Emerge in numbers
- 12 years on the market
- 3 Continents
- 100 people onboard
- 90 % + Senior level
- 50 Million transactions daily for mobile wallet
We seek a skilled and highly motivated Data Engineer with a strong background in building and optimizing data pipelines, managing large datasets, and leveraging Google BigQuery for analytic and operational data. As a Data Engineer, you will work closely with data scientists, business analysts, software engineers and other stakeholders to ensure that data is efficiently collected, processed, and accessible for data consumers. This role requires expertise in cloud-based data solutions, particularly Google Cloud Platform (GCP), and a strong understanding of data warehousing and ETL processes.
Key Responsibilities:
- Design, implement, and manage scalable data pipelines using Google BigQuery to support data-driven decision-making.
- Collaborate with software engineers, data scientists, analysts, and business stakeholders to gather data requirements and translate them into technical solutions.
- Optimize queries, data storage, and performance of BigQuery to ensure low latency and cost-efficient data operations.
- Build and maintain ETL (Extract, Transform, Load) processes to streamline data flow from source systems into BigQuery.
- Work with cloud services (Google Cloud Storage, Dataform, and Kafka) for data ingestion, transformation, and processing.
- Design and implement data models and schemas to ensure consistency and efficiency in data storage.
- Monitor and troubleshoot data pipelines, ensuring data quality, integrity, and availability.
- Develop and maintain automated data processing workflows and scheduled jobs using tools like Google Workflows.
- Apply best practices for data security, privacy, and governance, ensuring compliance with organizational and regulatory standards.
- Stay up to date with new BigQuery features and GCP tools, recommending improvements and innovations to optimize performance.
Required Skills and Qualifications:
Experience: 3+ years of experience in data engineering, with a strong focus on Google BigQuery and cloud-based data solutions.
Technical Skills:
- Expertise in Google BigQuery for data querying, management, and optimization.
- Strong proficiency in SQL and query optimization techniques for large datasets.
- Experience with Google Cloud Platform (GCP) services such as Google Cloud Storage, Dataform, BigTable, Workflow, and Spanner.
- Knowledge of ETL frameworks, data modeling, and data warehousing principles.
- Familiarity with scripting languages such as Python, Bash, or JavaScript for automating data workflows.
- Understanding of Google Workflow or other orchestration tools for scheduling data tasks.
- Experience with version control (Git) and collaborative development practices.
Soft Skills:
- Strong problem-solving abilities and attention to detail.
- Excellent communication skills for collaborating with cross-functional teams.
- Ability to work independently and manage multiple projects simultaneously.
- Continuous learning mindset to stay updated with the latest tools, trends, and technologies in the data engineering space.
Preferred Qualifications:
- Familiarity with data visualization tools like Tableau.
- Experience in data governance and ensuring data privacy and security compliance.
- Knowledge of machine learning concepts and how they integrate with data pipelines.
- Familiarity with DevOps practices for automated deployment and CI/CD pipelines.
- Experience working in an Agile or Scrum development environment.
Nice to haves:
- Experience from the iGaming industry is meriting