- Company Name
- Amyantek
- Job Title
- Senior Data Engineer
- Job Description
-
**Job Title**
Senior Data Engineer
**Role Summary**
Design, build, and maintain scalable data pipelines and analytics infrastructure that powers a high‑volume retail media platform. Deliver reliable, high‑velocity data solutions for internal and external users to create, manage, and report on advertising campaigns, ensuring data integrity and performance at scale.
**Expectations**
- Minimum 3 years of hands‑on data engineering experience.
- Strong programming in Python, Scala, or Java.
- Proficiency with cloud data platforms (preferred GCP; AWS or Azure acceptable).
- Experience with BigQuery, Bigtable, Druid, DataProc, DBT, Airflow, or equivalent tooling.
- Advanced SQL and data‑modeling expertise.
- Familiarity with data governance, quality, and security best practices.
**Key Responsibilities**
- Design and develop scalable ETL/ELT pipelines for the Retail Media Platform.
- Build and manage data models, semantic layers, and reporting structures for self‑serve analytics.
- Develop and optimise real‑time streaming pipelines and dashboards for campaign performance.
- Collaborate with product, marketing, operations, and analytics stakeholders to capture requirements and deliver data solutions.
- Implement testing, validation, and monitoring to ensure data accuracy, completeness, and reliability.
- Optimize pipeline performance and SQL queries to handle large‑scale, high‑velocity datasets.
- Provide ad‑hoc reporting and insights to support data‑driven decision‑making.
- Stay abreast of industry trends and emerging technologies in data engineering, analytics, and ad tech.
**Required Skills**
- Data engineering expertise (ETL/ELT, pipeline orchestration, data modeling).
- Proficiency in Python, Scala, or Java.
- Cloud platform experience: GCP (BigQuery, Bigtable, Druid, DataProc) with knowledge of alternative clouds (AWS, Azure).
- Tooling: DBT, Airflow, or equivalent.
- Advanced SQL (complex query writing, performance tuning).
- Real‑time data processing and streaming concepts.
- Git, CI/CD, and collaborative development workflows.
- Understanding of data governance, data quality, and warehousing principles.
**Preferred Skills**
- AdTech or retail media platform experience.
- Real‑time bidding and high‑volume ad‑serving knowledge.
- Event‑driven architecture and real‑time analytics exposure.
- Experience with ML pipelines or integrating ML insights into reporting.
**Required Education & Certifications**
- Bachelor’s degree (or higher) in Computer Science, Data Engineering, Information Systems, or a related technical field, or equivalent professional experience.
- Relevant certifications: Google Cloud Certified – Professional Data Engineer, AWS Big Data Specialty, Azure Data Engineer Associate (preferred).