- Company Name
- UBDS Digital
- Job Title
- AWS Data Platform Engineer
- Job Description
-
**Job Title:** AWS Data Platform Engineer
**Role Summary:**
Design, implement, and optimize AWS‑native data services and associated CI/CD pipelines. Automate infrastructure using Terraform, orchestrate workflows with Apache Airflow, and ensure secure, reliable large‑scale data operations in a cross‑functional environment.
**Expectations:**
- Active UK Security Clearance (SC).
- Proven hands‑on experience with AWS data services and IaC.
- Ability to work autonomously and collaboratively in Agile teams.
- Strong problem‑solving, stakeholder management, and communication skills.
**Key Responsibilities:**
- Provision, configure, and maintain S3, Redshift, OpenSearch, Athena, Lambda, Glue, Batch, Step Functions, SQS, CloudWatch, CloudTrail, and EMR.
- Develop and manage infrastructure as code with Terraform.
- Build and monitor Airflow DAGs for data workflow orchestration.
- Implement CI/CD pipelines using GitLab (YAML) and support version control.
- Monitor security, access patterns, RBAC, and data ingress/egress; enforce AWS security best practices.
- Design and maintain disaster recovery, backup, and snapshot strategies.
- Collaborate with Data Engineering, SRE, and Security teams to ensure robust data operations.
- Troubleshoot and resolve incidents affecting data infrastructure.
- Produce and maintain documentation (Confluence, README).
**Required Skills:**
- AWS native data services (S3, Redshift, OpenSearch, Athena, Lambda, Glue, Batch, Step Functions, SQS, CloudWatch, CloudTrail, EMR).
- Terraform for IaC.
- Apache Airflow for workflow orchestration.
- YAML‑based CI/CD (GitLab CI/CD, GitHub Actions).
- Scripting/automation: Python, SQL, Bash.
- AWS security fundamentals: IAM policies, RBAC, VPC networking.
- Docker containerisation.
- Disaster recovery, backup, and snapshot management.
- Agile methodology and stakeholder communication.
**Required Education & Certifications:**
- Bachelor’s degree in Computer Science, Information Technology, Engineering, or a related field (or equivalent practical experience).
- Active Security Clearance (SC).
- Preferred: AWS Certified Solutions Architect – Associate/Professional or AWS Certified Data Analytics – Specialty (not mandatory).