- Company Name
- Gorilla - Energy data applications
- Job Title
- Lead Data Platform Engineer
- Job Description
-
**Job Title**: Lead Data Platform Engineer
**Role Summary**:
Lead the architecture, strategy, and scaling of a high‑performance, secure, and scalable data platform for data‑intensive SaaS workloads. Drive cross‑functional initiatives, mentor engineering teams, and ensure operational excellence across cloud‑native infrastructure.
**Expectations**:
- Proven leadership in designing, building, and scaling data platforms or backend infrastructure.
- Deep expertise in Python, AWS, Terraform, container orchestration, and modern data tools.
- Ability to influence technical strategy, align stakeholders, and mentor a distributed team.
**Key Responsibilities**:
1. Define the technical vision and strategy for the internal data platform, shaping architecture and best practices.
2. Design, implement, and evolve platform services (data ingestion, storage, pipelines) using Terraform, Docker, CI/CD, and workflow orchestration tools.
3. Scale services for high load and complex data workloads, ensuring performance, security, and reliability.
4. Mentor and coach engineering staff, elevating technical capabilities and best practices.
5. Automate infrastructure, enforce observability, and lead incident response and root‑cause analysis.
6. Evaluate and adopt emerging technologies (e.g., container orchestration, data lake solutions) to meet evolving business needs.
7. Collaborate with data engineering, backend, DevOps, and product teams to identify gaps and deliver scalable solutions that unlock product innovation.
8. Ensure compliance with data governance and security standards in regulated environments.
**Required Skills**:
- Strong Python programming and solid software engineering fundamentals.
- Expertise with AWS services (Lambda, ECS/EC2, S3, RDS, IAM).
- Deep experience with Terraform and infrastructure‑as‑code practices.
- Familiarity with Airflow, DBT, Snowflake, Databricks, and other data orchestration/processing tools.
- Proficiency in CI/CD pipelines, observability, and platform reliability in cloud‑native settings.
- Container orchestration with Kubernetes in cloud or hybrid environments.
- Understanding of distributed computing concepts, scale, security, and high availability.
- Excellent communication, stakeholder alignment, and mentoring abilities.
**Required Education & Certifications**:
- Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field.
- Preferred certifications: AWS Certified Solutions Architect, Certified Kubernetes Administrator, Terraform Associate, or equivalent.