- Company Name
- Vortexa
- Job Title
- Software Engineer- Python
- Job Description
-
Job Title: Software Engineer – Python
Role Summary: Build and maintain high‑performance, scalable data pipelines and micro‑service components that ingest, process, and serve terabyte‑scale satellite and market data in real time. Design, deploy, and monitor distributed systems leveraging AWS, Kafka, and big‑data frameworks, ensuring 100% uptime and fault tolerance. Collaborate with data scientists and analysts to transition ML models into production, adhering to SDLC best practices.
Expactations:
- Fluent in Python and core software engineering principles.
- Expertise in distributed systems, micro‑services, and large‑scale data processing.
- Proactive in a fast‑pacing startup environment; self‑motivated and collaborative.
- Experienced with end‑to‑end SDLC: design, coding standards, review, CI/CD, testing, and operations.
- Strong communication and mentoring skills to coach junior developers.
Key Responsibilities:
- Design, implement, and optimize data ingestion pipelines handling multi‑terabyte daily volumes.
- Develop and maintain micro‑service APIs and background workers using Python.
- Integrate and deploy ML research projects into production as reliable services.
- Configure and monitor AWS services, Kafka clusters, and Kubernetes orchestration.
- Ensure data quality through automated benchmarking and monitoring tools.
- Participate in architecture reviews, code reviews, and performance tuning.
- Mentor team members and facilitate knowledge sharing.
Required Skills:
- Advanced Python (asyncio, multiprocessing, data libraries).
- Distributed systems expertise: Kafka, Kafka Streams, Apache Beam, Flink, Spark.
- Cloud: AWS (S3, EMR, Lambda, ECS/EKS, CloudWatch), Kubernetes.
- Workflow orchestration: Airflow or equivalent.
- Data formats: Parquet, ORC, Athena, Glue.
- Optional: Rust, Java, Kotlin; Apache Flink, Kinesis.
- Familiarity with ML model serving and monitoring.
Required Education & Certifications:
- Bachelor’s or higher in Computer Science, Software Engineering, or related field (or equivalent professional experience).
- AWS Certified Solutions Architect, DevOps Engineer, or Kafka Confluent Certified Developer (preferred).