- Company Name
- York Solutions, LLC
- Job Title
- Machine Learning Engineer
- Job Description
-
Job title: Backend Engineer – Secrets Portal
Role Summary: Design, build, and maintain a high‑throughput Go‑based detection platform that processes YARA/YARA‑X rules, manages secrets via Vault/KMS, and orchestrates asynchronous workflows. Deliver scalable, secure, and reliable backend services that support real‑time threat detection and data processing at enterprise scale.
Expactations: Deliver production‑ready Go services with robust testing, CI/CD pipelines, and observability. Maintain low latency and high throughput across Kafka‑based pipelines. Design secure key‑management flows and harden secret‑usage patterns. Own database schema evolution and query optimization. Collaborate cross‑functionally with security, data engineering, and product teams to implement new features and troubleshoot complex issues.
Key Responsibilities
- Extend and maintain the core detection platform (YARA/YARA‑X rule processors, event producers, APIs).
- Own the design, deployment, and hardening of Vault‑backed secrets flows and KMS encryption proxies.
- Implement and tune Postgres migrations, indexing, and query performance; integrate Solr/Lucene search as needed.
- Ensure reliability of high‑throughput pipelines (Kafka/Benthos) by implementing idempotency, back‑pressure, and instrumentation.
- Improve test coverage (unit, integration, golden tests) and refine CI/CD with golangci‑lint and Docker optimizations.
- Provide observability using OpenTelemetry, tracing, and metrics; troubleshoot outages and performance bottlenecks.
- Mentor peers on secure coding, Go best practices, and architecture decisions.
Required Skills
- 5+ years software development; 4+ years production Go.
- 2+ years Vault integration and KMS key‑management experience.
- Practical YARA/YARA‑X (or equivalent pattern engine) usage; familiarity with string‑search algorithms.
- 3+ years Postgres schema design, migrations, and tuning.
- Kafka (or similar) stream‑processing expertise; comfort with Benthos or equivalent.
- Docker/Docker‑Compose, Dockerfile optimization, Makefile‑driven workflows.
- Basic OpenTelemetry, distributed tracing, metrics.
- Strong testing mindset (unit, integration, golden tests) and CI/CD literacy.
- Excellent problem‑solving, communication, and Agile collaboration skills.
Required Education & Certifications
- Bachelor’s degree in Computer Science, Engineering, or related field.
- Optional certifications: Go Certified Engineer, HashiCorp Certified: Vault Associate, or relevant cloud security credentials.
Minneapolis, United states
Hybrid
Mid level
05-02-2026