- Company Name
- Holland & Barrett
- Job Title
- LLM Data Scientist
- Job Description
-
Job title:
LLM Data Scientist
Role Summary:
Design, evaluate, and deploy large language model (LLM) solutions that drive product page content, SEO, personalized recommendations, and health content generation.
Expactations:
- Build production‑ready LLM applications, including prompt engineering, RAG, and vector‑store integration.
- Develop and maintain evaluation frameworks for quality, safety, relevance, latency, and cost.
- Monitor model performance, mitigate drift and degradation, and iterate on improvements.
- Act as the go‑to LLM expert across teams, translating technical insights into business value.
Key Responsibilities:
- Design, test, and optimize prompts and prompt‑chains for live customer‑facing products.
- Create evaluation metrics and frameworks to assess LLM output across multiple dimensions.
- Implement RAG architectures, embeddings, and vector databases for retrieval accuracy.
- Own the SEO content‑optimisation tool, enhancing product page copy for discoverability.
- Power personalized recommendations and messaging within the Personalisation squad.
- Generate, rewrite, and improve wellness content with evidence‑based safety.
- Collaborate with Data Engineering on context management, memory strategies, tool/function‑calling, and observability.
- Monitor model drift, prompt degradation, and system regressions; execute mitigation actions.
- Translate new LLM research into actionable, business‑relevant solutions.
Required Skills:
- Hands‑on experience building and deploying LLM applications beyond prompt writing.
- Strong data‑science foundation: experimentation, statistical analysis, and working with real‑world datasets.
- Deep knowledge of prompt optimisation, RAG, embeddings, vector stores, context management, and LLM evaluation.
- Proficient in Python; comfortable with coding, Git, version control, and CI/CD pipelines.
- Ability to balance quality, latency, and cost trade‑offs.
- Excellent communication skills for explaining complex LLM concepts to non‑technical stakeholders.
- Curious, pragmatic mindset with a desire to shape pioneering LLM roles.
Required Education & Certifications:
- Bachelor’s degree in Computer Science, Data Science, Artificial Intelligence, or related field (advanced degrees preferred).
- No mandatory certifications; relevant technical certifications (e.g., Python, ML engineering) are a plus.