Website Vallum Associates
No goal is too big or too small, whether you're a startup founder or a candidate ready for your next big role, we're here to support you. We aim to make your journey—whatever change you're navigating—exciting and stress-free.
Artificial Intelligence / LLM Solutions Lead – Energy Company – Contract role
The AI / LLM Solutions Lead will design, build, and operationalise AI capabilities within a major energy company’s Data team. The role focuses on delivering an LLM-based Sales Call Quality Assurance (QA) solution, creating a repeatable AI architecture, and uplifting team capability.
- Contract role – 3 months rolling
- Largely remote
- Outside IR35
Key Responsibilities
- Evaluate LLM model options and recommend a preferred approach.
- Tune models and optimise prompts to improve accuracy.
- Implement continuous monitoring for performance, drift, and cost, with alerting integrated into existing tools.
- Lead deployment and integration of models into production.
- Design a scalable, repeatable architecture for multiple AI use cases.
- Ensure the design supports the Sales QA solution, minimises technical debt, and adapts to future needs.
- Provide model-strategy recommendations (e.g., one large model vs multiple smaller models with triage).
- Bring external best practices into the Data AI function.
- Enable team members to replicate the development approach for future LLM use cases.
Must have experience in the following:
- Hands-on experience building and deploying LLM or generative AI solutions in production.
- Strong understanding of model selection, fine-tuning, prompt engineering, and evaluation methods.
- Python, SQL, dbt, Airflow
- Understand how to frame prompts, evaluate outputs of LLMs, manage prompts with LangChain
- Platforms: Snowflake Cortex, AWS Bedrock
- Evaluate costs / performance advantages of models on Bedrock vs Snowflake, the size of the model, fine-tune smaller models
- Create logic for summarising calls transcripts, validate QA checklist
- Build evaluation framework
- Integrate LLM API to process text at scale via Snowflake Cortex or AWS Bedrock
- Build APIs on AWS to connect to other systems (slack, excel, kraken)
- Implement data security and governance practices to work with PII data
If this sounds like an opportunity you are interested in, apply now for an immediate review!