Hiring Now: AI Engineer Near You – Apply Today!
Your Next AI Engineer Job Starts Here – Apply Now!
AI Engineer
Job Posted: 9 days ago
Salary: £ 75,000 - 80,000 / Annum
Job Type: Permanent
Location: London
Expire in: 19 days
Job Description
AI Engineer - Defence RAG Systems ( Security Clearance Essential ) On Site 2 X Days a week, Plymouth
Clearance: Active SC Essential | Sector: Defence
Role Overview
Defence client requires an SC Cleared AI Engineer to build fully on-premises RAG systems using open-source technologies. You'll develop classified AI capabilities on air-gapped infrastructure with zero external dependencies.
Key Responsibilities
- Build end-to-end RAG pipelines on isolated defence networks using open-source LLMs (Llama 3, Mistral, Qwen)
- Deploy local vector stores (Chroma, FAISS, Milvus) with sensitive document ingestion pipelines
- Host and optimise LLMs using vLLM/TGI on local GPU clusters without internet connectivity
- Implement agent orchestration using LangChain/LangGraph in completely offline environments
- Design secure document processing for classified materials with appropriate data sanitisation
- Build monitoring and evaluation systems that operate within air-gapped infrastructure
Essential Requirements
- Active SC Clearance (non-negotiable) - willingness to undergo DV if required
- Demonstrable experience deploying open-source LLMs (Llama, Mistral, Falcon) on-premises
- Expertise with local vector databases (Chroma, FAISS, Weaviate) in offline deployments
- Strong vLLM/Text Generation Inference experience for high-throughput model serving
- Proven ability to work on air-gapped systems with no external package repositories
- Experience with GPU orchestration (NVIDIA A100/H100) and CUDA optimisation
- Python expertise with offline dependency management and local package mirrors
Technical Stack (All On-Premises)
Models: Llama 3, Mistral, Qwen (locally hosted)
Vector Stores: Chroma, FAISS, Milvus
Orchestration: LangChain, LangGraph for agents
Hosting: vLLM, TGI, Ollama on bare metal/private cloud
Infrastructure: Air-gapped Kubernetes, local container registries
Desirable Skills
- Experience with defence/government IT security protocols
- Knowledge of CIS benchmarks and NCSC guidelines
- Familiarity with cross-domain solutions and data diodes
- Understanding of classification marking and handling proceduresBefore You Apply
Do not include the following in your job application, CV, or cover letter:
- Bank details.
- National Insurance number.
- Date of birth.
You should not be asked for payment or irrelevant information. If you have concerns about a job advert or employer, seek guidance on how to proceed.
Looking for your next career move? Join a top company hiring AI Engineer job near me in London! This is your chance to work on exciting projects, grow professionally, and enjoy a rewarding career with competitive pay and excellent benefits. Whether you're an experienced professional or looking to take the next step, this role offers the perfect opportunity to enhance your skills and make an impact. Don’t miss out—apply today via Vita CV and take your career to the next level!
© Vita CV: Registered in England and Wales (16187919).