AI Engineer - LLM Infrastructure & Agentic AI

About the role

A company is hiring a skilled AI Engineer in Nairobi, Kenya, to build production-grade AI systems using open-source technologies. The role covers LLM deployment, GPU infrastructure, RAG pipelines and agentic AI systems. It is a full-time, on-site or hybrid position open to junior to mid-level candidates.

Key responsibilities

• Deploy and optimise open-source LLMs using Ollama and llama.cpp.
• Build and maintain RAG pipelines using LangChain and LlamaIndex.
• Work with vector databases such as ChromaDB and FAISS.
• Develop and integrate multi-agent AI systems.
• Manage AI workloads on Kubernetes and Docker.
• Monitor and optimise GPU performance and inference efficiency.
• Explore and integrate emerging open-source AI technologies.

Required profile

• Strong Python programming skills.
• Hands-on experience with open-source LLM deployment.
• Good technical communication skills.

Required skills

• Understanding of LLM quantisation formats such as GGUF, GPTQ and AWQ.
• Experience with RAG frameworks and vector databases.
• Knowledge of Kubernetes, Docker and Linux.
• Basic understanding of NVIDIA CUDA and GPU infrastructure.