Senior AI Engineer

via Mediro ICT · Johannesburg, Gauteng

About the role

Our client in Waterfall City is recruiting for a Senior AI Engineer to join their team.

Translate clinical reporting needs into the datapoints each report requires, and build them as governed tables in Databricks.
Design the prompts, templates and orchestration that generate structured, narrative reports from those datapoints.
Build retrieval over clinical guidelines and policy documents where reports depend on them.
Put guardrails in place so every statement is grounded in source data and patient data stays protected.
Build evaluation with clinicians: test sets, automated scoring and regression checks.
Take the solution into production with monitoring, an audit trail and cost control.
Demo progress to clinical stakeholders every sprint and turn their feedback into improvements.

Skills and experience

Must have:

Experience in ML or AI engineering, including at least one LLM solution delivered into production use.
Strong Databricks: Unity Catalog, Delta, Workflows, MLflow, Mosaic AI Model Serving and Vector Search.
Python, PySpark and SQL to production standard.
Prompt engineering and orchestration (LangChain, LangGraph, DSPy or equivalent), including structured output generation.
Retrieval-augmented generation design, tuning and evaluation.
LLM evaluation methods: golden datasets, groundedness scoring, LLM-as-judge, regression testing.
Guardrails, hallucination controls and handling of sensitive personal data.

Strongly preferred:

Healthcare data experience: admissions, clinical coding (ICD-10), case management or funder interactions.
Working knowledge of POPIA and health data governance in South Africa.
Azure experience, including Azure OpenAI, Key Vault and private networking.
Databricks Generative AI Engineer or Machine Learning Professional certification.