Senior Data Engineer – AI & Agentic Systems

What You Will Do

• Own technical workstreams. Design and deliver machine learning, Generative AI and agentic/autonomous AI systems from architecture through production.
• Architect scalable data platforms. Build robust batch and streaming pipelines that are tuned for modern AI workloads.
• Integrate GenAI and agentic frameworks into client solutions. This covers RAG pipelines, embeddings, vector databases, context construction, prompt design and output handling.
• Design MLOps/LLMOps architectures for model management, observability, automated evaluation and retraining.
• Lead feature engineering on complex workstreams so that data assets are reliable, reusable and ready for AI.
• Govern and secure data. Implement access controls, PII/PHI handling, authentication and RBAC across cloud environments.
• Make sound engineering trade-offs between quality, latency and cost. Apply evaluation, reliability and guardrail practices to AI features.
• Mentor and raise the bar. Coach junior engineers and drive software engineering best practices across the team.
• Partner with clients and stakeholders. Turn business problems into technical solutions and help build client capabilities.

Must have

• A degree in Computer Science or Engineering, or equivalent experience
• 5+ years in data engineering, including leading technical workstreams and mentoring engineers
• Expert-level Python and SQL, plus comfort with Scala or Java when client systems need them
• Hands-on experience building Agentic AI, GenAI, ML and BI systems in production with frameworks such as Spark, Databricks, LangChain, Dask, Airflow, Dagster or Kedro
• Practical knowledge of RAG, embeddings, vector databases and prompt and context engineering
• Strong MLOps/LLMOps skills:
  • CI/CD for data workflows
  • Automated agent evaluation (LangSmith, Langfuse, Opik)
  • Infrastructure as code (Terraform)
• Experience on at least one major cloud (AWS, Azure or GCP); multi-cloud is a plus
• Proven experience with data security and governance (PII/PHI, authentication, RBAC)
• The ability to own workstreams on your own, with excellent time management
• Clear, confident written and verbal communication in English