Vacaturebank.ai

Werkvorm

Dienstverband

Bedrijf

Salarisrange

GeekSoft Consulting logo
GeekSoft Consulting5 dagen geleden

AI Engineer - GenAI & Customer Service

AI Training & Evaluatie
Voltijd
Hybride
Utrecht
Online t/m 7 nov. 2026

Functieomschrijving

  • Help design, build and continuously improve the clients online platform.

  • Research, suggest and implement new technology solutions following best practices/standards.

  • Take responsibility for the resiliency and availability of different products.

  • Be a productive member of the team.



Requirements

  • AI Data & Evaluation Engineer to work within a Scrum team, preparing, structuring, enriching, and validating enterprise data for AI knowledge bases and AI chatbots.

  • Build and maintain Databricks data pipelines to process structured and unstructured data for AI knowledge bases.

  • Prepare, clean, transform, and enrich source data to improve the quality and reliability of information used by AI assistants.

  • Develop and maintain evaluation datasets covering realistic conversations, complex scenarios, edge cases, and multi-step workflows.

  • Apply evaluation frameworks to test advanced chatbots across single-turn, multi-turn, simulation-based, and agentic scenarios.

  • Implement automated testing, monitoring, and quality gates for changes to data, prompts, models, retrieval, and orchestration.

  • Deploy and manage cloud infrastructure using Infrastructure as Code, particularly Azure Bicep and CI/CD pipelines.

  • Analyze evaluation results and translate findings into improvements across knowledge, retrieval, prompts, tools, and application logic.

  • Strong proficiency in Python, data engineering, and automated testing.

  • Hands-on experience with Azure, Databricks, DevOps, CI/CD, and Infrastructure as Code, preferably Bicep.

  • Experience building data pipelines and preparing structured and unstructured enterprise data for AI knowledge bases and RAG applications.

  • Experience with chatbot evaluation, including multi-turn, simulated, and agentic interactions.

  • Familiarity with Context Engineering, Agentic AI, Function Calling, retrieval strategies, and tool use.

  • Strong engineering and data-quality mindset with an affinity for Agile development.

  • Strong critical thinking, ownership, accountability, and problem-solving skills.

  • Excellent communication skills and a customer-focused approach.

  • Relevant HBO or university degree and fluency in English.





Benefits

  • A challenging, innovating environment.

  • Opportunities for learning where needed.

Weet u niet zeker wat een AI-term betekent? Bekijk onze AI-begrippenlijst →

Wij gebruiken noodzakelijke cookies voor Vacaturebank.ai en, met uw toestemming, analytische cookies om het platform te verbeteren. U kunt uw keuze altijd wijzigen via Cookies onderaan de pagina. Zie ons Privacybeleid.