Senior MLOps/LLMOps Engineer

Our Mission
Ivy Partners is a Swiss consulting firm that helps companies navigate strategic, technological, and organizational challenges.
We are committed to providing our employees with a career that supports both their personal and professional growth. We guide them in skill development and offer genuine opportunities for advancement.

As a Senior ML Ops / LLM Ops Engineer at Ivy Partners, you will be responsible for:
- Designing and implementing ingestion pipelines for ML/LLM traffic in production
- Constructing mechanisms for PII redaction and classifying safety/abuse
- Setting architecture of storage, retention policies, and data governance
- Implementing dashboards and query layers for operational debugging
- Developing workflows for eval mining and regression detection
- Integrating autoraters and LLM-as-judge pipelines
- Building automatic triage mechanisms for failure detection
- Ensuring the reliability, observability, and access control of the platform
- Supporting scalable onboarding of multiple tenants
- Making decisions on tooling and hosting (self-hosted vs managed SaaS)

About You
You are our ideal candidate if you:
- Have extensive hands-on experience in ML Ops / Data Platform Engineering
- Have proven experience with LLM systems in production
- Possess a strong background in observability, tracing, and evaluation systems
- Have excellent command of production-grade Python
- Are knowledgeable in governance, PII handling, and regulated environments
- Have experience with Azure and/or AWS
- Are familiar with vector databases, eval pipelines, and failure analysis
- Exhibit a pragmatic mindset and technical ownership from end-to-end
- Are capable of operating critical systems with a focus on reliability
- Have experience in multi-tenant SaaS environments
- Have knowledge of SQL and TypeScript for dashboards
- Have interest in modern AI tooling (Claude, OpenAI, GitHub, etc.).

Why Join Ivy Partners?
Care | We care about our employees by creating a supportive environment where everyone is valued and empowered with training and growth prospects.
Trust | We believe in building strong and long-lasting relationships with our clients. Working with us is about establishing a partnership based on trust, professionalism, and transparency at all times.
Innovation | We empower effective digital transformation through a unique blend of innovative technology and creative thinking.
Responsibility | Community is at the heart of everything we do, and we take that responsibility seriously by working hard to create a positive impact.