About this role

ABOUT THE ROLE This is a founding engineering role at an early-stage B2B SaaS pricing intelligence company, where you'll own the evaluation systems, feedback loops, and LLM infrastructure that connect model outputs directly to revenue and compliance outcomes. You'll join a small, product-focused team shipping to real customers — with meaningful influence over the technical direction of the AI platform from day one. WHAT YOU'LL DO - Build eval harnesses and benchmarks using tracked pricing outcomes as ground truth for model quality.

- Systematize and automate expert review workflows that are currently handled manually. - Develop AI personas that simulate B2B buying committees using usage data and call transcripts. - Automate persona training pipelines and reduce reliance on manual processes. - Own LLM routing across multiple providers with explicit cost, latency, and quality tradeoffs. - Maintain infrastructure and data residency boundaries (e.g., keeping EU model calls within the EU).

- Extend the MCP server used by LLM agents so that features are agent-driven, not just UI-rendered. - Work within a typed ontology of pricing entities to ensure model outputs are structured and auditable. - Identify and remediate systemic latency, data drift, and cold-start issues in the pricing loop. WHAT WE'RE LOOKING FOR - 8+ years of engineering experience with strong, recent production LLM depth. - Proven track record shipping and owning LLM-powered product features end-to-end — from development through production monitoring.

- Hands-on experience building eval harnesses and observability for LLM systems, including baselining prompts against a typed ontology for release gating. - Experience with MCP or building tools for LLM agents; familiarity with platforms such as LangChain, LlamaIndex, Braintrust, or OpenRouter is a plus. - Experience with structured data models and typed ontologies (e.g., Pydantic) to land model outputs in auditable, structured form.

- Background operating under data residency, SOC2, and GDPR constraints — ideally in pricing, billing, or payments domains where accuracy is audited. - Strong communication skills to explain non-deterministic systems to clients, pricing experts, and non-technical stakeholders. - Comfortable with ambiguity and high ownership in a lean, fast-moving startup environment. - Must be authorized to work in the United States; visa sponsorship is not available.

COMPENSATION & BENEFITS Salary range: $225,000 – $255,000 USD annually. Visa sponsorship is not available. LOCATION On-site in Amsterdam, Netherlands.

Source listing: ashby_clera