← All workExperience · Microsoft · April 2021 – 2026
From product engineering to the quality of AI systems.
I joined Microsoft in April 2021. My work moved from product engineering, through AI-powered product experiences, to measuring the quality of AI responses and tuning agents with expert know-how.
Chapter 02 · Late 2023 – 2026
AI-Powered Product Experiences
My work moved from conventional product engineering to AI-powered experiences: first features that summarise and surface information in existing products, then experiences built on agent workflows. The client now had to request work, follow its state, stream results and fail clearly. Not all of these experiences were released publicly.
Copilot in Outlook · Catch-up experiences in Microsoft 365 Copilot · A daily-briefing agent
Chapter 03 · Primarily 2025 – 2026
AI Quality, Evaluation and Reliability
Measuring whether AI-generated responses are good, finding out why they fall short, and making the sources behind them reliable. Two different problems, each with its own case study.
Researcher and Copilot Citations in Microsoft 365 Copilot
Key contributions
- Developed the claim density metric, building on ideas shared with a research colleague, and built a temporal relevance metric, both integrated into offline evaluation.
- Led regular baseline runs to separate real changes from noise.
- Investigated context and grounding failures, and implemented a change to preserve context between workflow stages.
- Investigated why citation markers leaked and shipped detection for them, helped move citation grouping into the service, and made citation problems measurable without collecting user content.
01 ProfessionalResearcher: Measuring and Improving AI Response Quality
Researcher produces grounded reports in Microsoft 365 Copilot. I built evaluation metrics, ran offline baselines and experiments, and investigated why responses lose context or fall short.
02 ProfessionalCopilot Citations: Improving Response Reliability
Citations let people check where an AI answer came from. I investigated why citation markers leaked and shipped detection for them, helped move citation grouping into the service, and made citation problems measurable without collecting user content.
Chapter 04 · 2026
Microsoft 365 Copilot Tuning
Helping subject-matter experts capture how they work and turn that knowledge into reusable agent playbooks, instructions and quality checks. I owned the skill-suggestion experience.
Workflow discovery and skill suggestions
Internal systems, customer information and unpublished figures are left out for confidentiality.