Work Immersive Dialogue AI

Summary

Fine-tuned a roleplay-oriented LLM for immersive persona chats with context retention and scenario depth.

My Role

AI Engineer

Challenges

• Model lacked long-context awareness
• Client had no eval framework to measure quality
• Deployment infra was a monolithic Vertex setup

What We Did

• Fine-tuned LLM on custom dialogue data
• Created 100+ test samples across 10 metrics
• Dockerized model and decoupled infra

Outcomes

• Fine-tuned model outperformed baseline
• Added custom evaluation pipeline
• Shipped in 3 weeks