Members-Only
Recent Talks & Demos are for members only
You must be an AI Tinkerers active member to view these talks and demos.
Can Identity be fine-tuned with QLoRA for an AI Vtuber?
Step‑by‑step guide to building a real‑time AI VTuber using LLaMA‑3.2 3B fine‑tuned with QLoRA, covering dataset prep, prompt design, LoRA layers, quantization, and RTX‑3060 optimization.
Can Identity be fine-tuned with QLoRA for an AI Vtuber?
In this technical demonstration, I’ll walk you through the step-by-step creation a real-time interactive VTuber powered by a base LLM (LLaMA 3.2) 3B*, fine-tuned with QLoRA and the Unsloth framework. You’ll see firsthand how we went beyond typical “instruction-following” models to craft a uniquely creative and reflexive virtual personality.
I’ll share:
How we efficiently applied LoRA layers for lightweight, GPU-friendly fine-tuning.
Deep insights into dataset preparation, custom prompt engineering, and careful handling of conversational structure to create a convincingly human-like personality.
Technical challenges overcome, including managing VRAM constraints (on an RTX 3060) through quantization, CPU offloading, and careful gradient management.
Demonstrates LLaMA 3.2 fine-tuned for real-time, reflexive AI VTuber interaction.
Compose Email
Loading recent emails...