WaifuMaker - Refactored Architecture

Settings

Model Info

No model selected

Select Model

Click if model is facing away from camera

Model Control

Control Mode:

Mouse: rotate camera | Arrow keys: move camera | Model+Environment: move together

Movement Speed: 2.0x

Rotation Speed: 1.0x

Model Scale: 2.0x

Animation Library

Click an animation to play it

Selected Animations

No animations selected

Environment Settings

Environment Selection

Choose Environment:

Environment Controls

Visibility: 100%

Rotation Y: 0°

Scale: 1.0x

Lightmap Settings

Choose Lightmap:

Lightmap Intensity: 1.0x

Enable Lightmap:

Environment Status

Current Environment: None

Loading Status: Ready

File Path: -

Current Lightmap: None

Lightmap Status: Ready

Environment Actions

Movement Controls

Please click below to change mode

Mouse: rotate camera | Arrow keys: move camera | Model+Environment: move together

Control Modes:

Unified Mode: Camera and model move together. Best for general use.
Lateral Movement: Move model on floor while camera stays fixed.
Rotation Mode: Rotate model and move vertically.
🎮 Unified Mode: Camera and model move together. Best for general use.
🏃 Lateral Movement: Move model on floor while camera stays fixed.
🔄 Rotation Mode: Rotate model and move vertically.

Voice Selection

Voice System Selection

Chat System Toggle

Choose your chat system:

Active System: Mistral + ElevenLabs

Personality Source: Built-in Energy Mirroring

Language: English | Visemes: Gentle Forced Alignment

VOICEVOX Settings

Voice Testing

Status: Initializing...

Selected Voice: None

Available Voices: 0

VOICEVOX Controls

AI Model Settings

AI Model:

Currently using: Mistral Medium

System Info: This system uses the selected AI model for chat responses and ElevenLabs for high-quality voice synthesis with Gentle forced alignment visemes.

Speech-to-Text (Input)

Google Speech API:

Status: Google Speech API Key Required

Text-to-Speech (Output)

ElevenLabs TTS:

ElevenLabs Voice:

Status: Loading API key from .env...

Voice Testing

Viseme start delay (ms) 30 ms Align visemes to audio start (experimental)

🎯 Precise Sync System

Sync Precision

Max Drift (ms) 50 ms

Ready for synchronization

🔍 Timing Debug Interface

                  Waiting for audio/viseme data...
                

Viseme Offset (ms) 0 ms

Sync Method:

Google STT: Disabled

ElevenLabs TTS: Disabled

Selected Voice: Voice 1

System Controls

Viseme Testing

Test Visemes Only (No Voice)

Phoneme System: Simple text-based (Gentle forced alignment used for audio sync)

Quick Test:

Status: Ready

Generated Visemes: 0

Current Viseme: None

Test Duration: 0.0s

Viseme Settings

Viseme Intensity: 1.0

Audio Sync Mode: Sync visemes with actual audio timing

Test Speed Multiplier: 1.0x

Visemes will be generated from text for speech animation

VOICEVOX System Personality

📌 Note: This personality system is used by the VOICEVOX System only. The Mistral + ElevenLabs System has its own separate personality managed internally by the Mistral AI.

Quick Character Selection

Examples: "Tsunade from Naruto", "Yor Forger from Spy x Family", "Asuka from Evangelion", "Raphtalia from Shield Hero"

Current Character

Name: Sarah

Type: Custom

Last Modified: Default

Character Data Editor

Name:

Description:

Personality:

First Message:

Message Example:

Scenario:

Creator Notes:

Quick Presets

Personality Controls

VOICEVOX System Status

Server Status: Unknown

Last Action: None

Character Modified: No

Mistral + ElevenLabs System

🤖 AI System: Mistral AI (Energy Mirroring)

🎤 Voice: ElevenLabs TTS

🎭 Visemes: Gentle Forced Alignment (AIUEO)

🧠 Personality: Built-in energy mirroring system

💬 Language: English

Note: The Mistral system has its own internal personality that adapts to your conversation style. It uses energy mirroring to match your tone and energy level.

Facial Expressions

Save/Load Controls

State Management

Save/Load settings and state

Display Format

Toggle between desktop and mobile layouts

Debug Information

Development Mode

Toggle between User Mode and Developer Mode. Developer Mode shows advanced controls and debug information.

Developer Mode Active

Shortcut: Ctrl + Shift + D

Model Scanning Status

Initializing...

Available Models

Console Logs

Chat History Test

Add test messages to chat history without TTS/voice processing

Assistant Message:

Current history: 0 messages

Viseme Timing Modes

Audio Sync: Audio Sync

VOICEVOX Timing: Text-based

Viseme Intensity: 1.0

Custom Expressions

Camera Controls

Camera Speed: 1.0

Dynamic Target: Keep target in front of camera

Target Distance: 3.0

WASD: Move on floor | Arrow Keys: Vertical/Strafe | Mouse: Rotate | Scroll: Zoom

Loading WaifuMaker...

Loading Model...

Chat History

Settings

Model Info

Select Model

Model Control

Animation Library

Selected Animations

Environment Settings

Environment Selection

Environment Controls

Lightmap Settings

Environment Status

Environment Actions

Movement Controls

Voice Selection

Voice System Selection

Chat System Toggle

VOICEVOX Settings

Voice Testing

VOICEVOX Controls

AI Model Settings

Speech-to-Text (Input)

Text-to-Speech (Output)

Voice Testing

🎯 Precise Sync System

🔍 Timing Debug Interface

System Controls

Viseme Testing

Test Visemes Only (No Voice)

Viseme Settings

VOICEVOX System Personality

Quick Character Selection

Current Character

Character Data Editor

Quick Presets

Personality Controls

VOICEVOX System Status

Mistral + ElevenLabs System

Facial Expressions

Save/Load Controls

State Management

Display Format

Debug Information

Development Mode

Model Scanning Status

Available Models

Console Logs

Chat History Test

Viseme Timing Modes

Custom Expressions

Camera Controls

Advanced Controls