9fde3d31ba
## Performance Optimizations (3-10x faster responses) - STT beam_size reduced to 1 (3-5x faster transcription, minimal quality loss) - Smart query routing: Haiku (simple) → Sonnet (medium) → Opus (complex) - TTS cache for common phrases (27 pre-generated responses) - Sentence-level streaming TTS (start playing while generating) - Sample-based VAD timing (30x improvement in silence detection) ## TTS Engine Upgrade - Migrated from Chatterbox to Chatterbox-Turbo - Zero-shot voice cloning (no fine-tuning required) - Native paralinguistic tag support ([laugh], [sigh], [chuckle], etc.) - Emotion presets with temperature control - Improved marker conversion (*action*, (action), ~action~) ## Discord Bot Enhancements - Multi-agent support (Jarvis, Sage) - Improved voice receiving with discord-ext-voice-recv - Enhanced /join, /leave, /status commands - Per-agent personality configuration - Better audio sink/receiver implementation ## OpenClaw Integration - WebSocket support for Gateway communication - Query complexity routing (auto-select model) - Improved error handling and retries - Session management per Discord guild - Better latency tracking ## Pipeline Improvements - Sentence splitter for streaming optimization - Query router for intelligent model selection - Enhanced VAD receiver with sample-based timing - Improved audio buffering and format conversion - Better transcript management ## Documentation - Added QUICK_START.md (5-minute test guide) - Added OPTIMIZATION_SUMMARY.md (performance analysis) - Added DISCORD_OPTIMIZATION_TEST.md (testing guide) - Added USAGE_GUIDE.md (comprehensive usage) - Updated README.md with optimization details ## Utilities & Scripts - Added get_invite_link.py (Discord bot invite) - Added sync_commands.py, sync_to_guild.py (command sync) - Added test_gateway.py, test_stt.py (testing utilities) - Added openclaw_wrapper.py (wrapper script) - Removed create_mock_turn_model.py (no longer needed) ## Configuration Updates - STT model: medium → small (faster, acceptable quality) - TTS engine: chatterbox → coqui (Turbo integration) - Beam size: 5 → 1 (latency optimization) - Added emotion_exaggeration per agent - Updated .gitignore for project files Total: ~2105 insertions, ~462 deletions across 35 files Performance: ~5.5s total latency (down from 22-35s) Target: ~3.5s (achieved in simple queries with cache) Co-Authored-By: Claude Sonnet 4.5 <noreply@anthropic.com>
220 lines
2.6 KiB
Text
220 lines
2.6 KiB
Text
# Python
|
|
__pycache__/
|
|
*.py[cod]
|
|
*$py.class
|
|
*.so
|
|
.Python
|
|
build/
|
|
develop-eggs/
|
|
dist/
|
|
downloads/
|
|
eggs/
|
|
.eggs/
|
|
lib/
|
|
lib64/
|
|
parts/
|
|
sdist/
|
|
var/
|
|
wheels/
|
|
*.egg-info/
|
|
.installed.cfg
|
|
*.egg
|
|
MANIFEST
|
|
|
|
# Virtual Environment
|
|
venv/
|
|
ENV/
|
|
env/
|
|
.venv
|
|
env.bak/
|
|
venv.bak/
|
|
|
|
# IDEs
|
|
.vscode/
|
|
.idea/
|
|
*.swp
|
|
*.swo
|
|
*~
|
|
.project
|
|
.pydevproject
|
|
.settings/
|
|
|
|
# Environment Variables & Secrets (CRITICAL!)
|
|
.env
|
|
.env.*
|
|
!.env.example
|
|
*.env
|
|
.envrc
|
|
secrets/
|
|
credentials/
|
|
*.key
|
|
*.pem
|
|
*.p12
|
|
*.pfx
|
|
api_keys.txt
|
|
tokens.txt
|
|
|
|
# Configuration Overrides (keep generic config.yaml, ignore local overrides)
|
|
config.local.yaml
|
|
config.*.yaml
|
|
!config.yaml
|
|
openclaw.json
|
|
!openclaw.json.example
|
|
|
|
# Models (large files - download locally, don't commit)
|
|
models/*.onnx
|
|
models/*.pt
|
|
models/*.bin
|
|
models/*.safetensors
|
|
models/*.gguf
|
|
models/*.h5
|
|
models/*.pb
|
|
models/*.tflite
|
|
models/whisper-*
|
|
models/smart-turn-*
|
|
models/chatterbox-*
|
|
*.model
|
|
*.pth
|
|
*.ckpt
|
|
|
|
# Voice Files (user-specific - NEVER commit personal voice samples!)
|
|
server/voices/*.wav
|
|
server/voices/*.mp3
|
|
server/voices/*.flac
|
|
server/voices/*.ogg
|
|
server/voices/*.m4a
|
|
server/voices/*.aac
|
|
!server/voices/.gitkeep
|
|
!server/voices/README.md
|
|
|
|
# Audio Test Files
|
|
test_audio/
|
|
audio_samples/
|
|
recordings/
|
|
*.wav
|
|
*.mp3
|
|
!tests/fixtures/*.wav
|
|
!tests/fixtures/*.mp3
|
|
|
|
# Test Coverage
|
|
.coverage
|
|
.coverage.*
|
|
htmlcov/
|
|
.pytest_cache/
|
|
*.cover
|
|
.hypothesis/
|
|
.tox/
|
|
coverage.xml
|
|
*.coveragerc
|
|
|
|
# OS
|
|
.DS_Store
|
|
.DS_Store?
|
|
._*
|
|
.Spotlight-V100
|
|
.Trashes
|
|
ehthumbs.db
|
|
Thumbs.db
|
|
desktop.ini
|
|
|
|
# Logs & Debug Output
|
|
*.log
|
|
logs/
|
|
*.log.*
|
|
log_*.txt
|
|
debug.log
|
|
error.log
|
|
output.log
|
|
|
|
# Temporary Files
|
|
*.tmp
|
|
*.temp
|
|
*.bak
|
|
*.backup
|
|
*.swp
|
|
*~
|
|
.cache/
|
|
tmp/
|
|
temp/
|
|
|
|
# User Data & Sessions
|
|
user_data/
|
|
sessions/
|
|
transcripts/
|
|
conversation_history/
|
|
*.db
|
|
*.sqlite
|
|
*.sqlite3
|
|
|
|
# Personal Notes & Documentation (keep public docs, ignore personal notes)
|
|
NOTES.md
|
|
TODO.md
|
|
PERSONAL.md
|
|
MY_*.md
|
|
notes/
|
|
personal/
|
|
|
|
# Local Testing
|
|
local_test/
|
|
sandbox/
|
|
scratch/
|
|
|
|
# Build & Distribution
|
|
*.pyc
|
|
*.pyo
|
|
*.pyd
|
|
.Python
|
|
pip-log.txt
|
|
pip-delete-this-directory.txt
|
|
|
|
# Jupyter Notebook
|
|
.ipynb_checkpoints
|
|
*.ipynb
|
|
|
|
# macOS
|
|
.AppleDouble
|
|
.LSOverride
|
|
|
|
# Windows
|
|
Thumbs.db
|
|
ehthumbs.db
|
|
Desktop.ini
|
|
$RECYCLE.BIN/
|
|
|
|
# Editor Backups
|
|
*~
|
|
*.orig
|
|
*.rej
|
|
|
|
# Package Manager
|
|
node_modules/
|
|
package-lock.json
|
|
yarn.lock
|
|
.pnp/
|
|
.pnp.js
|
|
|
|
# Compiled Documentation
|
|
docs/_build/
|
|
site/
|
|
|
|
# MyPy
|
|
.mypy_cache/
|
|
.dmypy.json
|
|
dmypy.json
|
|
|
|
# Pyre
|
|
.pyre/
|
|
|
|
# Pytype
|
|
.pytype/
|
|
|
|
# Cython
|
|
cython_debug/
|
|
|
|
# CRITICAL: Ensure no accidental commits of:
|
|
# - Discord bot tokens
|
|
# - OpenClaw Gateway tokens
|
|
# - API keys (OpenAI, Anthropic, etc.)
|
|
# - Voice reference files (personal/copyrighted)
|
|
# - User conversation data
|
|
# - Local configuration with real URLs/credentials
|