Commit graph

16 commits

Author SHA1 Message Date
603032f1db feat: enhance voice connection testing with better timeout handling
- Add 45s manual timeout for connection testing
- Add Promise.race for better timeout control
- Enhanced error reporting with connection timing
- Better disconnect handling in test command
- More detailed connection success information
2025-07-26 18:35:55 +02:00
c5cf8f0488 feat: add voice connection retry logic and diagnostic tools
- Add 3-attempt retry logic with exponential backoff for voice connections
- Add connection health checking during stream creation
- Add specific error messages for different connection failure types
- Add 'test voice' command for connectivity diagnostics
- Better error handling for VOICE_CONNECTION_TIMEOUT scenarios
- Should significantly improve connection reliability
2025-07-26 18:29:01 +02:00
6b5b3d1867 feat: improve stream active state detection
- Use 'active' field from streams array to detect camera on/off
- Remove inactive stream SSRCs from mapping when camera turns off
- Enhanced logging to show active stream count and status
- Better detection of camera state changes using both video_ssrc and active field
- Should now properly detect when user turns camera on/off
2025-07-26 17:38:35 +02:00
f9a0e46c59 feat: add comprehensive connection monitoring and timeout handling
- Add connection timeout detection and retry logic
- Monitor FFmpeg data reception for early failure detection
- Increase frame detection timeout from 30s to 45s
- Add aggressive stall detection every 30s instead of 60s
- Filter FFmpeg log output to reduce spam while keeping important info
- Add connection health checks during stream creation retries
- Better handling of 'Connection timed out' errors from FFmpeg
2025-07-26 17:01:59 +02:00
3f2918a7d5 feat: enhance webcam recording initialization timing
- Increase initial wait time to 8s for better connection stability
- Add SSRC mapping readiness check with 15s timeout
- Extend camera detection retry interval to 2s
- Add comprehensive SSRC mapping debug logging before recording
- Better state validation before starting webcam stream
2025-07-26 16:51:23 +02:00
9470815ad1 feat: add frame production monitoring and auto-stop for failed webcam streams
- Monitor FFmpeg frame output and detect stalled recordings
- Auto-stop after 30s if no frames are produced
- Add stall detection for recordings that stop producing frames
- Provide user feedback when recording fails due to no video data
- Clean up monitoring intervals on recording stop
2025-07-26 16:39:16 +02:00
1886ea7c94 feat: improve webcam recording startup reliability
- Add longer wait time (5s) for SSRC mapping establishment
- Add camera detection retry logic with 10s timeout
- Add webcam stream creation retry mechanism
- Enhance debug voice command with SSRC mapping information
- Better error handling and user feedback during setup
2025-07-26 16:32:36 +02:00
b904653535 chore: reduce streaming event log verbosity
- Remove verbose streaming event logs that spam the console
- Only log when actions are taken (camera/screen turned off)
- Keep important operational logs but reduce noise
2025-07-26 16:23:05 +02:00
f7b437fbc3 chore: update discord.js-selfbot-v13 submodule with disconnect event fix 2025-07-26 16:14:46 +02:00
81a2318bd2 feat: add auto-stop functionality for webcam and video recordings
- Add automatic recording stop when user turns off camera/screenshare
- Listen for startStreaming events to detect video_ssrc=0 (camera/screen off)
- Add disconnect and connection close event handling
- Implement proper cleanup of event listeners to prevent memory leaks
- Add targetUserId tracking for accurate event filtering
- Update both videoRecording.js and webcamRecording.js services
- Update discord.js-selfbot-v13 submodule with latest webcam recording fixes
2025-07-26 16:13:19 +02:00
ac2282eabd chore: Update discord.js-selfbot-v13 submodule 2025-07-26 14:35:49 +02:00
2e94820164 Updated the docs to focus on a local only stack instead of one relient on services like OpenAI, Eleven labs and so on. 2025-07-26 14:26:18 +02:00
44b45b7212 Major refactor: Transform into AI-powered Kasane Teto companion bot
🎭 Core Transformation:
- Reframe project as AI companion bot with Kasane Teto personality
- Focus on natural conversation, multimodal interaction, and character roleplay
- Position video recording as one tool in AI toolkit rather than main feature

🏗️ Architecture Improvements:
- Refactor messageCreate.js into modular command system (35 lines vs 310+)
- Create dedicated videoRecording service with clean API
- Implement commandHandler for extensible command routing
- Add centralized configuration system (videoConfig.js)
- Separate concerns: events, services, config, documentation

📚 Documentation Overhaul:
- Consolidate scattered READMEs into organized docs/ directory
- Create comprehensive documentation covering:
  * AI architecture and capabilities
  * Natural interaction patterns and personality
  * Setup guides for AI services and Docker deployment
  * Commands reference focused on conversational AI
  * Troubleshooting and development guidelines
- Transform root README into compelling AI companion overview

🤖 AI-Ready Foundation:
- Document integration points for:
  * Language models (GPT-4/Claude) for conversation
  * Vision models (GPT-4V/CLIP) for image analysis
  * Voice synthesis (ElevenLabs) for speaking
  * Memory systems for conversation continuity
  * Personality engine for character consistency

🔧 Technical Updates:
- Integrate custom discord.js-selfbot-v13 submodule with enhanced functionality
- Update package.json dependencies for AI and multimedia capabilities
- Maintain Docker containerization with improved architecture
- Add development and testing infrastructure

📖 New Documentation Structure:
docs/
├── README.md (documentation hub)
├── setup.md (installation & AI configuration)
├── interactions.md (how to chat with Teto)
├── ai-architecture.md (technical AI systems overview)
├── commands.md (natural language interactions)
├── personality.md (character understanding)
├── development.md (contributing guidelines)
├── troubleshooting.md (problem solving)
└── [additional specialized guides]

 This update transforms the project from a simple recording bot into a foundation for an engaging AI companion that can naturally interact through text, voice, and visual content while maintaining authentic Kasane Teto personality traits.
2025-07-26 13:08:47 +02:00
f93781931f Reworked auth, added WS for imediate communication, cleaned up architecture. 2025-07-26 05:43:38 +02:00
19d7ee1dc5 Reworking the dashboard with Gemini, gotta go in myself, because Gemini can't seem to vibe out the auth. 2025-07-24 06:48:19 +02:00
88018eeebf Initial commit 2025-07-21 06:44:37 +02:00