Automated Collection Engine
Pulls content from RSS, X, YouTube, Instagram, TikTok, Facebook, Google News and AI-assisted local sources — continuously, in the background.
- RSS Robot — every 5 minutes
- X Robot — every 1 minute
- Social media collectors
- Google News pipeline
- Local News AI
- Trust score & source priority
- SHA-256 deduplication
- Full-text fetch for truncated feeds