fix(reddit,bilibili): switch to rdt-cli and add bili-cli support (#235)

Reddit: Exa crawling had chronic CRAWL_LIVECRAWL_TIMEOUT issues.
rdt-cli (304 stars, public-clis) works without login — search, read
full posts, and comments all verified. Massive improvement.

Bilibili: add bili-cli (590 stars) as optional enhanced backend for
hot/rank/search/feed. yt-dlp remains for video metadata + subtitles.

Also fix UA string (was "agent-reach/1.0", now proper browser UA).

75 tests passing.

Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
This commit is contained in:
Pnant
2026-03-31 17:04:58 +08:00
committed by GitHub
parent 794455cc9f
commit 15f161e5b5
6 changed files with 1696 additions and 78 deletions
+7 -7
View File
@@ -243,9 +243,9 @@ def _cmd_install(args):
# Environment-specific advice
if env == "server":
print()
print("Tip: Reddit and Bilibili block server IPs.")
print(" Reddit search still works via Exa (free).")
print(" For full access: agent-reach configure proxy http://user:pass@ip:port")
print("Tip: Bilibili may block server IPs.")
print(" Reddit: rdt-cli works without proxy (pipx install rdt-cli).")
print(" For Bilibili full access: agent-reach configure proxy http://user:pass@ip:port")
print(" Cheap option: https://www.webshare.io ($1/month)")
# Test channels
@@ -1000,7 +1000,7 @@ def _cmd_configure(args):
if args.key == "proxy":
config.set("bilibili_proxy", value)
print(f"✅ Proxy configured for Bilibili!")
print(" Note: Reddit 已改为通过 Exa 访问,无需代理。")
print(" Note: Reddit 已改为通过 rdt-cli 访问,无需代理。")
elif args.key == "twitter-cookies":
# Accept two formats:
@@ -1433,9 +1433,9 @@ def _cmd_setup():
print(" 跳过。公开 API 也能用")
print()
# Step 3: Reddit — no config needed (uses Exa)
print("【信息】Reddit — 通过 Exa 搜索和阅读,无需配置")
print(" 搜索和阅读 Reddit 内容已通过 Exa 自动完成,免费无需代理。")
# Step 3: Reddit — rdt-cli
print("【信息】Reddit — 通过 rdt-cli 搜索和阅读,无需配置")
print(" 安装:pipx install rdt-cli")
print()
# Step 4: Groq (Whisper)