fernando_jacob
d793afaba6
The Xueqiu stock API requires a login session token (xq_a_token) that is generated by Xueqiu's frontend JavaScript and cannot be obtained by simply visiting the homepage. This caused persistent HTTP 400 (error code 400016) for all users. Changes: - _ensure_cookies(): add three-level priority — config file (saved by --from-browser) → live Chrome cookies via browser_cookie3 → homepage fallback. The homepage-only approach only ever got acw_tc (anti-DDoS token), never xq_a_token. - _get_json(): switch User-Agent from "agent-reach/1.0" to a real Chrome UA, and add Referer: https://xueqiu.com/ to all API requests. - get_hot_posts(): replace the defunct /statuses/hot/listV3.json endpoint (returns empty body) with the v4 public timeline endpoint; correctly parse item.data as a JSON string to extract author, text, and likes. - cookie_extract.py: add Xueqiu to PLATFORM_SPECS and configure_from_browser so that `agent-reach configure --from-browser chrome` now also saves Xueqiu cookies (only when xq_a_token is present). - check(): improve error message to direct users to --from-browser instead of suggesting a proxy. - Fix urllib.parse.quote usage (was using urllib.request.quote). - Update tier and backends description to reflect cookie requirement. - Add 2 new tests: cookie loading from config, Referer/UA header verification. - Update docs: README, install guide, troubleshooting, SKILL.md, CHANGELOG.
315 lines
10 KiB
Markdown
315 lines
10 KiB
Markdown
---
|
||
name: agent-reach
|
||
description: >
|
||
Give your AI agent eyes to see the entire internet.
|
||
Search and read 17 platforms: Twitter/X, Reddit, YouTube, GitHub, Bilibili,
|
||
XiaoHongShu, Douyin, Weibo, WeChat Articles, Xiaoyuzhou Podcast, LinkedIn,
|
||
V2EX, Xueqiu, RSS, Exa web search, and any web page.
|
||
Zero config for 8 channels. Use when user asks to search, read, or interact
|
||
on any supported platform, shares a URL, or asks to search the web.
|
||
Triggers: "搜推特", "搜小红书", "看视频", "搜一下", "上网搜", "帮我查",
|
||
"search twitter", "youtube transcript", "search reddit", "read this link",
|
||
"B站", "bilibili", "抖音视频", "微信文章", "公众号", "微博", "V2EX",
|
||
"小宇宙", "播客", "podcast", "雪球", "股票", "stock quote",
|
||
"web search", "research", "帮我安装".
|
||
metadata:
|
||
openclaw:
|
||
homepage: https://github.com/Panniantong/Agent-Reach
|
||
---
|
||
|
||
# Agent Reach — Usage Guide
|
||
|
||
Upstream tools for 13+ platforms. Call them directly.
|
||
|
||
Run `agent-reach doctor` to check which channels are available.
|
||
|
||
## ⚠️ Workspace Rules
|
||
|
||
**Never create files in the agent workspace.** Use `/tmp/` for temporary output and `~/.agent-reach/` for persistent data.
|
||
|
||
## Web — Any URL
|
||
|
||
```bash
|
||
curl -s "https://r.jina.ai/URL"
|
||
```
|
||
|
||
## Web Search (Exa)
|
||
|
||
```bash
|
||
mcporter call 'exa.web_search_exa(query: "query", numResults: 5)'
|
||
mcporter call 'exa.get_code_context_exa(query: "code question", tokensNum: 3000)'
|
||
```
|
||
|
||
## Twitter/X (bird)
|
||
|
||
```bash
|
||
bird search "query" -n 10 # search
|
||
bird read URL_OR_ID # read tweet (supports /status/ and /article/ URLs)
|
||
bird user-tweets @username -n 20 # user timeline
|
||
bird thread URL_OR_ID # full thread
|
||
```
|
||
|
||
## YouTube (yt-dlp)
|
||
|
||
```bash
|
||
yt-dlp --dump-json "URL" # video metadata
|
||
yt-dlp --write-sub --write-auto-sub --sub-lang "zh-Hans,zh,en" --skip-download -o "/tmp/%(id)s" "URL"
|
||
# download subtitles, then read the .vtt file
|
||
yt-dlp --dump-json "ytsearch5:query" # search
|
||
```
|
||
|
||
## Bilibili (yt-dlp)
|
||
|
||
```bash
|
||
yt-dlp --dump-json "https://www.bilibili.com/video/BVxxx"
|
||
yt-dlp --write-sub --write-auto-sub --sub-lang "zh-Hans,zh,en" --convert-subs vtt --skip-download -o "/tmp/%(id)s" "URL"
|
||
```
|
||
|
||
> Server IPs may get 412. Use `--cookies-from-browser chrome` or configure proxy.
|
||
|
||
## Reddit
|
||
|
||
```bash
|
||
curl -s "https://www.reddit.com/r/SUBREDDIT/hot.json?limit=10" -H "User-Agent: agent-reach/1.0"
|
||
curl -s "https://www.reddit.com/search.json?q=QUERY&limit=10" -H "User-Agent: agent-reach/1.0"
|
||
```
|
||
|
||
> Server IPs may get 403. Search via Exa instead, or configure proxy.
|
||
|
||
## GitHub (gh CLI)
|
||
|
||
```bash
|
||
gh search repos "query" --sort stars --limit 10
|
||
gh repo view owner/repo
|
||
gh search code "query" --language python
|
||
gh issue list -R owner/repo --state open
|
||
gh issue view 123 -R owner/repo
|
||
```
|
||
|
||
## 小红书 / XiaoHongShu (mcporter)
|
||
|
||
```bash
|
||
mcporter call 'xiaohongshu.search_feeds(keyword: "query")'
|
||
mcporter call 'xiaohongshu.get_feed_detail(feed_id: "xxx", xsec_token: "yyy")'
|
||
mcporter call 'xiaohongshu.get_feed_detail(feed_id: "xxx", xsec_token: "yyy", load_all_comments: true)'
|
||
mcporter call 'xiaohongshu.publish_content(title: "标题", content: "正文", images: ["/path/img.jpg"], tags: ["tag"])'
|
||
```
|
||
|
||
> Requires login. Use Cookie-Editor to import cookies.
|
||
|
||
> **Tip: Clean bloated output.** XHS API returns large JSON with many unused fields.
|
||
> Pipe through the formatter to save context:
|
||
> ```bash
|
||
> mcporter call 'xiaohongshu.search_feeds(keyword: "query")' | agent-reach format xhs
|
||
> ```
|
||
> This keeps only: title, content, author, engagement counts, image URLs, and tags.
|
||
|
||
## 抖音 / Douyin (mcporter)
|
||
|
||
```bash
|
||
mcporter call 'douyin.parse_douyin_video_info(share_link: "https://v.douyin.com/xxx/")'
|
||
mcporter call 'douyin.get_douyin_download_link(share_link: "https://v.douyin.com/xxx/")'
|
||
```
|
||
|
||
> No login needed.
|
||
|
||
## 微信公众号 / WeChat Articles
|
||
|
||
**Search** (miku_ai):
|
||
```bash
|
||
# miku_ai is installed inside the agent-reach Python environment.
|
||
# Use the same interpreter that runs agent-reach (handles pipx / venv installs):
|
||
AGENT_REACH_PYTHON=$(python3 -c "import agent_reach, sys; print(sys.executable)" 2>/dev/null || echo python3)
|
||
$AGENT_REACH_PYTHON -c "
|
||
import asyncio
|
||
from miku_ai import get_wexin_article
|
||
async def s():
|
||
for a in await get_wexin_article(\'query\', 5):
|
||
print(f\'{a[\"title\"]} | {a[\"url\"]}\')
|
||
asyncio.run(s())
|
||
"
|
||
```
|
||
|
||
**Read** (Camoufox — bypasses WeChat anti-bot):
|
||
```bash
|
||
cd ~/.agent-reach/tools/wechat-article-for-ai && python3 main.py "https://mp.weixin.qq.com/s/ARTICLE_ID"
|
||
```
|
||
|
||
> WeChat articles cannot be read with Jina Reader or curl. Must use Camoufox.
|
||
|
||
## 微博 / Weibo (mcporter)
|
||
|
||
```bash
|
||
# 热搜榜
|
||
mcporter call 'weibo.get_trendings(limit: 20)'
|
||
|
||
# 搜索用户
|
||
mcporter call 'weibo.search_users(keyword: "雷军", limit: 10)'
|
||
|
||
# 获取用户资料
|
||
mcporter call 'weibo.get_profile(uid: "1195230310")'
|
||
|
||
# 获取用户微博动态
|
||
mcporter call 'weibo.get_feeds(uid: "1195230310", limit: 20)'
|
||
|
||
# 获取用户热门微博
|
||
mcporter call 'weibo.get_hot_feeds(uid: "1195230310", limit: 10)'
|
||
|
||
# 搜索微博内容
|
||
mcporter call 'weibo.search_content(keyword: "人工智能", limit: 20)'
|
||
|
||
# 搜索话题
|
||
mcporter call 'weibo.search_topics(keyword: "AI", limit: 10)'
|
||
|
||
# 获取微博评论
|
||
mcporter call 'weibo.get_comments(mid: "5099916367123456", limit: 50)'
|
||
|
||
# 获取粉丝列表
|
||
mcporter call 'weibo.get_fans(uid: "1195230310", limit: 20)'
|
||
|
||
# 获取关注列表
|
||
mcporter call 'weibo.get_followers(uid: "1195230310", limit: 20)'
|
||
```
|
||
|
||
> Zero config. No login needed. Uses mobile API with auto visitor cookies.
|
||
|
||
## 小宇宙播客 / Xiaoyuzhou Podcast (groq-whisper + ffmpeg)
|
||
|
||
```bash
|
||
# 转录单集播客（输出文本到 /tmp/）
|
||
~/.agent-reach/tools/xiaoyuzhou/transcribe.sh "https://www.xiaoyuzhoufm.com/episode/EPISODE_ID"
|
||
```
|
||
|
||
> 需要 ffmpeg + Groq API Key（免费）。
|
||
> 配置 Key：`agent-reach configure groq-key YOUR_KEY`
|
||
> 首次运行需安装工具：`agent-reach install --env=auto`
|
||
> 运行 `agent-reach doctor` 检查状态。
|
||
> 输出 Markdown 文件默认保存到 `/tmp/`。
|
||
|
||
|
||
## LinkedIn (mcporter)
|
||
|
||
```bash
|
||
mcporter call 'linkedin.get_person_profile(linkedin_url: "https://linkedin.com/in/username")'
|
||
mcporter call 'linkedin.search_people(keyword: "AI engineer", limit: 10)'
|
||
```
|
||
|
||
Fallback: `curl -s "https://r.jina.ai/https://linkedin.com/in/username"`
|
||
|
||
## V2EX (public API)
|
||
|
||
```bash
|
||
# 热门主题
|
||
curl -s "https://www.v2ex.com/api/topics/hot.json" -H "User-Agent: agent-reach/1.0"
|
||
|
||
# 节点主题（node_name 如 python、tech、jobs、qna）
|
||
curl -s "https://www.v2ex.com/api/topics/show.json?node_name=python&page=1" -H "User-Agent: agent-reach/1.0"
|
||
|
||
# 主题详情（topic_id 从 URL 获取，如 https://www.v2ex.com/t/1234567）
|
||
curl -s "https://www.v2ex.com/api/topics/show.json?id=TOPIC_ID" -H "User-Agent: agent-reach/1.0"
|
||
|
||
# 主题回复
|
||
curl -s "https://www.v2ex.com/api/replies/show.json?topic_id=TOPIC_ID&page=1" -H "User-Agent: agent-reach/1.0"
|
||
|
||
# 用户信息
|
||
curl -s "https://www.v2ex.com/api/members/show.json?username=USERNAME" -H "User-Agent: agent-reach/1.0"
|
||
```
|
||
|
||
Python 调用示例（V2EXChannel）：
|
||
|
||
```python
|
||
from agent_reach.channels.v2ex import V2EXChannel
|
||
|
||
ch = V2EXChannel()
|
||
|
||
# 获取热门帖子（默认 20 条）
|
||
# 返回字段：id, title, url, replies, node_name, node_title, content(前200字), created
|
||
topics = ch.get_hot_topics(limit=10)
|
||
for t in topics:
|
||
print(f"[{t['node_title']}] {t['title']} ({t['replies']} 回复) {t['url']}")
|
||
print(f" id={t['id']} created={t['created']}")
|
||
|
||
# 获取指定节点的最新帖子
|
||
# 返回字段：id, title, url, replies, node_name, node_title, content(前200字), created
|
||
node_topics = ch.get_node_topics("python", limit=5)
|
||
for t in node_topics:
|
||
print(t["id"], t["title"], t["url"])
|
||
|
||
# 获取单个帖子详情 + 回复列表
|
||
# 返回字段：id, title, url, content, replies_count, node_name, node_title,
|
||
# author, created, replies (list of {author, content, created})
|
||
topic = ch.get_topic(1234567)
|
||
print(topic["title"], "—", topic["author"])
|
||
for r in topic["replies"]:
|
||
print(f" {r['author']}: {r['content'][:80]}")
|
||
|
||
# 获取用户信息
|
||
# 返回字段：id, username, url, website, twitter, psn, github, btc, location, bio, avatar, created
|
||
user = ch.get_user("Livid")
|
||
print(user["username"], user["bio"], user["github"])
|
||
|
||
# 搜索（V2EX 公开 API 不支持，会返回说明信息）
|
||
result = ch.search("asyncio")
|
||
print(result[0]["error"]) # 提示使用站内搜索或 Exa channel
|
||
```
|
||
|
||
> No auth required. Results are public JSON. V2EX 节点名见 https://www.v2ex.com/planes
|
||
|
||
## 雪球 / Xueqiu (需要登录 Cookie)
|
||
|
||
```python
|
||
from agent_reach.channels.xueqiu import XueqiuChannel
|
||
|
||
ch = XueqiuChannel()
|
||
|
||
# 获取股票行情（符号格式：SH600519 沪市、SZ000858 深市、AAPL 美股、00700 港股）
|
||
# 返回字段：symbol, name, current, percent, chg, high, low, open, last_close,
|
||
# volume, amount, market_capital, turnover_rate, pe_ttm, timestamp
|
||
quote = ch.get_stock_quote("SH600519")
|
||
print(f"{quote['name']} ({quote['symbol']}): {quote['current']} ({quote['percent']}%)")
|
||
|
||
# 搜索股票
|
||
# 返回字段：symbol, name, exchange
|
||
stocks = ch.search_stock("茅台", limit=5)
|
||
for s in stocks:
|
||
print(f"{s['name']} ({s['symbol']}) - {s['exchange']}")
|
||
|
||
# 热门帖子（v4 timeline，含作者、点赞数、正文）
|
||
# 返回字段：id, title, text(前200字), author, likes, url
|
||
posts = ch.get_hot_posts(limit=10)
|
||
for p in posts:
|
||
print(f"{p['author']}: {p['text'][:50]}... ({p['likes']} 赞)")
|
||
|
||
# 热门股票（stock_type=10 人气榜，stock_type=12 关注榜）
|
||
# 返回字段：symbol, name, current, percent, rank
|
||
hot = ch.get_hot_stocks(limit=10, stock_type=10)
|
||
for s in hot:
|
||
print(f"#{s['rank']} {s['name']} ({s['symbol']}): {s['current']} ({s['percent']}%)")
|
||
```
|
||
|
||
> 需要登录 Cookie。先在 Chrome 登录 xueqiu.com，再运行 `agent-reach configure --from-browser chrome`。
|
||
|
||
## RSS (feedparser)
|
||
|
||
## RSS
|
||
|
||
```python
|
||
python3 -c "
|
||
import feedparser
|
||
for e in feedparser.parse('FEED_URL').entries[:5]:
|
||
print(f'{e.title} — {e.link}')
|
||
"
|
||
```
|
||
|
||
## Troubleshooting
|
||
|
||
- **Channel not working?** Run `agent-reach doctor` — shows status and fix instructions.
|
||
- **Twitter fetch failed?** Ensure `undici` is installed: `npm install -g undici`. Configure proxy: `agent-reach configure proxy URL`.
|
||
|
||
## Setting Up a Channel ("帮我配 XXX")
|
||
|
||
If a channel needs setup (cookies, Docker, etc.), fetch the install guide:
|
||
https://raw.githubusercontent.com/Panniantong/agent-reach/main/docs/install.md
|
||
|
||
User only provides cookies. Everything else is your job.
|