v1.0.0 — Agent Eyes: search + read the entire internet

Major restructure from x-reader fork to independent project: Architecture: - readers/ — content extraction from 10+ platforms (based on x-reader, MIT) - search/ — semantic search via Exa, GitHub API, birdx (NEW) - config.py — configuration management (~/.agent-eyes/config.yaml) (NEW) - doctor.py — environment health checker (NEW) - core.py — AgentEyes unified entry point (NEW) - cli.py — full CLI: read, search, setup, doctor (NEW) - integrations/mcp_server.py — 8 MCP tools (NEW) - guides/ — 6 Agent-readable setup guides (NEW) - integrations/skill/ — OpenClaw Skill package (NEW) Platforms (zero config): - Web pages, GitHub, Bilibili, YouTube, RSS, single tweets Platforms (one free API key): - Web search, Reddit search, Twitter search (via Exa) Platforms (optional setup): - Reddit full reader, Twitter advanced, WeChat, XiaoHongShu Tests: 34/34 passing Credits: Built on x-reader by @runes_leo (MIT License)
2026-02-24 04:00:47 +01:00
parent 3a3a0101cf
commit 8eab038cb9
46 changed files with 2232 additions and 1054 deletions
@@ -0,0 +1,62 @@
+# -*- coding: utf-8 -*-
+"""
+WeChat article fetcher — two-tier fallback:
+
+1. Jina Reader (fast, no deps)
+2. Playwright headless (no login needed for public articles)
+"""
+
+from loguru import logger
+from typing import Dict, Any
+
+
+async def fetch_wechat(url: str) -> Dict[str, Any]:
+    """
+    Fetch a WeChat public account article with fallback.
+
+    Args:
+        url: mp.weixin.qq.com article URL
+
+    Returns:
+        Dict with: title, content, author, url, platform
+    """
+    # Tier 1: Jina Reader
+    try:
+        logger.info(f"[WeChat] Tier 1 — Jina: {url}")
+        from agent_eyes.fetchers.jina import fetch_via_jina
+
+        data = fetch_via_jina(url)
+        if data.get("content"):
+            return {
+                "title": data["title"],
+                "content": data["content"],
+                "author": data.get("author", ""),
+                "url": url,
+                "platform": "wechat",
+            }
+        logger.warning("[WeChat] Jina returned empty content, falling back to browser")
+    except Exception as e:
+        logger.warning(f"[WeChat] Jina failed ({e}), falling back to browser")
+
+    # Tier 2: Playwright headless (no session needed)
+    try:
+        logger.info(f"[WeChat] Tier 2 — Playwright headless: {url}")
+        from agent_eyes.fetchers.browser import fetch_via_browser
+
+        data = await fetch_via_browser(url)
+        return {
+            "title": data["title"],
+            "content": data["content"],
+            "author": data.get("author", ""),
+            "url": url,
+            "platform": "wechat",
+        }
+    except RuntimeError:
+        # Playwright not installed — re-raise with original Jina error context
+        raise
+    except Exception as e:
+        logger.error(f"[WeChat] Browser fetch also failed: {e}")
+        raise RuntimeError(
+            f"❌ All WeChat fetch methods failed.\n"
+            f"   Last error: {e}"
+        )