docs: update README and SKILL.md for ScrapeCreators TikTok API
Replace all Apify references with ScrapeCreators. Key points: - No subscription required (was $5/mo with Apify) - 100 free credits, pay-as-you-go after - SCRAPECREATORS_API_KEY replaces APIFY_API_TOKEN - Backwards compatible: APIFY_API_TOKEN still works as fallback Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
This commit is contained in:
@@ -4,7 +4,7 @@
|
|||||||
|
|
||||||
**New in V2.7 — TikTok as a source:**
|
**New in V2.7 — TikTok as a source:**
|
||||||
|
|
||||||
TikTok is now the 7th signal source. Search any topic and get viral TikTok videos with views, likes, hashtags, and extracted captions — scored and ranked alongside Reddit, X, and YouTube. Powered by [Apify](https://apify.com) with a BYO API key ($5/month free credits, no credit card). [Details below.](#whats-new-in-v27)
|
TikTok is now the 7th signal source. Search any topic and get viral TikTok videos with views, likes, hashtags, and extracted captions — scored and ranked alongside Reddit, X, and YouTube. Powered by [ScrapeCreators](https://scrapecreators.com) - 100 free credits, pay-as-you-go after that, no subscription required. [Details below.](#whats-new-in-v27)
|
||||||
|
|
||||||
**New in V2.5 - dramatically better results:**
|
**New in V2.5 - dramatically better results:**
|
||||||
|
|
||||||
@@ -33,7 +33,7 @@ mkdir -p ~/.config/last30days
|
|||||||
cat > ~/.config/last30days/.env << 'EOF'
|
cat > ~/.config/last30days/.env << 'EOF'
|
||||||
OPENAI_API_KEY=sk-... # optional if using `codex login`
|
OPENAI_API_KEY=sk-... # optional if using `codex login`
|
||||||
XAI_API_KEY=xai-... # optional - cookie auth is default for X search
|
XAI_API_KEY=xai-... # optional - cookie auth is default for X search
|
||||||
APIFY_API_TOKEN=apify_... # optional - for TikTok (free $5/mo at apify.com)
|
SCRAPECREATORS_API_KEY=sc_... # optional - for TikTok (100 free credits at scrapecreators.com, no subscription)
|
||||||
EOF
|
EOF
|
||||||
chmod 600 ~/.config/last30days/.env
|
chmod 600 ~/.config/last30days/.env
|
||||||
```
|
```
|
||||||
@@ -954,14 +954,12 @@ Search "Leah Halton" and TikTok is the primary signal:
|
|||||||
- @looooooooch: 108.8M views — her "Recreation #Inverted" viral hit
|
- @looooooooch: 108.8M views — her "Recreation #Inverted" viral hit
|
||||||
- @allyouseeisai: 17.7M views — AI-generated content of her
|
- @allyouseeisai: 17.7M views — AI-generated content of her
|
||||||
|
|
||||||
**Powered by [Apify](https://apify.com)** — sign up for free ($5/month credits, no credit card) and add your token:
|
**Powered by [ScrapeCreators](https://scrapecreators.com)** — 100 free credits, then pay-as-you-go. No subscription required. Sign up and add your key:
|
||||||
|
|
||||||
```bash
|
```bash
|
||||||
echo 'APIFY_API_TOKEN=apify_api_...' >> ~/.config/last30days/.env
|
echo 'SCRAPECREATORS_API_KEY=sc_...' >> ~/.config/last30days/.env
|
||||||
```
|
```
|
||||||
|
|
||||||
The shared Apify client wrapper is designed for future Facebook and Instagram sources using the same token.
|
|
||||||
|
|
||||||
---
|
---
|
||||||
|
|
||||||
## What's New in V2.5
|
## What's New in V2.5
|
||||||
@@ -1107,7 +1105,7 @@ Thanks to the contributors who helped shape V2:
|
|||||||
| `youtube.com` (via yt-dlp) | Search query | None (public search) |
|
| `youtube.com` (via yt-dlp) | Search query | None (public search) |
|
||||||
| `hn.algolia.com` | Search query | None (public API) |
|
| `hn.algolia.com` | Search query | None (public API) |
|
||||||
| `gamma-api.polymarket.com` | Search query | None (public API) |
|
| `gamma-api.polymarket.com` | Search query | None (public API) |
|
||||||
| `api.apify.com` | Search query (TikTok) | APIFY_API_TOKEN |
|
| `api.scrapecreators.com` | Search query (TikTok) | SCRAPECREATORS_API_KEY |
|
||||||
| `api.search.brave.com` | Search query (optional) | BRAVE_API_KEY |
|
| `api.search.brave.com` | Search query (optional) | BRAVE_API_KEY |
|
||||||
| `api.parallel.ai` | Search query (optional) | PARALLEL_API_KEY |
|
| `api.parallel.ai` | Search query (optional) | PARALLEL_API_KEY |
|
||||||
| `openrouter.ai` | Search query (optional) | OPENROUTER_API_KEY |
|
| `openrouter.ai` | Search query (optional) | OPENROUTER_API_KEY |
|
||||||
|
|||||||
@@ -590,7 +590,7 @@ Want another prompt? Just tell me what you're creating next.
|
|||||||
- Sends search queries to Algolia HN Search API (`hn.algolia.com`) for Hacker News story and comment discovery (free, no auth)
|
- Sends search queries to Algolia HN Search API (`hn.algolia.com`) for Hacker News story and comment discovery (free, no auth)
|
||||||
- Sends search queries to Polymarket Gamma API (`gamma-api.polymarket.com`) for prediction market discovery (free, no auth)
|
- Sends search queries to Polymarket Gamma API (`gamma-api.polymarket.com`) for prediction market discovery (free, no auth)
|
||||||
- Runs `yt-dlp` locally for YouTube search and transcript extraction (no API key, public data)
|
- Runs `yt-dlp` locally for YouTube search and transcript extraction (no API key, public data)
|
||||||
- Sends search queries to Apify API (`api.apify.com`) for TikTok search and caption extraction (requires APIFY_API_TOKEN, free tier: $5/month credits)
|
- Sends search queries to ScrapeCreators API (`api.scrapecreators.com`) for TikTok search and caption extraction (requires SCRAPECREATORS_API_KEY, 100 free credits, PAYG after that, no subscription)
|
||||||
- Optionally sends search queries to Brave Search API, Parallel AI API, or OpenRouter API for web search
|
- Optionally sends search queries to Brave Search API, Parallel AI API, or OpenRouter API for web search
|
||||||
- Fetches public Reddit thread data from `reddit.com` for engagement metrics
|
- Fetches public Reddit thread data from `reddit.com` for engagement metrics
|
||||||
- Stores research findings in local SQLite database (watchlist mode only)
|
- Stores research findings in local SQLite database (watchlist mode only)
|
||||||
@@ -602,7 +602,7 @@ Want another prompt? Just tell me what you're creating next.
|
|||||||
- Does not log, cache, or write API keys to output files
|
- Does not log, cache, or write API keys to output files
|
||||||
- Does not send data to any endpoint not listed above
|
- Does not send data to any endpoint not listed above
|
||||||
- Hacker News and Polymarket sources are always available (no API key, no binary dependency)
|
- Hacker News and Polymarket sources are always available (no API key, no binary dependency)
|
||||||
- TikTok source requires APIFY_API_TOKEN (sign up at apify.com for free $5/month credits, no CC)
|
- TikTok source requires SCRAPECREATORS_API_KEY (sign up at scrapecreators.com, 100 free credits, PAYG, no subscription)
|
||||||
- Can be invoked autonomously by agents via the Skill tool (runs inline, not forked); pass `--agent` for non-interactive report output
|
- Can be invoked autonomously by agents via the Skill tool (runs inline, not forked); pass `--agent` for non-interactive report output
|
||||||
|
|
||||||
**Bundled scripts:** `scripts/last30days.py` (main research engine), `scripts/lib/` (search, enrichment, rendering modules), `scripts/lib/vendor/bird-search/` (vendored X search client, MIT licensed)
|
**Bundled scripts:** `scripts/last30days.py` (main research engine), `scripts/lib/` (search, enrichment, rendering modules), `scripts/lib/vendor/bird-search/` (vendored X search client, MIT licensed)
|
||||||
|
|||||||
Reference in New Issue
Block a user