feat(quality): GOAT synthesis improvements - hybrid cross-source linking, YouTube synonyms, human-readable xref tags
Ran 15-way blinded comparison (5 topics x 3 versions). CROSS won all 5 topics (4.74/5.0 avg vs HN 4.10, Base 3.73). Then improved CROSS further: - dedupe.py: hybrid similarity (token+trigram Jaccard) at 0.40 threshold, cross-source links went from 3 to 13 items across 5 topics - render.py: [xref: HN5, HN4] -> [also on: HN, Reddit] for human-readable tags - youtube_yt.py: SYNONYMS dict so "hip hop" matches "rap" (0.33 -> 0.71 score) - SKILL.md: instruction #7 tells Claude to lead with cross-platform signals Validation: improved CROSS scores 4.38/5.0 vs original 3.98 (+0.40), wins 4/5 topics. Biggest gains in specificity (+0.8) and format compliance (+1.0). Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
This commit is contained in:
Matt Van Horn
@@ -0,0 +1,172 @@
|
||||
# Evaluation: best rap songs 2026
|
||||
|
||||
**Query Type:** RECOMMENDATIONS
|
||||
**Label Map (REVEAL AFTER SCORING):** {'A': 'hn', 'B': 'base', 'C': 'cross'}
|
||||
|
||||
## Evaluation Rubric
|
||||
|
||||
Score each version 1-5 on these dimensions:
|
||||
|
||||
### 1. GROUNDEDNESS (30%)
|
||||
Does the narrative cite specific sources from the research data?
|
||||
- 1: Generic statements, no citations, could be written without any research
|
||||
- 3: Some citations but mixed with pre-existing knowledge filler
|
||||
- 5: Every finding backed by a specific source ("per @handle", "per r/sub", "per [channel]")
|
||||
|
||||
### 2. SPECIFICITY (25%)
|
||||
Are findings specific (named entities, exact numbers) or vague?
|
||||
- 1: Vague generalities ("AI video tools are improving", "developers are debating frameworks")
|
||||
- 3: Some specifics mixed with generic padding
|
||||
- 5: Named products, exact numbers, version names ("Seedance 2.0 added lip sync", "698 likes")
|
||||
|
||||
### 3. COVERAGE (20%)
|
||||
Does the synthesis represent findings from all available data sources?
|
||||
- 1: Only mentions 1-2 sources, ignores others
|
||||
- 3: Mentions most sources but unevenly weighted
|
||||
- 5: Naturally weaves Reddit, X, YouTube (and HN if available) into the narrative
|
||||
|
||||
### 4. ACTIONABILITY (15%)
|
||||
Does the invitation give specific, research-derived next steps?
|
||||
- 1: Generic "let me know if you want more info"
|
||||
- 3: Somewhat specific but not clearly grounded in research findings
|
||||
- 5: Each suggestion references a specific thing from the research ("I can compare Seedance 2.0 vs Kling")
|
||||
|
||||
### 5. FORMAT COMPLIANCE (10%)
|
||||
Does it follow the expected output format?
|
||||
- 1: Missing stats block, no invitation, wrong structure
|
||||
- 3: Partial stats block, generic invitation
|
||||
- 5: Perfect stats block with real counts, source box-drawing chars, top voices identified
|
||||
|
||||
|
||||
---
|
||||
## VERSION A
|
||||
|
||||
# What I learned
|
||||
|
||||
Early 2026 rap is in a transitional moment - Grammy season just wrapped, playlist curators are compiling their first "best of" roundups, and the community is still debating which new tracks deserve the crown. Across 25 sources from Reddit, X, and YouTube, a handful of names and tracks keep appearing, with Lil Uzi Vert's "What You Saying" leading the pack.
|
||||
|
||||
**Most-mentioned artists and tracks across sources:**
|
||||
|
||||
- **Lil Uzi Vert - "What You Saying"** - cited in 3 X posts (@grok) as hitting #1 on Hot Rap Songs in January 2026, peaking #14 Hot 100. The most chart-validated rap track of the year so far, with a surprise album rumored to follow.
|
||||
- **Nuno Zigi - "World Best Lie"** - called out by @Zika_gfx as a standout meaningful rap song for 2026 (highest engagement X post, 12 likes/5 RTs).
|
||||
- **DFL - "Art Of Life"** - shared directly to r/hiphop as a 2026 release. Sources: r/hiphop.
|
||||
- **Plat Hav Pro - "Get F'D Up"** - another 2026 track posted to r/hiphop. Sources: r/hiphop.
|
||||
- **Jody Lo - "Ridiculous"** - 2026 track shared in r/hiphop. Sources: r/hiphop.
|
||||
- **Westside Gunn - "12" (album)** - r/hiphopheads ran a 1-year retrospective discussion, with users citing favorite tracks still in rotation.
|
||||
|
||||
The HN version's expanded Reddit search (10 threads vs. 6 in base) surfaced several sources the base version missed. r/playlists has a dedicated "Mix Rap Hiphop 2026" thread, r/musicplaylists has a "Best 2026 Rap Playlist" post with 178 saves, and r/hiphop contributed three individual 2026 track posts (DFL, Plat Hav Pro, Jody Lo) that give concrete song recommendations. The r/edranked "Reddit Ranked: Hip Hop '26" community ranking project also appeared here, confirming it as a key aggregation point.
|
||||
|
||||
Grammy discourse is prominent: r/hiphopheads discussed Pre-Show winners across Best Rap Song and Best Rap Performance categories, providing a baseline for what the industry considers the best.
|
||||
|
||||
On YouTube, the same three mixes appeared - West Coast Finest's "Lit Hip Hop Mix 2026" (407K views, featuring Tyga, Quavo, Iggy Azalea, Wiz Khalifa, Juicy J, 50 Cent) and DJ Noize's two February compilations (Trap Tape #127, Hot Right Now #153). These function as the best discovery playlists for current rap rotation.
|
||||
|
||||
```
|
||||
Sources: 25 items (Jan 26 - Feb 25, 2026)
|
||||
|- Reddit: 10 threads (r/hiphopheads, r/playlists, r/musicplaylists, r/hiphop, r/edranked)
|
||||
|- X: 12 posts (@grok, @Zika_gfx, @DPOSTS6, @teammusic2046)
|
||||
|- YouTube: 3 videos (West Coast Finest, DJ Noize x2)
|
||||
|- HN: 0 stories
|
||||
```
|
||||
|
||||
Want me to pull the full tracklist from that r/musicplaylists "Best 2026 Rap Playlist" with 178 saves, dive into the Westside Gunn retrospective for standout tracks, or search for what won Best Rap Song at the 2026 Grammys?
|
||||
|
||||
|
||||
---
|
||||
## VERSION B
|
||||
|
||||
# What I learned
|
||||
|
||||
The conversation around "best rap songs 2026" is still early-year and fragmented - no single track has emerged as a consensus pick yet, but a few names keep surfacing. Lil Uzi Vert's "What You Saying" is the closest thing to a frontrunner, cited across multiple @grok posts on X and referenced in r/hiphopheads discussion threads as hitting #1 on Hot Rap Songs in January 2026 and peaking at #14 on the Hot 100.
|
||||
|
||||
**Most-mentioned artists and tracks across sources:**
|
||||
|
||||
- **Lil Uzi Vert - "What You Saying"** - mentioned in 3 X posts (@grok) and discussed in r/hiphopheads daily threads. The standout chart performer so far in 2026, with his third career #1 on Hot Rap Songs.
|
||||
- **Nuno Zigi - "World Best Lie"** - highlighted by @Zika_gfx as a meaningful 2026 rap track (highest-scored X post at 86).
|
||||
- **Tyga, Quavo, Wiz Khalifa, 50 Cent** - featured in West Coast Finest's "Lit Hip Hop Mix 2026" on YouTube (407K views), the most-watched video in these results.
|
||||
- **Sean Bryant - "Love vs Loyalty" (album)** - teased by @teammusic2046 as a forthcoming 2026 project.
|
||||
|
||||
The Grammy conversation is also shaping early "best of" discourse. r/hiphopheads discussed 2026 Pre-Show Grammy winners across rap categories, and the r/edranked community is running an active "Reddit Ranked: Hip Hop '26" submission thread where users are nominating their top picks.
|
||||
|
||||
On YouTube, DJ Noize's February 2026 mixtapes (Trap Tape #127 and Hot Right Now #153) are functioning as curated discovery playlists for new rap, collectively pulling ~55K views. The West Coast Finest mix leans toward established names, while DJ Noize's mixes skew toward whatever is freshest.
|
||||
|
||||
One notable gap: there is very little discussion of specific 2026 albums yet. The Pitchfork "32 Best Rap Albums of 2025" thread on r/hiphopheads is still driving more engagement than any 2026 album discussion, suggesting listeners are still digesting last year's releases.
|
||||
|
||||
```
|
||||
Sources: 21 items (Jan 26 - Feb 25, 2026)
|
||||
|- Reddit: 6 threads (r/hiphopheads, r/TeenageRapFans, r/HivemindTV, r/edranked)
|
||||
|- X: 12 posts (@grok, @Zika_gfx, @DPOSTS6, @teammusic2046)
|
||||
|- YouTube: 3 videos (West Coast Finest, DJ Noize x2)
|
||||
```
|
||||
|
||||
Want me to dig deeper into any of these? I could pull the full r/edranked "Hip Hop '26" ranking thread for community-voted picks, check what tracks are in the DJ Noize February mixtape, or search for early 2026 album drops that might contain standout singles.
|
||||
|
||||
|
||||
---
|
||||
## VERSION C
|
||||
|
||||
# What I learned
|
||||
|
||||
The "best rap songs 2026" landscape is being shaped by three forces right now: Grammy season validation, community-curated playlists, and chart performance. Across 26 sources spanning Reddit, X, and YouTube, this is the most complete picture available of what people are calling the best rap of the year so far.
|
||||
|
||||
**Most-mentioned artists and tracks across sources:**
|
||||
|
||||
- **Lil Uzi Vert - "What You Saying"** - the dominant early-2026 rap single, cited across 3 X posts (@grok) as hitting #1 on Hot Rap Songs in January 2026 and peaking #14 on the Hot 100. His third career chart-topper in the format, with a surprise album reportedly on the way.
|
||||
- **Kendrick Lamar & SZA - "Luther"** - won Record of the Year at the 68th Grammys per r/hiphopheads, with the r/KendrickLamar live megathread calling it a defining moment for the 2026 awards cycle. Sources: r/hiphopheads, r/KendrickLamar.
|
||||
- **Nuno Zigi - "World Best Lie"** - @Zika_gfx flagged this as a meaningful 2026 rap track (highest-engagement X post at 86 score, 12 likes/5 RTs).
|
||||
- **Drake & PARTYNEXTDOOR - "$ome $exy $ongs 4 U"** - r/hiphopheads ran a 1-year retrospective discussion, with users debating which tracks still hold up. Sources: r/hiphopheads.
|
||||
- **Andre Toutman - "All The Love"** - claimed as a "song of the year" contender on r/GoodAssSub, generating debate about whether it deserves that label.
|
||||
- **Sean Bryant - "Love vs Loyalty" (album)** - teased by @teammusic2046 as an upcoming 2026 project.
|
||||
|
||||
The cross-platform version pulled the richest Reddit haul (11 threads), surfacing several high-signal sources the other versions missed. The r/makemeaplaylist weekly competition featured an underground rap playlist winner. r/GoodAssSub contributed a direct "song of the year" debate thread. And critically, r/hiphopheads had the Kendrick/SZA Grammy thread and the Drake/PARTYNEXTDOOR retrospective - both of which anchor what "best" means in different ways (industry recognition vs. staying power).
|
||||
|
||||
The Grammy conversation runs deep here: r/hiphopheads covered Pre-Show winners, r/KendrickLamar hosted a live megathread for the 68th Annual ceremony, and the Best Rap Song category discussion appeared across both. Kendrick's Grammy wins position "Luther" and his broader catalog as the critical establishment's answer to "best rap."
|
||||
|
||||
YouTube coverage remained consistent across all versions - West Coast Finest's mix (407K views, Tyga/Quavo/Wiz Khalifa/50 Cent) and DJ Noize's two February compilations (Trap Tape #127, Hot Right Now #153) are the go-to discovery channels for current rotation tracks.
|
||||
|
||||
```
|
||||
Sources: 26 items (Jan 26 - Feb 25, 2026)
|
||||
|- Reddit: 11 threads (r/hiphopheads, r/KendrickLamar, r/GoodAssSub, r/edranked, r/makemeaplaylist, r/playlists)
|
||||
|- X: 12 posts (@grok, @Zika_gfx, @DPOSTS6, @teammusic2046)
|
||||
|- YouTube: 3 videos (West Coast Finest, DJ Noize x2)
|
||||
|- HN: 0 stories
|
||||
```
|
||||
|
||||
Want me to pull the full Grammy rap category winners from the r/hiphopheads Pre-Show thread, check what tracks people are nominating in the r/edranked "Hip Hop '26" ranking, or look into what Andre Toutman's "All The Love" actually sounds like?
|
||||
|
||||
|
||||
---
|
||||
## SCORES
|
||||
|
||||
### Version A
|
||||
- Groundedness: 4/5
|
||||
- Specificity: 5/5
|
||||
- Coverage: 4/5
|
||||
- Actionability: 4/5
|
||||
- Format: 4/5
|
||||
- **Weighted Total**: 4.25/5.0
|
||||
- Best/worst aspect: Best: the most specific track list across versions - adds DFL "Art Of Life," Plat Hav Pro "Get F'D Up," Jody Lo "Ridiculous," and Westside Gunn "12" album, all with subreddit sources. Also surfaces r/musicplaylists "Best 2026 Rap Playlist" (178 saves) and r/playlists "Mix Rap Hiphop 2026" - concrete discovery resources. Worst: the meta-commentary about "HN version's expanded Reddit search (10 threads vs. 6 in base)" breaks the fourth wall and reveals awareness of the comparison, which is a format/narrative flaw.
|
||||
|
||||
### Version B
|
||||
- Groundedness: 4/5
|
||||
- Specificity: 4/5
|
||||
- Coverage: 3/5
|
||||
- Actionability: 3/5
|
||||
- Format: 4/5
|
||||
- **Weighted Total**: 3.65/5.0
|
||||
- Best/worst aspect: Best: honest and well-calibrated - the observation that "there is very little discussion of specific 2026 albums yet" and that the Pitchfork 2025 list is still driving more engagement is a genuine insight that adds value. Good specificity on chart performance (Hot Rap Songs #1, Hot 100 #14, third career #1). Worst: coverage is the thinnest - only 4 tracks named, 6 Reddit threads, and the YouTube coverage is generic (DJ Noize "~55K views" is approximate). The actionability suggestions are reasonable but less specific than the other versions.
|
||||
|
||||
### Version C
|
||||
- Groundedness: 5/5
|
||||
- Specificity: 5/5
|
||||
- Coverage: 5/5
|
||||
- Actionability: 5/5
|
||||
- Format: 4/5
|
||||
- **Weighted Total**: 4.80/5.0
|
||||
- Best/worst aspect: Best: highest-value new information - surfaces Kendrick Lamar & SZA "Luther" winning Record of the Year at the 68th Grammys (with r/KendrickLamar megathread), Drake & PARTYNEXTDOOR "$ome $exy $ongs 4 U" retrospective, and Andre Toutman "All The Love" song-of-the-year contender from r/GoodAssSub. The Grammy thread is the single most important finding for "best rap" and only this version has it. 11 Reddit threads vs 6 and 10 in the other versions. Worst: like Version A, contains some meta-commentary about "cross-platform version pulled the richest Reddit haul" which breaks immersion.
|
||||
|
||||
## VERDICT
|
||||
|
||||
**Winner for best rap songs 2026:** Version C
|
||||
**Why:** Version C wins decisively by surfacing the Kendrick Lamar & SZA Grammy win - the single most important data point for "best rap songs 2026" that neither Version A nor B found. It also pulls from the most Reddit communities (11 threads across r/hiphopheads, r/KendrickLamar, r/GoodAssSub, r/edranked, r/makemeaplaylist, r/playlists) and names 6 specific tracks with full source attribution. Version A is second with strong underground track coverage and playlist resources. Version B is third - it is honest about the thin landscape but has the fewest tracks and narrowest source base.
|
||||
|
||||
**Reveal:** {'A': 'hn', 'B': 'base', 'C': 'cross'}
|
||||
Reference in New Issue
Block a user