GitHub Trending

Discover trending repositories on GitHub filtered by language, date range, or topic.

Quick Start

Method 1: Web Scraping (No API needed)

bash
1# Fetch trending page
2web_fetch "https://github.com/trending/python?since=daily"
3
4# Parse with browser tool for better extraction
5browser.open("https://github.com/trending")
6browser.snapshot()

Method 2: GitHub CLI (if authenticated)

bash
1# Search trending repos
2gh search repos --sort stars --order desc --limit 10
3
4# Filter by topic
5gh search repos --topic databricks --sort stars --order desc
6
7# Filter by language and recent updates
8gh search repos --language python --sort updated --limit 10

Method 3: GitHub API (requires token)

bash
1# Search by stars (proxy for trending)
2curl "https://api.github.com/search/repositories?q=created:>$(date -v-7d +%Y-%m-%d)&sort=stars&order=desc"

Trending Time Ranges

• ?since=daily - Today's trending
• ?since=weekly - This week's trending
• ?since=monthly - This month's trending

Popular Languages

Data Engineering:

• python - Data science, ML, ETL
• scala - Spark, big data
• jupyter-notebook - Analysis notebooks

General:

• javascript, typescript, go, rust

Filtering Strategies

For Databricks/Data Engineering

bash
1# GitHub search query
2site:github.com databricks OR "delta lake" OR spark stars:>100
3
4# Topic-based search (gh CLI)
5gh search repos --topic databricks --sort stars
6gh search repos --topic spark --sort stars
7gh search repos --topic mlflow --sort stars

Extract Key Info

From trending page, capture:

• Repository name (owner/repo)
• Description
• Stars (total)
• Stars today/week (if shown)
• Primary language
• Topics/tags

Output Format

markdown
1## 🔥 GitHub Trending - [Language/Topic] - [Date]
2
31. **owner/repo-name** (⭐ 12.3K | +234 today)
4   Description of the project
5   Topics: #databricks #spark #python
6   https://github.com/owner/repo-name
7
82. **owner/another-repo** (⭐ 5.6K | +89 today)
9   Brief description
10   Topics: #data-engineering #etl
11   https://github.com/owner/another-repo

Common Use Cases

Daily Data Engineering Trends

Track Databricks, Spark, Delta Lake projects:

1. Fetch https://github.com/trending/python?since=daily
2. Filter for keywords: databricks, spark, delta, mlflow
3. Return top 3-5 matches

Weekly Learning Resources

Find popular educational repos:

1. Search repos with topic "data-engineering" or "databricks"
2. Sort by stars (last 7 days)
3. Filter for tutorials, examples, courses

Interview Prep Projects

Discover real-world implementations:

1. Search: "databricks" OR "lakehouse" language:python
2. Filter: stars >100, updated recently
3. Look for: example projects, best practices

Tips

• Browser tool preferred for visual parsing (stars, trends)
• GitHub CLI fastest for authenticated searches
• Web scraping simplest for trending pages (no auth)
• Cache results - trending changes slowly (safe to cache 1-2 hours)

Example Script

See scripts/github-trending.sh for automated trending fetch with keyword filtering.