GitHub: scrapers and the official API, compared
Repositories, code metadata, issues, releases, users and organisation data.
Short answer
For most GitHub jobs, start with GitHub Repository Metadata & README Extractor: it covers 5 of 6 core fields (stars, language, description, updated at and 1 more) at $0.99 per 1,000 results on Apify's Free plan. The top published score for GitHub goes to GitHub Repositories Search Scraper by fetch_cat (93 of 100), a Store tool from another publisher, listed for reference.
From published Store listings, output schemas and the official documentation. Checked 2026-11-11. How the ranking works.GitHub Repository Metadata & README Extractor: inputs, code and costOpen in Apify Store
What do you need from GitHub?
- Research repositories GitHub Repository Metadata & README Extractor Only this one: watchers, subscribersCount, openIssues 10,000 results: $10.30 on Free, incl. $0.40 start, plus Apify platform usage (compute)
- Discover trending repositories GitHub Weekly Trending Repos & Org Repo Finder Only this one: trendingRank 10,000 results: $10.30 on Free, incl. $0.40 start, plus Apify platform usage (compute)
- Analyze repository languages GitHub Repository Language Breakdown Analyzer 10,000 results: $10.30 on Free, incl. $0.40 start, plus Apify platform usage (compute)
- Discover marketplace listings GitHub Marketplace App & Action Listings by Category Only this one: listingType, slug, installedCount 10,000 results: $10.30 on Free, incl. $0.40 start, plus Apify platform usage (compute)
Route map
Each line is one way to get GitHub data; each stop is a field you probably need. Green lines are catalogue Actors, ranked by the published formula.
- 1 GitHub Repository Metadata & README Extractor 19 output fields, pay per event 5 of 6 core fields
$0.99 / 1K - 2 GitHub Weekly Trending Repos & Org Repo Finder 9 output fields, pay per event 4 of 6 core fields
$0.99 / 1K - 3 GitHub Repository Language Breakdown Analyzer 9 output fields, pay per event 3 of 6 core fields
$0.99 / 1K - 4 GitHub Marketplace App & Action Listings by Category 9 output fields, pay per event 2 of 6 core fields
$0.99 / 1K - + 6 other Store tools, combined Reference only 5 of 6 core fields
from $0.23 / 1K - API GitHub REST API Public API fields not compared
Stops are fields. A ring means the field is in that route's published output schema; no ring means the line passes without it. Bold labels are the core fields for this website, the rest are fields that differ between routes. A white capsule means every data line stops there. The red line is the official API; its field coverage is not compared. A crossed red line means there is no open official API.
Catalogue Actors for GitHub
GitHub Repository Metadata & README Extractor
Fetch stars, forks, topics, license, language breakdown and README text for GitHub repositories, by search query or a direct list of repository…
GitHub Weekly Trending Repos & Org Repo Finder
Find GitHub repositories gaining stars this week, run keyword searches across all public repos, or list an organization's public repos with stars,…
GitHub Repository Language Breakdown Analyzer
Pull repositories for a GitHub organization, a keyword search, or a single repo, with per-repo programming-language percentage breakdown, stars,…
Which route for which job
The catalogue Actors for GitHub return different records. "Only this route" lists the published fields no other Actor in this table returns, which is usually what decides the choice. Cost is the published per-result rate; start events and platform usage are extra.
| Actor | Good for | Only this route | Core fields | 10K results |
|---|---|---|---|---|
| GitHub Repository Metadata & README Extractor | Research repositories | watchers, subscribersCount, openIssues, visibility, createdAt | 5/6 | $9.90 |
| GitHub Weekly Trending Repos & Org Repo Finder | Discover trending repositories | trendingRank | 4/6 | $9.90 |
| GitHub Repository Language Breakdown Analyzer | Analyze repository languages | no unique fields | 3/6 | $9.90 |
| GitHub Marketplace App & Action Listings by Category | Discover marketplace listings | listingType, slug, installedCount, planType, verifiedPublisher | 2/6 | $9.90 |
Field matrix: who returns what
Every tool with a published output schema, against the 6 fields most GitHub jobs need. A dot means the field name appears in the schema; rows can still leave it empty.
| Tool | repo | stars | language | description | updated at | url | Fields |
|---|---|---|---|---|---|---|---|
| GitHub Repository Metadata & README Extractor | – | ● | ● | ● | ● | ● | 5/6 |
| GitHub Weekly Trending Repos & Org Repo Finder | – | ● | ● | ● | – | ● | 4/6 |
| GitHub Repository Language Breakdown Analyzer | – | ● | ● | – | – | ● | 3/6 |
| GitHub Marketplace App & Action Listings by Category | – | ● | – | – | – | ● | 2/6 |
| GitHub Repositories Search ScraperReference only, by fetch_cat | – | ● | ● | ● | ● | ● | 5/6 |
| GitHub Repository & Trending ScraperReference only, by rupom888 | – | ● | ● | ● | ● | ● | 5/6 |
| GitHub Repository ScraperReference only, by logiover | – | ● | ● | ● | ● | ● | 5/6 |
| GitHub Repository Search & ScraperReference only, by scrapeworks | – | ● | ● | ● | – | ● | 4/6 |
| GitHub Repository IntelligenceReference only, by benthepythondev | – | ● | ● | ● | – | ● | 4/6 |
| Github Repository AnalyzerReference only, by constant_quadruped | – | – | – | – | – | ● | 1/6 |
| Tools returning it | 0 | 9 | 8 | 7 | 4 | 10 |
Field dictionary: the exact keys
The same core field has a different key in each Actor's output. Map these before you merge datasets; a dash means the published schema has no matching key. Need a field that is not listed here, such as email? Search every GitHub Actor by field.
| Core field | GitHub Repository Metadata… | GitHub Weekly Trending Repos… | GitHub Repository Language… |
|---|---|---|---|
| repo | – | – | – |
| stars | stars | stars | stars |
| language | primaryLanguage | language | language |
| description | description | description | – |
| updated at | updatedAt | – | – |
| url | htmlUrl | repoUrl | repoUrl |
Download this comparison: CSV · JSON (every tool with a published schema, matching keys per core field, price and score).
All 12 tools, scored
Catalogue Actors link to their detail pages; the score (0 to 100) is the published formula, identical for every tool. Other Store tools follow in their own table, for reference. Price is the published primary-result rate per 1,000 (the Free-plan rate where the price is tiered; higher Apify plans pay less); start events and platform usage are excluded.
| Sample fields | ||||||
|---|---|---|---|---|---|---|
| 82 | GitHub Repository Metadata & README Extractor Catalogue Actor, pay per event | stars, primaryLanguage, description | 19 | $0.99 | 1 run, too few to rate | Nov 2026 |
| 77 | GitHub Weekly Trending Repos & Org Repo Finder Catalogue Actor, pay per event | stars, language, description | 9 | $0.99 | 1 run, too few to rate | Nov 2026 |
| 72 | GitHub Repository Language Breakdown Analyzer Catalogue Actor, pay per event | stars, language, repoUrl | 9 | $0.99 | 3 runs, too few to rate | Nov 2026 |
| 67 | GitHub Marketplace App & Action Listings by Category Catalogue Actor, pay per event | stars, url, name | 9 | $0.99 | 1 run, too few to rate | Nov 2026 |
Other Store tools, for reference
Scored with the same published formula and listed for comparison only; this site does not link or recommend them.
| Sample fields | ||||||
|---|---|---|---|---|---|---|
| 93 | GitHub Repositories Search Scraper Reference only, by fetch_cat | stars, language, description | 42 | $0.23 | 96% of 309 runs | Nov 2026 |
| 92 | GitHub Repository & Trending Scraper Reference only, by rupom888 | stars, language, description | 8 | $0.50 | 98% of 168 runs | May 2026 |
| 91 | GitHub Repository Scraper Reference only, by logiover | stars, language, description | 25 | $1.99 | 100% of 35 runs | Nov 2026 |
| 84 | GitHub Repository Search & Scraper Reference only, by scrapeworks | stars, language, description | 8 | $2.00 | 89% of 140 runs | Jul 2026 |
| 72 | GitHub Repository Scraper Reference only, by cloud9_ai | No published schema | – | $2.00 | 100% of 52 runs | Oct 2026 |
| 69 | GitHub Repository Intelligence Reference only, by benthepythondev | stars, language, description | 8 | $20 | 100% of 36 runs | Nov 2026 |
| 64 | GitHub Reference only, by moving_beacon-owner1 | No published schema | – | $10 | 100% of 48 runs | Jul 2026 |
| 63 | Github Repository Analyzer Reference only, by constant_quadruped | repositoryUrl, owner, name | 25 | not listed | 100% of 36 runs | Oct 2026 |
Official API route
GitHub REST API
The GitHub REST API exposes repositories, issues, releases, users, organisations and more. A token raises rate limits.
Price. No per-call fee for standard REST API use.
Limits. Unauthenticated requests have a lower hourly limit; authenticated requests have a higher one.
Terms and personal data
Public repository data only; respect licences and rate limits. This is general information, not legal advice.
Read GitHub's terms. Keep to public data, do not bypass logins or access controls, and check whether personal data is involved before you collect it. The can-I-scrape checklist walks through it.
How to start
- Open GitHub Repository Metadata & README Extractor and start from its default input; its Actor page has the full example input and code.
- Set the GitHub search, profile, listing or URL you need and a result limit.
- Run it and export the dataset as JSON, CSV or Excel, or call it from the Apify API.
Call GitHub Repository Metadata & README Extractor from code
The example input uses the Actor's published defaults; set your own GitHub query before you run it. You need an Apify API token.
Python
from apify_client import ApifyClient
client = ApifyClient("<YOUR_APIFY_TOKEN>")
run_input = {
"mode": "search",
"searchQuery": "stars:>10000 language:python",
"repositoryUrls": [
"https://github.com/apify/crawlee"
],
"sortBy": "stars",
"sortOrder": "desc",
"minStars": 0,
"minForks": 0,
"includeForks": False,
"includeArchived": True,
"maxResults": 30,
"includeReadme": True,
"includeTopics": True,
"includeLanguages": True,
"includeRepoDetails": False,
"includeReleases": False,
"releasesLimit": 10,
"includeContributors": False,
"contributorsLimit": 30,
"includeActivity": False
}
run = client.actor("nimbryxo-studio/github-repository-metadata-and-readme-extractor").call(run_input=run_input)
if run is None:
raise RuntimeError("The Actor run was not found.")
for item in client.dataset(run.default_dataset_id).iterate_items():
print(item) pip install apify-client
JavaScript
import { ApifyClient } from "apify-client";
const client = new ApifyClient({ token: "<YOUR_APIFY_TOKEN>" });
const input = {
"mode": "search",
"searchQuery": "stars:>10000 language:python",
"repositoryUrls": [
"https://github.com/apify/crawlee"
],
"sortBy": "stars",
"sortOrder": "desc",
"minStars": 0,
"minForks": 0,
"includeForks": false,
"includeArchived": true,
"maxResults": 30,
"includeReadme": true,
"includeTopics": true,
"includeLanguages": true,
"includeRepoDetails": false,
"includeReleases": false,
"releasesLimit": 10,
"includeContributors": false,
"contributorsLimit": 30,
"includeActivity": false
};
const run = await client.actor("nimbryxo-studio/github-repository-metadata-and-readme-extractor").call(input);
const { items } = await client.dataset(run.defaultDatasetId).listItems();
console.log(items); npm install apify-client
cURL
curl -X POST "https://api.apify.com/v2/actors/nimbryxo-studio~github-repository-metadata-and-readme-extractor/run-sync-get-dataset-items" -H "Authorization: Bearer $APIFY_TOKEN" -H "Content-Type: application/json" -d '{"mode":"search","searchQuery":"stars:>10000 language:python","repositoryUrls":["https://github.com/apify/crawlee"],"sortBy":"stars","sortOrder":"desc","minStars":0,"minForks":0,"includeForks":false,"includeArchived":true,"maxResults":30,"includeReadme":true,"includeTopics":true,"includeLanguages":true,"includeRepoDetails":false,"includeReleases":false,"releasesLimit":10,"includeContributors":false,"contributorsLimit":30,"includeActivity":false}' Waits for the run and returns the dataset items (runs over 300 seconds return HTTP 408; start an async run instead).
MCP (AI agents)
{
"mcpServers": {
"apify": {
"url": "https://mcp.apify.com?tools=nimbryxo-studio/github-repository-metadata-and-readme-extractor",
"headers": {
"Authorization": "Bearer <YOUR_APIFY_TOKEN>"
}
}
}
} Adds this Actor as a tool in an MCP client that takes a remote server URL (Cursor, VS Code, Claude Code) through Apify's hosted MCP server. OAuth sign-in also works without the header. Clients that only start local servers can wrap the URL with npx mcp-remote.
Questions people ask
What is the cheapest catalogue Actor for GitHub data?
GitHub Repository Metadata & README Extractor lists $0.99 per 1,000 results (pay per event), with 19 fields in its published output schema. Start events and platform usage are billed separately. Checked 2026-11-11.
Which GitHub scraper returns the most core fields?
GitHub Repository Metadata & README Extractor covers 5 of the 6 core GitHub fields this page tracks (repo, stars, language, description, updated at, url), based on its published output schema.
Does GitHub have an official API?
Public API: The GitHub REST API exposes repositories, issues, releases, users, organisations and more. A token raises rate limits. No per-call fee for standard REST API use.
Is it legal to scrape GitHub?
It depends on what you collect and how. Public repository data only; respect licences and rate limits. Read GitHub's terms (https://docs.github.com/en/site-policy/github-terms/github-terms-of-service) before you collect, and check whether personal data is involved. This is general information, not legal advice.
More on GitHub
Related websites
- Product Hunt1 Actor
Sources
- GitHub Repository Metadata & README Extractor on Apify Store
- GitHub Weekly Trending Repos & Org Repo Finder on Apify Store
- GitHub Repository Language Breakdown Analyzer on Apify Store
- GitHub Marketplace App & Action Listings by Category on Apify Store
- GitHub REST API documentation
- GitHub terms
Cite this page
Scraper Finder. "How to get GitHub data." https://scraperfinder.com/sites/github/ (data checked 2026-11-11).
Highest-scoring catalogue Actor
GitHub Repository Metadata & README Extractor: 5 of 6 core fields, $0.99 per 1,000 results, score 82. The highest score overall is 93 (GitHub Repositories Search Scraper, a Store tool from another publisher); both are in the table above.