GitHub: scrapers and the official API, compared

Repositories, code metadata, issues, releases, users and organisation data.

Short answer

For most GitHub jobs, start with GitHub Repository Metadata & README Extractor: it covers 5 of 6 core fields (stars, language, description, updated at and 1 more) at $0.99 per 1,000 results on Apify's Free plan. The top published score for GitHub goes to GitHub Repositories Search Scraper by fetch_cat (93 of 100), a Store tool from another publisher, listed for reference.

From published Store listings, output schemas and the official documentation. Checked 2026-11-11. How the ranking works.

GitHub Repository Metadata & README Extractor: inputs, code and costOpen in Apify Store

4 catalogue Actors 8 other Store tools Official API: Public API Lowest rate  $0.23 per 1K

What do you need from GitHub?

Route map

Each line is one way to get GitHub data; each stop is a field you probably need. Green lines are catalogue Actors, ranked by the published formula.

Route diagram for GitHub dataGitHub Repository Metadata & README Extractor: stops at 9 of the 10 fields shown; GitHub Weekly Trending Repos & Org Repo Finder: stops at 6 of the 10 fields shown; GitHub Repository Language Breakdown Analyzer: stops at 7 of the 10 fields shown; GitHub Marketplace App & Action Listings by Category: stops at 2 of the 10 fields shown; Other Store tools (6): stops at 9 of the 10 fields shown; GitHub REST API: public, field coverage not compared.GitHublanguagedescriptionupdated atrepostarsurlfullNameforkstopicspushedAt1234+API

Stops are fields. A ring means the field is in that route's published output schema; no ring means the line passes without it. Bold labels are the core fields for this website, the rest are fields that differ between routes. A white capsule means every data line stops there. The red line is the official API; its field coverage is not compared. A crossed red line means there is no open official API.

Catalogue Actors for GitHub

GitHub Repository Metadata & README Extractor

Fetch stars, forks, topics, license, language breakdown and README text for GitHub repositories, by search query or a direct list of repository…

5/6 core fields 19 output fields $0.99 per 1K Open in Apify Store

GitHub Weekly Trending Repos & Org Repo Finder

Find GitHub repositories gaining stars this week, run keyword searches across all public repos, or list an organization's public repos with stars,…

4/6 core fields 9 output fields $0.99 per 1K Open in Apify Store

GitHub Repository Language Breakdown Analyzer

Pull repositories for a GitHub organization, a keyword search, or a single repo, with per-repo programming-language percentage breakdown, stars,…

3/6 core fields 9 output fields $0.99 per 1K Open in Apify Store

Which route for which job

The catalogue Actors for GitHub return different records. "Only this route" lists the published fields no other Actor in this table returns, which is usually what decides the choice. Cost is the published per-result rate; start events and platform usage are extra.

Catalogue Actors for GitHub by job, with the fields only each one returns
Actor Good for Only this route Core fields 10K results
GitHub Repository Metadata & README Extractor Research repositories watchers, subscribersCount, openIssues, visibility, createdAt 5/6 $9.90
GitHub Weekly Trending Repos & Org Repo Finder Discover trending repositories trendingRank 4/6 $9.90
GitHub Repository Language Breakdown Analyzer Analyze repository languages no unique fields 3/6 $9.90
GitHub Marketplace App & Action Listings by Category Discover marketplace listings listingType, slug, installedCount, planType, verifiedPublisher 2/6 $9.90

Field matrix: who returns what

Every tool with a published output schema, against the 6 fields most GitHub jobs need. A dot means the field name appears in the schema; rows can still leave it empty.

Which tools return each core GitHub field, from published output schemas
Toolrepostarslanguagedescriptionupdated aturlFields
GitHub Repository Metadata & README Extractor–●●●●●5/6
GitHub Weekly Trending Repos & Org Repo Finder–●●●–●4/6
GitHub Repository Language Breakdown Analyzer–●●––●3/6
GitHub Marketplace App & Action Listings by Category–●–––●2/6
GitHub Repositories Search ScraperReference only, by fetch_cat–●●●●●5/6
GitHub Repository & Trending ScraperReference only, by rupom888–●●●●●5/6
GitHub Repository ScraperReference only, by logiover–●●●●●5/6
GitHub Repository Search & ScraperReference only, by scrapeworks–●●●–●4/6
GitHub Repository IntelligenceReference only, by benthepythondev–●●●–●4/6
Github Repository AnalyzerReference only, by constant_quadruped–––––●1/6
Tools returning it0987410

Field dictionary: the exact keys

The same core field has a different key in each Actor's output. Map these before you merge datasets; a dash means the published schema has no matching key. Need a field that is not listed here, such as email? Search every GitHub Actor by field.

Output keys for each core GitHub field in the top catalogue Actors
Core field GitHub Repository Metadata…GitHub Weekly Trending Repos…GitHub Repository Language…
repo –––
stars starsstarsstars
language primaryLanguagelanguagelanguage
description descriptiondescription–
updated at updatedAt––
url htmlUrlrepoUrlrepoUrl

Download this comparison: CSV · JSON (every tool with a published schema, matching keys per core field, price and score).

All 12 tools, scored

Catalogue Actors link to their detail pages; the score (0 to 100) is the published formula, identical for every tool. Other Store tools follow in their own table, for reference. Price is the published primary-result rate per 1,000 (the Free-plan rate where the price is tiered; higher Apify plans pay less); start events and platform usage are excluded.

Catalogue Actors for GitHub, ranked by the published method
Sample fields
82
GitHub Repository Metadata & README Extractor Catalogue Actor, pay per event
stars, primaryLanguage, description 19 $0.99 1 run, too few to rate Nov 2026
77
GitHub Weekly Trending Repos & Org Repo Finder Catalogue Actor, pay per event
stars, language, description 9 $0.99 1 run, too few to rate Nov 2026
72
GitHub Repository Language Breakdown Analyzer Catalogue Actor, pay per event
stars, language, repoUrl 9 $0.99 3 runs, too few to rate Nov 2026
67 stars, url, name 9 $0.99 1 run, too few to rate Nov 2026

Other Store tools, for reference

Scored with the same published formula and listed for comparison only; this site does not link or recommend them.

Other Store tools for GitHub, for reference
Sample fields
93
GitHub Repositories Search Scraper Reference only, by fetch_cat
stars, language, description 42 $0.23 96% of 309 runs Nov 2026
92
GitHub Repository & Trending Scraper Reference only, by rupom888
stars, language, description 8 $0.50 98% of 168 runs May 2026
91
GitHub Repository Scraper Reference only, by logiover
stars, language, description 25 $1.99 100% of 35 runs Nov 2026
84
GitHub Repository Search & Scraper Reference only, by scrapeworks
stars, language, description 8 $2.00 89% of 140 runs Jul 2026
72
GitHub Repository Scraper Reference only, by cloud9_ai
No published schema – $2.00 100% of 52 runs Oct 2026
69
GitHub Repository Intelligence Reference only, by benthepythondev
stars, language, description 8 $20 100% of 36 runs Nov 2026
64
GitHub Reference only, by moving_beacon-owner1
No published schema – $10 100% of 48 runs Jul 2026
63
Github Repository Analyzer Reference only, by constant_quadruped
repositoryUrl, owner, name 25 not listed 100% of 36 runs Oct 2026

Official API route

GitHub REST API

The GitHub REST API exposes repositories, issues, releases, users, organisations and more. A token raises rate limits.

Price. No per-call fee for standard REST API use.

Limits. Unauthenticated requests have a lower hourly limit; authenticated requests have a higher one.

Official documentation

Public repository data only; respect licences and rate limits. This is general information, not legal advice.

Read GitHub's terms. Keep to public data, do not bypass logins or access controls, and check whether personal data is involved before you collect it. The can-I-scrape checklist walks through it.

How to start

  1. Open GitHub Repository Metadata & README Extractor and start from its default input; its Actor page has the full example input and code.
  2. Set the GitHub search, profile, listing or URL you need and a result limit.
  3. Run it and export the dataset as JSON, CSV or Excel, or call it from the Apify API.

Call GitHub Repository Metadata & README Extractor from code

The example input uses the Actor's published defaults; set your own GitHub query before you run it. You need an Apify API token.

Python

from apify_client import ApifyClient

client = ApifyClient("<YOUR_APIFY_TOKEN>")
run_input = {
    "mode": "search",
    "searchQuery": "stars:>10000 language:python",
    "repositoryUrls": [
        "https://github.com/apify/crawlee"
    ],
    "sortBy": "stars",
    "sortOrder": "desc",
    "minStars": 0,
    "minForks": 0,
    "includeForks": False,
    "includeArchived": True,
    "maxResults": 30,
    "includeReadme": True,
    "includeTopics": True,
    "includeLanguages": True,
    "includeRepoDetails": False,
    "includeReleases": False,
    "releasesLimit": 10,
    "includeContributors": False,
    "contributorsLimit": 30,
    "includeActivity": False
}

run = client.actor("nimbryxo-studio/github-repository-metadata-and-readme-extractor").call(run_input=run_input)
if run is None:
    raise RuntimeError("The Actor run was not found.")
for item in client.dataset(run.default_dataset_id).iterate_items():
    print(item)

pip install apify-client

JavaScript

import { ApifyClient } from "apify-client";

const client = new ApifyClient({ token: "<YOUR_APIFY_TOKEN>" });
const input = {
    "mode": "search",
    "searchQuery": "stars:>10000 language:python",
    "repositoryUrls": [
        "https://github.com/apify/crawlee"
    ],
    "sortBy": "stars",
    "sortOrder": "desc",
    "minStars": 0,
    "minForks": 0,
    "includeForks": false,
    "includeArchived": true,
    "maxResults": 30,
    "includeReadme": true,
    "includeTopics": true,
    "includeLanguages": true,
    "includeRepoDetails": false,
    "includeReleases": false,
    "releasesLimit": 10,
    "includeContributors": false,
    "contributorsLimit": 30,
    "includeActivity": false
};

const run = await client.actor("nimbryxo-studio/github-repository-metadata-and-readme-extractor").call(input);
const { items } = await client.dataset(run.defaultDatasetId).listItems();
console.log(items);

npm install apify-client

cURL

curl -X POST "https://api.apify.com/v2/actors/nimbryxo-studio~github-repository-metadata-and-readme-extractor/run-sync-get-dataset-items"   -H "Authorization: Bearer $APIFY_TOKEN"   -H "Content-Type: application/json"   -d '{"mode":"search","searchQuery":"stars:>10000 language:python","repositoryUrls":["https://github.com/apify/crawlee"],"sortBy":"stars","sortOrder":"desc","minStars":0,"minForks":0,"includeForks":false,"includeArchived":true,"maxResults":30,"includeReadme":true,"includeTopics":true,"includeLanguages":true,"includeRepoDetails":false,"includeReleases":false,"releasesLimit":10,"includeContributors":false,"contributorsLimit":30,"includeActivity":false}'

Waits for the run and returns the dataset items (runs over 300 seconds return HTTP 408; start an async run instead).

MCP (AI agents)

{
  "mcpServers": {
    "apify": {
      "url": "https://mcp.apify.com?tools=nimbryxo-studio/github-repository-metadata-and-readme-extractor",
      "headers": {
        "Authorization": "Bearer <YOUR_APIFY_TOKEN>"
      }
    }
  }
}

Adds this Actor as a tool in an MCP client that takes a remote server URL (Cursor, VS Code, Claude Code) through Apify's hosted MCP server. OAuth sign-in also works without the header. Clients that only start local servers can wrap the URL with npx mcp-remote.

Questions people ask

What is the cheapest catalogue Actor for GitHub data?

GitHub Repository Metadata & README Extractor lists $0.99 per 1,000 results (pay per event), with 19 fields in its published output schema. Start events and platform usage are billed separately. Checked 2026-11-11.

Which GitHub scraper returns the most core fields?

GitHub Repository Metadata & README Extractor covers 5 of the 6 core GitHub fields this page tracks (repo, stars, language, description, updated at, url), based on its published output schema.

Does GitHub have an official API?

Public API: The GitHub REST API exposes repositories, issues, releases, users, organisations and more. A token raises rate limits. No per-call fee for standard REST API use.

Is it legal to scrape GitHub?

It depends on what you collect and how. Public repository data only; respect licences and rate limits. Read GitHub's terms (https://docs.github.com/en/site-policy/github-terms/github-terms-of-service) before you collect, and check whether personal data is involved. This is general information, not legal advice.

More on GitHub

Sources

Data checked 2026-11-11
Cite this page

Scraper Finder. "How to get GitHub data." https://scraperfinder.com/sites/github/ (data checked 2026-11-11).

Highest-scoring catalogue Actor

GitHub Repository Metadata & README Extractor: 5 of 6 core fields, $0.99 per 1,000 results, score 82. The highest score overall is 93 (GitHub Repositories Search Scraper, a Store tool from another publisher); both are in the table above.

Open in Apify Store