Any News Site Article Extractor
Point this actor at a news website's homepage and get back structured articles: title, authors, publish date, full body text, top image, keywords and a short summary, with keyword and minimum-length filtering.
Open in Apify Store$0.99 / 1K on Free
Short answer
Any News Site Article Extractor is an Apify Store Actor that returns 17 published output fields, including articleUrl, articleTitle, articleAuthors, articlePublishDate. It lists $0.99 per 1,000 results on the Free plan (pay per event), $0.49 on the Business plan. It takes 10 input settings, none required. Last updated Nov 14, 2026.
From the public Store listing and published build schema, synced 2026-11-15.What it returns
17 fields from the published dataset schema. Export as JSON, CSV or Excel, or read the dataset through the Apify API.
articleUrlarticleTitlearticleAuthorsarticlePublishDatearticleModifiedDatearticleSectionarticleWordCountarticleTopImagearticleLanguagearticleKeywordsarticleSummarysourceDomainscrapedAtarticleCanonicalUrlarticleDescriptionarticleImagesarticleSiteName
Input
| Setting | Type | Required | Default | What it does |
|---|---|---|---|---|
| articleUrls | array | No | – | Paste one or more article URLs to extract directly. Any news site works, and no discovery is needed. When both this and News website URL are set, these URLs are processed first. |
| websiteUrl | string | No | – | Homepage, section page, or newsroom URL to discover articles from. The actor reads the site's sitemaps first (including robots.txt entries and gzipped sitemaps) and falls back to article-shaped links on the page itself. Leave blank when using Article URLs. |
| maxArticles | integer | No | 20 | Hard cap on the number of articles returned across all input URLs. |
| keywordFilter | string | No | – | Boolean expression applied to each article's title and body. Supports AND, OR, NOT and parentheses, case-insensitive. Examples: `AI AND NOT crypto`, `(startup OR funding) AND SaaS`. Leave blank to keep every article. |
| minWordCount | integer | No | 100 | Drop articles whose extracted body text is shorter than this. |
| concurrency | integer | No | 5 | Number of articles fetched in parallel. Higher is faster but more likely to trigger rate limits on small sites. |
| extractKeywords | boolean | No | true | Compute the top 10 most frequent content words per article (stopwords removed). |
| extractSummary | boolean | No | true | Emit the first three sentences of each article as a summary, with a meta-description fallback. |
| language | string | No | auto | Language hint for the articles. Use `auto` to detect from site metadata. An explicit language also filters out articles that declare a different one. |
| autoProxyFallback | boolean | No | true | When a direct datacenter-IP fetch is blocked (0 candidates or 0 extracted articles), retry the same requests once through Apify residential proxy. Sites that work directly never trigger it. Turn off to guarantee zero proxy spend. |
Example input
Built from the input form's published example values and defaults.
{
"websiteUrl": "https://techcrunch.com",
"maxArticles": 1,
"minWordCount": 100,
"concurrency": 5,
"extractKeywords": true,
"extractSummary": true,
"language": "auto",
"autoProxyFallback": true
} Run it from code or an AI agent
The same run through the Apify API, with the example input. You need an Apify API token; the run is billed to your account at the Store price.
Python
from apify_client import ApifyClient
client = ApifyClient("<YOUR_APIFY_TOKEN>")
run_input = {
"websiteUrl": "https://techcrunch.com",
"maxArticles": 1,
"minWordCount": 100,
"concurrency": 5,
"extractKeywords": True,
"extractSummary": True,
"language": "auto",
"autoProxyFallback": True
}
run = client.actor("vexaloom-labs/any-news-site-article-extractor").call(run_input=run_input)
if run is None:
raise RuntimeError("The Actor run was not found.")
for item in client.dataset(run.default_dataset_id).iterate_items():
print(item) pip install apify-client
JavaScript
import { ApifyClient } from "apify-client";
const client = new ApifyClient({ token: "<YOUR_APIFY_TOKEN>" });
const input = {
"websiteUrl": "https://techcrunch.com",
"maxArticles": 1,
"minWordCount": 100,
"concurrency": 5,
"extractKeywords": true,
"extractSummary": true,
"language": "auto",
"autoProxyFallback": true
};
const run = await client.actor("vexaloom-labs/any-news-site-article-extractor").call(input);
const { items } = await client.dataset(run.defaultDatasetId).listItems();
console.log(items); npm install apify-client
cURL
curl -X POST "https://api.apify.com/v2/actors/vexaloom-labs~any-news-site-article-extractor/run-sync-get-dataset-items" -H "Authorization: Bearer $APIFY_TOKEN" -H "Content-Type: application/json" -d '{"websiteUrl":"https://techcrunch.com","maxArticles":1,"minWordCount":100,"concurrency":5,"extractKeywords":true,"extractSummary":true,"language":"auto","autoProxyFallback":true}' Waits for the run and returns the dataset items (runs over 300 seconds return HTTP 408; start an async run instead).
MCP (AI agents)
{
"mcpServers": {
"apify": {
"url": "https://mcp.apify.com?tools=vexaloom-labs/any-news-site-article-extractor",
"headers": {
"Authorization": "Bearer <YOUR_APIFY_TOKEN>"
}
}
}
} Adds this Actor as a tool in an MCP client that takes a remote server URL (Cursor, VS Code, Claude Code) through Apify's hosted MCP server. OAuth sign-in also works without the header. Clients that only start local servers can wrap the URL with npx mcp-remote.
What a run costs
The result rate falls on higher Apify plans. Each figure is the published per-result rate times the number of results.
| Apify plan | Per 1,000 | 10,000 results | 100,000 results |
|---|---|---|---|
| Free plan | $0.99 | $9.90 | $99 |
| Starter plan | $0.82 | $8.20 | $82 |
| Scale plan | $0.66 | $6.60 | $66 |
| Business plan | $0.49 | $4.90 | $49 |
- Every run also has a start event, charged per GB of memory (minimum one): $0.10 on Free, $0.03 on Business. At its default memory of 4 GB a run starts at $0.40 on Free. Fewer, larger runs keep this small.
- The Free plan includes $5 of monthly usage (Apify pricing, checked 2026-11-11); at the Free rate that covers at most about 5,050 results, less start events and platform usage.
- Worked example: 10,000 results in one run on the Free plan cost $10.30 ($9.90 for results + $0.40 start), plus Apify platform usage (compute), billed separately by Apify.
- Pay per event. Platform usage (compute) is billed by Apify on top of the event prices. Compare other tools in the cost estimator.
Similar Actors
Yandex News Story Clusters Across Russia & the CIS
Search or browse Yandex News and get story clusters with every linked article, topic tags, source names and publication dates across Russian and…
Crunchbase News & Funding Coverage Scraper
Extract Crunchbase's editorial news articles on startup funding, M&A, IPOs and tech trends: full text, author, publish date, categories, tags and…
Google News Keyword & Full-Text Article Scraper
Search Google News by keyword with real resolved article links, headlines, sources, and dates, plus optional full article text and image…
Patch.com Local News, Events & Classifieds Finder
Search Patch.com's hyperlocal US news by keyword, town, category, author, or tag, and browse its local events calendar or classifieds board, with…
Yahoo News Trending, Category & Keyword Feed by Region
Get Yahoo News trending top stories, category feeds, or keyword-filtered headlines across six regional editions, with source, publish date, image,…
Apartment Therapy Article Scraper
Scrape articles from Apartment Therapy - home decor, interior design, DIY, and small-space content from apartmenttherapy.com, with title, author,…
Questions people ask
How much does Any News Site Article Extractor cost?
The published result rate depends on your Apify plan: $0.99 per 1,000 on Free, $0.82 per 1,000 on Starter, $0.66 per 1,000 on Scale, $0.49 per 1,000 on Business. So 10,000 results cost about $9.90 on the Free plan and $4.90 on Business, plus a start fee of $0.10 per run per GB of memory on Free. Platform usage is billed separately.
What data does Any News Site Article Extractor return?
Its published output schema lists 17 fields: articleUrl, articleTitle, articleAuthors, articlePublishDate, articleModifiedDate, articleSection, articleWordCount, articleTopImage, articleLanguage, articleKeywords, articleSummary, sourceDomain, and 5 more. A listed field is not guaranteed to be filled in every row.
What input does Any News Site Article Extractor need?
No input is strictly required; the defaults run as is. Common settings: articleUrls, websiteUrl, maxArticles, keywordFilter, minWordCount, concurrency.
How do I run Any News Site Article Extractor from Python or the API?
Use the Apify API client: in Python, ApifyClient(token).actor("vexaloom-labs/any-news-site-article-extractor").call(run_input=...), then read the run's default dataset (run.default_dataset_id); in JavaScript the same call is client.actor("vexaloom-labs/any-news-site-article-extractor").call(input). Without a client, POST the input JSON to https://api.apify.com/v2/actors/vexaloom-labs~any-news-site-article-extractor/run-sync-get-dataset-items with your API token. Ready-to-paste code with the example input is on this page.
Sources
Cite this page
Scraper Finder. "Any News Site Article Extractor." https://scraperfinder.com/catalogue/any-news-site-article-extractor/ (data checked 2026-11-15).
Run Any News Site Article Extractor
$0.99 per 1,000 results. Paste the example input above, set your target query, then export the dataset.