482 scrapers live47.7K runs1,562 usersRebuilt in the last 30 days: 482 of 482

Scrapers / News & Public Data

PubMed Scraper logo

PubMed Scraper

hipersoft/pubmed-scraper

Bulk-scrape PubMed's 35M+ biomedical articles: title, abstract, authors, journal, publication date, DOI, PMC ID, MeSH terms and keywords. Full PubMed query syntax, date filters, thousands of results per run. Powered by NCBI E-utilities. No setup.

Total users

1

Monthly users

1

Total runs

107

Per article scraped

$0.001

Last rebuilt

Oct 28, 2026

Overview

Bulk-scrape biomedical literature from PubMed — the U.S. National Library of Medicine's index of 35M+ articles. Get titles, full abstracts, authors, journals, publication dates, DOIs, PMC IDs, MeSH terms and keywords for every matching paper. Full PubMed query syntax, date filters, and thousands of results per run. Powered by the official NCBI E-utilities API. No account, no API key.

PubMed Scraper input — query, date range and result limit in the Apify Console

Features

  • 🔎 Full PubMed query syntax — terms, fields ([Title], [Author], [MeSH]), booleans and date ranges
  • 📄 Full abstracts — complete abstract text for every article that has one
  • 👥 Authors — full author lists with a count per paper
  • 🏷️ Rich metadata — journal, publication date, DOI, PMC ID, MeSH terms, keywords, article types
  • 📅 Date filters — restrict by publication date
  • 📊 Bulk & history-paginated — one query streams through tens of thousands of results
  • ⚡ Official & reliable — built on NCBI E-utilities

What you get

PubMed Scraper output example — biomedical articles with abstracts, authors and MeSH terms as structured JSON

One record per article:

{
  "pmid": "38512345",
  "title": "…",
  "journal": "Nature Medicine",
  "pubYear": 2024,
  "pubDate": "2024 Mar 15",
  "authors": ["Jane A Smith", "…"],
  "authorCount": 8,
  "doi": "10.1038/s41591-024-00000-0",
  "pmcId": "PMC10987654",
  "articleTypes": ["Journal Article"],
  "meshTerms": ["CRISPR-Cas Systems", "Gene Editing"],
  "keywords": ["…"],
  "url": "https://pubmed.ncbi.nlm.nih.gov/38512345/",
  "abstract": "…"
}

Output schema

Field Type Description
pmid string PubMed ID of the article.
title string Article title.
journal string Journal the article was published in.
pubYear integer Publication year.
pubDate string Full publication date as printed by PubMed.
authors array List of author names.
authorCount integer Number of authors on the article.
doi string Digital Object Identifier of the article.
pmcId string PubMed Central ID, when the full text is in PMC.
articleTypes array Publication types (e.g. Journal Article, Review).
meshTerms array Assigned MeSH subject headings.
keywords array Author-supplied keywords.
url string (URL) Link to the article on PubMed.
abstract string Full abstract text (when includeAbstract is on).

Input

{
  "query": "crispr gene editing",
  "dateFrom": "2020",
  "dateTo": "2025",
  "includeAbstract": true,
  "maxResults": 5000
}
Field Description
query Any PubMed search (e.g. asthma[MeSH] AND treatment, covid-19 AND vaccine[Title]).
dateFrom / dateTo Publication date range (YYYY/MM/DD or YYYY).
includeAbstract Include the full abstract text.
maxResults Max articles to return (a broad query can match tens of thousands).
apiKey Optional NCBI key to raise the request rate for very large runs.

Use cases

  • Systematic & literature reviews — pull every paper on a topic, with abstracts, in one run
  • Research monitoring — track new publications in your field by date
  • Biomedical datasets — build corpora of titles + abstracts for analysis or AI
  • Citation & metadata — collect DOIs, PMC IDs and MeSH terms at scale

Pricing

Pay-per-event: a small amount per article scraped. See the Pricing tab for current rates.

FAQ

Do I need an API key? No. This Actor runs on the official NCBI E-utilities API with no account required. You can optionally add an NCBI apiKey to raise the request rate for very large runs, but it's not needed for typical use.

How many articles can I scrape per run? Set maxResults as high as you need — a single query streams through PubMed's history server, so one broad query can return tens of thousands of articles in a run.

Is scraping PubMed legal? Yes. This Actor uses PubMed's official NCBI E-utilities API and follows its usage guidance (paced requests, an identified client). It returns openly available metadata as-is.

What format is the output? Structured JSON — one record per article — exportable as JSON, CSV or Excel. Each record includes PMID, title, full abstract, authors, journal, publication date, DOI, PMC ID, MeSH terms and keywords.

Can I filter by date or use PubMed field syntax? Yes. The query field accepts full PubMed syntax including fields like [Title], [Author] and [MeSH] plus booleans, and dateFrom/dateTo restrict results to a publication date range.

Can I integrate this with other tools? The PubMed Scraper can be connected with almost any cloud service or web app thanks to integrations on the Apify platform. It works with Make, Zapier, Slack, Airbyte, GitHub, Google Drive and many more, plus the Apify API, JavaScript/Python clients and MCP. Or use webhooks to trigger an action whenever a run finishes.

Building a biomedical literature dataset? These other hipersoft scrapers pair well with this one:

Notes

Uses the official NCBI E-utilities API and follows its usage guidance (paced requests, identified client). Returns PubMed's openly-available metadata as-is. PubMed is a service of the U.S. National Library of Medicine; this is an independent tool and is not affiliated with or endorsed by the NLM or NCBI.

Input

FieldTypeDescription
query required
PubMed query
stringAny PubMed search query. Supports full syntax: terms, fields ([Title], [Author], [MeSH]), booleans, and date ranges. e.g. "crispr gene editing", "asthma[MeSH] AND treatment", "covid-19 AND vaccine[Title]".
dateFrom
Published from
stringEarliest publication date (YYYY/MM/DD or YYYY). Optional.
dateTo
Published to
stringLatest publication date (YYYY/MM/DD or YYYY). Optional.
includeAbstract
Include abstracts
booleanInclude the full abstract text for each article.
Default: true
maxResults
Max results
integerMaximum number of articles to return (a broad query can match tens of thousands).
Default: 1000
apiKey
NCBI API key (optional)
stringOptional NCBI API key to raise the request rate (3→10/sec) for faster large runs. Not required.

API

curl -X POST "https://api.apify.com/v2/acts/hipersoft~pubmed-scraper/run-sync-get-dataset-items?token=$APIFY_TOKEN" \
  -H "Content-Type: application/json" \
  -d '{
  "query": "crispr gene editing"
}'

Pricing

EventPricePaid plans from
Article scraped
One PubMed article with metadata and abstract
$0.001$0.0005
API request
One NCBI E-utilities request (a batch of records)
$0.0005$0.0005

You pay only for what the run returns. Set a maximum cost per run and it stops cleanly at that limit.

Related scrapers

Europe PMC Scraper

Bulk-scrape life-science and biomedical literature from Europe PMC (40M+ records: PubMed, PMC, preprints, patents): title, abstract, authors, journal, year, DOI, PMID/PMCID, citation count, MeSH terms, open-access flag and full-text/PDF links. Thousands per run. No setup.

325 runs · 5 users · $0.001 / article scraped

arXiv Papers Scraper

Search and extract arXiv papers: title, abstract, authors, categories, published/updated dates, DOI, journal reference, and direct PDF links. Filter by category and sort by newest, recently updated or relevance. Fetch by arXiv ID too. For research, lit reviews and AI/ML monitoring. No setup.

140 runs · 2 users · $0.0025 / paper scraped

Letterboxd Scraper

Scrape Letterboxd films with ratings, rating counts, genres, director, cast, runtime and synopsis. Feed it film pages, a user's films/watchlist/diary, any list URL, or browse pages. For film data, recommendations and research.

139 runs · 7 users · $0.0042 / film scraped

OpenLibrary Book Scraper

Search millions of books on OpenLibrary by keyword, author, subject or ISBN and get title, authors, publisher, year, subjects, ISBNs, edition count, ratings, page count and cover. Clean, no setup.

124 runs · 5 users · $0.002 / book scraped

Semantic Scholar Scraper

Bulk-scrape academic papers from Semantic Scholar's 200M+ corpus: title, abstract, AI TLDR summary, authors, venue, year, citation & influential-citation counts, fields of study, DOI/PubMed/arXiv IDs and open-access PDF links. Filter by year, field and citations. Thousands per run. No setup.

123 runs · 7 users · $0.001 / paper scraped

Wikipedia Scraper

Search Wikipedia or look up exact articles and get the full plain-text content, summary, categories, image, Wikidata ID and monthly pageview trends. Any language. Great for research, RAG and AI datasets. No setup.

121 runs · 1 users · $0.001 / article scraped
Need a source that isn't here?

Send the site and the fields. We build it and you get it first.

Request a build