BiomedBERT (PubMedBERT abstract)

huggingface
Embeddings

Microsoft BiomedBERT (formerly PubMedBERT) pretrained from scratch on PubMed abstracts with a domain-specific vocabulary, rather than adapting a general model. As a feature extractor it gives 768-dim biomedical embeddings and set the original state of the art on the BLURB biomedical NLP benchmark.

Embed with BiomedBERT (PubMedBERT abstract)
Vectorize text and preview the first 8 dimensions as a bar chart.
Sign in to try this model with €5 free credits.
Sign in
Outputs a high-dimensional vector you can plug into RAG or search.
Vector preview appears here.
TL;DR·Last updated June 24, 2026

BiomedBERT (PubMedBERT abstract) is embeddings AI model from huggingface, priced at €0.000 per 1M input tokens with a 512 tokens context window.

About this model

BiomedBERT, originally released as PubMedBERT, was trained from random initialization purely on biomedical text from PubMed, with its vocabulary learned from that same corpus. Microsoft's research showed that domain-specific pretraining from scratch beats continual pretraining of general BERT for biomedicine, and the model topped the BLURB benchmark. This abstract-only checkpoint is the most widely used variant. Through the Hugging Face feature-extraction pipeline it returns contextual token embeddings; mean-pool or take [CLS] for sentence and document vectors.
Try BiomedBERT (PubMedBERT abstract)
Sign in to generate — 50 free credits on sign-up

Pricing

Price per Generation
Per generation€1.00

API Integration

Use our OpenAI-compatible API to integrate BiomedBERT (PubMedBERT abstract) into your application.

Install
npm install railwail
JavaScript / TypeScript
import railwail from "railwail";

const rw = railwail("YOUR_API_KEY");

const vectors = await rw.run("biomedbert-base-uncased-abstract", "Hello world", { type: "embed" });
console.log(vectors[0].length); // embedding dimensions

// Or use the embed() method for full control
const res = await rw.embed("biomedbert-base-uncased-abstract", ["Hello", "World"]);
for (const item of res.data) {
  console.log(item.embedding.length);
}
Specifications
Price
€1.00
Context window
512 tokens
Developer
huggingface
Category
Embeddings
Supported Formats
text
Tags
science
embedding
research
huggingface
biomedbert
pubmedbert
microsoft
biomedical

Frequently asked questions

Related Models

View all Embeddings

Start using BiomedBERT (PubMedBERT abstract) today

Get started with free credits. No credit card required. Access BiomedBERT (PubMedBERT abstract) and 100+ other models through a single API.