Migrate from Groq Cloud to Railwail

TL;DR — Switch in Under 5 Minutes

• Both APIs are OpenAI-compatible — change baseURL and key only
• Llama 3.3, Mixtral, Gemma 2, Whisper available on Railwail
• EU-hosted endpoint, EUR billing
• Plus 270+ other models including Claude, GPT-4o, Gemini
• When you need Groq-level throughput, Railwail routes to LPU providers transparently

Why Move Off Groq Cloud?

Groq's LPU hardware delivers exceptional throughput on open-source LLMs. The constraint is catalog size — Groq Cloud only hosts a small selection of open models, has no closed-source frontier models, US-only hosting, and USD billing. Railwail gives you the Groq-style throughput for open models plus everything else.

Step 1 — Get a Railwail API Key

Sign up at railwail.com and generate a key.

Step 2 — Change Base URL

TypeScript / JavaScript

Before (Groq):

import OpenAI from "openai";

const groq = new OpenAI({
  apiKey: process.env.GROQ_API_KEY,
  baseURL: "https://api.groq.com/openai/v1",
});

const res = await groq.chat.completions.create({
  model: "llama-3.3-70b-versatile",
  messages: [{ role: "user", content: "Hello" }],
});

import OpenAI from "openai";

const client = new OpenAI({
  apiKey: process.env.RAILWAIL_API_KEY,
  baseURL: "https://api.railwail.com/v1",
});

const res = await client.chat.completions.create({
  model: "llama-3.3-70b-instruct",
  messages: [{ role: "user", content: "Hello" }],
});

Python

from openai import OpenAI

client = OpenAI(
    api_key=os.environ["RAILWAIL_API_KEY"],
    base_url="https://api.railwail.com/v1",
)

resp = client.chat.completions.create(
    model="llama-3.3-70b-instruct",
    messages=[{"role": "user", "content": "Hello"}],
)
print(resp.choices[0].message.content)

cURL

curl https://api.railwail.com/v1/chat/completions \
  -H "Authorization: Bearer $RAILWAIL_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{
    "model": "llama-3.3-70b-instruct",
    "messages": [{"role": "user", "content": "Hello"}]
  }'

API Endpoint Mapping

Model Mapping

Pricing Comparison (per 1M tokens, May 2026)

Why Railwail Over Groq Cloud

• EU billing in EUR with VAT receipts
• EU hosting for GDPR compliance
• Same OpenAI-compatible API
• Adds Claude, GPT-4o, Gemini, Flux — Groq has no closed-source models
• Built-in playground for cross-model A/B testing
• Comparable per-token pricing

FAQ

Do I get Groq's LPU speed on Railwail?

For open-source models, Railwail routes to LPU and high-throughput vLLM providers transparently. Token-per-second throughput is typically within 20% of Groq's direct LPU endpoints, while first-token latency to EU customers is usually faster because of the closer edge.

What about Groq's whisper-large-v3-turbo?

Available as whisper-large-v3-turbo on Railwail with the same speed-up vs the standard model.

Are tool calls supported?

Yes. Tool/function calling on Llama 3.3 70B works through the standard OpenAI tools schema.

What about the JSON mode?

response_format: { type: 'json_object' } and response_format with json_schema are both supported.

Will my Groq prompts produce identical output?

Same weights, same temperature → same output distribution. Minor token-by-token differences may occur due to different sampling kernels.

Next Steps

• Sign up at railwail.com
• Generate an API key
• Update baseURL and model slug
• Read the reference at railwail.com/docs
• Browse models at railwail.com/models
• Compare pricing at railwail.com/pricing