Ferret — Parsers Overview
333 parsers, 39 categories, build OK, 10GB RAM free Updated: June 18, 2026
Summary
| Metric | Value |
|---|---|
| Total parsers | 333 |
| 🇫🇷 France | 49 (data.gouv.fr, national APIs) |
| 🇬🇧 UK / 🇯🇵 Japan / 🇨🇦 Canada | 3 CKAN portals |
| 🌍 International & APIs | ~283 |
| ✅ Benchmark OK | 269/325 (82.8%) |
| Build | ✅ 0 errors |
| Free RAM | 10 GB |
| Obscura headless | 46MB (4 instances) |
| 597 User-Agents | ✅ rotation |
| 1446 CMS signatures | ✅ imported |
Parser Categories (39)
| Category | Count | Examples |
|---|---|---|
| 🌐 Web Search | ~20 | Bing, DDG, Brave, Google, Yahoo, Yandex, Baidu, AOL, Qwant, Startpage, Dogpile, You, Ask, Rambler |
| 🛒 E-commerce | ~12 | Amazon, Steam, Booking, eBay, Aliexpress, Wildberries, Etsy, Reverb, Cheapshark |
| 💰 Finance & Crypto | ~15 | Yahoo Finance, Binance, Kraken, CoinPaprika, CoinGecko, Alpha Vantage, Fear & Greed, ECB, Floatrates |
| 🇫🇷 France | 49 | data.gouv.fr, Communes, Adresse, Carburants, SIRENE, DVF, ANSM, SNCF gares — see France parsers |
| 📱 Social | ~15 | Reddit, Instagram, TikTok, Pinterest, Lemmy, Quora, Medium, Weibo, Bilibili |
| 📊 SEO | ~15 | Whois, DNS, CMS (1446 sig.), Cache, Position, Pagespeed, Robots.txt, hreflang, OpenGraph |
| 💻 Dev | ~12 | GitHub, PyPI, Crates.io, NPM, OpenRouter, MDN, OpenAPI, StackExchange, Docker Hub |
| 🎵 Music & Culture | ~8 | Deezer, MusicBrainz, TVMaze, iTunes, Audiodb, Musixmatch, Jikan (anime) |
| 🌤️ Weather & Environment | ~6 | Open-Meteo, NOAA, Air Quality, wttr.in, Carbon intensity, Global warming |
| 🚀 DevOps | ~5 | Docker Hub, NPM, GitLab, GitHub Status |
| 🎮 Games | ~5 | Steam, BoardGameGeek, Pokémon |
| 🎨 Art | ~6 | Met Museum, Art Institute of Chicago, Cleveland Museum |
| 🔬 Science & Space | ~8 | PubChem, USGS, ISS, SpaceX, NASA, Spaceflight, Astronauts |
| 🌍 Travel & Transport | ~6 | OpenTripMap, SBB, CityBikes, OpenSky, Booking, TripAdvisor |
| 🚗 Vehicles | ~3 | NHTSA Recalls |
| 📰 News | ~6 | Hacker News, Spaceflight, BBC News, Bing News, Google News |
| 💊 Health | ~4 | FDA, WHO, PubChem, ANSM médicaments |
| 🎓 Education & Research | ~6 | OpenAlex, Crossref, ISSN, University rankings, OpenLibrary |
| 🎯 Utilities | ~15 | GeoIP, Currency, QR Code, Whois, DNS, IPify, Zippopotamus, Nationalize, Genderize |
| 📡 Open Data | ~8 | CKAN (generic), UK, Japan, Canada, OpenDataSoft, Eurostat, World Bank |
France — 49 parsers
A detailed breakdown of the 49 French parsers, organized by category. See the France parsers page for full request examples.
| Category | Count | Parsers |
|---|---|---|
| Government | 6 | datasets, orgs, stats, topics, search, reuses (data.gouv.fr) |
| Geo | 6 | communes, départements, régions, adresse (BAN), reverse geocode, code postal |
| Economy | 4 | DVF (50 items), immobilier, loyers, SIRENE |
| Business | 2 | API Entreprises, RNA associations |
| Health | 3 | médicaments (ANSM), médecins (RPPS), water quality |
| Transport | 3 | bornes électriques, covoiturage, gares SNCF |
| Education | 2 | établissements, calendrier scolaire |
| Culture | 2 | musées, monuments |
| Services | 4 | services publics, bibliothèques, toilettes, parkings |
| Environment | 4 | air quality, risques, arbres, eau potable |
| Misc | 8 | carburants, décès, députés, élections, sport, marchés, ZRR, search |
International — New parsers
| Type | Endpoint | Status |
|---|---|---|
| UK data.gov.uk | /data/uk?q=population | ✅ 10 datasets |
| Japan data.go.jp | /data/japan?q=population | ✅ 10 datasets |
| Canada open.canada.ca | /data/canada?q=economy | ✅ 10 datasets |
| CKAN generic | /data/ckan?host=...&q=... | ✅ Any CKAN portal |
| Spain datos.gob.es | /data/spain?q=economia | ⚠️ Non-standard API |
| Ireland data.gov.ie | /data/ireland?q=population | ⚠️ Different path |
| Eurostat GDP | /economy/gdp/eurostat?q=FR | ✅ 12 items |
| Eurostat Population | /economy/population/eurostat?q=FR | ✅ 12 items |
| BBC News | /news/bbc?q=technology | ✅ 38 articles |
| PeerTube | /videos/peertube?q=rust | ✅ 20 videos |
| Internet Archive | /search/archive-org?q=rust | ✅ 10 results |
| OpenDataSoft | /data/opendatasoft?q=population | ✅ 11 datasets |
| WHO Health | /health/who | ✅ 30 indicators |
| SWAPI (Star Wars) | /starwars?q=luke | ✅ 1 character |
| Open Trivia | /quiz?q=general | ✅ 10 questions |
| AudioDB | /music/artist/audiodb?q=beatles | ✅ 1 artist |
| IPify | /ipify | ✅ Public IP |
| IP-API.com | /geo/ip-api?q=8.8.8.8 | ✅ Geolocation |
| Zippopotamus | /geo/zip/us?q=10001 | ✅ US ZIP code |
| Nationalize | /names/nationalize?q=john | ✅ 6 countries |
| Genderize | /names/genderize?q=john | ✅ Prediction |
| Meow Facts | /cats/facts/meow | ✅ Cat facts |
Infrastructure
- Obscura headless — 46MB RAM, 4 instances (ports 9322–9325),
--stealthanti-detection - 9 5G proxies — automatic rotation via x-proxy (ports 4001–4005, 6001–6005)
- 597 User-Agents — rotating
- 1446 CMS signatures — imported
- Export — CSV / XML / JSON via
?format= - Batch mode —
POST /batch - Pagination — standard
pagecount - Cache — LRU + optional Redis
- Auto-tuning timeout — EMA-based
- Gateway MCP API key — port 9097
- Auto-detected benchmark —
bench.py - systemd user services —
ferret.service(REST 9093) +ferret-mcp.service(MCP 9094) - Cleanup script —
scripts/kill-obscura.sh
Related
- France parsers — full detail of the 49 French parsers
- Business endpoints — cross-cutting analyses built on top of these parsers
- Benchmark — 269/325 routes passing (82.8%)