Skip to content

lobstr.io banner

Get the data you need

Thousands of companies of all sizes — from startups to large enterprises — use lobstr.io's software and APIs to collect data and automate repetitive actions online.

X / Twitter LinkedIn YouTube

Store Docs Blog Help Center


Why lobstr.io ⚡

Building a scraper from scratch means handling proxies, captchas, account bans, exports, scheduling, and a dozen edge cases per platform. lobstr.io packages 50+ production-ready scrapers — we call them Squids — that already solve those problems, accessible from a no-code dashboard or programmatically via API, SDK, CLI, and MCP.

  • No-code dashboard and a full API. Most platforms force a choice. Launch ad-hoc work from the UI in three clicks, then graduate to the SDK or CLI for production pipelines — same Squids, same data, same credit pool.
  • One-click account sync, no password sharing. A browser add-on captures your cookies for LinkedIn, Sales Navigator, Facebook, Leboncoin, X/Twitter, and TikTok. lobstr.io scrapes through your authenticated session — credentials never leave your browser.
  • Built-in everything. Rotating proxies on every plan, scheduling (every 5 minutes to weekly), multi-threaded runs (up to 20 parallel slots per Squid), Google Sheets / S3 / SFTP exports, Zapier and HubSpot integrations, and human support from the team that built it. No add-ons, no plugins.

What you can scrape 🎯

By source

AutoScout24 Facebook Google Idealista Immoweb Instagram LaCentrale Leboncoin LinkedIn Pages Jaunes PAP ParuVendu Realtor Reddit Sales Navigator SeLoger TikTok TripAdvisor Trustpilot X / Twitter Vinted Yelp YouTube

By use case

Lead Generation Reviews Social Media Human Resources SEO eCommerce Real Estate Restaurants News


Browse the Store


What teams build with lobstr.io 🏗️

  • Sales lead generation — daily LinkedIn Sales Navigator scrapes piped into HubSpot, Salesforce, or a spreadsheet via the Make and Zapier integrations.
  • Local market research — enumerate every restaurant, clinic, agency, or shop in a city with phone, email, hours, and ratings from Google Maps.
  • Real estate intelligence — track new listings and price changes across SeLoger, Immoweb, Idealista, PAP, Realtor, and others on a schedule.
  • HR & talent analytics — pull LinkedIn profiles and job listings for hiring pipelines and competitive workforce intelligence.
  • Reputation monitoring — aggregate TripAdvisor, Trustpilot, and Yelp reviews into BI dashboards for brand teams.
  • Marketplace & price tracking — monitor Vinted, Leboncoin, AutoScout24, and LaCentrale inventory and pricing in near-real-time.
  • Social listening — pull YouTube channel analytics, Instagram profiles, TikTok content, Reddit threads, and X/Twitter activity for content and trend analysis.

Learn about lobstr.io 🦞

💳

Pricing
Plan tiers and per-Squid rates.

🔌

API & Docs
Trigger scrapes programmatically.

📚

Help Center
Guides, tutorials, and core concepts.

✍️

Blog
Case studies and how-tos.

Developer tools 🛠️

Use the API, SDK, or CLI for production. Connect lobstr.io to AI agents via MCP. All four speak to the same backend as the dashboard.

Python SDK

lobstrio/lobstrio-sdk - GitHub

pip install lobstrio-sdk
from lobstrio import LobstrClient

# Token resolved from LOBSTR_TOKEN env var, then ~/.config/lobstr/config.toml
client = LobstrClient()

# Find the right crawler, create a Squid, run it, stream results
crawler = next(c for c in client.crawlers.list() if c.slug == "google-maps-leads-scraper")
squid = client.squids.create(crawler=crawler.id, name="Paris Restaurants")
client.tasks.add(squid=squid.id, tasks=[
    {"url": "https://google.com/maps/search/restaurants+paris"}
])

run = client.runs.wait(client.runs.start(squid=squid.id).id)
print(f"Done — {run.total_results} results, {run.credit_used} credits used")

for place in client.results.iter(squid=squid.id):
    print(place["name"], place.get("phone"))

Full SDK docs →

CLI

lobstrio/lobstrio-cli - GitHub

pip install lobstrio

lobstr crawlers search "google maps"
lobstr squid create google-maps-leads-scraper --name "Paris Restaurants"
lobstr task add SQUID_ID "https://google.com/maps/search/restaurants+paris"
lobstr run start SQUID_ID --wait
lobstr results get SQUID_ID --format csv -o results.csv

Full CLI docs →

MCP server

Connect lobstr.io's docs MCP server to Claude, Cursor, or any MCP-compatible agent to query the help center and generate code from inside your AI assistant.

curl -X POST https://docs.lobstr.io/mcp \
  -H "Content-Type: application/json" \
  -H "Accept: application/json, text/event-stream" \
  -d '{
    "jsonrpc": "2.0",
    "method": "tools/call",
    "params": {
      "name": "search_lobstr_io",
      "arguments": { "query": "create squid" }
    },
    "id": 1
  }'

Full MCP docs →


Find us on

G2 Capterra Make


Get the data you need.
Browse the Store · Read the docs · Help Center


Made in Paris 🇫🇷 by the lobstr.io team.

Popular repositories Loading

  1. shadow-useragent shadow-useragent Public

    Pick the most common user-agents on the Internet 👻

    Python 173 11

  2. bieniciscraper bieniciscraper Public

    Scrape housing listings on Bien'Ici from any Bien'Ici Search URL 💛

    Python 21 4

  3. seloger-listings-scraper-tutorial seloger-listings-scraper-tutorial Public

    Bypass (temporarily) Datadome and scrape housing listings on SeLoger 🏡

    Python 2 3

  4. deproto deproto Public

    A Python library for decoding Google Maps protocol buffer (protobuf) responses into readable data.

    Python 2

  5. lobstrio-sdk lobstrio-sdk Public

    Python 2

  6. puppeteer puppeteer Public

    Forked from puppeteer/puppeteer

    Headless Chrome Node API

    JavaScript

Repositories

Showing 10 of 11 repositories

People

This organization has no public members. You must be a member to see who’s a part of this organization.

Top languages

Loading…

Most used topics

Loading…