LAZERDISC
Scrape everything. Transform anything. Write to anywhere.
The universal data import layer for the modern internet stack. CLI, SDK, and API — zero bloat, zero boilerplate.
Capabilities
Everything you need
A pluggable scraping and transformation framework for developers who want total control over their data pipeline.
CLI First
Three composable commands — fetch, transform, pipe. Chain them into powerful data pipelines from your terminal.
Blazing Fast
Parallel fetching, streaming transforms, and smart retries with exponential backoff. Built for throughput.
Any Destination
Write to local filesystem, AWS S3, Storj buckets, or any S3-compatible storage. Organized by domain, date, or type.
Transform Everything
Built-in transformers for common patterns. Write custom TypeScript functions. Chain multiple transforms.
SDK & API
Use programmatically via TypeScript SDK or the REST API. Embed scraping into any application or workflow.
AI-Ready
Feed scraped data directly into AI agents and knowledge graphs. Schema inference and intelligent parsing coming soon.
Developer Experience
Three commands. Infinite power.
fetch, transform, pipe — compose them into any data pipeline you can imagine.
Or install globally: pnpm add -g @lazerdisc/cli