Web Data Source Posts

Latest how-tos, release notes, and product updates from the WDS team.

Run WDS in minutes - and start using all features for free! thumbnail

Apr 1, 2026

Run WDS in minutes - and start using all features for free!

Launch Web Data Source locally in minutes with the Docker Compose deployment path and start exploring crawling, extraction, and AI-ready workflows right away.

Query Indexed Resources with AI Agents - RAG Workflow from Web Data thumbnail

Mar 25, 2026

Query Indexed Resources with AI Agents - RAG Workflow from Web Data

A transparent Retrieval-Augmented Generation workflow that lets AI agents query indexed web resources with explainable, verifiable retrieval.

Mar 18, 2026

"Index" Prompt - Cache the Web, Work Faster

Preload entire websites into cache during off-hours so WDS workflows run on local, stable data instead of live pages.

Mar 11, 2026

"Scrape Data" Prompt

Structured website data extraction with AI agents and reusable WDS MCP crawling configurations.

MS SQL drives structured crawling - starting from a sitemap thumbnail

Feb 25, 2026

MS SQL drives structured crawling - starting from a sitemap

Use MS SQL and Web Data Source to turn sitemap-driven crawling into relational, queryable datasets.

“Sliced Resume” Prompt — Phased Website Intelligence thumbnail

Feb 18, 2026

“Sliced Resume” Prompt — Phased Website Intelligence

Progressive website profiling with phased crawling and structured expansion.

“Resume” Prompt thumbnail

Feb 11, 2026

“Resume” Prompt

A Structured Profile for Any Website.

Web data, usable directly in SQL thumbnail

Feb 4, 2026

Web data, usable directly in SQL

Web Data Source allows web resources to be queried and consumed directly from MS SQL.

MS SQL is no longer just a database thumbnail

Jan 28, 2026

MS SQL is no longer just a database

It’s becoming a data acquisition layer.

Infrastructure for trustworthy RAG thumbnail

Jan 21, 2026

Infrastructure for trustworthy RAG

Retrieval is not just a feature. It’s infrastructure for trustworthy RAG.

Air-Gapped by Design thumbnail

Jan 7, 2026

Air-Gapped by Design

Air-Gapped by Design, Not by Compromise.

Cloud-Native by Design thumbnail

Dec 17, 2025

Cloud-Native by Design

WebDataSource is Cloud-Native by Design.

Retrieval Config thumbnail

Dec 4, 2025

Retrieval Config

Precision-driven Retrieval for RAG — built for secure, controlled environments.

Cross Domain Access thumbnail

Nov 19, 2025

Cross Domain Access

Control Exactly Where Your Crawls Are Allowed to Go.

Crawlers Protection Bypass thumbnail

Nov 13, 2025

Crawlers Protection Bypass

Responsible Crawling with CrawlersProtectionBypass.

Download Error Handling thumbnail

Nov 5, 2025

Download Error Handling

Keep Your Crawls Resilient with DownloadErrorHandling.

Cookies Config thumbnail

Oct 29, 2025

Cookies Config

Bringing Legacy Compatibility to Modern Crawling.

Https Config thumbnail

Oct 22, 2025

Https Config

How to Work with Self-Signed Certificates.

Restart Config thumbnail

Oct 16, 2025

Restart Config

Full Control Over Your Data Refresh Strategy.

Headers Config thumbnail

Oct 15, 2025

Headers Config

Zero Trust Friendly Access to Your Corporate Data.

Proxy Config thumbnail

Sep 16, 2025

Proxy Config

Make your data pipeline as resilient and secure as possible.

Sergei Gorbushin thumbnail

Aug 26, 2025

Sergei Gorbushin

My name is Sergei Gorbushin, I am the developer and creator of Web Data Source.

Crawl Using Sitemap thumbnail

Apr 7, 2025

Crawl Using Sitemap

Learn how to find product pages more efficiently when websites have already prepared them for robots

Intro thumbnail

Mar 27, 2025

Intro

Automate Your Data Extraction with Ease!