AI Workflow Automation
n8n Website Data Extraction to JSON
An n8n and OpenAI workflow discovers website datasets, processes Excel, CSV and HTML tables, and prepares structured JSON with schemas and tags.
Illustrative overview of website dataset discovery, format-specific processing and the JSON handoff.
The problem
Website datasets were spread across downloadable spreadsheets, CSV files and HTML tables. The task was to start from supplied URLs, discover relevant data sources and organize their contents for downstream analysis instead of handling each format separately.
What I built
n8n orchestration with an OpenAI discovery agent to find candidate dataset links from starting URLs.
Separate processing paths for Excel, CSV and HTML tables, with reusable table-to-JSON subworkflows.
Schema generation and classification, including geographic and subcategory tags.
JSON output organized by starting URL, containing dataset entries and a processing log.
Configurable crawl settings and URL-pattern filtering for the requested language scope. The language filter checks URL patterns rather than translating or verifying every page's language.
Structured error logging and a separate notification path for fatal failures.
The outcome
The workflow connects discovery and format-specific processing to a common JSON handoff. Schemas, tags and logs provide context for downstream tools and for investigating failures. New website structures and unusual file formats can require processor changes.
Who this approach suits
Teams collecting recurring website datasets for analysis or internal tools. To scope similar work, bring starting URLs, example source files, required fields and the intended JSON format.
Working on something similar?
Discuss a similar project