Italy Open Data Scraper - dati.gov.it CKAN Catalog

resource-row

One downloadable file or service: its download URL, normalised and raw format, MIME type, byte size, checksum, licence and access rights, plus the identity, organization and data holder of the dataset it belongs to.

organization-row

One of the 399 publishing bodies on the portal, with its IPA code, certified email, telephone, own open data website, Italian region, dataset count and the themes and keywords it publishes under.

theme-row

One of the 13 EU data themes with its Italian and English titles, its EU theme code and how many datasets it carries.

tag-row

One keyword from the catalogue vocabulary with the number of datasets carrying it, ranked, honouring whatever filters the run set.

licence-row

One licence string as the portal stores it, with its normalised code, plain-English label, whether it is open, and how many datasets declare it. The portal records the same licence under several different spellings and this row exposes each one.

format-row

One distribution format spelling with its canonical name, whether it is machine readable, and its dataset count. The catalogue uses 92 spellings for about 34 real formats and the index is case sensitive, so the raw spellings matter.

holder-row

One titolare del dato, the body legally responsible for the data under Italian open data rules, with how many datasets it holds. There are 1,763 of them against 399 publishing organizations.

publisher-row

One DCAT publisher name with its dataset count. Usually a department inside a public body rather than the body itself.

source-catalog-row

One of the 328 regional, municipal and ministerial portals that dati.gov.it harvests, with how many datasets it contributes to the national catalogue.

link-check

Optional. One distribution URL fetched from the publisher's own server to see whether it is actually alive: HTTP status, redirect target, content type, byte size and latency. dati.gov.it harvests metadata from 328 catalogues and never revalidates the links.

file-probe

Optional. The first 64 KB of a distribution read with a range request, returning what the bytes really are, whether that matches the declared format, the CSV delimiter, the column headers and a sample row. Not charged when the file could not be read.

organization-profile

Optional. The publishing body's IPA code, contact email, telephone, website, Italian region and total dataset count added to a dataset row. Each organization is fetched once per run and reused across every dataset it published.