7.9 KiB
Site Registry source licenses
Reviewed against the primary distribution and licensing pages on 2026-09-13. The Rust code uses the workspace's AGPL-3.0-or-later license. Imported data keeps its own licenses; neither the code license nor a merged export relicenses it. Commercial reuse is supported subject to the following obligations. A provider's listing is evidence of an assertion, not a guarantee of ownership or safety.
| Source | Exact data license and evidence | Distribution and consumed fields |
|---|---|---|
| Wikidata | CC0 1.0 Universal, CC0-1.0 |
JSON dumps, entity JSON. Entity ID, revision, all labels/aliases, full P856 statements including ranks, qualifiers and references; P17, P159, P407, P1001 and country/language code mappings P297/P218/P219/P220. Relevant raw entity records remain available for audit. |
| Research Organization Registry (ROR) | CC0 1.0 Universal, CC0-1.0 |
Official versioned data dump distributed from ROR's Zenodo community. Schema 2.1 organization ID, names and aliases, website links, declared domains, status, organization types, locations/countries, relationships and external IDs. The importer requires the official JSON-and-CSV ZIP shape and retains the JSON record for audit. ROR documents GeoNames as upstream for location metadata; GeoNames attribution and CC BY 3.0 terms are preserved. |
| Majestic Million | CC BY 3.0 Unported, CC-BY-3.0 |
Official CSV. Domain/IDN/TLD, global/TLD ranks, referring subnet/IP counts and their previous values. Ranks remain source-specific signals; no entity ownership is inferred. |
| Chrome UX Report (CrUX), Google | CC BY 4.0 International, CC-BY-4.0 |
Monthly BigQuery dataset: origin, experimental.popularity.rank, observation month, optional audience-country dataset code. The adapter produces origin,rank,yyyymm,country_code CSV. Rank is a coarse bucket, not a precise visit count. Audience country is not website jurisdiction. No API key or OAuth token is retained. |
| Curlie | CC BY 3.0 Unported, CC-BY-3.0, including the attribution placement prescribed on that page |
Format documentation, official download redirect, currently Passau-hosted archive. Despite its RDF name, the current archive contains literal TSV. Content: URL, title, description, category ID. Structure: category ID, full category path, entry count, description, latitude, longitude. Archive notices are retained. |
| Public Suffix List contributors | Mozilla Public License 2.0, MPL-2.0 |
Official list. All ICANN and PRIVATE rules, wildcard/exception rules, version/commit comments and notices. Used for hostname, registrable-domain and public-suffix derivations. Download at most once per day. |
| Argand candidate observer | CC0 1.0 Universal, CC0-1.0 |
Local host-side observations authored by the registry publisher: HTTP status and redirect targets, canonical/hreflang/JSON-LD/sitemap/country-selector targets, public DNS-set hash, TLS leaf-certificate hash, bounded failure class, content hash and selectors. These records describe a capture; they do not incorporate page prose or prove ownership. |
Attribution and distribution
-
Wikidata: CC0 imposes no attribution condition. Keep Wikidata IDs, source links and revision evidence for traceability. CC0 structured data does not extend to unrelated Wikipedia prose, images or linked websites.
-
ROR: CC0 imposes no attribution condition on the ROR dump. Keep ROR IDs, release/Zenodo record identity, provider checksum evidence and schema version for traceability. ROR location fields declare GeoNames as upstream; credit GeoNames, link its CC BY 3.0 license, retain notices and identify Argand's projection when distributing those fields. A ROR website or declared domain is an assertion and never grants route approval.
-
Majestic: credit “Majestic Million, Majestic”, link the source and CC BY 3.0, retain supplied notices, and identify Argand's changes. The current distribution page governs this import; older blog posts describe different historic terms.
-
CrUX: credit “Chrome UX Report, Google”, link the source and CC BY 4.0, retain notices and indicate the projection/normalization. BigQuery access and billing are separate from the data license. This adapter requires an explicit project and positive maximum-bytes-billed limit.
-
Curlie: the requirement applies to names, categories and descriptions. Every public page using Curlie content must include its prescribed HTML credit:
<div title="Curlie Directory Attribution"> With content from <a style="text-decoration:none; color:#cd4932;" href="https://curlie.org/" title="Curlie - the largest human-edited directory of the web">Curlie.org</a> - the largest human-edited directory of the web. Contribute by submitting a website or becoming an editor. </div>Also retain the source and license links and indicate modifications. Imports retain descriptions as audit data. Lookup/resolve never expose descriptions; JSONL export omits them by default.
--include-descriptionsis an explicit distribution choice: receiving applications must satisfy these obligations before displaying the text. Treat directory descriptions as untrusted text, never as executable HTML. A JSON attribution object alone does not satisfy Curlie's public-page placement requirement. -
PSL: retain the list's notices, MPL license and access to its source form when redistributing it. Generations retain the unmodified list in
recordsandfacts; exports include the PSL fact and original download locator. Changes to covered PSL source files must remain available under MPL 2.0. The Rustpublicsuffixparser is MIT/Apache-2.0; that is separate from the list. -
Argand observer: locally produced observation metadata is dedicated under CC0. The fetched page remains subject to its own rights. The default observer stores only a bounded body in the local replay cache and emits normalized link, status, hash and failure metadata. Publishers control and document retention of local cache bodies; generated registry releases do not contain them.
Every generation contains this document and ATTRIBUTION.json, both hash-bound
by its signed completion receipt. Exports carry source manifests, licenses,
retrieval times, assertion selectors and confidence, plus a required attribution
envelope. Consumers must preserve these when extracting subsets or redistributing
derived facts. Source credits do not imply endorsement by any provider.
Cloudflare Radar, default Tranco, Cisco Umbrella, arbitrary mirrors and any other unreviewed source are not supported. Adding a source requires verified commercial reuse rights, its own adapter, provenance and attribution policy. A source format or distribution-host change fails validation until the adapter is reviewed.