domainsproject.org

What Is It

DomainsProject.org positions itself as the “world’s single largest internet domain dataset.” Its public pages state that it has processed more than 10.5PB of internet traffic, aggregated 3.16B+ unique domains, and covers 1,519 TLDs. Its core value is not as a traditional development framework, but as large-scale foundational data for security research, academic research, threat intelligence, and domain ecosystem analysis.

Core Capabilities and Ecosystem

The free product is a sorted domain list available via GitHub, released under the BSD-3-Clause license, allowing personal, academic, and commercial use. Paid capabilities include enhanced datasets, historical DNS data, and real-time notifications. The feature list explicitly mentions WebSocket support, which can be used to receive real-time notifications of new domains and is valuable for phishing domain monitoring, threat hunting, and brand protection. The site also lists projects such as LLMSE, SoOPNav, OSPChat, and ytMusicLibrary. Among them, LLMSE is an Ollama-based LLM search/classification service, but the main content does not provide API details, SDKs, data formats, or integration examples.

Pricing and Terms

The pricing section only shows “Loading pricing...” and does not provide specific amounts. The terms of service state that free data is licensed under BSD-3-Clause; Subscriber and Enterprise are paid subscriptions, priced in euros and prepaid monthly or annually. Due to the nature of digital data products, refunds are generally not available unless required by law or caused by a service-side failure. Enterprise plans may include custom data sources and an SLA, but specific service levels are not disclosed.

Pros and Cons

Its strengths are the large data scale, permissive licensing, clear security-research-oriented use cases, and value-added capabilities such as historical DNS and real-time notifications. The drawbacks are also clear: the page acknowledges that data accuracy, completeness, or real-time freshness is not guaranteed; Russian domains are explicitly excluded, so coverage is not absolutely complete; and commercial pricing and API documentation are insufficient. Engineering teams will need further communication before evaluating integration cost, rate limits, stability, and compliance.

Who It’s For and Access from China

It is suitable for cybersecurity companies, threat intelligence teams, university labs, and users who need large-scale domain corpora for detection model training or registration ecosystem research. Access from China is not mentioned in the main content and is therefore unknown; if GitHub access is unstable, obtaining the free dataset may be affected. Payment methods are not disclosed, only that pricing is in euros. Alternative or complementary data sources may include SecurityTrails, DomainTools, Censys, Rapid7 Open Data, Common Crawl, and others.