All functions |
|
|---|---|
Empty the page cache |
|
Classification result contract |
|
Get Category from Anthropic Claude |
|
Fetch homepage HTML and text for domains |
|
Get Category from DMOZ |
|
Reasons a domain can fail to get a category |
|
Summarise the outcome of a fetch or classification run |
|
Get DMOZ Data |
|
Get Shalla Data |
|
Get Steven Black's Host List Data |
|
Download the UT-Capitole blacklists |
|
Extract text, title, description and language from HTML |
|
Classify domain names with a language model |
|
Detect soft- and hard-news keywords in URLs |
|
Get Category from OpenAI |
|
What kind of page is this? |
|
Classify fetched HTML with piedomains |
|
rdomains: Classify Domains by their Content |
|
A persistent cache directory for fetched pages |
|
Get Category from Shallalist |
|
Report what each category source is and when it was last published |
|
Get Category from Steven Black's Host List |
|
Get Category from University Domain List |
|
Get category from the UT-Capitole blacklists |
|
Get Category from VirusTotal |
|
Default categories for domain-name inference |
|