All functions |
|
|---|---|
Probability that Domain Hosts Adult Content Based on features of Domain Name and Suffix alone. |
|
Empty the page cache |
|
Get Category from Anthropic Claude |
|
Fetch homepage HTML and text for domains |
|
Get Category from DMOZ |
|
Reasons a domain can fail to get a category |
|
Summarise the outcome of a fetch or classification run |
|
Get DMOZ Data |
|
Get Shalla Data |
|
Get Steven Black's Host List Data |
|
Download the UT-Capitole blacklists |
|
ML Model |
|
Extract text, title, description and language from HTML |
|
Classify News and Non-News Based on keywords in the URL |
|
Get Category from OpenAI |
|
What kind of page is this? |
|
Classify domains with the piedomains model |
|
rdomains: Classify Domains by their Content |
|
A persistent cache directory for fetched pages |
|
Get Category from Shallalist |
|
Report what each category source is and when it was last published |
|
Get Category from Steven Black's Host List |
|
Get Category from University Domain List |
|
Get category from the UT-Capitole blacklists |
|
Get Category from VirusTotal |
|