• Natanael@infosec.pub
    link
    fedilink
    English
    arrow-up
    4
    ·
    6 days ago

    The ability to block crawling is separate from the ability to delist old pages. The latter usually happens after domains change owners