Thats what the canonical link is for, isn't it? [0]
RFC 6596 introduced it in 2012. Other websites, like search engines or social media, have been using it for a while.
[0] https://developers.google.com/search/docs/crawling-indexing/...
reply
Other sites grab contact information or verification headers. So they also load the page.
Seems like the only people who wouldn't want to load at all, would be those places where deduplication doesn't matter in the first place.
Thats what the canonical link is for, isn't it? [0]
RFC 6596 introduced it in 2012. Other websites, like search engines or social media, have been using it for a while.
[0] https://developers.google.com/search/docs/crawling-indexing/...