Lemmy newb here, not sure if this is right for this /c.
An article I found from someone who hosts their own website and micro-social network, and their experience with web-scraping robots who refuse to respect robots.txt, and how they deal with them.
Oh. Yeah, I don’t think they’re being malicious; I just get frustrated with that sort of behavior. The primary DNS servers for usps.com, neakasa.com, and vitacost.com all block DNS queries from Mullvad’s DNS servers, and one of them blocks all traffic from at least some of Mullvad’s exit nodes. It means I have to waste time working around these blocks, because I’ll be damned if I’m going to take down the house VPN just to visit their stupid sites. So, I hard-code DNS entries for them, and route traffic to the one through one of my VPSes. It’s annoying, a waste of my time, and I’m just generally offended by the whiff of surveillance state about it, even when that’s not the reason why they’re doing it.
Really, it boils down to the fact that I’m offended by the presumption that their (not OP, but VPN-hostile companies in general) anti-spam or whatever they’re trying to accomplish takes priority over my right to privacy. So, yeah; I generally have a bone to pick with any site that’s hostile to VPNs.
I have no doubt at all that you’re right. And, they have no obligation to accommodate me (which I think is not true for companies I’m trying to do business with).
I’m just uppity about the topic, is all.
I’ll happily have a cordial disagreement with anyone arguing in good faith. It’s echo-ey enough, and these are good conversations.