Chad scraperdramaticcat@sh.itjust.works to Lemmy Shitpost@lemmy.world – 1014 points – 9 months ago96Post a CommentPreviewYou are viewing a single commentView all commentsJust a heads up for companies thinking it's wrong to scrap: if you don't want info to be scraped, don't put it on the internet.But, but, norobots.txt! Chad doesn't care!uses curl manually instead
Just a heads up for companies thinking it's wrong to scrap: if you don't want info to be scraped, don't put it on the internet.But, but, norobots.txt! Chad doesn't care!uses curl manually instead
Just a heads up for companies thinking it's wrong to scrap: if you don't want info to be scraped, don't put it on the internet.
But, but, norobots.txt!
Chad doesn't care!
uses curl manually instead