☆ Yσɠƚԋσʂ ☆@lemmygrad.ml to technology@hexbear.netEnglish · 9 days agoReddit will block the Internet Archivewww.theverge.comexternal-linkmessage-square6linkfedilinkarrow-up132arrow-down10cross-posted to: reddit@lemmy.worldreddit@lemdro.idreddit@lemmy.mltechnology@lemmygrad.mlredditwasfun@lemmy.worldfuck_bigtech@europe.pubnews@lemmy.worldtechnology@lemmy.worldfedibridge@lemmy.dbzer0.com
arrow-up132arrow-down1external-linkReddit will block the Internet Archivewww.theverge.com☆ Yσɠƚԋσʂ ☆@lemmygrad.ml to technology@hexbear.netEnglish · 9 days agomessage-square6linkfedilinkcross-posted to: reddit@lemmy.worldreddit@lemdro.idreddit@lemmy.mltechnology@lemmygrad.mlredditwasfun@lemmy.worldfuck_bigtech@europe.pubnews@lemmy.worldtechnology@lemmy.worldfedibridge@lemmy.dbzer0.com
minus-squareLargeAdultRedBook [none/use name]@hexbear.netlinkfedilinkEnglisharrow-up1·7 days agoHow so? Do archive services not also archive content from linked CDNs?
minus-squareThermonuclearEgg [she/her, they/them]@hexbear.netlinkfedilinkEnglisharrow-up2·edit-27 days agoMaybe I’m mistaken but I have heard the Internet Archive applies robots.txt retroactively
How so? Do archive services not also archive content from linked CDNs?
Maybe I’m mistaken but I have heard the Internet Archive applies robots.txt retroactively