furrypony
hopelessly sad filly
I've looked into The Pony Archive project. They are doing a very complete archiving using grab-site:
@It downloads the entire blog, including other thigns the blog links to (but only one level, like a twitter post for example) We can use this to host the blog just like it'd appear in the wayback machine later. Catch: we won't download avatars for tumblr users, too many files to do that.@
And it seems there are at least two people grabbing all 20000 tumblrs listed in the "tumblr list":/tumblrs.txt
It seems that our downloading effort would not be able to make a dent compared to their effort. So we should concentrate on the "uploading to Derpibooru and tagging" part.
They have a "temporary Discord invite":https://discord.gg/EKzB7X7
@It downloads the entire blog, including other thigns the blog links to (but only one level, like a twitter post for example) We can use this to host the blog just like it'd appear in the wayback machine later. Catch: we won't download avatars for tumblr users, too many files to do that.@
And it seems there are at least two people grabbing all 20000 tumblrs listed in the "tumblr list":/tumblrs.txt
It seems that our downloading effort would not be able to make a dent compared to their effort. So we should concentrate on the "uploading to Derpibooru and tagging" part.
They have a "temporary Discord invite":https://discord.gg/EKzB7X7