Rockcrimson
How can I know what has been archived and what not? That way I can avoid posting something that is already here
Tumblr NSFW Upload thread
Poll results: halp
I'll do my part and help
53.11% 777 votes
I just want to sit back and wank
46.89% 686 votes
Poll ended with 1463 votes.
rautamiekka 
https://derpibooru.org/search/reverse, which is the camera pic next to the search box.
How can I know what has been archived and what not? That way I can avoid posting something that is already here
https://derpibooru.org/search/reverse, which is the camera pic next to the search box.
The Smiling Pony 
( ͠° ͟ʖ ͡° )
@rautamiekka
Depending on the artist, sometimes it’s faster to just search their name and a few terms to sort out what’s missing; ex. if you have 15 images of Pinkie by one artist, search for their artist tag and “pp” and you can see what (if anything) is missing at a glance.
Obviously not so effective if the artist is absurdly prolific.
Depending on the artist, sometimes it’s faster to just search their name and a few terms to sort out what’s missing; ex. if you have 15 images of Pinkie by one artist, search for their artist tag and “pp” and you can see what (if anything) is missing at a glance.
Obviously not so effective if the artist is absurdly prolific.
Garden Tinker 
http://agentsofheart.tumblr.com/tagged/PSact1/chrono
Does anyone know if TumblThree saves Adobe Flash files/games like the one towards the bottom of this page?
If not, is thee a specific other program we should use for checking other blogs for Flash works?
Does anyone know if TumblThree saves Adobe Flash files/games like the one towards the bottom of this page?
If not, is thee a specific other program we should use for checking other blogs for Flash works?
stsyn 
Moderator
@Garden Tinker
Tumblr itself doesn’t allow flash files and TumblThree (and any other tumblr dumper (until they store everything that was linked)) doesn’t save them. The one you linked stored on DevaintArt: http://fc07.deviantart.net/fs70/f/2012/308/e/f/luna__enter_by_captainhoers-d5jyemn.swf
Tumblr itself doesn’t allow flash files and TumblThree (and any other tumblr dumper (until they store everything that was linked)) doesn’t save them. The one you linked stored on DevaintArt: http://fc07.deviantart.net/fs70/f/2012/308/e/f/luna__enter_by_captainhoers-d5jyemn.swf
MaresFillies 
Assistant
Twi’s Engineer Hubby
@Garden Tinker
Usually I just go into the blog and just download it manually through Firefox Browser.
Usually I just go into the blog and just download it manually through Firefox Browser.
Background Pony #C38C
How is everyone doing in the backup so far?
Micro-Cyberbrony
All lives matter.
To whoever added reverse search to derpibooru, you deserve a Nobel prize.
Give that person a promotion or something great, because this is awesome!
Seriously, thanks a ton!!!
Give that person a promotion or something great, because this is awesome!
Seriously, thanks a ton!!!
rannius 
cya on a better booru
@twkr
Finally I have everything ready for the blogs that require Tumblr authorization.
Then I’ll just go for the stage 2 list until the 17th.
Did you update that list since?
Also what the hell is 1o1o1o1o1o1o1o1o1o1o1 and why does it have 121K posts.
Also also https://pikons-sketch.tumblr.com/ seems to no longer be hidden.
Finally I have everything ready for the blogs that require Tumblr authorization.
Then I’ll just go for the stage 2 list until the 17th.
Did you update that list since?
Also what the hell is 1o1o1o1o1o1o1o1o1o1o1 and why does it have 121K posts.
Also also https://pikons-sketch.tumblr.com/ seems to no longer be hidden.
Background Pony #C38C
For the blogs that are dead, is there a way to mass tag images with those blogs as the source with dead source?
rautamiekka
If everything fails, anyone with a database access to the table storing the correlations between pics and keywords and the table containing the URLs could do a mass-insertion of correlations based on the URL. I’m sure PostgreSQL can do that.
For the blogs that are dead, is there a way to mass tag images with those blogs as the source with dead source?
If everything fails, anyone with a database access to the table storing the correlations between pics and keywords and the table containing the URLs could do a mass-insertion of correlations based on the URL. I’m sure PostgreSQL can do that.
furrypony 
hopelessly sad filly
@Garden Tinker
For that particular blog, I have indeed backed up all the swf files too.
The way I did it was to grab it with bbolli python script, then parse the html files generated for all external url links to media files (jpg, jpeg, png, bmp, gif, mp3, mp4, swf), then wget these, then parse the html files again and change the external url links to local links.
See here
This trick should also work if you grabbed json files instead. Just parse the json files for external urls to media files, then compare these media file names to the media files you have already grabbed, then grab (wget or some other way) all the media files still not grabbed.
StSyaN For that particular blog, I have indeed backed up all the swf files too.
The way I did it was to grab it with bbolli python script, then parse the html files generated for all external url links to media files (jpg, jpeg, png, bmp, gif, mp3, mp4, swf), then wget these, then parse the html files again and change the external url links to local links.
See here
This trick should also work if you grabbed json files instead. Just parse the json files for external urls to media files, then compare these media file names to the media files you have already grabbed, then grab (wget or some other way) all the media files still not grabbed.
stsyn
Moderator
@Background Pony #1A91
You may leave a request at general tagging thread or report any single image with related source and artist tag.
You may leave a request at general tagging thread or report any single image with related source and artist tag.
Garden Tinker
@MaresFillies
I would, but we’re kinda looking for quick, mass-effective methods at the moment.
@furrypony
Thank you. I’m afraid I don’t have a thick enough grasp on scripting and the like to follow suit, though.
For anyone who is, could they grab a comprehensive archive of ask-cyberpunkspitfire? It has a lot of material that isn’t in standard posts.
I would, but we’re kinda looking for quick, mass-effective methods at the moment.
StSyaN @furrypony
Thank you. I’m afraid I don’t have a thick enough grasp on scripting and the like to follow suit, though.
For anyone who is, could they grab a comprehensive archive of ask-cyberpunkspitfire? It has a lot of material that isn’t in standard posts.
twkr
Yaaaay~ Can you upload it somewhere? I want to have a copy just in case. Hope you don’t mind.
Wish I knew that myself. I don’t really check contents of the blogs, just whether they are alive or not.
Last update finished today at approximately 4am UTC but there wasn’t any changes so the file didn’t get overwritten.
Finally I have everything ready for the blogs that require Tumblr authorization.
Yaaaay~ Can you upload it somewhere? I want to have a copy just in case. Hope you don’t mind.
Also what the hell is 1o1o1o1o1o1o1o1o1o1o1 and why does it have 121K posts.
Wish I knew that myself. I don’t really check contents of the blogs, just whether they are alive or not.
Did you update that list since?
Last update finished today at approximately 4am UTC but there wasn’t any changes so the file didn’t get overwritten.
Darkenetor
@twkr
Sorry couldn’t work on it yesterday. It was the damn GDPR cookie consent redirect, just going through them on a VPN.
Stage-2 only took a few minutes but that discards auth- or pass-required ones right?
(Also some new links on the lists I posted if anybody cares.)
Sorry couldn’t work on it yesterday. It was the damn GDPR cookie consent redirect, just going through them on a VPN.
Stage-2 only took a few minutes but that discards auth- or pass-required ones right?
(Also some new links on the lists I posted if anybody cares.)
rannius
cya on a better booru
So I tried importing the stage 2 list and TumblThree started complaining with
“Error 1:Limit exceeded: rarityismywaifu-arts. You should lower the connections to the tumblr api in the Settings->Connection pane.”
Can I ignore that since I have set it to 90 per 60 seconds anyway?
“Error 1:Limit exceeded: rarityismywaifu-arts. You should lower the connections to the tumblr api in the Settings->Connection pane.”
Can I ignore that since I have set it to 90 per 60 seconds anyway?
rautamiekka
That’s 1.5 (unrounded) connections per second, so I’m not surprised you hit the limit. Dunno how long you were downloading, but you exceed the 1000 connections per day in a short time with that.
I’d make it 1 connection per second, meaning 60 connections per minute, at max, and even that’s stretching it. You get your
Not 101% sure, but I think you’ve to wait until the day switches to the next before retrying, especially if you’re getting way more of that.
So I tried importing the stage 2 list and TumblThree started complaining with
“Error 1:Limit exceeded: rarityismywaifu-arts. You should lower the connections to the tumblr api in the Settings->Connection pane.”
Can I ignore that since I have set it to 90 per 60 seconds anyway?
That’s 1.5 (unrounded) connections per second, so I’m not surprised you hit the limit. Dunno how long you were downloading, but you exceed the 1000 connections per day in a short time with that.
I’d make it 1 connection per second, meaning 60 connections per minute, at max, and even that’s stretching it. You get your
connections per minute by multiplying your connections per second by 60.Not 101% sure, but I think you’ve to wait until the day switches to the next before retrying, especially if you’re getting way more of that.
rannius
cya on a better booru
@rautamiekka
Thanks, I’ve set it to 50/60 for now.
However this message didn’t appear while actually downloading but rather while importing the blog list via clipboard (where the program checks if a blog is 404 or not) and I can still download just fine for now at least.
Thanks, I’ve set it to 50/60 for now.
However this message didn’t appear while actually downloading but rather while importing the blog list via clipboard (where the program checks if a blog is 404 or not) and I can still download just fine for now at least.
Background Pony #0216
Deletion reason: Rule #6
Interested in advertising on Derpibooru? Click here for information!
Help fund the $15 daily operational cost of Derpibooru - support us financially!