Off Topic Tools for downloading/archiving/sharing

[redery]

First and foremost, r/DataHoarder and r/Piracy are probably the best resources on this, particularly the wikis:

Reddit - Dive into anything

www.reddit.com

Reddit - Dive into anything

www.reddit.com

But here's a down and dirty list of some good stuff.

manual = tools that work on a per-file basis (i.e. you have to manually download each file individually)
batch = tools that can download content in bulk from a single operation


Easiest method:
works for: OnlyFans, random websites (manual)
(how to right-click->save as on sites that block it)

For a lot of sites (including Onlyfans), downloading is as simple as having your browser override the script that is disabling right-click functionality. This will allow you to do the typical "right-click>save" operation.

MOBILE:
Use this browser:

Aloha Browser

Private browser for iPhone, iPad and Android. Provides maximum privacy and security and comes with free unlimited VPN

alohabrowser.com

It should allow you to tap-hold and save the actual file.

Play the video and wait for the play button to disappear. When the screen is clear, tap and hold on the video toward the top left or right corner and the download option should appear. Images illustrate:

You must be registered for see images

You must be registered for see images

Apple still treats its customers like shit and locks down its products like Fort Knox, so file management on iOS may be a problem.
You might need to install a separate file manager to be able to access and share downloaded files.
This is a popular one:

Documents by Readdle

Documents is a home for all your files. Watch movies, listen to music, open ZIP files, download MP3 on iPhone and iPad.

readdle.com

DESKTOP:
Absolute Enable Right-Click (Firefox) (Chromium)
There are quite a few browser extensions/add-ons that re-enable the right-click functionality when a website blocks it.
Absolute Enable Right Click & Copy is a good one.

1) Just turn it on
2) Switch the video quality to the highest setting (usually "original")
3) right-click on your mouse, "save as"

(Just be sure you're viewing the highest quality version of the content when you attempt to download.
OnlyFans videos should say "source" in the file name.)




3 best downloading apps:
1. works for: Most video/audio content anywhere (manual+batch functionality)
Internet Download Manager is an awesome utility that not only will help you grab media from almost everywhere, but it also will accelerate your downloads, and allows for a bunch of great settings to manage how your downloads operate. You can have it pop up a download button on media on the webpage where it is playing, or you can input a list of URLs to download in bulk.

You can either feed it specific links/URLs to download, or have it pop up a download button when media appears on a webage (great for grabbing pesky content that doesn't offer a download option.)


2. works for: Almost everything (YouTube, TikTok, Instagram, Twitter, PornHub, other video sites and more) (batch)
JDownloader is the holy grail of FOSS downloading apps. It's a download management tool that has almost every customization you could want. That does mean it can get complex, but if you take the time to figure out how to do what you want, it's possibly the best tool available for grabbing entire YouTube channels or videos from hundreds of other sites and automatically naming them, sorting them, and doing pretty much anything else you want.

You do need to feed it the links you want to download, but once you have those, it takes care of the rest. You can set parameters like automatically name files by date and sort them into different folders for each channel, download thumbnail images and subtitle files, etc. There's a an active forum you can use for support. And the app is free and open-source.

It will also download Tiktok videos without the watermark.


3. works for: Most sites, including this forum (batch)
DownThemAll is a browser extension that allows you to batch download media content from a webpage. (You might have to try the media tab and the links tab to properly grab what you're wanting).


Instagram LIVE:
IGLiveRec is great. Don't be a screen-recording doofus.
Get an app that will not only grab the stream for you, but can:

1) get multiple streams simultaneously
2) get HD quality (although it's only SD for the free version)
3) get the entire livestream even if you start the recording late
4) create a list of profiles to automatically record any time they go live


Simplistic, easy apps:
works for: Instagram, YouTube, TikTok, other video sites (batch)
4KDownload is a software provider for...downloading stuff. If you ask me, their company/main-product name is stupid and unnecessarily confusing, as it has nothing to do with 4K resolution video. That being said, 4K Video Downloader is a simple and easy app that will download videos in best quality, including YouTube and (I think) TikTok. But they now have a dedicated TikTok app called 4k Tokkit.

Their 4K Stogram app is the best in my opinion for Instagram scraping. It's totally worth getting the paid license if you download full IG accounts. (It's a one-time lifetime license, reasonably priced, and you can get a bulk license for all the products for a discount. Run a quick inet search to see if there's any coupons as well.)
It will automate the process for grabbing entire Instagram accounts, including stories, and reels that are posted on the account's main page. It even includes the publish date on the filename, and the direct URL and caption for the post in the metadata. (Warning: recently IG has been cracking down on high volume API calls, and there's reddit threads with reports of accounts being banned. So use a dummy IG account to log in to 4kStogram.)


How to batch/bulk download:

OnlyFans, Fansly (batch)
(see scripts section below)

YouTube (batch or manual)
(see JDownloader above)

Instagram (batch)
(see JDownloader and 4K Stogram above)

Twitter (batch)
(see JDownloader above)

TikTok (batch)
(see JDownloader above)
All you need to do is feed it the link to each post you want to download. The easiest way to grab those is use an extraction tool (I like the browser extension Link Gopher). Just copy all the URLs for the posts you want, and paste that list into the JDownloader LinkGrabber.

Spoiler: browser extension

Another option is something like TT Downloader. I don't know if it still works, but it's a Chromium browser extension that puts a download button on each tiktok post when you visit an account page. Something like this is good if you prefer HQ and/or something a little less labor intensive than having to copy and paste links into a website one at a time. It doesn't offer a version without the watermark, but sometimes you'll get a higher quality version of the file. It's You can click posts individually to download them, or click a button at the top of the browser to batch download all the videos that are currently visible on the page.
Again, not sure if this one still works.

Web apps:

Instagram (web app manual)
Ingramer Inflact
-a lot like Bibliogram above, but offers other tools like stories viewer and analytics
InstaFinsta
-appears to be largely a clone of Inflact
StorySaver.net

Instadp
-Simple and easy site to download best quality from Instagram, including profile pictures, stories, and reels
Bibliogram
-website that takes data from Instagram's public profile views and puts it into a friendlier page that loads faster, gives downloadable images, eliminates ads, generates RSS feeds, and doesn't urge you to sign up.


TikTok (web app manual)
(Thanks to Mekillah for notifying of this alternative to the original site I mentioned below (ssstiktok.io)...)

tikcd.com allows you to paste a direct link to a tiktok post and it will generate a download link. It allows downloading without the watermark, and presumably the HQ version of the video, which is usually 720x1280.

ssstiktok.io , but it's usually not the highest quality version of the video. Around 2020 June 26 TikTok started hiding the key necessary to download the high quality without the watermark. But you can still get HQ versions without the watermark for videos that were published before then by using the tiktok scraper mentioned in the scripts section below.

^There's a ton of copycats of this now. You can just search "tiktok downloader" and get plenty of results to try.
If you're downloading tiktok content, use something like this to get it in better quality and without the watermark.


OnlyFans (semi-batch)
OF Extractor (Firefox) (Chromium)
Originally came from here. Works great. Mozilla removed it from the official addons page, as did Google, but it doesn't violate OF terms of service, and you can still get it at the two links above.
(Be sure to enable the setting that adds the date to the downloaded file names.)

...Looks like it doesn't work anymore and isn't being updated.


Scripts:
For the best in automation, if you're technologically inclined, there's some pretty good scrapers out there for mass downloading. Depending on what you want to do, no actual coding is necessary, but these are command line apps and you do have to do some data plugging to set them up...

works for: OnlyFans, Fansly, StarsAVN
OnlyFans DataScraper from Digitalcriminals Ultima Scraper from Ultima Hoarder currently works for OnlyFans, Fansly, Stars AVN, 4chan, bbwchan and works great. If you use it, do everyone a favor and have it include the publish date of the file in the filename. It makes organization much easier.
Tips:

1. See here for installation prerequisites if you have any issues.
2. Alter the config.json "filename_format" parameter to include {date}, so that the date the media was published is included in the filename.
3. Set the "date_format" to something like "%Y.%m.%d" ...This way content is naturally sorted in chronological order, and photo sets aren't scattered throughout the download folder.

If you come across errors or can't get it to work, search in the issues section and there's a solution usually there. I have it working currently, and the only thing it isn't grabbing is stories.


OF-DL from sim0n00ps is supposed to be able to bypass the DRM restrictions. I haven't tried it yet, but feel free to report your feedback.


works for: YouTube, various media sites
Youtube-dl (site is here, because is Github ownership is a bunch of pussies who maintain a policy of just bowing to litigious threats. But at least they did help fight to get it reinstated.)
This is probably the biggest and most supported project, which means it's constantly getting expanded and improved. You can use it to scrape sites for most any content you want...media, metadata, etc.

works for: TikTok
TikTok scraper from drawrowfly was great. Very versatile and allows automated scraping of pretty much everything including entire accounts and metadata. There's a decent amount of support/activity in the Dis cord...but I can't get it to work anymore and there doesn't appear to be any more development going on. But you might keep an eye on it for updates. (Although, JDownloader mentioned above works for grabbing the content. Haven't tried metadata.)

works for: Image/Video sharing sites (e.g. THIS FORUM, Bunkr, Cyberdrop, GoFile, ImgBox, jpg.church, img.kiwi, PixelDrain, Coomer, Kemono, and more...)
CyberDropDownloader by Jules-WinnfieldX is great, and probably as easy as you're going to get from a script. Just follow the instructions.

A lot of the popular image sharing sites these days are basically just white labeled versions of the Chevereto software. That's why so many of them look and operate almost exactly the same... jpg.church, img.kiwi, putme.ga (putmega), pixl.li...they're all using the same site code, just with different branding. So CheveretoDownloader from MandoCoding worked great for those kind of sites because they were all structured the same. But it doesn't appear to be working anymore. Not sure if it'll get any updates. But CyberDropDownloader mentioned above looks to have carried on the torch.


Organization:

Deduplication
If you grab a lot of content, you're bound to end up with duplicate files. A dedup utility can be a life (and storage) saver. As with most software, there's a number of options.
I'm very happy with Duplicate Cleaner. It's got an intuitive interface, and the options make finding and cleaning pretty easy. Get rid of exact duplicates, and then drill down even further using the image mode or audio mode to find similar content. Get rid of inferior quality or watermarked versions and only save the good stuff. Again there's a forum for support, and the company, Digital Volcano, also produces some other useful apps as well.

Backing up
FreeFileSync is a sync utility that makes it really easy to back up content to other locations. It's free and open source, and along with Duplicate Cleaner it's probably one of the best programs I've ever used in terms of doing what it's supposed to do along with providing a good interface.

Photo/video media viewing and organization
FastStone Image Viewer is great for viewing and organizing media. Tons of options to set your preferences. You can even reorganize files by dragging them around in the viewer and then saving that sorting you created by batch-renaming the files. They have other tools as well.
Irfanview is another option that is not as feature-rich, but is smaller and lighter. It's actually a great replacement for the horrible default image viewer in Windows10.

File renaming
Advanced Renamer is great if you need bigger guns for batch file renaming.


Sharing:

If you can attach it directly to the post, great. But that functionality seems to have been shoddy for a while, and then it was also deactivated and reactivated entirely a bunch of times, so it's always a crapshoot whether it will work.

For files under 50MB, you can upload directly in a post.

Video: It's been suggested to click embed after you attach a video to a post because it increases likelihood for playability for mobile viewers.​

​

Images: You don't, I repeat, you don't have to embed images in a post. If you just attach them, they will appear in the post as thumbnail attachments. This is preferred because not only does it allow the site to load faster, but it makes thread pages less cluttered and easier to navigate.​

PLEASE, if you insist on embedding images in the post, at least click the "thumbnail" button. And if you insist on embedding the full size image, at least manually resize it so forum members aren't having to wait for megabytes of gigantic photos to take up the screen every time they load the page.​

If it's just images,

piXhost.to​

Cyberdrop.me​

Pixeldrain​

Cyberfile​

Bunkr​

are popular options that make downloading easiest.​

​

If you use Chevereto sites like the ones listed below, it's a bit more cumbersome to download the content.​

Try the ones above instead. You'll like at least one of those.​

jpg.church​

pixl.li​

img.kiwi​

​

if you use imgbox.com set to 200x200px thumbnails and just paste the BB code.​

​

​

For individual files between 50MB–500MB,

use mirrored.to and it will mirror your upload across different hosts, giving recipients multiple options, and minimizing link rot.​

For multiple files you want to group together, or individual files 500MB+,
of course mega.nz is standard, but requires registration, and it's not uncommon for content to get removed.

gofile.io Is pretty good. No registration required, and no file size or speed limits (or so it says). No image thumbnails, but video files can be played without downloading.​

​

I don't think any of these offer video playback, but other than that they have served well:​

cyberdrop.me​

bunkr.sk​

pixeldrain.com​

​

ufile.io is pretty fast with high limits and no required registration. File expiration is 30 days, but even after that paid users can still access files. (If you create a free account, your uploads won't expire, but you're limited to 2GB of storage unless you pay for more.)​

​

WeTransfer has been good, and it also doesn't require registration, and the limits are high enough, and speeds are good. The downside is content expires after only 7 days, so it leads to a lot of requests for reups.​

Hoard and share on, bros.
If there's anything else you'd like or you think I missed, definitely share.

 

[novelmoon]

I figured I'd share how I do things. This is all based on open source and it's all command-line because I prefer to script everything, then leave and let the computer do the actual work. Using a GUI for these things seem inefficient to me. I have a native nix shell at my disposal, but this might work on Windows too - I have no idea.

Note: if bash and command line isn't your thing, this isn't for you.


instagram-scraper [https://github.com/arc298/instagram-scraper]
Self-explanatory. Gotta be careful though - never download more than 100 posts in 15 minutes as your IP will get temporarily banned from accessing a post.
Below are the scripts I wrote for it.

IGUSR="<YOUR USERNAME GOES HERE>"
IGPWD="<PASSWORD GOES HERE>"
IGDLPATH="<FULL PATH TO TARGET DIRECTORY GOES HERE>"
igscrape() {
    echo 'entering' ${IGDLPATH};
    cd "$IGDLPATH";
    echo 'Scraping' $1 'from instagram [types: image]';
    instagram-scraper $1 -t image --latest --cookiejar _cookie.txt --template "{year}-{month}-{day}_{urlname}" -u $IGUSR -p $IGPWD
}

igscrapeall() {
    echo 'entering' ${IGDLPATH};
    cd "$IGDLPATH";
    echo 'Scraping LATEST from _batch.txt [types: image]';
    instagram-scraper -f _batch.txt -t image --latest --cookiejar _cookie.txt --template "{year}-{month}-{day}_{urlname}" -u $IGUSR -p $IGPWD
}

Within my target folder there's a file called "batch.txt". In it, there are a few accounts I scrape often. Since the option to not download posts that are already present is defined, this works well. I've also chosen to only download images, but this is a flag to remove if it doesn't fit you.


bdfr (Bulk Downloader for Reddit) [https://github.com/aliparlakci/bulk-downloader-for-reddit]
Specifically I wrote a tiny bash script that makes life a little easier:

rdl() {
    if [[ -z $2 ]];
        then lim="1000";
        else lim="$2"
    fi
    echo 'downloading maximum' $lim 'posts';
    python3.9 -m bdfr download . --user $1 --limit $lim --authenticate --sort new --submitted --no-dupes --file-scheme '{POSTID}' --folder-scheme '{REDDITOR}'
}

It takes two parameters: the username and the limit. I never use offset so didn't include that option.


yt-dlp [https://github.com/yt-dlp/yt-dlp]
Downloading YouTube videos. These are just simple aliases with some flags I almost always use.

alias ytd="yt-dlp -f 'bv*+ba/b' "
alias ytdc="yt-dlp -f 'bv*+ba/b' --cookies='<PATH TO A .TXT WITH YT COOKIES>'"

I export my YT cookies and place it on the Desktop, name it ytcookies.txt, and thus I'm able to download age-restricted videos.


cyberdrop-dl [https://github.com/Jules-WinnfieldX/CyberDropDownloader]
For batch downloading from cyberdrop, bunkr, gofile, pixl etc etc.

It's super simple to use and works like a treat.


EroMe Data Scraper [https://openbase.com/python/erome]
Self-explanatory. Rarely used because we all know Erome is a _terrible_ host for anything, let alone video.

---

Oh and by the way... Clean images before you post!
I've downloaded images on here that had coordinates in them. And since ya'll are likely at home when screenshoting OF, that's just bad opsec. Images "produced" by you will most likely have information about your devices at the very least. So it's just a good idea to get rid of that information if there happen to be any. So I suggest _always_ running images through an EXIF cleaner of some sort.

I'd recommend exiv2 because it's dead-simple.

alias cleanjpeg="find . -type f \( -iname \*.jpg -o -iname \*.jpeg \) -exec exiv2 -d a {}  \;"

When it's installed, this is a simple alias to find all jpeg images within your current directory tree and eras any EXIF data there is.

 

[Mekillah]

I thought you’d want to know that HD tiktok downloading never fully stopped. Some developers like ssstiktok just gave up trying to keep up with the tiktok changes.

I’m currently using tikcd.com.

Whenever one stops downloading HD, I just start running down the Google results until I find one that does. Typical highest res available is 720x1280. You can also tell you’ve gotten the original file and not just an upscale because it will have the original creation date.

Happy downloading!

 

[ofdbn]

I saw that most of the older downloaders are buggy/don't work anymore, so I made https://www.onlyfansdownloadbutton.com/

 

[vehemental]

Great links. CyberdropDownloader also works great and for bunker.is links as well.

As mentioned, ripme works very well too.

 

[redery]

Came here to ask a similar question, apologies if its been answered.

I have recently bought an onlyfans video that is well overdue being shared on here, I'd like to share it here - but is there anything I need to do to make sure its anonymised or suchlike? Obviously don't want to get busted, permabanned from OF or even sued by the creator.

I'll post here separately so this remains for anyone else who might be concerned about this...

Bottom line: I don't think you have to worry about content ID from sites like OnlyFans.​

Commenter 1: I'd be really surprised if OF doesn't encode invisible subscriber ID watermarks in videos, or at least some kind of identifying metadata. Maybe it's more rendering power than it's worth?

Commenter 2: If what you are saying was true, the PPV and video flows on this site would have stopped a long time ago. There was another person that had just subscribed to her back in mid- to late-feb and he was not receiving the DMs on new PPVs either, and she was not responding to his messages. Maybe she is just getting tired and lazy of posting PPVs.

My response:
I can't be sure if or why they haven't implemented some mechanism like that, but my guess is that anything that would be feasible enough to implement would be trivially easy for the downloader to circumvent, and anything that would make the content too difficult to anonymize would be cost prohibitive for the host.

Cost prohibitive
And even if the host did bother swallowing the cost of creating and instituting some kind of ID system, it would then still require the resources necessary to constantly monitor the Internet for leaked content and match it to the respective accounts. (Remember we're talking about over 1 million creators, and over 100 million users, with around 500k new registrations per day. And that's just on OnlyFans alone.) There's no way they're going to pay the cost of Internet copyright policing for e-thots.)

Waste of time/money
But a response to that might be: "Well they don't have to actually police the Internet, they could just have their system fingerprint the content automatically, and if the creator herself finds it online, she'll be able to find out who to sue if she wants to."

First of all, I think if that were the case, we would have heard about it by now—either from actual lawsuits, or people would have noticed different hash digests from the same content downloaded by different accounts.

Second, pursuing legal action would be a total waste of time and money. The odds of being able to get more from a leaker than it would cost to actually sue them are slim to none.

Counterproductive
So really the best they could accomplish is banning some people from the platform...who happen to be reliable paying customers. It's effectively just biting the hands that feed you. So it would almost be a guaranteed effort of lowering their revenue.

They'd be spending money to lose more money. It's not as if you ban a leaker and all of a sudden everyone who was getting the content for free will start paying. Not to mention, it's pretty trivial to just start a new OF account with a different email address and payment method. Trying to block leakers from your site is a futile game of whack-a-mole that's ultimately just a waste of resources for the host. And if we're being honest, I don't really think sites like OnlyFans care that much anyway.

Leaks are actually free marketing
This is all not to mention, it's highly likely that leaks have a net positive effect...
(Why else do you think it's the default to have the content watermarked with the creator's username/URL? They know it's going to get shared.)

Gaiman on Copyright Piracy and the Web | Mises Institute

Fascinating short comments by science fiction author Neil Gaiman on how he came to realize that there was nothing wrong with people copying his books:

mises.org

 

[Jarvis15]

Here is a script to download video from bunkr.sk / bunkr.sk automatically. It will click download button and close the tab after 5 sec. https://greasyfork.org/en/scripts/461808-bunkr-video-downloader

 

[shunikiren]

I wonder what happens to all those accounts and data after the dude collected them dies

 

[NCSFO]

There is any external site or Chrome extension that allows to dowload Instagram picture in 1800x1440 resolution.
Until a few weeks ago i was using "mystalk" , but now it is almost always maintenance (or when it is online is seems that it also switched to 1350x1080 resolution)

 

[following_links]

This isn't for downloading or sharing, but it's great for collection management and autotagging

GitHub - stashapp/stash: An organizer for your porn, written in Go

An organizer for your porn, written in Go. Contribute to stashapp/stash development by creating an account on GitHub.

github.com

 

[Deleted member 3420554]

For windows there is absolute enable right click for chrome and Firefox, you can right click and save anything with absolute mode.

Absolute Enable Right Click & Copy – Get this Extension for 🦊 Firefox (en-US)

Download Absolute Enable Right Click & Copy for Firefox. Force Enable Right Click & Copy

addons.mozilla.org

 

[YoGet9ouere]

There are plenty of tools that everyone use to download tiktok video. You can read all tiktok video downloader tool here

 

[redery]

(Making new post so the info remains for posterity):

byeah For data recovery, it depends on how deep you have to go and what all you're trying to recover.

There's a few well known brands like EaseUS, Stellar, Recuva (from Piriform), and Wondershare, and others. I always have a bias toward FOSS, but sometimes it's easier with proprietary.

Ultimately this is the kind of thing that is best covered with a YouTube search for reviews.

This is also decent:

Top 10 Best Data Recovery Software in 2023 (Including FREE)

Selecting the best data recovery app can be confusing, but our selection of the top 10 best solutions is here to help.

www.handyrecovery.com

 

[unicord]

My most frequent (mostly for Reddit, but also useful elsewhere) is Ripme.

Also, as a Mac user - MacYTDL is easy to use for YT, Twitch, Vimeo (with some url digging, etc. )

 

[Artaud Terranova]

does anyone know how to download b3ntb0x thumbnails in high resolution?