Off Topic Tools for downloading/archiving/sharing

alx88


--i use idm internet download manager very easy to use and install. but if the video has protection i cant download--

yea that is correct sir.. !!

i would like to know too if there is any IDM mod or crack which would allow to download protected content with IDM. ??

there is anoying baypass with ytb-dl and u need adress which u copy from idm link catcher,but it does not work every time.
 
Last edited:
Comment
I figured I'd share how I do things. This is all based on open source and it's all command-line because I prefer to script everything, then leave and let the computer do the actual work. Using a GUI for these things seem inefficient to me. I have a native nix shell at my disposal, but this might work on Windows too - I have no idea.

Note: if bash and command line isn't your thing, this isn't for you.


instagram-scraper [https://github.com/arc298/instagram-scraper]
Self-explanatory. Gotta be careful though - never download more than 100 posts in 15 minutes as your IP will get temporarily banned from accessing a post.
Below are the scripts I wrote for it.
Bash:
IGUSR="<YOUR USERNAME GOES HERE>"
IGPWD="<PASSWORD GOES HERE>"
IGDLPATH="<FULL PATH TO TARGET DIRECTORY GOES HERE>"
igscrape() {
    echo 'entering' ${IGDLPATH};
    cd "$IGDLPATH";
    echo 'Scraping' $1 'from instagram [types: image]';
    instagram-scraper $1 -t image --latest --cookiejar _cookie.txt --template "{year}-{month}-{day}_{urlname}" -u $IGUSR -p $IGPWD
}

igscrapeall() {
    echo 'entering' ${IGDLPATH};
    cd "$IGDLPATH";
    echo 'Scraping LATEST from _batch.txt [types: image]';
    instagram-scraper -f _batch.txt -t image --latest --cookiejar _cookie.txt --template "{year}-{month}-{day}_{urlname}" -u $IGUSR -p $IGPWD
}

Within my target folder there's a file called "batch.txt". In it, there are a few accounts I scrape often. Since the option to not download posts that are already present is defined, this works well. I've also chosen to only download images, but this is a flag to remove if it doesn't fit you.


bdfr (Bulk Downloader for Reddit) [https://github.com/aliparlakci/bulk-downloader-for-reddit]
Specifically I wrote a tiny bash script that makes life a little easier:
Bash:
rdl() {
    if [[ -z $2 ]];
        then lim="1000";
        else lim="$2"
    fi
    echo 'downloading maximum' $lim 'posts';
    python3.9 -m bdfr download . --user $1 --limit $lim --authenticate --sort new --submitted --no-dupes --file-scheme '{POSTID}' --folder-scheme '{REDDITOR}'
}

It takes two parameters: the username and the limit. I never use offset so didn't include that option.


yt-dlp [https://github.com/yt-dlp/yt-dlp]
Downloading YouTube videos. These are just simple aliases with some flags I almost always use.

Bash:
alias ytd="yt-dlp -f 'bv*+ba/b' "
alias ytdc="yt-dlp -f 'bv*+ba/b' --cookies='<PATH TO A .TXT WITH YT COOKIES>'"

I export my YT cookies and place it on the Desktop, name it ytcookies.txt, and thus I'm able to download age-restricted videos.


cyberdrop-dl [https://github.com/Jules-WinnfieldX/CyberDropDownloader]
For batch downloading from cyberdrop, bunkr, gofile, pixl etc etc.

It's super simple to use and works like a treat.


EroMe Data Scraper [https://openbase.com/python/erome]
Self-explanatory. Rarely used because we all know Erome is a _terrible_ host for anything, let alone video.



Oh and by the way... Clean images before you post!
I've downloaded images on here that had coordinates in them. And since ya'll are likely at home when screenshoting OF, that's just bad opsec. Images "produced" by you will most likely have information about your devices at the very least. So it's just a good idea to get rid of that information if there happen to be any. So I suggest _always_ running images through an EXIF cleaner of some sort.

I'd recommend exiv2 because it's dead-simple.

Bash:
alias cleanjpeg="find . -type f \( -iname \*.jpg -o -iname \*.jpeg \) -exec exiv2 -d a {}  \;"

When it's installed, this is a simple alias to find all jpeg images within your current directory tree and eras any EXIF data there is.
 
Comment
Feb 13, 2020
31
86
Gallery -dl and Hydrus Network are good options to batch download images from variouss sites

Hydrus works a bit different in the way it stores image, since it creates a database to show images inside the program.

Gallery -dl it's just a python program to run from terminal
 
  • Like
Reactions: ogg
Comment