FantiaDL
Download media and other data from Fantia fanclubs and posts. A session cookie must be provided with the -c/–cookie argument directly or by passing the path to a legacy Netscape cookies file. Please see the About Session Cookies section.
usage: fantiadl [options] url
positional arguments:
url fanclub or post URL
options:
-h, --help show this help message and exit
-c SESSION_COOKIE, --cookie SESSION_COOKIE
_session_id cookie or cookies.txt
-q, --quiet suppress output
-v, --version show program's version number and exit
--db DB_PATH database to track post download state (creates tables when first specified)"
--db-bypass-post-check
bypass checking a post for new content if it's marked as completed on the database
download options:
-i, --ignore-errors continue on download errors
-l #, --limit # limit the number of posts to process per fanclub (excludes -n)
-o OUTPUT_PATH, --output-directory OUTPUT_PATH
directory to download to
-s, --use-server-filenames
download using server defined filenames
-r, --mark-incomplete-posts
add .incomplete file to post directories that are incomplete
-m, --dump-metadata store metadata to file (including fanclub icon, header, and background)
-x, --parse-for-external-links
parse posts for external links
-t, --download-thumbnail
download post thumbnails
-f, --download-fanclubs
download posts from all followed fanclubs
-p, --download-paid-fanclubs
download posts from all fanclubs backed on a paid plan
-n #, --download-new-posts #
download a specified number of new posts from your fanclub timeline
-d %Y-%m, --download-month %Y-%m
download posts only from a specific month, e.g. 2007-08 (excludes -n)
--exclude EXCLUDE_FILE
file containing a list of filenames to exclude from downloading
To track post downloads, specify a database path using --db, e.g. --db ~/fantiadl.db. When existing post content downloads are encountered, they will be skipped over. When all post contents under a parent post have been downloaded, the post will be marked complete on the database. If future requests to download a post indicate the post was modified based on its timestamp, new contents will be checked for; this behavior can be disabled by setting --db-bypass-post-check.
When parsing for external links using -x, a .crawljob file is created in your root directory (either the directory provided with -o or the directory the script is being run from) that can be parsed by JDownloader. As posts are parsed, links will be appended and assigned their appropriate post directories for download. You can import this file manually into JDownloader (File -> Load Linkcontainer) or setup the Folder Watch plugin to watch your root directory for .crawljob files.
About Session Cookies
Due to recent changes imposed by Fantia, providing an email and password to login from the command line is no longer supported. In order to login, you will need to provide the _session_id cookie for your Fantia login session using -c/–cookie. After logging in normally on your browser, this value can then be extracted and used with FantiaDL. This value expires and may need to be updated with some regularity.
Mozilla Firefox
- On https://fantia.jp, press Ctrl + Shift + I to open Developer Tools.
- Select the Storage tab at the top. In the sidebar, select https://fantia.jp under the Cookies heading.
- Locate the
_session_id cookie name. Click on the value to copy it.
Google Chrome
- On https://fantia.jp, press Ctrl + Shift + I to open DevTools.
- Select the Application tab at the top. In the sidebar, expand Cookies under the Storage heading and select https://fantia.jp.
- Locate the
_session_id cookie name. Click on the value to copy it.
Third-Party Extensions (cookies.txt)
You also have the option of passing the path to a legacy Netscape format cookies file with -c/–cookie, e.g. -c ~/cookies.txt. Using an extension like cookies.txt, create a text file matching the accepted format:
# Netscape HTTP Cookie File
# https://curl.haxx.se/rfc/cookie_spec.html
# This is a generated file! Do not edit.
fantia.jp FALSE / FALSE 1595755239 _session_id a1b2c3d4...
Only the _session_id cookie is required.
Download
pip install fantiadl
https://pypi.org/project/fantiadl/
Binaries are also provided for new releases.
Build Requirements
- Python >=3.7
- requests
- beautifulsoup4
Roadmap
评论