mirror of
https://github.com/AAndyProgram/SCrawler.git
synced 2026-03-14 15:52:18 +00:00
2025.6.1.0
5
Home.md
5
Home.md
@@ -128,6 +128,11 @@ Load sessions:
|
|||||||
- `Move checked to...` - move checked items to another location
|
- `Move checked to...` - move checked items to another location
|
||||||
- `Copy feed/session files to...` - copy all the files of the loaded feed/session to another location
|
- `Copy feed/session files to...` - copy all the files of the loaded feed/session to another location
|
||||||
- `Move feed/session files to...` - move all the files of the loaded feed/session to another location
|
- `Move feed/session files to...` - move all the files of the loaded feed/session to another location
|
||||||
|
- `Filter`
|
||||||
|
- `Simple filter` - apply filter to current feed/session
|
||||||
|
- `Disable filter`
|
||||||
|
- `Save current filter`
|
||||||
|
- `Managing saved filters`
|
||||||
- `Load Favorite` - load your Favorite feed
|
- `Load Favorite` - load your Favorite feed
|
||||||
- `Load special feed` - load one or more of your special feeds
|
- `Load special feed` - load one or more of your special feeds
|
||||||
- `Add checked to Favorite` - add checked posts to your Favorite feed
|
- `Add checked to Favorite` - add checked posts to your Favorite feed
|
||||||
|
|||||||
13
Settings.md
13
Settings.md
@@ -191,6 +191,11 @@ Red highlight means that the field is required or you have entered an incorrect
|
|||||||
- `Get user media only` - the default for creating new users
|
- `Get user media only` - the default for creating new users
|
||||||
- `Temporary`, `Download images/videos` - personal site settings by default for creating new users. Means the same as the parameters of the same name on the `Defaults` tab. If the checkbox is in an intermediate state, then the same name setting of the `Defaults` tab will be used instead. Otherwise, this setting will be applied.
|
- `Temporary`, `Download images/videos` - personal site settings by default for creating new users. Means the same as the parameters of the same name on the `Defaults` tab. If the checkbox is in an intermediate state, then the same name setting of the `Defaults` tab will be used instead. Otherwise, this setting will be applied.
|
||||||
|
|
||||||
|
- `New user defaults`
|
||||||
|
- `Download text` - download text *(if available)* for posts with image and video. If this checkbox is checked, the post text will be downloaded along with the file and saved under the same name but with the `txt` extension.
|
||||||
|
- `Download text posts` - download text *(if available)* for text posts *(no image and video)*
|
||||||
|
- `Text special folder` - if checked, text files will be saved to a separate folder
|
||||||
|
|
||||||
## Basic rules for sites settings
|
## Basic rules for sites settings
|
||||||
- **Always add cookies first** *(if required)*. Some fields can be extracted and filled from cookies.
|
- **Always add cookies first** *(if required)*. Some fields can be extracted and filled from cookies.
|
||||||
- When updating cookies, I recommend updating headers as well *(if required)*
|
- When updating cookies, I recommend updating headers as well *(if required)*
|
||||||
@@ -217,7 +222,7 @@ ffmpeg is required for several sites like Reddit, PornHub, XHamster, XVIDEOS, et
|
|||||||
|
|
||||||
### Gallery-dl
|
### Gallery-dl
|
||||||
|
|
||||||
Version **1.29.2** ([release](https://github.com/mikf/gallery-dl/releases/tag/v1.29.2); [x64](https://github.com/mikf/gallery-dl/releases/download/v1.29.2/gallery-dl.exe); [x86](https://github.com/mikf/gallery-dl/releases/download/v1.29.2/gallery-dl_x86.exe))
|
Version **1.29.7** ([release](https://github.com/mikf/gallery-dl/releases/tag/v1.29.7); [x64](https://github.com/mikf/gallery-dl/releases/download/v1.29.7/gallery-dl.exe); [x86](https://github.com/mikf/gallery-dl/releases/download/v1.29.7/gallery-dl_x86.exe))
|
||||||
|
|
||||||
**The following sites use gallery-dl:**
|
**The following sites use gallery-dl:**
|
||||||
- [Pinterest](#pinterest)
|
- [Pinterest](#pinterest)
|
||||||
@@ -226,12 +231,12 @@ Version **1.29.2** ([release](https://github.com/mikf/gallery-dl/releases/tag/v1
|
|||||||
|
|
||||||
### YT-DLP
|
### YT-DLP
|
||||||
|
|
||||||
Version **2025.02.19** ([release](https://github.com/yt-dlp/yt-dlp/releases/tag/2025.02.19); [x64](https://github.com/yt-dlp/yt-dlp/releases/download/2025.02.19/yt-dlp.exe); [x86](https://github.com/yt-dlp/yt-dlp/releases/download/2025.02.19/yt-dlp_x86.exe))
|
Version **2025.05.22** ([release](https://github.com/yt-dlp/yt-dlp/releases/tag/2025.05.22); [x64](https://github.com/yt-dlp/yt-dlp/releases/download/2025.05.22/yt-dlp.exe); [x86](https://github.com/yt-dlp/yt-dlp/releases/download/2025.05.22/yt-dlp_x86.exe))
|
||||||
|
|
||||||
**The following sites use yt-dlp:**
|
**The following sites use yt-dlp:**
|
||||||
- [YouTube](#youtube)
|
- [YouTube](#youtube)
|
||||||
- [ThisVid](#thisvid)
|
- [ThisVid](#thisvid)
|
||||||
- [TikTok](#tiktok)<!-- (using [plugin](https://github.com/bashonly/yt-dlp-TTUser))-->
|
- [TikTok](#tiktok)
|
||||||
|
|
||||||
### OF-Scraper
|
### OF-Scraper
|
||||||
|
|
||||||
@@ -382,6 +387,7 @@ To completely download a large profile, you can use sleep timers. The sleep time
|
|||||||
- `keydb_api` - change the keydb_api. **Change this value only if you know what you are doing.**
|
- `keydb_api` - change the keydb_api. **Change this value only if you know what you are doing.**
|
||||||
- `Private key` - path to the DRM key file `private_key.pem`
|
- `Private key` - path to the DRM key file `private_key.pem`
|
||||||
- `Client ID` - path to the DRM key file `client_id.bin`
|
- `Client ID` - path to the DRM key file `client_id.bin`
|
||||||
|
- `backend` - the value of `advanced_options` in the configuration. If you can't download the video, try using 'httpx'.
|
||||||
|
|
||||||

|

|
||||||
|
|
||||||
@@ -478,6 +484,7 @@ To support the downloading of this site you should add the Mastodon domain to th
|
|||||||
- `Request timer` - this is the time value (in milliseconds) the program will wait before processing the next `Request time counter` request (**it is highly recommended not to change this default value**)
|
- `Request timer` - this is the time value (in milliseconds) the program will wait before processing the next `Request time counter` request (**it is highly recommended not to change this default value**)
|
||||||
- `Request time counter` - how many requests will be sent to Instagram before the program waits `Request timer` milliseconds (**it is highly recommended not to change this default value**)
|
- `Request time counter` - how many requests will be sent to Instagram before the program waits `Request timer` milliseconds (**it is highly recommended not to change this default value**)
|
||||||
- `Post limit timer` - this is the time value (in milliseconds) the program will wait before processing the next request after 195 requests (**it is highly recommended not to change this default value**)
|
- `Post limit timer` - this is the time value (in milliseconds) the program will wait before processing the next request after 195 requests (**it is highly recommended not to change this default value**)
|
||||||
|
- `Next profile timer` - the time value (in milliseconds) the program will wait before processing the next profile. -2 to use max timer. -1 to disable. The default value is -2 (**it is highly recommended not to change this default value**)
|
||||||
- Errors
|
- Errors
|
||||||
- `Skip errors` - skip the following errors (comma separated). Facing these errors will not disable the download, but will add a simple line to the log.
|
- `Skip errors` - skip the following errors (comma separated). Facing these errors will not disable the download, but will add a simple line to the log.
|
||||||
- `Add skipped errors to the log`
|
- `Add skipped errors to the log`
|
||||||
|
|||||||
@@ -3,6 +3,7 @@ This is a standalone application. It works separately from SCrawler.
|
|||||||
- `Add`
|
- `Add`
|
||||||
- `Add`
|
- `Add`
|
||||||
- `Add URL array`
|
- `Add URL array`
|
||||||
|
- `Filter` - filter downloaded data
|
||||||
- `Download` - start download
|
- `Download` - start download
|
||||||
- `Stop` - stop download
|
- `Stop` - stop download
|
||||||
- `Delete` - delete selected items (with files)
|
- `Delete` - delete selected items (with files)
|
||||||
|
|||||||
Reference in New Issue
Block a user