geonu/SCrawler
1
0
Fork 0
mirror of https://github.com/AAndyProgram/SCrawler.git synced 2026-03-14 15:52:18 +00:00
Code Issues Packages Projects Releases Wiki Activity

2025.10.4.0

Browse Source 
YT
YouTubeSettings: add property 'ParseLongUserTitle'
YouTubeMediaContainerBase: concatenate artists

SCrawler
Bluesky: add saved posts downloading
xHamster: temporarily disable the plugin
This commit is contained in:
Andy
2025-10-04 15:43:40 +03:00
parent 1404afdfa3
commit 8dfd4e8bd1
10 changed files with 256 additions and 125 deletions
Download Patch File Download Diff File Expand all files Collapse all files

226
Changelog.md
View File

@@ -1,11 +1,35 @@
# 2025.9.1.0 # Program versions
- [ffmpeg](https://github.com/AAndyProgram/SCrawler/wiki/Settings#ffmpeg)
- x64 version - [release](https://github.com/GyanD/codexffmpeg/releases/tag/5.1.2); [zip](https://github.com/GyanD/codexffmpeg/releases/download/5.1.2/ffmpeg-5.1.2-full_build.zip); **version `5.1.2-full_build-www.gyan.dev`**
- x86 version - [release](https://github.com/yt-dlp/FFmpeg-Builds/releases/tag/autobuild-2022-11-30-12-57); [zip](https://github.com/yt-dlp/FFmpeg-Builds/releases/download/autobuild-2022-11-30-12-57/ffmpeg-N-109274-gd7a5f068c2-win32-gpl.zip); **version `N-109457-geeb280f351-20221226`**
- [Gallery-dl](https://github.com/AAndyProgram/SCrawler/wiki/Settings#gallery-dl) - **1.30.9**
- [YT-DLP](https://github.com/AAndyProgram/SCrawler/wiki/Settings#yt-dlp) - **2025.09.26**
- [OF-Scraper](https://github.com/AAndyProgram/SCrawler/wiki/Settings#of-scraper) - **3.12.9** ([release](https://github.com/datawhores/OF-Scraper/releases/tag/3.12.9))
# 2025
## 2025.10.4.0
*2025-10-04*
**xHamster downloads are temporarily disabled**
- Added
- Sites:
- Bluesky: **saved posts downloading**
- xHamster: **temporarily disable the plugin**
- Minor improvements
- Updated
- yt-dlp up to version **2025.09.26**
- gallery-dl up to version **1.30.9**
## 2025.9.1.0
*2025-09-01* *2025-09-01*
- Fixed - Fixed
- PornHub: data is not downloading - PornHub: data is not downloading
# 2025.8.30.0 ## 2025.8.30.0
*2025-08-30* *2025-08-30*
@@ -23,7 +47,7 @@
- **YouTube: downloading error** - **YouTube: downloading error**
- Minor bugs - Minor bugs
# 2025.8.1.0 ## 2025.8.1.0
*2025-08-01* *2025-08-01*
@@ -39,7 +63,7 @@
- Reddit: in some cases crossposts don't download - Reddit: in some cases crossposts don't download
- Minor bugs - Minor bugs
# 2025.7.18.0 ## 2025.7.18.0
*2025-07-18* *2025-07-18*
@@ -56,7 +80,7 @@
- OnlyFans: **hanging on purchased content** - OnlyFans: **hanging on purchased content**
- Minor bugs - Minor bugs
# 2025.6.12.0 ## 2025.6.12.0
*2025-06-12* *2025-06-12*
@@ -70,7 +94,7 @@
- Saved posts: text downloading with saved posts - Saved posts: text downloading with saved posts
- Environment incorrect output - Environment incorrect output
# 2025.6.1.0 ## 2025.6.1.0
*2025-06-01* *2025-06-01*
@@ -112,7 +136,7 @@
- data is not downloaded in some cases - data is not downloaded in some cases
- Minor bugs - Minor bugs
# 2025.3.17.0 ## 2025.3.17.0
*2025-03-17* *2025-03-17*
@@ -126,7 +150,7 @@
- PornHub: newly added users aren't downloading - PornHub: newly added users aren't downloading
- Threads: users aren't updated if there is a pinned post - Threads: users aren't updated if there is a pinned post
# 2025.2.25.0 ## 2025.2.25.0
*2025-02-25* *2025-02-25*
@@ -158,7 +182,7 @@
- Threads: **data is not downloading** - Threads: **data is not downloading**
- Minor bugs - Minor bugs
# 2025.1.12.0 ## 2025.1.12.0
*2025-01-12* *2025-01-12*
@@ -183,7 +207,8 @@
- YouTube: **communities are not downloading** *(see settings in wiki)* - YouTube: **communities are not downloading** *(see settings in wiki)*
- Minor bugs - Minor bugs
# 2024.11.21.0 # 2024
## 2024.11.21.0
*2024-11-21* *2024-11-21*
@@ -206,7 +231,7 @@
- Main window: in some cases users are not updated in the list - Main window: in some cases users are not updated in the list
- Minor bugs - Minor bugs
# 2024.10.24.0 ## 2024.10.24.0
*2024-10-24* *2024-10-24*
@@ -231,7 +256,7 @@
- Can't change data path (issue #206) - Can't change data path (issue #206)
- Minor bugs - Minor bugs
# 2024.9.2.0 ## 2024.9.2.0
*2024-09-02* *2024-09-02*
@@ -247,7 +272,7 @@
- YouTube (SCrawler): incorrect parsing of video page - YouTube (SCrawler): incorrect parsing of video page
- Minor bugs - Minor bugs
# 2024.8.10.0 ## 2024.8.10.0
*2024-08-10* *2024-08-10*
@@ -259,7 +284,7 @@
- Fixed - Fixed
- YouTube (standalone app): **video is being parsed using cookies but is not downloading** *(Issue #205)* - YouTube (standalone app): **video is being parsed using cookies but is not downloading** *(Issue #205)*
# 2024.8.1.0 ## 2024.8.1.0
*2024-08-01* *2024-08-01*
@@ -268,7 +293,7 @@
- Updated - Updated
- yt-dlp up to version **2024.08.01** - yt-dlp up to version **2024.08.01**
# 2024.7.24.0 ## 2024.7.24.0
*2024-07-24* *2024-07-24*
@@ -291,7 +316,7 @@
- OnlyFans: rules parsing bug - OnlyFans: rules parsing bug
- Minor bugs - Minor bugs
# 2024.6.25.0 ## 2024.6.25.0
*2024-06-25* *2024-06-25*
@@ -305,7 +330,7 @@
- Fixed - Fixed
- Minor bugs - Minor bugs
# 2024.6.10.0 ## 2024.6.10.0
*2024-06-10* *2024-06-10*
@@ -318,7 +343,7 @@
- Fixed - Fixed
- Minor bugs - Minor bugs
# 2024.6.6.0 ## 2024.6.6.0
*2024-06-06* *2024-06-06*
@@ -334,7 +359,7 @@
- OnlyFans: **data is not downloading** - OnlyFans: **data is not downloading**
- Minor bugs - Minor bugs
# 2024.6.4.0 ## 2024.6.4.0
*2024-06-04* *2024-06-04*
@@ -353,7 +378,7 @@
- Twitter: deleting user directory when redownloading missing posts - Twitter: deleting user directory when redownloading missing posts
- Minor bugs - Minor bugs
# 2024.5.19.0 ## 2024.5.19.0
*2024-05-19* *2024-05-19*
@@ -362,7 +387,7 @@
- Fixed - Fixed
- YouTube (SCrawler): advanced settings are not saved when changed - YouTube (SCrawler): advanced settings are not saved when changed
# 2024.5.18.0 ## 2024.5.18.0
*2024-05-18* *2024-05-18*
@@ -389,7 +414,7 @@
- Twitter: **data is not downloading due to domain change from twitter.com to x.com** - Twitter: **data is not downloading due to domain change from twitter.com to x.com**
- Minor bugs - Minor bugs
# 2024.5.4.0 ## 2024.5.4.0
*2024-05-04* *2024-05-04*
@@ -404,7 +429,7 @@
- Reddit: token update error - Reddit: token update error
- Threads: unable to obtain credentials (`ID`) - Threads: unable to obtain credentials (`ID`)
# 2024.4.26.0 ## 2024.4.26.0
*2024-04-26* *2024-04-26*
@@ -417,14 +442,14 @@
- Fixed - Fixed
- xHamster: **saved posts aren't downloading** - xHamster: **saved posts aren't downloading**
# 2024.4.14.0 ## 2024.4.14.0
*2024-04-14* *2024-04-14*
- Fixed - Fixed
- Facebook: can't get tokens - Facebook: can't get tokens
# 2024.4.13.0 ## 2024.4.13.0
*2024-04-13* *2024-04-13*
@@ -438,7 +463,7 @@
- YouTube: remove last download date when erasing history data - YouTube: remove last download date when erasing history data
- Instagram: **saved posts aren't downloading** - Instagram: **saved posts aren't downloading**
# 2024.4.10.0 ## 2024.4.10.0
*2024-04-10* *2024-04-10*
@@ -506,7 +531,7 @@
- Feed: a scrolling bug where the feed scrolls up after returning to it - Feed: a scrolling bug where the feed scrolls up after returning to it
- Minor bugs - Minor bugs
# 2024.2.25.0 ## 2024.2.25.0
*2024-02-25* *2024-02-25*
@@ -540,7 +565,7 @@
- TikTok: files with long names aren't downloaded - TikTok: files with long names aren't downloaded
- Minor bugs - Minor bugs
# 2024.1.26.0 ## 2024.1.26.0
*2024-01-26* *2024-01-26*
@@ -552,7 +577,7 @@
- Instagram: stories (user) downloading with the wrong aspect ratio for some users - Instagram: stories (user) downloading with the wrong aspect ratio for some users
- Minor bugs - Minor bugs
# 2024.1.20.0 ## 2024.1.20.0
*2024-01-20* *2024-01-20*
@@ -560,7 +585,7 @@
- Instagram: **the ability to download reels** - Instagram: **the ability to download reels**
- LPSG: handle 404 error - LPSG: handle 404 error
# 2024.1.18.0 ## 2024.1.18.0
*2024-01-18* *2024-01-18*
@@ -570,7 +595,7 @@
- YouTube (standalone app): URL array form doesn't show scrollbars - YouTube (standalone app): URL array form doesn't show scrollbars
- Minor bugs - Minor bugs
# 2024.1.12.1 ## 2024.1.12.1
*2024-01-12* *2024-01-12*
@@ -583,7 +608,7 @@
- YouTube: incorrect opening of a post from the feed - YouTube: incorrect opening of a post from the feed
- YouTube: wrong date to data parsing - YouTube: wrong date to data parsing
# 2024.1.12.0 ## 2024.1.12.0
*2024-01-12* *2024-01-12*
@@ -599,7 +624,8 @@
- xHamster: profiles are not downloading - xHamster: profiles are not downloading
- Minor bugs - Minor bugs
# 2023.12.27.0 # 2023
## 2023.12.27.0
*2023-12-27* *2023-12-27*
@@ -613,7 +639,7 @@
- Saved posts: session file is not updated when new data is added - Saved posts: session file is not updated when new data is added
- Minor bugs - Minor bugs
# 2023.12.15.0 ## 2023.12.15.0
*2023-12-15* *2023-12-15*
@@ -621,7 +647,7 @@
- Twitter: some twitter profiles don't download completely - Twitter: some twitter profiles don't download completely
- Minor bugs - Minor bugs
# 2023.12.14.0 ## 2023.12.14.0
*2023-12-14* *2023-12-14*
@@ -629,7 +655,7 @@
- YouTube: options `Create thumbnail files (video)` and `Create thumbnail files (music)` - YouTube: options `Create thumbnail files (video)` and `Create thumbnail files (music)`
- YouTube: `Select all` and `Select none` buttons - YouTube: `Select all` and `Select none` buttons
# 2023.12.13.0 ## 2023.12.13.0
*2023-12-13* *2023-12-13*
@@ -641,7 +667,7 @@
- Feed: saved posts are added to the end of the feed - Feed: saved posts are added to the end of the feed
- xHamster: some videos won't download - xHamster: some videos won't download
# 2023.12.10.0 ## 2023.12.10.0
*2023-12-10* *2023-12-10*
@@ -650,7 +676,7 @@
- Fixed - Fixed
- Twitter: data is not downloading - Twitter: data is not downloading
# 2023.12.7.0 ## 2023.12.7.0
*2023-12-07* *2023-12-07*
@@ -666,14 +692,14 @@
- Standalone downloader: URL files are not deleted along with the file - Standalone downloader: URL files are not deleted along with the file
- Minor bugs - Minor bugs
# 2023.11.25.0 ## 2023.11.25.0
*2023-11-25* *2023-11-25*
- Fixed - Fixed
- Reddit: missing refresh token button in the settings form - Reddit: missing refresh token button in the settings form
# 2023.11.24.0 ## 2023.11.24.0
*2023-11-24* *2023-11-24*
@@ -697,7 +723,7 @@ For those of you who use TikTok, I recommend updating [TikTok plugin](https://gi
- YouTube: path not set when adding array to download - YouTube: path not set when adding array to download
- Minor bugs - Minor bugs
# 2023.11.17.0 ## 2023.11.17.0
*2023-11-17* *2023-11-17*
@@ -727,7 +753,7 @@ For those of you who use TikTok, I recommend updating [TikTok plugin](https://gi
- Automation: handle automation start error (in some cases) when changing scheduler - Automation: handle automation start error (in some cases) when changing scheduler
- Minor bugs - Minor bugs
# 2023.10.10.0 ## 2023.10.10.0
*2023-10-10* *2023-10-10*
@@ -753,7 +779,7 @@ For those of you who use TikTok, I recommend updating [TikTok plugin](https://gi
- Standalone downloader: cached thumbnail is not removed when item is removed from the list - Standalone downloader: cached thumbnail is not removed when item is removed from the list
- Minor bugs - Minor bugs
# 2023.10.1.0 ## 2023.10.1.0
*2023-10-01* *2023-10-01*
@@ -768,14 +794,14 @@ For those of you who use TikTok, I recommend updating [TikTok plugin](https://gi
- JustForFans: some profiles won't download - JustForFans: some profiles won't download
- Minor bugs - Minor bugs
# 2023.9.21.0 ## 2023.9.21.0
*2023-09-21* *2023-09-21*
- Fixed - Fixed
- PornHub: videos are not downloading - PornHub: videos are not downloading
# 2023.9.20.0 ## 2023.9.20.0
*2023-09-20* *2023-09-20*
@@ -791,7 +817,7 @@ For those of you who use TikTok, I recommend updating [TikTok plugin](https://gi
- Instagram: handle error 500 - Instagram: handle error 500
- Collections: update labels only for the added user - Collections: update labels only for the added user
# 2023.8.27.0 ## 2023.8.27.0
*2023-08-27* *2023-08-27*
@@ -810,7 +836,7 @@ For those of you who use TikTok, I recommend updating [TikTok plugin](https://gi
- Auto downloader: downloading stuck - Auto downloader: downloading stuck
- Minor bugs - Minor bugs
# 2023.8.6.0 ## 2023.8.6.0
*2023-08-06* *2023-08-06*
@@ -898,7 +924,7 @@ For those of you who use TikTok, I recommend updating [TikTok plugin](https://gi
- YouTube: a bug that caused the video to redownload - YouTube: a bug that caused the video to redownload
- Minor bugs - Minor bugs
# 2023.6.19.0 ## 2023.6.19.0
*2023-06-19* *2023-06-19*
@@ -918,7 +944,7 @@ For those of you who use TikTok, I recommend updating [TikTok plugin](https://gi
- Progress bar bugs - Progress bar bugs
- Minor bugs - Minor bugs
# 2023.6.9.0 ## 2023.6.9.0
*2023-06-09* *2023-06-09*
@@ -927,7 +953,7 @@ For those of you who use TikTok, I recommend updating [TikTok plugin](https://gi
- Twitter: make the algorithm faster - Twitter: make the algorithm faster
- Make progress more informative - Make progress more informative
# 2023.6.8.0 ## 2023.6.8.0
*2023-06-08* *2023-06-08*
@@ -939,7 +965,7 @@ For those of you who use TikTok, I recommend updating [TikTok plugin](https://gi
- Twitter: profile not fully downloaded - Twitter: profile not fully downloaded
- Corrected form size for small monitors (Issue #136) - Corrected form size for small monitors (Issue #136)
# 2023.6.5.0 ## 2023.6.5.0
*2023-06-05* *2023-06-05*
@@ -958,7 +984,7 @@ For those of you who use TikTok, I recommend updating [TikTok plugin](https://gi
- Saved posts: remove main progress perform when downloading saved posts - Saved posts: remove main progress perform when downloading saved posts
- Minor bugs - Minor bugs
# 2023.5.12.0 ## 2023.5.12.0
*2023-05-12* *2023-05-12*
@@ -976,7 +1002,7 @@ For those of you who use TikTok, I recommend updating [TikTok plugin](https://gi
- Reddit: missing & broken images bug - Reddit: missing & broken images bug
- Main window: collection pointing bug - Main window: collection pointing bug
# 2023.4.28.0 ## 2023.4.28.0
*2023-04-28* *2023-04-28*
@@ -1020,7 +1046,7 @@ For those of you who use TikTok, I recommend updating [TikTok plugin](https://gi
- PornHub: photo galleries bug (Issue #115) - PornHub: photo galleries bug (Issue #115)
- Minor bugs - Minor bugs
# 2023.3.5.0 ## 2023.3.5.0
*2023-03-05* *2023-03-05*
@@ -1029,7 +1055,7 @@ For those of you who use TikTok, I recommend updating [TikTok plugin](https://gi
- An error that could occur during Twitter MD5 comparison. - An error that could occur during Twitter MD5 comparison.
- A bug in the ffmpeg file parts concatenation algorithm that could occur in some cases. - A bug in the ffmpeg file parts concatenation algorithm that could occur in some cases.
# 2023.3.1.0 ## 2023.3.1.0
*2023-03-01* *2023-03-01*
@@ -1051,7 +1077,7 @@ For those of you who use TikTok, I recommend updating [TikTok plugin](https://gi
- (Issue #106) problem with non-Latin characters - (Issue #106) problem with non-Latin characters
- ffmpeg: maximum input length error when merging parts of files - ffmpeg: maximum input length error when merging parts of files
# 2023.2.5.0 ## 2023.2.5.0
*2023-02-05* *2023-02-05*
@@ -1060,7 +1086,7 @@ For those of you who use TikTok, I recommend updating [TikTok plugin](https://gi
- Fixed - Fixed
- (Issue #101) Failed download Gfycat video in some cases - (Issue #101) Failed download Gfycat video in some cases
# 2023.1.27.0 ## 2023.1.27.0
*2023-01-27* *2023-01-27*
@@ -1074,7 +1100,7 @@ For those of you who use TikTok, I recommend updating [TikTok plugin](https://gi
- `Interaction` option to the `Provider` attribute - `Interaction` option to the `Provider` attribute
- `IPropertyProvider` interface - `IPropertyProvider` interface
# 2023.1.24.1 ## 2023.1.24.1
*2023-01-24* *2023-01-24*
@@ -1083,7 +1109,7 @@ For those of you who use TikTok, I recommend updating [TikTok plugin](https://gi
- Fixed - Fixed
- (Issue #100) some Imgur albums won't download - (Issue #100) some Imgur albums won't download
# 2023.1.24.0 ## 2023.1.24.0
*2023-01-24* *2023-01-24*
@@ -1091,7 +1117,7 @@ For those of you who use TikTok, I recommend updating [TikTok plugin](https://gi
- (Issue #100) Imgur albums not downloading - (Issue #100) Imgur albums not downloading
- When deleting a collection with the 'ban' option, users in the collection are not banned - When deleting a collection with the 'ban' option, users in the collection are not banned
# 2023.1.2.0 ## 2023.1.2.0
*2023-01-02* *2023-01-02*
@@ -1106,7 +1132,8 @@ For those of you who use TikTok, I recommend updating [TikTok plugin](https://gi
- Fixed a bug in the user list loading algorithm - Fixed a bug in the user list loading algorithm
- Notifications: pressing any button opens SCrawler - Notifications: pressing any button opens SCrawler
# 2022.12.27.0 # 2022
## 2022.12.27.0
*2022-12-27* *2022-12-27*
@@ -1116,7 +1143,7 @@ For those of you who use TikTok, I recommend updating [TikTok plugin](https://gi
- Fixed - Fixed
- XVideos not downloading (sorry, I broke it in a previous release) - XVideos not downloading (sorry, I broke it in a previous release)
# 2022.12.26.0 ## 2022.12.26.0
*2022-12-26* *2022-12-26*
@@ -1139,7 +1166,7 @@ For those of you who use TikTok, I recommend updating [TikTok plugin](https://gi
- (Issue #69) **RedGifs data is not downloading**. Again. - (Issue #69) **RedGifs data is not downloading**. Again.
- Minor bugs - Minor bugs
# 2022.11.16.0 ## 2022.11.16.0
*2022-11-16* *2022-11-16*
@@ -1173,7 +1200,7 @@ For those of you who use TikTok, I recommend updating [TikTok plugin](https://gi
- Users search form doesn't remember last size - Users search form doesn't remember last size
- Minor bugs - Minor bugs
# 2022.10.23.0 ## 2022.10.23.0
*2022-10-23* *2022-10-23*
@@ -1192,7 +1219,7 @@ For those of you who use TikTok, I recommend updating [TikTok plugin](https://gi
- (Issue #69) **RedGifs data is not downloading**. Requires token. - (Issue #69) **RedGifs data is not downloading**. Requires token.
- Minor bugs - Minor bugs
# 2022.10.18.0 ## 2022.10.18.0
*2022-10-18* *2022-10-18*
@@ -1227,7 +1254,7 @@ For those of you who use TikTok, I recommend updating [TikTok plugin](https://gi
- When trying to delete multiple collections, each collection asked for confirmation to delete - When trying to delete multiple collections, each collection asked for confirmation to delete
- Minor bugs - Minor bugs
# 2022.9.24.0 ## 2022.9.24.0
*2022-09-24* *2022-09-24*
@@ -1245,7 +1272,7 @@ For those of you who use TikTok, I recommend updating [TikTok plugin](https://gi
- Bug in the XVIDEOS downloader - Bug in the XVIDEOS downloader
- Minor bugs - Minor bugs
# 2022.9.17.0 ## 2022.9.17.0
*2022-09-17* *2022-09-17*
@@ -1261,7 +1288,7 @@ For those of you who use TikTok, I recommend updating [TikTok plugin](https://gi
- Incorrect feed sorting algorithm - Incorrect feed sorting algorithm
- Minor bugs - Minor bugs
# 2022.9.16.0 ## 2022.9.16.0
*2022-09-16* *2022-09-16*
@@ -1270,7 +1297,7 @@ For those of you who use TikTok, I recommend updating [TikTok plugin](https://gi
- Incorrect rendering of the 'Feed' table when the number of columns is more than one - Incorrect rendering of the 'Feed' table when the number of columns is more than one
- Minor design bugs - Minor design bugs
# 2022.9.13.0 ## 2022.9.13.0
*2022-09-13* *2022-09-13*
@@ -1280,21 +1307,21 @@ For those of you who use TikTok, I recommend updating [TikTok plugin](https://gi
- (Issue #70) Instagram posts not downloading if there are pinned posts that have already been downloaded - (Issue #70) Instagram posts not downloading if there are pinned posts that have already been downloaded
- Minor bugs - Minor bugs
# 2022.9.10.0 ## 2022.9.10.0
*2022-09-10* *2022-09-10*
- Fixed - Fixed
- The memory is still leaking. This time because of the video. *Using WMP was not the best choice.* - The memory is still leaking. This time because of the video. *Using WMP was not the best choice.*
# 2022.9.8.1 ## 2022.9.8.1
*2022-09-08* *2022-09-08*
- Fixed - Fixed
- Unexpected memory leak when using the 'Feed' form - Unexpected memory leak when using the 'Feed' form
# 2022.9.8.0 ## 2022.9.8.0
*2022-09-08* *2022-09-08*
@@ -1305,7 +1332,7 @@ For those of you who use TikTok, I recommend updating [TikTok plugin](https://gi
- Fixed - Fixed
- (Issue #67) Saved Instagram posts not downloading - (Issue #67) Saved Instagram posts not downloading
# 2022.8.28.0 ## 2022.8.28.0
*2022-08-28* *2022-08-28*
@@ -1314,7 +1341,7 @@ For those of you who use TikTok, I recommend updating [TikTok plugin](https://gi
- Fixed - Fixed
- Incorrect number of posts displayed in the Reddit channels downloader. - Incorrect number of posts displayed in the Reddit channels downloader.
# 2022.8.22.0 ## 2022.8.22.0
*2022-08-22* *2022-08-22*
@@ -1328,7 +1355,7 @@ For those of you who use TikTok, I recommend updating [TikTok plugin](https://gi
- AutoDownloader option ```Show notifications``` not saved - AutoDownloader option ```Show notifications``` not saved
- Minor bugs - Minor bugs
# 2022.7.7.0 ## 2022.7.7.0
*2022-07-07* *2022-07-07*
@@ -1346,7 +1373,7 @@ For those of you who use TikTok, I recommend updating [TikTok plugin](https://gi
- In some cases, Twitter image is not downloading - In some cases, Twitter image is not downloading
- Minor bugs - Minor bugs
# 2022.6.10.0 ## 2022.6.10.0
*2022-06-10* *2022-06-10*
@@ -1355,7 +1382,7 @@ For those of you who use TikTok, I recommend updating [TikTok plugin](https://gi
- Fixed - Fixed
- Can't get Instagram user ID - Can't get Instagram user ID
# 2022.6.6.0 ## 2022.6.6.0
*2022-06-06* *2022-06-06*
@@ -1365,7 +1392,7 @@ For those of you who use TikTok, I recommend updating [TikTok plugin](https://gi
- GIFs from Twitter not downloading - GIFs from Twitter not downloading
- Not quite correct algorithm for stopping automation - Not quite correct algorithm for stopping automation
# 2022.6.3.0 ## 2022.6.3.0
*2022-06-03* *2022-06-03*
@@ -1380,7 +1407,7 @@ Changed version numbering method. From now on, new versions will be numbered by
- Videos hosted on Reddit that are downloaded via m3u8 playlists are missing an audio track. - Videos hosted on Reddit that are downloaded via m3u8 playlists are missing an audio track.
- Instagram hash not able to be auto-filled from cookies - Instagram hash not able to be auto-filled from cookies
# 3.0.0.10 ## 3.0.0.10
*2022-05-23* *2022-05-23*
@@ -1403,7 +1430,7 @@ Changed version numbering method. From now on, new versions will be numbered by
- In some cases, the date and time are not added to the filename - In some cases, the date and time are not added to the filename
- Unable to download photos from Twitter in full resolution (4K) - Unable to download photos from Twitter in full resolution (4K)
# 3.0.0.9 ## 3.0.0.9
*2022-04-24* *2022-04-24*
@@ -1415,7 +1442,7 @@ Changed version numbering method. From now on, new versions will be numbered by
- Removed adding "No Parsed" internal label when not needed - Removed adding "No Parsed" internal label when not needed
- Redownloading Instagram Stories - Redownloading Instagram Stories
# 3.0.0.8 ## 3.0.0.8
*2022-04-19* *2022-04-19*
@@ -1425,7 +1452,7 @@ Changed version numbering method. From now on, new versions will be numbered by
- Fixed - Fixed
- The script does not run after the user download is complete - The script does not run after the user download is complete
# 3.0.0.7 ## 3.0.0.7
*2022-04-14* *2022-04-14*
@@ -1437,7 +1464,7 @@ Changed version numbering method. From now on, new versions will be numbered by
- (Issue #33) Instagram Stories downloading error - (Issue #33) Instagram Stories downloading error
- LPSG downloader does not download all content - LPSG downloader does not download all content
# 3.0.0.6 ## 3.0.0.6
*2022-04-04* *2022-04-04*
@@ -1450,14 +1477,14 @@ Changed version numbering method. From now on, new versions will be numbered by
- Incorrect behavior of the main progress bar when downloading saved posts - Incorrect behavior of the main progress bar when downloading saved posts
- (Issue #25) Date and Time not added for Stories and Tagged Photos - (Issue #25) Date and Time not added for Stories and Tagged Photos
# 3.0.0.5 ## 3.0.0.5
*2022-04-02* *2022-04-02*
- Added - Added
- ```New```, ```Hot```, ```Top``` Reddit channel and user download modes - ```New```, ```Hot```, ```Top``` Reddit channel and user download modes
# 3.0.0.4 ## 3.0.0.4
*2022-03-26* *2022-03-26*
@@ -1465,7 +1492,7 @@ Changed version numbering method. From now on, new versions will be numbered by
- External plugins do not save information about downloaded files - External plugins do not save information about downloaded files
- The user cannot be added to the collection if a special path has been specified. - The user cannot be added to the collection if a special path has been specified.
# 3.0.0.3 ## 3.0.0.3
*2022-03-24* *2022-03-24*
@@ -1478,7 +1505,7 @@ Changed version numbering method. From now on, new versions will be numbered by
- Typo when applying "Download UHD" in XVIDEOS plugin - Typo when applying "Download UHD" in XVIDEOS plugin
- The sites filter does not work unless the "Fast profiles loading" option is enabled. - The sites filter does not work unless the "Fast profiles loading" option is enabled.
# 3.0.0.2 ## 3.0.0.2
*2022-03-22* *2022-03-22*
@@ -1490,7 +1517,7 @@ Changed version numbering method. From now on, new versions will be numbered by
- Fixed - Fixed
- Minor bugs - Minor bugs
# 3.0.0.1 ## 3.0.0.1
*2022-03-20* *2022-03-20*
@@ -1505,7 +1532,7 @@ Changed version numbering method. From now on, new versions will be numbered by
- Some design fixes - Some design fixes
- Minor bugs - Minor bugs
# 3.0.0.0 ## 3.0.0.0
*2022-03-17* *2022-03-17*
@@ -1547,7 +1574,7 @@ Changed version numbering method. From now on, new versions will be numbered by
At the requests of some users, I added [screenshots](ProgramScreenshots) of the program and added screenshots to [ReadMe](README.md) and the [guide](https://github.com/AAndyProgram/SCrawler/wiki). At the requests of some users, I added [screenshots](ProgramScreenshots) of the program and added screenshots to [ReadMe](README.md) and the [guide](https://github.com/AAndyProgram/SCrawler/wiki).
# 2.0.0.4 ## 2.0.0.4
*2022-02-07* *2022-02-07*
@@ -1563,7 +1590,7 @@ At the requests of some users, I added [screenshots](ProgramScreenshots) of the
- **Error when specifying network paths** - **Error when specifying network paths**
- Minor bugs - Minor bugs
# 2.0.0.3 ## 2.0.0.3
*2022-02-02* *2022-02-02*
@@ -1580,7 +1607,7 @@ At the requests of some users, I added [screenshots](ProgramScreenshots) of the
- Collection ignored when validated when creating a new user - Collection ignored when validated when creating a new user
- Incorrect number of Instagram profiles downloads per session - Incorrect number of Instagram profiles downloads per session
# 2.0.0.2 ## 2.0.0.2
*2022-01-23* *2022-01-23*
@@ -1604,7 +1631,8 @@ At the requests of some users, I added [screenshots](ProgramScreenshots) of the
- Fixed - Fixed
- The program was showing incorrect information about the total numbers of images and videos downloaded when a Reddit user was created from a channel - The program was showing incorrect information about the total numbers of images and videos downloaded when a Reddit user was created from a channel
# 2.0.0.1 # 2021
## 2.0.0.1
*2021-12-29* *2021-12-29*
@@ -1614,7 +1642,7 @@ At the requests of some users, I added [screenshots](ProgramScreenshots) of the
- Incorrect filling of user parameters in the user creation form - Incorrect filling of user parameters in the user creation form
- In some cases, the global settings cannot be saved. - In some cases, the global settings cannot be saved.
# 2.0.0.0 ## 2.0.0.0
*2021-12-27* *2021-12-27*
@@ -1633,7 +1661,7 @@ At the requests of some users, I added [screenshots](ProgramScreenshots) of the
- Suspended profiles do not change status if the profile is no longer suspended - Suspended profiles do not change status if the profile is no longer suspended
- Limited download for Twitter not implemented - Limited download for Twitter not implemented
# 1.0.1.0 ## 1.0.1.0
*2021-12-20* *2021-12-20*
@@ -1656,7 +1684,7 @@ At the requests of some users, I added [screenshots](ProgramScreenshots) of the
- Users in the main window are not refreshed if new users are added by a list that includes banned and/or unrecognized users. - Users in the main window are not refreshed if new users are added by a list that includes banned and/or unrecognized users.
- Minor bugs - Minor bugs
# 1.0.0.4 ## 1.0.0.4
*2021-12-12* *2021-12-12*
@@ -1666,7 +1694,7 @@ At the requests of some users, I added [screenshots](ProgramScreenshots) of the
- Fixed - Fixed
- Images hosted on Imgur won't download - Images hosted on Imgur won't download
# 1.0.0.3 ## 1.0.0.3
*2021-12-11* *2021-12-11*
@@ -1674,7 +1702,7 @@ At the requests of some users, I added [screenshots](ProgramScreenshots) of the
- Custom "Download videos" option is not saved - Custom "Download videos" option is not saved
- The "Download all" button is not activated after changing modes - The "Download all" button is not activated after changing modes
# 1.0.0.2 ## 1.0.0.2
*2021-12-10* *2021-12-10*
@@ -1684,7 +1712,7 @@ At the requests of some users, I added [screenshots](ProgramScreenshots) of the
- Fixed - Fixed
- In some cases, the "Stop" button is not activated after download start - In some cases, the "Stop" button is not activated after download start
# 1.0.0.1 ## 1.0.0.1
*2021-12-09* *2021-12-09*

3
SCrawler.YouTube/Base/YouTubeSettings.vb
View File

@@ -268,6 +268,9 @@ Namespace API.YouTube.Base
<Browsable(True), GridVisible, XMLVN({"Defaults"}, FileDateMode.None), Category("Defaults"), DisplayName("Add channel to file name"), <Browsable(True), GridVisible, XMLVN({"Defaults"}, FileDateMode.None), Category("Defaults"), DisplayName("Add channel to file name"),
Description("Add channel name before/after the file name")> Description("Add channel name before/after the file name")>
Public ReadOnly Property FileAddChannelToFileName As XMLValue(Of FileDateMode) Public ReadOnly Property FileAddChannelToFileName As XMLValue(Of FileDateMode)
<Browsable(True), GridVisible, XMLVN({"Defaults"}, True), Category("Defaults"), DisplayName("Parse long user titles"),
Description("Suitable for multiple artists")>
Public ReadOnly Property ParseLongUserTitle As XMLValue(Of Boolean)
#End Region #End Region
#Region "Defaults ChannelsDownload" #Region "Defaults ChannelsDownload"
<Browsable(True), GridVisible, XMLVN({"Defaults", "Channels"}), Category("Defaults"), DisplayName("Default download tabs for channels"), <Browsable(True), GridVisible, XMLVN({"Defaults", "Channels"}), Category("Defaults"), DisplayName("Default download tabs for channels"),

4
SCrawler.YouTube/My Project/AssemblyInfo.vb
View File

@@ -32,6 +32,6 @@ Imports System.Runtime.InteropServices
' by using the '*' as shown below: ' by using the '*' as shown below:
' <Assembly: AssemblyVersion("1.0.*")> ' <Assembly: AssemblyVersion("1.0.*")>
<Assembly: AssemblyVersion("2025.8.30.0")> <Assembly: AssemblyVersion("2025.10.4.0")>
<Assembly: AssemblyFileVersion("2025.8.30.0")> <Assembly: AssemblyFileVersion("2025.10.4.0")>
<Assembly: NeutralResourcesLanguage("en")> <Assembly: NeutralResourcesLanguage("en")>

10
SCrawler.YouTube/Objects/YouTubeMediaContainerBase.vb
View File

@@ -1716,12 +1716,20 @@ Namespace API.YouTube.Objects
If Not tmpPls.IsEmptyString Then PlaylistTitle = tmpPls If Not tmpPls.IsEmptyString Then PlaylistTitle = tmpPls
End If End If
Dim tmpTitle$
UserID = .Value("uploader_id") UserID = .Value("uploader_id")
UserTitle = TitleHtmlConverter.Invoke(.Value("uploader")) UserTitle = TitleHtmlConverter.Invoke(.Value("uploader"))
If Not UserTitle.IsEmptyString Then If Not UserTitle.IsEmptyString Then
Dim tmpTitle$ = UserTitle.Replace("Topic", String.Empty).StringTrimEnd(" ", "-") tmpTitle = UserTitle.Replace("Topic", String.Empty).StringTrimEnd(" ", "-")
If Not tmpTitle.IsEmptyString Then UserTitle = tmpTitle If Not tmpTitle.IsEmptyString Then UserTitle = tmpTitle
End If End If
If MyYouTubeSettings.ParseLongUserTitle Or UserTitle.IsEmptyString Then
tmpTitle = TitleHtmlConverter.Invoke(.Value("artist"))
If Not tmpTitle.IsEmptyString Then
If Not UserTitle.IsEmptyString AndAlso Not tmpTitle.Contains(UserTitle) Then tmpTitle = $"{UserTitle}, {tmpTitle}"
UserTitle = ListAddList(Nothing, tmpTitle.Split(","), CType(Function(v$) v.StringTrim, Func(Of Object, Object)), EDP.ReturnValue).ListToString(" & ").IfNullOrEmpty(UserTitle)
End If
End If
Dim ext$ = IIf(IsMusic, Dim ext$ = IIf(IsMusic,
MyYouTubeSettings.DefaultAudioCodecMusic.Value.StringToLower, MyYouTubeSettings.DefaultAudioCodecMusic.Value.StringToLower,

4
SCrawler.YouTubeDownloader/My Project/AssemblyInfo.vb
View File

@@ -32,6 +32,6 @@ Imports System.Runtime.InteropServices
' by using the '*' as shown below: ' by using the '*' as shown below:
' <Assembly: AssemblyVersion("1.0.*")> ' <Assembly: AssemblyVersion("1.0.*")>
<Assembly: AssemblyVersion("2025.8.30.0")> <Assembly: AssemblyVersion("2025.10.4.0")>
<Assembly: AssemblyFileVersion("2025.8.30.0")> <Assembly: AssemblyFileVersion("2025.10.4.0")>
<Assembly: NeutralResourcesLanguage("en")> <Assembly: NeutralResourcesLanguage("en")>

2
SCrawler/API/Bluesky/SiteSettings.vb
View File

@@ -14,7 +14,7 @@ Imports PersonalUtilities.Functions.RegularExpressions
Imports PersonalUtilities.Tools.Web.Clients Imports PersonalUtilities.Tools.Web.Clients
Imports PersonalUtilities.Tools.Web.Documents.JSON Imports PersonalUtilities.Tools.Web.Documents.JSON
Namespace API.Bluesky Namespace API.Bluesky
<Manifest(BlueskySiteKey), SpecialForm(False)> <Manifest(BlueskySiteKey), SpecialForm(False), SavedPosts>
Friend Class SiteSettings : Inherits SiteSettingsBase Friend Class SiteSettings : Inherits SiteSettingsBase
<PropertyOption(ControlText:="Cookies enabled", ControlToolTip:="If checked, cookies will be used in requests", IsAuth:=True), PXML, PClonable, HiddenControl> <PropertyOption(ControlText:="Cookies enabled", ControlToolTip:="If checked, cookies will be used in requests", IsAuth:=True), PXML, PClonable, HiddenControl>
Friend ReadOnly Property CookiesEnabled As PropertyValue Friend ReadOnly Property CookiesEnabled As PropertyValue

37
SCrawler/API/Bluesky/UserData.vb
View File

@@ -79,22 +79,33 @@ Namespace API.Bluesky
Private Overloads Sub DownloadData(ByVal Cursor As String, ByVal Token As CancellationToken) Private Overloads Sub DownloadData(ByVal Cursor As String, ByVal Token As CancellationToken)
Dim URL$ = String.Empty Dim URL$ = String.Empty
Try Try
If ID.IsEmptyString Then GetProfileInfo(Token) If Not IsSavedPosts And ID.IsEmptyString Then GetProfileInfo(Token)
If ID.IsEmptyString Then Throw New ArgumentNullException("ID", "ID is null") If Not IsSavedPosts And ID.IsEmptyString Then Throw New ArgumentNullException("ID", "ID is null")
If UpdateToken() Then If UpdateToken() Then
Dim nextCursor$ = String.Empty Dim nextCursor$ = String.Empty
Dim c% Dim c%
Dim n$(), p$()
If IsSavedPosts Then
URL = "https://bsky.social/xrpc/app.bsky.bookmark.getBookmarks"
If Not Cursor.IsEmptyString Then URL &= $"?cursor={Cursor}"
n = {"bookmarks"}
p = {"item"}
Else
URL = $"https://bsky.social/xrpc/app.bsky.feed.getAuthorFeed?actor={ID_Encoded}&filter=posts_and_author_threads&includePins=false&limit=99" URL = $"https://bsky.social/xrpc/app.bsky.feed.getAuthorFeed?actor={ID_Encoded}&filter=posts_and_author_threads&includePins=false&limit=99"
If Not Cursor.IsEmptyString Then URL &= $"&cursor={SymbolsConverter.ASCII.EncodeSymbolsOnly(Cursor)}" If Not Cursor.IsEmptyString Then URL &= $"&cursor={SymbolsConverter.ASCII.EncodeSymbolsOnly(Cursor)}"
n = {"feed"}
p = {"post"}
End If
Dim r$ = Responser.GetResponse(URL) Dim r$ = Responser.GetResponse(URL)
TokenUpdateCountReset() TokenUpdateCountReset()
If Not r.IsEmptyString Then If Not r.IsEmptyString Then
Using j As EContainer = JsonDocument.Parse(r) Using j As EContainer = JsonDocument.Parse(r)
If j.ListExists Then If j.ListExists Then
With j("feed") nextCursor = j.Value("cursor")
With j(n)
If .ListExists Then If .ListExists Then
For Each post As EContainer In .Self For Each post As EContainer In .Self
With post({"post"}) With post(p)
c = DefaultParser(.Self,, nextCursor) c = DefaultParser(.Self,, nextCursor)
Select Case c Select Case c
Case CInt(DateResult.Skip) * -1 : Continue For Case CInt(DateResult.Skip) * -1 : Continue For
@@ -104,6 +115,8 @@ Namespace API.Bluesky
If DownloadTopCount.HasValue AndAlso DownloadTopCount.Value <= _PostCount Then Exit Sub If DownloadTopCount.HasValue AndAlso DownloadTopCount.Value <= _PostCount Then Exit Sub
End With End With
Next Next
ElseIf IsSavedPosts Then
nextCursor = String.Empty
End If End If
End With End With
End If End If
@@ -126,7 +139,7 @@ Namespace API.Bluesky
Optional ByVal CheckTempPosts As Boolean = True, Optional ByVal State As UStates = UStates.Unknown) As Integer Optional ByVal CheckTempPosts As Boolean = True, Optional ByVal State As UStates = UStates.Unknown) As Integer
Const exitReturn% = CInt(DateResult.Exit) * -1 Const exitReturn% = CInt(DateResult.Exit) * -1
Const skipReturn% = CInt(DateResult.Skip) * -1 Const skipReturn% = CInt(DateResult.Skip) * -1
Dim postID$, postDate$, __url$, __urlBase$, __txt$, __userId$ Dim postID$, postDate$, __url$, __urlBase$, __txt$, __userId$, __postAuthor$
Dim updateUrl As Boolean Dim updateUrl As Boolean
Dim c% = 0 Dim c% = 0
Dim m As UserMedia Dim m As UserMedia
@@ -138,11 +151,12 @@ Namespace API.Bluesky
__urlBase = String.Empty __urlBase = String.Empty
__txt = String.Empty __txt = String.Empty
__userId = .Value({"author"}, "did") __userId = .Value({"author"}, "did")
__postAuthor = String.Empty
With .Item({"record"}) With .Item({"record"})
If .ListExists Then If .ListExists Then
'2025-01-28T02:42:12.415Z '2025-01-28T02:42:12.415Z
postDate = .Value("createdAt") postDate = .Value("createdAt")
NextCursor = postDate If Not IsSavedPosts Then NextCursor = postDate
If CheckDateLimits Then If CheckDateLimits Then
Select Case CheckDatesLimit(postDate, DateProvider) Select Case CheckDatesLimit(postDate, DateProvider)
Case DateResult.Skip : Return skipReturn 'Continue For Case DateResult.Skip : Return skipReturn 'Continue For
@@ -155,9 +169,10 @@ Namespace API.Bluesky
If _TempPostsList.Contains(postID) Then Return exitReturn Else _TmpPosts2.Add(postID) If _TempPostsList.Contains(postID) Then Return exitReturn Else _TmpPosts2.Add(postID)
End If End If
If ParseUserMediaOnly And Not ID.IsEmptyString And Not __userId.IsEmptyString And Not ID = __userId Then Return skipReturn If ParseUserMediaOnly And Not IsSavedPosts And Not ID.IsEmptyString And Not __userId.IsEmptyString And Not ID = __userId Then Return skipReturn
__urlBase = $"https://bsky.app/profile/{NameTrue}/post/{postID}" __postAuthor = e.Value({"author"}, "did")
__urlBase = $"https://bsky.app/profile/{If(IsSavedPosts, __postAuthor, NameTrue)}/post/{postID}"
End If End If
End With End With
@@ -190,7 +205,11 @@ Namespace API.Bluesky
__url = d.Value("fullsize") __url = d.Value("fullsize")
If __url.IsEmptyString Then __url = d.Value({"image", "ref"}, "$link") : updateUrl = True If __url.IsEmptyString Then __url = d.Value({"image", "ref"}, "$link") : updateUrl = True
If __url.IsEmptyString And SecondExtraction Then updateUrl = False : __url = e.Value({"embed"}, "thumb") If __url.IsEmptyString And SecondExtraction Then updateUrl = False : __url = e.Value({"embed"}, "thumb")
If Not __url.IsEmptyString Then createMedia(__url, UTypes.Picture) If Not __url.IsEmptyString Then
If updateUrl AndAlso Not __url.StartsWith("http") Then _
__url = $"https://cdn.bsky.app/img/feed_fullsize/plain/{__postAuthor}/{__url}@jpeg"
createMedia(__url, UTypes.Picture)
End If
Next Next
End With End With
End If End If

2
SCrawler/API/Xhamster/SiteSettings.vb
View File

@@ -75,6 +75,8 @@ Namespace API.Xhamster
Return New UserData Return New UserData
End Function End Function
Friend Overrides Function Available(ByVal What As ISiteSettings.Download, ByVal Silent As Boolean) As Boolean Friend Overrides Function Available(ByVal What As ISiteSettings.Download, ByVal Silent As Boolean) As Boolean
'TODELETE: xHamster disabled
Return False
If Settings.UseM3U8 AndAlso MyBase.Available(What, Silent) Then If Settings.UseM3U8 AndAlso MyBase.Available(What, Silent) Then
If What = ISiteSettings.Download.SavedPosts Then If What = ISiteSettings.Download.SavedPosts Then
Return Responser.CookiesExists Return Responser.CookiesExists

85
SCrawler/API/Xhamster/UserData.vb
View File

@@ -6,14 +6,15 @@
' '
' This program is distributed in the hope that it will be useful, ' This program is distributed in the hope that it will be useful,
' but WITHOUT ANY WARRANTY ' but WITHOUT ANY WARRANTY
Imports System.Text
Imports System.Threading Imports System.Threading
Imports SCrawler.API.Base Imports PersonalUtilities.Functions.RegularExpressions
Imports SCrawler.API.YouTube.Objects
Imports PersonalUtilities.Functions.XML Imports PersonalUtilities.Functions.XML
Imports PersonalUtilities.Functions.XML.Base Imports PersonalUtilities.Functions.XML.Base
Imports PersonalUtilities.Functions.RegularExpressions
Imports PersonalUtilities.Tools.Web.Clients Imports PersonalUtilities.Tools.Web.Clients
Imports PersonalUtilities.Tools.Web.Documents.JSON Imports PersonalUtilities.Tools.Web.Documents.JSON
Imports SCrawler.API.Base
Imports SCrawler.API.YouTube.Objects
Imports UTypes = SCrawler.API.Base.UserMedia.Types Imports UTypes = SCrawler.API.Base.UserMedia.Types
Namespace API.Xhamster Namespace API.Xhamster
Friend Class UserData : Inherits UserDataBase : Implements IPSite Friend Class UserData : Inherits UserDataBase : Implements IPSite
@@ -564,15 +565,85 @@ Namespace API.Xhamster
Return ErrorsDescriber.Execute(EDP.ReturnValue, ex, $"[{ToStringForLog()}]: API.Xhamster.GetM3U8({URL})", False) Return ErrorsDescriber.Execute(EDP.ReturnValue, ex, $"[{ToStringForLog()}]: API.Xhamster.GetM3U8({URL})", False)
End Try End Try
End Function End Function
Private Overloads Function GetM3U8(ByRef m As UserMedia, ByVal j As EContainer, ByVal SpecFolder As String) As Boolean Private Overloads Function GetM3U8(ByRef m As UserMedia, ByVal j As EContainer, ByVal SpecFolder As String, Optional ByVal r As Integer = 0) As Boolean
Dim node As EContainer = j({"xplayerSettings", "sources", "hls"}) Const urlNode$ = "url"
Dim node As EContainer = j({"xplayerSettings", "sources", If(r = 0, "hls", "standard")})
If node.ListExists Then If node.ListExists Then
Dim url$ = node.GetNode({New NodeParams("url", True, True, True, True, 2)}).XmlIfNothingValue Dim url$ 'node.GetNode({New NodeParams("url", True, True, True, True, 2)}).XmlIfNothingValue
If Not url.IsEmptyString Then m.URL = url : m.Type = UTypes.m3u8 : Return True Dim jn As EContainer, jn2 As EContainer
Dim __getUrl As Func(Of EContainer, String) = Function(jj) If(jj.Contains(urlNode), Decipher_URL(jj.Value(urlNode)), String.Empty)
url = __getUrl(node)
If url.IsEmptyString Then
For Each jn In node
If jn.Contains(urlNode) Then
url = __getUrl(jn)
ElseIf jn.Count > 0 Then
For Each jn2 In jn
url = __getUrl(jn2)
If Not url.IsEmptyString Then Exit For
Next
End If End If
If Not url.IsEmptyString Then Exit For
Next
End If
If Not url.IsEmptyString Then
m.URL = url
m.Type = UTypes.m3u8
Return True
End If
End If
If r = 0 Then Return GetM3U8(m, j, SpecFolder, r + 1)
Return False Return False
End Function End Function
#End Region #End Region
#Region "Decipher"
'https://github.com/yt-dlp/yt-dlp/blob/5513036104ed9710f624c537fb3644b07a0680db/yt_dlp/extractor/xhamster.py#L146-L165
Private Function Decipher_URL(ByVal Input As String) As String
If Input.IsEmptyString Then Return String.Empty
Dim _XOR_KEY As Byte() = Encoding.ASCII.GetBytes("xh7999")
Dim cipher_type$ = String.Empty
Dim ciphertext$ = String.Empty
Try
Dim decoded$ = Encoding.ASCII.GetString(Convert.FromBase64String(Input))
Dim parts$() = decoded.Split(New Char() {"_"c}, 2)
If parts.Length = 2 Then cipher_type = parts(0) : ciphertext = parts(1)
Catch
End Try
If cipher_type.IsEmptyString Or ciphertext.IsEmptyString Then Return String.Empty
If cipher_type = "xor" Then
Dim ciphertextBytes() As Byte = Encoding.ASCII.GetBytes(ciphertext)
Dim resultBytes(ciphertextBytes.Length - 1) As Byte
For i% = 0 To ciphertextBytes.Length - 1
resultBytes(i) = ciphertextBytes(i) Xor _XOR_KEY(i Mod _XOR_KEY.Length)
Next
Return Encoding.ASCII.GetString(resultBytes)
End If
If cipher_type = "rot13" Then Return Decipher_URL_Rot13(ciphertext)
Return String.Empty
End Function
Private Function Decipher_URL_Rot13(ByVal Input As String) As String
Dim result As New Text.StringBuilder(Input.Length)
For Each c As Char In Input
Dim offset%
If c >= "a"c AndAlso c <= "z"c Then
offset = Asc("a"c)
result.Append(ChrW((Asc(c) - offset + 13) Mod 26 + offset))
ElseIf c >= "A"c AndAlso c <= "Z"c Then
offset = Asc("A"c)
result.Append(ChrW((Asc(c) - offset + 13) Mod 26 + offset))
Else
result.Append(c)
End If
Next
Return result.ToString
End Function
#End Region
#Region "DownloadSingleObject" #Region "DownloadSingleObject"
Protected Overrides Sub DownloadSingleObject_GetPosts(ByVal Data As IYouTubeMediaContainer, ByVal Token As CancellationToken) Protected Overrides Sub DownloadSingleObject_GetPosts(ByVal Data As IYouTubeMediaContainer, ByVal Token As CancellationToken)
_ContentList.Add(New UserMedia(Data.URL_BASE) With {.State = UserMedia.States.Missing}) _ContentList.Add(New UserMedia(Data.URL_BASE) With {.State = UserMedia.States.Missing})

4
SCrawler/My Project/AssemblyInfo.vb
View File

@@ -32,6 +32,6 @@ Imports System.Runtime.InteropServices
' by using the '*' as shown below: ' by using the '*' as shown below:
' <Assembly: AssemblyVersion("1.0.*")> ' <Assembly: AssemblyVersion("1.0.*")>
<Assembly: AssemblyVersion("2025.9.1.0")> <Assembly: AssemblyVersion("2025.10.4.0")>
<Assembly: AssemblyFileVersion("2025.9.1.0")> <Assembly: AssemblyFileVersion("2025.10.4.0")>
<Assembly: NeutralResourcesLanguage("en")> <Assembly: NeutralResourcesLanguage("en")>