2024.5.19.0

YT
YouTubeSettings: add 'CreateDescriptionFiles_AddUploadDate' and 'CreateDescriptionFiles_CreateWithNoDescription' properties
YouTubeMediaContainerBase: add upload date to description

SCrawler
API.YouTube: 'YTSettings_Internal' is not saved when changed

.github/ISSUE_TEMPLATE/bug_report.md

@@ -30,7 +30,9 @@ A clear and concise description of what you expected to happen.
 **Screenshots**
 If applicable, add screenshots to help explain your problem.
 
-**Release information (please complete the following information):**
+**Release information:**
+
+**Please complete the following information or replace the following text with data copied from SCrawler (click the top right info button in the main window, then the `Environment` button, then the `Copy` button, and paste the copied text here).**
  - OS: [e.g. Windows 10, Windows 11]
  - Architecture: [e.g. x86, x64]
  - Version: [e.g. 2023.3.5.0]
@@ -38,6 +40,7 @@ If applicable, add screenshots to help explain your problem.
  - ffmpeg version (command `ffmpeg -version`):
  - yt-dlp version (command `yt-dlp --version`):
  - gallery-dl version (command `gallery-dl --version`):
+ - cURL version (command `curl --version`):
 
 **Additional context**
 Add any other context about the problem here.

.gitignore

@@ -10,8 +10,7 @@
 *.userosscache
 *.sln.docstates
 .obsidian/
-ToDo.txt
-ToDo.md
+BugReporterFormDiscordWebHook.vb
 
 # User-specific files (MonoDevelop/Xamarin Studio)
 *.userprefs

CONTRIBUTING.md

@@ -5,7 +5,13 @@ I welcome requests! Follow these steps to contribute:
 1. Find an [issue](https://github.com/AAndyProgram/SCrawler/issues) that needs assistance.
 1. Let me know you are working on it by posting a comment on the issue.
 1. If you find an error in the code, please provide a link to the file and the line number.
-1. If you have a code change suggestion, you can post a replacement code block. I also accept pull requests.
+1. If you have a code change suggestion, you can post a replacement code block.<!-- I also accept pull requests.-->
+
+# How to report a problem
+1. Attach the **profile URLs or links** that you cannot download.
+1. Attach the **LOG** if it exists.
+1. **Attach the environment information copied from SCrawler (click the top right info button in the main window, then the `Environment` button, then the `Copy` button, and paste the copied text into the issue).**
+1. *Add screenshots to illustrate the problem (**optional**)*
 
 # How to build from source
 1. Delete the `PersonalUtilities` project from the solution.
@@ -39,5 +45,4 @@ I welcome requests! Follow these steps to contribute:
 If I'm interested in a site you want to add, it may be added in future releases.
 
 # Sites I will never develop
-- Facebook
 - Tumblr

Changelog.md

@@ -1,3 +1,626 @@
+# 2024.5.19.0
+
+*2024-05-19*
+
+- Added
+  - YouTube (standalone app): add upload date to description (request #192) (`Settings` - `Info` - `Create description files: add upload date`, `Create description files: create without description`).
+- Fixed
+  - YouTube (SCrawler): advanced settings are not saved when changed
+
+# 2024.5.18.0
+
+*2024-05-18*
+
+- Added
+  - YouTube (standalone app): highlight frame rates higher/lower than this value (`Settings` - `Defaults Video` - `Highlight FPS (higher/lower)`).
+  - Sites
+    - Instagram: 'DownDetector' support to determine if the site is accessible
+    - Reddit: change the naming method of video files (hosted on Reddit) to the `YYYYMMDD_HHMMSS` pattern
+    - Twitter
+      - `Likes` downloading *(user settings)*
+      - **changed domain from twitter.com to x.com**
+  - Site settings: group options by category
+  - Minor improvements
+- PluginProvider
+  - `PropertyOption` attribute: set category name when `IsAuth = True`
+  - `ISiteSettings`: added `UserAgentDefault` property
+- Updated
+  - gallery-dl up to version **1.27.0-dev**
+- Fixed
+  - Sites
+    - Instagram: incorrect definition of pinned posts
+    - Threads: new posts are no longer downloaded from profiles with pinned posts
+    - Reddit: bypass error 429 for saved posts
+    - Twitter: **data is not downloading due to domain change from twitter.com to x.com**
+  - Minor bugs
+
+# 2024.5.4.0
+
+*2024-05-04*
+
+- Added
+  - YouTube (standalone app): setting to remove specific characters (`Defaults` - `Remove characters`)
+  - Instagram: simplify the `Connection closed` error
+  - Users search: add `Friendly name` to search results
+- Fixed
+  - YouTube (standalone app): incorrect download processing when the file name ends with a dot (Issue #188)
+  - The program is freezes when editing users in some cases
+  - Sites
+    - Reddit: token update error
+    - Threads: unable to obtain credentials (`ID`)
+
+# 2024.4.26.0
+
+*2024-04-26*
+
+- Added
+  - Site settings: the values that can be extracted from cookies immediately populate fields
+  - Feed: ability to load the last session of the current day (if it exists) as the current session after restarting SCrawler
+  - Users search: include friendly name matches in search result
+- Updated
+  - gallery-dl up to version **1.26.9**
+- Fixed
+  - xHamster: **saved posts aren't downloading**
+
+# 2024.4.14.0
+
+*2024-04-14*
+
+- Fixed
+  - Facebook: can't get tokens
+
+# 2024.4.13.0
+
+*2024-04-13*
+
+- Added
+  - Minor improvements
+- PluginProvider
+  - IPluginContentProvider: added `ResetHistoryData` function
+- Fixed
+  - Sites
+    - TikTok: remove last download date when erasing history data
+    - YouTube: remove last download date when erasing history data
+    - Instagram: **saved posts aren't downloading**
+
+# 2024.4.10.0
+
+*2024-04-10*
+
+**For those of you who use TikTok, it is highly recommended to update TikTok plugin (using [these instructions](https://github.com/AAndyProgram/SCrawler/wiki/Settings#how-to-install-yt-dlp-ttuser-plugin)) to the latest version!**
+
+**ATTENTION! This version includes changes to downloading groups (including the scheduler) and the settings file. Once you start using it, you won't be able to downgrade. I recommend making a backup of your SCrawler settings folder. It is also recommended to check all of your download groups settings and scheduler plans settings.**
+
+- Added
+  - Sites
+    - TikTok: more settings for standalone downloader
+    - Instagram:
+      - automatically reset download options after updating credentials
+      - **ability to extract an image (if it exists) from a video that contains a static image**
+      - updated reels downloading function
+      - GraphQL support
+      - request timers (per request)
+    - OnlyFans:
+      - **download stories**
+      - option to disable timeline downloading
+    - Reddit: added `Check image` setting (unchecked by default) to make Reddit downloading faster
+  - **YouTube (standalone app)**:
+    - **the ability to add downloaded item(s) to a playlist**
+    - **the ability to create a playlist from downloaded music**
+    - calculation and display of the actual size of downloaded files
+    - **the ability to change audio bitrate** *(you can also set the default bitrate in  `Defaults Audio` - `Bitrate`)*
+    - **embed thumbnail in the extracted audio (`mp3` only) as cover art** (Settings: `Defaults Audio` - `Embed thumbnail (extracted files)`)
+    - Exclude `drc` *(dynamic range compression)* from parsing results
+  - Standalone downloader: 
+    - allow thumbnail to be saved with file
+    - calculation and display of the actual size of downloaded files
+  - Feed:
+    - add hotkeys: `Home`, `End`, `Up`, `Page Up`, `Down`, `Page Down`
+    - ability to save/load views
+  - Scheduler: **`All` and `Default` options removed.** *Only `Disabled`, `Specified` and `Groups` are available.*
+  - Download groups: **filter users who have been (not)downloaded in the last `x` days** *(download groups, advanced filter (main window), scheduler)*.
+  - Main window:
+    - ability to save/load views (`View` - `Save/Load view`)
+    - **all filter options from the `View` menu have now been moved to `Filter`**
+  - Settings:
+    - ability to confirm mass download using the `F6` key *(to protect against accidental pressing) (`Settings` - `Behavior`)*
+    - the ability to find the program environment
+    - default headers (`Settings` - `Headers`)
+  - Added the ability to display group users *(works in scheduler, scheduler plans, download groups)*
+  - Added exclusion of last 3 days from deleting session files
+  - Other improvements
+- Updated
+  - **yt-dlp up to version 2024.04.09**
+- PluginProvider
+  - Add `PropertyValueEventArgs` class
+  - PropertyValue:
+    - add `Checked` parameter
+    - add `OnCheckboxCheckedChange` handler
+  - ISiteSettings:
+    - add `CMDEncoding`, `EnvironmentPrograms` properties
+    - add `EnvironmentProgramsUpdated` function
+- Fixed
+  - Sites
+    - PornHub: some videos won't download
+    - xHamster:
+      - some videos are missing when downloading creators
+      - user videos aren't downloading
+    - **JustForFans: fixed video downloading**
+    - TikTok (standalone downloader): files with long names aren't downloaded
+  - Users: incorrect decision to set last update date, which resulted in an incorrect last download date for some users
+  - Feed: a scrolling bug where the feed scrolls up after returning to it
+  - Minor bugs
+
+# 2024.2.25.0
+
+*2024-02-25*
+
+- Added
+  - A `Feed` button has been added to notifications
+  - Feed:
+    - ability to merge multiple special feeds into one
+    - ability to select all/none media
+    - ability to add to a special feed(s) with removal from the current one
+    - the name of the loaded feed is now displayed in the form title
+    - `Refresh` button now refreshes the loaded feed
+    - ability to move/copy media
+  - Scheduler: the ability to move tasks (higher, lower) *(just a view attribute, doesn't affect the scheduler)*
+  - YouTube (standalone app): add `Open file` to the context menu
+  - YouTube (standalone app): **the ability to edit each playlist item**
+  - YouTube (standalone app): **embed thumbnail in the audio/video as cover art** (Settings: `Defaults Audio` - `Embed thumbnail`; `Defaults Video` - `Embed thumbnail (video)`)
+  - Instagram: the `csrftoken` can now be automatically extracted from cookies
+  - Instagram: remove `x-ig-www-claim` from settings
+  - Threads: the `csrftoken` can now be automatically extracted from cookies
+  - Threads: simplify 500 error when updating tokens
+  - Facebook: simplify token update errors
+  - OnlyFans: handle 500 error
+  - Plugins: added `ReplaceInternalPluginAttribute` attribute
+  - Other improvements
+- Fixed
+  - Main window: incorrect sorting of profiles and collections
+  - Standalone downloader: url array form doesn't show scrollbars
+  - Feed: image rendering bug
+  - YouTube (standalone app): audio codec does not change when changing audio/video in the video options form
+  - Instagram: error downloading single post
+  - TikTok: files with long names aren't downloaded
+  - Minor bugs
+
+# 2024.1.26.0
+
+*2024-01-26*
+
+- Added
+  - YouTube (standalone app): **the ability to reduce video FPS**
+  - TikTok: the ability to use a regex to clean the title
+  - YouTube (SCrawler): the ability to ignore community errors
+- Fixed
+  - Instagram: stories (user) downloading with the wrong aspect ratio for some users
+  - Minor bugs
+
+# 2024.1.20.0
+
+*2024-01-20*
+
+- Added
+  - Instagram: **the ability to download reels**
+  - LPSG: handle 404 error
+
+# 2024.1.18.0
+
+*2024-01-18*
+
+- Fixed
+  - Main window: incorrect collection sorting
+  - xHamster: some user videos were not downloaded
+  - YouTube (standalone app): URL array form doesn't show scrollbars
+  - Minor bugs
+
+# 2024.1.12.1
+
+*2024-01-12*
+
+- Added
+  - YouTube (SCrawler): data downloading by dates
+  - Feed: ability to merge multiple session feeds into one
+  - Feed: remove session number from special feeds
+- Fixed
+  - **Instagram**: stories (user) downloading with the wrong aspect ratio for some users
+  - YouTube: incorrect opening of a post from the feed
+  - YouTube: wrong date to data parsing
+
+# 2024.1.12.0
+
+*2024-01-12*
+
+- Added
+  - Feed: added a prompt before clearing the current session
+  - xHamster: creators
+  - YouTube communities: add error to log
+  - Added scheduler to tray menu
+  - Other improvements
+- Fixed
+  - Feed: there is no option to create a new feed when adding checked items
+  - **Instagram**: downloading of tagged posts
+  - xHamster: profiles are not downloading
+  - Minor bugs
+
+# 2023.12.27.0
+
+*2023-12-27*
+
+- Added
+  - Notification of new log data
+  - OnlyFans: **OF-Scrapper support to download DRM protected videos**
+  - Other improvements
+- Fixed
+  - The default options are changed (`Favorite`, `Temporary`, etc.) when changing an account for a created user
+  - When changing the account for a created user, the new account does not apply to that user until SCrawler is restarted
+  - Saved posts: session file is not updated when new data is added
+  - Minor bugs
+
+# 2023.12.15.0
+
+*2023-12-15*
+
+- Fixed
+  - Twitter: some twitter profiles don't download completely
+  - Minor bugs
+
+# 2023.12.14.0
+
+*2023-12-14*
+
+- Added
+  - YouTube: options `Create thumbnail files (video)` and `Create thumbnail files (music)`
+  - YouTube: `Select all` and `Select none` buttons
+
+# 2023.12.13.0
+
+*2023-12-13*
+
+- Added
+  - YouTube (standalone app): additional options for downloading channels
+- Updated
+  - gallery-dl up to version 1.26.4
+- Fixed
+  - Feed: saved posts are added to the end of the feed
+  - xHamster: some videos won't download
+
+# 2023.12.10.0
+
+*2023-12-10*
+
+- Updated
+  - gallery-dl up to version 1.26.4-dev
+- Fixed
+  - Twitter: data is not downloading
+
+# 2023.12.7.0
+
+*2023-12-07*
+
+- Added
+  - Saved posts: add downloaded saved posts to the feed
+  - **YouTube (SCrawler): the ability to download YouTube user community feeds**
+  - Main window: add `Alt+A` hotkey to show scheduler
+  - Main window: add `Alt+P` hotkey to show progress form
+  - YouTube: check of adding a URL if it has already been downloaded
+  - YouTube: ability to check for a new version at start
+  - **Updater**
+- Fixed
+  - Standalone downloader: URL files are not deleted along with the file
+  - Minor bugs
+
+# 2023.11.25.0
+
+*2023-11-25*
+
+- Fixed
+  - Reddit: missing refresh token button in the settings form
+
+# 2023.11.24.0
+
+*2023-11-24*
+
+For those of you who use TikTok, I recommend updating [TikTok plugin](https://github.com/bashonly/yt-dlp-TTUser) to the latest version using [these instructions](https://github.com/AAndyProgram/SCrawler/wiki/Settings#how-to-install-yt-dlp-ttuser-plugin).
+
+- Added
+  - Automation: manual task option
+  - Scheduler: add scheduler name to form title
+  - Feeds: update when users' location and/or basic information changes
+  - Reddit: special notification for error 429
+  - TikTok: ID, username and friendly name extraction from data
+  - TikTok: new option `Use video date as file date`
+  - YouTube: absolute path for a single playlist
+- Updated
+  - yt-dlp up to version 2023.11.16
+- Fixed
+  - Scheduler: scheduler change error
+  - Twitter: JSON deserialization error
+  - xHamster, XVideos, PornHub, ThisVid: incorrect parsing of search queries
+  - YouTube: the file name is not changed manually
+  - YouTube: path not set when adding array to download
+  - Minor bugs
+
+# 2023.11.17.0
+
+*2023-11-17*
+
+- Added
+  - **Facebook**
+  - **Multi-account**
+  - **Special feeds**
+  - Site settings: option `Download saved posts`
+  - Standalone downloader: support for multiple account
+  - PornHub: add playlists downloading
+  - YouTube: ability to download subtitles **and** `CC` if they both exists
+  - Other improvements
+- PluginProvider
+  - `IDownloadableMedia`: added `AccountName` property
+  - `IPluginContentProvider`: added `AccountName` property
+  - `ISiteSettings`: added properties: `AccountName`, `Temporary`, `AvailableText`, `DefaultInstance`; added functions: `Clone`, `Update`, `Delete`; removed `Load` function; implement `IDisposable` interface
+  - `PropertyValue`: added functions: `BeginInit`, `EndInit`, `Clone`
+  - `Attributes.DoNotUse` - add `Value` field
+- Fixed
+  - Instagram: handling 401 error
+  - OnlyFans: handling 401 error
+  - xHamster: handling 503 error
+  - xHamster: incorrect parsing of search queries
+  - XVideos: incorrect parsing of search queries
+  - ThisVid: incorrect parsing of search queries
+  - PornHub: incorrect parsing of search queries
+  - Automation: handle automation start error (in some cases) when changing scheduler
+  - Minor bugs
+
+# 2023.10.10.0
+
+*2023-10-10*
+
+- Added
+  - Notification if the user has disabled downloading from the site
+  - Standalone downloader: new setting `Create URL files`
+  - Changed the sessions naming method to be more intuitive
+  - Settings that allow the user to change the number of saved session (`Settings` - `Feed` - `Store session data`)
+  - **YouTube: new settings `Create URL files` and `Create description files`**
+  - YouTube: added the `Clear selected` button
+  - YouTube: group the `Clear and remove` buttons in the menu
+- Fixed
+  - Reddit: unable to save settings without OAuth data
+  - JustForFans: rewritten m3u8 downloader
+  - JustForFans: downloading of missing posts
+  - JustForFans: download to the date
+  - JustForFans: corrupted files
+  - Threads: new token is not saved if it was received during download
+  - ThisVid: parsing stops when new videos are added
+  - YouTube: file name is missing when destination is changed by selecting one of the saved locations
+  - YouTube: missing files still appear in the list
+  - Collections: labels are removed when creating a new collection
+  - Standalone downloader: cached thumbnail is not removed when item is removed from the list
+  - Minor bugs
+
+# 2023.10.1.0
+
+*2023-10-01*
+
+- Added
+  - **Threads.net**
+  - YouTube: add URL standardization
+- Fixed
+  - UserEditor: disable updating labels if they haven't changed
+  - Collections: incorrect updating of colors and labels when adding a new user
+  - RedGifs: incorrect handling of error 410
+  - Mastodon: hide error 503
+  - JustForFans: some profiles won't download
+  - Minor bugs
+
+# 2023.9.21.0
+
+*2023-09-21*
+
+- Fixed
+  - PornHub: videos are not downloading
+
+# 2023.9.20.0
+
+*2023-09-20*
+
+- Added
+  - **Instagram: user active (non-pinned) stories (Issue #17)**
+  - Reddit: reduce the number of token updates (refresh the token if there are Reddit users in the download queue)
+  - YouTube (standalone app): priority download protocol *(`Settings` - `Defaults` - `Protocol`)* (you can now select the default protocol you want to download media on: `Any`, `https`, `m3u8`))
+  - Automation: ability to change schedulers (`Download` - `Automation` - `Script icon`)
+  - Collections: update colors for the added user
+- Fixed
+  - YouTube: can't detect `shorts` links
+  - Incorrect MD5 validation initial value
+  - Instagram: handle error 500
+  - Collections: update labels only for the added user
+
+# 2023.8.27.0
+
+*2023-08-27*
+
+- Added
+  - **JustForFans**
+  - Advanced download (`Download` - `Download (advanced)`)
+  - Advanced filter (`View` - `Advanced filter`)
+  - Auto downloader: cloning plans
+  - Feed: add button to go to custom page
+  - Special log for non-existent users
+  - Twitter: group 'limit' notifications
+  - Ability to set custom color for subscription users
+  - Other improvements
+- Fixed
+  - Auto downloader: new plan date display bug
+  - Auto downloader: downloading stuck
+  - Minor bugs
+
+# 2023.8.6.0
+
+*2023-08-06*
+
+- Added
+  - The ability to remove user data and/or download history for redownload
+  - **Subscription** mode
+  - Settings to change the program title and information in the program information
+  - Settings for saving video thumbnail along with the file or in the cache (temporary cache or permanent cache)
+  - A bug report form to create a bug report or say something nice to the developer :blush:
+  - Prevent adding site-specific labels when adding to a collection
+  - Ability to select custom user highlighting in the main window and feed.
+  - Add a notification to the log if the user is not found on the site
+  - Added visualization of users download queue
+  - Ability to set more than one global paths
+  - Improve user paths changing: now you can also simply move the user/collection to another global location
+  - Ability to move multiple user/collection to another location
+  - Download groups: added `Subscription` options
+  - Download groups: the ability to set the number of users to download
+  - Auto downloader: new group options
+  - Auto downloader: additional skip options
+  - Auto downloader: added force start
+  - Feed: press `Ctrl+G` to go to a specific page
+  - Feed: added site icon to post
+  - Feed: always using `Friendly name` instead of `UserName` if it exists
+  - Missing posts: the ability to delete all missing posts
+  - Standalone downloader: add the ability to store download locations and quickly select after
+  - Standalone downloader: add `Ctrl+O` hotkey to select destination path
+  - Standalone downloader: add `Alt+O` hotkey to select destination path and save it to download locations
+  - User editor: ability to hide/show site-specific labels in collection editing mode
+  - Main window: filters by subscription and user
+  - Instagram: if the user is not found on the site, SCrawler will check for a new user name
+  - OnlyFans: handling of `504` and `429` errors
+  - OnlyFans: the `sec-ch-ua` header is now optional
+  - OnlyFans: ability to download 'Highlights" and media from chats
+  - PathPlugin: incorrect detection of path existence
+  - PornHub: completely rewritten videos parser
+  - PornHub: now you choose which videos you want to download (uploaded, tagged, private, favorites)
+  - PornHub: subscription mode
+  - PornHub: ability to download search queries and search categories
+  - Reddit: ability to set the number of concurrent downloads
+  - Reddit: added bearer token (optional)
+  - Reddit: added OAuth authorization (optional)
+  - Reddit: options to use the bearer token for the timeline and/or saved posts
+  - Reddit: option to disable the use of cookies for the timeline
+  - ThisVid: now you can also download user's favorite videos
+  - ThisVid: ability to download search queries, search categories and search tags
+  - ThisVid: subscription mode
+  - Twitter: new options: `Use the appropriate model`, `New endpoint: search`, `New endpoint: profiles`, `Abort on limit`, `Download already parsed` and `Media Model: allow non-user tweets`
+  - Twitter: new user option `Force apply`
+  - xHamster: ability to download search queries, search categories and search tags
+  - xHamster: subscription mode
+  - xHamster: pornstars download
+  - XVideos: ability to download search queries, search categories and search tags
+  - XVideos: subscription mode
+  - YouTube: added `Output path: ask for a name` and `Output path: auto add` settings
+  - YouTube: added the ability to store download locations and quickly select after
+  - YouTube: subscription mode
+  - Plugins.Attributes: added `DependentFields` attribute
+  - Plugins.Attributes: replace `Dependencies` with `Arguments` (`PropertyUpdater` attribute)
+  - Plugins.IPluginContentProvider: added `Options` and `IsSubscription` properties
+  - Plugins.ISiteSettings: added `SubscriptionsAllowed` property
+  - Plugins.ExchangeOptions: added `Options` field
+  - Plugins: added `ExitException`
+  - Other improvements
+- Updated
+  - gallery-dl up to version 1.25.8
+  - yt-dlp up to version 2023.07.06
+  - LibVLCSharp up to 3.7.0
+  - VideoLAN up to 3.0.18
+- Fixed
+  - **TikTok** supported again!
+  - Auto downloader: excluded labels and sites in default mode are not respected
+  - Download info: does not remember the last size and location
+  - Download info: hide unnecessary error
+  - Feed: `webm` photos not showing
+  - Search users: incorrect search by name
+  - OnlyFans: incorrect parsing of username containing dots
+  - OnlyFans: incorrect error handler
+  - Reddit: Handling error 502 (Reddit data not downloading)
+  - RedGifs: incorrect behavior when updating token
+  - Twitter: gifs are not downloading
+  - xHamster: some channels cannot be downloaded or are not fully downloaded
+  - YouTube: re-saving elements when loading a video list
+  - YouTube: files were not deleted when the delete button was clicked
+  - YouTube: a bug that caused the video to redownload
+  - Minor bugs
+
+# 2023.6.19.0
+
+*2023-06-19*
+
+- Added
+  - **OnlyFans**
+  - YouTube: make the playlists parsing progress more informative
+  - YouTube: add `Add` button to tray
+  - YouTube: add `Ctrl+Click` on tray icon to add download
+  - YouTube: add setting `Download on click in tray: show form`
+  - Minor improvements to progress bars
+  - Other improvements
+- Fixed
+  - YouTube: incorrect sorting algorithm
+  - LPSG: some files didn't download
+  - Reddit: downloaded gifs are static (Issue #141)
+  - xHamster: videos are not downloading or downloading incorrectly (Issue #144)
+  - Progress bar bugs
+  - Minor bugs
+
+# 2023.6.9.0
+
+*2023-06-09*
+
+- Fixed
+  - YouTube: opening paths to downloaded playlists and channels
+  - Twitter: make the algorithm faster
+  - Make progress more informative
+
+# 2023.6.8.0
+
+*2023-06-08*
+
+- Added
+  - YouTube: append artist name to music playlist output path
+  - YouTube: save thumbnail path for playlist and channel
+- Fixed
+  - YouTube: opening paths to downloaded playlists and channels
+  - Twitter: profile not fully downloaded
+  - Corrected form size for small monitors (Issue #136)
+
+# 2023.6.5.0
+
+*2023-06-05*
+
+- Added
+  - **Instagram**: add additional authorization headers
+  - Setting to prevent user icon and banner from downloading (Request #129)
+  - Add standalone downloader to tray context menu
+  - YouTube downloader: added `Replace modification date` property
+  - Minor improvements
+- Fixed
+  - Fascist **Twitter**: posts not downloading (new API)
+  - Main window: refill bug when the number of filtered profiles = 0
+  - Standalone downloader: new items are not added to the queue
+  - Standalone downloader: bug when not downloaded videos do not appear in the list when loading the program
+  - Standalone downloader: add videos array not working
+  - Saved posts: remove main progress perform when downloading saved posts
+  - Minor bugs
+
+# 2023.5.12.0
+
+*2023-05-12*
+
+- Added
+  - Advanced progress (make progress bars more informative)
+  - User metrics calculation
+  - Reddit: improve parsing function
+  - PornHub: add `Download UHD` option
+- Fixed
+  - MD5 GIF hash bug
+  - Mastodon: handle 'Forbidden' error
+  - Mastodon: bug in parsing non-user posts
+  - Pinterest: remove cookies requirement for saved posts
+  - PornHub: resolutions issue
+  - Reddit: missing & broken images bug
+  - Main window: collection pointing bug 
+
 # 2023.4.28.0
 
 *2023-04-28*

FAQ.md

@@ -14,8 +14,6 @@ Any other questions I will keep in this file.
 
 A: https://github.com/AAndyProgram/SCrawler/wiki/Settings#how-to-set-up-cookies
 
-<!---**ATTENTION! If you need to use cookies but cannot import them, I highly recommend that you don't use SCrawler and use another program. Don't create issues, discussions, or write to me on Discord. Any issue or discussion about cookies will be deleted immediately without a response. Any user who asks me about cookies on Discord will be banned.**--->
-
 ----
 
 #### Q: **Does this program have GUI or CLI.**
@@ -41,13 +39,16 @@ A: NO.
 
 A: Check your credentials and **[SITES REQUIREMENTS](https://github.com/AAndyProgram/SCrawler/wiki/Settings#sites-requirements)**. If all settings are set, but nothing works, go to [create a new issue](https://github.com/AAndyProgram/SCrawler/issues). Don't forget to attach the LOG.
 
+**You also can join our Discord server**: https://discord.gg/uFNUXvFFmg
+<br/>*You can get help faster there!*
+
 **ATTENTION! Issues without URLs will be closed without a response!**
 
 ----
 
 #### Q: **I have set credentials but still nothing is downloading**
 
-A: Click the ```Start downloading``` button
+A: Click the `Start downloading` button or press `F5`
 
 ----
 
@@ -59,7 +60,7 @@ A: https://github.com/AAndyProgram/SCrawler/releases/latest
 
 #### Q: **How to run the program?**
 
-A: Double-click ```SCrawler.exe```
+A: Double-click `SCrawler.exe`
 
 ----
 
@@ -77,19 +78,19 @@ A: The program stored posts IDs in users' folders. For the first time, the progr
 
 #### Q: **How to redownload all data**
 
-A: Double-click on the user you want to redownload. In the opened window open folder setting. Delete the files ending with ```_Data.xml```  and ```_Posts.txt```. Restart SCrawler. Download this user again.
+A: https://github.com/AAndyProgram/SCrawler/wiki#redownload-user
 
 ----
 
 #### Q: **How to remove the label**
 
-A: There is no functionality to remove an individual label. You can open the ```Labels.txt``` file in the program settings folder and delete any label you want. You also can delete this file (```Labels.txt```). In this case, when the program starts, the list of labels list will be updated with only existing labels (from the user data files).
+A: There is no functionality to remove an individual label. You can open the `Labels.txt` file in the program settings folder and delete any label you want. You also can delete this file (`Labels.txt`). In this case, when the program starts, the list of labels list will be updated with only existing labels (from the user data files).
 
 ----
 
 #### Q: **How to remove a user from the blacklist**
 
-A: Just add that user back to the program. In the dialog box that opens, click on the ```Add and remove from blacklist``` button.
+A: Just add that user back to the program. In the dialog box that opens, click on the `Add and remove from blacklist` button.
 
 ----
 
@@ -113,4 +114,8 @@ A: I can only [suggest](#q-you-lost-me-your-program-is-too-complicated) you find
 
 #### Q: **Can you add a step-by-step guide or video on how to use the program?**
 
-A: **NO! NEVER!** The guide fully covers all the functionality of SCrawler! If you don't respect my work, I don't waste my time. If you want, you can create a video tutorial and send it to me. Then I add it. All options and what each option does described on the wiki. The wiki also contains a description of all settings and how-to configure them. For complex settings, there is a steep-by-steep guide. Read the [main](README.md) information and [GUIDE](https://github.com/AAndyProgram/SCrawler/wiki/) and you won't have any problems. I have developed a program with an intuitive interface. There is a Settings button, download buttons, a context menu that drops down when a user is clicked, and other controls. Anyone can use it.
+A: **NO!** The guide fully covers all the functionality of SCrawler! If you don't respect my work, I don't waste my time. If you want, you can create a video tutorial and send it to me. Then I add it. All options and what each option does described on the wiki. The wiki also contains a description of all settings and how-to configure them. For complex settings, there is a steep-by-steep guide. Read the [main](README.md) information and [GUIDE](https://github.com/AAndyProgram/SCrawler/wiki/) and you won't have any problems. I have developed a program with an intuitive interface. There is a Settings button, download buttons, a context menu that drops down when a user is clicked, and other controls. Anyone can use it.
+
+**The following video was recorded by a user who loves SCrawler and demonstrates how to add credentials using Instagram as an example:**
+
+[![How to configure](https://img.youtube.com/vi/XDn7zG4I700/0.jpg)](https://www.youtube.com/watch?v=XDn7zG4I700)

Plugins.md

@@ -1,3 +1,9 @@
+You can create a plugin for any site you want. **To create a plugin, read [this guide](https://github.com/AAndyProgram/SCrawler/wiki/Plugins).**
+
+If you've created a plugin, you can create a [new issue](https://github.com/AAndyProgram/SCrawler/issues/new?assignees=&labels=New+Plugin&projects=&template=plugin_add.md&title=%5BNEW+PLUGIN%5D) and I'll add your plugin to the list below.
+
+----
+
 List of available plugins:
 
 Tools:

ProgramsComparison.md

@@ -6,11 +6,19 @@ https://github.com/yt-dlp/yt-dlp/
 
 SCrawler has advanced user management, collections, labels, groups, automatic downloads, a beautiful view, GUI, the ability to add plugins for other sites and much more. Just try it and compare.
 
+# gallery-dl
+
+https://github.com/mikf/gallery-dl
+
+**Great powerful CLI tool that supports hundreds of sites.**
+
+SCrawler has advanced user management, collections, labels, groups, automatic downloads, a beautiful view, GUI, the ability to add plugins for other sites and much more. Just try it and compare.
+
 # 4K Video Downloader
 
 https://www.4kdownload.com/-plbrz/video-downloader
 
-| Option | SCrawler | 4K Stogram |
+| Option | SCrawler | 4K Video Downloader |
 | ---- | ---- | ---- |
 | User managament | **Advanced** | No |
 | Automatic downloads | **Yes** | No |
@@ -117,14 +125,7 @@ https://github.com/RipMeApp/ripme
 | **Free options** | The program is completely free | The program is completely free, but site limits are not declared |
 | Operating Systems | Windows 10+ | Windows, MacOS, Linux |
 | Select want content type to download | Yes | Yes |
-| Suported sites | 15 internal and any site using plugins | 86+ sites (declared) |
+| Suported sites | 15+ internal and any site using plugins | 86+ sites (declared) |
 | Other sites support | **Yes** | No |
 | Still supported | **Yes** | **No (last release date May 4, 2021)** |
 
-# gallery-dl
-
-https://github.com/mikf/gallery-dl
-
-**CLI tool**
-
-SCrawler has advanced user management, collections, labels, groups, automatic downloads, a beautiful view, GUI, the ability to add plugins for other sites and much more. Just try it and compare.

README.md

@@ -1,7 +1,10 @@
-# :rainbow_flag: Social networks crawler :rainbow_flag:
+<!-- # :rainbow_flag: Happy LGBT Pride Month :tada:
+-->
+# 🏳️‍🌈 Social networks crawler 🏳️‍🌈
 
 [![GitHub release (latest by date)](https://img.shields.io/github/v/release/AAndyProgram/SCrawler)](https://github.com/AAndyProgram/SCrawler/releases/latest)
 [![GitHub license](https://img.shields.io/github/license/AAndyProgram/SCrawler)](https://github.com/AAndyProgram/SCrawler/blob/main/LICENSE)
+[![Discord](https://img.shields.io/discord/1124032649682493462?logo=discord)](https://discord.gg/uFNUXvFFmg)
 [![GitHub all releases](https://img.shields.io/github/downloads/aandyprogram/scrawler/total?label=Total%20downloads)](https://github.com/AAndyProgram/SCrawler/releases)
 [![FAQ](https://img.shields.io/badge/FAQ-green)](FAQ.md)
 [![GUIDE](https://img.shields.io/badge/GUIDE-green)](https://github.com/AAndyProgram/SCrawler/wiki)
@@ -9,46 +12,58 @@
 :eu:
 :greece:
 
-A program to download photo and video from [any site](#supported-sites) (e.g. YouTube, YouTube Music, Reddit, Twitter, Mastodon, Instagram, TikTok, RedGifs, PornHub, XHamster, XVIDEOS, ThisVid, LPSG, Pinterest).
+A program to download photo and video from [any site](#supported-sites) (e.g. YouTube, YouTube Music, OnlyFans, Reddit, Twitter, Mastodon, Instagram, Threads, Facebook, TikTok, RedGifs, JustForFans, PornHub, XHamster, XVIDEOS, ThisVid, LPSG, Pinterest).
 
 **If you like SCrawler, please like the program on [this site](https://alternativeto.net/software/scrawler/about/) and/or [this](https://www.softpedia.com/get/Internet/Download-Managers/Social-networks-crawler.shtml)**
+
+**Join our Discord server**: https://discord.gg/uFNUXvFFmg
+<br/>*If you have problems using the program, you can get help faster on our Discord server!*
+
 <!---Do you like this program? Consider adding to my coffee fund by making a donation to show your support. :blush:
 [![ko-fi](https://www.ko-fi.com/img/githubbutton_sm.svg)](https://ko-fi.com/andyprogram)--->
 **Bitcoin**: BC1Q0NH839FT5TA44DD7L7RLR97XDQAG9V8D6N7XET
 
+[![](https://www.softpedia.com/_img/softpedia_100_free.png?2023_1)](https://www.softpedia.com/get/Internet/Download-Managers/Social-networks-crawler.shtml#status)
+
 ![Main window](ProgramScreenshots/MainWindow.png)
 ![Channels window](ProgramScreenshots/Channels.png)
 
-[**YouTube standalone application:**](https://github.com/AAndyProgram/SCrawler/wiki/YouTube%20downloader)
+[**YouTube standalone application:**](https://github.com/AAndyProgram/SCrawler/wiki/YouTube-downloader)
 
 ![YouTube application](ProgramScreenshots/AppYouTube.png)
 
 # What can program do:
 - Download pictures and videos from users' profiles and subreddits:
-  - YouTube videos, shorts, users, artists, playlists, music, tracks;
+  - YouTube videos, shorts, community feeds, users, artists, playlists, music, tracks;
   - Reddit images, galleries of images, videos, saved posts;
   - Redgifs videos (https://www.redgifs.com/);
   - Twitter images and videos, saved (bookmarked) posts;
+  - OnlyFans images and videos, saved (bookmarked) posts;
+  - JustForFans images and videos, saved (bookmarked) posts;
   - Mastodon images and videos, saved (bookmarked) posts;
   - Instagram images and videos, tagged posts, stories, saved posts;
-  - TikTok videos (*currently broken*; [limited](https://github.com/AAndyProgram/SCrawler/wiki/Settings#tiktok-limits));
+  - Threads images and videos;
+  - Facebook images and videos, stories, saved posts;
+  - TikTok videos;
   - Pinterest boards, users, saved posts;
   - Imgur images, galleries and videos;
   - Gfycat videos;
-  - PornHub images, videos, save (liked) posts;
-  - XHamster images, videos, saved posts;
-  - XVIDEOS videos, saved posts;
-  - ThiVid images, videos, saved posts;
+  - PornHub images, videos, save (liked) posts, search queries, search categories;
+  - XHamster images, videos, saved posts, search queries, search categories, search tags;
+  - XVIDEOS videos, saved posts, search queries, search categories;
+  - ThisVid images, videos, saved posts, search queries, search categories, search tags;
   - [Other](#supported-sites) supported sites
-- Parse [channel and view data](https://github.com/AAndyProgram/SCrawler/wiki/Channels)
-- Download [saved Reddit, Twitter and Instagram posts](https://github.com/AAndyProgram/SCrawler/wiki/Home#saved-posts)
+- Parse [Reddit channel and view data](https://github.com/AAndyProgram/SCrawler/wiki/Channels)
+- Download [saved posts](https://github.com/AAndyProgram/SCrawler/wiki/Home#saved-posts)
 - Add users from parsed channel
 - **Advanced user management**
 - **Automation** ([downloading data automatically](https://github.com/AAndyProgram/SCrawler/wiki/Settings#automation) every ```X``` minutes)
-- **Feed** ([feed](https://github.com/AAndyProgram/SCrawler/wiki#feed) of downloaded media files)
+- **Feed** ([feed](https://github.com/AAndyProgram/SCrawler/wiki#feed) of downloaded media files and subscriptions posts)
+- Multiple accounts support
 - Labeling users
 - Create [download groups](https://github.com/AAndyProgram/SCrawler/wiki/Settings#download-groups)
 - Adding users to favorites and temporary
+- Adding users and search queries in the **Subscription** mode (download post preview, but do not download the media file)
 - [Filter exists users](https://github.com/AAndyProgram/SCrawler/wiki#view) by label or group
 - Selection of media types you want to download (images only, videos only, both)
 - [Download a special video](https://github.com/AAndyProgram/SCrawler/wiki#download-separate-video), image or gallery
@@ -63,9 +78,13 @@ A program to download photo and video from [any site](#supported-sites) (e.g. Yo
 - **YouTube Music**
 - **Reddit**
 - **Twitter**
+- **OnlyFans** *(partial support)*[^1]
 - **Mastodon**
 - **Instagram**
-- TikTok (*currently broken*; [limited](https://github.com/AAndyProgram/SCrawler/wiki/Settings#tiktok-limits))
+- **Threads**
+- **Facebook**
+- JustForFans *(partial support)*[^1]
+- TikTok
 - RedGifs
 - Pinterest
 - Imgur
@@ -83,14 +102,6 @@ A program to download photo and video from [any site](#supported-sites) (e.g. Yo
 
 First, the program downloads the full profile. After the program downloads only new posts. The program remembers downloaded posts.
 
-## Reddit
-
-The program parses user posts, obtain MD5  images hash and compares them with existing ones to remove duplicates. Then the media will be downloaded.
-
-## Other sites
-
-The program parses user posts and compares file names with existing ones to remove duplicates. Then the media will be downloaded.
-
 ## How to request a new site
 
 <!---Read [here](CONTRIBUTING.md#how-to-request-a-new-site) about--->
@@ -120,29 +131,43 @@ The program parses user posts and compares file names with existing ones to remo
   - **[SITES REQUIREMENTS](https://github.com/AAndyProgram/SCrawler/wiki/Settings#sites-requirements)**
   - [Reddit](https://github.com/AAndyProgram/SCrawler/wiki/Settings#reddit)
   - [Twitter](https://github.com/AAndyProgram/SCrawler/wiki/Settings#twitter)
-  - [Mastodon](https://github.com/AAndyProgram/SCrawler/wiki/Settings#Mastodon)
+  - [OnlyFans](https://github.com/AAndyProgram/SCrawler/wiki/Settings#onlyfans)
+  - [Mastodon](https://github.com/AAndyProgram/SCrawler/wiki/Settings#mastodon)
   - [Instagram](https://github.com/AAndyProgram/SCrawler/wiki/Settings#instagram)
+  - [Threads](https://github.com/AAndyProgram/SCrawler/wiki/Settings#threads)
+  - [Facebook](https://github.com/AAndyProgram/SCrawler/wiki/Settings#facebook)
+  - [JustForFans](https://github.com/AAndyProgram/SCrawler/wiki/Settings#justforfans)
   - [TikTok](https://github.com/AAndyProgram/SCrawler/wiki/Settings#tiktok)
   - [RedGifs](https://github.com/AAndyProgram/SCrawler/wiki/Settings#redgifs)
-  - [YouTube](https://github.com/AAndyProgram/SCrawler/wiki/Settings#YouTube)
+  - [YouTube](https://github.com/AAndyProgram/SCrawler/wiki/Settings#youtube)
   - [Pinterest](https://github.com/AAndyProgram/SCrawler/wiki/Settings#Pinterest)
   - [PornHub](https://github.com/AAndyProgram/SCrawler/wiki/Settings#pornhub)
   - [XHamster](https://github.com/AAndyProgram/SCrawler/wiki/Settings#xhamster)
   - [XVIDEOS](https://github.com/AAndyProgram/SCrawler/wiki/Settings#xvideos)
-  - [ThisVid](https://github.com/AAndyProgram/SCrawler/wiki/Settings#ThisVid)
+  - [ThisVid](https://github.com/AAndyProgram/SCrawler/wiki/Settings#thisvid)
   - [LPSG](https://github.com/AAndyProgram/SCrawler/wiki/Settings#lpsg)
 
 **Full guide you can find [here](https://github.com/AAndyProgram/SCrawler/wiki)**
 
+**Video on how to configure**
+
+[![How to configure](https://img.youtube.com/vi/XDn7zG4I700/0.jpg)](https://www.youtube.com/watch?v=XDn7zG4I700)
+
 # Installation
 
 **Just download the [latest release](https://github.com/AAndyProgram/SCrawler/releases/latest), unzip the program archive to any folder and enjoy.** :blush:
 
 **Don't put program in the ```Program Files``` system folder (this is portable program and program settings are stored in the program folder)**
 
+**I highly doubt you can run SCrawler on Linux or Mac. SCrawler is a program that is heavily dependent on Windows.**
+
 # Updating
 
-Just download [latest](https://github.com/AAndyProgram/SCrawler/releases/latest) version and unpack it into the program folder. **Before starting a new version, I recommend making a backup copy of the program settings folder.**
+Just download [latest](https://github.com/AAndyProgram/SCrawler/releases/latest) version and unpack it into the program folder. **Before launching a new version, I recommend making a backup copy of the program settings folder and user settings/data files.**
+
+**You can also use the updater included in the release package.**
+
+# [How to report a problem](CONTRIBUTING.md#how-to-report-a-problem)
 
 # [How to build from source](CONTRIBUTING.md#how-to-build-from-source)
 
@@ -156,13 +181,50 @@ The program has an intuitive interface.
 
 **[SITES REQUIREMENTS](https://github.com/AAndyProgram/SCrawler/wiki/Settings#sites-requirements)**
 
+[![How to configure](https://img.youtube.com/vi/XDn7zG4I700/0.jpg)](https://www.youtube.com/watch?v=XDn7zG4I700)
+
 Just add a user profile and **click the ```Download``` button**.
 
-Read more about adding users and subreddits [here](https://github.com/AAndyProgram/SCrawler/wiki#Add%20user)
+```mermaid
+stateDiagram
+Start: Add site credentials
+What: What would I like to do
+DownUser: Download user
+DownVideo: Download video
+AUser: Add user (1)
+OVIF: Open standalone downloader (2)
+AVideo: Add video url
+F5: Press 'F5' or click the download button
+[*]-->Start
+Start-->What
+What-->DownUser
+What-->DownVideo
+DownUser-->AUser
+DownVideo-->OVIF
+OVIF-->AVideo
+AVideo-->F5
+AUser-->F5
+F5-->[*]
+```
+1. Press `Insert` or click the `Download` button ([read more here](https://github.com/AAndyProgram/SCrawler/wiki#users-list), [hot keys](https://github.com/AAndyProgram/SCrawler/wiki#hot-keys))
+2. Click the `Download` button, then `Standalone downloader` ([read more here](https://github.com/AAndyProgram/SCrawler/wiki#download-separate-video))
 
 ![Add user](ProgramScreenshots/CreateUserClear.png)
 
 # Contact me
 
+Discord server: https://discord.gg/uFNUXvFFmg
+
+<!--
+[e-mail](mailto:andyprogram@proton.me): andyprogram@proton.me
+
 Matrix (Element): https://matrix.to/#/@andyprogram:matrix.org
-Discord: AndyProgram#3804
+
+Discord (contact the developer): andyprogram
+
+Discord server: https://discord.gg/uFNUXvFFmg
+
+[Wire](https://account.wire.com/user-profile/?id=93985052-cf2c-4b72-ac75-bbe3231cf544): @andyprogram
+-->
+
+[^1]: Partial support means that I don't have personal accounts on paid porn sites because I don't pay for porn. If this site has stopped downloading and you want me to fix it, please be ready to give me access to an account with at least one active subscription. Otherwise, the download from this site will not be fixed.

SCrawler.PluginProvider/.editorconfig

@@ -1,3 +1,3 @@
 [*.vb]
 # Modifier preferences
-file_header_template = Copyright (C) 2023  Andy https://github.com/AAndyProgram\nThis program is free software: you can redistribute it and/or modify\nit under the terms of the GNU General Public License as published by\nthe Free Software Foundation, either version 3 of the License, or\n(at your option) any later version.\n\nThis program is distributed in the hope that it will be useful,\nbut WITHOUT ANY WARRANTY; without even the implied warranty of\nMERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the\nGNU General Public License for more details.\n\nYou should have received a copy of the GNU General Public License\nalong with this program.  If not, see <https://www.gnu.org/licenses/>
+file_header_template = Copyright (C) Andy https://github.com/AAndyProgram\nThis program is free software: you can redistribute it and/or modify\nit under the terms of the GNU General Public License as published by\nthe Free Software Foundation, either version 3 of the License, or\n(at your option) any later version.\n\nThis program is distributed in the hope that it will be useful,\nbut WITHOUT ANY WARRANTY; without even the implied warranty of\nMERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the\nGNU General Public License for more details.\n\nYou should have received a copy of the GNU General Public License\nalong with this program.  If not, see <https://www.gnu.org/licenses/>

SCrawler.PluginProvider/Attributes/Attributes.vb

@@ -36,17 +36,44 @@ Namespace Plugin.Attributes
         Public Property IsInformationLabel As Boolean = False
         ''' <summary>Label text alignment.<br/>Default: <see cref="Drawing.ContentAlignment.TopCenter"/></summary>
         Public Property LabelTextAlign As Drawing.ContentAlignment = Drawing.ContentAlignment.TopCenter
+        Private _IsAuth As Boolean = False
         ''' <summary>This is an authorization property</summary>
-        Public Property IsAuth As Boolean = False
+        Public Property IsAuth As Boolean
+            Get
+                Return _IsAuth
+            End Get
+            Set(ByVal _IsAuth As Boolean)
+                Me._IsAuth = _IsAuth
+                If _IsAuth And String.IsNullOrEmpty(Category) Then
+                    Category = CategoryAuth
+                ElseIf Not _IsAuth AndAlso Not String.IsNullOrEmpty(Category) AndAlso Category = CategoryAuth Then
+                    Category = String.Empty
+                End If
+            End Set
+        End Property
+        Public Const CategoryAuth As String = "Authorization"
+        Public Property Category As String = Nothing
+        Public Property InheritanceName As String = Nothing
         ''' <summary>Initialize a new property option attribute</summary>
         ''' <param name="PropertyName">Property name</param>
         Public Sub New(<CallerMemberName()> Optional ByVal PropertyName As String = Nothing)
             Name = PropertyName
         End Sub
     End Class
+    ''' <summary>Set the dependent fields that need to be updated when this property is changed internally.</summary>
+    <AttributeUsage(AttributeTargets.Property, AllowMultiple:=False, Inherited:=False)> Public NotInheritable Class DependentFields : Inherits Attribute
+        Public ReadOnly Fields As String()
+        Public Sub New(ByVal Field As String)
+            Fields = {Field}
+        End Sub
+        Public Sub New(ByVal Fields As String())
+            Me.Fields = Fields
+        End Sub
+    End Class
     ''' <summary>Store property value in settings XML file</summary>
     <AttributeUsage(AttributeTargets.Property, AllowMultiple:=False, Inherited:=False)> Public NotInheritable Class PXML : Inherits Attribute
         Public ReadOnly ElementName As String
+        Public Property OnlyForChecked As Boolean = False
         ''' <summary>Initialize a new XML attribute</summary>
         ''' <param name="XMLElementName">XML element name</param>
         Public Sub New(<CallerMemberName()> Optional ByVal XMLElementName As String = Nothing)
@@ -55,20 +82,26 @@ Namespace Plugin.Attributes
     End Class
     ''' <summary>Attribute to disable some properties for host use</summary>
     <AttributeUsage(AttributeTargets.Property, AllowMultiple:=False, Inherited:=False)> Public NotInheritable Class DoNotUse : Inherits Attribute
+        Public ReadOnly Value As Boolean = True
+        Public Sub New()
+        End Sub
+        Public Sub New(ByVal Value As Boolean)
+            Me.Value = Value
+        End Sub
     End Class
     ''' <summary>Special property updater</summary>
     <AttributeUsage(AttributeTargets.Method, AllowMultiple:=True, Inherited:=False)> Public NotInheritable Class PropertyUpdater : Inherits Attribute
         Public ReadOnly Name As String
-        Public ReadOnly Dependencies As String()
+        Public ReadOnly Arguments As String()
         ''' <inheritdoc cref="PropertyUpdater.New(String, String())"/>
         Public Sub New(ByVal UpdatingPropertyName As String)
             Name = UpdatingPropertyName
         End Sub
         ''' <summary>Initialize a new PropertyUpdater attribute</summary>
         ''' <param name="UpdatingPropertyName">The name of the property to be updated</param>
-        Public Sub New(ByVal UpdatingPropertyName As String, ByVal Dependent As String())
+        Public Sub New(ByVal UpdatingPropertyName As String, ByVal Arguments As String())
             Name = UpdatingPropertyName
-            Dependencies = Dependent
+            Me.Arguments = Arguments
         End Sub
     End Class
     ''' <summary>Plugin key</summary>
@@ -172,4 +205,13 @@ Namespace Plugin.Attributes
             Repository = RepoName
         End Sub
     End Class
+    ''' <summary>Replace internal plugin with the current one</summary>
+    <AttributeUsage(AttributeTargets.Class, AllowMultiple:=False, Inherited:=False)> Public NotInheritable Class ReplaceInternalPluginAttribute : Inherits Attribute
+        Public ReadOnly SiteName As String
+        Public ReadOnly PluginKey As String
+        Public Sub New(ByVal PluginKey As String, Optional ByVal SiteName As String = Nothing)
+            Me.PluginKey = PluginKey
+            Me.SiteName = SiteName
+        End Sub
+    End Class
 End Namespace

SCrawler.PluginProvider/Interfaces/IDownloadableMedia.vb

@@ -14,6 +14,7 @@ Namespace Plugin
         ReadOnly Property SiteIcon As Drawing.Image
         ReadOnly Property Site As String
         ReadOnly Property SiteKey As String
+        Property AccountName As String
         Property ThumbnailUrl As String
         Property ThumbnailFile As String
         Property Title As String

SCrawler.PluginProvider/Interfaces/IPluginContentProvider.vb

@@ -10,11 +10,15 @@ Namespace Plugin
     Public Interface IPluginContentProvider : Inherits IDisposable
         Event ProgressChanged(ByVal Value As Integer)
         Event ProgressMaximumChanged(ByVal Value As Integer, ByVal Add As Boolean)
+        Event ProgressPreChanged As ProgressChangedEventHandler
+        Event ProgressPreMaximumChanged As ProgressMaximumChangedEventHandler
         Property Thrower As IThrower
         Property LogProvider As ILogProvider
         Property Settings As ISiteSettings
+        Property AccountName As String
         Property Name As String
         Property ID As String
+        Property Options As String
         Property ParseUserMediaOnly As Boolean
         Property UserDescription As String
         Property ExistingContentList As List(Of IUserMedia)
@@ -23,6 +27,7 @@ Namespace Plugin
         Property UserExists As Boolean
         Property UserSuspended As Boolean
         Property IsSavedPosts As Boolean
+        Property IsSubscription As Boolean
         Property SeparateVideoFolder As Boolean
         Property DataPath As String
         Property PostsNumberLimit As Integer?
@@ -35,5 +40,6 @@ Namespace Plugin
         Sub GetMedia(ByVal Token As Threading.CancellationToken)
         Sub Download(ByVal Token As Threading.CancellationToken)
         Sub DownloadSingleObject(ByVal Data As IDownloadableMedia, ByVal Token As Threading.CancellationToken)
+        Sub ResetHistoryData()
     End Interface
 End Namespace

SCrawler.PluginProvider/Interfaces/ISiteSettings.vb

@@ -8,7 +8,7 @@
 ' but WITHOUT ANY WARRANTY
 Imports System.Drawing
 Namespace Plugin
-    Public Interface ISiteSettings
+    Public Interface ISiteSettings : Inherits IDisposable
         Enum Download As Integer
             Main = 0
             SavedPosts = 1
@@ -17,6 +17,14 @@ Namespace Plugin
         ReadOnly Property Icon As Icon
         ReadOnly Property Image As Image
         ReadOnly Property Site As String
+        Property CMDEncoding As String
+        Property EnvironmentPrograms As IEnumerable(Of String)
+        Property UserAgentDefault As String
+        Sub EnvironmentProgramsUpdated()
+        Property AccountName As String
+        Property Temporary As Boolean
+        Property DefaultInstance As ISiteSettings
+        ReadOnly Property SubscriptionsAllowed As Boolean
         Property Logger As ILogProvider
         Function GetUserUrl(ByVal User As IPluginContentProvider) As String
         Function IsMyUser(ByVal UserURL As String) As ExchangeOptions
@@ -24,9 +32,6 @@ Namespace Plugin
         Function GetInstance(ByVal What As Download) As IPluginContentProvider
         Function GetSingleMediaInstance(ByVal URL As String, ByVal OutputFile As String) As IDownloadableMedia
         Function GetUserPostUrl(ByVal User As IPluginContentProvider, ByVal Media As IUserMedia) As String
-#Region "XML Support"
-        Sub Load(ByVal XMLValues As IEnumerable(Of KeyValuePair(Of String, String)))
-#End Region
 #Region "Initialization"
         Sub BeginInit()
         Sub EndInit()
@@ -36,6 +41,7 @@ Namespace Plugin
         Sub EndEdit()
 #End Region
 #Region "Site availability"
+        Property AvailableText As String
         Function Available(ByVal What As Download, ByVal Silent As Boolean) As Boolean
         Function ReadyToDownload(ByVal What As Download) As Boolean
 #End Region
@@ -45,7 +51,10 @@ Namespace Plugin
         Sub AfterDownload(ByVal User As Object, ByVal What As Download)
         Sub DownloadDone(ByVal What As Download)
 #End Region
-        Sub Update()
+        Function Clone(ByVal Full As Boolean) As ISiteSettings
+        Sub Delete()
+        Overloads Sub Update()
+        Overloads Sub Update(ByVal Source As ISiteSettings)
         Sub Reset()
         Sub OpenSettingsForm()
         Sub UserOptions(ByRef Options As Object, ByVal OpenForm As Boolean)

SCrawler.PluginProvider/My Project/AssemblyInfo.vb

@@ -13,7 +13,7 @@ Imports System.Runtime.InteropServices
 <Assembly: AssemblyDescription("Plugin provider for SCrawler")>
 <Assembly: AssemblyCompany("AndyProgram")>
 <Assembly: AssemblyProduct("SCrawler.PluginProvider")>
-<Assembly: AssemblyCopyright("Copyright © 2023")>
+<Assembly: AssemblyCopyright("Copyright © 2024")>
 <Assembly: AssemblyTrademark("AndyProgram")>
 
 <Assembly: ComVisible(False)>
@@ -32,6 +32,6 @@ Imports System.Runtime.InteropServices
 ' by using the '*' as shown below:
 ' <Assembly: AssemblyVersion("1.0.*")>
 
-<Assembly: AssemblyVersion("2023.4.28.0")>
-<Assembly: AssemblyFileVersion("2023.4.28.0")>
+<Assembly: AssemblyVersion("2024.5.18.0")>
+<Assembly: AssemblyFileVersion("2024.5.18.0")>
 <Assembly: NeutralResourcesLanguage("en")>

SCrawler.PluginProvider/ObjectInterfaces/ILogProvider.vb

@@ -11,6 +11,6 @@ Namespace Plugin
         Overloads Sub Add(ByVal Message As String)
         Overloads Sub Add(ByVal ex As Exception, ByVal Message As String,
                           Optional ByVal ShowMainMsg As Boolean = False, Optional ByVal ShowErrorMsg As Boolean = False,
-                          Optional ByVal SendInLog As Boolean = True)
+                          Optional ByVal SendToLog As Boolean = True)
     End Interface
 End Namespace

SCrawler.PluginProvider/Objects/ExchangeOptions.vb

@@ -11,6 +11,7 @@ Namespace Plugin
         Public UserName As String
         Public SiteName As String
         Public HostKey As String
+        Public Options As String
         Public Exists As Boolean
         Public Sub New(ByVal Site As String, ByVal Name As String)
             UserName = Name

SCrawler.PluginProvider/Objects/ExitException.vb

@@ -0,0 +1,36 @@
+' Copyright (C) 2023  Andy https://github.com/AAndyProgram
+' This program is free software: you can redistribute it and/or modify
+' it under the terms of the GNU General Public License as published by
+' the Free Software Foundation, either version 3 of the License, or
+' (at your option) any later version.
+'
+' This program is distributed in the hope that it will be useful,
+' but WITHOUT ANY WARRANTY
+Namespace Plugin
+    ''' <summary>Represents errors that occur during downloading to be thrown to the root downloading function.</summary>
+    Public Class ExitException : Inherits Exception
+        ''' <summary>Add only the message to the log, without adding a <see cref="StackTrace"/>. Default: <see langword="True"/>.</summary>
+        ''' <returns><see langword="True"/> if only the message should be added to the log; otherwise the stack trace will also be added.</returns>
+        Public Property SimpleLogLine As Boolean = True
+        ''' <summary>Don't add a message to the log. Default: <see langword="False"/>.</summary>
+        ''' <returns><see langword="True"/> if the error is exit-only and there is no need to add a message to the log; otherwise add a message to the log.</returns>
+        Public Property Silent As Boolean = False
+        ''' <summary>Initializes a new instance of the <see cref="ExitException"/> class.</summary>
+        Public Sub New()
+        End Sub
+        ''' <summary>Initializes a new instance of the <see cref="ExitException"/> class with a specified error message.</summary>
+        ''' <param name="Message">The message that describes the error.</param>
+        Public Sub New(ByVal Message As String)
+            MyBase.New(Message)
+        End Sub
+        ''' <summary>
+        ''' Initializes a new instance of the <see cref="ExitException"/> class with a specified error message 
+        ''' and a reference to the inner exception that is the cause of this exception.
+        ''' </summary>
+        ''' <param name="Message">The error message that explains the reason for the exception.</param>
+        ''' <param name="InnerException">The exception that is the cause of the current exception, or a null reference (Nothing in Visual Basic) if no inner exception is specified.</param>
+        Public Sub New(ByVal Message As String, ByVal InnerException As Exception)
+            MyBase.New(Message, InnerException)
+        End Sub
+    End Class
+End Namespace

SCrawler.PluginProvider/Objects/PropertyValue.vb

@@ -9,8 +9,24 @@
 Namespace Plugin
     Public NotInheritable Class PropertyValue : Implements IPropertyValue
         Public Event ValueChanged As IPropertyValue.ValueChangedEventHandler Implements IPropertyValue.ValueChanged
+        Public Event CheckedChanged As IPropertyValue.ValueChangedEventHandler
         Public Property [Type] As Type Implements IPropertyValue.Type
         Public Property OnChangeFunction As IPropertyValue.ValueChangedEventHandler
+        Public Property OnCheckboxCheckedChange As EventHandler(Of PropertyValueEventArgs)
+        Private _Checked As Boolean = False
+        Public Property Checked As Boolean
+            Get
+                Return _Checked
+            End Get
+            Set(ByVal IsChecked As Boolean)
+                _Checked = IsChecked
+                If Not _Initialization Then
+                    If Not OnCheckboxCheckedChange Is Nothing Then OnCheckboxCheckedChange.Invoke(Me, EventArgs.Empty)
+                    RaiseEvent CheckedChanged(_Checked)
+                End If
+            End Set
+        End Property
+        Private _Initialization As Boolean = False
         ''' <inheritdoc cref="PropertyValue.New(Object, Type, ByRef IPropertyValue.ValueChangedEventHandler)"/>
         ''' <exception cref="ArgumentNullException"></exception>
         Public Sub New(ByVal InitValue As Object)
@@ -41,10 +57,26 @@ Namespace Plugin
             End Get
             Set(ByVal NewValue As Object)
                 _Value = NewValue
-                If Not OnChangeFunction Is Nothing Then OnChangeFunction.Invoke(Value)
-                RaiseEvent ValueChanged(_Value)
+                If Not _Initialization Then
+                    If Not OnChangeFunction Is Nothing Then OnChangeFunction.Invoke(Value)
+                    RaiseEvent ValueChanged(_Value)
+                End If
             End Set
         End Property
+        Public Sub BeginInit()
+            _Initialization = True
+        End Sub
+        Public Sub EndInit()
+            _Initialization = False
+        End Sub
+        Public Sub Clone(ByVal Source As PropertyValue)
+            _Initialization = True
+            Type = Source.Type
+            OnChangeFunction = Source.OnChangeFunction
+            _Value = Source._Value
+            _Checked = Source._Checked
+            _Initialization = False
+        End Sub
     End Class
     Public Interface IPropertyValue
         ''' <summary>Event for internal exchange</summary>
@@ -55,4 +87,8 @@ Namespace Plugin
         ''' <summary>Property value</summary>
         Property Value As Object
     End Interface
+    Public Class PropertyValueEventArgs : Inherits EventArgs
+        Public Property Checked As Boolean = False
+        Public Property ControlEnabled As Boolean = True
+    End Class
 End Namespace

SCrawler.PluginProvider/SCrawler.PluginProvider.vbproj

@@ -107,6 +107,7 @@
     <Compile Include="Objects\ExchangeOptions.vb" />
     <Compile Include="ObjectInterfaces\ILogProvider.vb" />
     <Compile Include="Interfaces\IPluginContentProvider.vb" />
+    <Compile Include="Objects\ExitException.vb" />
     <Compile Include="Objects\PluginUserMedia.vb" />
     <Compile Include="Interfaces\ISiteSettings.vb" />
     <Compile Include="ObjectInterfaces\IThrower.vb" />

SCrawler.Shared/.editorconfig

@@ -0,0 +1,3 @@
+[*.vb]
+# Modifier preferences
+file_header_template = Copyright (C) Andy https://github.com/AAndyProgram\nThis program is free software: you can redistribute it and/or modify\nit under the terms of the GNU General Public License as published by\nthe Free Software Foundation, either version 3 of the License, or\n(at your option) any later version.\n\nThis program is distributed in the hope that it will be useful,\nbut WITHOUT ANY WARRANTY; without even the implied warranty of\nMERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the\nGNU General Public License for more details.\n\nYou should have received a copy of the GNU General Public License\nalong with this program.  If not, see <https://www.gnu.org/licenses/>

SCrawler.Shared/Functions.vb

@@ -0,0 +1,33 @@
+' Copyright (C) Andy https://github.com/AAndyProgram
+' This program is free software: you can redistribute it and/or modify
+' it under the terms of the GNU General Public License as published by
+' the Free Software Foundation, either version 3 of the License, or
+' (at your option) any later version.
+'
+' This program is distributed in the hope that it will be useful,
+' but WITHOUT ANY WARRANTY
+Namespace [Shared]
+    Public Module Functions
+        Public Const NewReleaseFolderName As String = "__NewRelease"
+        Public Function GetCurrentMaxVer(Optional ByVal Path As SFile = Nothing) As Version
+            Try
+                If Path.IsEmptyString Then Path = Application.StartupPath.CSFileP
+                If Path.Exists(SFO.Path, False) Then
+                    Dim versions As New List(Of Version)
+                    Dim v As FileVersionInfo
+                    With SFile.GetFiles(Path, "*.exe",, EDP.ReturnValue).ListIfNothing.Where(Function(f) f.Name = "SCrawler" Or f.Name = "YouTubeDownloader")
+                        If .ListExists Then
+                            For Each f As SFile In .Self
+                                v = FileVersionInfo.GetVersionInfo(f)
+                                versions.Add(New Version(v.ProductVersion))
+                            Next
+                        End If
+                    End With
+                    If versions.Count > 0 Then Return versions.Max
+                End If
+            Catch
+            End Try
+            Return Nothing
+        End Function
+    End Module
+End Namespace

SCrawler.Shared/My Project/Application.Designer.vb

@@ -0,0 +1,13 @@
+'------------------------------------------------------------------------------
+' <auto-generated>
+'     This code was generated by a tool.
+'     Runtime Version:4.0.30319.42000
+'
+'     Changes to this file may cause incorrect behavior and will be lost if
+'     the code is regenerated.
+' </auto-generated>
+'------------------------------------------------------------------------------
+
+Option Strict On
+Option Explicit On
+

SCrawler.Shared/My Project/Application.myapp

@@ -0,0 +1,10 @@
+<?xml version="1.0" encoding="utf-8"?>
+<MyApplicationData xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xmlns:xsd="http://www.w3.org/2001/XMLSchema">
+  <MySubMain>false</MySubMain>
+  <SingleInstance>false</SingleInstance>
+  <ShutdownMode>0</ShutdownMode>
+  <EnableVisualStyles>true</EnableVisualStyles>
+  <AuthenticationMode>0</AuthenticationMode>
+  <ApplicationType>1</ApplicationType>
+  <SaveMySettingsOnExit>true</SaveMySettingsOnExit>
+</MyApplicationData>

SCrawler.Shared/My Project/AssemblyInfo.vb

@@ -0,0 +1,37 @@
+Imports System.Resources
+Imports System
+Imports System.Reflection
+Imports System.Runtime.InteropServices
+
+' General Information about an assembly is controlled through the following
+' set of attributes. Change these attribute values to modify the information
+' associated with an assembly.
+
+' Review the values of the assembly attributes
+
+<Assembly: AssemblyTitle("SCrawler.Shared")>
+<Assembly: AssemblyDescription("SCrawler shared functions")>
+<Assembly: AssemblyCompany("AndyProgram")>
+<Assembly: AssemblyProduct("SCrawler.Shared")>
+<Assembly: AssemblyCopyright("Copyright © 2024")>
+<Assembly: AssemblyTrademark("AndyProgram")>
+
+<Assembly: ComVisible(False)>
+
+'The following GUID is for the ID of the typelib if this project is exposed to COM
+<Assembly: Guid("75a22c7c-6f90-49cb-852b-078ea0b8f2b6")>
+
+' Version information for an assembly consists of the following four values:
+'
+'      Major Version
+'      Minor Version
+'      Build Number
+'      Revision
+'
+' You can specify all the values or you can default the Build and Revision Numbers
+' by using the '*' as shown below:
+' <Assembly: AssemblyVersion("1.0.*")>
+
+<Assembly: AssemblyVersion("2023.12.15.0")>
+<Assembly: AssemblyFileVersion("2023.12.15.0")>
+<Assembly: NeutralResourcesLanguage("en")>

SCrawler.Shared/My Project/Resources.Designer.vb

@@ -0,0 +1,63 @@
+'------------------------------------------------------------------------------
+' <auto-generated>
+'     This code was generated by a tool.
+'     Runtime Version:4.0.30319.42000
+'
+'     Changes to this file may cause incorrect behavior and will be lost if
+'     the code is regenerated.
+' </auto-generated>
+'------------------------------------------------------------------------------
+
+Option Strict On
+Option Explicit On
+
+Imports System
+
+Namespace My.Resources
+    
+    'This class was auto-generated by the StronglyTypedResourceBuilder
+    'class via a tool like ResGen or Visual Studio.
+    'To add or remove a member, edit your .ResX file then rerun ResGen
+    'with the /str option, or rebuild your VS project.
+    '''<summary>
+    '''  A strongly-typed resource class, for looking up localized strings, etc.
+    '''</summary>
+    <Global.System.CodeDom.Compiler.GeneratedCodeAttribute("System.Resources.Tools.StronglyTypedResourceBuilder", "16.0.0.0"),  _
+     Global.System.Diagnostics.DebuggerNonUserCodeAttribute(),  _
+     Global.System.Runtime.CompilerServices.CompilerGeneratedAttribute(),  _
+     Global.Microsoft.VisualBasic.HideModuleNameAttribute()>  _
+    Friend Module Resources
+        
+        Private resourceMan As Global.System.Resources.ResourceManager
+        
+        Private resourceCulture As Global.System.Globalization.CultureInfo
+        
+        '''<summary>
+        '''  Returns the cached ResourceManager instance used by this class.
+        '''</summary>
+        <Global.System.ComponentModel.EditorBrowsableAttribute(Global.System.ComponentModel.EditorBrowsableState.Advanced)>  _
+        Friend ReadOnly Property ResourceManager() As Global.System.Resources.ResourceManager
+            Get
+                If Object.ReferenceEquals(resourceMan, Nothing) Then
+                    Dim temp As Global.System.Resources.ResourceManager = New Global.System.Resources.ResourceManager("SCrawler.Resources", GetType(Resources).Assembly)
+                    resourceMan = temp
+                End If
+                Return resourceMan
+            End Get
+        End Property
+        
+        '''<summary>
+        '''  Overrides the current thread's CurrentUICulture property for all
+        '''  resource lookups using this strongly typed resource class.
+        '''</summary>
+        <Global.System.ComponentModel.EditorBrowsableAttribute(Global.System.ComponentModel.EditorBrowsableState.Advanced)>  _
+        Friend Property Culture() As Global.System.Globalization.CultureInfo
+            Get
+                Return resourceCulture
+            End Get
+            Set
+                resourceCulture = value
+            End Set
+        End Property
+    End Module
+End Namespace

SCrawler.Shared/My Project/Resources.resx

@@ -0,0 +1,117 @@
+<?xml version="1.0" encoding="utf-8"?>
+<root>
+  <!-- 
+    Microsoft ResX Schema 
+    
+    Version 2.0
+    
+    The primary goals of this format is to allow a simple XML format 
+    that is mostly human readable. The generation and parsing of the 
+    various data types are done through the TypeConverter classes 
+    associated with the data types.
+    
+    Example:
+    
+    ... ado.net/XML headers & schema ...
+    <resheader name="resmimetype">text/microsoft-resx</resheader>
+    <resheader name="version">2.0</resheader>
+    <resheader name="reader">System.Resources.ResXResourceReader, System.Windows.Forms, ...</resheader>
+    <resheader name="writer">System.Resources.ResXResourceWriter, System.Windows.Forms, ...</resheader>
+    <data name="Name1"><value>this is my long string</value><comment>this is a comment</comment></data>
+    <data name="Color1" type="System.Drawing.Color, System.Drawing">Blue</data>
+    <data name="Bitmap1" mimetype="application/x-microsoft.net.object.binary.base64">
+        <value>[base64 mime encoded serialized .NET Framework object]</value>
+    </data>
+    <data name="Icon1" type="System.Drawing.Icon, System.Drawing" mimetype="application/x-microsoft.net.object.bytearray.base64">
+        <value>[base64 mime encoded string representing a byte array form of the .NET Framework object]</value>
+        <comment>This is a comment</comment>
+    </data>
+                
+    There are any number of "resheader" rows that contain simple 
+    name/value pairs.
+    
+    Each data row contains a name, and value. The row also contains a 
+    type or mimetype. Type corresponds to a .NET class that support 
+    text/value conversion through the TypeConverter architecture. 
+    Classes that don't support this are serialized and stored with the 
+    mimetype set.
+    
+    The mimetype is used for serialized objects, and tells the 
+    ResXResourceReader how to depersist the object. This is currently not 
+    extensible. For a given mimetype the value must be set accordingly:
+    
+    Note - application/x-microsoft.net.object.binary.base64 is the format 
+    that the ResXResourceWriter will generate, however the reader can 
+    read any of the formats listed below.
+    
+    mimetype: application/x-microsoft.net.object.binary.base64
+    value   : The object must be serialized with 
+            : System.Serialization.Formatters.Binary.BinaryFormatter
+            : and then encoded with base64 encoding.
+    
+    mimetype: application/x-microsoft.net.object.soap.base64
+    value   : The object must be serialized with 
+            : System.Runtime.Serialization.Formatters.Soap.SoapFormatter
+            : and then encoded with base64 encoding.
+
+    mimetype: application/x-microsoft.net.object.bytearray.base64
+    value   : The object must be serialized into a byte array 
+            : using a System.ComponentModel.TypeConverter
+            : and then encoded with base64 encoding.
+    -->
+  <xsd:schema id="root" xmlns="" xmlns:xsd="http://www.w3.org/2001/XMLSchema" xmlns:msdata="urn:schemas-microsoft-com:xml-msdata">
+    <xsd:element name="root" msdata:IsDataSet="true">
+      <xsd:complexType>
+        <xsd:choice maxOccurs="unbounded">
+          <xsd:element name="metadata">
+            <xsd:complexType>
+              <xsd:sequence>
+                <xsd:element name="value" type="xsd:string" minOccurs="0" />
+              </xsd:sequence>
+              <xsd:attribute name="name" type="xsd:string" />
+              <xsd:attribute name="type" type="xsd:string" />
+              <xsd:attribute name="mimetype" type="xsd:string" />
+            </xsd:complexType>
+          </xsd:element>
+          <xsd:element name="assembly">
+            <xsd:complexType>
+              <xsd:attribute name="alias" type="xsd:string" />
+              <xsd:attribute name="name" type="xsd:string" />
+            </xsd:complexType>
+          </xsd:element>
+          <xsd:element name="data">
+            <xsd:complexType>
+              <xsd:sequence>
+                <xsd:element name="value" type="xsd:string" minOccurs="0" msdata:Ordinal="1" />
+                <xsd:element name="comment" type="xsd:string" minOccurs="0" msdata:Ordinal="2" />
+              </xsd:sequence>
+              <xsd:attribute name="name" type="xsd:string" msdata:Ordinal="1" />
+              <xsd:attribute name="type" type="xsd:string" msdata:Ordinal="3" />
+              <xsd:attribute name="mimetype" type="xsd:string" msdata:Ordinal="4" />
+            </xsd:complexType>
+          </xsd:element>
+          <xsd:element name="resheader">
+            <xsd:complexType>
+              <xsd:sequence>
+                <xsd:element name="value" type="xsd:string" minOccurs="0" msdata:Ordinal="1" />
+              </xsd:sequence>
+              <xsd:attribute name="name" type="xsd:string" use="required" />
+            </xsd:complexType>
+          </xsd:element>
+        </xsd:choice>
+      </xsd:complexType>
+    </xsd:element>
+  </xsd:schema>
+  <resheader name="resmimetype">
+    <value>text/microsoft-resx</value>
+  </resheader>
+  <resheader name="version">
+    <value>2.0</value>
+  </resheader>
+  <resheader name="reader">
+    <value>System.Resources.ResXResourceReader, System.Windows.Forms, Version=2.0.0.0, Culture=neutral, PublicKeyToken=b77a5c561934e089</value>
+  </resheader>
+  <resheader name="writer">
+    <value>System.Resources.ResXResourceWriter, System.Windows.Forms, Version=2.0.0.0, Culture=neutral, PublicKeyToken=b77a5c561934e089</value>
+  </resheader>
+</root>

SCrawler.Shared/My Project/Settings.Designer.vb

@@ -0,0 +1,73 @@
+'------------------------------------------------------------------------------
+' <auto-generated>
+'     This code was generated by a tool.
+'     Runtime Version:4.0.30319.42000
+'
+'     Changes to this file may cause incorrect behavior and will be lost if
+'     the code is regenerated.
+' </auto-generated>
+'------------------------------------------------------------------------------
+
+Option Strict On
+Option Explicit On
+
+
+Namespace My
+    
+    <Global.System.Runtime.CompilerServices.CompilerGeneratedAttribute(),  _
+     Global.System.CodeDom.Compiler.GeneratedCodeAttribute("Microsoft.VisualStudio.Editors.SettingsDesigner.SettingsSingleFileGenerator", "16.10.0.0"),  _
+     Global.System.ComponentModel.EditorBrowsableAttribute(Global.System.ComponentModel.EditorBrowsableState.Advanced)>  _
+    Partial Friend NotInheritable Class MySettings
+        Inherits Global.System.Configuration.ApplicationSettingsBase
+        
+        Private Shared defaultInstance As MySettings = CType(Global.System.Configuration.ApplicationSettingsBase.Synchronized(New MySettings()),MySettings)
+        
+#Region "My.Settings Auto-Save Functionality"
+#If _MyType = "WindowsForms" Then
+    Private Shared addedHandler As Boolean
+
+    Private Shared addedHandlerLockObject As New Object
+
+    <Global.System.Diagnostics.DebuggerNonUserCodeAttribute(), Global.System.ComponentModel.EditorBrowsableAttribute(Global.System.ComponentModel.EditorBrowsableState.Advanced)> _
+    Private Shared Sub AutoSaveSettings(sender As Global.System.Object, e As Global.System.EventArgs)
+        If My.Application.SaveMySettingsOnExit Then
+            My.Settings.Save()
+        End If
+    End Sub
+#End If
+#End Region
+        
+        Public Shared ReadOnly Property [Default]() As MySettings
+            Get
+                
+#If _MyType = "WindowsForms" Then
+               If Not addedHandler Then
+                    SyncLock addedHandlerLockObject
+                        If Not addedHandler Then
+                            AddHandler My.Application.Shutdown, AddressOf AutoSaveSettings
+                            addedHandler = True
+                        End If
+                    End SyncLock
+                End If
+#End If
+                Return defaultInstance
+            End Get
+        End Property
+    End Class
+End Namespace
+
+Namespace My
+    
+    <Global.Microsoft.VisualBasic.HideModuleNameAttribute(),  _
+     Global.System.Diagnostics.DebuggerNonUserCodeAttribute(),  _
+     Global.System.Runtime.CompilerServices.CompilerGeneratedAttribute()>  _
+    Friend Module MySettingsProperty
+        
+        <Global.System.ComponentModel.Design.HelpKeywordAttribute("My.Settings")>  _
+        Friend ReadOnly Property Settings() As Global.SCrawler.My.MySettings
+            Get
+                Return Global.SCrawler.My.MySettings.Default
+            End Get
+        End Property
+    End Module
+End Namespace

SCrawler.Shared/My Project/Settings.settings

@@ -0,0 +1,7 @@
+<?xml version='1.0' encoding='utf-8'?>
+<SettingsFile xmlns="http://schemas.microsoft.com/VisualStudio/2004/01/settings" CurrentProfile="(Default)" UseMySettingsClassName="true">
+  <Profiles>
+    <Profile Name="(Default)" />
+  </Profiles>
+  <Settings />
+</SettingsFile>

SCrawler.Shared/SCrawler.Shared.vbproj

@@ -0,0 +1,151 @@
+<?xml version="1.0" encoding="utf-8"?>
+<Project ToolsVersion="15.0" xmlns="http://schemas.microsoft.com/developer/msbuild/2003">
+  <Import Project="$(MSBuildExtensionsPath)\$(MSBuildToolsVersion)\Microsoft.Common.props" Condition="Exists('$(MSBuildExtensionsPath)\$(MSBuildToolsVersion)\Microsoft.Common.props')" />
+  <PropertyGroup>
+    <Configuration Condition=" '$(Configuration)' == '' ">Debug</Configuration>
+    <Platform Condition=" '$(Platform)' == '' ">AnyCPU</Platform>
+    <ProjectGuid>{DC634700-24C7-42DD-BF8F-87E6CC54E625}</ProjectGuid>
+    <OutputType>Library</OutputType>
+    <RootNamespace>SCrawler</RootNamespace>
+    <AssemblyName>SCrawler.Shared</AssemblyName>
+    <FileAlignment>512</FileAlignment>
+    <MyType>Windows</MyType>
+    <TargetFrameworkVersion>v4.6.1</TargetFrameworkVersion>
+    <Deterministic>true</Deterministic>
+  </PropertyGroup>
+  <PropertyGroup Condition=" '$(Configuration)|$(Platform)' == 'Debug|AnyCPU' ">
+    <DebugSymbols>true</DebugSymbols>
+    <DebugType>full</DebugType>
+    <DefineDebug>true</DefineDebug>
+    <DefineTrace>true</DefineTrace>
+    <OutputPath>bin\Debug\</OutputPath>
+    <DocumentationFile>
+    </DocumentationFile>
+    <NoWarn>42016,41999,42017,42018,42019,42032,42036,42020,42021,42022</NoWarn>
+  </PropertyGroup>
+  <PropertyGroup Condition=" '$(Configuration)|$(Platform)' == 'Release|AnyCPU' ">
+    <DebugType>pdbonly</DebugType>
+    <DefineDebug>false</DefineDebug>
+    <DefineTrace>true</DefineTrace>
+    <Optimize>true</Optimize>
+    <OutputPath>bin\Release\</OutputPath>
+    <DocumentationFile>
+    </DocumentationFile>
+    <NoWarn>42016,41999,42017,42018,42019,42032,42036,42020,42021,42022</NoWarn>
+  </PropertyGroup>
+  <PropertyGroup>
+    <OptionExplicit>On</OptionExplicit>
+  </PropertyGroup>
+  <PropertyGroup>
+    <OptionCompare>Binary</OptionCompare>
+  </PropertyGroup>
+  <PropertyGroup>
+    <OptionStrict>Off</OptionStrict>
+  </PropertyGroup>
+  <PropertyGroup>
+    <OptionInfer>On</OptionInfer>
+  </PropertyGroup>
+  <PropertyGroup Condition="'$(Configuration)|$(Platform)' == 'Debug|x64'">
+    <DebugSymbols>true</DebugSymbols>
+    <DefineDebug>true</DefineDebug>
+    <DefineTrace>true</DefineTrace>
+    <OutputPath>bin\x64\Debug\</OutputPath>
+    <NoWarn>42016,41999,42017,42018,42019,42032,42036,42020,42021,42022</NoWarn>
+    <DebugType>full</DebugType>
+    <PlatformTarget>x64</PlatformTarget>
+  </PropertyGroup>
+  <PropertyGroup Condition="'$(Configuration)|$(Platform)' == 'Release|x64'">
+    <DefineTrace>true</DefineTrace>
+    <OutputPath>bin\x64\Release\</OutputPath>
+    <Optimize>true</Optimize>
+    <NoWarn>42016,41999,42017,42018,42019,42032,42036,42020,42021,42022</NoWarn>
+    <DebugType>pdbonly</DebugType>
+    <PlatformTarget>x64</PlatformTarget>
+  </PropertyGroup>
+  <PropertyGroup Condition="'$(Configuration)|$(Platform)' == 'Debug|x86'">
+    <DebugSymbols>true</DebugSymbols>
+    <DefineDebug>true</DefineDebug>
+    <DefineTrace>true</DefineTrace>
+    <OutputPath>bin\x86\Debug\</OutputPath>
+    <NoWarn>42016,41999,42017,42018,42019,42032,42036,42020,42021,42022</NoWarn>
+    <DebugType>full</DebugType>
+    <PlatformTarget>x86</PlatformTarget>
+  </PropertyGroup>
+  <PropertyGroup Condition="'$(Configuration)|$(Platform)' == 'Release|x86'">
+    <DefineTrace>true</DefineTrace>
+    <OutputPath>bin\x86\Release\</OutputPath>
+    <Optimize>true</Optimize>
+    <NoWarn>42016,41999,42017,42018,42019,42032,42036,42020,42021,42022</NoWarn>
+    <DebugType>pdbonly</DebugType>
+    <PlatformTarget>x86</PlatformTarget>
+  </PropertyGroup>
+  <ItemGroup>
+    <Reference Include="System" />
+    <Reference Include="System.Data" />
+    <Reference Include="System.Windows.Forms" />
+    <Reference Include="System.Xml" />
+    <Reference Include="System.Core" />
+    <Reference Include="System.Xml.Linq" />
+    <Reference Include="System.Data.DataSetExtensions" />
+    <Reference Include="System.Net.Http" />
+  </ItemGroup>
+  <ItemGroup>
+    <Import Include="Microsoft.VisualBasic" />
+    <Import Include="PersonalUtilities.Functions" />
+    <Import Include="System" />
+    <Import Include="System.Collections" />
+    <Import Include="System.Collections.Generic" />
+    <Import Include="System.Data" />
+    <Import Include="System.Diagnostics" />
+    <Import Include="System.Linq" />
+    <Import Include="System.Windows.Forms" />
+    <Import Include="System.Xml.Linq" />
+    <Import Include="System.Threading.Tasks" />
+  </ItemGroup>
+  <ItemGroup>
+    <Compile Include="Functions.vb" />
+    <Compile Include="My Project\AssemblyInfo.vb" />
+    <Compile Include="My Project\Application.Designer.vb">
+      <AutoGen>True</AutoGen>
+      <DependentUpon>Application.myapp</DependentUpon>
+      <DesignTime>True</DesignTime>
+    </Compile>
+    <Compile Include="My Project\Resources.Designer.vb">
+      <AutoGen>True</AutoGen>
+      <DesignTime>True</DesignTime>
+      <DependentUpon>Resources.resx</DependentUpon>
+    </Compile>
+    <Compile Include="My Project\Settings.Designer.vb">
+      <AutoGen>True</AutoGen>
+      <DependentUpon>Settings.settings</DependentUpon>
+      <DesignTimeSharedInput>True</DesignTimeSharedInput>
+    </Compile>
+  </ItemGroup>
+  <ItemGroup>
+    <EmbeddedResource Include="My Project\Resources.resx">
+      <Generator>VbMyResourcesResXFileCodeGenerator</Generator>
+      <LastGenOutput>Resources.Designer.vb</LastGenOutput>
+      <CustomToolNamespace>My.Resources</CustomToolNamespace>
+      <SubType>Designer</SubType>
+    </EmbeddedResource>
+  </ItemGroup>
+  <ItemGroup>
+    <None Include=".editorconfig" />
+    <None Include="My Project\Application.myapp">
+      <Generator>MyApplicationCodeGenerator</Generator>
+      <LastGenOutput>Application.Designer.vb</LastGenOutput>
+    </None>
+    <None Include="My Project\Settings.settings">
+      <Generator>SettingsSingleFileGenerator</Generator>
+      <CustomToolNamespace>My</CustomToolNamespace>
+      <LastGenOutput>Settings.Designer.vb</LastGenOutput>
+    </None>
+  </ItemGroup>
+  <ItemGroup>
+    <ProjectReference Include="..\..\..\MyUtilities\PersonalUtilities\PersonalUtilities.vbproj">
+      <Project>{8405896b-2685-4916-bc93-1fb514c323a9}</Project>
+      <Name>PersonalUtilities</Name>
+    </ProjectReference>
+  </ItemGroup>
+  <Import Project="$(MSBuildToolsPath)\Microsoft.VisualBasic.targets" />
+</Project>

SCrawler.Updater/.editorconfig

@@ -0,0 +1,3 @@
+[*.vb]
+# Modifier preferences
+file_header_template = Copyright (C) Andy https://github.com/AAndyProgram\nThis program is free software: you can redistribute it and/or modify\nit under the terms of the GNU General Public License as published by\nthe Free Software Foundation, either version 3 of the License, or\n(at your option) any later version.\n\nThis program is distributed in the hope that it will be useful,\nbut WITHOUT ANY WARRANTY; without even the implied warranty of\nMERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the\nGNU General Public License for more details.\n\nYou should have received a copy of the GNU General Public License\nalong with this program.  If not, see <https://www.gnu.org/licenses/>

SCrawler.Updater/App.config

@@ -0,0 +1,6 @@
+<?xml version="1.0" encoding="utf-8" ?>
+<configuration>
+    <startup> 
+        <supportedRuntime version="v4.0" sku=".NETFramework,Version=v4.6.1" />
+    </startup>
+</configuration>

SCrawler.Updater/MainMod.vb

@@ -0,0 +1,229 @@
+' Copyright (C) Andy https://github.com/AAndyProgram
+' This program is free software: you can redistribute it and/or modify
+' it under the terms of the GNU General Public License as published by
+' the Free Software Foundation, either version 3 of the License, or
+' (at your option) any later version.
+'
+' This program is distributed in the hope that it will be useful,
+' but WITHOUT ANY WARRANTY
+Imports System.Net
+Imports System.IO.Compression
+Imports PersonalUtilities.Functions
+Imports PersonalUtilities.Functions.XML
+Imports PersonalUtilities.Tools.Web.Clients
+Imports PersonalUtilities.Tools.Web.Documents.JSON
+Imports SCrawler.Shared
+Public Module MainMod
+    Private MyProcessID As Integer = -1
+    Private MyWorkingPath As SFile = Nothing
+    Private ReadOnly ProcessNames As String() = {"SCrawler", "YouTubeDownloader", "Updater"}
+    Private Silent As Boolean = False
+    Private Function GetConsoleResponse(ByVal Request As String) As String
+        Console.Write(Request)
+        Return Console.ReadLine
+    End Function
+    Private Function DownloadFile(ByVal URL As String, ByVal Destination As SFile) As Boolean
+        Try
+            Dim lastPerc% = -1
+            Dim currentCursor% = Console.CursorTop
+            Using w As New RWebClient With {.AsyncMode = True}
+                AddHandler w.DownloadProgressChanged,
+                           New DownloadProgressChangedEventHandler(Sub(ByVal Sender As Object, ByVal e As DownloadProgressChangedEventArgs)
+                                                                       If lastPerc < e.ProgressPercentage Then
+                                                                           lastPerc = e.ProgressPercentage
+                                                                           Console.SetCursorPosition(0, currentCursor)
+                                                                           Console.Write("{0}% completed", e.ProgressPercentage)
+                                                                       End If
+                                                                   End Sub)
+                Return w.DownloadFile(URL, Destination, EDP.ReturnValue)
+            End Using
+        Catch ex As Exception
+            Return False
+        End Try
+    End Function
+    Public Sub Main()
+        Try
+            MyWorkingPath = AppDomain.CurrentDomain.BaseDirectory.CSFileP
+            MyProcessID = Process.GetCurrentProcess.Id
+            Console.Title = "SCrawler updater"
+            With Environment.GetCommandLineArgs
+                If .ListExists(2) Then Silent = .Self()(1).FromXML(Of Boolean)(False)
+            End With
+
+            Dim currentDir As SFile = MyWorkingPath.CutPath
+            Dim extractionDir As SFile = $"{currentDir.CSFilePS}{NewReleaseFolderName}\"
+            If extractionDir.Exists(SFO.Path, False) Then extractionDir.Delete(SFO.Path, SFODelete.DeletePermanently, EDP.None)
+
+            Dim currVer As Version = GetCurrentMaxVer(currentDir)
+            If currVer Is Nothing Then
+                Console.WriteLine("The current version of the program cannot be determined")
+            Else
+                Console.WriteLine($"The current version is {currVer} (x{IIf(Environment.Is64BitProcess, 64, 86)})")
+                Dim release As GitRelease = GetGitRelease()
+                If Not release.URL.IsEmptyString And Not release.Version Is Nothing Then
+                    If release.Version > currVer Then
+                        Console.WriteLine($"The new version is {release.Version} ({release.Name})")
+
+                        If Not Silent AndAlso GetConsoleResponse("Do you want to update the program? (y/n): ").IfNullOrEmpty("n") = "n" Then Exit Sub
+
+                        If ActiveProcessesExist() Then
+                            Console.WriteLine("One of the SCrawler programs is still running. Waiting for all SCrawler programs to close.")
+                            While ActiveProcessesExist() : Threading.Thread.Sleep(100) : End While
+                            Console.WriteLine("All SCrawler programs are closed.")
+                        End If
+
+                        If extractionDir.Exists(SFO.Path, True) Then
+                            Dim destFile As SFile = $"{extractionDir.CSFilePS}{New SFile(release.URL).File}"
+                            Console.WriteLine("Downloading new version...")
+                            If DownloadFile(release.URL, destFile) Then
+                                Console.WriteLine("")
+                                Console.WriteLine("New version downloaded!")
+                                Console.WriteLine("Extracting files...")
+                                ZipFile.ExtractToDirectory(destFile, extractionDir)
+                                Console.WriteLine("Files extracted!")
+                                destFile.Delete(SFO.File, SFODelete.DeletePermanently, EDP.None)
+                                If Not MoveFiles(extractionDir, currentDir) Then GetConsoleResponse("Unable to update the program. Press Enter to exit") : Exit Sub
+                            Else
+                                extractionDir.Delete(SFO.Path, SFODelete.DeletePermanently, EDP.None)
+                                Console.WriteLine("Unable to download new version")
+                            End If
+                        Else
+                            Console.WriteLine("Unable to create temp directory")
+                        End If
+                    Else
+                        Console.WriteLine("The program is up to date")
+                    End If
+                Else
+                    Console.WriteLine("Unable to get information about new version")
+                End If
+            End If
+        Catch ex As Exception
+            Console.WriteLine("An error occurred during update")
+            Console.WriteLine(ex.Message)
+        Finally
+            GetConsoleResponse("Press Enter to exit")
+        End Try
+    End Sub
+    Private Function MoveFiles(ByVal Source As SFile, ByVal Destination As SFile) As Boolean
+        Console.WriteLine("Updating files")
+        Try
+
+            Dim oldFiles As List(Of SFile) = SFile.GetFiles(Destination,,, EDP.ReturnValue)
+            Dim oldFolders As List(Of SFile) = SFile.GetDirectories(Destination,,, EDP.ReturnValue)
+
+            Dim newFiles As List(Of SFile) = SFile.GetFiles(Source,,, EDP.ReturnValue)
+            Dim newFolders As List(Of SFile) = SFile.GetDirectories(Source,,, EDP.ReturnValue)
+
+            Dim obj As SFile = Nothing
+            Dim wSegment As String = MyWorkingPath.Segments.Last
+            Dim filesPredicate As Predicate(Of SFile) = Function(ByVal f As SFile) As Boolean
+                                                            If obj = f Or obj.Name = f.Name Then
+                                                                f.Delete(SFO.File, SFODelete.DeleteToRecycleBin, EDP.None)
+                                                                Return True
+                                                            Else
+                                                                Return False
+                                                            End If
+                                                        End Function
+            Dim foldersPredicate As Predicate(Of SFile) = Function(ByVal f As SFile) As Boolean
+                                                              Dim ls$ = f.Segments.Last
+                                                              If ls = obj.Segments.Last And Not ls = NewReleaseFolderName And Not ls = wSegment Then
+                                                                  f.Delete(SFO.Path, SFODelete.DeleteToRecycleBin, EDP.None)
+                                                                  Return True
+                                                              Else
+                                                                  Return False
+                                                              End If
+                                                          End Function
+
+            Dim getDestFile As Func(Of SFile, Boolean, SFile) = Function(ByVal f As SFile, ByVal isFolder As Boolean) As SFile
+                                                                    Dim ff As SFile = f
+                                                                    If isFolder Then
+                                                                        ff = $"{Destination.PathWithSeparator}{f.Segments.Last}\"
+                                                                    Else
+                                                                        ff.Path = Destination.Path
+                                                                    End If
+                                                                    Console.WriteLine(ff)
+                                                                    Return ff
+                                                                End Function
+            If newFiles.ListExists Then
+                If oldFiles.ListExists Then
+                    For Each obj In newFiles : oldFiles.RemoveAll(filesPredicate) : Next
+                End If
+                newFiles.ForEach(Sub(ff) SFile.Move(ff, getDestFile(ff, False), SFO.File, True, SFODelete.DeleteToRecycleBin, EDP.None))
+            End If
+
+            If newFolders.ListExists Then
+                If oldFolders.ListExists Then
+                    For Each obj In newFolders : oldFolders.RemoveAll(foldersPredicate) : Next
+                End If
+                newFolders.ForEach(Sub(ff) If Not ff.Segments.Last = wSegment Then _
+                                              SFile.Move(ff, getDestFile(ff, True), SFO.Path, True, SFODelete.DeleteToRecycleBin, EDP.None))
+            End If
+
+            Console.WriteLine("Files updated")
+            Return True
+        Catch
+            Return False
+        End Try
+    End Function
+    Private Function ActiveProcessesExist() As Boolean
+        Try
+            Return Process.GetProcesses.Any(Function(p) ProcessNames.Contains(p.ProcessName) And Not p.Id = MyProcessID)
+        Catch
+            Return True
+        End Try
+    End Function
+    Private Structure GitRelease
+        Friend URL As String
+        Friend Name As String
+        Friend Version As Version
+    End Structure
+    Private Function GetGitRelease() As GitRelease
+        Try
+            Dim nameEnd$ = $"_x{IIf(Environment.Is64BitProcess, 64, 86)}.zip"
+            Dim name$, relName$, relTag$
+
+            Using resp As New Responser With {.Accept = "application/vnd.github.v3+json"}
+                Dim r$ = resp.GetResponse("https://api.github.com/repos/AAndyProgram/SCrawler/releases",, EDP.ReturnValue)
+                If Not r.IsEmptyString Then
+                    Dim getver As Func(Of String, Version) = Function(ByVal input As String) As Version
+                                                                 Try
+                                                                     If Not input.IsEmptyString Then
+                                                                         If input.ToLower.StartsWith("scrawler") Then
+                                                                             Return New Version(input.Split("_")(1))
+                                                                         Else
+                                                                             Return New Version(input)
+                                                                         End If
+                                                                     End If
+                                                                 Catch
+                                                                 End Try
+                                                                 Return Nothing
+                                                             End Function
+                    Using j As EContainer = JsonDocument.Parse(r, EDP.ReturnValue)
+                        If j.ListExists Then
+                            With j.FirstOrDefault(Function(e) Not e.Value("draft").FromXML(Of Boolean) And Not e.Value("prerelease").FromXML(Of Boolean))
+                                If .ListExists Then
+                                    relName = .Value("name")
+                                    relTag = .Value("tag_name")
+                                    With .Item("assets")
+                                        If .ListExists Then
+                                            For Each asset As EContainer In .Self
+                                                name = asset.Value("name")
+                                                If Not name.IsEmptyString AndAlso name.EndsWith(nameEnd) Then _
+                                                   Return New GitRelease With {
+                                                    .Name = name,
+                                                    .URL = asset.Value("browser_download_url"),
+                                                    .Version = getver(name).IfNullOrEmpty(getver(relName).IfNullOrEmpty(getver(relTag)))}
+                                            Next
+                                        End If
+                                    End With
+                                End If
+                            End With
+                        End If
+                    End Using
+                End If
+            End Using
+        Catch
+        End Try
+        Return Nothing
+    End Function
+End Module

SCrawler.Updater/My Project/Application.Designer.vb

@@ -0,0 +1,13 @@
+'------------------------------------------------------------------------------
+' <auto-generated>
+'     This code was generated by a tool.
+'     Runtime Version:4.0.30319.42000
+'
+'     Changes to this file may cause incorrect behavior and will be lost if
+'     the code is regenerated.
+' </auto-generated>
+'------------------------------------------------------------------------------
+
+Option Strict On
+Option Explicit On
+

SCrawler.Updater/My Project/Application.myapp

@@ -0,0 +1,10 @@
+<?xml version="1.0" encoding="utf-8"?>
+<MyApplicationData xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xmlns:xsd="http://www.w3.org/2001/XMLSchema">
+  <MySubMain>false</MySubMain>
+  <SingleInstance>false</SingleInstance>
+  <ShutdownMode>0</ShutdownMode>
+  <EnableVisualStyles>true</EnableVisualStyles>
+  <AuthenticationMode>0</AuthenticationMode>
+  <ApplicationType>2</ApplicationType>
+  <SaveMySettingsOnExit>true</SaveMySettingsOnExit>
+</MyApplicationData>

SCrawler.Updater/My Project/AssemblyInfo.vb

@@ -0,0 +1,37 @@
+Imports System.Resources
+Imports System
+Imports System.Reflection
+Imports System.Runtime.InteropServices
+
+' General Information about an assembly is controlled through the following
+' set of attributes. Change these attribute values to modify the information
+' associated with an assembly.
+
+' Review the values of the assembly attributes
+
+<Assembly: AssemblyTitle("SCrawler updater")>
+<Assembly: AssemblyDescription("SCrawler updater")>
+<Assembly: AssemblyCompany("AndyProgram")>
+<Assembly: AssemblyProduct("SCrawler.Updater")>
+<Assembly: AssemblyCopyright("Copyright © 2024")>
+<Assembly: AssemblyTrademark("AndyProgram")>
+
+<Assembly: ComVisible(False)>
+
+'The following GUID is for the ID of the typelib if this project is exposed to COM
+<Assembly: Guid("df008b29-ad5e-4271-acfe-650396d15c40")>
+
+' Version information for an assembly consists of the following four values:
+'
+'      Major Version
+'      Minor Version
+'      Build Number
+'      Revision
+'
+' You can specify all the values or you can default the Build and Revision Numbers
+' by using the '*' as shown below:
+' <Assembly: AssemblyVersion("1.0.*")>
+
+<Assembly: AssemblyVersion("2023.12.7.0")>
+<Assembly: AssemblyFileVersion("2023.12.7.0")>
+<Assembly: NeutralResourcesLanguage("en")>

SCrawler.Updater/My Project/Resources.Designer.vb

@@ -0,0 +1,73 @@
+'------------------------------------------------------------------------------
+' <auto-generated>
+'     This code was generated by a tool.
+'     Runtime Version:4.0.30319.42000
+'
+'     Changes to this file may cause incorrect behavior and will be lost if
+'     the code is regenerated.
+' </auto-generated>
+'------------------------------------------------------------------------------
+
+Option Strict On
+Option Explicit On
+
+Imports System
+
+Namespace My.Resources
+    
+    'This class was auto-generated by the StronglyTypedResourceBuilder
+    'class via a tool like ResGen or Visual Studio.
+    'To add or remove a member, edit your .ResX file then rerun ResGen
+    'with the /str option, or rebuild your VS project.
+    '''<summary>
+    '''  A strongly-typed resource class, for looking up localized strings, etc.
+    '''</summary>
+    <Global.System.CodeDom.Compiler.GeneratedCodeAttribute("System.Resources.Tools.StronglyTypedResourceBuilder", "16.0.0.0"),  _
+     Global.System.Diagnostics.DebuggerNonUserCodeAttribute(),  _
+     Global.System.Runtime.CompilerServices.CompilerGeneratedAttribute(),  _
+     Global.Microsoft.VisualBasic.HideModuleNameAttribute()>  _
+    Friend Module Resources
+        
+        Private resourceMan As Global.System.Resources.ResourceManager
+        
+        Private resourceCulture As Global.System.Globalization.CultureInfo
+        
+        '''<summary>
+        '''  Returns the cached ResourceManager instance used by this class.
+        '''</summary>
+        <Global.System.ComponentModel.EditorBrowsableAttribute(Global.System.ComponentModel.EditorBrowsableState.Advanced)>  _
+        Friend ReadOnly Property ResourceManager() As Global.System.Resources.ResourceManager
+            Get
+                If Object.ReferenceEquals(resourceMan, Nothing) Then
+                    Dim temp As Global.System.Resources.ResourceManager = New Global.System.Resources.ResourceManager("SCrawler.Resources", GetType(Resources).Assembly)
+                    resourceMan = temp
+                End If
+                Return resourceMan
+            End Get
+        End Property
+        
+        '''<summary>
+        '''  Overrides the current thread's CurrentUICulture property for all
+        '''  resource lookups using this strongly typed resource class.
+        '''</summary>
+        <Global.System.ComponentModel.EditorBrowsableAttribute(Global.System.ComponentModel.EditorBrowsableState.Advanced)>  _
+        Friend Property Culture() As Global.System.Globalization.CultureInfo
+            Get
+                Return resourceCulture
+            End Get
+            Set
+                resourceCulture = value
+            End Set
+        End Property
+        
+        '''<summary>
+        '''  Looks up a localized resource of type System.Drawing.Icon similar to (Icon).
+        '''</summary>
+        Friend ReadOnly Property RainbowIcon_48() As System.Drawing.Icon
+            Get
+                Dim obj As Object = ResourceManager.GetObject("RainbowIcon_48", resourceCulture)
+                Return CType(obj,System.Drawing.Icon)
+            End Get
+        End Property
+    End Module
+End Namespace

SCrawler.Updater/My Project/Resources.resx

@@ -0,0 +1,124 @@
+<?xml version="1.0" encoding="utf-8"?>
+<root>
+  <!-- 
+    Microsoft ResX Schema 
+    
+    Version 2.0
+    
+    The primary goals of this format is to allow a simple XML format 
+    that is mostly human readable. The generation and parsing of the 
+    various data types are done through the TypeConverter classes 
+    associated with the data types.
+    
+    Example:
+    
+    ... ado.net/XML headers & schema ...
+    <resheader name="resmimetype">text/microsoft-resx</resheader>
+    <resheader name="version">2.0</resheader>
+    <resheader name="reader">System.Resources.ResXResourceReader, System.Windows.Forms, ...</resheader>
+    <resheader name="writer">System.Resources.ResXResourceWriter, System.Windows.Forms, ...</resheader>
+    <data name="Name1"><value>this is my long string</value><comment>this is a comment</comment></data>
+    <data name="Color1" type="System.Drawing.Color, System.Drawing">Blue</data>
+    <data name="Bitmap1" mimetype="application/x-microsoft.net.object.binary.base64">
+        <value>[base64 mime encoded serialized .NET Framework object]</value>
+    </data>
+    <data name="Icon1" type="System.Drawing.Icon, System.Drawing" mimetype="application/x-microsoft.net.object.bytearray.base64">
+        <value>[base64 mime encoded string representing a byte array form of the .NET Framework object]</value>
+        <comment>This is a comment</comment>
+    </data>
+                
+    There are any number of "resheader" rows that contain simple 
+    name/value pairs.
+    
+    Each data row contains a name, and value. The row also contains a 
+    type or mimetype. Type corresponds to a .NET class that support 
+    text/value conversion through the TypeConverter architecture. 
+    Classes that don't support this are serialized and stored with the 
+    mimetype set.
+    
+    The mimetype is used for serialized objects, and tells the 
+    ResXResourceReader how to depersist the object. This is currently not 
+    extensible. For a given mimetype the value must be set accordingly:
+    
+    Note - application/x-microsoft.net.object.binary.base64 is the format 
+    that the ResXResourceWriter will generate, however the reader can 
+    read any of the formats listed below.
+    
+    mimetype: application/x-microsoft.net.object.binary.base64
+    value   : The object must be serialized with 
+            : System.Runtime.Serialization.Formatters.Binary.BinaryFormatter
+            : and then encoded with base64 encoding.
+    
+    mimetype: application/x-microsoft.net.object.soap.base64
+    value   : The object must be serialized with 
+            : System.Runtime.Serialization.Formatters.Soap.SoapFormatter
+            : and then encoded with base64 encoding.
+
+    mimetype: application/x-microsoft.net.object.bytearray.base64
+    value   : The object must be serialized into a byte array 
+            : using a System.ComponentModel.TypeConverter
+            : and then encoded with base64 encoding.
+    -->
+  <xsd:schema id="root" xmlns="" xmlns:xsd="http://www.w3.org/2001/XMLSchema" xmlns:msdata="urn:schemas-microsoft-com:xml-msdata">
+    <xsd:import namespace="http://www.w3.org/XML/1998/namespace" />
+    <xsd:element name="root" msdata:IsDataSet="true">
+      <xsd:complexType>
+        <xsd:choice maxOccurs="unbounded">
+          <xsd:element name="metadata">
+            <xsd:complexType>
+              <xsd:sequence>
+                <xsd:element name="value" type="xsd:string" minOccurs="0" />
+              </xsd:sequence>
+              <xsd:attribute name="name" use="required" type="xsd:string" />
+              <xsd:attribute name="type" type="xsd:string" />
+              <xsd:attribute name="mimetype" type="xsd:string" />
+              <xsd:attribute ref="xml:space" />
+            </xsd:complexType>
+          </xsd:element>
+          <xsd:element name="assembly">
+            <xsd:complexType>
+              <xsd:attribute name="alias" type="xsd:string" />
+              <xsd:attribute name="name" type="xsd:string" />
+            </xsd:complexType>
+          </xsd:element>
+          <xsd:element name="data">
+            <xsd:complexType>
+              <xsd:sequence>
+                <xsd:element name="value" type="xsd:string" minOccurs="0" msdata:Ordinal="1" />
+                <xsd:element name="comment" type="xsd:string" minOccurs="0" msdata:Ordinal="2" />
+              </xsd:sequence>
+              <xsd:attribute name="name" type="xsd:string" use="required" msdata:Ordinal="1" />
+              <xsd:attribute name="type" type="xsd:string" msdata:Ordinal="3" />
+              <xsd:attribute name="mimetype" type="xsd:string" msdata:Ordinal="4" />
+              <xsd:attribute ref="xml:space" />
+            </xsd:complexType>
+          </xsd:element>
+          <xsd:element name="resheader">
+            <xsd:complexType>
+              <xsd:sequence>
+                <xsd:element name="value" type="xsd:string" minOccurs="0" msdata:Ordinal="1" />
+              </xsd:sequence>
+              <xsd:attribute name="name" type="xsd:string" use="required" />
+            </xsd:complexType>
+          </xsd:element>
+        </xsd:choice>
+      </xsd:complexType>
+    </xsd:element>
+  </xsd:schema>
+  <resheader name="resmimetype">
+    <value>text/microsoft-resx</value>
+  </resheader>
+  <resheader name="version">
+    <value>2.0</value>
+  </resheader>
+  <resheader name="reader">
+    <value>System.Resources.ResXResourceReader, System.Windows.Forms, Version=4.0.0.0, Culture=neutral, PublicKeyToken=b77a5c561934e089</value>
+  </resheader>
+  <resheader name="writer">
+    <value>System.Resources.ResXResourceWriter, System.Windows.Forms, Version=4.0.0.0, Culture=neutral, PublicKeyToken=b77a5c561934e089</value>
+  </resheader>
+  <assembly alias="System.Windows.Forms" name="System.Windows.Forms, Version=4.0.0.0, Culture=neutral, PublicKeyToken=b77a5c561934e089" />
+  <data name="RainbowIcon_48" type="System.Resources.ResXFileRef, System.Windows.Forms">
+    <value>..\Content\Icons\RainbowIcon_48.ico;System.Drawing.Icon, System.Drawing, Version=4.0.0.0, Culture=neutral, PublicKeyToken=b03f5f7f11d50a3a</value>
+  </data>
+</root>

SCrawler.Updater/My Project/Settings.Designer.vb

@@ -0,0 +1,73 @@
+'------------------------------------------------------------------------------
+' <auto-generated>
+'     This code was generated by a tool.
+'     Runtime Version:4.0.30319.42000
+'
+'     Changes to this file may cause incorrect behavior and will be lost if
+'     the code is regenerated.
+' </auto-generated>
+'------------------------------------------------------------------------------
+
+Option Strict On
+Option Explicit On
+
+
+Namespace My
+    
+    <Global.System.Runtime.CompilerServices.CompilerGeneratedAttribute(),  _
+     Global.System.CodeDom.Compiler.GeneratedCodeAttribute("Microsoft.VisualStudio.Editors.SettingsDesigner.SettingsSingleFileGenerator", "16.10.0.0"),  _
+     Global.System.ComponentModel.EditorBrowsableAttribute(Global.System.ComponentModel.EditorBrowsableState.Advanced)>  _
+    Partial Friend NotInheritable Class MySettings
+        Inherits Global.System.Configuration.ApplicationSettingsBase
+        
+        Private Shared defaultInstance As MySettings = CType(Global.System.Configuration.ApplicationSettingsBase.Synchronized(New MySettings()),MySettings)
+        
+#Region "My.Settings Auto-Save Functionality"
+#If _MyType = "WindowsForms" Then
+    Private Shared addedHandler As Boolean
+
+    Private Shared addedHandlerLockObject As New Object
+
+    <Global.System.Diagnostics.DebuggerNonUserCodeAttribute(), Global.System.ComponentModel.EditorBrowsableAttribute(Global.System.ComponentModel.EditorBrowsableState.Advanced)> _
+    Private Shared Sub AutoSaveSettings(sender As Global.System.Object, e As Global.System.EventArgs)
+        If My.Application.SaveMySettingsOnExit Then
+            My.Settings.Save()
+        End If
+    End Sub
+#End If
+#End Region
+        
+        Public Shared ReadOnly Property [Default]() As MySettings
+            Get
+                
+#If _MyType = "WindowsForms" Then
+               If Not addedHandler Then
+                    SyncLock addedHandlerLockObject
+                        If Not addedHandler Then
+                            AddHandler My.Application.Shutdown, AddressOf AutoSaveSettings
+                            addedHandler = True
+                        End If
+                    End SyncLock
+                End If
+#End If
+                Return defaultInstance
+            End Get
+        End Property
+    End Class
+End Namespace
+
+Namespace My
+    
+    <Global.Microsoft.VisualBasic.HideModuleNameAttribute(),  _
+     Global.System.Diagnostics.DebuggerNonUserCodeAttribute(),  _
+     Global.System.Runtime.CompilerServices.CompilerGeneratedAttribute()>  _
+    Friend Module MySettingsProperty
+        
+        <Global.System.ComponentModel.Design.HelpKeywordAttribute("My.Settings")>  _
+        Friend ReadOnly Property Settings() As Global.SCrawler.My.MySettings
+            Get
+                Return Global.SCrawler.My.MySettings.Default
+            End Get
+        End Property
+    End Module
+End Namespace

SCrawler.Updater/My Project/Settings.settings

@@ -0,0 +1,7 @@
+<?xml version='1.0' encoding='utf-8'?>
+<SettingsFile xmlns="http://schemas.microsoft.com/VisualStudio/2004/01/settings" CurrentProfile="(Default)" UseMySettingsClassName="true">
+  <Profiles>
+    <Profile Name="(Default)" />
+  </Profiles>
+  <Settings />
+</SettingsFile>

SCrawler.Updater/My Project/app.manifest

@@ -0,0 +1,79 @@
+<?xml version="1.0" encoding="utf-8"?>
+<assembly manifestVersion="1.0" xmlns="urn:schemas-microsoft-com:asm.v1">
+  <assemblyIdentity version="1.0.0.0" name="MyApplication.app"/>
+  <trustInfo xmlns="urn:schemas-microsoft-com:asm.v2">
+    <security>
+      <requestedPrivileges xmlns="urn:schemas-microsoft-com:asm.v3">
+        <!-- UAC Manifest Options
+             If you want to change the Windows User Account Control level replace the 
+             requestedExecutionLevel node with one of the following.
+
+        <requestedExecutionLevel  level="asInvoker" uiAccess="false" />
+        <requestedExecutionLevel  level="requireAdministrator" uiAccess="false" />
+        <requestedExecutionLevel  level="highestAvailable" uiAccess="false" />
+
+            Specifying requestedExecutionLevel element will disable file and registry virtualization. 
+            Remove this element if your application requires this virtualization for backwards
+            compatibility.
+        -->
+        <requestedExecutionLevel level="asInvoker" uiAccess="false" />
+      </requestedPrivileges>
+    </security>
+  </trustInfo>
+
+  <compatibility xmlns="urn:schemas-microsoft-com:compatibility.v1">
+    <application>
+      <!-- A list of the Windows versions that this application has been tested on
+           and is designed to work with. Uncomment the appropriate elements
+           and Windows will automatically select the most compatible environment. -->
+
+      <!-- Windows Vista -->
+      <!--<supportedOS Id="{e2011457-1546-43c5-a5fe-008deee3d3f0}" />-->
+
+      <!-- Windows 7 -->
+      <!--<supportedOS Id="{35138b9a-5d96-4fbd-8e2d-a2440225f93a}" />-->
+
+      <!-- Windows 8 -->
+      <!--<supportedOS Id="{4a2f28e3-53b9-4441-ba9c-d69d4a4a6e38}" />-->
+
+      <!-- Windows 8.1 -->
+      <!--<supportedOS Id="{1f676c76-80e1-4239-95bb-83d0f6d0da78}" />-->
+
+      <!-- Windows 10 -->
+      <!--<supportedOS Id="{8e0f7a12-bfb3-4fe8-b9a5-48fd50a15a9a}" />-->
+
+    </application>
+  </compatibility>
+
+  <!-- Indicates that the application is DPI-aware and will not be automatically scaled by Windows at higher
+       DPIs. Windows Presentation Foundation (WPF) applications are automatically DPI-aware and do not need 
+       to opt in. Windows Forms applications targeting .NET Framework 4.6 that opt into this setting, should 
+       also set the 'EnableWindowsFormsHighDpiAutoResizing' setting to 'true' in their app.config. 
+       
+       Makes the application long-path aware. See https://docs.microsoft.com/windows/win32/fileio/maximum-file-path-limitation -->
+  <!--
+  <application xmlns="urn:schemas-microsoft-com:asm.v3">
+    <windowsSettings>
+      <dpiAware xmlns="http://schemas.microsoft.com/SMI/2005/WindowsSettings">true</dpiAware>
+      <longPathAware xmlns="http://schemas.microsoft.com/SMI/2016/WindowsSettings">true</longPathAware>
+    </windowsSettings>
+  </application>
+  -->
+
+  <!-- Enable themes for Windows common controls and dialogs (Windows XP and later) -->
+  <!--
+  <dependency>
+    <dependentAssembly>
+      <assemblyIdentity
+          type="win32"
+          name="Microsoft.Windows.Common-Controls"
+          version="6.0.0.0"
+          processorArchitecture="*"
+          publicKeyToken="6595b64144ccf1df"
+          language="*"
+        />
+    </dependentAssembly>
+  </dependency>
+  -->
+
+</assembly>

SCrawler.Updater/SCrawler.Updater.vbproj

@@ -0,0 +1,173 @@
+<?xml version="1.0" encoding="utf-8"?>
+<Project ToolsVersion="15.0" xmlns="http://schemas.microsoft.com/developer/msbuild/2003">
+  <Import Project="$(MSBuildExtensionsPath)\$(MSBuildToolsVersion)\Microsoft.Common.props" Condition="Exists('$(MSBuildExtensionsPath)\$(MSBuildToolsVersion)\Microsoft.Common.props')" />
+  <PropertyGroup>
+    <Configuration Condition=" '$(Configuration)' == '' ">Debug</Configuration>
+    <Platform Condition=" '$(Platform)' == '' ">AnyCPU</Platform>
+    <ProjectGuid>{71263EEE-E25F-44DD-B0A9-F09047C0BEEA}</ProjectGuid>
+    <OutputType>Exe</OutputType>
+    <StartupObject>Sub Main</StartupObject>
+    <RootNamespace>SCrawler</RootNamespace>
+    <AssemblyName>Updater</AssemblyName>
+    <FileAlignment>512</FileAlignment>
+    <MyType>Console</MyType>
+    <TargetFrameworkVersion>v4.6.1</TargetFrameworkVersion>
+    <AutoGenerateBindingRedirects>true</AutoGenerateBindingRedirects>
+    <Deterministic>true</Deterministic>
+  </PropertyGroup>
+  <PropertyGroup Condition=" '$(Configuration)|$(Platform)' == 'Debug|AnyCPU' ">
+    <PlatformTarget>AnyCPU</PlatformTarget>
+    <DebugSymbols>true</DebugSymbols>
+    <DebugType>full</DebugType>
+    <DefineDebug>true</DefineDebug>
+    <DefineTrace>true</DefineTrace>
+    <OutputPath>bin\Debug\Updater\</OutputPath>
+    <DocumentationFile>
+    </DocumentationFile>
+    <NoWarn>42016,41999,42017,42018,42019,42032,42036,42020,42021,42022</NoWarn>
+    <Prefer32Bit>false</Prefer32Bit>
+  </PropertyGroup>
+  <PropertyGroup Condition=" '$(Configuration)|$(Platform)' == 'Release|AnyCPU' ">
+    <PlatformTarget>AnyCPU</PlatformTarget>
+    <DebugType>pdbonly</DebugType>
+    <DefineDebug>false</DefineDebug>
+    <DefineTrace>true</DefineTrace>
+    <Optimize>true</Optimize>
+    <OutputPath>bin\Release\Updater\</OutputPath>
+    <DocumentationFile>
+    </DocumentationFile>
+    <NoWarn>42016,41999,42017,42018,42019,42032,42036,42020,42021,42022</NoWarn>
+    <Prefer32Bit>false</Prefer32Bit>
+  </PropertyGroup>
+  <PropertyGroup>
+    <OptionExplicit>On</OptionExplicit>
+  </PropertyGroup>
+  <PropertyGroup>
+    <OptionCompare>Binary</OptionCompare>
+  </PropertyGroup>
+  <PropertyGroup>
+    <OptionStrict>Off</OptionStrict>
+  </PropertyGroup>
+  <PropertyGroup>
+    <OptionInfer>On</OptionInfer>
+  </PropertyGroup>
+  <PropertyGroup>
+    <ApplicationIcon>Content\Icons\RainbowIcon_48.ico</ApplicationIcon>
+  </PropertyGroup>
+  <PropertyGroup>
+    <ApplicationManifest>My Project\app.manifest</ApplicationManifest>
+  </PropertyGroup>
+  <PropertyGroup Condition="'$(Configuration)|$(Platform)' == 'Debug|x64'">
+    <DebugSymbols>true</DebugSymbols>
+    <DefineDebug>true</DefineDebug>
+    <DefineTrace>true</DefineTrace>
+    <OutputPath>bin\x64\Debug\Updater\</OutputPath>
+    <NoWarn>42016,41999,42017,42018,42019,42032,42036,42020,42021,42022</NoWarn>
+    <DebugType>full</DebugType>
+    <PlatformTarget>x64</PlatformTarget>
+  </PropertyGroup>
+  <PropertyGroup Condition="'$(Configuration)|$(Platform)' == 'Release|x64'">
+    <DefineTrace>true</DefineTrace>
+    <OutputPath>bin\x64\Release\Updater\</OutputPath>
+    <Optimize>true</Optimize>
+    <NoWarn>42016,41999,42017,42018,42019,42032,42036,42020,42021,42022</NoWarn>
+    <DebugType>pdbonly</DebugType>
+    <PlatformTarget>x64</PlatformTarget>
+  </PropertyGroup>
+  <PropertyGroup Condition="'$(Configuration)|$(Platform)' == 'Debug|x86'">
+    <DebugSymbols>true</DebugSymbols>
+    <DefineDebug>true</DefineDebug>
+    <DefineTrace>true</DefineTrace>
+    <OutputPath>bin\x86\Debug\Updater\</OutputPath>
+    <NoWarn>42016,41999,42017,42018,42019,42032,42036,42020,42021,42022</NoWarn>
+    <DebugType>full</DebugType>
+    <PlatformTarget>x86</PlatformTarget>
+  </PropertyGroup>
+  <PropertyGroup Condition="'$(Configuration)|$(Platform)' == 'Release|x86'">
+    <DefineTrace>true</DefineTrace>
+    <OutputPath>bin\x86\Release\Updater\</OutputPath>
+    <Optimize>true</Optimize>
+    <NoWarn>42016,41999,42017,42018,42019,42032,42036,42020,42021,42022</NoWarn>
+    <DebugType>pdbonly</DebugType>
+    <PlatformTarget>x86</PlatformTarget>
+  </PropertyGroup>
+  <ItemGroup>
+    <Reference Include="System" />
+    <Reference Include="System.Data" />
+    <Reference Include="System.Deployment" />
+    <Reference Include="System.Drawing" />
+    <Reference Include="System.IO.Compression" />
+    <Reference Include="System.IO.Compression.FileSystem" />
+    <Reference Include="System.Xml" />
+    <Reference Include="System.Core" />
+    <Reference Include="System.Xml.Linq" />
+    <Reference Include="System.Data.DataSetExtensions" />
+    <Reference Include="System.Net.Http" />
+  </ItemGroup>
+  <ItemGroup>
+    <Import Include="Microsoft.VisualBasic" />
+    <Import Include="System" />
+    <Import Include="System.Collections" />
+    <Import Include="System.Collections.Generic" />
+    <Import Include="System.Data" />
+    <Import Include="System.Diagnostics" />
+    <Import Include="System.Linq" />
+    <Import Include="System.Xml.Linq" />
+    <Import Include="System.Threading.Tasks" />
+  </ItemGroup>
+  <ItemGroup>
+    <Compile Include="MainMod.vb" />
+    <Compile Include="My Project\AssemblyInfo.vb" />
+    <Compile Include="My Project\Application.Designer.vb">
+      <AutoGen>True</AutoGen>
+      <DependentUpon>Application.myapp</DependentUpon>
+      <DesignTime>True</DesignTime>
+    </Compile>
+    <Compile Include="My Project\Resources.Designer.vb">
+      <AutoGen>True</AutoGen>
+      <DesignTime>True</DesignTime>
+      <DependentUpon>Resources.resx</DependentUpon>
+    </Compile>
+    <Compile Include="My Project\Settings.Designer.vb">
+      <AutoGen>True</AutoGen>
+      <DependentUpon>Settings.settings</DependentUpon>
+      <DesignTimeSharedInput>True</DesignTimeSharedInput>
+    </Compile>
+  </ItemGroup>
+  <ItemGroup>
+    <EmbeddedResource Include="My Project\Resources.resx">
+      <Generator>VbMyResourcesResXFileCodeGenerator</Generator>
+      <LastGenOutput>Resources.Designer.vb</LastGenOutput>
+      <CustomToolNamespace>My.Resources</CustomToolNamespace>
+      <SubType>Designer</SubType>
+    </EmbeddedResource>
+  </ItemGroup>
+  <ItemGroup>
+    <None Include=".editorconfig" />
+    <None Include="My Project\app.manifest" />
+    <None Include="My Project\Application.myapp">
+      <Generator>MyApplicationCodeGenerator</Generator>
+      <LastGenOutput>Application.Designer.vb</LastGenOutput>
+    </None>
+    <None Include="My Project\Settings.settings">
+      <Generator>SettingsSingleFileGenerator</Generator>
+      <CustomToolNamespace>My</CustomToolNamespace>
+      <LastGenOutput>Settings.Designer.vb</LastGenOutput>
+    </None>
+    <None Include="App.config" />
+  </ItemGroup>
+  <ItemGroup>
+    <Content Include="Content\Icons\RainbowIcon_48.ico" />
+  </ItemGroup>
+  <ItemGroup>
+    <ProjectReference Include="..\..\..\MyUtilities\PersonalUtilities\PersonalUtilities.vbproj">
+      <Project>{8405896b-2685-4916-bc93-1fb514c323a9}</Project>
+      <Name>PersonalUtilities</Name>
+    </ProjectReference>
+    <ProjectReference Include="..\SCrawler.Shared\SCrawler.Shared.vbproj">
+      <Project>{dc634700-24c7-42dd-bf8f-87e6cc54e625}</Project>
+      <Name>SCrawler.Shared</Name>
+    </ProjectReference>
+  </ItemGroup>
+  <Import Project="$(MSBuildToolsPath)\Microsoft.VisualBasic.targets" />
+</Project>

SCrawler.YouTube/.editorconfig

@@ -1,3 +1,3 @@
 [*.vb]
 # Modifier preferences
-file_header_template = Copyright (C) 2023  Andy https://github.com/AAndyProgram\nThis program is free software: you can redistribute it and/or modify\nit under the terms of the GNU General Public License as published by\nthe Free Software Foundation, either version 3 of the License, or\n(at your option) any later version.\n\nThis program is distributed in the hope that it will be useful,\nbut WITHOUT ANY WARRANTY; without even the implied warranty of\nMERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the\nGNU General Public License for more details.\n\nYou should have received a copy of the GNU General Public License\nalong with this program.  If not, see <https://www.gnu.org/licenses/>
+file_header_template = Copyright (C) Andy https://github.com/AAndyProgram\nThis program is free software: you can redistribute it and/or modify\nit under the terms of the GNU General Public License as published by\nthe Free Software Foundation, either version 3 of the License, or\n(at your option) any later version.\n\nThis program is distributed in the hope that it will be useful,\nbut WITHOUT ANY WARRANTY; without even the implied warranty of\nMERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the\nGNU General Public License for more details.\n\nYou should have received a copy of the GNU General Public License\nalong with this program.  If not, see <https://www.gnu.org/licenses/>

SCrawler.YouTube/Base/Structures.vb

@@ -6,6 +6,10 @@
 '
 ' This program is distributed in the hope that it will be useful,
 ' but WITHOUT ANY WARRANTY
+Imports System.Drawing.Design
+Imports System.ComponentModel
+Imports PersonalUtilities.Tools.Grid.Attributes
+Imports PersonalUtilities.Tools.Grid.EnumObjects
 Namespace API.YouTube.Base
     Public Structure Thumbnail : Implements IIndexable, IComparable(Of Thumbnail)
         Public ID As String
@@ -24,8 +28,19 @@ Namespace API.YouTube.Base
     End Structure
     Public Structure Subtitles : Implements IIndexable, IComparable(Of Subtitles)
         Public ID As String
-        Public Name As String
+        Private _Name As String
+        Public Property Name As String
+            Get
+                Dim n$ = _Name.IfNullOrEmpty(ID)
+                If CC Then n &= " (CC)"
+                Return n
+            End Get
+            Set(ByVal NewName As String)
+                _Name = NewName
+            End Set
+        End Property
         Public Formats As String
+        Public CC As Boolean
         Public ReadOnly Property FullID As String
             Get
                 Return IIf(ID = "en", "en.*", ID)
@@ -47,9 +62,26 @@ Namespace API.YouTube.Base
         Channel = 2
         PlayList = 3
     End Enum
+    <Editor(GetType(EnumDropDownEditor), GetType(UITypeEditor)), Flags>
+    Public Enum YouTubeChannelTab As Integer
+        <EnumValue(IsNullValue:=True)>
+        All = 0
+        Videos = 1
+        Shorts = 3
+        Playlists = 10
+    End Enum
+    <Editor(GetType(EnumDropDownEditor), GetType(UITypeEditor))>
+    Public Enum Protocols As Integer
+        <EnumValue(ExcludeFromList:=True)>
+        Undefined = -1
+        Any = 0
+        https = 1
+        m3u8 = 2
+    End Enum
     Public Structure MediaObject : Implements IIndexable, IComparable(Of MediaObject)
         Public Type As Plugin.UserMediaTypes
         Public ID As String
+        Public ID_DRC As Boolean
         Public Extension As String
         Public Width As Integer
         Public Height As Integer
@@ -58,7 +90,18 @@ Namespace API.YouTube.Base
         ''' <summary>Kb</summary>
         Public Size As Double
         Public Codec As String
-        Public Info As String
+        Public Protocol As String
+        Public ReadOnly Property ProtocolType As Protocols
+            Get
+                If Not Protocol.IsEmptyString Then
+                    Select Case Protocol.StringToLower.StringTrim
+                        Case "http", "https" : Return Protocols.https
+                        Case "m3u8" : Return Protocols.m3u8
+                    End Select
+                End If
+                Return Protocols.Undefined
+            End Get
+        End Property
         Public URL As String
         Public Property Index As Integer Implements IIndexable.Index
         Private Function SetIndex(ByVal Obj As Object, ByVal Index As Integer) As Object Implements IIndexable.SetIndex
@@ -68,10 +111,14 @@ Namespace API.YouTube.Base
         End Function
         Private Function CompareTo(ByVal Other As MediaObject) As Integer Implements IComparable(Of MediaObject).CompareTo
             If Type = Other.Type Then
-                If Width.CompareTo(Other.Width) = 0 Then
-                    Return Size.CompareTo(Other.Size) * -1
+                If ID_DRC.CompareTo(Other.ID_DRC) = 0 Then
+                    If Width.CompareTo(Other.Width) = 0 Then
+                        Return Size.CompareTo(Other.Size) * -1
+                    Else
+                        Return Width.CompareTo(Other.Width) * -1
+                    End If
                 Else
-                    Return Width.CompareTo(Other.Width) * -1
+                    Return ID_DRC.CompareTo(Other.ID_DRC)
                 End If
             Else
                 Return CInt(Type).CompareTo(CInt(Other.Type))

SCrawler.YouTube/Base/YouTubeFunctions.vb

@@ -20,22 +20,81 @@ Namespace API.YouTube.Base
         Public Const UrlTypePattern As String = "(?<=https?://[^/]*?youtube.com/)((@|[^\?/&]+))([/\?]{0,1}(list=|v=|)([^\?/&]*))(?=(\S+|\Z|))"
         Private Sub New()
         End Sub
+        Public Shared Function StandardizeURL(ByVal URL As String) As String
+            Try
+                Dim isMusic As Boolean = False, isShorts As Boolean = False
+                If Info_GetUrlType(URL, isMusic, isShorts) = YouTubeMediaType.Single Then
+                    If Not isMusic And Not isShorts Then
+                        Dim videoOptionRegex As RParams = RParams.DMS("[\?&]v=([^\?&]+)", 1, EDP.ReturnValue)
+                        Dim data As List(Of String) = RegexReplace(URL, RParams.DMS(UrlTypePattern, 0, RegexReturn.ListByMatch, EDP.ReturnValue))
+                        Dim val$ = String.Empty
+                        If data.ListExists Then
+                            For Each d$ In data
+                                val = RegexReplace(d, videoOptionRegex)
+                                If Not val.IsEmptyString Then Exit For
+                            Next
+                            data.Clear()
+                        End If
+                        If Not val.IsEmptyString Then Return $"https://www.youtube.com/watch?v={val}"
+                    End If
+                End If
+                Return URL
+            Catch ex As Exception
+                Return URL
+            End Try
+        End Function
+        Public Shared Function StandardizeURL_Channel(ByVal URL As String, Optional ByVal Process As Boolean = True) As String
+            Try
+                Dim ct As YouTubeChannelTab = YouTubeChannelTab.All
+                Dim isMusic As Boolean = False
+                If Process AndAlso Info_GetUrlType(URL, isMusic,,,, ct) = YouTubeMediaType.Channel AndAlso Not isMusic Then
+                    If Not ct = YouTubeChannelTab.All Then
+                        Dim rValue$ = String.Empty
+                        Select Case ct
+                            Case YouTubeChannelTab.Videos : rValue = "/videos"
+                            Case YouTubeChannelTab.Shorts : rValue = "/shorts"
+                            Case YouTubeChannelTab.Playlists : rValue = "/playlists"
+                        End Select
+                        If Not rValue.IsEmptyString Then
+                            Dim startIndx% = InStr(URL, rValue)
+                            If startIndx > 0 Then URL = URL.Remove(startIndx - 1)
+                        End If
+                    End If
+                End If
+                Return URL
+            Catch ex As Exception
+                Return URL
+            End Try
+        End Function
         Public Shared Function IsMyUrl(ByVal URL As String) As Boolean
             Return Not Info_GetUrlType(URL) = YouTubeMediaType.Undefined
         End Function
-        Public Shared Function Info_GetUrlType(ByVal URL As String, Optional ByRef IsMusic As Boolean = False,
-                                               Optional ByRef IsChannelUser As Boolean = False, Optional ByRef Id As String = Nothing) As YouTubeMediaType
+        Public Shared Function Info_GetUrlType(ByVal URL As String, Optional ByRef IsMusic As Boolean = False, Optional ByRef IsShorts As Boolean = False,
+                                               Optional ByRef IsChannelUser As Boolean = False, Optional ByRef Id As String = Nothing,
+                                               Optional ByRef ChannelOptions As YouTubeChannelTab = YouTubeChannelTab.All) As YouTubeMediaType
             If Not URL.IsEmptyString Then
                 IsMusic = URL.Contains("music.youtube.com")
                 IsChannelUser = False
+                IsShorts = False
                 Dim data As List(Of String) = RegexReplace(URL, RParams.DMS(UrlTypePattern, 0, RegexReturn.ListByMatch, EDP.ReturnValue))
                 If data.ListExists Then
                     If data.Count >= 6 Then Id = data(5)
                     If data.Count >= 3 And Not data(2).IsEmptyString Then
                         Select Case data(2).ToLower
                             Case "watch" : Return YouTubeMediaType.Single
+                            Case "shorts" : IsShorts = True : Return YouTubeMediaType.Single
                             Case "playlist" : Return YouTubeMediaType.PlayList
-                            Case UserChannelOption, "@" : IsChannelUser = data(2).ToLower = UserChannelOption : Return YouTubeMediaType.Channel
+                            Case UserChannelOption, "@"
+                                IsChannelUser = data(2).ToLower = UserChannelOption
+                                If data.Count > 6 Then
+                                    Select Case data(6).StringToLower.StringTrimStart("/")
+                                        Case "videos" : ChannelOptions = YouTubeChannelTab.Videos
+                                        Case "shorts" : ChannelOptions = YouTubeChannelTab.Shorts
+                                        Case "playlists" : ChannelOptions = YouTubeChannelTab.Playlists
+                                        Case Else : ChannelOptions = YouTubeChannelTab.All
+                                    End Select
+                                End If
+                                Return YouTubeMediaType.Channel
                         End Select
                     End If
                 End If
@@ -57,27 +116,25 @@ Namespace API.YouTube.Base
         ''' <exception cref="InvalidOperationException"></exception>
         Public Shared Function Parse(ByVal URL As String, Optional ByVal UseCookies As Boolean? = Nothing,
                                      Optional ByVal Token As Threading.CancellationToken = Nothing, Optional ByVal Progress As IMyProgress = Nothing,
-                                     Optional ByVal GetDefault As Boolean? = Nothing, Optional ByVal GetShorts As Boolean? = Nothing,
-                                     Optional ByVal DateAfter As Date? = Nothing, Optional ByVal DateBefore As Date? = Nothing) As IYouTubeMediaContainer
+                                     Optional ByVal DateAfter As Date? = Nothing, Optional ByVal DateBefore As Date? = Nothing,
+                                     Optional ByVal ChannelOption As YouTubeChannelTab? = Nothing, Optional ByVal UrlAsIs As Boolean = False) As IYouTubeMediaContainer
             If URL.IsEmptyString Then Throw New ArgumentNullException("URL", "URL cannot be null")
             If Not MyYouTubeSettings.YTDLP.Value.Exists Then Throw New IO.FileNotFoundException("Path to 'yt-dlp.exe' not set or program not found at destination", MyYouTubeSettings.YTDLP.Value.ToString)
             Dim urlOrig$ = URL
             URL = RegexReplace(URL, TrueUrlRegEx)
             If URL.IsEmptyString Then Throw New ArgumentNullException("URL", $"Can't get true URL from [{urlOrig}]")
-            Dim isMusic As Boolean = False
-            Dim objType As YouTubeMediaType = Info_GetUrlType(URL, isMusic)
+            Dim isMusic As Boolean = False, isShorts As Boolean = False
+            Dim channelTab As YouTubeChannelTab = YouTubeChannelTab.All
+            Dim objType As YouTubeMediaType = Info_GetUrlType(URL, isMusic, isShorts,,, channelTab)
+            If ChannelOption.HasValue Then channelTab = ChannelOption.Value
             If Not objType = YouTubeMediaType.Undefined Then
-                Dim __GetDefault As Boolean = If(GetDefault, True)
-                Dim __GetShorts As Boolean = If(GetShorts, True)
-                If isMusic Then __GetShorts = False
                 Dim container As IYouTubeMediaContainer
                 Dim pattern$ = "%(channel_id)s_%(id)s_%(playlist_index)s"
 
                 Select Case objType
                     Case YouTubeMediaType.Single
-                        __GetShorts = False
                         If isMusic Then container = New Track Else container = New Video
-                    Case YouTubeMediaType.PlayList : container = New PlayList : pattern = "%(playlist_index)s_%(id)s" : __GetShorts = False
+                    Case YouTubeMediaType.PlayList : container = New PlayList : pattern = "%(playlist_index)s_%(id)s"
                     Case YouTubeMediaType.Channel
                         container = New Channel
                         If isMusic Then pattern = "%(playlist_id)s/%(channel_id)s_%(id)s_%(playlist_index)s"
@@ -96,16 +153,16 @@ Namespace API.YouTube.Base
                 Dim useCookiesForce As Boolean = UseCookies.HasValue AndAlso UseCookies.Value AndAlso cookiesExists
                 If UseCookies.HasValue AndAlso UseCookies.Value Then
                     withCookieRequested = True
-                    result = Parse_Internal(URL, pattern, _CachePathDefault, True, YouTubeCookieNetscapeFile, DateAfter, DateBefore, __GetDefault, __GetShorts)
+                    result = Parse_Internal(URL, pattern, _CachePathDefault, True, YouTubeCookieNetscapeFile, DateAfter, DateBefore, objType, channelTab, isMusic, UrlAsIs)
                 End If
                 If Not result And Not withCookieRequested Then
-                    If Not UseCookies.HasValue OrElse Not UseCookies.Value Then result = Parse_Internal(URL, pattern, _CachePathDefault, False, YouTubeCookieNetscapeFile, DateAfter, DateBefore, __GetDefault, __GetShorts)
-                    If Not result And Not UseCookies.HasValue And cookiesExists Then result = Parse_Internal(URL, pattern, _CachePathDefault, True, YouTubeCookieNetscapeFile, DateAfter, DateBefore, __GetDefault, __GetShorts)
+                    If Not UseCookies.HasValue OrElse Not UseCookies.Value Then result = Parse_Internal(URL, pattern, _CachePathDefault, False, YouTubeCookieNetscapeFile, DateAfter, DateBefore, objType, channelTab, isMusic, UrlAsIs)
+                    If Not result And Not UseCookies.HasValue And cookiesExists Then result = Parse_Internal(URL, pattern, _CachePathDefault, True, YouTubeCookieNetscapeFile, DateAfter, DateBefore, objType, channelTab, isMusic, UrlAsIs)
                 End If
 
                 If result Then
                     container.Parse(Nothing, _CachePathDefault, isMusic, Token, Progress)
-                    If Not container.HasError Then container.URL = URL : Return container
+                    If Not container.HasError Then container.URL = URL : container.IsShorts = isShorts : Return container
                 End If
                 container.Dispose()
             End If
@@ -114,21 +171,40 @@ Namespace API.YouTube.Base
         Private Shared Function Parse_Internal(ByVal URL As String, ByVal OutputPattern As String, ByVal OutputPath As SFile,
                                                ByVal UseCookies As Boolean, ByVal CookiesFile As SFile,
                                                ByVal DateAfter As Date?, ByVal DateBefore As Date?,
-                                               ByVal GetDefault As Boolean, ByVal GetShorts As Boolean) As Boolean
+                                               ByVal ObjType As YouTubeMediaType, ByVal ChannelTab As YouTubeChannelTab,
+                                               ByVal IsMusic As Boolean, ByVal UrlAsIs As Boolean) As Boolean
             Try
-                Dim command$ = "yt-dlp --write-info-json --skip-download"
+                Dim command$ = $"{YTDLP_NAME} --write-info-json --skip-download"
                 command.StringAppend(GetCookiesCommand(UseCookies, CookiesFile), " ")
                 If DateAfter.HasValue Then command.StringAppend($"--dateafter {DateAfter.Value:yyyyMMdd}", " ")
                 If DateBefore.HasValue Then command.StringAppend($"--datebefore {DateBefore.Value:yyyyMMdd}", " ")
                 command.StringAppend("{0}" & $" -o ""{OutputPattern}""", " ")
+                '#If DEBUG Then
+                'Debug.WriteLine(String.Format(command, URL))
+                '#End If
+                Dim debugString As Func(Of String, String) = Function(ByVal input As String) As String
 #If DEBUG Then
-                Debug.WriteLine(String.Format(command, URL))
+                                                                 Debug.WriteLine(input)
 #End If
+                                                                 Return input
+                                                             End Function
                 Using batch As New BatchExecutor(True)
                     With batch
                         .CommandPermanent = BatchExecutor.GetDirectoryCommand(MyYouTubeSettings.YTDLP.Value)
-                        If GetDefault Then .Execute(String.Format(command, URL))
-                        If GetShorts Then .Execute(String.Format(command, $"{URL.StringTrimEnd("/")}/shorts"))
+                        If ObjType = YouTubeMediaType.Channel And Not IsMusic And Not UrlAsIs Then
+                            Dim ct As List(Of YouTubeChannelTab) = EnumExtract(Of YouTubeChannelTab)(ChannelTab,, True).ListIfNothing
+                            If ct.Count = 0 Then
+                                .Execute(debugString(String.Format(command, $"{URL.StringTrimEnd("/")}/videos")))
+                                .Execute(debugString(String.Format(command, $"{URL.StringTrimEnd("/")}/shorts")))
+                                .Execute(debugString(String.Format(command, $"{URL.StringTrimEnd("/")}/playlists")))
+                            Else
+                                If ct.Contains(YouTubeChannelTab.Videos) Then .Execute(debugString(String.Format(command, $"{URL.StringTrimEnd("/")}/videos")))
+                                If ct.Contains(YouTubeChannelTab.Shorts) Then .Execute(debugString(String.Format(command, $"{URL.StringTrimEnd("/")}/shorts")))
+                                If ct.Contains(YouTubeChannelTab.Playlists) Then .Execute(debugString(String.Format(command, $"{URL.StringTrimEnd("/")}/playlists")))
+                            End If
+                        Else
+                            .Execute(debugString(String.Format(command, URL)))
+                        End If
                     End With
                 End Using
                 Return SFile.GetFiles(OutputPath,, IO.SearchOption.AllDirectories, EDP.ReturnValue).Count > 0

SCrawler.YouTube/Base/YouTubeSettings.vb

@@ -15,6 +15,7 @@ Imports PersonalUtilities.Forms
 Imports PersonalUtilities.Functions.XML
 Imports PersonalUtilities.Functions.XML.Base
 Imports PersonalUtilities.Functions.XML.Objects
+Imports PersonalUtilities.Functions.XML.Attributes
 Imports PersonalUtilities.Functions.XML.Attributes.Specialized
 Imports PersonalUtilities.Tools
 Imports PersonalUtilities.Tools.Grid.Base
@@ -34,13 +35,39 @@ Namespace API.YouTube.Base
         <Browsable(False)> Friend ReadOnly Property DesignXml As XmlFile
         <Browsable(False)> Private Property Mode As GridUpdateModes = GridUpdateModes.OnConfirm Implements IGridValuesContainer.Mode
         <Browsable(False), XMLVV(-1)> Friend ReadOnly Property PlaylistFormSplitterDistance As XMLValue(Of Integer)
+        <Browsable(False)> Friend ReadOnly Property DownloadLocations As DownloadLocationsCollection
+        <Browsable(False)> Friend ReadOnly Property PlaylistsLocations As DownloadLocationsCollection
+        <Browsable(False)> Public Overridable Property AccountName As String
+        <Browsable(False), XMLVV(0)> Private ReadOnly Property SettingsVersion As XMLValue(Of Integer)
 #Region "Environment"
-        <Browsable(True), GridVisible(False), XMLVN({"Environment"}), Category("Environment"), DisplayName("Path to yt-dlp.exe"),
+#Region "Programs"
+        <Browsable(True), GridVisible(False), XMLVN({"Environment"}), Category("Environment programs"), DisplayName("Path to yt-dlp.exe"),
             Description("Path to yt-dlp.exe file")>
         Public ReadOnly Property YTDLP As XMLValue(Of SFile)
-        <Browsable(True), GridVisible(False), XMLVN({"Environment"}), Category("Environment"), DisplayName("Path to ffmpeg.exe"),
+        <Browsable(True), GridVisible(False), XMLVN({"Environment"}), Category("Environment programs"), DisplayName("Path to ffmpeg.exe"),
             Description("Path to ffmpeg.exe file")>
         Public ReadOnly Property FFMPEG As XMLValue(Of SFile)
+        <Browsable(False)> Private ReadOnly Property ENVIR_FFMPEG As SFile Implements IDownloaderSettings.ENVIR_FFMPEG
+            Get
+                Return FFMPEG
+            End Get
+        End Property
+        <Browsable(False)> Private ReadOnly Property ENVIR_YTDLP As SFile Implements IDownloaderSettings.ENVIR_YTDLP
+            Get
+                Return YTDLP
+            End Get
+        End Property
+        <Browsable(False)> Private ReadOnly Property ENVIR_GDL As SFile Implements IDownloaderSettings.ENVIR_GDL
+            Get
+                Return Nothing
+            End Get
+        End Property
+        <Browsable(False)> Private ReadOnly Property ENVIR_CURL As SFile Implements IDownloaderSettings.ENVIR_CURL
+            Get
+                Return Nothing
+            End Get
+        End Property
+#End Region
         <Browsable(True), GridVisible(False), Category("Environment"), Description("YouTube cookies"), GridCollectionForm(GetType(CookieListForm2)),
             EditorBrowsable(EditorBrowsableState.Never), DesignerSerializationVisibility(DesignerSerializationVisibility.Content)>
         Public ReadOnly Property Cookies As CookieKeeper
@@ -59,9 +86,37 @@ Namespace API.YouTube.Base
             Description("The default output path where files should be downloaded."),
             Editor(GetType(GridSFileTypeEditorPath), GetType(UITypeEditor))>
         Public ReadOnly Property OutputPath As XMLValue(Of SFile)
+        <Browsable(True), GridVisible(False), XMLVN({"Environment"}), Category("Environment"), DisplayName("Playlist file"),
+            Description("Last selected playlist file"),
+            Editor(GetType(GridSFileTypeEditor_M3U8), GetType(UITypeEditor))>
+        Public ReadOnly Property LatestPlaylistFile As XMLValue(Of SFile)
+        Private Class GridSFileTypeEditor_M3U8 : Inherits GridSFileTypeEditor
+            Public Overrides Function EditValue(ByVal Context As ITypeDescriptorContext, ByVal Provider As IServiceProvider, ByVal Value As Object) As Object
+                Dim f As SFile = SFile.SelectFiles(New SFile(CStr(AConvert(Of String)(Value, AModes.Var, String.Empty))), False,
+                                                   "Select playlist file", "Playlists|*.m3u;*.m3u8|All files|*.*", EDP.ReturnValue).FirstOrDefault()
+                If Not f.IsEmptyString() Then Value = f
+                Return Value
+            End Function
+        End Class
         <Browsable(True), GridVisible(False), XMLVN({"Environment"}), Category("Environment"), DisplayName("Output path auto change"),
             Description("Automatically change the output path when a new destination is selected in the opening forms.")>
         Public ReadOnly Property OutputPathAutoChange As XMLValue(Of Boolean)
+        <Browsable(True), GridVisible(False), XMLVN({"Environment"}, True), Category("Environment"), DisplayName("Output path: ask for a name"),
+            Description("Ask for a name when adding a new output path to the list.")>
+        Public ReadOnly Property OutputPathAskForName As XMLValue(Of Boolean)
+        Private ReadOnly Property IDownloaderSettings_OutputPathAskForName As Boolean Implements IDownloaderSettings.OutputPathAskForName
+            Get
+                Return OutputPathAskForName
+            End Get
+        End Property
+        <Browsable(True), GridVisible(False), XMLVN({"Environment"}, True), Category("Environment"), DisplayName("Output path: auto add"),
+            Description("Add new paths to the list automatically.")>
+        Public ReadOnly Property OutputPathAutoAddPaths As XMLValue(Of Boolean)
+        Private ReadOnly Property IDownloaderSettings_OutputPathAutoAddPaths As Boolean Implements IDownloaderSettings.OutputPathAutoAddPaths
+            Get
+                Return OutputPathAutoAddPaths
+            End Get
+        End Property
         <Browsable(True), GridVisible(False), XMLVN({"Environment"}, DoubleClickBehavior.Folder), Category("Environment"), DisplayName("On item double click"),
             Description("What should program open when you double-click on an item...")>
         Public ReadOnly Property OnItemDoubleClick As XMLValue(Of DoubleClickBehavior)
@@ -92,14 +147,47 @@ Namespace API.YouTube.Base
                 OpenFolderInOtherProgram.Value = command
             End Set
         End Property
+        <Browsable(True), GridVisible(False), XMLVN({"Environment"}, True), Category("Environment"), DisplayName("Check new version at start")>
+        Friend ReadOnly Property CheckUpdatesAtStart As XMLValue(Of Boolean)
+#End Region
+#Region "Info"
+        <Browsable(True), GridVisible, XMLVN({"Info"}), Category("Info"), DisplayName("Create URL files"),
+            Description("Create local URL files to link to the original page. Default: false.")>
+        Public ReadOnly Property CreateUrlFiles As XMLValue(Of Boolean)
+        Private ReadOnly Property IDownloaderSettings_CreateUrlFiles As Boolean Implements IDownloaderSettings.CreateUrlFiles
+            Get
+                Return CreateUrlFiles
+            End Get
+        End Property
+        <Browsable(True), GridVisible, XMLVN({"Info"}), Category("Info"), DisplayName("Create description files"),
+            Description("Create video description files. Default: false.")>
+        Public ReadOnly Property CreateDescriptionFiles As XMLValue(Of Boolean)
+        <Browsable(True), GridVisible, XMLVN({"Info"}, True), Category("Info"), DisplayName("Create description files: add upload date"),
+            Description("Add the upload date to the top of the description file. Default: true.")>
+        Public ReadOnly Property CreateDescriptionFiles_AddUploadDate As XMLValue(Of Boolean)
+        <Browsable(True), GridVisible, XMLVN({"Info"}, True), Category("Info"), DisplayName("Create description files: create without description"),
+            Description("Create a description file with the upload date, even if the description does not exist. Default: true.")>
+        Public ReadOnly Property CreateDescriptionFiles_CreateWithNoDescription As XMLValue(Of Boolean)
+        <Browsable(True), GridVisible, XMLVN({"Info"}, True), Category("Info"), DisplayName("Create thumbnail files (video)"),
+            Description("Create video thumbnail files. Default: true.")>
+        Public ReadOnly Property CreateThumbnails_Video As XMLValue(Of Boolean)
+        <Browsable(True), GridVisible, XMLVN({"Info"}, True), Category("Info"), DisplayName("Create thumbnail files (music)"),
+            Description("Create music thumbnail files (covers). Default: true.")>
+        Public ReadOnly Property CreateThumbnails_Music As XMLValue(Of Boolean)
 #End Region
 #Region "Defaults"
+        <Browsable(True), GridVisible, XMLVN({"Defaults"}, True), Category("Defaults"), DisplayName("Standardize URLs"),
+            Description("Standardize URLs by eliminating unwanted strings. Default: true.")>
+        Public ReadOnly Property StandardizeURLs As XMLValue(Of Boolean)
+        <Browsable(True), GridVisible, XMLVN({"Defaults"}), Category("Defaults"), DisplayName("Replace modification date"),
+            Description("Set the file date to the date the video was added (website) (if available). Default: false.")>
+        Public ReadOnly Property ReplaceModificationDate As XMLValue(Of Boolean)
         <Browsable(True), GridVisible, XMLVN({"Defaults"}), Category("Defaults"), DisplayName("Use cookies"),
             Description("By default, use cookies when downloading from YouTube.")>
         Public ReadOnly Property DefaultUseCookies As XMLValue(Of Boolean)
-        <Browsable(True), GridVisible(False), XMLVN({"Defaults"}, 100), Category("Defaults"), DisplayName("Items limit"),
-            Description("Number of items displayed in the list.")>
-        Public ReadOnly Property ItemsListLimit As XMLValue(Of Integer)
+        <Browsable(True), GridVisible, XMLVN({"Defaults"}, Protocols.Any), Category("Defaults"), DisplayName("Protocol"),
+            Description("Priority download protocol. Default: 'Any'")>
+        Public ReadOnly Property DefaultProtocol As XMLValue(Of Protocols)
         <Browsable(True), GridVisible(False), XMLVN({"Defaults"}), Category("Defaults"),
             DisplayName("Auto remove"), Description("Automatically remove downloaded items from the list.")>
         Public ReadOnly Property RemoveDownloadedAutomatically As XMLValue(Of Boolean)
@@ -152,6 +240,50 @@ Namespace API.YouTube.Base
         <Browsable(True), GridVisible(False), XMLVN({"Defaults"}, False), Category("Defaults"), DisplayName("Confirm exit"),
             Description("Exit confirmation when closing the program.")>
         Public ReadOnly Property ExitConfirm As XMLValue(Of Boolean)
+        <Browsable(True), GridVisible(False), XMLVN({"Defaults"}), Category("Defaults"), DisplayName("Download on click in tray: show form"),
+            Description("Show main window when download by clicking (Ctrl+Click) the tray icon. Default: false")>
+        Public ReadOnly Property ShowFormDownTrayClick As XMLValue(Of Boolean)
+        <Browsable(True), GridVisible(False), XMLVN({"Defaults"}), Category("Defaults"), DisplayName("Program title"),
+            Description("Change the title of the main window if you need to")>
+        Friend ReadOnly Property ProgramText As XMLValue(Of String)
+        <Browsable(True), GridVisible(False), XMLVN({"Defaults"}), Category("Defaults"), DisplayName("Program description"),
+            Description("Add some additional info to the program info if you need")>
+        Friend ReadOnly Property ProgramDescription As XMLValue(Of String)
+        <Browsable(True), GridVisible(False), XMLVN({"Defaults"}, "%"""), Category("Defaults"), DisplayName("Remove characters"),
+            Description("Remove specific characters from a file name")>
+        Friend ReadOnly Property FileRemoveCharacters As XMLValue(Of String)
+#End Region
+#Region "Defaults ChannelsDownload"
+        <Browsable(True), GridVisible, XMLVN({"Defaults", "Channels"}), Category("Defaults"), DisplayName("Default download tabs for channels"),
+            Description("Default download tabs for downloading channels"), TypeConverter(GetType(YouTubeChannelTabConverter))>
+        Public ReadOnly Property ChannelsDownload As XMLValue(Of YouTubeChannelTab)
+        Private Class YouTubeChannelTabConverter : Inherits TypeConverter
+            Public Overrides Function ConvertTo(ByVal Context As ITypeDescriptorContext, ByVal Culture As CultureInfo, ByVal Value As Object,
+                                                ByVal DestinationType As Type) As Object
+                If Not DestinationType Is Nothing Then
+                    If DestinationType Is GetType(String) Then
+                        If IsNothing(Value) Then
+                            Return YouTubeChannelTab.All.ToString
+                        Else
+                            Dim v As List(Of YouTubeChannelTab) = EnumExtract(Of YouTubeChannelTab)(Value,,, EDP.ReturnValue).ListIfNothing
+                            If v.ListExists Then
+                                v.Sort()
+                                Return v.ListToStringE(, New ANumbers.EnumToStringProvider(GetType(YouTubeChannelTab)))
+                            Else
+                                Return YouTubeChannelTab.All.ToString
+                            End If
+                        End If
+                    Else
+                        If IsNothing(Value) Then
+                            Return YouTubeChannelTab.All
+                        Else
+                            Return Value
+                        End If
+                    End If
+                End If
+                Return MyBase.ConvertTo(Context, Culture, Value, DestinationType)
+            End Function
+        End Class
 #End Region
 #Region "Defaults Video"
         <Browsable(True), GridVisible, XMLVN({"DefaultsVideo"}, "MKV"), Category("Defaults Video"), DisplayName("Default format"),
@@ -164,6 +296,83 @@ Namespace API.YouTube.Base
         <Browsable(True), GridVisible, XMLVN({"DefaultsVideo"}, 1080), Category("Defaults Video"), DisplayName("Default definition"),
             Description("The default maximum video resolution. -1 for max definition")>
         Public ReadOnly Property DefaultVideoDefinition As XMLValue(Of Integer)
+        <Browsable(True), GridVisible, XMLVN({"DefaultsVideo"}, False), Category("Defaults Video"), DisplayName("Embed thumbnail (video)"),
+            Description("Embed thumbnail in the video as cover art. Default: true.")>
+        Public ReadOnly Property DefaultVideoEmbedThumbnail As XMLValue(Of Boolean)
+        <Browsable(True), GridVisible, XMLVN({"DefaultsVideo"}), Category("Defaults Video"), DisplayName("Include zero size formats"),
+            Description("Include formats with zero size (or undefined size).")>
+        Public ReadOnly Property DefaultVideoIncludeNullSize As XMLValue(Of Boolean)
+        <Browsable(False), XMLV("DefaultVideoFPS", {"DefaultsVideo"}, -1)>
+        Private ReadOnly Property DefaultVideoFPS_XML As XMLValue(Of Double)
+        <Browsable(True), GridVisible, Category("Defaults Video"), DisplayName("Default video FPS"),
+            Description("Set default video FPS (only to reduce video FPS). Default: -1 (disabled)."),
+            TypeConverter(GetType(FieldsTypeConverter)), GridFormatProvider(GetType(FpsFormatProvider))>
+        Public Property DefaultVideoFPS As Double
+            Get
+                Return DefaultVideoFPS_XML
+            End Get
+            Set(ByVal fps As Double)
+                DefaultVideoFPS_XML.Value = fps
+            End Set
+        End Property
+        Private Function ShouldSerializeDefaultVideoFPS() As Boolean
+            Return DefaultVideoFPS <> DefaultVideoFPS_XML.Value
+        End Function
+        Private Sub ResetDefaultVideoFPS()
+            DefaultVideoFPS = -1
+        End Sub
+        Friend Class FpsFormatProvider : Implements IGridConversionProvider
+            Private Property Converter As TypeConverter Implements IGridConversionProvider.Converter
+            Private Property Context As ITypeDescriptorContext Implements IGridConversionProvider.Context
+            Private Property DataType As Type Implements IGridConversionProvider.DataType
+            Private Property Instance As Object Implements IGridConversionProvider.Instance
+            Friend Shared ReadOnly Property MyProviderDefault As ANumbers
+                Get
+                    Return New ANumbers(ANumbers.Cultures.Primitive) With {.DecimalDigits = 5, .TrimDecimalDigits = True}
+                End Get
+            End Property
+            Friend Const ErrorMessageDefault As String = "The fps value must be a number"
+            Private ReadOnly MyProvider As ANumbers = MyProviderDefault
+            Friend Function ToObject(ByVal Context As ITypeDescriptorContext, ByVal Culture As CultureInfo, ByVal Value As Object) As Object Implements IGridConversionProvider.ToObject
+                Return AConvert(Of Double)(Value, MyProvider, -1)
+            End Function
+            Friend Overloads Function ToString(ByVal Context As ITypeDescriptorContext, ByVal Culture As CultureInfo, ByVal Value As Object,
+                                               ByVal DestinationType As Type) As Object Implements IGridConversionProvider.ToString
+                If ACheck(Of Double)(Value, AModes.Var, MyProvider) Then
+                    Return Value.ToString
+                Else
+                    Return -1
+                End If
+            End Function
+            Friend Function CreateInstance(ByVal Context As ITypeDescriptorContext, ByVal NewValue As Object, ByRef RefreshGrid As Boolean) As Object Implements IGridConversionProvider.CreateInstance
+                If ACheck(Of Double)(NewValue, AModes.Var, MyProvider) Then
+                    Return NewValue
+                Else
+                    RefreshGrid = True
+                    Return -1
+                End If
+            End Function
+            Friend Function Convert(ByVal Value As Object, ByVal DestinationType As Type, ByVal Provider As IFormatProvider,
+                                    Optional ByVal NothingArg As Object = Nothing, Optional ByVal e As ErrorsDescriber = Nothing) As Object Implements ICustomProvider.Convert
+                Return AConvert(Value, AModes.Var, DestinationType,, True, -1, MyProvider, EDP.ReturnValue)
+            End Function
+            Friend Function IsValid(ByVal Context As ITypeDescriptorContext, ByVal Value As Object, ByVal DestinationType As Type) As Boolean Implements IGridValidator.IsValid
+                If ACheck(Of Double)(Value, AModes.Var, MyProvider) Then
+                    Return True
+                Else
+                    Throw New FormatException(ErrorMessageDefault)
+                End If
+            End Function
+            Private Function GetFormat(ByVal FormatType As Type) As Object Implements IFormatProvider.GetFormat
+                Throw New NotImplementedException("'GetFormat' is not available in 'FpsFormatProvider'")
+            End Function
+        End Class
+        <Browsable(True), GridVisible, XMLVN({"DefaultsVideo"}, 30), Category("Defaults Video"), DisplayName("Highlight FPS (higher)"),
+            Description("Highlight frame rates higher than this value." & vbCr & "Default: 30" & vbCr & "-1 to disable")>
+        Public ReadOnly Property DefaultVideoHighlightFPS_H As XMLValue(Of Integer)
+        <Browsable(True), GridVisible, XMLVN({"DefaultsVideo"}, -1), Category("Defaults Video"), DisplayName("Highlight FPS (lower)"),
+            Description("Highlight frame rates lower than this value." & vbCr & "Default: -1" & vbCr & "-1 to disable")>
+        Public ReadOnly Property DefaultVideoHighlightFPS_L As XMLValue(Of Integer)
 #End Region
 #Region "Defaults Audio"
         <Browsable(True), GridVisible, XMLVN({"DefaultsAudio"}, "AAC"), Category("Defaults Audio"), DisplayName("Default codec"),
@@ -183,6 +392,35 @@ Namespace API.YouTube.Base
             TypeConverter(GetType(ValueCollectionConverter)),
             Description("Additional audio format for downloading videos. This means that the audio will be extracted and saved as a separate file in these formats.")>
         Public ReadOnly Property DefaultAudioCodecAddit As XMLValuesCollection(Of String)
+        <Browsable(True), GridVisible, XMLVN({"DefaultsAudio"}, True), Category("Defaults Audio"), DisplayName("Embed thumbnail"),
+            Description("Embed thumbnail in the audio as cover art. Default: true.")>
+        Public ReadOnly Property DefaultAudioEmbedThumbnail As XMLValue(Of Boolean)
+        <Browsable(True), GridVisible, XMLVN({"DefaultsAudio"}, True), Category("Defaults Audio"), DisplayName("Embed thumbnail (extracted files)"),
+            Description("Embed thumbnail in the extracted (additional file ('mp3' only)) audio as cover art. Default: true.")>
+        Public ReadOnly Property DefaultAudioEmbedThumbnail_ExtractedFiles As XMLValue(Of Boolean)
+        <Browsable(True), GridVisible, XMLVN({"DefaultsAudio"}, -1), Category("Defaults Audio"), DisplayName("Bitrate"),
+            Description("Default audio bitrate if you want to change it during download. -1 to disable. Default: -1.")>
+        Public ReadOnly Property DefaultAudioBitrate As XMLValue(Of Integer)
+        <Browsable(True), GridVisible, XMLVN({"DefaultsAudio"}, 20), Category("Defaults Audio"), DisplayName("Bitrate: ffmpeg crf"),
+            Description("This is the ffmpeg argument. Change it only if you know what you're doing. Default: 20.")>
+        Public ReadOnly Property DefaultAudioBitrate_crf As XMLValue(Of Integer)
+#Region "Music"
+        <Browsable(True), GridVisible, XMLVN({"Playlists"}, True), Category("Music"), DisplayName("Create M3U8"),
+            Description("Create M3U8 playlist for music. Default: true.")>
+        Public ReadOnly Property MusicPlaylistCreate_M3U8 As XMLValue(Of Boolean)
+        <Browsable(True), GridVisible, XMLVN({"Playlists"}), Category("Music"), DisplayName("Create M3U"),
+            Description("Create M3U playlist for music. Default: false.")>
+        Public ReadOnly Property MusicPlaylistCreate_M3U As XMLValue(Of Boolean)
+        <Browsable(True), GridVisible, XMLVN({"Playlists"}), Category("Music"), DisplayName("M3U8 Append artist"),
+            Description("Add artist to file name. Default: false.")>
+        Public ReadOnly Property MusicPlaylistCreate_M3U8_AppendArtist As XMLValue(Of Boolean)
+        <Browsable(True), GridVisible, XMLVN({"Playlists"}), Category("Music"), DisplayName("M3U8 Append file extension"),
+            Description("Add file extension to file name. Default: false.")>
+        Public ReadOnly Property MusicPlaylistCreate_M3U8_AppendExt As XMLValue(Of Boolean)
+        <Browsable(True), GridVisible, XMLVN({"Playlists"}), Category("Music"), DisplayName("M3U8 Append file number"),
+            Description("Add file number to file name. Default: false.")>
+        Public ReadOnly Property MusicPlaylistCreate_M3U8_AppendNumber As XMLValue(Of Boolean)
+#End Region
 #End Region
 #Region "Defaults Subtitles"
         <XMLVN({"DefaultsSubtitles"}, {"en"}, CollectionMode:=IXMLValuesCollection.Modes.String)>
@@ -230,7 +468,19 @@ Namespace API.YouTube.Base
 #End Region
 #Region "Initializer"
         Public Sub New()
-            XML = New XmlFile(YouTubeSettingsFile,, False) With {.AutoUpdateFile = True}
+            Me.New(String.Empty)
+        End Sub
+        Public Sub New(ByVal AccountName As String)
+            Me.AccountName = AccountName
+            DownloadLocations = New DownloadLocationsCollection
+            PlaylistsLocations = New DownloadLocationsCollection
+            DownloadLocations.Load(False, True)
+            PlaylistsLocations.Load(True, True, $"{XmlFile.SettingsFolder}\DownloadLocations_Playlists.xml")
+            Dim acc$ = String.Empty
+            If Not AccountName.IsEmptyString Then acc = $"_{AccountName}"
+            Dim f As SFile = YouTubeSettingsFile
+            f.Name &= acc
+            XML = New XmlFile(f,, False) With {.AutoUpdateFile = True}
             XML.LoadData(EDP.None)
             DesignXml = New XmlFile("Settings\DesignDownloader.xml", Protector.Modes.All, False)
             DesignXml.LoadData(EDP.None)
@@ -238,7 +488,9 @@ Namespace API.YouTube.Base
             AddHandler ShowNotificationsEveryDownload.TempValueChanged, AddressOf ShowNotificationsEveryDownload_TempValueChanged
             Cookies = New CookieKeeper
             Grid.Abstract.DesignerXmlSource.Add(New Grid.Abstract.DesignerXmlData(GetType(CookieListForm2), DesignXml, "CookiesListForm"))
-            If YouTubeCookieNetscapeFile.Exists Then Cookies.AddRange(CookieKeeper.ParseNetscapeText(YouTubeCookieNetscapeFile.GetText(EDP.ReturnValue), EDP.None),, EDP.None)
+            f = YouTubeCookieNetscapeFile
+            f.Name &= acc
+            If f.Exists Then Cookies.AddRange(CookieKeeper.ParseNetscapeText(f.GetText(EDP.ReturnValue), EDP.None),, EDP.None)
             If Not YTDLP.Value.Exists Then YTDLP.Value = ProgramPath("yt-dlp.exe")
             If Not FFMPEG.Value.Exists Then FFMPEG.Value = ProgramPath("ffmpeg.exe")
             If Not OutputPath.Value.Exists(SFO.Path, False) Then OutputPath.Value = YouTubeDownloadPathDefault

SCrawler.YouTube/Controls/ChannelTabsChooserForm.Designer.vb

@@ -0,0 +1,179 @@
+' Copyright (C) Andy https://github.com/AAndyProgram
+' This program is free software: you can redistribute it and/or modify
+' it under the terms of the GNU General Public License as published by
+' the Free Software Foundation, either version 3 of the License, or
+' (at your option) any later version.
+'
+' This program is distributed in the hope that it will be useful,
+' but WITHOUT ANY WARRANTY
+Namespace API.YouTube.Controls
+    <Global.Microsoft.VisualBasic.CompilerServices.DesignerGenerated()>
+    Partial Friend Class ChannelTabsChooserForm : Inherits System.Windows.Forms.Form
+        <System.Diagnostics.DebuggerNonUserCode()>
+        Protected Overrides Sub Dispose(ByVal disposing As Boolean)
+            Try
+                If disposing AndAlso components IsNot Nothing Then
+                    components.Dispose()
+                End If
+            Finally
+                MyBase.Dispose(disposing)
+            End Try
+        End Sub
+        Private components As System.ComponentModel.IContainer
+        <System.Diagnostics.DebuggerStepThrough()>
+        Private Sub InitializeComponent()
+            Dim CONTAINER_MAIN As System.Windows.Forms.ToolStripContainer
+            Dim TP_MAIN As System.Windows.Forms.TableLayoutPanel
+            Me.CH_ALL = New System.Windows.Forms.CheckBox()
+            Me.CH_VIDEOS = New System.Windows.Forms.CheckBox()
+            Me.CH_SHORTS = New System.Windows.Forms.CheckBox()
+            Me.CH_PLS = New System.Windows.Forms.CheckBox()
+            Me.TXT_URL = New PersonalUtilities.Forms.Controls.TextBoxExtended()
+            Me.CH_URL_ASIS = New System.Windows.Forms.CheckBox()
+            CONTAINER_MAIN = New System.Windows.Forms.ToolStripContainer()
+            TP_MAIN = New System.Windows.Forms.TableLayoutPanel()
+            CONTAINER_MAIN.ContentPanel.SuspendLayout()
+            CONTAINER_MAIN.SuspendLayout()
+            TP_MAIN.SuspendLayout()
+            CType(Me.TXT_URL, System.ComponentModel.ISupportInitialize).BeginInit()
+            Me.SuspendLayout()
+            '
+            'CONTAINER_MAIN
+            '
+            '
+            'CONTAINER_MAIN.ContentPanel
+            '
+            CONTAINER_MAIN.ContentPanel.Controls.Add(TP_MAIN)
+            CONTAINER_MAIN.ContentPanel.Size = New System.Drawing.Size(474, 159)
+            CONTAINER_MAIN.Dock = System.Windows.Forms.DockStyle.Fill
+            CONTAINER_MAIN.LeftToolStripPanelVisible = False
+            CONTAINER_MAIN.Location = New System.Drawing.Point(0, 0)
+            CONTAINER_MAIN.Name = "CONTAINER_MAIN"
+            CONTAINER_MAIN.RightToolStripPanelVisible = False
+            CONTAINER_MAIN.Size = New System.Drawing.Size(474, 184)
+            CONTAINER_MAIN.TabIndex = 0
+            CONTAINER_MAIN.TopToolStripPanelVisible = False
+            '
+            'TP_MAIN
+            '
+            TP_MAIN.CellBorderStyle = System.Windows.Forms.TableLayoutPanelCellBorderStyle.[Single]
+            TP_MAIN.ColumnCount = 1
+            TP_MAIN.ColumnStyles.Add(New System.Windows.Forms.ColumnStyle(System.Windows.Forms.SizeType.Percent, 100.0!))
+            TP_MAIN.Controls.Add(Me.CH_ALL, 0, 2)
+            TP_MAIN.Controls.Add(Me.CH_VIDEOS, 0, 3)
+            TP_MAIN.Controls.Add(Me.CH_SHORTS, 0, 4)
+            TP_MAIN.Controls.Add(Me.CH_PLS, 0, 5)
+            TP_MAIN.Controls.Add(Me.TXT_URL, 0, 0)
+            TP_MAIN.Controls.Add(Me.CH_URL_ASIS, 0, 1)
+            TP_MAIN.Dock = System.Windows.Forms.DockStyle.Fill
+            TP_MAIN.Location = New System.Drawing.Point(0, 0)
+            TP_MAIN.Name = "TP_MAIN"
+            TP_MAIN.RowCount = 7
+            TP_MAIN.RowStyles.Add(New System.Windows.Forms.RowStyle(System.Windows.Forms.SizeType.Absolute, 28.0!))
+            TP_MAIN.RowStyles.Add(New System.Windows.Forms.RowStyle(System.Windows.Forms.SizeType.Absolute, 25.0!))
+            TP_MAIN.RowStyles.Add(New System.Windows.Forms.RowStyle(System.Windows.Forms.SizeType.Absolute, 25.0!))
+            TP_MAIN.RowStyles.Add(New System.Windows.Forms.RowStyle(System.Windows.Forms.SizeType.Absolute, 25.0!))
+            TP_MAIN.RowStyles.Add(New System.Windows.Forms.RowStyle(System.Windows.Forms.SizeType.Absolute, 25.0!))
+            TP_MAIN.RowStyles.Add(New System.Windows.Forms.RowStyle(System.Windows.Forms.SizeType.Absolute, 25.0!))
+            TP_MAIN.RowStyles.Add(New System.Windows.Forms.RowStyle(System.Windows.Forms.SizeType.Percent, 100.0!))
+            TP_MAIN.Size = New System.Drawing.Size(474, 159)
+            TP_MAIN.TabIndex = 0
+            '
+            'CH_ALL
+            '
+            Me.CH_ALL.AutoSize = True
+            Me.CH_ALL.Dock = System.Windows.Forms.DockStyle.Fill
+            Me.CH_ALL.Location = New System.Drawing.Point(4, 59)
+            Me.CH_ALL.Name = "CH_ALL"
+            Me.CH_ALL.Size = New System.Drawing.Size(466, 19)
+            Me.CH_ALL.TabIndex = 2
+            Me.CH_ALL.Text = "ALL"
+            Me.CH_ALL.UseVisualStyleBackColor = True
+            '
+            'CH_VIDEOS
+            '
+            Me.CH_VIDEOS.AutoSize = True
+            Me.CH_VIDEOS.Dock = System.Windows.Forms.DockStyle.Fill
+            Me.CH_VIDEOS.Location = New System.Drawing.Point(4, 85)
+            Me.CH_VIDEOS.Name = "CH_VIDEOS"
+            Me.CH_VIDEOS.Size = New System.Drawing.Size(466, 19)
+            Me.CH_VIDEOS.TabIndex = 3
+            Me.CH_VIDEOS.Text = "Videos"
+            Me.CH_VIDEOS.UseVisualStyleBackColor = True
+            '
+            'CH_SHORTS
+            '
+            Me.CH_SHORTS.AutoSize = True
+            Me.CH_SHORTS.Dock = System.Windows.Forms.DockStyle.Fill
+            Me.CH_SHORTS.Location = New System.Drawing.Point(4, 111)
+            Me.CH_SHORTS.Name = "CH_SHORTS"
+            Me.CH_SHORTS.Size = New System.Drawing.Size(466, 19)
+            Me.CH_SHORTS.TabIndex = 4
+            Me.CH_SHORTS.Text = "Shorts"
+            Me.CH_SHORTS.UseVisualStyleBackColor = True
+            '
+            'CH_PLS
+            '
+            Me.CH_PLS.AutoSize = True
+            Me.CH_PLS.Dock = System.Windows.Forms.DockStyle.Fill
+            Me.CH_PLS.Location = New System.Drawing.Point(4, 137)
+            Me.CH_PLS.Name = "CH_PLS"
+            Me.CH_PLS.Size = New System.Drawing.Size(466, 19)
+            Me.CH_PLS.TabIndex = 5
+            Me.CH_PLS.Text = "Playlists"
+            Me.CH_PLS.UseVisualStyleBackColor = True
+            '
+            'TXT_URL
+            '
+            Me.TXT_URL.CaptionText = "Channel URL"
+            Me.TXT_URL.CaptionWidth = 80.0R
+            Me.TXT_URL.Dock = System.Windows.Forms.DockStyle.Fill
+            Me.TXT_URL.Location = New System.Drawing.Point(4, 4)
+            Me.TXT_URL.Name = "TXT_URL"
+            Me.TXT_URL.Size = New System.Drawing.Size(466, 22)
+            Me.TXT_URL.TabIndex = 0
+            '
+            'CH_URL_ASIS
+            '
+            Me.CH_URL_ASIS.AutoSize = True
+            Me.CH_URL_ASIS.Dock = System.Windows.Forms.DockStyle.Fill
+            Me.CH_URL_ASIS.Location = New System.Drawing.Point(4, 33)
+            Me.CH_URL_ASIS.Name = "CH_URL_ASIS"
+            Me.CH_URL_ASIS.Size = New System.Drawing.Size(466, 19)
+            Me.CH_URL_ASIS.TabIndex = 1
+            Me.CH_URL_ASIS.Text = "Download URL as is"
+            Me.CH_URL_ASIS.UseVisualStyleBackColor = True
+            '
+            'ChannelTabsChooserForm
+            '
+            Me.AutoScaleDimensions = New System.Drawing.SizeF(6.0!, 13.0!)
+            Me.AutoScaleMode = System.Windows.Forms.AutoScaleMode.Font
+            Me.ClientSize = New System.Drawing.Size(474, 184)
+            Me.Controls.Add(CONTAINER_MAIN)
+            Me.FormBorderStyle = System.Windows.Forms.FormBorderStyle.FixedSingle
+            Me.Icon = Global.SCrawler.My.Resources.SiteYouTube.YouTubeIcon_32
+            Me.MaximizeBox = False
+            Me.MaximumSize = New System.Drawing.Size(490, 223)
+            Me.MinimizeBox = False
+            Me.MinimumSize = New System.Drawing.Size(490, 223)
+            Me.Name = "ChannelTabsChooserForm"
+            Me.SizeGripStyle = System.Windows.Forms.SizeGripStyle.Hide
+            Me.Text = "Tabs"
+            CONTAINER_MAIN.ContentPanel.ResumeLayout(False)
+            CONTAINER_MAIN.ResumeLayout(False)
+            CONTAINER_MAIN.PerformLayout()
+            TP_MAIN.ResumeLayout(False)
+            TP_MAIN.PerformLayout()
+            CType(Me.TXT_URL, System.ComponentModel.ISupportInitialize).EndInit()
+            Me.ResumeLayout(False)
+
+        End Sub
+
+        Private WithEvents CH_ALL As CheckBox
+        Private WithEvents CH_VIDEOS As CheckBox
+        Private WithEvents CH_SHORTS As CheckBox
+        Private WithEvents CH_PLS As CheckBox
+        Private WithEvents TXT_URL As PersonalUtilities.Forms.Controls.TextBoxExtended
+        Private WithEvents CH_URL_ASIS As CheckBox
+    End Class
+End Namespace

SCrawler.YouTube/Controls/ChannelTabsChooserForm.resx

@@ -0,0 +1,126 @@
+<?xml version="1.0" encoding="utf-8"?>
+<root>
+  <!-- 
+    Microsoft ResX Schema 
+    
+    Version 2.0
+    
+    The primary goals of this format is to allow a simple XML format 
+    that is mostly human readable. The generation and parsing of the 
+    various data types are done through the TypeConverter classes 
+    associated with the data types.
+    
+    Example:
+    
+    ... ado.net/XML headers & schema ...
+    <resheader name="resmimetype">text/microsoft-resx</resheader>
+    <resheader name="version">2.0</resheader>
+    <resheader name="reader">System.Resources.ResXResourceReader, System.Windows.Forms, ...</resheader>
+    <resheader name="writer">System.Resources.ResXResourceWriter, System.Windows.Forms, ...</resheader>
+    <data name="Name1"><value>this is my long string</value><comment>this is a comment</comment></data>
+    <data name="Color1" type="System.Drawing.Color, System.Drawing">Blue</data>
+    <data name="Bitmap1" mimetype="application/x-microsoft.net.object.binary.base64">
+        <value>[base64 mime encoded serialized .NET Framework object]</value>
+    </data>
+    <data name="Icon1" type="System.Drawing.Icon, System.Drawing" mimetype="application/x-microsoft.net.object.bytearray.base64">
+        <value>[base64 mime encoded string representing a byte array form of the .NET Framework object]</value>
+        <comment>This is a comment</comment>
+    </data>
+                
+    There are any number of "resheader" rows that contain simple 
+    name/value pairs.
+    
+    Each data row contains a name, and value. The row also contains a 
+    type or mimetype. Type corresponds to a .NET class that support 
+    text/value conversion through the TypeConverter architecture. 
+    Classes that don't support this are serialized and stored with the 
+    mimetype set.
+    
+    The mimetype is used for serialized objects, and tells the 
+    ResXResourceReader how to depersist the object. This is currently not 
+    extensible. For a given mimetype the value must be set accordingly:
+    
+    Note - application/x-microsoft.net.object.binary.base64 is the format 
+    that the ResXResourceWriter will generate, however the reader can 
+    read any of the formats listed below.
+    
+    mimetype: application/x-microsoft.net.object.binary.base64
+    value   : The object must be serialized with 
+            : System.Runtime.Serialization.Formatters.Binary.BinaryFormatter
+            : and then encoded with base64 encoding.
+    
+    mimetype: application/x-microsoft.net.object.soap.base64
+    value   : The object must be serialized with 
+            : System.Runtime.Serialization.Formatters.Soap.SoapFormatter
+            : and then encoded with base64 encoding.
+
+    mimetype: application/x-microsoft.net.object.bytearray.base64
+    value   : The object must be serialized into a byte array 
+            : using a System.ComponentModel.TypeConverter
+            : and then encoded with base64 encoding.
+    -->
+  <xsd:schema id="root" xmlns="" xmlns:xsd="http://www.w3.org/2001/XMLSchema" xmlns:msdata="urn:schemas-microsoft-com:xml-msdata">
+    <xsd:import namespace="http://www.w3.org/XML/1998/namespace" />
+    <xsd:element name="root" msdata:IsDataSet="true">
+      <xsd:complexType>
+        <xsd:choice maxOccurs="unbounded">
+          <xsd:element name="metadata">
+            <xsd:complexType>
+              <xsd:sequence>
+                <xsd:element name="value" type="xsd:string" minOccurs="0" />
+              </xsd:sequence>
+              <xsd:attribute name="name" use="required" type="xsd:string" />
+              <xsd:attribute name="type" type="xsd:string" />
+              <xsd:attribute name="mimetype" type="xsd:string" />
+              <xsd:attribute ref="xml:space" />
+            </xsd:complexType>
+          </xsd:element>
+          <xsd:element name="assembly">
+            <xsd:complexType>
+              <xsd:attribute name="alias" type="xsd:string" />
+              <xsd:attribute name="name" type="xsd:string" />
+            </xsd:complexType>
+          </xsd:element>
+          <xsd:element name="data">
+            <xsd:complexType>
+              <xsd:sequence>
+                <xsd:element name="value" type="xsd:string" minOccurs="0" msdata:Ordinal="1" />
+                <xsd:element name="comment" type="xsd:string" minOccurs="0" msdata:Ordinal="2" />
+              </xsd:sequence>
+              <xsd:attribute name="name" type="xsd:string" use="required" msdata:Ordinal="1" />
+              <xsd:attribute name="type" type="xsd:string" msdata:Ordinal="3" />
+              <xsd:attribute name="mimetype" type="xsd:string" msdata:Ordinal="4" />
+              <xsd:attribute ref="xml:space" />
+            </xsd:complexType>
+          </xsd:element>
+          <xsd:element name="resheader">
+            <xsd:complexType>
+              <xsd:sequence>
+                <xsd:element name="value" type="xsd:string" minOccurs="0" msdata:Ordinal="1" />
+              </xsd:sequence>
+              <xsd:attribute name="name" type="xsd:string" use="required" />
+            </xsd:complexType>
+          </xsd:element>
+        </xsd:choice>
+      </xsd:complexType>
+    </xsd:element>
+  </xsd:schema>
+  <resheader name="resmimetype">
+    <value>text/microsoft-resx</value>
+  </resheader>
+  <resheader name="version">
+    <value>2.0</value>
+  </resheader>
+  <resheader name="reader">
+    <value>System.Resources.ResXResourceReader, System.Windows.Forms, Version=4.0.0.0, Culture=neutral, PublicKeyToken=b77a5c561934e089</value>
+  </resheader>
+  <resheader name="writer">
+    <value>System.Resources.ResXResourceWriter, System.Windows.Forms, Version=4.0.0.0, Culture=neutral, PublicKeyToken=b77a5c561934e089</value>
+  </resheader>
+  <metadata name="CONTAINER_MAIN.GenerateMember" type="System.Boolean, mscorlib, Version=4.0.0.0, Culture=neutral, PublicKeyToken=b77a5c561934e089">
+    <value>False</value>
+  </metadata>
+  <metadata name="TP_MAIN.GenerateMember" type="System.Boolean, mscorlib, Version=4.0.0.0, Culture=neutral, PublicKeyToken=b77a5c561934e089">
+    <value>False</value>
+  </metadata>
+</root>

SCrawler.YouTube/Controls/ChannelTabsChooserForm.vb

@@ -0,0 +1,85 @@
+' Copyright (C) Andy https://github.com/AAndyProgram
+' This program is free software: you can redistribute it and/or modify
+' it under the terms of the GNU General Public License as published by
+' the Free Software Foundation, either version 3 of the License, or
+' (at your option) any later version.
+'
+' This program is distributed in the hope that it will be useful,
+' but WITHOUT ANY WARRANTY
+Imports PersonalUtilities.Forms
+Imports PersonalUtilities.Functions.XML
+Imports PersonalUtilities.Functions.XML.Base
+Imports SCrawler.API.YouTube.Base
+Namespace API.YouTube.Controls
+    Friend Class ChannelTabsChooserForm : Implements IDesignXMLContainer
+        Private WithEvents MyDefs As DefaultFormOptions
+        Friend Property DesignXML As EContainer Implements IDesignXMLContainer.DesignXML
+        Private Property DesignXMLNodes As String() Implements IDesignXMLContainer.DesignXMLNodes
+        Private Property DesignXMLNodeName As String Implements IDesignXMLContainer.DesignXMLNodeName
+        Private _Result As YouTubeChannelTab = YouTubeChannelTab.All
+        Friend ReadOnly Property Result As YouTubeChannelTab
+            Get
+                Return _Result
+            End Get
+        End Property
+        Friend ReadOnly Property URL As String
+            Get
+                Return TXT_URL.Text
+            End Get
+        End Property
+        Friend ReadOnly Property MyUrlAsIs As Boolean
+            Get
+                Return CH_URL_ASIS.Checked
+            End Get
+        End Property
+        Friend Sub New(ByVal InitVal As YouTubeChannelTab, ByVal _URL As String)
+            InitializeComponent()
+            MyDefs = New DefaultFormOptions(Me)
+            _Result = InitVal
+            TXT_URL.Text = _URL
+        End Sub
+        Private Sub ChannelTabsChooserForm_Load(sender As Object, e As EventArgs) Handles Me.Load
+            Try
+                With MyDefs
+                    MyDefs.MyXML = DesignXML
+                    If Not DesignXML Is Nothing Then .MyViewInitialize(True)
+                    .AddOkCancelToolbar()
+                    If _Result = YouTubeChannelTab.All And Not MyYouTubeSettings Is Nothing Then _Result = MyYouTubeSettings.ChannelsDownload
+                    Dim r() As YouTubeChannelTab = _Result.EnumExtract(Of YouTubeChannelTab)
+                    If r.ListExists Then
+                        For Each value As YouTubeChannelTab In r
+                            Select Case value
+                                Case YouTubeChannelTab.All : CH_ALL.Checked = True
+                                Case YouTubeChannelTab.Videos : CH_VIDEOS.Checked = True
+                                Case YouTubeChannelTab.Shorts : CH_SHORTS.Checked = True
+                                Case YouTubeChannelTab.Playlists : CH_PLS.Checked = True
+                            End Select
+                        Next
+                    Else
+                        CH_ALL.Checked = True
+                    End If
+                    UpdateCheckBoxes()
+                    .EndLoaderOperations()
+                    .MyOkCancel.EnableOK = True
+                End With
+            Catch ex As Exception
+                MyDefs.InvokeLoaderError(ex)
+            End Try
+        End Sub
+        Private Sub MyDefs_ButtonOkClick(ByVal Sender As Object, ByVal e As KeyHandleEventArgs) Handles MyDefs.ButtonOkClick
+            _Result = YouTubeChannelTab.All
+            If Not CH_ALL.Checked And {CH_VIDEOS, CH_SHORTS, CH_PLS}.Any(Function(c) c.Checked) Then
+                If CH_VIDEOS.Checked Then _Result += YouTubeChannelTab.Videos
+                If CH_SHORTS.Checked Then _Result += YouTubeChannelTab.Shorts
+                If CH_PLS.Checked Then _Result += YouTubeChannelTab.Playlists
+            End If
+            MyDefs.CloseForm()
+        End Sub
+        Private Sub UpdateCheckBoxes() Handles CH_ALL.CheckedChanged, CH_URL_ASIS.CheckedChanged
+            Dim e As Boolean = Not CH_ALL.Checked And Not CH_URL_ASIS.Checked
+            CH_VIDEOS.Enabled = e
+            CH_SHORTS.Enabled = e
+            CH_PLS.Enabled = e
+        End Sub
+    End Class
+End Namespace