2025.1.12.0

YT
YouTubeSettings: add 'FileAddChannelToFileName' property
YouTubeMediaContainerBase: add channel name and video URL to info file; add channel name to file name

SCrawler
DownDetector: fix 403 error; add 'IDownDetector' interface and 'Checker' class; create an isolated environment
API.Instagram: update 'SiteSettings' to the new 'DownDetector' environment; make 'PostKV' public; add static function 'LoadSavePostsKV'
API.OnlyFans: add 'EnableCookiesUpdate' hidden property; add support for DRM keys; add the ability to disable cookie updates
API.Pinterest: add 'x-pinterest-pws-handler' header
API.Reddit: update 'SiteSettings' to the new 'DownDetector' environment
API.ThisVid: fix subscription videos images
API.Threads: change 'heic' extension to 'jpg'
API.Twitter: add broadcasts download
API.Xhamster: fix absolute M3U8 URLs
API.YouTube: add support of personal API instances ('YouTube-operational-API') for download communities
SiteEditorForm: add 'Ctrl+Enter' hotkey to force save settings, ignoring  requirements
PluginsEnvironment.Attributes: add 'UseDownDetectorAttribute' attribute
SettingsHost: update to the new 'DownDetector' environment; add 'AvailableDownDetector' property
SettingsHostCollection: update to the new 'DownDetector' environment; minor bugs in multiprofile
SettingsCLS: add 'DownDetectorEnabled' property

CONTRIBUTING.md

@@ -1,17 +1,14 @@
 # Contributor's Guide
 
-I welcome requests! Follow these steps to contribute:
-
+Follow these steps to contribute:
 1. Find an [issue](https://github.com/AAndyProgram/SCrawler/issues) that needs assistance.
-1. Let me know you are working on it by posting a comment on the issue.
-1. If you find an error in the code, please provide a link to the file and the line number.
+1. Let me know you're working on this by posting a comment on this issue.
+1. If you find a bug in the code, please provide a link to the file and line number.
 1. If you have a code change suggestion, you can post a replacement code block.<!-- I also accept pull requests.-->
 
 # How to report a problem
-1. Attach the **profile URLs or links** that you cannot download.
-1. Attach the **LOG** if it exists.
-1. **Attach the environment information copied from SCrawler (click the top right info button in the main window, then the `Environment` button, then the `Copy` button, and paste the copied text into the issue).**
-1. *Add screenshots to illustrate the problem (**optional**)*
+
+**[Read here](https://github.com/AAndyProgram/SCrawler/blob/main/FAQ.md#how-to-report-a-problem)**
 
 # How to build from source
 1. Delete the `PersonalUtilities` project from the solution.
@@ -30,7 +27,7 @@ I welcome requests! Follow these steps to contribute:
 **I'm currently not accepting requests to develop new sites.**
 
 1. Check [issues](https://github.com/AAndyProgram/SCrawler/issues) (open and [closed](https://github.com/AAndyProgram/SCrawler/issues?q=is%3Aissue+is%3Aclosed)) and [discussions](https://github.com/AAndyProgram/SCrawler/discussions) to find your issue. Perhaps I have already answered your request.
-1. If you don't find anything, create a new issue with your request. I usually reply as soon as possible (within the next few hours).
+1. If you don't find anything, create a new issue with your request.
 
 # Requirements for new site requests
 

Changelog.md

@@ -1,3 +1,113 @@
+# 2025.1.12.0
+
+*2025-01-12*
+
+- Added
+  - Sites:
+    - YouTube (standalone app):
+      - ability to add channel name to file name (`Add channel to file name`)
+      - adding channel name and video URL to info file
+    - OnlyFans: **built-in usage of DRM keys**
+    - Threads: automatically change `heic` extension to `jpg`
+    - Twitter: download broadcasts *(user option)*
+  - Minor improvements
+- Updated
+  - yt-dlp up to version **2024.12.23**
+  - gallery-dl up to version **1.28.3**
+  - **OF-Scraper** up to version **3.12.9** *(you must update it personally)*
+- Fixed
+  - Sites:
+    - DownDetector: fixed 403 error
+    - OnlyFans: **DRM videos not downloading**
+    - xHamster: some videos are not downloading
+    - YouTube: **communities are not downloading** *(see settings in wiki)*
+  - Minor bugs
+
+# 2024.11.21.0
+
+*2024-11-21*
+
+- Added
+  - Sites:
+    - Instagram:
+      - setting to skip errors without disabling download *(site settings)*
+      - settings to force update of username and/or user information *(user settings)*
+      - setting to continue downloading profile if error 560 occurs while downloading user stories *(site settings)*
+      - improve username update algorithm
+    - YouTube: 404 error handling (community)
+  - Main window: add extra buttons for special download (limited and dated) in collection
+  - Global settings: ability to change the feed opening shortcut (`Ctrl+F`/`Alt+F` *(Settings - Behavior)*)
+  - Minor improvements
+- Updated
+  - yt-dlp up to version **2024.11.18**
+  - gallery-dl up to version **1.27.7**
+- Fixed
+  - Users: network paths aren't working
+  - Main window: in some cases users are not updated in the list
+  - Minor bugs
+
+# 2024.10.24.0
+
+*2024-10-24*
+
+- Added
+  - YouTube (standalone app):
+    - settings `Embed thumbnail (cover)` and `Allow webm formats`
+    - changed cover selection for music downloads
+    - allow `webm` formats if there are no `mp4` formats via http protocol (issue #211)
+  - Sites:
+    - Instagram:
+      - **ability to manually change username**
+      - **mark user as non-existent if user `ID` cannot be obtained**
+    - Twitter: **ability to manually change username**
+  - Main window: add users search button to 'Info' menu
+  - Minor improvements
+- Updated
+  - yt-dlp up to version **2024.10.22**
+  - gallery-dl up to version **1.27.6**
+- Fixed
+  - YouTube (standalone app): adding incorrect playlist lines
+  - Reddit: incorrect UNIX date parsing
+  - Can't change data path (issue #206)
+  - Minor bugs
+
+# 2024.9.2.0
+
+*2024-09-02*
+
+- Added
+  - Instagram: options to enable/disable image extraction from video
+  - Feed: **prompt before moving entire feed/session**
+  - Main window: hotkeys `Alt+U` and `Ctrl+U` to open the user search form
+  - Minor improvements
+- Updated
+  - gallery-dl up to version **1.27.3**
+- Fixed
+  - **OnlyFans**: data is not downloading
+  - YouTube (SCrawler): incorrect parsing of video page
+  - Minor bugs
+
+# 2024.8.10.0
+
+*2024-08-10*
+
+- Added
+  - Feed: button to open file folder
+- Updated
+  - yt-dlp up to version **2024.08.06**
+  - gallery-dl up to version **1.27.2**
+- Fixed
+  - YouTube (standalone app): **video is being parsed using cookies but is not downloading** *(Issue #205)*
+
+# 2024.8.1.0
+
+*2024-08-01*
+
+- Added
+  - Minor improvements
+- Updated
+  - yt-dlp up to version **2024.08.01**
+
 # 2024.7.24.0
 
 *2024-07-24*

FAQ.md

@@ -1,120 +1,98 @@
-# Frequently asked questions
 
-**Please read the [GUIDE](https://github.com/AAndyProgram/SCrawler/wiki/) Before asking a question!**
+**Join our Discord server**: https://discord.gg/uFNUXvFFmg
+<br/>*You can get help faster there!*
 
-**Also read [here](README.md) for basic information.**
+# Docs
+- Basic info: https://github.com/AAndyProgram/SCrawler/blob/main/README.md
+- **GUIDE**: https://github.com/AAndyProgram/SCrawler/wiki/
+- Settings: https://github.com/AAndyProgram/SCrawler/wiki/Settings
+- Discord: https://discord.gg/uFNUXvFFmg
 
 Most of your questions are already answered. All settings, functions, buttons and everything else described in the guide.
 
-Any other questions I will keep in this file.
+# Backup
+I strongly recommend you to **regularly** create backup copies of the settings files. **An [example script](https://github.com/AAndyProgram/SCrawler/blob/main/Tools/ArchiveSCrawlerUsersDataFiles.bat) for this** on GitHub (you **should adapt** it to your environment, and you can use it when [SCrawler is closed](https://github.com/AAndyProgram/SCrawler/wiki/Settings#behavior)).
 
-----
+**This way you'll always have the latest backup of your settings files and can restore it if something goes wrong!**
 
-#### Q: **HOW TO SETUP COOKIES**
-
-A: https://github.com/AAndyProgram/SCrawler/wiki/Settings#how-to-set-up-cookies
-
-----
-
-#### Q: **Does this program have GUI or CLI.**
-
-A: This is a GUI program.
-
-----
-
-#### Q: **Will CLI be added in the future?**
-
-A: NO.
-
-----
-
-#### Q: **I want to add "...." site. How to request.**
-
-<!---A: How to request a new site you can read [here](CONTRIBUTING.md#how-to-request-a-new-site)--->
-**I'm currently not accepting requests to develop new sites.**
-
-----
-
-#### Q: **Site download failed.**
-
-A: Check your credentials and **[SITES REQUIREMENTS](https://github.com/AAndyProgram/SCrawler/wiki/Settings#sites-requirements)**. If all settings are set, but nothing works, go to [create a new issue](https://github.com/AAndyProgram/SCrawler/issues). Don't forget to attach the LOG.
-
-**You also can join our Discord server**: https://discord.gg/uFNUXvFFmg
-<br/>*You can get help faster there!*
+# How to report a problem
+1. **Post your problem [here](https://github.com/AAndyProgram/SCrawler/issues) or in the [help channel](https://discord.com/channels/1124032649682493462/1124281838056259614) on our Discord server**
+2. Attach the **profile URLs or links** that you cannot download.
+3. Attach the **LOG** if it exists.
+4. Attach **the environment information** copied from SCrawler (click the top right info button in the main window, then the `Environment` button, then the `Copy` button, and paste the copied text into the message).
+5. *Add screenshots to illustrate the problem (**optional**)*
 
 **ATTENTION! Issues without URLs will be closed without a response!**
 
-----
+# Most frequently questions about SCrawler
 
-#### Q: **I have set credentials but still nothing is downloading**
+**If something doesn't download, always check the [SITE'S REQUIREMENTS](https://github.com/AAndyProgram/SCrawler/wiki/Settings#sites-requirements) before asking questions!**
 
-A: Click the `Start downloading` button or press `F5`
+*How to use: find your problem in the list and read the answer.*
 
-----
+## General questions
+- **PROFILES**
+    - I added a profile but **nothing downloaded** :arrow_forward: check your cookies and [site requirements](https://github.com/AAndyProgram/SCrawler/wiki/Settings#sites-requirements). If there are any optional fields that you don't fill in, do so. Still nothing works - [report it](#how-to-report-a-problem)!
+    - User downloading failed :arrow_forward: check your credentials and **[SITES REQUIREMENTS](https://github.com/AAndyProgram/SCrawler/wiki/Settings#sites-requirements)**. If all settings are set and nothing works, [report it](#how-to-report-a-problem). **Don't forget to attach the LOG.**
+    - [How to redownload user](https://github.com/AAndyProgram/SCrawler/wiki#redownload-user)
+    - How to **add profile** to download :arrow_forward: copy the **[profile URL](https://github.com/AAndyProgram/SCrawler/wiki#add-user)** and press `Insert` or `Ctrl+Insert`. **ALWAYS PASTE THE USER PROFILE URL**. After that select this user and press `F5` or click the `Download selected` button.
+- How to download **[saved posts](https://github.com/AAndyProgram/SCrawler/wiki#saved-posts)**
+- **[HOW TO ADD COOKIES](https://github.com/AAndyProgram/SCrawler/wiki/Settings#how-to-set-up-cookies)**
+- [How to report a problem](#how-to-report-a-problem)
+- I want you to **add the site** to SCrawler :arrow_forward: **I'm not currently accepting requests to add new sites**, but you can [create a plugin](https://github.com/AAndyProgram/SCrawler/wiki/Plugins) (for your site) for SCrawler.
+- What language is SCrawler written in :arrow_forward: `vb.net`
+- I don't know `vb.net` and I can't write a plugin :arrow_forward: you can write a plugin in `C#`
+- I have a suggestion, will it be added :arrow_forward: maybe if it interested me.
+- How to name files using a pattern (e.g. `Site_PostID_Name.jpg`) :arrow_forward: **there is no such functionality and there are no such plans**.
+- **DON'T CHANGE THE DEFAULT SITE SETTINGS UNLESS YOU KNOW EXACTLY WHAT YOU'RE DOING!** SCrawler already has all the default settings to work. You only need to add credentials (where [required](https://github.com/AAndyProgram/SCrawler/wiki/Settings#sites-requirements)).
+- My computer shut down while SCrawler was running and now **SCrawler won't start or some users are missing** :arrow_forward: restore user settings from [backup](#backup).
+- Installation, update and configuration
+    - How to install: https://github.com/AAndyProgram/SCrawler#installation
+    - How to update: https://github.com/AAndyProgram/SCrawler#updating
+    - What file executes the program: **`SCrawler.exe`**
+    - Where to find binaries: https://github.com/AAndyProgram/SCrawler/releases/latest
+	- [How to build from source](https://github.com/AAndyProgram/SCrawler/blob/main/CONTRIBUTING.md#how-to-build-from-source)
+    - [Video how to configure](#video-how-to-configure)
+- **Antivirus**
+    - **Antivirus detects SCrawler as a virus** :arrow_forward: SCrawler doesn't contain any viruses at all. All code is posted on GitHub. You can review it. I have nothing to hide. SCrawler just downloads pictures and videos. That's all. If you trust SCrawler, you should just add it to the antivirus exceptions, as I did. Sometimes antiviruses identify SCawler as a virus. This is usually related to the number of files being edited (users' settings files) and the number of files being downloaded. In this case, the antivirus can also remove these files, which will damage users' settings. **If you don't trust SCrawler, just delete it.**
+    - **Antivirus detects gallery-dl as a virus** :arrow_forward: it's a trustworthy program that is trusted by thousands of people around the world. Antiviruses identify some builds as containing viruses, but this is not true. **If you don't trust gallery-dl, you can simply delete it. But if you delete it, you won't be able to download [Twitter & Pinterest](https://github.com/AAndyProgram/SCrawler/wiki/Settings#gallery-dl).** You should decide for yourself.
 
-#### Q: **Where can I find the release?**
+## Sites questions
 
-A: https://github.com/AAndyProgram/SCrawler/releases/latest
+*How to use: find the site you need in the list and read the answer.*
 
-----
+- Reddit: don't use credentials at all or configure [OAuth](https://github.com/AAndyProgram/SCrawler/wiki/Settings#how-to-get-reddit-credentials). **Reddit profiles can be downloaded without any credentials at all. Subreddits require OAuth! If nothing downloads, use OAuth!** Don't use OAuth token to download saved posts (use cookies only).
+- **META** (**Instagram**, Threads, Facebook): you need **cookies** and fill in **all fields**
+- **Instagram saved posts**: I don't consider questions like "I have 10k saved posts and only 1000 were downloaded". Download posts, remove them from saved posts, delete the `Saved posts` **settings folder**, repeat.
+- TikTok: works via yt-dlp. If something doesn't download, we need to wait until yt-dlp fixes it. TikTok doesn't require cookies to download.
+- Porn sites: **COOKIES**!
+- ThisVid: https://github.com/AAndyProgram/SCrawler/wiki/Settings#thisvid-faq
+- **OnlyFans**: cookies + **all fields** + [OF-Scraper (download the correct version that I pointed)](https://github.com/AAndyProgram/SCrawler/wiki/Settings#of-scraper) & [mp4decrypt](https://www.bento4.com/downloads/) & **DRM keys** to download DRM protected videos. [OF-Scraper support](https://github.com/AAndyProgram/SCrawler/wiki/Settings#of-scraper-support). Also read [this](https://github.com/AAndyProgram/SCrawler/wiki/Settings#onlyfans-faq)
+- **JustForFans**: **THE VIDEO ISN'T DOWNLOADING AT THE MOMENT** ([Issue](https://discord.com/channels/1124032649682493462/1205547615199039551/1231349555132366870))
 
-#### Q: **How to run the program?**
+## Other questions
 
-A: Double-click `SCrawler.exe`
+### Does the program remember the last download and check for new posts, downloading only new posts, or does the program download the entire profile every time
+The program stored posts IDs in users' folders. For the first time, the program downloads the entire profile. All subsequent times the program will check for new posts and download **only new posts**!
 
-----
+### Does this program have a GUI or CLI, and will a CLI be added in the future
+This is a GUI program and **NO**, <u>CLI will not be added</u>
 
-#### Q: **Where to find binaries?**
+### How to remove the label
+There is no functionality to remove an individual label. You can open the `Labels.txt` file in the program settings folder and delete any label you want. You also can delete this file (`Labels.txt`). In this case, when SCrawler is launched, the list of labels will be populated only with existing labels (from the user data files).
 
-A: https://github.com/AAndyProgram/SCrawler/releases/latest
+### How to remove a user from the blacklist
+Just add that user back to the program. In the dialog box that opens, click the `Add and remove from blacklist` button.
 
-----
+### You lost me. Your program is too complicated.
+**I'm fine with that**. If the program is too complicated for you or you can't configure it, I can only suggest you find another (easier) program. I really don't mind! The program is free. I develop SCrawler for myself and publish it on GitHub because people found my program useful. If someone can't use it or doesn't like it, I'm okay with it.
 
-#### Q: **Does the program remember the last download and check for new posts, downloading only new posts? Or does the program download the entire profile every time?**
+### Add a step-by-step guide or video on how to use the program
+**NO!** The guide fully covers all the functionality of SCrawler! If you don't respect my work, I don't waste my time. If you want, you can create a video tutorial and send it to me. Then I'll add it. All options and their purposes are described on the wiki. The wiki also contains a description of all the settings and how to configure them. For complex settings there is a step-by-step guide. Read the [main](README.md) information and [GUIDE](https://github.com/AAndyProgram/SCrawler/wiki/) and you won't have any problems. I've developed a program with an intuitive interface. There is a `Settings` button, download buttons, a context menu that appears when you right-click on a user, and other controls. Anyone can use it.
 
-A: The program stored posts IDs in users' folders. For the first time, the program downloads the entire profile. All subsequent times the program will check for new posts and download **only new posts**!
+**There is already a [video](#video-how-to-configure) example of how to configure a site.**
 
-----
-
-#### Q: **How to redownload all data**
-
-A: https://github.com/AAndyProgram/SCrawler/wiki#redownload-user
-
-----
-
-#### Q: **How to remove the label**
-
-A: There is no functionality to remove an individual label. You can open the `Labels.txt` file in the program settings folder and delete any label you want. You also can delete this file (`Labels.txt`). In this case, when the program starts, the list of labels list will be updated with only existing labels (from the user data files).
-
-----
-
-#### Q: **How to remove a user from the blacklist**
-
-A: Just add that user back to the program. In the dialog box that opens, click on the `Add and remove from blacklist` button.
-
-----
-
-#### Q: **Why don't you answer how it works**
-
-A: Because **I don't want to**. I don't want to waste my time explaining things that are already covered in the **[GUIDE](https://github.com/AAndyProgram/SCrawler/wiki)**! If you didn't bother to read the guide, why would I waste my time?! ALL FUNCTIONALITY IS DESCRIBED IN THE GUIDE. Before publishing a new release, I update the guide. If you don't respect my work, I don't waste my time.
-
-----
-
-#### Q: **You lost me. Your program is too complicated.**
-
-A: **I'm fine with that**. If the program is difficult for you or you can't configure it, I can only suggest you find another (easier) program. I really don't mind! The program is free. I am develop SCrawler for myself and publish on GitHub because people found my program useful. If someone can't use it or doesn't like it, I'm fine.
-
-----
-
-#### Q: **I can't configure something**
-
-A: I can only [suggest](#q-you-lost-me-your-program-is-too-complicated) you find another (easier) program.
-
-----
-
-#### Q: **Can you add a step-by-step guide or video on how to use the program?**
-
-A: **NO!** The guide fully covers all the functionality of SCrawler! If you don't respect my work, I don't waste my time. If you want, you can create a video tutorial and send it to me. Then I add it. All options and what each option does described on the wiki. The wiki also contains a description of all settings and how-to configure them. For complex settings, there is a steep-by-steep guide. Read the [main](README.md) information and [GUIDE](https://github.com/AAndyProgram/SCrawler/wiki/) and you won't have any problems. I have developed a program with an intuitive interface. There is a Settings button, download buttons, a context menu that drops down when a user is clicked, and other controls. Anyone can use it.
+# Video how to configure
 
 **The following video was recorded by a user who loves SCrawler and demonstrates how to add credentials using Instagram as an example:**
 

README.md

@@ -82,7 +82,7 @@ A program to download photo and video from [any site](#supported-sites) (e.g. Yo
 - **Instagram**
 - **Threads**
 - **Facebook**
-- JustForFans *(partial support)*[^1]
+- JustForFans *(partial support) ([video issue](https://discord.com/channels/1124032649682493462/1205547615199039551/1231349555132366870))*[^1]
 - Mastodon *(out of support)*
 - TikTok
 - RedGifs

SCrawler.YouTube/Base/YouTubeSettings.vb

@@ -191,7 +191,7 @@ Namespace API.YouTube.Base
         <Browsable(True), GridVisible, XMLVN({"Defaults"}), Category("Defaults"), DisplayName("Use cookies"),
             Description("By default, use cookies when downloading from YouTube.")>
         Public ReadOnly Property DefaultUseCookies As XMLValue(Of Boolean)
-        <Browsable(True), GridVisible, XMLVN({"Defaults"}, Protocols.Any), Category("Defaults"), DisplayName("Protocol"),
+        <Browsable(True), GridVisible, XMLVN({"Defaults"}, Protocols.https), Category("Defaults"), DisplayName("Protocol"),
             Description("Priority download protocol. Default: 'Any'")>
         Public ReadOnly Property DefaultProtocol As XMLValue(Of Protocols)
         <Browsable(True), GridVisible(False), XMLVN({"Defaults"}), Category("Defaults"),
@@ -267,6 +267,9 @@ Namespace API.YouTube.Base
         <Browsable(True), GridVisible, XMLVN({"Defaults"}), Category("Defaults"), DisplayName("Add date to title: video list"),
             Description("Add video upload date before video title (visual only) in the video list")>
         Public ReadOnly Property FileAddDateToFileName_VideoList As XMLValue(Of Boolean)
+        <Browsable(True), GridVisible, XMLVN({"Defaults"}, FileDateMode.None), Category("Defaults"), DisplayName("Add channel to file name"),
+            Description("Add channel name before/after the file name")>
+        Public ReadOnly Property FileAddChannelToFileName As XMLValue(Of FileDateMode)
 #End Region
 #Region "Defaults ChannelsDownload"
         <Browsable(True), GridVisible, XMLVN({"Defaults", "Channels"}), Category("Defaults"), DisplayName("Default download tabs for channels"),
@@ -311,6 +314,9 @@ Namespace API.YouTube.Base
         <Browsable(True), GridVisible, XMLVN({"DefaultsVideo"}, 1080), Category("Defaults Video"), DisplayName("Default definition"),
             Description("The default maximum video resolution. -1 for max definition")>
         Public ReadOnly Property DefaultVideoDefinition As XMLValue(Of Integer)
+        <Browsable(True), GridVisible, XMLVN({"DefaultsVideo"}, True), Category("Defaults Video"), DisplayName("Allow webm formats"),
+            Description("Allow webm formats over http if mp4 formats are not available. Default: true.")>
+        Public ReadOnly Property DefaultVideoAllowWebm As XMLValue(Of Boolean)
         <Browsable(True), GridVisible, XMLVN({"DefaultsVideo"}), Category("Defaults Video"), DisplayName("Convert non-AVC codecs to AVC"),
             Description("Convert non-AVC codecs (eg 'VP9') to AVC. Not recommended due to high CPU usage!")>
         Public ReadOnly Property DefaultVideoConvertNonAVC As XMLValue(Of Boolean)
@@ -416,6 +422,9 @@ Namespace API.YouTube.Base
         <Browsable(True), GridVisible, XMLVN({"DefaultsAudio"}, True), Category("Defaults Audio"), DisplayName("Embed thumbnail"),
             Description("Embed thumbnail in the audio as cover art. Default: true.")>
         Public ReadOnly Property DefaultAudioEmbedThumbnail As XMLValue(Of Boolean)
+        <Browsable(True), GridVisible, XMLVN({"DefaultsAudio"}, True), Category("Defaults Audio"), DisplayName("Embed thumbnail (cover)"),
+            Description("Try embedding the playlist cover (if it exists) as cover art. Default: true.")>
+        Public ReadOnly Property DefaultAudioEmbedThumbnail_Cover As XMLValue(Of Boolean)
         <Browsable(True), GridVisible, XMLVN({"DefaultsAudio"}, True), Category("Defaults Audio"), DisplayName("Embed thumbnail (extracted files)"),
             Description("Embed thumbnail in the extracted (additional file ('mp3' only)) audio as cover art. Default: true.")>
         Public ReadOnly Property DefaultAudioEmbedThumbnail_ExtractedFiles As XMLValue(Of Boolean)

SCrawler.YouTube/Controls/VideoOptionsForm.vb

@@ -32,6 +32,7 @@ Namespace API.YouTube.Controls
         Private Initialization As Boolean = True
         Private ReadOnly InheritsFromContainer As Boolean
         Private ReadOnly M3U8Files As List(Of SFile)
+        Friend Property UseCookies As Boolean = False
         Private ReadOnly Property M3U8FilesFull As List(Of SFile)
             Get
                 Return ListAddList(Nothing, M3U8Files, LAP.NotContainsOnly).ListAddValue(CMB_PLS.Text, LAP.NotContainsOnly)
@@ -65,6 +66,7 @@ Namespace API.YouTube.Controls
             CNT_PROCESSOR = New TableControlsProcessor(TP_CONTROLS)
             Me.InheritsFromContainer = InheritsFromContainer
             MyFieldsChecker = New FieldsChecker
+            UseCookies = MyYouTubeSettings.DefaultUseCookies
         End Sub
 #End Region
 #Region "Form handlers"
@@ -227,7 +229,7 @@ Namespace API.YouTube.Controls
                 Dim data As IEnumerable(Of Control)
 
                 If .HasElements Then
-                    data = .Elements.Select(Function(ee) New MediaItem(ee, True) With {.Dock = DockStyle.Fill, .Checked = ee.Checked})
+                    data = .Elements.Select(Function(ee) New MediaItem(ee, True) With {.Dock = DockStyle.Fill, .Checked = ee.Checked, .UseCookies = UseCookies})
                 Else
                     data = (From m As MediaObject In .Self.MediaObjects
                             Where m.Type = __contentType

SCrawler.YouTube/Declarations.vb

@@ -59,6 +59,7 @@ Namespace API.YouTube
         Public ReadOnly TrueUrlRegEx As RParams = RParams.DM(Base.YouTubeFunctions.TrueUrlPattern, 0, EDP.ReturnValue)
         Friend ReadOnly MusicUrlApply As RParams = RParams.DMS("https://([w\.]*)youtube.com.+", 1, RegexReturn.Replace, EDP.ReturnValue,
                                                                CType(Function(input$) "music.", Func(Of String, String)), String.Empty)
+        Friend ReadOnly M3U8ExcludedSymbols As String() = {".", ",", ":", "/", "\", "(", ")", "[", "]"}
         <Extension> Friend Function ToMusicUrl(ByVal URL As String, ByVal IsMusic As Boolean) As String
             Try : Return If(IsMusic And Not URL.IsEmptyString, CStr(RegexReplace(URL, MusicUrlApply)).IfNullOrEmpty(URL), URL) : Catch : Return URL : End Try
         End Function

SCrawler.YouTube/Downloader/MediaItem.vb

@@ -437,7 +437,7 @@ Namespace DownloadObjects.STDownloader
                     Else
                         RaiseEvent BeforeOpenEditor(Me, MyContainer)
                     End If
-                    Using f As New VideoOptionsForm(MyContainer, initProtected Or isFull)
+                    Using f As New VideoOptionsForm(MyContainer, initProtected Or isFull) With {.UseCookies = UseCookies}
                         f.ShowDialog()
                         .Protected = IIf(f.DialogResult = DialogResult.OK, True, initProtected)
                     End Using
@@ -465,12 +465,12 @@ Namespace DownloadObjects.STDownloader
             If Not MyContainer Is Nothing Then
                 Dim f As Form = Nothing
                 Select Case MyContainer.ObjectType
-                    Case Base.YouTubeMediaType.Single : f = New VideoOptionsForm(MyContainer, True)
+                    Case Base.YouTubeMediaType.Single : f = New VideoOptionsForm(MyContainer, True) With {.UseCookies = UseCookies}
                     Case Base.YouTubeMediaType.Channel, Base.YouTubeMediaType.PlayList
                         If MyContainer.IsMusic Then
                             f = New MusicPlaylistsForm(MyContainer)
                         Else
-                            f = New VideoOptionsForm(MyContainer, True)
+                            f = New VideoOptionsForm(MyContainer, True) With {.UseCookies = UseCookies}
                         End If
                 End Select
                 If Not f Is Nothing Then

SCrawler.YouTube/Downloader/VideoListForm.vb

@@ -132,7 +132,8 @@ Namespace DownloadObjects.STDownloader
 #End Region
 #Region "Controls"
         Protected Sub ControlCreateAndAdd(ByVal Container As IYouTubeMediaContainer, Optional ByVal DisableDownload As Boolean = False,
-                                          Optional ByVal PerformClick As Boolean = True, Optional ByVal IsLoading As Boolean = False)
+                                          Optional ByVal PerformClick As Boolean = True, Optional ByVal IsLoading As Boolean = False,
+                                          Optional ByVal UseCookies As Boolean = False)
             ControlInvokeFast(TP_CONTROLS, Sub()
                                                With TP_CONTROLS
                                                    .SuspendLayout()
@@ -142,7 +143,7 @@ Namespace DownloadObjects.STDownloader
                                                    .RowStyles.Insert(0, New RowStyle(SizeType.Absolute, 60))
                                                    .RowCount = .RowStyles.Count
                                                    OffsetControls(0, True)
-                                                   Dim cnt As New MediaItem(Container) With {.Dock = DockStyle.Fill, .Margin = New Padding(0)}
+                                                   Dim cnt As New MediaItem(Container) With {.Dock = DockStyle.Fill, .Margin = New Padding(0), .UseCookies = UseCookies}
                                                    AddHandler cnt.FileDownloaded, AddressOf MediaControl_FileDownloaded
                                                    AddHandler cnt.Removal, AddressOf MediaControl_Removal
                                                    AddHandler cnt.DownloadAgain, AddressOf MediaControl_DownloadAgain
@@ -333,19 +334,19 @@ Namespace DownloadObjects.STDownloader
                     If Not c Is Nothing Then
                         Dim f As Form
                         Select Case c.ObjectType
-                            Case YouTubeMediaType.Single : f = New VideoOptionsForm(c)
+                            Case YouTubeMediaType.Single : f = New VideoOptionsForm(c) With {.UseCookies = useCookies}
                             Case YouTubeMediaType.Channel, YouTubeMediaType.PlayList
                                 If c.IsMusic Then
                                     f = New MusicPlaylistsForm(c)
                                 Else
-                                    f = New VideoOptionsForm(c)
+                                    f = New VideoOptionsForm(c) With {.UseCookies = useCookies}
                                 End If
                             Case Else : c.Dispose() : Throw New ArgumentException($"Object type {c.ObjectType} not implemented", "IYouTubeMediaContainer.ObjectType")
                         End Select
                         If Not f Is Nothing Then
                             If TypeOf f Is IDesignXMLContainer Then DirectCast(f, IDesignXMLContainer).DesignXML = DesignXML
                             f.ShowDialog()
-                            If f.DialogResult = DialogResult.OK AndAlso ValidateContainerURL(c) Then ControlCreateAndAdd(c, disableDown)
+                            If f.DialogResult = DialogResult.OK AndAlso ValidateContainerURL(c) Then ControlCreateAndAdd(c, disableDown,,, useCookies)
                             f.Dispose()
                         End If
                     End If

SCrawler.YouTube/My Project/AssemblyInfo.vb

@@ -13,7 +13,7 @@ Imports System.Runtime.InteropServices
 <Assembly: AssemblyDescription("YouTube plugin environment")>
 <Assembly: AssemblyCompany("AndyProgram")>
 <Assembly: AssemblyProduct("SCrawler.YouTube")>
-<Assembly: AssemblyCopyright("Copyright © 2024")>
+<Assembly: AssemblyCopyright("Copyright © 2025")>
 <Assembly: AssemblyTrademark("AndyProgram")>
 
 <Assembly: ComVisible(False)>
@@ -32,6 +32,6 @@ Imports System.Runtime.InteropServices
 ' by using the '*' as shown below:
 ' <Assembly: AssemblyVersion("1.0.*")>
 
-<Assembly: AssemblyVersion("2024.7.24.0")>
-<Assembly: AssemblyFileVersion("2024.7.24.0")>
+<Assembly: AssemblyVersion("2025.1.12.0")>
+<Assembly: AssemblyFileVersion("2025.1.12.0")>
 <Assembly: NeutralResourcesLanguage("en")>

SCrawler.YouTube/Objects/YouTubeMediaContainerBase.vb

@@ -175,7 +175,9 @@ Namespace API.YouTube.Objects
         Protected _ThumbnailUrl As String = String.Empty
         <XMLEC> Public Overridable Property ThumbnailUrl As String Implements IDownloadableMedia.ThumbnailUrl
             Get
-                If _ThumbnailUrl.IsEmptyString And Thumbnails.Count > 0 Then
+                If Not CoverURL.IsEmptyString Then
+                    Return CoverURL
+                ElseIf _ThumbnailUrl.IsEmptyString And Thumbnails.Count > 0 Then
                     Return Thumbnails.FirstOrDefault.URL
                 Else
                     Return _ThumbnailUrl
@@ -683,10 +685,17 @@ Namespace API.YouTube.Objects
         Friend Sub FileDateUpdate()
             Dim n$ = _File.Name.StringTrim
             Dim s$ = IIf(n.IsEmptyString, String.Empty, " ")
+            Dim c$ = AccountName.IfNullOrEmpty(UserID)
             Select Case MyYouTubeSettings.FileAddDateToFileName.Value
                 Case FileDateMode.Before : n = $"[{DateAdded:yyyy-MM-dd}]{s}{n}"
                 Case FileDateMode.After : n = $"{n}{s}[{DateAdded:yyyy-MM-dd}]"
             End Select
+            If Not c.IsEmptyString Then
+                Select Case MyYouTubeSettings.FileAddChannelToFileName.Value
+                    Case FileDateMode.Before : n = $"[{c}] {n}"
+                    Case FileDateMode.After : n = $"{n} [{c}]"
+                End Select
+            End If
             _File.Name = n
         End Sub
         Public Property FileSettings As SFile
@@ -904,7 +913,8 @@ Namespace API.YouTube.Objects
             Const m3u8DataRow$ = "#EXTINF:{0},{1}" & vbCrLf & "{2}"
             With Element
                 Dim f As SFile = __file.IfNullOrEmpty(.File)
-                Dim __f$ = SymbolsConverter.ASCII.EncodeSymbolsOnly(If(Mode = M3U8CreationMode.Absolute, f.ToString, f.File))
+                Dim fStr$ = f.ToString.StringReplaceSymbols({"\"}, "/", EDP.ReturnValue)
+                Dim __f$ = SymbolsConverter.ASCII.Extended.EncodeSymbolsOnly(If(Mode = M3U8CreationMode.Absolute, fStr, f.File), M3U8ExcludedSymbols)
                 If Mode = M3U8CreationMode.Absolute Then __f = $"file:///{__f}"
                 Dim fName$ = .Title.IfNullOrEmpty(f.Name)
                 If MyYouTubeSettings.MusicPlaylistCreate_M3U8_AppendNumber And .PlaylistIndex > 0 Then fName = $"{ .PlaylistIndex}. {fName}"
@@ -1022,12 +1032,19 @@ Namespace API.YouTube.Objects
                     End If
 
                     Dim cDown As Boolean = False
+                    Dim fCover As SFile = Nothing
+                    Dim cUrl$ = String.Empty
                     For Each elem In Elements
                         With DirectCast(elem, YouTubeMediaContainerBase)
-                            If Not .CoverDownloaded Then .CoverDownloaded = cDown
+                            'If Not .CoverDownloaded Then .CoverDownloaded = cDown
+                            .CoverDownloaded = cDown
+                            .CoverFile = fCover
+                            .CoverURL = cUrl
                             AddHandler .FileDownloadStarted, fDown
                             .Download(UseCookies, Token)
                             cDown = .CoverDownloaded
+                            fCover = .CoverFile
+                            cUrl = .CoverURL
                             RemoveHandler .FileDownloadStarted, fDown
                         End With
                         If Token.IsCancellationRequested Or disposedValue Then Exit For
@@ -1054,6 +1071,8 @@ Namespace API.YouTube.Objects
             End Try
         End Sub
         Protected CoverDownloaded As Boolean = False
+        Protected CoverFile As SFile = Nothing
+        Protected CoverURL As String = String.Empty
         Private Sub DownloadPlaylistCover(ByVal PlsId As String, ByVal f As SFile, ByVal UseCookies As Boolean)
             Try
                 Dim url$ = $"https://{IIf(IsMusic, "music", "www")}.youtube.com/playlist?list={PlsId}"
@@ -1089,7 +1108,8 @@ Namespace API.YouTube.Objects
                                 url = LinkFormatterSecure(u)
                                 f.Name = "cover"
                                 f.Extension = "jpg"
-                                If resp.DownloadFile(url, f, EDP.ReturnValue) And f.Exists Then CoverDownloaded = True : AddFile(f)
+                                If resp.DownloadFile(url, f, EDP.ReturnValue) And f.Exists Then _
+                                   CoverFile = f : CoverURL = url : CoverDownloaded = True : AddFile(f)
                             End If
                         End If
                     End Using
@@ -1201,6 +1221,9 @@ Namespace API.YouTube.Objects
                                     fileDesr.Extension = "txt"
                                     Using fileDesrText As New TextSaver(fileDesr)
                                         If .CreateDescriptionFiles_AddUploadDate Then fileDesrText.Append($"Uploaded: {DateAdded:yyyy-MM-dd HH:mm:ss}")
+                                        fileDesrText.AppendLine($"URL: {URL}")
+                                        fileDesrText.AppendLine($"Channel name: {AccountName}")
+                                        fileDesrText.AppendLine($"Channel ID: {UserID}")
                                         If Not Description.IsEmptyString Then
                                             If Not fileDesrText.IsEmptyString Then fileDesrText.AppendLine.AppendLine()
                                             fileDesrText.Append(Description)
@@ -1270,10 +1293,10 @@ Namespace API.YouTube.Objects
                                     End Sub
                                 Dim embedThumbTo As Action(Of SFile) =
                                     Sub(ByVal dFile As SFile)
-                                        If dFile.Exists And ThumbnailFile.Exists Then
+                                        If dFile.Exists And CoverFile.IfNullOrEmpty(ThumbnailFile).Exists Then
                                             Dim dFileNew As SFile = dFile
                                             dFileNew.Name &= "_NEW"
-                                            .Execute($"ffmpeg -i ""{dFile}"" -i ""{ThumbnailFile}"" -map 0:0 -map 1:0 -c copy -id3v2_version 3 -metadata:s:v title=""Cover"" -metadata:s:v comment=""Cover"" ""{dFileNew}""")
+                                            .Execute($"ffmpeg -i ""{dFile}"" -i ""{CoverFile.IfNullOrEmpty(ThumbnailFile)}"" -map 0:0 -map 1:0 -c copy -id3v2_version 3 -metadata:s:v title=""Cover"" -metadata:s:v comment=""Cover"" ""{dFileNew}""")
                                             If dFileNew.Exists AndAlso dFile.Delete(,, EDP.ReturnValue) Then SFile.Rename(dFileNew, dFile)
                                         End If
                                     End Sub
@@ -1353,6 +1376,10 @@ Namespace API.YouTube.Objects
                                     End If
                                 End If
 
+                                'mp3
+                                If IsMusic And ObjectType = YouTubeMediaType.Single And File.Extension = mp3 And
+                                   Not mp3ThumbEmbedded And CoverFile.Exists And MyYouTubeSettings.DefaultAudioEmbedThumbnail_Cover Then embedThumbTo.Invoke(File)
+
                                 'Update video
                                 ThrowAny(Token)
                                 If SelectedVideoIndex >= 0 AndAlso tempFilesList.Count > 0 AndAlso tempFilesList.Exists(Function(tf) tf.ToReplace) Then
@@ -1725,6 +1752,7 @@ Namespace API.YouTube.Objects
                 Dim obj As MediaObject
                 Dim nValue#
                 Dim sValue$
+                Dim allowWebm As Boolean = MyYouTubeSettings.DefaultVideoAllowWebm
                 Dim validCodecValue As Func(Of String, Boolean) = Function(codec) Not codec.IsEmptyString AndAlso Not codec = "none"
 
                 For Each ee In e({"formats"})
@@ -1775,12 +1803,13 @@ Namespace API.YouTube.Objects
                             Dim d As MediaObject = Nothing
                             Dim expWebm As Predicate(Of MediaObject) = Function(mo) mo.Extension = webm
                             Dim expAVC As Predicate(Of MediaObject) = Function(mo) mo.Codec.IfNullOrEmpty("/").ToLower.StartsWith(avc)
-                            Dim comp As Func(Of MediaObject, Predicate(Of MediaObject), Boolean, Boolean) =
-                                Function(mo, exp, isTrue) mo.Type = t And exp.Invoke(mo) = isTrue And mo.Width = d.Width
-                            Dim CountWebm As Func(Of MediaObject, Boolean) = Function(mo) comp.Invoke(mo, expWebm, False)
-                            Dim RemoveWebm As Predicate(Of MediaObject) = Function(mo) comp.Invoke(mo, expWebm, True)
-                            Dim CountAVC As Func(Of MediaObject, Boolean) = Function(mo) comp.Invoke(mo, expAVC, True)
-                            Dim RemoveAVC As Predicate(Of MediaObject) = Function(mo) comp.Invoke(mo, expAVC, False)
+                            Dim comp As Func(Of MediaObject, Predicate(Of MediaObject), Boolean, Boolean, Boolean) =
+                                Function(mo, exp, isTrue, checkHttp) mo.Type = t And exp.Invoke(mo) = isTrue And mo.Width = d.Width And
+                                                                     (Not checkHttp OrElse mo.ProtocolType = Protocols.https)
+                            Dim CountWebm As Func(Of MediaObject, Boolean) = Function(mo) comp.Invoke(mo, expWebm, False, allowWebm)
+                            Dim RemoveWebm As Predicate(Of MediaObject) = Function(mo) comp.Invoke(mo, expWebm, True, allowWebm)
+                            Dim CountAVC As Func(Of MediaObject, Boolean) = Function(mo) comp.Invoke(mo, expAVC, True, False)
+                            Dim RemoveAVC As Predicate(Of MediaObject) = Function(mo) comp.Invoke(mo, expAVC, False, False)
                             For Each d In data
                                 If MediaObjects.Count = 0 Then Exit For
                                 If MediaObjects.LongCount(CountWebm) > 0 Then MediaObjects.RemoveAll(RemoveWebm)

SCrawler.YouTubeDownloader/My Project/AssemblyInfo.vb

@@ -13,7 +13,7 @@ Imports System.Runtime.InteropServices
 <Assembly: AssemblyDescription("SCrawler YouTube downloader")>
 <Assembly: AssemblyCompany("AndyProgram")>
 <Assembly: AssemblyProduct("SCrawler.YouTubeDownloader")>
-<Assembly: AssemblyCopyright("Copyright © 2024")>
+<Assembly: AssemblyCopyright("Copyright © 2025")>
 <Assembly: AssemblyTrademark("AndyProgram")>
 
 <Assembly: ComVisible(False)>
@@ -32,6 +32,6 @@ Imports System.Runtime.InteropServices
 ' by using the '*' as shown below:
 ' <Assembly: AssemblyVersion("1.0.*")>
 
-<Assembly: AssemblyVersion("2024.7.24.0")>
-<Assembly: AssemblyFileVersion("2024.7.24.0")>
+<Assembly: AssemblyVersion("2025.1.12.0")>
+<Assembly: AssemblyFileVersion("2025.1.12.0")>
 <Assembly: NeutralResourcesLanguage("en")>

SCrawler/API/Base/DeclaredNames.vb

@@ -28,6 +28,8 @@ Namespace API.Base
         Friend Const GifsDownloadCaption As String = "Download GIFs"
         Friend Const UseMD5ComparisonCaption As String = "Use MD5 comparison"
         Friend Const UseMD5ComparisonToolTip As String = "Each image will be checked for existence using MD5"
+        Friend Const UserNameChangeCaption As String = "UserName"
+        Friend Const UserNameChangeToolTip As String = "If the user has changed their UserName, you can set a new name here. Not required for new users."
         Private Sub New()
         End Sub
     End Class

SCrawler/API/Base/DownDetector.vb

@@ -6,8 +6,9 @@
 '
 ' This program is distributed in the hope that it will be useful,
 ' but WITHOUT ANY WARRANTY
-Imports System.Net
+Imports SCrawler.Plugin
 Imports PersonalUtilities.Functions.RegularExpressions
+Imports Download = SCrawler.Plugin.ISiteSettings.Download
 Namespace API.Base
     Friend NotInheritable Class DownDetector
         Private Shared ReadOnly Property Params As New RParams("x:.'([\S]+?)',.y:.(\d+)", -1, Nothing, RegexReturn.List)
@@ -34,34 +35,106 @@ Namespace API.Base
             Try
                 Dim l As List(Of Data) = Nothing
                 Dim l2 As List(Of Data) = Nothing
-                Using w As New WebClient
-                    Dim r$ = w.DownloadString($"https://downdetector.co.uk/status/{Site}/")
-                    If Not r.IsEmptyString Then
-                        l = RegexFields(Of Data)(r, {Params}, {1, 2})
-                        If l.ListExists(2) Then
-                            l.Sort()
-                            l2 = New List(Of Data)
-                            Dim d As Data
-                            Dim eDates As New List(Of Date)
-                            Dim MaxValue As Func(Of Date, Integer) = Function(dd) (From ddd In l Where ddd.Date = dd Select ddd.Value).DefaultIfEmpty(0).Max
-                            For i% = 0 To l.Count - 1
-                                If Not eDates.Contains(l(i).Date) Then
-                                    d = l(i)
-                                    d.Value = MaxValue(d.Date)
-                                    l2.Add(d)
-                                    eDates.Add(d.Date)
-                                End If
-                            Next
-                            eDates.Clear()
-                            l.Clear()
-                            l2.Sort()
-                        End If
+                Dim r$ = GetWebString($"https://downdetector.co.uk/status/{Site}/",, EDP.ThrowException)
+                If Not r.IsEmptyString Then
+                    l = RegexFields(Of Data)(r, {Params}, {1, 2})
+                    If l.ListExists(2) Then
+                        l.Sort()
+                        l2 = New List(Of Data)
+                        Dim d As Data
+                        Dim eDates As New List(Of Date)
+                        Dim MaxValue As Func(Of Date, Integer) = Function(dd) (From ddd As Data In l Where ddd.Date = dd Select ddd.Value).DefaultIfEmpty(0).Max
+                        For i% = 0 To l.Count - 1
+                            If Not eDates.Contains(l(i).Date) Then
+                                d = l(i)
+                                d.Value = MaxValue(d.Date)
+                                l2.Add(d)
+                                eDates.Add(d.Date)
+                            End If
+                        Next
+                        eDates.Clear()
+                        l.Clear()
+                        l2.Sort()
                     End If
-                End Using
+                End If
                 Return l2
             Catch ex As Exception
                 Return ErrorsDescriber.Execute(EDP.SendToLog + EDP.ReturnValue, ex, $"[DownDetector.GetData({Site})]")
             End Try
         End Function
+        Friend Interface IDownDetector
+            ReadOnly Property Value As Integer
+            ReadOnly Property AddToLog As Boolean
+            ReadOnly Property CheckSite As String
+            Function Available(ByVal What As Download, ByVal Silent As Boolean) As Boolean
+        End Interface
+        Friend Class Checker(Of T As {ISiteSettings, IDownDetector})
+            Protected ReadOnly Property Source As T
+            Private ReadOnly NP As New ANumbers With {.FormatOptions = ANumbers.Options.GroupIntegral}
+            Friend Sub New(ByRef _Source As T)
+                Source = _Source
+            End Sub
+            Private ____AvailableChecked As Boolean = False
+            Private ____AvailableResult As Boolean = False
+            Friend Overridable Function Available(ByVal What As Download, ByVal Silent As Boolean) As Boolean
+                If Settings.DownDetectorEnabled And Source.Value >= 0 Then
+                    If Not ____AvailableChecked Then
+                        ____AvailableResult = AvailableImpl(What, Silent)
+                        ____AvailableChecked = True
+                    End If
+                    Return ____AvailableResult
+                Else
+                    Return True
+                End If
+            End Function
+            Protected Overridable Function AvailableImpl(ByVal What As Download, ByVal Silent As Boolean) As Boolean
+                Try
+                    Source.AvailableText = String.Empty
+                    If Source.Value < 0 Then
+                        Return True
+                    Else
+                        Dim dl As List(Of Data) = GetData(Source.CheckSite)
+                        If dl.ListExists Then
+                            dl = dl.Take(4).ToList
+                            Dim avg% = dl.Average(Function(d) d.Value)
+                            If avg > Source.Value Then
+                                Source.AvailableText = $"Over the past hour, {Source.Site} has received an average of {avg.NumToString(NP)} outage reports:{vbCr}{dl.ListToString(vbCr)}"
+                                If Source.AddToLog Then MyMainLOG = Source.AvailableText
+                                If Silent Then
+                                    Return AvailableImpl_FALSE_SILENT()
+                                Else
+                                    If MsgBoxE({$"{Source.AvailableText}{vbCr}{vbCr}Do you want to continue parsing {Source.Site} data?",
+                                                $"There are outage reports on {Source.Site}"}, vbYesNo) = vbYes Then
+                                        Return AvailableImpl_FALSE_SILENT_NOT_MSG_YES()
+                                    Else
+                                        Return AvailableImpl_FALSE_SILENT_NOT_MSG_NO()
+                                    End If
+                                End If
+                            End If
+                        End If
+                        Return AvailableImpl_TRUE()
+                    End If
+                Catch ex As Exception
+                    Return ErrorsDescriber.Execute(EDP.SendToLog + EDP.ReturnValue, ex, $"[API.{Source.Site}.SiteSettings.Available([DownDetector])]", True)
+                End Try
+            End Function
+            Protected Overridable Function AvailableImpl_TRUE() As Boolean
+                Return True
+            End Function
+            Protected Overridable Function AvailableImpl_FALSE_SILENT() As Boolean
+                Return False
+            End Function
+            Protected Overridable Function AvailableImpl_FALSE_SILENT_NOT_MSG_YES() As Boolean
+                Return True
+            End Function
+            Protected Overridable Function AvailableImpl_FALSE_SILENT_NOT_MSG_NO() As Boolean
+                Return False
+            End Function
+            Friend Overridable Sub Reset()
+                ____AvailableChecked = False
+                ____AvailableResult = False
+                Source.AvailableText = String.Empty
+            End Sub
+        End Class
     End Class
 End Namespace

SCrawler/API/Base/UserDataBase.vb

@@ -80,6 +80,8 @@ Namespace API.Base
         Private _CollectionButtonsExists As Boolean = False
         Private _CollectionButtonsColorsSet As Boolean = False
         Friend WithEvents BTT_CONTEXT_DOWN As ToolStripKeyMenuItem
+        Friend WithEvents BTT_CONTEXT_DOWN_LIMIT As ToolStripKeyMenuItem
+        Friend WithEvents BTT_CONTEXT_DOWN_DATE As ToolStripKeyMenuItem
         Friend WithEvents BTT_CONTEXT_EDIT As ToolStripMenuItem
         Friend WithEvents BTT_CONTEXT_DELETE As ToolStripMenuItem
         Friend WithEvents BTT_CONTEXT_ERASE As ToolStripMenuItem
@@ -98,6 +100,8 @@ Namespace API.Base
                 End If
             End With
             BTT_CONTEXT_DOWN = New ToolStripKeyMenuItem(tn, i) With {.Name = tnn("DOWN"), .Tag = Me}
+            BTT_CONTEXT_DOWN_LIMIT = New ToolStripKeyMenuItem(tn, i) With {.Name = tnn("DOWN_LIMIT"), .Tag = Me}
+            BTT_CONTEXT_DOWN_DATE = New ToolStripKeyMenuItem(tn, i) With {.Name = tnn("DOWN_DATE"), .Tag = Me}
             BTT_CONTEXT_EDIT = New ToolStripMenuItem(tn, i) With {.Name = tnn("EDIT"), .Tag = Me}
             BTT_CONTEXT_DELETE = New ToolStripMenuItem(tn, i) With {.Name = tnn("DELETE"), .Tag = Me}
             BTT_CONTEXT_ERASE = New ToolStripMenuItem(tn, i) With {.Name = tnn("ERASE"), .Tag = Me}
@@ -117,7 +121,8 @@ Namespace API.Base
                 cb = MyColor.EditBack
                 cf = MyColor.EditFore
             End If
-            For Each b As ToolStripMenuItem In {BTT_CONTEXT_DOWN, BTT_CONTEXT_EDIT, BTT_CONTEXT_DELETE, BTT_CONTEXT_ERASE,
+            For Each b As ToolStripMenuItem In {BTT_CONTEXT_DOWN, BTT_CONTEXT_DOWN_LIMIT, BTT_CONTEXT_DOWN_DATE,
+                                                BTT_CONTEXT_EDIT, BTT_CONTEXT_DELETE, BTT_CONTEXT_ERASE,
                                                 BTT_CONTEXT_OPEN_PATH, BTT_CONTEXT_OPEN_SITE}
                 If Not b Is Nothing Then b.BackColor = cb : b.ForeColor = cf
             Next
@@ -410,9 +415,7 @@ Namespace API.Base
         End Function
         Friend Overridable Sub SetPicture(ByVal f As SFile) Implements IUserData.SetPicture
             Try
-                If f.Exists Then
-                    Using p As New UserImage(f, MyFile) : p.Save() : End Using
-                End If
+                If f.Exists Then UserImage.NewUserPicture(f, MyFile)
             Catch
             End Try
         End Sub
@@ -451,11 +454,7 @@ BlockPictureScan:
                                                      New ErrorsDescriber(EDP.ReturnValue) With {
                                                          .ReturnValue = New List(Of SFile),
                                                          .ReturnValueExists = True}).FirstOrDefault
-            If NewPicFile.Exists Then
-                p = New UserImage(NewPicFile, MyFile)
-                p.Save()
-                GoTo BlockReturn
-            End If
+            If NewPicFile.Exists Then p = UserImage.NewUserPicture(NewPicFile, MyFile,, True) : GoTo BlockReturn
 BlockDeletePictureFolder:
             On Error GoTo BlockReturn
             If DelPath Then
@@ -654,6 +653,7 @@ BlockNullPicture:
         End Sub
         Protected ReadOnly _TempMediaList As List(Of UserMedia)
         Protected ReadOnly _TempPostsList As List(Of String)
+        Private ReadOnly _MD5List As List(Of String)
         Friend Function GetLastImageAddress() As SFile
             If _ContentList.Count > 0 Then
                 Return _ContentList.LastOrDefault(Function(c) c.Type = UTypes.Picture And Not c.File.IsEmptyString And Not c.File.Extension = "gif").File
@@ -679,6 +679,7 @@ BlockNullPicture:
         Protected MyFileSettings As SFile
         Protected MyFileData As SFile
         Protected MyFilePosts As SFile
+        Private MyMD5File As SFile
         Friend Overridable Property FileExists As Boolean = False Implements IUserData.FileExists
         Friend Overridable Property DataMerging As Boolean
             Get
@@ -856,6 +857,7 @@ BlockNullPicture:
             LatestData = New List(Of UserMedia)
             _TempMediaList = New List(Of UserMedia)
             _TempPostsList = New List(Of String)
+            _MD5List = New List(Of String)
             Labels = New List(Of String)
             UserUpdatedEventHandlers = New List(Of IUserData.UserUpdatedEventHandler)
             UserDownloadStateChangedEventHandlers = New List(Of UserDownloadStateChangedEventHandler)
@@ -950,6 +952,9 @@ BlockNullPicture:
                 LogError(ex, "user information loading error")
             End Try
         End Sub
+        Private Sub UpdateUserInformation_Ex()
+            If _ForceSaveUserInfoOnException Then UpdateUserInformation()
+        End Sub
         Friend Overridable Overloads Sub UpdateUserInformation() Implements IUserData.UpdateUserInformation
             UpdateUserInformation(False)
         End Sub
@@ -1037,6 +1042,8 @@ BlockNullPicture:
                     If _ContentList.Count > 0 Then x.AddRange(_ContentList)
                     x.Save(MyFileData)
                 End Using
+                If Not MyMD5File.IsEmptyString And _MD5List.Count > 0 Then _
+                   TextSaver.SaveTextToFile(_MD5List.ListToString(Environment.NewLine), MyMD5File, True,, EDP.None)
             Catch ex As Exception
                 LogError(ex, "history saving error")
             End Try
@@ -1118,6 +1125,7 @@ BlockNullPicture:
         Protected UseClientTokens As Boolean = False
         Protected _ForceSaveUserData As Boolean = False
         Protected _ForceSaveUserInfo As Boolean = False
+        Protected _ForceSaveUserInfoOnException As Boolean = False
         Private _DownloadInProgress As Boolean = False
         Private _EnvirUserExists As Boolean
         Private _EnvirUserSuspended As Boolean
@@ -1131,11 +1139,13 @@ BlockNullPicture:
             TokenPersonal = Nothing
             ProgressPre.Reset()
             UpdateDataFiles()
+            _MD5Loaded = False
             _DownloadInProgress = True
             _DescriptionChecked = False
             _DescriptionEveryTime = Settings.UpdateUserDescriptionEveryTime
             _ForceSaveUserData = False
             _ForceSaveUserInfo = False
+            _ForceSaveUserInfoOnException = False
             _EnvirUserExists = UserExists
             _EnvirUserSuspended = UserSuspended
             _EnvirCreatedByChannel = CreatedByChannel
@@ -1212,7 +1222,7 @@ BlockNullPicture:
                 ProgressPre.Done()
                 ThrowAny(Token)
 
-                If UseMD5Comparison And Not IsSubscription Then ValidateMD5(Token) : ProgressPre.Done() : ThrowAny(Token)
+                If RemoveExistingDuplicates And Not IsSubscription Then ValidateMD5(Token) : ProgressPre.Done() : ThrowAny(Token)
 
                 If _TempPostsList.Count > 0 And Not DownloadMissingOnly And Not __isChannelsSupport Then
                     If _TempPostsList.Count > 1000 Then _TempPostsList.ListAddList(_TempPostsList.ListTake(-2, 1000, EDP.ReturnValue).ListReverse, LAP.ClearBeforeAdd)
@@ -1265,9 +1275,11 @@ BlockNullPicture:
                 ThrowIfDisposed()
                 If Not _PictureExists Or _EnvirInvokeUserUpdated Then OnUserUpdated()
             Catch oex As OperationCanceledException When Token.IsCancellationRequested Or TokenPersonal.IsCancellationRequested Or TokenQueue.IsCancellationRequested
+                UpdateUserInformation_Ex()
                 MyMainLOG = $"{ToStringForLog()}: downloading canceled"
                 Canceled = True
             Catch exit_ex As ExitException
+                UpdateUserInformation_Ex()
                 If Not exit_ex.Silent Then
                     If exit_ex.SimpleLogLine Then
                         MyMainLOG = $"{ToStringForLog()}: downloading interrupted (exit) ({exit_ex.Message})"
@@ -1275,11 +1287,14 @@ BlockNullPicture:
                         ErrorsDescriber.Execute(EDP.SendToLog, exit_ex, $"{ToStringForLog()}: downloading interrupted (exit)")
                     End If
                 End If
+                If _EnvirInvokeUserUpdated Then OnUserUpdated()
                 Canceled = True
             Catch dex As ObjectDisposedException When Disposed
                 Canceled = True
             Catch ex As Exception
+                UpdateUserInformation_Ex()
                 LogError(ex, "downloading data error")
+                If _EnvirInvokeUserUpdated Then OnUserUpdated()
                 HasError = True
             Finally
                 If Not UserExists Then AddNonExistingUserToLog($"User '{ToStringForLog()}' not found on the site")
@@ -1315,6 +1330,11 @@ BlockNullPicture:
                 MyFilePosts = MyFileSettings
                 MyFilePosts.Name &= "_Posts"
                 MyFilePosts.Extension = "txt"
+                If Not IsSavedPosts Then
+                    MyMD5File = MyFileSettings
+                    MyMD5File.Name &= "_MD5"
+                    MyMD5File.Extension = "txt"
+                End If
             Else
                 Throw New ArgumentNullException("User.File", "User file not detected")
             End If
@@ -1438,81 +1458,94 @@ BlockNullPicture:
         End Sub
 #End Region
 #Region "MD5 support"
-        Protected Const VALIDATE_MD5_ERROR As String = "VALIDATE_MD5_ERROR"
+        Private Const VALIDATE_MD5_ERROR As String = "VALIDATE_MD5_ERROR"
         Friend Property UseMD5Comparison As Boolean = False
         Protected Property StartMD5Checked As Boolean = False
         Friend Property RemoveExistingDuplicates As Boolean = False
-        Protected Overridable Sub ValidateMD5(ByVal Token As CancellationToken)
+        Private ReadOnly ErrMD5 As New ErrorsDescriber(EDP.ReturnValue)
+        Private _MD5Loaded As Boolean = False
+        Private Sub LoadMD5()
+            Try
+                If Not _MD5Loaded Then
+                    _MD5Loaded = True
+                    _MD5List.Clear()
+                    If _ContentList.Count > 0 Then _MD5List.ListAddList(_ContentList.Select(Function(c) c.MD5), LAP.NotContainsOnly, EDP.ReturnValue)
+                    If MyMD5File.Exists Then _MD5List.ListAddList(MyMD5File.GetLines, LAP.NotContainsOnly, EDP.ThrowException)
+                End If
+            Catch ex As Exception
+                ErrorsDescriber.Execute(EDP.SendToLog, ex, "LoadMD5")
+            End Try
+        End Sub
+        Private Function ValidateMD5_GetMD5(ByVal __data As UserMedia, ByVal IsUrl As Boolean) As String
+            Try
+                Dim ImgFormat As Imaging.ImageFormat = Nothing
+                Dim hash$ = String.Empty
+                Dim __isGif As Boolean = False
+                If __data.Type = UTypes.GIF Then
+                    ImgFormat = Imaging.ImageFormat.Gif
+                    __isGif = True
+                ElseIf Not __data.File.IsEmptyString Then
+                    ImgFormat = GetImageFormat(__data.File)
+                End If
+                If ImgFormat Is Nothing Then ImgFormat = Imaging.ImageFormat.Jpeg
+                If IsUrl And Not __isGif Then
+                    hash = ByteArrayToString(GetMD5(SFile.GetBytesFromNet(__data.URL.IfNullOrEmpty(__data.URL_BASE), ErrMD5), ImgFormat, ErrMD5))
+                ElseIf IsUrl And __isGif Then
+                    hash = ByteArrayToString(GetMD5FromBytes(SFile.GetBytesFromNet(__data.URL.IfNullOrEmpty(__data.URL_BASE), ErrMD5), ErrMD5))
+                Else
+                    hash = ByteArrayToString(GetMD5(SFile.GetBytes(__data.File, ErrMD5), ImgFormat, ErrMD5))
+                End If
+                If hash.IsEmptyString And Not __isGif Then
+                    If ImgFormat Is Imaging.ImageFormat.Jpeg Then ImgFormat = Imaging.ImageFormat.Png Else ImgFormat = Imaging.ImageFormat.Jpeg
+                    If IsUrl Then
+                        hash = ByteArrayToString(GetMD5(SFile.GetBytesFromNet(__data.URL.IfNullOrEmpty(__data.URL_BASE), ErrMD5), ImgFormat, ErrMD5))
+                    Else
+                        hash = ByteArrayToString(GetMD5(SFile.GetBytes(__data.File, ErrMD5), ImgFormat, ErrMD5))
+                    End If
+                End If
+                Return hash
+            Catch
+                Return String.Empty
+            End Try
+        End Function
+        Private Sub ValidateMD5(ByVal Token As CancellationToken)
             Try
                 Dim missingMD5 As Predicate(Of UserMedia) = Function(d) (d.Type = UTypes.GIF Or d.Type = UTypes.Picture) And d.MD5.IsEmptyString
-                If UseMD5Comparison And _TempMediaList.Exists(missingMD5) Then
+                If RemoveExistingDuplicates Then
+                    RemoveExistingDuplicates = False
+                    _ForceSaveUserInfo = True
+                    LoadMD5()
                     Dim i%
                     Dim itemsCount% = 0
                     Dim limit% = If(DownloadTopCount, 0)
                     Dim data As UserMedia = Nothing
-                    Dim hashList As New Dictionary(Of String, SFile)
                     Dim f As SFile
-                    Dim ErrMD5 As New ErrorsDescriber(EDP.ReturnValue)
-                    Dim __getMD5 As Func(Of UserMedia, Boolean, String) =
-                        Function(ByVal __data As UserMedia, ByVal IsUrl As Boolean) As String
-                            Try
-                                Dim ImgFormat As Imaging.ImageFormat = Nothing
-                                Dim hash$ = String.Empty
-                                Dim __isGif As Boolean = False
-                                If __data.Type = UTypes.GIF Then
-                                    ImgFormat = Imaging.ImageFormat.Gif
-                                    __isGif = True
-                                ElseIf Not __data.File.IsEmptyString Then
-                                    ImgFormat = GetImageFormat(__data.File)
-                                End If
-                                If ImgFormat Is Nothing Then ImgFormat = Imaging.ImageFormat.Jpeg
-                                If IsUrl And Not __isGif Then
-                                    hash = ByteArrayToString(GetMD5(SFile.GetBytesFromNet(__data.URL.IfNullOrEmpty(__data.URL_BASE), ErrMD5), ImgFormat, ErrMD5))
-                                ElseIf IsUrl And __isGif Then
-                                    hash = ByteArrayToString(GetMD5FromBytes(SFile.GetBytesFromNet(__data.URL.IfNullOrEmpty(__data.URL_BASE), ErrMD5), ErrMD5))
-                                Else
-                                    hash = ByteArrayToString(GetMD5(SFile.GetBytes(__data.File, ErrMD5), ImgFormat, ErrMD5))
-                                End If
-                                If hash.IsEmptyString And Not __isGif Then
-                                    If ImgFormat Is Imaging.ImageFormat.Jpeg Then ImgFormat = Imaging.ImageFormat.Png Else ImgFormat = Imaging.ImageFormat.Jpeg
-                                    If IsUrl Then
-                                        hash = ByteArrayToString(GetMD5(SFile.GetBytesFromNet(__data.URL.IfNullOrEmpty(__data.URL_BASE), ErrMD5), ImgFormat, ErrMD5))
-                                    Else
-                                        hash = ByteArrayToString(GetMD5(SFile.GetBytes(__data.File, ErrMD5), ImgFormat, ErrMD5))
-                                    End If
-                                End If
-                                Return hash
-                            Catch
-                                Return String.Empty
-                            End Try
-                        End Function
+
                     If Not StartMD5Checked Then
                         StartMD5Checked = True
-                        If _ContentList.Exists(missingMD5) Then
-                            Dim existingFiles As List(Of SFile) = SFile.GetFiles(MyFileSettings.CutPath, "*.jpg|*.jpeg|*.png|*.gif",, EDP.ReturnValue).ListIfNothing
-                            Dim eIndx%
-                            Dim eFinder As Predicate(Of SFile) = Function(ff) ff.File = data.File.File
-                            If RemoveExistingDuplicates Then
-                                RemoveExistingDuplicates = False
-                                _ForceSaveUserInfo = True
-                                If existingFiles.Count > 0 Then
-                                    Dim h$
-                                    ProgressPre.ChangeMax(existingFiles.Count)
-                                    For i = existingFiles.Count - 1 To 0 Step -1
-                                        ProgressPre.Perform()
-                                        h = __getMD5(New UserMedia With {.File = existingFiles(i)}, False)
-                                        If Not h.IsEmptyString Then
-                                            If hashList.ContainsKey(h) Then
-                                                MyMainLOG = $"{ToStringForLog()}: Removed image [{existingFiles(i).File}] (duplicate of [{hashList(h).File}])"
-                                                existingFiles(i).Delete(SFO.File, SFODelete.DeleteToRecycleBin, ErrMD5)
-                                                existingFiles.RemoveAt(i)
-                                            Else
-                                                hashList.Add(h, existingFiles(i))
-                                            End If
-                                        End If
-                                    Next
+                        Dim existingFiles As List(Of SFile) = SFile.GetFiles(MyFileSettings.CutPath, "*.jpg|*.jpeg|*.png|*.gif",, EDP.ReturnValue).ListIfNothing
+                        Dim eIndx%
+                        Dim eFinder As Predicate(Of SFile) = Function(ff) ff.File = data.File.File
+
+                        If existingFiles.Count > 0 Then
+                            Dim h$
+                            ProgressPre.ChangeMax(existingFiles.Count)
+                            For i = existingFiles.Count - 1 To 0 Step -1
+                                ProgressPre.Perform()
+                                h = ValidateMD5_GetMD5(New UserMedia With {.File = existingFiles(i)}, False)
+                                If Not h.IsEmptyString Then
+                                    If _MD5List.Contains(h) Then
+                                        MyMainLOG = $"{ToStringForLog()}: Removed image [{existingFiles(i).File}] (duplicate)"
+                                        existingFiles(i).Delete(SFO.File, SFODelete.DeleteToRecycleBin, ErrMD5)
+                                        existingFiles.RemoveAt(i)
+                                    Else
+                                        _MD5List.Add(h)
+                                    End If
                                 End If
-                            End If
+                            Next
+                        End If
+
+                        If _ContentList.Count > 0 AndAlso _ContentList.Exists(missingMD5) Then
                             ProgressPre.ChangeMax(_ContentList.Count)
                             For i = 0 To _ContentList.Count - 1
                                 data = _ContentList(i)
@@ -1522,61 +1555,34 @@ BlockNullPicture:
                                         ThrowAny(Token)
                                         eIndx = existingFiles.FindIndex(eFinder)
                                         If eIndx >= 0 Then
-                                            data.MD5 = __getMD5(New UserMedia With {.File = existingFiles(eIndx)}, False)
+                                            data.MD5 = ValidateMD5_GetMD5(New UserMedia With {.File = existingFiles(eIndx)}, False)
                                             If Not data.MD5.IsEmptyString Then _ContentList(i) = data : _ForceSaveUserData = True
                                         End If
                                     End If
                                     existingFiles.RemoveAll(eFinder)
                                 End If
                             Next
-                            If existingFiles.Count > 0 Then
-                                ProgressPre.ChangeMax(existingFiles.Count)
-                                For i = 0 To existingFiles.Count - 1
-                                    f = existingFiles(i)
-                                    ProgressPre.Perform()
-                                    data = New UserMedia(f.File) With {
-                                        .State = UStates.Downloaded,
-                                        .Type = IIf(f.Extension = "gif", UTypes.GIF, UTypes.Picture),
-                                        .File = f
-                                    }
-                                    ThrowAny(Token)
-                                    data.MD5 = __getMD5(data, False)
-                                    If Not data.MD5.IsEmptyString Then _ContentList.Add(data) : _ForceSaveUserData = True
-                                Next
-                                existingFiles.Clear()
-                            End If
                         End If
-                    End If
 
-                    If _ContentList.Count > 0 Then
-                        With _ContentList.Select(Function(d) d.MD5)
-                            If .ListExists Then .ToList.ForEach(Sub(md5value) _
-                               If Not md5value.IsEmptyString AndAlso Not hashList.ContainsKey(md5value) Then hashList.Add(md5value, New SFile))
-                        End With
-                    End If
-
-                    ProgressPre.ChangeMax(_TempMediaList.Count)
-                    For i = _TempMediaList.Count - 1 To 0 Step -1
-                        ProgressPre.Perform()
-                        If limit > 0 And itemsCount >= limit Then
-                            _TempMediaList.RemoveAt(i)
-                        Else
-                            data = _TempMediaList(i)
-                            If missingMD5(data) Then
+                        If existingFiles.Count > 0 Then
+                            ProgressPre.ChangeMax(existingFiles.Count)
+                            For i = 0 To existingFiles.Count - 1
+                                f = existingFiles(i)
+                                ProgressPre.Perform()
+                                data = New UserMedia(f.File) With {
+                                    .State = UStates.Downloaded,
+                                    .Type = IIf(f.Extension = "gif", UTypes.GIF, UTypes.Picture),
+                                    .File = f
+                                }
                                 ThrowAny(Token)
-                                data.MD5 = __getMD5(data, True)
-                                If Not data.MD5.IsEmptyString Then
-                                    If hashList.ContainsKey(data.MD5) Then
-                                        _TempMediaList.RemoveAt(i)
-                                    Else
-                                        hashList.Add(data.MD5, New SFile)
-                                        _TempMediaList(i) = data
-                                        itemsCount += 1
-                                    End If
-                                End If
-                            End If
+                                data.MD5 = ValidateMD5_GetMD5(data, False)
+                                If Not data.MD5.IsEmptyString Then _ContentList.Add(data) : _ForceSaveUserData = True
+                            Next
+                            existingFiles.Clear()
                         End If
-                    Next
+                    End If
+
+                    If _ContentList.Count > 0 Then _MD5List.ListAddList(_ContentList.Select(Function(d) d.MD5), LAP.NotContainsOnly, EDP.ReturnValue)
                 End If
             Catch iex As ArgumentOutOfRangeException When Disposed
             Catch ex As Exception
@@ -1614,6 +1620,7 @@ BlockNullPicture:
                 Source.Progress.Done()
             End Sub
         End Class
+        Protected Const VideoFolderName As String = "Video"
         Protected Sub DownloadContentDefault(ByVal Token As CancellationToken)
             Try
                 Dim i%
@@ -1622,6 +1629,7 @@ BlockNullPicture:
                 If _ContentNew.Count > 0 Then
                     _ContentNew.RemoveAll(Function(c) c.URL.IsEmptyString)
                     If _ContentNew.Count > 0 Then
+                        If UseMD5Comparison Then LoadMD5()
                         MyFile.Exists(SFO.Path)
                         Dim MissingErrorsAdd As Boolean = Settings.AddMissingErrorsToLog
                         Dim MyDir$ = DownloadContentDefault_GetRootDir()
@@ -1630,6 +1638,7 @@ BlockNullPicture:
                         Dim __interrupt As Boolean
                         Dim f As SFile
                         Dim v As UserMedia
+                        Dim __fileDeleted As Boolean
                         Dim fileNumProvider As SFileNumbers = SFileNumbers.Default
                         Dim __deleteFile As Action(Of SFile, String) = Sub(ByVal FileToDelete As SFile, ByVal FileUrl As String)
                                                                            Try
@@ -1641,9 +1650,21 @@ BlockNullPicture:
                                                                                ErrorsDescriber.Execute(EDP.SendToLog, file_del_ex)
                                                                            End Try
                                                                        End Sub
+                        Dim updateDownCount As Action = Sub()
+                                                            Dim __n% = IIf(__fileDeleted, -1, 1)
+                                                            If __isVideo Then
+                                                                v.Type = UTypes.Video
+                                                                DownloadedVideos(False) += __n
+                                                            ElseIf v.Type = UTypes.GIF Then
+                                                                DownloadedPictures(False) += __n
+                                                            Else
+                                                                v.Type = UTypes.Picture
+                                                                DownloadedPictures(False) += __n
+                                                            End If
+                                                        End Sub
 
                         Using w As New OptionalWebClient(Me)
-                            If vsf Then CSFileP($"{MyDir}\Video\").Exists(SFO.Path)
+                            If vsf Then CSFileP($"{MyDir}\{VideoFolderName}\").Exists(SFO.Path)
                             Progress.Maximum += _ContentNew.Count
                             If IsSingleObjectDownload Then
                                 If _ContentNew.Count = 1 And _ContentNew(0).Type = UTypes.Video Then
@@ -1671,6 +1692,8 @@ BlockNullPicture:
 
                                 If v.URL_BASE.IsEmptyString Then v.URL_BASE = v.URL
 
+                                __fileDeleted = False
+
                                 If Not f.IsEmptyString And Not v.URL.IsEmptyString Then
                                     Try
                                         __isVideo = v.Type = UTypes.Video Or f.Extension = "mp4" Or v.Type = UTypes.m3u8
@@ -1691,7 +1714,7 @@ BlockNullPicture:
                                         End If
                                         If __isVideo And vsf Then
                                             If v.SpecialFolder.IsEmptyString OrElse Not v.SpecialFolder.EndsWith("*") Then
-                                                f.Path = $"{f.PathWithSeparator}Video"
+                                                f.Path = $"{f.PathWithSeparator}{VideoFolderName}"
                                                 If Not v.SpecialFolder.IsEmptyString Then f.Exists(SFO.Path)
                                             End If
                                         End If
@@ -1715,19 +1738,26 @@ BlockNullPicture:
                                             End If
                                         End If
 
-                                        If __isVideo Then
-                                            v.Type = UTypes.Video
-                                            DownloadedVideos(False) += 1
-                                        ElseIf v.Type = UTypes.GIF Then
-                                            DownloadedPictures(False) += 1
-                                        Else
-                                            v.Type = UTypes.Picture
-                                            DownloadedPictures(False) += 1
-                                        End If
+                                        updateDownCount()
 
                                         v.File = ChangeFileNameByProvider(f, v)
                                         v.State = UStates.Downloaded
                                         DownloadContentDefault_PostProcessing(v, f, Token)
+                                        If UseMD5Comparison And (v.Type = UTypes.GIF Or v.Type = UTypes.Picture) Then
+                                            If v.File.Exists Then
+                                                v.MD5 = ValidateMD5_GetMD5(v, False)
+                                                If Not v.MD5.IsEmptyString Then
+                                                    If _MD5List.Contains(v.MD5) Then
+                                                        __fileDeleted = v.File.Delete(SFO.File, SFODelete.DeletePermanently, EDP.ReturnValue)
+                                                        If __fileDeleted Then dCount -= 1 : updateDownCount()
+                                                    Else
+                                                        _MD5List.Add(v.MD5)
+                                                    End If
+                                                End If
+                                            Else
+                                                dCount -= 1
+                                            End If
+                                        End If
                                         dCount += 1
                                     Catch woex As OperationCanceledException When Token.IsCancellationRequested
                                         __deleteFile.Invoke(f, v.URL_BASE)
@@ -1745,7 +1775,7 @@ BlockNullPicture:
                                 Else
                                     v.State = UStates.Skipped
                                 End If
-                                _ContentNew(i) = v
+                                If Not __fileDeleted Then _ContentNew(i) = v
                                 If DownloadTopCount.HasValue AndAlso dCount >= DownloadTopCount.Value Then
                                     Progress.Perform(_ContentNew.Count - dTotal)
                                     Exit Sub
@@ -1897,6 +1927,7 @@ BlockNullPicture:
                         If m.Contains(IUserData.EraseMode.History) Then
                             If MyFilePosts.Delete(SFO.File, SFODelete.DeleteToRecycleBin, e) Then result = True
                             If MyFileData.Delete(SFO.File, SFODelete.DeleteToRecycleBin, e) Then result = True
+                            If MyMD5File.Delete(SFO.File, SFODelete.DeleteToRecycleBin, e) Then result = True
                             LastUpdated = Nothing
                             EraseData_AdditionalDataFiles()
                             UpdateUserInformation()
@@ -1913,6 +1944,8 @@ BlockNullPicture:
                             _TempMediaList.Clear()
                             _ContentNew.Clear()
                             _ContentList.Clear()
+                            _MD5List.Clear()
+                            _MD5Loaded = False
                         End If
                     End If
                 End If
@@ -2165,6 +2198,12 @@ BlockNullPicture:
         Private Sub BTT_CONTEXT_DOWN_KeyClick(sender As Object, e As MyKeyEventArgs) Handles BTT_CONTEXT_DOWN.KeyClick
             Downloader.Add(Me, e.IncludeInTheFeed)
         End Sub
+        Private Sub BTT_CONTEXT_DOWN_LIMIT_KeyClick(sender As Object, e As MyKeyEventArgs) Handles BTT_CONTEXT_DOWN_LIMIT.KeyClick
+            ControlInvokeFast(MainFrameObj.MF, Sub() MainFrameObj.MF.DownloadSelectedUser(MainFrame.DownUserLimits.Number, e.IncludeInTheFeed, Me), EDP.SendToLog)
+        End Sub
+        Private Sub BTT_CONTEXT_DOWN_DATE_KeyClick(sender As Object, e As MyKeyEventArgs) Handles BTT_CONTEXT_DOWN_DATE.KeyClick
+            ControlInvokeFast(MainFrameObj.MF, Sub() MainFrameObj.MF.DownloadSelectedUser(MainFrame.DownUserLimits.Date, e.IncludeInTheFeed, Me), EDP.SendToLog)
+        End Sub
         Private Sub BTT_CONTEXT_EDIT_Click(sender As Object, e As EventArgs) Handles BTT_CONTEXT_EDIT.Click
             Using f As New Editors.UserCreatorForm(Me)
                 f.ShowDialog()
@@ -2240,10 +2279,13 @@ BlockNullPicture:
                     LatestData.Clear()
                     _TempMediaList.Clear()
                     _TempPostsList.Clear()
+                    _MD5List.Clear()
                     TokenPersonal = Nothing
                     If Not ProgressPre Is Nothing Then ProgressPre.Reset() : ProgressPre.Dispose()
                     If Not Responser Is Nothing Then Responser.Dispose()
                     If Not BTT_CONTEXT_DOWN Is Nothing Then BTT_CONTEXT_DOWN.Dispose()
+                    If Not BTT_CONTEXT_DOWN_LIMIT Is Nothing Then BTT_CONTEXT_DOWN_LIMIT.Dispose()
+                    If Not BTT_CONTEXT_DOWN_DATE Is Nothing Then BTT_CONTEXT_DOWN_DATE.Dispose()
                     If Not BTT_CONTEXT_EDIT Is Nothing Then BTT_CONTEXT_EDIT.Dispose()
                     If Not BTT_CONTEXT_DELETE Is Nothing Then BTT_CONTEXT_DELETE.Dispose()
                     If Not BTT_CONTEXT_ERASE Is Nothing Then BTT_CONTEXT_ERASE.Dispose()

SCrawler/API/Instagram/EditorExchangeOptions.vb

@@ -7,8 +7,10 @@
 ' This program is distributed in the hope that it will be useful,
 ' but WITHOUT ANY WARRANTY
 Imports SCrawler.Plugin.Attributes
+Imports DN = SCrawler.API.Base.DeclaredNames
 Namespace API.Instagram
-    Friend Class EditorExchangeOptions
+    Friend NotInheritable Class EditorExchangeOptions
+#Region "Download"
         <PSetting(Caption:="Get timeline", ToolTip:="Download user timeline")>
         Friend Property GetTimeline As Boolean
         <PSetting(Caption:="Get reels", ToolTip:="Download user reels")>
@@ -19,6 +21,27 @@ Namespace API.Instagram
         Friend Property GetStoriesUser As Boolean
         <PSetting(Caption:="Get tagged posts", ToolTip:="Download user tagged posts")>
         Friend Property GetTagged As Boolean
+#End Region
+#Region "Extract image"
+        <PSetting(Caption:="Extract image from video: timeline")>
+        Friend Property GetTimeline_VideoPic As Boolean
+        <PSetting(Caption:="Extract image from video: reels")>
+        Friend Property GetReels_VideoPic As Boolean
+        <PSetting(Caption:="Extract image from video: stories")>
+        Friend Property GetStories_VideoPic As Boolean
+        <PSetting(Caption:="Extract image from video: stories: user")>
+        Friend Property GetStoriesUser_VideoPic As Boolean
+        <PSetting(Caption:="Extract image from video: tagged posts")>
+        Friend Property GetTagged_VideoPic As Boolean
+#End Region
+        <PSetting(Caption:="Place the extracted image into the video folder")>
+        Friend Property PutImageVideoFolder As Boolean
+        <PSetting(Address:=SettingAddress.User, Caption:=DN.UserNameChangeCaption, ToolTip:=DN.UserNameChangeToolTip)>
+        Friend Property UserName As String = String.Empty
+        <PSetting(Address:=SettingAddress.User, Caption:="Force update UserName", ToolTip:="Try to force update UserName if it is not found on the site")>
+        Friend Property ForceUpdateUserName As Boolean = False
+        <PSetting(Address:=SettingAddress.User, Caption:="Force update user information")>
+        Friend Property ForceUpdateUserInfo As Boolean = False
         Friend Sub New(ByVal u As UserData)
             With u
                 GetTimeline = .GetTimeline
@@ -26,6 +49,18 @@ Namespace API.Instagram
                 GetStories = .GetStories
                 GetStoriesUser = .GetStoriesUser
                 GetTagged = .GetTaggedData
+
+                GetTimeline_VideoPic = .GetTimeline_VideoPic
+                GetReels_VideoPic = .GetReels_VideoPic
+                GetStories_VideoPic = .GetStories_VideoPic
+                GetStoriesUser_VideoPic = .GetStoriesUser_VideoPic
+                GetTagged_VideoPic = .GetTaggedData_VideoPic
+
+                PutImageVideoFolder = .PutImageVideoFolder
+
+                UserName = .NameTrue(True)
+                ForceUpdateUserName = .ForceUpdateUserName
+                ForceUpdateUserInfo = .ForceUpdateUserInfo
             End With
         End Sub
         Friend Sub New(ByVal s As SiteSettings)
@@ -35,6 +70,14 @@ Namespace API.Instagram
                 GetStories = CBool(.GetStories.Value)
                 GetStoriesUser = CBool(.GetStoriesUser.Value)
                 GetTagged = CBool(.GetTagged.Value)
+
+                GetTimeline_VideoPic = CBool(.GetTimeline_VideoPic.Value)
+                GetReels_VideoPic = CBool(.GetReels_VideoPic.Value)
+                GetStories_VideoPic = CBool(.GetStories_VideoPic.Value)
+                GetStoriesUser_VideoPic = CBool(.GetStoriesUser_VideoPic.Value)
+                GetTagged_VideoPic = CBool(.GetTagged_VideoPic.Value)
+
+                PutImageVideoFolder = CBool(.PutImageVideoFolder.Value)
             End With
         End Sub
     End Class

SCrawler/API/Instagram/SiteSettings.vb

@@ -16,8 +16,8 @@ Imports PersonalUtilities.Tools.Web.Cookies
 Imports Download = SCrawler.Plugin.ISiteSettings.Download
 Imports DN = SCrawler.API.Base.DeclaredNames
 Namespace API.Instagram
-    <Manifest(InstagramSiteKey), SeparatedTasks(1), SavedPosts, SpecialForm(False)>
-    Friend Class SiteSettings : Inherits SiteSettingsBase
+    <Manifest(InstagramSiteKey), SeparatedTasks(1), SavedPosts, SpecialForm(False), UseDownDetector>
+    Friend Class SiteSettings : Inherits SiteSettingsBase : Implements DownDetector.IDownDetector
 #Region "Declarations"
 #Region "Providers"
         Friend Class TimersChecker : Inherits FieldsCheckerProviderBase
@@ -57,8 +57,11 @@ Namespace API.Instagram
 #End Region
 #Region "Categories"
         Private Const CAT_DOWN As String = "Download data"
+        Private Const CAT_UserDefs_VIDEO As String = DN.CAT_UserDefs & ": extract image from video"
+        Private Const CAT_ERRORS As String = "Errors"
 #End Region
-#Region "Authorization properties"
+#Region "Properties"
+#Region "Authorization"
         Friend Const Header_IG_APP_ID As String = "x-ig-app-id"
         Friend Const Header_IG_WWW_CLAIM As String = "x-ig-www-claim"
         Friend Const Header_CSRF_TOKEN As String = "x-csrftoken"
@@ -67,18 +70,18 @@ Namespace API.Instagram
         Friend Const Header_Browser As String = "Sec-Ch-Ua"
         Friend Const Header_BrowserExt As String = "Sec-Ch-Ua-Full-Version-List"
         Friend Const Header_Platform_Verion As String = "Sec-Ch-Ua-Platform-Version"
-        <PropertyOption(ControlText:="x-csrftoken", ControlToolTip:="Can be automatically extracted from cookies", IsAuth:=True, AllowNull:=True), ControlNumber(2), PClonable(Clone:=False)>
+        <PropertyOption(ControlText:="x-csrftoken", ControlToolTip:="Can be automatically extracted from cookies", IsAuth:=True, AllowNull:=True), PClonable(Clone:=False)>
         Friend ReadOnly Property HH_CSRF_TOKEN As PropertyValue
         <CookieValueExtractor(NameOf(HH_CSRF_TOKEN))>
         Private Function GetValueFromCookies(ByVal PropName As String, ByVal c As CookieKeeper) As String
             Return c.GetCookieValue(Header_CSRF_TOKEN_COOKIE, PropName, NameOf(HH_CSRF_TOKEN))
         End Function
-        <PropertyOption(ControlText:="x-ig-app-id", IsAuth:=True, AllowNull:=False), ControlNumber(3), PClonable(Clone:=False)>
+        <PropertyOption(ControlText:="x-ig-app-id", IsAuth:=True, AllowNull:=False), PClonable(Clone:=False)>
         Friend ReadOnly Property HH_IG_APP_ID As PropertyValue
-        <PropertyOption(ControlText:="x-asbd-id", IsAuth:=True, AllowNull:=True), ControlNumber(4), PClonable(Clone:=False)>
+        <PropertyOption(ControlText:="x-asbd-id", IsAuth:=True, AllowNull:=True), PClonable(Clone:=False)>
         Friend ReadOnly Property HH_ASBD_ID As PropertyValue
         'PropertyOption(ControlText:="x-ig-www-claim", IsAuth:=True, AllowNull:=True)
-        <ControlNumber(5), PClonable(Clone:=False)>
+        <PClonable(Clone:=False)>
         Friend ReadOnly Property HH_IG_WWW_CLAIM As PropertyValue
         Private ReadOnly Property HH_IG_WWW_CLAIM_IS_ZERO As Boolean
             Get
@@ -87,16 +90,16 @@ Namespace API.Instagram
             End Get
         End Property
         <PropertyOption(ControlText:="sec-ch-ua", IsAuth:=True, AllowNull:=True,
-                        InheritanceName:=SettingsCLS.HEADER_DEF_sec_ch_ua), ControlNumber(6), PClonable, PXML(OnlyForChecked:=True)>
+                        InheritanceName:=SettingsCLS.HEADER_DEF_sec_ch_ua), PClonable, PXML(OnlyForChecked:=True)>
         Private ReadOnly Property HH_BROWSER As PropertyValue
         <PropertyOption(ControlText:="sec-ch-ua-full", ControlToolTip:="sec-ch-ua-full-version-list", IsAuth:=True, AllowNull:=True,
-                        InheritanceName:=SettingsCLS.HEADER_DEF_sec_ch_ua_full_version_list), ControlNumber(7), PClonable, PXML(OnlyForChecked:=True)>
+                        InheritanceName:=SettingsCLS.HEADER_DEF_sec_ch_ua_full_version_list), PClonable, PXML(OnlyForChecked:=True)>
         Private ReadOnly Property HH_BROWSER_EXT As PropertyValue
         <PropertyOption(ControlText:="sec-ch-ua-platform-ver", ControlToolTip:="sec-ch-ua-platform-version", IsAuth:=True, AllowNull:=True, LeftOffset:=135,
-                        InheritanceName:=SettingsCLS.HEADER_DEF_sec_ch_ua_platform_version), ControlNumber(8), PClonable, PXML(OnlyForChecked:=True)>
+                        InheritanceName:=SettingsCLS.HEADER_DEF_sec_ch_ua_platform_version), PClonable, PXML(OnlyForChecked:=True)>
         Private ReadOnly Property HH_PLATFORM As PropertyValue
         <PropertyOption(ControlText:="UserAgent", IsAuth:=True, AllowNull:=True,
-                        InheritanceName:=SettingsCLS.HEADER_DEF_UserAgent), ControlNumber(9), PClonable, PXML(OnlyForChecked:=True)>
+                        InheritanceName:=SettingsCLS.HEADER_DEF_UserAgent), PClonable, PXML(OnlyForChecked:=True)>
         Private ReadOnly Property HH_USER_AGENT As PropertyValue
         Friend Overrides Function BaseAuthExists() As Boolean
             Return Responser.CookiesExists And ACheck(HH_IG_APP_ID.Value) And ACheck(HH_CSRF_TOKEN.Value)
@@ -125,99 +128,167 @@ Namespace API.Instagram
             End If
         End Sub
 #Region "HH_IG_WWW_CLAIM"
-        <PropertyOption(ControlText:="ig-www-claim update interval", IsAuth:=True, LeftOffset:=150), PXML, ControlNumber(10), PClonable, HiddenControl>
+        <PropertyOption(ControlText:="ig-www-claim update interval", IsAuth:=True, LeftOffset:=150), PXML, PClonable, HiddenControl>
         Private ReadOnly Property HH_IG_WWW_CLAIM_UPDATE_INTERVAL As PropertyValue
         <PropertyOption(ControlText:="ig-www-claim: always 0", ControlToolTip:="Keep token value always = 0", IsAuth:=True),
-            PXML, ControlNumber(11), PClonable, HiddenControl>
+            PXML, PClonable, HiddenControl>
         Friend ReadOnly Property HH_IG_WWW_CLAIM_ALWAYS_ZERO As PropertyValue
         <PropertyOption(ControlText:="ig-www-claim: reset each session", ControlToolTip:="Set 'x-ig-www-claim' to '0' before each session", IsAuth:=True),
-            PXML, ControlNumber(12), PClonable, HiddenControl>
+            PXML, PClonable, HiddenControl>
         Friend ReadOnly Property HH_IG_WWW_CLAIM_RESET_EACH_SESSION As PropertyValue
         <PropertyOption(ControlText:="ig-www-claim: reset each target", ControlToolTip:="Set 'x-ig-www-claim' to '0' before each target", IsAuth:=True),
-            PXML, ControlNumber(13), PClonable, HiddenControl>
+            PXML, PClonable, HiddenControl>
         Friend ReadOnly Property HH_IG_WWW_CLAIM_RESET_EACH_TARGET As PropertyValue
-        <PropertyOption(ControlText:="ig-www-claim: use in requests", IsAuth:=True), PXML, ControlNumber(14), PClonable, HiddenControl>
+        <PropertyOption(ControlText:="ig-www-claim: use in requests", IsAuth:=True), PXML, PClonable, HiddenControl>
         Friend ReadOnly Property HH_IG_WWW_CLAIM_USE As PropertyValue
-        <PropertyOption(ControlText:="ig-www-claim: use default algorithm to update", IsAuth:=True), PXML, ControlNumber(15), PClonable, HiddenControl>
+        <PropertyOption(ControlText:="ig-www-claim: use default algorithm to update", IsAuth:=True), PXML, PClonable, HiddenControl>
         Friend ReadOnly Property HH_IG_WWW_CLAIM_USE_DEFAULT_ALGO As PropertyValue
         <Provider(NameOf(HH_IG_WWW_CLAIM_UPDATE_INTERVAL), FieldsChecker:=True)>
         Private ReadOnly Property TokenUpdateIntervalProvider As IFormatProvider
 #End Region
-        <PropertyOption(ControlText:="Use GraphQL to download", IsAuth:=True), PXML, ControlNumber(16), PClonable>
+        <PropertyOption(ControlText:="Use GraphQL to download", IsAuth:=True), PXML, PClonable>
         Friend ReadOnly Property USE_GQL As PropertyValue
 #End Region
-#Region "Download properties"
-        <PropertyOption(ControlText:="DownDetector",
-                        ControlToolTip:="Use 'DownDetector' to determine if the site is accessible. -1 to disable." & vbCr &
-                                        "The value represents the average number of error reports over the last 4 hours"),
-            PClonable, PXML, ControlNumber(17)>
-        Private ReadOnly Property DownDetectorValue As PropertyValue
-        <Provider(NameOf(DownDetectorValue), FieldsChecker:=True)>
-        Private ReadOnly Property DownDetectorValueProvider As IFormatProvider
-        <PropertyOption(ControlText:="Add 'DownDetector' information to the log."), PClonable, PXML, ControlNumber(18), HiddenControl>
-        Private ReadOnly Property DownDetectorValueAddToLog As PropertyValue
+#Region "Download data"
+        <PropertyOption(ControlText:="Download timeline", Category:=CAT_DOWN), PXML, PClonable>
+        Friend ReadOnly Property DownloadTimeline As PropertyValue
+        <PXML> Private ReadOnly Property DownloadTimeline_Def As PropertyValue
+        <PropertyOption(ControlText:="Download reels", Category:=CAT_DOWN), PXML, PClonable>
+        Friend ReadOnly Property DownloadReels As PropertyValue
+        <PXML> Private ReadOnly Property DownloadReels_Def As PropertyValue
+        <PropertyOption(ControlText:="Download stories", Category:=CAT_DOWN), PXML, PClonable>
+        Friend ReadOnly Property DownloadStories As PropertyValue
+        <PXML> Private ReadOnly Property DownloadStories_Def As PropertyValue
+        <PropertyOption(ControlText:="Download stories: user", Category:=CAT_DOWN), PXML, PClonable>
+        Friend ReadOnly Property DownloadStoriesUser As PropertyValue
+        <PXML> Private ReadOnly Property DownloadStoriesUser_Def As PropertyValue
+        <PropertyOption(ControlText:="Download tagged posts", Category:=CAT_DOWN), PXML, PClonable>
+        Friend ReadOnly Property DownloadTagged As PropertyValue
+        <PXML> Private ReadOnly Property DownloadTagged_Def As PropertyValue
+#End Region
+#Region "Timers"
         Friend Const TimersUrgentTip As String = vbCr & "It is highly recommended not to change the default value."
         <PropertyOption(ControlText:="Request timer (any)",
                         ControlToolTip:="The timer (in milliseconds) that SCrawler should wait before executing the next request." &
                         vbCr & "The default value is 1'000." & vbCr & "The minimum value is 0." & TimersUrgentTip, AllowNull:=False, Category:=DN.CAT_Timers),
-                        PXML, ControlNumber(19), PClonable>
+                        PXML, PClonable>
         Friend ReadOnly Property RequestsWaitTimer_Any As PropertyValue
         <Provider(NameOf(RequestsWaitTimer_Any), FieldsChecker:=True)>
         Private ReadOnly Property RequestsWaitTimer_AnyProvider As IFormatProvider
         <PropertyOption(ControlText:="Request timer",
                         ControlToolTip:="The time value (in milliseconds) that the program will wait before processing the next 'Request time counter' request." &
                                         vbCr & "The default value is 1'000." & vbCr & "The minimum value is 100." & TimersUrgentTip,
-                        AllowNull:=False, Category:=DN.CAT_Timers), PXML, ControlNumber(20), PClonable>
+                        AllowNull:=False, Category:=DN.CAT_Timers), PXML, PClonable>
         Friend ReadOnly Property RequestsWaitTimer As PropertyValue
         <Provider(NameOf(RequestsWaitTimer), FieldsChecker:=True)>
         Private ReadOnly Property RequestsWaitTimerProvider As IFormatProvider
         <PropertyOption(ControlText:="Request timer counter",
                         ControlToolTip:="How many requests will be sent to Instagram before the program waits 'Request timer'." &
                                         vbCr & "The default value is 1." & vbCr & "The minimum value is 1." & TimersUrgentTip,
-                        AllowNull:=False, LeftOffset:=120, Category:=DN.CAT_Timers), PXML, ControlNumber(21), PClonable>
+                        AllowNull:=False, LeftOffset:=120, Category:=DN.CAT_Timers), PXML, PClonable>
         Friend ReadOnly Property RequestsWaitTimerTaskCount As PropertyValue
         <Provider(NameOf(RequestsWaitTimerTaskCount), FieldsChecker:=True)>
         Private ReadOnly Property RequestsWaitTimerTaskCountProvider As IFormatProvider
         <PropertyOption(ControlText:="Posts limit timer",
                         ControlToolTip:="The time value (in milliseconds) the program will wait before processing the next request after 195 requests." &
                                         vbCr & "The default value is 60'000." & vbCr & "The minimum value is 10'000." & TimersUrgentTip,
-                        AllowNull:=False, Category:=DN.CAT_Timers), PXML, ControlNumber(22), PClonable>
+                        AllowNull:=False, Category:=DN.CAT_Timers), PXML, PClonable>
         Friend ReadOnly Property SleepTimerOnPostsLimit As PropertyValue
         <Provider(NameOf(SleepTimerOnPostsLimit), FieldsChecker:=True)>
         Private ReadOnly Property SleepTimerOnPostsLimitProvider As IFormatProvider
-        <PropertyOption(ControlText:="Get timeline", ControlToolTip:="Default value for new users", Category:=DN.CAT_UserDefs), PXML, ControlNumber(23), PClonable>
+#End Region
+#Region "New user defaults"
+        <PropertyOption(ControlText:="Get timeline", ControlToolTip:="Default value for new users", Category:=DN.CAT_UserDefs), PXML, PClonable>
         Friend ReadOnly Property GetTimeline As PropertyValue
-        <PropertyOption(ControlText:="Get reels", ControlToolTip:="Default value for new users", Category:=DN.CAT_UserDefs), PXML, ControlNumber(24), PClonable>
+        <PropertyOption(ControlText:="From timeline", ControlToolTip:="Default value for new users", Category:=CAT_UserDefs_VIDEO), PXML, PClonable>
+        Friend ReadOnly Property GetTimeline_VideoPic As PropertyValue
+        <PropertyOption(ControlText:="Get reels", ControlToolTip:="Default value for new users", Category:=DN.CAT_UserDefs), PXML, PClonable>
         Friend ReadOnly Property GetReels As PropertyValue
-        <PropertyOption(ControlText:="Get stories", ControlToolTip:="Default value for new users", Category:=DN.CAT_UserDefs), PXML, ControlNumber(25), PClonable>
+        <PropertyOption(ControlText:="From reels", ControlToolTip:="Default value for new users", Category:=CAT_UserDefs_VIDEO), PXML, PClonable>
+        Friend ReadOnly Property GetReels_VideoPic As PropertyValue
+        <PropertyOption(ControlText:="Get stories", ControlToolTip:="Default value for new users", Category:=DN.CAT_UserDefs), PXML, PClonable>
         Friend ReadOnly Property GetStories As PropertyValue
-        <PropertyOption(ControlText:="Get stories: user", ControlToolTip:="Default value for new users", Category:=DN.CAT_UserDefs), PXML, ControlNumber(26), PClonable>
+        <PropertyOption(ControlText:="From stories", ControlToolTip:="Default value for new users", Category:=CAT_UserDefs_VIDEO), PXML, PClonable>
+        Friend ReadOnly Property GetStories_VideoPic As PropertyValue
+        <PropertyOption(ControlText:="Get stories: user", ControlToolTip:="Default value for new users", Category:=DN.CAT_UserDefs), PXML, PClonable>
         Friend ReadOnly Property GetStoriesUser As PropertyValue
-        <PropertyOption(ControlText:="Get tagged photos", ControlToolTip:="Default value for new users", Category:=DN.CAT_UserDefs), PXML, ControlNumber(27), PClonable>
+        <PropertyOption(ControlText:="From stories: user", ControlToolTip:="Default value for new users", Category:=CAT_UserDefs_VIDEO), PXML, PClonable>
+        Friend ReadOnly Property GetStoriesUser_VideoPic As PropertyValue
+        <PropertyOption(ControlText:="Get tagged posts", ControlToolTip:="Default value for new users", Category:=DN.CAT_UserDefs), PXML, PClonable>
         Friend ReadOnly Property GetTagged As PropertyValue
+        <PropertyOption(ControlText:="From tagged posts", ControlToolTip:="Default value for new users", Category:=CAT_UserDefs_VIDEO), PXML, PClonable>
+        Friend ReadOnly Property GetTagged_VideoPic As PropertyValue
+        <PropertyOption(ControlText:="From saved posts", ControlToolTip:="Default value for new users", Category:=CAT_UserDefs_VIDEO), PXML, PClonable>
+        Friend ReadOnly Property GetSavedPosts_VideoPic As PropertyValue
+        <PropertyOption(ControlText:="Place the extracted image into the video folder", ControlToolTip:="Default value for new users", Category:=CAT_UserDefs_VIDEO), PXML, PClonable>
+        Friend ReadOnly Property PutImageVideoFolder As PropertyValue
+#End Region
+#Region "Errors"
+        Private Const ErrorsDefault As String = "572"
+        <PropertyOption(ControlText:="Skip errors",
+                        ControlToolTip:="Skip the following errors (comma separated)." & vbCr &
+                                        "Facing these errors will not disable the download, but will add a simple line to the log.", Category:=CAT_ERRORS),
+         PClonable, PXML>
+        Private ReadOnly Property SkipErrors As PropertyValue
+        <PropertyOption(ControlText:="Add skipped errors to the log", Category:=CAT_ERRORS), PClonable, PXML>
+        Private ReadOnly Property SkipErrors_AddToLog As PropertyValue
+        <PropertyOption(ControlText:="Skip errors (exclude)",
+                        ControlToolTip:="Exclude the following errors from being added to the log (comma separated)", Category:=CAT_ERRORS), PClonable, PXML>
+        Private ReadOnly Property SkipErrors_AddToLog_Silent As PropertyValue
+        Friend ReadOnly Property ErrorSpecialHandling(ByVal ErrCode As Integer) As Boolean
+            Get
+                With CStr(SkipErrors.Value) : Return Not .IsEmptyString AndAlso .Contains(ErrCode) : End With
+            End Get
+        End Property
+        Friend ReadOnly Property ErrorSpecialHandling_AddToLog(ByVal ErrCode As Integer) As Boolean
+            Get
+                With CStr(SkipErrors_AddToLog_Silent.Value)
+                    Return CBool(SkipErrors_AddToLog.Value) AndAlso (.IsEmptyString OrElse Not .Contains(ErrCode))
+                End With
+            End Get
+        End Property
+        <PropertyOption(ControlText:="Ignore stories downloading errors (560)",
+                        ControlToolTip:="If checked, error 560 will be skipped and the download will continue. Otherwise, the download will be interrupted.",
+                        Category:=CAT_ERRORS), PClonable, PXML>
+        Friend ReadOnly Property IgnoreStoriesDownloadingErrors As PropertyValue
+#End Region
+#Region "Other params"
+        <PropertyOption(ControlText:="DownDetector",
+                        ControlToolTip:="Use 'DownDetector' to determine if the site is accessible. -1 to disable." & vbCr &
+                                        "The value represents the average number of error reports over the last 4 hours"),
+            PClonable, PXML>
+        Private ReadOnly Property DownDetectorValue As PropertyValue
+        <Provider(NameOf(DownDetectorValue), FieldsChecker:=True)>
+        Private ReadOnly Property DownDetectorValueProvider As IFormatProvider
+        <PropertyOption(ControlText:="Add 'DownDetector' information to the log."), PClonable, PXML, HiddenControl>
+        Private ReadOnly Property DownDetectorValueAddToLog As PropertyValue
         <PropertyOption(ControlText:="Tagged notify limit",
                         ControlToolTip:="If the number of tagged posts exceeds this number you will be notified." & vbCr &
-                        "-1 to disable"), PXML, ControlNumber(27), PClonable>
+                        "-1 to disable"), PXML, PClonable>
         Friend ReadOnly Property TaggedNotifyLimit As PropertyValue
         <Provider(NameOf(TaggedNotifyLimit), FieldsChecker:=True)>
         Private ReadOnly Property TaggedNotifyLimitProvider As IFormatProvider
 #End Region
-#Region "Download ready"
-        <PropertyOption(ControlText:="Download timeline", ControlToolTip:="Download timeline", Category:=CAT_DOWN), PXML, ControlNumber(10), PClonable>
-        Friend ReadOnly Property DownloadTimeline As PropertyValue
-        <PXML> Private ReadOnly Property DownloadTimeline_Def As PropertyValue
-        <PropertyOption(ControlText:="Download reels", ControlToolTip:="Download reels", Category:=CAT_DOWN), PXML, ControlNumber(11), PClonable>
-        Friend ReadOnly Property DownloadReels As PropertyValue
-        <PXML> Private ReadOnly Property DownloadReels_Def As PropertyValue
-        <PropertyOption(ControlText:="Download stories", ControlToolTip:="Download stories", Category:=CAT_DOWN), PXML, ControlNumber(12), PClonable>
-        Friend ReadOnly Property DownloadStories As PropertyValue
-        <PXML> Private ReadOnly Property DownloadStories_Def As PropertyValue
-        <PropertyOption(ControlText:="Download stories: user", ControlToolTip:="Download stories (user)", Category:=CAT_DOWN), PXML, ControlNumber(13), PClonable>
-        Friend ReadOnly Property DownloadStoriesUser As PropertyValue
-        <PXML> Private ReadOnly Property DownloadStoriesUser_Def As PropertyValue
-        <PropertyOption(ControlText:="Download tagged", ControlToolTip:="Download tagged posts", Category:=CAT_DOWN), PXML, ControlNumber(14), PClonable>
-        Friend ReadOnly Property DownloadTagged As PropertyValue
-        <PXML> Private ReadOnly Property DownloadTagged_Def As PropertyValue
+#End Region
+#Region "IDownDetector Support"
+        Private ReadOnly Property IDownDetector_Value As Integer Implements DownDetector.IDownDetector.Value
+            Get
+                Return DownDetectorValue.Value
+            End Get
+        End Property
+        Private ReadOnly Property IDownDetector_AddToLog As Boolean Implements DownDetector.IDownDetector.AddToLog
+            Get
+                Return DownDetectorValueAddToLog.Value
+            End Get
+        End Property
+        Private ReadOnly Property IDownDetector_CheckSite As String Implements DownDetector.IDownDetector.CheckSite
+            Get
+                Return "instagram"
+            End Get
+        End Property
+        Private Function IDownDetector_Available(ByVal What As Download, ByVal Silent As Boolean) As Boolean Implements DownDetector.IDownDetector.Available
+            Return MDD.Available(What, Silent)
+        End Function
 #End Region
 #Region "429 bypass"
         <PXML("InstagramDownloadingErrorDate")>
@@ -251,8 +322,40 @@ Namespace API.Instagram
             End Get
         End Property
         Private Const LastDownloadDateResetInterval As Integer = 60
+        Private TooManyRequestsReadyForCatch As Boolean = True
+        Friend Function GetWaitDate() As Date
+            With DownloadingErrorDate
+                If ACheck(Of Date)(.Value) Then
+                    Return CDate(.Value).AddMinutes(If(LastApplyingValue, 10))
+                Else
+                    Return Now
+                End If
+            End With
+        End Function
+        Friend Sub TooManyRequests(ByVal Catched As Boolean)
+            With DownloadingErrorDate
+                If Catched Then
+                    If Not ACheck(Of Date)(.Value) Then
+                        .Value = Now
+                        If TooManyRequestsReadyForCatch Then
+                            LastApplyingValue = If(LastApplyingValue, 0) + 10
+                            TooManyRequestsReadyForCatch = False
+                            MyMainLOG = $"Instagram downloading error: too many requests. Try again after {If(LastApplyingValue, 10)} minutes..."
+                        End If
+                    End If
+                Else
+                    .Value = Nothing
+                    LastApplyingValue = Nothing
+                    TooManyRequestsReadyForCatch = True
+                End If
+            End With
+        End Sub
+#End Region
+#Region "LastRequestsCount, Label"
         <PXML> Private ReadOnly Property LastDownloadDate As PropertyValue
         <PXML> Private ReadOnly Property LastRequestsCount As PropertyValue
+        <PropertyOption(IsInformationLabel:=True)>
+        Private ReadOnly Property LastRequestsCountLabel As PropertyValue
         Private ReadOnly MyLastRequests As Dictionary(Of Date, Integer)
         Private ReadOnly Property MyLastRequestsDate As Date
             Get
@@ -306,36 +409,6 @@ Namespace API.Instagram
                 ErrorsDescriber.Execute(EDP.SendToLog, ex, "[SiteSettings.Instagram.RefreshMyLastRequests]")
             End Try
         End Sub
-        <PropertyOption(IsInformationLabel:=True), ControlNumber(100)>
-        Private ReadOnly Property LastRequestsCountLabel As PropertyValue
-        Private TooManyRequestsReadyForCatch As Boolean = True
-        Friend Function GetWaitDate() As Date
-            With DownloadingErrorDate
-                If ACheck(Of Date)(.Value) Then
-                    Return CDate(.Value).AddMinutes(If(LastApplyingValue, 10))
-                Else
-                    Return Now
-                End If
-            End With
-        End Function
-        Friend Sub TooManyRequests(ByVal Catched As Boolean)
-            With DownloadingErrorDate
-                If Catched Then
-                    If Not ACheck(Of Date)(.Value) Then
-                        .Value = Now
-                        If TooManyRequestsReadyForCatch Then
-                            LastApplyingValue = If(LastApplyingValue, 0) + 10
-                            TooManyRequestsReadyForCatch = False
-                            MyMainLOG = $"Instagram downloading error: too many requests. Try again after {If(LastApplyingValue, 10)} minutes..."
-                        End If
-                    End If
-                Else
-                    .Value = Nothing
-                    LastApplyingValue = Nothing
-                    TooManyRequestsReadyForCatch = True
-                End If
-            End With
-        End Sub
 #End Region
 #End Region
 #Region "Initializer"
@@ -412,9 +485,6 @@ Namespace API.Instagram
             DownloadTagged = New PropertyValue(False)
             DownloadTagged_Def = New PropertyValue(DownloadTagged.Value, GetType(Boolean))
 
-            DownDetectorValue = New PropertyValue(20)
-            DownDetectorValueProvider = New TimersChecker(-1)
-            DownDetectorValueAddToLog = New PropertyValue(False)
             RequestsWaitTimer_Any = New PropertyValue(1000)
             RequestsWaitTimer_AnyProvider = New TimersChecker(0)
             RequestsWaitTimer = New PropertyValue(1000)
@@ -425,10 +495,26 @@ Namespace API.Instagram
             SleepTimerOnPostsLimitProvider = New TimersChecker(10000)
 
             GetTimeline = New PropertyValue(True)
+            GetTimeline_VideoPic = New PropertyValue(True)
             GetReels = New PropertyValue(False)
+            GetReels_VideoPic = New PropertyValue(True)
             GetStories = New PropertyValue(False)
+            GetStories_VideoPic = New PropertyValue(True)
             GetStoriesUser = New PropertyValue(False)
+            GetStoriesUser_VideoPic = New PropertyValue(True)
             GetTagged = New PropertyValue(False)
+            GetTagged_VideoPic = New PropertyValue(True)
+            GetSavedPosts_VideoPic = New PropertyValue(True)
+            PutImageVideoFolder = New PropertyValue(False)
+
+            SkipErrors = New PropertyValue(ErrorsDefault)
+            SkipErrors_AddToLog = New PropertyValue(True)
+            SkipErrors_AddToLog_Silent = New PropertyValue(String.Empty, GetType(String))
+            IgnoreStoriesDownloadingErrors = New PropertyValue(False)
+
+            DownDetectorValue = New PropertyValue(20)
+            DownDetectorValueProvider = New TimersChecker(-1)
+            DownDetectorValueAddToLog = New PropertyValue(False)
             TaggedNotifyLimit = New PropertyValue(200)
             TaggedNotifyLimitProvider = New TaggedNotifyLimitChecker
 
@@ -438,6 +524,8 @@ Namespace API.Instagram
             LastRequestsCountLabel = New PropertyValue(String.Empty, GetType(String))
             MyLastRequests = New Dictionary(Of Date, Integer)
 
+            MDD = New DownDetector.Checker(Of SiteSettings)(Me)
+
             _AllowUserAgentUpdate = False
             UrlPatternUser = "https://www.instagram.com/{0}/"
             UserRegex = RParams.DMS(String.Format(UserRegexDefaultPattern, "instagram.com/"), 1)
@@ -485,18 +573,10 @@ Namespace API.Instagram
         End Function
 #End Region
 #Region "Downloading"
-        Private ____DownloadStarted As Boolean = False
-        Private ____AvailableRequested As Boolean = False
-        Private ____AvailableSilent As Boolean = True
-        Private ____AvailableChecked As Boolean = False
-        Private ____AvailableResult As Boolean = False
+        Private ReadOnly MDD As DownDetector.Checker(Of SiteSettings)
         Private Sub ResetDownloadOptions()
             If ActiveJobs < 1 Then
-                ____DownloadStarted = False
-                ____AvailableRequested = False
-                ____AvailableChecked = False
-                ____AvailableSilent = True
-                ____AvailableResult = False
+                MDD.Reset()
                 If ActiveSessionRequestsExists Then RefreshMyLastRequests(Now)
                 ActiveSessionRequestsExists = False
                 _NextWNM = UserData.WNM.Notify
@@ -507,69 +587,11 @@ Namespace API.Instagram
             End If
         End Sub
         Friend Overrides Function Available(ByVal What As Download, ByVal Silent As Boolean) As Boolean
-            If MyBase.Available(What, Silent) And ActiveJobs < 2 Then
-                If CInt(DownDetectorValue.Value) >= 0 Then
-                    If ____DownloadStarted Then
-                        ____AvailableRequested = True
-                        ____AvailableSilent = Silent
-                        Return True
-                    Else
-                        Return AvailableImpl(What, Silent)
-                    End If
-                Else
-                    Return True
-                End If
-            Else
-                Return False
-            End If
-        End Function
-#Disable Warning IDE0060
-        Private Function AvailableImpl(ByVal What As Download, ByVal Silent As Boolean) As Boolean
-#Enable Warning
-            Try
-                AvailableText = String.Empty
-                If CInt(DownDetectorValue.Value) = -1 Then
-                    Return True
-                Else
-                    Dim dl As List(Of DownDetector.Data) = DownDetector.GetData("instagram")
-                    If dl.ListExists Then
-                        dl = dl.Take(4).ToList
-                        Dim avg% = dl.Average(Function(d) d.Value)
-                        If avg > CInt(DownDetectorValue.Value) Then
-                            AvailableText = "Over the past hour, Instagram has received an average of " &
-                                            avg.NumToString(New ANumbers With {.FormatOptions = ANumbers.Options.GroupIntegral}) & " outage reports:" & vbCr &
-                                            dl.ListToString(vbCr)
-                            If CBool(DownDetectorValueAddToLog.Value) Then MyMainLOG = AvailableText
-                            If Silent Then
-                                Return False
-                            Else
-                                Return MsgBoxE({$"{AvailableText}{vbCr}{vbCr}Do you want to continue parsing Instagram data?",
-                                               "There are outage reports on Instagram"}, vbYesNo) = vbYes
-                            End If
-                        End If
-                    End If
-                    Return True
-                End If
-            Catch ex As Exception
-                Return ErrorsDescriber.Execute(EDP.SendToLog + EDP.ReturnValue, ex, "[API.Instagram.SiteSettings.Available]", True)
-            End Try
+            Return MyBase.Available(What, Silent) And ActiveJobs < 2
         End Function
         Friend Property SkipUntilNextSession As Boolean = False
         Friend Overrides Function ReadyToDownload(ByVal What As Download) As Boolean
-            If ActiveJobs < 2 AndAlso Not SkipUntilNextSession AndAlso ReadyForDownload AndAlso BaseAuthExists() AndAlso CBool(DownloadTimeline.Value) Then
-                If ____DownloadStarted And ____AvailableRequested Then
-                    ____AvailableResult = AvailableImpl(What, ____AvailableSilent)
-                    ____AvailableChecked = True
-                    ____AvailableRequested = False
-                    Return ____AvailableResult
-                ElseIf ____AvailableChecked Then
-                    Return ____AvailableResult
-                Else
-                    Return True
-                End If
-            Else
-                Return False
-            End If
+            Return ActiveJobs < 2 AndAlso Not SkipUntilNextSession AndAlso ReadyForDownload AndAlso BaseAuthExists() AndAlso CBool(DownloadTimeline.Value)
         End Function
         Private ActiveJobs As Integer = 0
         Private ActiveSessionDate As Date
@@ -579,7 +601,7 @@ Namespace API.Instagram
         Friend Overrides Sub DownloadStarted(ByVal What As Download)
             ResetDownloadOptions()
             ActiveJobs += 1
-            If ActiveJobs = 1 Then ____DownloadStarted = True : ActiveSessionDate = Now
+            If ActiveJobs = 1 Then ActiveSessionDate = Now
             If Not HH_IG_WWW_CLAIM_IS_ZERO AndAlso
                (
                     (CBool(HH_IG_WWW_CLAIM_USE_DEFAULT_ALGO.Value) AndAlso MyLastRequestsDate.AddMinutes(HH_IG_WWW_CLAIM_UPDATE_INTERVAL.Value) < Now) Or

SCrawler/API/Instagram/UserData.GQL.vb

@@ -194,7 +194,7 @@ Namespace API.Instagram
                             With j({"data", "xdt_api__v1__feed__reels_media__connection", "edges"})
                                 If .ListExists Then
                                     ProgressPre.ChangeMax(.Count)
-                                    For Each n As EContainer In .Self : GetStoriesData_ParseSingleHighlight(n("node"), i, False, Token) : Next
+                                    For Each n As EContainer In .Self : GetStoriesData_ParseSingleHighlight(n("node"), i, False, Token, Sections.Stories) : Next
                                 End If
                             End With
                         End If
@@ -217,7 +217,7 @@ Namespace API.Instagram
                 Using j As EContainer = JsonDocument.Parse(r)
                     If j.ListExists Then
                         Dim i% = -1
-                        GetStoriesData_ParseSingleHighlight(j.ItemF({"data", "xdt_api__v1__feed__reels_media", "reels_media", 0}), i, True, Token)
+                        GetStoriesData_ParseSingleHighlight(j.ItemF({"data", "xdt_api__v1__feed__reels_media", "reels_media", 0}), i, True, Token, Sections.UserStories)
                     End If
                 End Using
             End If

SCrawler/API/Instagram/UserData.vb

@@ -26,15 +26,23 @@ Namespace API.Instagram
         Private Const Name_LastCursor As String = "LastCursor"
         Private Const Name_FirstLoadingDone As String = "FirstLoadingDone"
         Private Const Name_GetTimeline As String = "GetTimeline"
+        Private Const Name_GetTimeline_VideoPic As String = "GetTimeline_VideoPic"
         Private Const Name_GetReels As String = "GetReels"
+        Private Const Name_GetReels_VideoPic As String = "GetReels_VideoPic"
         Private Const Name_GetStories As String = "GetStories"
+        Private Const Name_GetStories_VideoPic As String = "GetStories_VideoPic"
         Private Const Name_GetStoriesUser As String = "GetStoriesUser"
+        Private Const Name_GetStoriesUser_VideoPic As String = "GetStoriesUser_VideoPic"
         Private Const Name_GetTagged As String = "GetTaggedData"
+        Private Const Name_GetTagged_VideoPic As String = "GetTaggedData_VideoPic"
+        Private Const Name_PutImageVideoFolder As String = "PutImageVideoFolder"
         Private Const Name_TaggedChecked As String = "TaggedChecked"
         Private Const Name_NameTrue As String = "NameTrue"
+        Private Const Name_ForceUpdateUserName As String = "ForceUpdateUserName"
+        Private Const Name_ForceUpdateUserInfo As String = "ForceUpdateUserInfo"
 #End Region
 #Region "Declarations"
-        Protected Structure PostKV : Implements IEContainerProvider
+        Friend Structure PostKV : Implements IEContainerProvider
             Private Const Name_Code As String = "Code"
             Private Const Name_Section As String = "Section"
             Friend Code As String
@@ -79,17 +87,41 @@ Namespace API.Instagram
         Private LastCursor As String = String.Empty
         Private FirstLoadingDone As Boolean = False
         Friend Property GetTimeline As Boolean = True
+        Friend Property GetTimeline_VideoPic As Boolean = True
         Friend Property GetReels As Boolean = False
+        Friend Property GetReels_VideoPic As Boolean = True
         Friend Property GetStories As Boolean
+        Friend Property GetStories_VideoPic As Boolean = True
         Friend Property GetStoriesUser As Boolean
+        Friend Property GetStoriesUser_VideoPic As Boolean = True
         Friend Property GetTaggedData As Boolean
+        Friend Property GetTaggedData_VideoPic As Boolean = True
+        Friend Property PutImageVideoFolder As Boolean = False
+        Private Function ExtractImageFrom(ByVal Section As Sections) As Boolean
+            Select Case Section
+                Case Sections.Timeline : Return GetTimeline_VideoPic
+                Case Sections.Reels : Return GetReels_VideoPic
+                Case Sections.Tagged : Return GetTaggedData_VideoPic
+                Case Sections.Stories : Return GetStories_VideoPic
+                Case Sections.UserStories : Return GetStoriesUser_VideoPic
+                Case Sections.SavedPosts
+                    Try
+                        If Not HOST Is Nothing AndAlso HOST.Key = InstagramSiteKey Then Return MySiteSettings.GetSavedPosts_VideoPic.Value
+                    Catch
+                    End Try
+                    Return True
+                Case Else : Return True
+            End Select
+        End Function
         Protected _NameTrue As String = String.Empty
-        Friend ReadOnly Property NameTrue As String
+        Friend ReadOnly Property NameTrue(Optional ByVal Exact As Boolean = False) As String
             Get
-                Return _NameTrue.IfNullOrEmpty(Name)
+                Return If(Exact, _NameTrue, _NameTrue.IfNullOrEmpty(Name))
             End Get
         End Property
         Private UserNameRequested As Boolean = False
+        Friend Property ForceUpdateUserName As Boolean = False
+        Friend Property ForceUpdateUserInfo As Boolean = False
 #End Region
 #Region "Loader"
         Protected Overrides Sub LoadUserInformation_OptionalFields(ByRef Container As XmlFile, ByVal Loading As Boolean)
@@ -98,22 +130,38 @@ Namespace API.Instagram
                     LastCursor = .Value(Name_LastCursor)
                     FirstLoadingDone = .Value(Name_FirstLoadingDone).FromXML(Of Boolean)(False)
                     GetTimeline = .Value(Name_GetTimeline).FromXML(Of Boolean)(CBool(MySiteSettings.GetTimeline.Value))
-                    GetReels = .Value(Name_GetReels).FromXML(Of Boolean)(MySiteSettings.GetReels.Value)
+                    GetTimeline_VideoPic = .Value(Name_GetTimeline_VideoPic).FromXML(Of Boolean)(CBool(MySiteSettings.GetTimeline_VideoPic.Value))
+                    GetReels = .Value(Name_GetReels).FromXML(Of Boolean)(CBool(MySiteSettings.GetReels.Value))
+                    GetReels_VideoPic = .Value(Name_GetReels_VideoPic).FromXML(Of Boolean)(CBool(MySiteSettings.GetReels_VideoPic.Value))
                     GetStories = .Value(Name_GetStories).FromXML(Of Boolean)(CBool(MySiteSettings.GetStories.Value))
-                    GetStoriesUser = .Value(Name_GetStoriesUser).FromXML(Of Boolean)(MySiteSettings.GetStoriesUser.Value)
+                    GetStories_VideoPic = .Value(Name_GetStories_VideoPic).FromXML(Of Boolean)(CBool(MySiteSettings.GetStories_VideoPic.Value))
+                    GetStoriesUser = .Value(Name_GetStoriesUser).FromXML(Of Boolean)(CBool(MySiteSettings.GetStoriesUser.Value))
+                    GetStoriesUser_VideoPic = .Value(Name_GetStoriesUser_VideoPic).FromXML(Of Boolean)(CBool(MySiteSettings.GetStoriesUser_VideoPic.Value))
+                    PutImageVideoFolder = .Value(Name_PutImageVideoFolder).FromXML(Of Boolean)(CBool(MySiteSettings.PutImageVideoFolder.Value))
                     GetTaggedData = .Value(Name_GetTagged).FromXML(Of Boolean)(CBool(MySiteSettings.GetTagged.Value))
+                    GetTaggedData_VideoPic = .Value(Name_GetTagged_VideoPic).FromXML(Of Boolean)(CBool(MySiteSettings.GetTagged_VideoPic.Value))
                     TaggedChecked = .Value(Name_TaggedChecked).FromXML(Of Boolean)(False)
                     _NameTrue = .Value(Name_NameTrue)
+                    ForceUpdateUserName = .Value(Name_ForceUpdateUserName).FromXML(Of Boolean)(False)
+                    ForceUpdateUserInfo = .Value(Name_ForceUpdateUserInfo).FromXML(Of Boolean)(False)
                 Else
                     .Add(Name_LastCursor, LastCursor)
                     .Add(Name_FirstLoadingDone, FirstLoadingDone.BoolToInteger)
                     .Add(Name_GetTimeline, GetTimeline.BoolToInteger)
+                    .Add(Name_GetTimeline_VideoPic, GetTimeline_VideoPic.BoolToInteger)
                     .Add(Name_GetReels, GetReels.BoolToInteger)
+                    .Add(Name_GetReels_VideoPic, GetReels_VideoPic.BoolToInteger)
                     .Add(Name_GetStories, GetStories.BoolToInteger)
+                    .Add(Name_GetStories_VideoPic, GetStories_VideoPic.BoolToInteger)
                     .Add(Name_GetStoriesUser, GetStoriesUser.BoolToInteger)
+                    .Add(Name_GetStoriesUser_VideoPic, GetStoriesUser_VideoPic.BoolToInteger)
                     .Add(Name_GetTagged, GetTaggedData.BoolToInteger)
+                    .Add(Name_GetTagged_VideoPic, GetTaggedData_VideoPic.BoolToInteger)
+                    .Add(Name_PutImageVideoFolder, PutImageVideoFolder.BoolToInteger)
                     .Add(Name_TaggedChecked, TaggedChecked.BoolToInteger)
                     .Add(Name_NameTrue, _NameTrue)
+                    .Add(Name_ForceUpdateUserName, ForceUpdateUserName.BoolToInteger)
+                    .Add(Name_ForceUpdateUserInfo, ForceUpdateUserInfo.BoolToInteger)
                 End If
             End With
         End Sub
@@ -130,6 +178,18 @@ Namespace API.Instagram
                     GetStories = .GetStories
                     GetStoriesUser = .GetStoriesUser
                     GetTaggedData = .GetTagged
+
+                    GetTimeline_VideoPic = .GetTimeline_VideoPic
+                    GetReels_VideoPic = .GetReels_VideoPic
+                    GetStories_VideoPic = .GetStories_VideoPic
+                    GetStoriesUser_VideoPic = .GetStoriesUser_VideoPic
+                    GetTaggedData_VideoPic = .GetTagged_VideoPic
+
+                    PutImageVideoFolder = .PutImageVideoFolder
+
+                    _NameTrue = .UserName
+                    ForceUpdateUserName = .ForceUpdateUserName
+                    ForceUpdateUserInfo = .ForceUpdateUserInfo
                 End With
             End If
         End Sub
@@ -147,15 +207,32 @@ Namespace API.Instagram
         Private WwwClaimUse As Boolean = True
         Private E560Thrown As Boolean = False
         Friend Err5xx As Integer = -1
+        Private _ErrHandling As Integer = -1
+        Private Property ErrHandling As Integer
+            Get
+                Return _ErrHandling
+            End Get
+            Set(ByVal ErrCode As Integer)
+                _ErrHandling = ErrCode
+                Err5xx = ErrCode
+            End Set
+        End Property
+        Private ErrHandlingLog As Boolean = True
+        Private ErrHandlingSection As Sections = Sections.Timeline
+        Private Const ErrHandlingValue As Integer = 100
+        Private Const ErrHandlingValueStories As Integer = 150
         Private Class ExitException : Inherits Exception
             Friend Property Is560 As Boolean = False
             Friend Property IsTokens As Boolean = False
             Friend Property TokensData As String = String.Empty
             Friend Shared Sub Throw560(ByRef Source As UserData)
-                If Not Source.E560Thrown Then
-                    MyMainLOG = $"{Source.ToStringForLog}: ({IIf(Source.Err5xx > 0, Source.Err5xx, 560)}) Download skipped until next session"
-                    Source.E560Thrown = True
-                End If
+                With Source
+                    If Not .E560Thrown Then
+                        If .ErrHandling = -1 Or .ErrHandlingLog Then _
+                           MyMainLOG = $"{ .ToStringForLog}: ({IIf(.Err5xx > 0, .Err5xx, 560)}) Download skipped {If(.ErrHandling = -1, "until next session", $"({ .ErrHandlingSection})")}"
+                        .E560Thrown = True
+                    End If
+                End With
                 Throw New ExitException With {.Is560 = True}
             End Sub
             Friend Shared Sub ThrowTokens(ByRef Source As UserData, ByVal Data As String)
@@ -175,25 +252,28 @@ Namespace API.Instagram
                 End If
             End Get
         End Property
-        Protected Sub LoadSavePostsKV(ByVal Load As Boolean)
+        Friend Overloads Shared Sub LoadSavePostsKV(ByVal Load As Boolean, ByVal fPosts As SFile, ByRef List As List(Of PostKV))
             Dim x As XmlFile
-            Dim f As SFile = MyFilePostsKV
+            Dim f As SFile = fPosts
             If Not f.IsEmptyString Then
                 If Load Then
-                    PostsKVIDs.Clear()
+                    List.Clear()
                     x = New XmlFile(f, Protector.Modes.All, False) With {.AllowSameNames = True, .XmlReadOnly = True}
                     x.LoadData()
-                    If x.Count > 0 Then PostsKVIDs.ListAddList(x, LAP.IgnoreICopier)
+                    If x.Count > 0 Then List.ListAddList(x, LAP.IgnoreICopier)
                     x.Dispose()
                 Else
                     x = New XmlFile With {.AllowSameNames = True}
-                    x.AddRange(PostsKVIDs)
+                    x.AddRange(List)
                     x.Name = "Posts"
                     x.Save(f, EDP.SendToLog)
                     x.Dispose()
                 End If
             End If
         End Sub
+        Protected Overloads Sub LoadSavePostsKV(ByVal Load As Boolean)
+            LoadSavePostsKV(Load, MyFilePostsKV, PostsKVIDs)
+        End Sub
         Protected Overloads Function PostKvExists(ByVal pkv As PostKV) As Boolean
             Return PostKvExists(pkv.ID, False, pkv.Section) OrElse PostKvExists(pkv.Code, True, pkv.Section)
         End Function
@@ -316,6 +396,9 @@ Namespace API.Instagram
             Dim errorFound As Boolean = False
             Try
                 Err5xx = -1
+                ErrHandling = -1
+                ErrHandlingLog = True
+                ErrHandlingSection = Sections.Timeline
                 _Limit = If(DownloadTopCount, -1)
                 _TotalPostsParsed = 0
                 LoadSavePostsKV(True)
@@ -396,7 +479,7 @@ Namespace API.Instagram
                 If Not errorFound Then LoadSavePostsKV(False)
             End Try
         End Sub
-        Private Sub ValidateExtension()
+        Protected Sub ValidateExtension()
             Try
                 Const heic$ = "heic"
                 If _TempMediaList.Count > 0 AndAlso _TempMediaList.Exists(Function(mm) mm.File.Extension = heic) Then
@@ -423,7 +506,7 @@ Namespace API.Instagram
         Protected Overrides Sub Responser_ResponseReceived(ByVal Sender As Object, ByVal e As EventArguments.WebDataResponse)
             Declarations.UpdateResponser(e, Responser, WwwClaimUpdate)
         End Sub
-        Protected Enum Sections : Timeline : Reels : Tagged : Stories : UserStories : SavedPosts : End Enum
+        Friend Enum Sections : Timeline : Reels : Tagged : Stories : UserStories : SavedPosts : End Enum
         Protected Const StoriesFolder As String = "Stories"
         Private Const TaggedFolder As String = "Tagged"
 #Region "429 bypass"
@@ -583,11 +666,13 @@ Namespace API.Instagram
                         'Check environment
                         If Not IsSavedPosts Then
                             If ID.IsEmptyString Then GetUserData()
-                            If ID.IsEmptyString Then Throw New Plugin.ExitException("can't get user ID")
+                            If ID.IsEmptyString Then UserExists = False : _ForceSaveUserInfoOnException = True : Throw New Plugin.ExitException("can't get user ID")
                             If _UseGQL And Cursor.IsEmptyString And Not Section = Sections.SavedPosts Then
                                 If Not ValidateBaseTokens() Then GetPageTokens()
                                 If Not ValidateBaseTokens(TokensErrData) Then ValidateBaseTokens_Error(TokensErrData)
                             End If
+                            If ForceUpdateUserName Then GetUserNameById()
+                            If ForceUpdateUserInfo Then GetUserData()
                         End If
 
                         'Create query
@@ -670,6 +755,14 @@ Namespace API.Instagram
                                     Select Case Section
                                         Case Sections.Timeline
                                             With n
+                                                If If(n("user")?.Count, 0) = 0 And Cursor.IsEmptyString Then
+                                                    If Not UserNameRequested Then
+                                                        ForceUpdateUserName = True
+                                                        Continue Do
+                                                    Else
+                                                        UserExists = False
+                                                    End If
+                                                End If
                                                 HasNextPage = .Value("more_available").FromXML(Of Boolean)(False)
                                                 EndCursor = .Value("next_max_id")
                                                 If If(.Item("items")?.Count, 0) > 0 Then
@@ -753,6 +846,11 @@ NextPageBlock:
                         Throw eex
                     Catch ex As Exception
                         dValue = ProcessException(ex, Token, $"data downloading error [{URL}]",, Section, False)
+                        If dValue = ErrHandlingValue Then
+                            ExitException.Throw560(Me)
+                        ElseIf dValue = ErrHandlingValueStories Then
+                            Exit Sub
+                        End If
                     End Try
                 Loop
             Catch jsonNull2 As JsonDocumentException When jsonNull2.State = WebDocumentEventArgs.States.Error And
@@ -809,7 +907,7 @@ NextPageBlock:
                                             With j("items")
                                                 For Each jj In .Self
                                                     before = _TempMediaList.Count
-                                                    ObtainMedia(jj, PostsToReparse(i).ID, specFolder)
+                                                    ObtainMedia(jj, PostsToReparse(i).ID, specFolder,,,,,,, IIf(IsTagged, Sections.Tagged, Sections.Timeline))
                                                     If Not before = _TempMediaList.Count Then _TotalPostsParsed += 1
                                                     If _Limit > 0 And _TotalPostsParsed >= _Limit Then Throw New ExitException
                                                 Next
@@ -911,7 +1009,7 @@ NextPageBlock:
                                     End Select
                                 End If
                                 before = _TempMediaList.Count
-                                ObtainMedia(.Self, PostIDKV.ID, SpecFolder, PostDate,, PostOriginUrl, State, Attempts)
+                                ObtainMedia(.Self, PostIDKV.ID, SpecFolder, PostDate,, PostOriginUrl, State, Attempts,, Section)
                                 If Not before = _TempMediaList.Count Then _TotalPostsParsed += 1
                                 If _Limit > 0 And _TotalPostsParsed >= _Limit Then Return False
                             End If
@@ -950,6 +1048,7 @@ NextPageBlock:
         Protected ObtainMedia_SizeFuncVid As Func(Of EContainer, Sizes) = Nothing
         Protected ObtainMedia_SizeFuncPic As Func(Of EContainer, Sizes) = Nothing
         Protected ObtainMedia_AllowAbstract As Boolean = False
+        Private Const ObtainMedia_NoSection As Integer = -10
         Protected Sub ObtainMedia_SetReelsFunc()
             ObtainMedia_SizeFuncPic = Function(ByVal ss As EContainer) As Sizes
                                           If ss.Value("url").IsEmptyString Then
@@ -971,7 +1070,8 @@ NextPageBlock:
                                   Optional ByVal DateObj As String = Nothing, Optional ByVal InitialType As Integer = -1,
                                   Optional ByVal PostOriginUrl As String = Nothing,
                                   Optional ByVal State As UStates = UStates.Unknown, Optional ByVal Attempts As Integer = 0,
-                                  Optional ByVal TryExtractImage As Boolean = False)
+                                  Optional ByVal TryExtractImage As Boolean = False,
+                                  Optional ByVal Section As Sections = ObtainMedia_NoSection)
             Try
                 Dim maxSize As Func(Of EContainer, Integer) = Function(ByVal _ss As EContainer) As Integer
                                                                   Dim w% = AConvert(Of Integer)(_ss.Value("width"), 0)
@@ -1018,6 +1118,12 @@ NextPageBlock:
                     If TryExtractImage Then
                         t = 1
                         abstractDecision = True
+                        If Not SpecialFolder.IsEmptyString AndAlso PutImageVideoFolder Then
+                            Dim endsAbs As Boolean = SpecialFolder.EndsWith("*")
+                            If endsAbs Then SpecialFolder = SpecialFolder.TrimEnd("*")
+                            If Not SpecialFolder.IsEmptyString Then SpecialFolder = $"{SpecialFolder.TrimEnd("\")}\{VideoFolderName}{IIf(Not endsAbs, "*", String.Empty)}"
+                            If endsAbs Then SpecialFolder &= "*"
+                        End If
                     ElseIf t = -1 And InitialType = 8 And ObtainMedia_AllowAbstract Then
                         If n.Contains(vid) Then
                             t = 2
@@ -1064,7 +1170,8 @@ NextPageBlock:
                                         End If
                                     End With
                                 End If
-                                If Not TryExtractImage Then ObtainMedia(n, PostID, SpecialFolder, DateObj, InitialType, PostOriginUrl, State, Attempts, True)
+                                If Not TryExtractImage And Not Section = ObtainMedia_NoSection And ExtractImageFrom(Section) Then _
+                                   ObtainMedia(n, PostID, SpecialFolder, DateObj, InitialType, PostOriginUrl, State, Attempts, True, Section)
                             Case 8 'gallery
                                 DateObj = mDate(n)
                                 With n("carousel_media").XmlIfNothing
@@ -1084,6 +1191,7 @@ NextPageBlock:
 #Region "GetUserId, GetUserName"
         Private Sub GetUserData()
             Dim __idFound As Boolean = False
+            If ForceUpdateUserInfo Then ForceUpdateUserInfo = False : _ForceSaveUserInfo = True
             Try
                 ChangeResponserMode(False)
                 UpdateRequestNumber()
@@ -1102,6 +1210,7 @@ NextPageBlock:
                                 If Not eUrl.IsEmptyString AndAlso (descr.IsEmptyString OrElse Not descr.Contains(eUrl)) Then descr.StringAppendLine(eUrl)
                                 UserDescriptionUpdate(descr)
                                 Dim f As New SFile With {.Path = DownloadContentDefault_GetRootDir(), .Name = "ProfilePicture", .Extension = "jpg"}
+                                f = SFile.IndexReindex(f)
                                 If Not f.Exists Then
                                     Dim profilePicture$ = .Value("profile_pic_url_hd")
                                     If profilePicture.IsEmptyString OrElse Not GetWebFile(profilePicture, f, EDP.ReturnValue) Then
@@ -1114,6 +1223,7 @@ NextPageBlock:
                     End Using
                 End If
             Catch ex As Exception
+                UserExists = False
                 If Not __idFound Then
                     If Responser.StatusCode = HttpStatusCode.NotFound Or Responser.StatusCode = HttpStatusCode.BadRequest Then
                         Throw ex
@@ -1127,6 +1237,7 @@ NextPageBlock:
         End Sub
         Private Function GetUserNameById() As Boolean
             UserNameRequested = True
+            If ForceUpdateUserName Then ForceUpdateUserName = False : _ForceSaveUserInfo = True
             Try
                 If Not ID.IsEmptyString Then
                     UpdateRequestNumber()
@@ -1143,7 +1254,7 @@ NextPageBlock:
                                         Dim descr$ = $"Username changed from '{oldName}' to '{newName}' ({Now.ToStringDate(ADateTime.Formats.BaseDateTime)})!"
                                         descr.StringAppendLine(UserDescription)
                                         UserDescription = descr
-                                        _ForceSaveUserData = True
+                                        _ForceSaveUserInfo = True
                                     End If
                                     Return True
                                 End If
@@ -1165,6 +1276,7 @@ NextPageBlock:
             Dim qStr$, r$
             Dim i% = -1
             Dim jj As EContainer
+            Dim section As Sections = IIf(GetUserStory, Sections.UserStories, Sections.Stories)
             ThrowAny(Token)
             If StoriesList.ListExists Or GetUserStory Then
                 If Not GetUserStory Then tmpList = StoriesList.Take(5)
@@ -1181,7 +1293,7 @@ NextPageBlock:
                         Using j As EContainer = JsonDocument.Parse(r).XmlIfNothing
                             If j.Contains("reels") Then
                                 ProgressPre.ChangeMax(j("reels").Count)
-                                For Each jj In j("reels") : GetStoriesData_ParseSingleHighlight(jj, i, GetUserStory, Token) : Next
+                                For Each jj In j("reels") : GetStoriesData_ParseSingleHighlight(jj, i, GetUserStory, Token, section) : Next
                             End If
                         End Using
                     End If
@@ -1189,7 +1301,8 @@ NextPageBlock:
                 End If
             End If
         End Sub
-        Private Sub GetStoriesData_ParseSingleHighlight(ByVal Node As EContainer, ByRef Index As Integer, ByVal GetUserStory As Boolean, ByVal Token As CancellationToken)
+        Private Sub GetStoriesData_ParseSingleHighlight(ByVal Node As EContainer, ByRef Index As Integer, ByVal GetUserStory As Boolean,
+                                                        ByVal Token As CancellationToken, Optional ByVal Section As Sections = Sections.Stories)
             If Not Node Is Nothing Then
                 With Node
                     ProgressPre.Perform()
@@ -1210,7 +1323,7 @@ NextPageBlock:
                                 pid = storyID & s.Value("id")
                                 If Not _TempPostsList.Contains(pid) Then
                                     ThrowAny(Token)
-                                    ObtainMedia(s, pid, sFolder)
+                                    ObtainMedia(s, pid, sFolder,,,,,,, Section)
                                     _TempPostsList.Add(pid)
                                 End If
                             Next
@@ -1220,20 +1333,15 @@ NextPageBlock:
             End If
         End Sub
         Private Function GetStoriesList() As List(Of String)
-            Try
-                UpdateRequestNumber()
-                Dim r$ = Responser.GetResponse($"https://i.instagram.com/api/v1/highlights/{ID}/highlights_tray/",, EDP.ThrowException)
-                If Not r.IsEmptyString Then
-                    Dim ee As New ErrorsDescriber(EDP.ReturnValue) With {.DeclaredMessage = New MMessage($"{ToStringForLog()}:")}
-                    Using j As EContainer = JsonDocument.Parse(r, ee).XmlIfNothing()("tray").XmlIfNothing
-                        If j.Count > 0 Then Return j.Select(Function(jj) jj.Value("id").Replace("highlight:", String.Empty)).ListIfNothing
-                    End Using
-                End If
-                Return Nothing
-            Catch ex As Exception
-                DownloadingException(ex, "API.Instagram.GetStoriesList", False, Sections.Stories)
-                Return Nothing
-            End Try
+            UpdateRequestNumber()
+            Dim r$ = Responser.GetResponse($"https://i.instagram.com/api/v1/highlights/{ID}/highlights_tray/",, EDP.ThrowException)
+            If Not r.IsEmptyString Then
+                Dim ee As New ErrorsDescriber(EDP.ReturnValue) With {.DeclaredMessage = New MMessage($"{ToStringForLog()}:")}
+                Using j As EContainer = JsonDocument.Parse(r, ee).XmlIfNothing()("tray").XmlIfNothing
+                    If j.Count > 0 Then Return j.Select(Function(jj) jj.Value("id").Replace("highlight:", String.Empty)).ListIfNothing
+                End Using
+            End If
+            Return Nothing
         End Function
 #End Region
 #Region "Download content"
@@ -1279,11 +1387,26 @@ NextPageBlock:
                 MyMainLOG = $"Number of requests before error 429: {RequestsCount}"
                 Return 1
             ElseIf Responser.StatusCode = 560 Or Responser.StatusCode = HttpStatusCode.InternalServerError Then '560, 500
-                MySiteSettings.SkipUntilNextSession = True
-                Err5xx = Responser.StatusCode
+                If Responser.StatusCode = 560 And s = Sections.Stories And MySiteSettings.IgnoreStoriesDownloadingErrors Then
+                    MyMainLOG = $"{ToStringForLog()}: Stories downloading skipped (560)"
+                    Return ErrHandlingValueStories
+                Else
+                    MySiteSettings.SkipUntilNextSession = True
+                    Err5xx = Responser.StatusCode
+                End If
             ElseIf Responser.StatusCode = -1 And Responser.Status = -1 Then
                 MySiteSettings.SkipUntilNextSession = True
                 Err5xx = Responser.StatusCode
+            ElseIf MySiteSettings.ErrorSpecialHandling(Responser.StatusCode) Then
+                ErrHandlingLog = MySiteSettings.ErrorSpecialHandling_AddToLog(Responser.StatusCode)
+                ErrHandling = Responser.StatusCode
+                ErrHandlingSection = s
+                Return ErrHandlingValue
+            ElseIf MySiteSettings.ErrorSpecialHandling(Responser.Status) Then
+                ErrHandlingLog = MySiteSettings.ErrorSpecialHandling_AddToLog(Responser.Status)
+                ErrHandling = Responser.Status
+                ErrHandlingSection = s
+                Return ErrHandlingValue
             Else
                 MyMainLOG = $"Something is wrong. Your credentials may have expired [{CInt(Responser.StatusCode)}/{CInt(Responser.Status)}]: {ToString()} [{s}]"
                 DisableSection(s)

SCrawler/API/Mastodon/EditorExchangeOptions.vb

@@ -15,6 +15,8 @@ Namespace API.Mastodon
         <PSetting(Address:=SettingAddress.None)> Friend Overrides Property DownloadModelSearch As Boolean
         <PSetting(Address:=SettingAddress.None)> Friend Overrides Property DownloadModelForceApply As Boolean
         <PSetting(Address:=SettingAddress.None)> Friend Overrides Property DownloadModelLikes As Boolean
+        <PSetting(Address:=SettingAddress.None)> Friend Overrides Property DownloadBroadcasts As Boolean
+        <PSetting(Address:=SettingAddress.None)> Friend Overrides Property UserName As String
         Friend Sub New(ByVal s As SiteSettings)
             MyBase.New(s)
         End Sub

SCrawler/API/OnlyFans/Declarations.vb

@@ -11,6 +11,11 @@ Namespace API.OnlyFans
     Friend Module Declarations
         Friend ReadOnly DateProvider As New ADateTime("O")
         Friend ReadOnly RegExPostID As RParams = RParams.DM("(?<=onlyfans\.com/)(\d+)", 0, EDP.ReturnValue)
+        Friend ReadOnly FilesSources As New List(Of Object()) From {
+            {{"source", "source"}},
+            {{"files", "source", "url"}},
+            {{"files", "full", "url"}}
+        }
         Friend Property Rules As DynamicRulesEnv
     End Module
 End Namespace

SCrawler/API/OnlyFans/SiteSettings.vb

@@ -19,6 +19,7 @@ Namespace API.OnlyFans
 #Region "Declarations"
 #Region "Categories"
         Private Const CAT_OFS As String = "OF-Scraper support"
+        Private Const CAT_ERRORS As String = "Errors"
 #End Region
 #Region "Options"
         <PropertyOption(ControlText:="Download timeline", ControlToolTip:="Download user timeline", Category:=DN.CAT_UserDefs), PXML, PClonable>
@@ -72,6 +73,23 @@ Namespace API.OnlyFans
             End If
             Return String.Empty
         End Function
+        <PropertyOption(ControlText:="Update cookies during requests",
+                        ControlToolTip:="If unchecked, cookies will not be updated during requests. Initial cookies will always be used.", IsAuth:=True),
+                        PClonable, PXML, HiddenControl>
+        Friend ReadOnly Property EnableCookiesUpdate As PropertyValue
+#End Region
+#Region "Errors"
+        <PClonable, PXML("UpdateRules401")> Private ReadOnly Property UpdateRules401_XML As PropertyValue
+        <PropertyOption(ControlText:="Try updating rules when you get a 401 error", Category:=CAT_ERRORS), HiddenControl>
+        Friend ReadOnly Property UpdateRules401 As PropertyValue
+            Get
+                If Not DefaultInstance Is Nothing Then
+                    Return DirectCast(DefaultInstance, SiteSettings).UpdateRules401_XML
+                Else
+                    Return UpdateRules401_XML
+                End If
+            End Get
+        End Property
 #End Region
 #Region "OFScraper"
         <PClonable, PXML("OFScraperPath")> Private ReadOnly Property OFScraperPath_XML As PropertyValue
@@ -98,7 +116,7 @@ Namespace API.OnlyFans
         End Property
         Friend Const KeyModeDefault_Default As String = "cdrm"
         <PClonable, PXML("KeyModeDefault")> Private ReadOnly Property KeyModeDefault_XML As PropertyValue
-        <PropertyOption(ControlText:="key-mode-default", Category:=CAT_OFS)>
+        <PropertyOption(ControlText:="key-mode-default", ControlToolTip:="Examples: cdrm, cdrm2, keydb, manual", Category:=CAT_OFS)>
         Friend ReadOnly Property KeyModeDefault As PropertyValue
             Get
                 If Not DefaultInstance Is Nothing Then
@@ -119,6 +137,62 @@ Namespace API.OnlyFans
                 End If
             End Get
         End Property
+        <PClonable, PXML("KEYS_Key")> Private ReadOnly Property OFS_KEYS_Key_XML As PropertyValue
+        <PropertyOption(ControlText:="Private key", ControlToolTip:="Path to the DRM key file 'private_key.pem'", Category:=CAT_OFS)>
+        Friend ReadOnly Property OFS_KEYS_Key As PropertyValue
+            Get
+                If Not DefaultInstance Is Nothing Then
+                    Return DirectCast(DefaultInstance, SiteSettings).OFS_KEYS_Key_XML
+                Else
+                    Return OFS_KEYS_Key_XML
+                End If
+            End Get
+        End Property
+        <PClonable, PXML("KEYS_ClientID")> Private ReadOnly Property OFS_KEYS_ClientID_XML As PropertyValue
+        <PropertyOption(ControlText:="Client ID", ControlToolTip:="Path to the DRM key file 'client_id.bin'", Category:=CAT_OFS)>
+        Friend ReadOnly Property OFS_KEYS_ClientID As PropertyValue
+            Get
+                If Not DefaultInstance Is Nothing Then
+                    Return DirectCast(DefaultInstance, SiteSettings).OFS_KEYS_ClientID_XML
+                Else
+                    Return OFS_KEYS_ClientID_XML
+                End If
+            End Get
+        End Property
+        <PropertiesDataChecker({NameOf(KeyModeDefault), NameOf(OFS_KEYS_Key), NameOf(OFS_KEYS_ClientID)})>
+        Private Function OFS_KEYS_CHECKER(ByVal p As IEnumerable(Of PropertyData)) As Boolean
+            Const manualMode$ = "manual"
+            If p.ListExists Then
+                Dim m$ = String.Empty, k$ = String.Empty, cid$ = String.Empty
+                For Each pp As PropertyData In p
+                    Select Case pp.Name
+                        Case NameOf(KeyModeDefault) : m = pp.Value
+                        Case NameOf(OFS_KEYS_Key) : k = pp.Value
+                        Case NameOf(OFS_KEYS_ClientID) : cid = pp.Value
+                        Case Else : Throw New ArgumentException($"Property name '{pp.Name}' is not implemented", "Property Name")
+                    End Select
+                Next
+                If k.IsEmptyString And cid.IsEmptyString Then
+                    Return True
+                ElseIf Not k.IsEmptyString And Not cid.IsEmptyString Then
+                    If m = manualMode Then
+                        Return True
+                    Else
+                        Return MsgBoxE({$"You are using key files and have selected '{m}' mode." & vbCr &
+                                        $"To use key files, you should use the '{manualMode}' mode" & vbCr &
+                                        "Are you sure you want to use this mode?", "Incorrect mode"}, vbExclamation + vbYesNo) = vbYes
+                    End If
+                End If
+                Dim t As New MMessage("", "Key missing",, vbCritical)
+                If k.IsEmptyString Then
+                    t.Text = "'Private key' is missing"
+                ElseIf cid.IsEmptyString Then
+                    t.Text = "'Client ID' is missing"
+                End If
+                If Not t.Text.IsEmptyString Then t.Show()
+            End If
+            Return False
+        End Function
 #End Region
 #End Region
 #Region "Initializer"
@@ -157,6 +231,8 @@ Namespace API.OnlyFans
                 UserAgent = New PropertyValue(IIf(.UserAgentExists, .UserAgent, String.Empty), GetType(String), Sub(v) UpdateHeader(NameOf(UserAgent), v))
             End With
 
+            EnableCookiesUpdate = New PropertyValue(True)
+
             DownloadTimeline = New PropertyValue(True)
             DownloadStories = New PropertyValue(True)
             DownloadHighlights = New PropertyValue(True)
@@ -177,6 +253,10 @@ Namespace API.OnlyFans
             OFScraperMP4decrypt_XML = New PropertyValue(String.Empty, GetType(String))
             KeyModeDefault_XML = New PropertyValue(KeyModeDefault_Default)
             Keydb_Api_XML = New PropertyValue(String.Empty, GetType(String))
+            OFS_KEYS_Key_XML = New PropertyValue(String.Empty, GetType(String))
+            OFS_KEYS_ClientID_XML = New PropertyValue(String.Empty, GetType(String))
+
+            UpdateRules401_XML = New PropertyValue(False)
 
             UserRegex = RParams.DMS(String.Format(UserRegexDefaultPattern, "onlyfans.com/"), 1, EDP.ReturnValue)
             UrlPatternUser = "https://onlyfans.com/{0}"

SCrawler/API/OnlyFans/UserData.vb

@@ -99,7 +99,7 @@ Namespace API.OnlyFans
                     If Not CCookie Is Nothing Then CCookie.Dispose()
                     CCookie = Responser.Cookies.Copy
                     Responser.Cookies.Clear()
-                    AddHandler Responser.ResponseReceived, AddressOf Responser_ResponseReceived
+                    If MySettings.EnableCookiesUpdate.Value Then AddHandler Responser.ResponseReceived, AddressOf Responser_ResponseReceived
                     UpdateCookieHeader()
 
                     If Not IsSavedPosts Then
@@ -119,7 +119,7 @@ Namespace API.OnlyFans
             End Try
         End Sub
         Protected Overrides Sub Responser_ResponseReceived(ByVal Sender As Object, ByVal e As WebDataResponse)
-            If e.CookiesExists Then
+            If e.CookiesExists And CBool(MySettings.EnableCookiesUpdate.Value) Then
                 CCookie.Update(e.Cookies, CookieKeeper.UpdateModes.ReplaceByNameAll,, EDP.ReturnValue)
                 UpdateCookieHeader()
             End If
@@ -394,6 +394,14 @@ Namespace API.OnlyFans
             Loop While Not _complete
         End Sub
 #End Region
+        Private Function GetMediaURL(ByVal m As EContainer) As String
+            Dim v$
+            For Each node As Object() In FilesSources
+                v = If(m.ItemF(node)?.Value, String.Empty)
+                If Not v.IsEmptyString Then Return v
+            Next
+            Return String.Empty
+        End Function
         Private Function TryCreateMedia(ByVal n As EContainer, ByVal PostID As String, Optional ByVal PostDate As String = Nothing,
                                         Optional ByRef Result As Boolean = False, Optional ByVal IsHL As Boolean = False,
                                         Optional ByVal SpecFolder As String = Nothing, Optional ByVal PostUserID As String = Nothing,
@@ -405,11 +413,14 @@ Namespace API.OnlyFans
             With n("media")
                 If .ListExists Then
                     For Each m In .Self
-                        If IsHL Then
-                            postUrl = m.Value({"files", "source"}, "url")
-                        Else
-                            postUrl = m.Value({"source"}, "source").IfNullOrEmpty(m.Value("full"))
-                        End If
+                        postUrl = GetMediaURL(m)
+                        'If IsHL Then
+                        '    'postUrl = m.Value({"files", "source"}, "url")
+                        '    postUrl = GetMediaURL(m)
+                        'Else
+                        '    'postUrl = m.Value({"source"}, "source").IfNullOrEmpty(m.Value("full"))
+                        '    postUrl = GetMediaURL(m)
+                        'End If
                         postUrlBase = String.Empty
                         Select Case m.Value("type")
                             Case "photo" : t = UTypes.Picture : ext = "jpg"
@@ -601,7 +612,7 @@ Namespace API.OnlyFans
                     '#If DEBUG Then
                     'Debug.WriteLine(command)
                     '#End If
-                    Using b As New TokenBatch(Token) : b.Execute(command) : End Using
+                    Using b As New TokenBatch(Token) With {.DebugMode = False} : b.Execute(command) : End Using
                     Return SFile.GetFiles(conf, "*.mp4", IO.SearchOption.AllDirectories, EDP.ReturnValue)
                 End If
                 Return Nothing
@@ -612,7 +623,13 @@ Namespace API.OnlyFans
         Private Function OFS_CreateConfig() As SFile
             Try
                 Const confMainPattern$ = "{0}"": ""([^""]*)"""
+                Const confMainPattern_Keys$ = "{0}"": ([^,]*)"
                 Const confMainPatternRulesManual$ = "DYNAMIC_RULE"": (""[^""]*"")"
+
+                Const m1 As Byte = 0 'not rules
+                Const m2 As Byte = 1 'rules
+                Const m3 As Byte = 2 'keys
+
                 If OFSCache Is Nothing Then OFSCache = If(IsSingleObjectDownload, Settings.Cache.NewInstance, CreateCache())
                 Dim currentCache As CacheKeeper = OFSCache.NewInstance
                 currentCache.Validate()
@@ -626,35 +643,47 @@ Namespace API.OnlyFans
                                                     CType(Function(input) replaceValue, Func(Of String, String)), String.Empty, EDP.ReturnValue)
                     Dim ff As SFile
                     configText = f.GetText
-                    Dim updateConf As Action(Of String, String, Boolean) =
-                        Sub(ByVal patternValue As String, ByVal __replaceValue As String, ByVal __isRules As Boolean)
-                            rp.Pattern = String.Format(IIf(__isRules, confMainPatternRulesManual, confMainPattern), patternValue)
+                    Dim updateConf As Action(Of String, String, Byte) =
+                        Sub(ByVal patternValue As String, ByVal __replaceValue As String, ByVal mode As Byte)
+                            Select Case mode
+                                Case m1 : rp.Pattern = String.Format(confMainPattern, patternValue)
+                                Case m2 : rp.Pattern = String.Format(confMainPatternRulesManual, patternValue)
+                                Case m3 : rp.Pattern = String.Format(confMainPattern_Keys, patternValue) : __replaceValue = $"""{__replaceValue}"""
+                                Case Else : Throw New ArgumentException($"Mode '{mode}' is not implemented", "mode")
+                            End Select
                             rp.Nothing = configText
                             replaceValue = __replaceValue
                             configText = RegexReplace(configText, rp)
                         End Sub
                     If Not configText.IsEmptyString Then
-                        updateConf("save_location", cacheRoot.PathNoSeparator.Replace("\", "/"), False)
+                        updateConf("save_location", cacheRoot.PathNoSeparator.Replace("\", "/"), m1)
                         If ACheck(MySettings.OFScraperMP4decrypt.Value) Then
                             ff = CStr(MySettings.OFScraperMP4decrypt.Value)
-                            If ff.Exists Then updateConf("mp4decrypt", ff.ToString.Replace("\", "/"), False)
+                            If ff.Exists Then updateConf("mp4decrypt", ff.ToString.Replace("\", "/"), m1)
                         End If
-                        If Settings.FfmpegFile.Exists Then updateConf("ffmpeg", Settings.FfmpegFile.File.ToString.Replace("\", "/"), False)
-                        updateConf("key-mode-default", CStr(MySettings.KeyModeDefault.Value).IfNullOrEmpty(SiteSettings.KeyModeDefault_Default), False)
-                        updateConf("keydb_api", CStr(MySettings.Keydb_Api.Value), False)
+                        If Settings.FfmpegFile.Exists Then updateConf("ffmpeg", Settings.FfmpegFile.File.ToString.Replace("\", "/"), m1)
+
+                        updateConf("key-mode-default", CStr(MySettings.KeyModeDefault.Value).IfNullOrEmpty(SiteSettings.KeyModeDefault_Default), m1)
+                        updateConf("keydb_api", CStr(MySettings.Keydb_Api.Value), m1)
+
+                        If Not CStr(MySettings.OFS_KEYS_Key.Value).IsEmptyString And Not CStr(MySettings.OFS_KEYS_ClientID.Value).IsEmptyString Then
+                            updateConf("private-key", CStr(MySettings.OFS_KEYS_Key.Value).Replace("\", "/"), m3)
+                            updateConf("client-id", CStr(MySettings.OFS_KEYS_ClientID.Value).Replace("\", "/"), m3)
+                        End If
+
                         If Rules.RulesReplaceConfig Then
                             If Rules.RulesConfigManualMode Then
-                                updateConf(DynamicRulesEnv.DynamicRulesConfig_Mode_NodeName, "manual", False)
+                                updateConf(DynamicRulesEnv.DynamicRulesConfig_Mode_NodeName, "manual", m1)
                                 configText = configText.Replace(DynamicRulesEnv.DynamicRulesConfigNodeName_URL, DynamicRulesEnv.DynamicRulesConfigNodeName_RULES)
-                                updateConf(DynamicRulesEnv.DynamicRulesConfigNodeName_RULES, Rules.CurrentContainerRulesText, True)
+                                updateConf(DynamicRulesEnv.DynamicRulesConfigNodeName_RULES, Rules.CurrentContainerRulesText, m2)
                             Else
                                 Dim confUrlNode$ = If(Rules.RulesConstants.ContainsKey(DynamicRulesEnv.DynamicRulesConfigNodeName_URL_CONST_NAME),
                                                       Rules.RulesConstants(DynamicRulesEnv.DynamicRulesConfigNodeName_URL_CONST_NAME),
                                                       DynamicRulesEnv.DynamicRulesConfigNodeName_URL)
-                                updateConf(DynamicRulesEnv.DynamicRulesConfigNodeName_URL, Rules.CurrentRule.UrlRaw, False)
+                                updateConf(DynamicRulesEnv.DynamicRulesConfigNodeName_URL, Rules.CurrentRule.UrlRaw, m1)
                                 configText = configText.Replace(DynamicRulesEnv.DynamicRulesConfigNodeName_URL, confUrlNode)
                                 If Rules.RulesConstants.ContainsKey(DynamicRulesEnv.DynamicRulesConfig_Mode_NodeName) Then _
-                                   updateConf(DynamicRulesEnv.DynamicRulesConfig_Mode_NodeName, Rules.RulesConstants(DynamicRulesEnv.DynamicRulesConfig_Mode_NodeName), False)
+                                   updateConf(DynamicRulesEnv.DynamicRulesConfig_Mode_NodeName, Rules.RulesConstants(DynamicRulesEnv.DynamicRulesConfig_Mode_NodeName), m1)
                             End If
                         End If
                         f = currentCache
@@ -749,14 +778,20 @@ Namespace API.OnlyFans
         Private _DownloadingException_AuthFileUpdate As Boolean = False
         Protected Overrides Function DownloadingException(ByVal ex As Exception, ByVal Message As String, Optional ByVal FromPE As Boolean = False,
                                                           Optional ByVal EObj As Object = Nothing) As Integer
-            If Responser.StatusCode = Net.HttpStatusCode.BadRequest Then '400
+            If Responser.StatusCode = Net.HttpStatusCode.BadRequest Or
+               (Responser.StatusCode = Net.HttpStatusCode.Unauthorized And CBool(MySettings.UpdateRules401.Value)) Then '400, [401]
                 If Not _DownloadingException_AuthFileUpdate AndAlso Rules.Update(True) Then
                     _DownloadingException_AuthFileUpdate = True
                     Return 2
                 Else
                     MySettings.SessionAborted = True
                     MyMainLOG = $"{ToStringForLog()} [{CInt(Responser.StatusCode)}]: OnlyFans credentials expired"
-                    Return 1
+                    If Responser.StatusCode = Net.HttpStatusCode.BadRequest Then
+                        Return 1
+                    Else
+                        MyMainLOG = $"{ToStringForLog()}: Rules updated (401)"
+                        Return 3
+                    End If
                 End If
             ElseIf Responser.StatusCode = Net.HttpStatusCode.NotFound Then '404
                 UserExists = False

SCrawler/API/Pinterest/Declarations.vb

@@ -7,9 +7,11 @@
 ' This program is distributed in the hope that it will be useful,
 ' but WITHOUT ANY WARRANTY
 Imports System.Globalization
+Imports PersonalUtilities.Tools.Web.Clients
 Namespace API.Pinterest
     Friend Module Declarations
         Friend ReadOnly DateProvider As ADateTime = GetDateProvider()
+        Friend ReadOnly PwsHeader As New HttpHeader("x-pinterest-pws-handler", "www/[username]/pins.js")
         Private Function GetDateProvider() As ADateTime
             Dim n As DateTimeFormatInfo = CultureInfo.GetCultureInfo("en-us").DateTimeFormat.Clone
             n.FullDateTimePattern = "ddd dd MMM yyyy HH:mm:ss"

SCrawler/API/Pinterest/UserData.vb

@@ -186,6 +186,7 @@ Namespace API.Pinterest
                 Dim l As List(Of String) = GetDataFromGalleryDL(Board.URL, False, Token)
                 If l.ListExists Then l.RemoveAll(Function(ll) Not ll.Contains("BoardFeedResource/get/"))
                 If l.ListExists Then
+                    Responser.Headers.Add(PwsHeader)
                     ProgressPre.ChangeMax(l.Count)
                     For Each bUrl In l
                         ProgressPre.Perform()
@@ -252,6 +253,8 @@ Namespace API.Pinterest
                 End If
             Catch ex As Exception
                 ProcessException(ex, Token, $"data (gallery-dl images) downloading error [{bUrl}]")
+            Finally
+                Responser.Headers.Remove(PwsHeader)
             End Try
         End Sub
 #End Region

SCrawler/API/Reddit/Declarations.vb

@@ -21,6 +21,6 @@ Namespace API.Reddit
         Friend ReadOnly UrlBasePattern As RParams = RParams.DM("(?<=/)([^/]+?\.[\w]{3,4})(?=(\?|\Z))", 0)
         Friend ReadOnly VideoRegEx As RParams = RParams.DM("http.{0,1}://[^" & Chr(34) & "]+?mp4", 0)
         Private ReadOnly EUR_PROVIDER As New ANumbers(ANumbers.Cultures.EUR)
-        Friend ReadOnly UnixDate32ProviderReddit As New CustomProvider(Function(v, d, p, n, e) ADateTime.ParseUnix32(AConvert(Of Integer)(v, EUR_PROVIDER, v), n, e))
+        Friend ReadOnly UnixDate32ProviderReddit As New CustomProvider(Function(v, d, p, n, e) ADateTime.ParseUnix32(AConvert(Of Double)(v, EUR_PROVIDER, v), n, e))
     End Module
 End Namespace

SCrawler/API/Reddit/SiteSettings.vb

@@ -17,8 +17,8 @@ Imports PersonalUtilities.Functions.RegularExpressions
 Imports DownDetector = SCrawler.API.Base.DownDetector
 Imports Download = SCrawler.Plugin.ISiteSettings.Download
 Namespace API.Reddit
-    <Manifest(RedditSiteKey), SavedPosts, SpecialForm(False)>
-    Friend Class SiteSettings : Inherits SiteSettingsBase
+    <Manifest(RedditSiteKey), SavedPosts, SpecialForm(False), UseDownDetector>
+    Friend Class SiteSettings : Inherits SiteSettingsBase : Implements DownDetector.IDownDetector
 #Region "Declarations"
 #Region "Authorization"
         <PropertyOption(ControlText:="Login", ControlToolTip:="Your authorization username", IsAuth:=True), PXML, PClonable(Clone:=False)>
@@ -67,6 +67,26 @@ Namespace API.Reddit
         <PropertyOption(ControlText:="Check image: get original", ControlToolTip:="Get the original image if it exists", IsAuth:=False), PXML, PClonable>
         Friend ReadOnly Property CheckImageReturnOrig As PropertyValue
 #End Region
+#Region "IDownDetector Support"
+        Private ReadOnly Property IDownDetector_Value As Integer Implements DownDetector.IDownDetector.Value
+            Get
+                Return 100
+            End Get
+        End Property
+        Private ReadOnly Property IDownDetector_AddToLog As Boolean Implements DownDetector.IDownDetector.AddToLog
+            Get
+                Return False
+            End Get
+        End Property
+        Private ReadOnly Property IDownDetector_CheckSite As String Implements DownDetector.IDownDetector.CheckSite
+            Get
+                Return "reddit"
+            End Get
+        End Property
+        Private Function IDownDetector_Available(ByVal What As Download, ByVal Silent As Boolean) As Boolean Implements DownDetector.IDownDetector.Available
+            Return MDD.Available(What, Silent)
+        End Function
+#End Region
 #End Region
 #Region "Initializer"
         Friend Sub New(ByVal AccName As String, ByVal Temp As Boolean)
@@ -97,6 +117,8 @@ Namespace API.Reddit
             CheckImage = New PropertyValue(False)
             CheckImageReturnOrig = New PropertyValue(True)
 
+            MDD = New MyDownDetector(Me)
+
             UrlPatternUser = "https://www.reddit.com/{0}/{1}/"
             ImageVideoContains = "reddit.com"
             UserRegex = RParams.DM("[htps:/]{7,8}.*?reddit.com/([user]{1,4})/([^/\?&]+)", 0, RegexReturn.ListByMatch, EDP.ReturnValue)
@@ -116,81 +138,48 @@ Namespace API.Reddit
         End Function
 #End Region
 #Region "DownloadStarted, ReadyToDownload, Available, DownloadDone, UpdateRedGifsToken"
-        Private ____DownloadStarted As Boolean = False
-        Friend Overrides Sub DownloadStarted(ByVal What As Download)
-            If What = Download.Main Then ____DownloadStarted = True
-            MyBase.DownloadStarted(What)
-        End Sub
+        Private ReadOnly MDD As MyDownDetector
+        Private Class MyDownDetector : Inherits DownDetector.Checker(Of SiteSettings)
+            Private __TrueValue As Boolean = False
+            Friend Sub New(ByRef _Source As SiteSettings)
+                MyBase.New(_Source)
+            End Sub
+            Protected Overrides Function AvailableImpl(ByVal What As Download, ByVal Silent As Boolean) As Boolean
+                __TrueValue = Source.AvailableTrueValue(What)
+                Return MyBase.AvailableImpl(What, Silent)
+            End Function
+            Protected Overrides Function AvailableImpl_TRUE() As Boolean
+                Return AvailableImpl_TrueValueReturn()
+            End Function
+            Protected Overrides Function AvailableImpl_FALSE_SILENT_NOT_MSG_YES() As Boolean
+                Return AvailableImpl_TrueValueReturn()
+            End Function
+            Private Function AvailableImpl_TrueValueReturn() As Boolean
+                If __TrueValue Then Source.UpdateRedGifsToken()
+                Return __TrueValue AndAlso Source.UpdateTokenIfRequired()
+            End Function
+            Friend Overrides Sub Reset()
+                __TrueValue = False
+                MyBase.Reset()
+            End Sub
+        End Class
         Friend Property SessionInterrupted As Boolean = False
         Friend Overrides Function ReadyToDownload(ByVal What As Download) As Boolean
             If What = Download.Main Then
-                Dim result As Boolean = Not SessionInterrupted
-                If result Then
-                    If ____DownloadStarted And ____AvailableRequested Then
-                        ____AvailableResult = AvailableImpl(What, ____AvailableSilent)
-                        ____AvailableChecked = True
-                        ____AvailableRequested = False
-                        result = ____AvailableResult
-                    ElseIf ____AvailableChecked Then
-                        result = ____AvailableResult
-                    End If
-                End If
-                Return result
+                Return Not SessionInterrupted
             Else
                 Return True
             End If
         End Function
-        Private ____AvailableRequested As Boolean = False
-        Private ____AvailableSilent As Boolean = True
-        Private ____AvailableChecked As Boolean = False
-        Private ____AvailableResult As Boolean = False
         Friend Overrides Function Available(ByVal What As Download, ByVal Silent As Boolean) As Boolean
-            If What = Download.Main And ____DownloadStarted Then
-                ____AvailableRequested = True
-                ____AvailableSilent = Silent
-                Return True
-            Else
-                Return AvailableImpl(What, Silent)
-            End If
+            Return AvailableTrueValue(What)
         End Function
-        Private Function AvailableImpl(ByVal What As Download, ByVal Silent As Boolean) As Boolean
-            Try
-                AvailableText = String.Empty
-                Dim trueValue As Boolean = Not What = Download.SavedPosts OrElse (Responser.CookiesExists And ACheck(SavedPostsUserName.Value))
-                If Not trueValue Then Return False
-                Dim dl As List(Of DownDetector.Data) = DownDetector.GetData("reddit")
-                If dl.ListExists Then
-                    dl = dl.Take(4).ToList
-                    Dim avg% = dl.Average(Function(d) d.Value)
-                    If avg > 100 Then
-                        AvailableText = "Over the past hour, Reddit has received an average of " &
-                                        avg.NumToString(New ANumbers With {.FormatOptions = ANumbers.Options.GroupIntegral}) & " outage reports:" & vbCr &
-                                        dl.ListToString(vbCr)
-                        If Silent Then
-                            Return False
-                        Else
-                            If MsgBoxE({$"{AvailableText}{vbCr}{vbCr}Do you want to continue parsing Reddit data?", "There are outage reports on Reddit"}, vbYesNo) = vbYes Then
-                                If trueValue Then UpdateRedGifsToken()
-                                Return trueValue AndAlso UpdateTokenIfRequired()
-                            Else
-                                Return False
-                            End If
-                        End If
-                    End If
-                End If
-                If trueValue Then UpdateRedGifsToken()
-                Return trueValue AndAlso UpdateTokenIfRequired()
-            Catch ex As Exception
-                Return ErrorsDescriber.Execute(EDP.SendToLog + EDP.ReturnValue, ex, "[API.Reddit.SiteSettings.Available]", True)
-            End Try
+        Private Function AvailableTrueValue(ByVal What As Download) As Boolean
+            Return Not What = Download.SavedPosts OrElse (Responser.CookiesExists And ACheck(SavedPostsUserName.Value))
         End Function
         Friend Overrides Sub DownloadDone(ByVal What As Download)
             SessionInterrupted = False
-            ____DownloadStarted = False
-            ____AvailableRequested = False
-            ____AvailableChecked = False
-            ____AvailableSilent = True
-            ____AvailableResult = False
+            MDD.Reset()
             MyBase.DownloadDone(What)
         End Sub
         Private Sub UpdateRedGifsToken()

SCrawler/API/ThisVid/UserData.vb

@@ -473,35 +473,47 @@ Namespace API.ThisVid
                     Dim u As UserMedia
                     Dim n$, r$
                     Dim c% = 0
+                    Dim ii As Byte
+                    Dim repeat As Boolean
                     Progress.Maximum += _TempMediaList.Count
                     For i% = _TempMediaList.Count - 1 To 0 Step -1
                         Progress.Perform()
                         u = _TempMediaList(i)
                         If u.Type = UserMedia.Types.VideoPre Then
                             If Not DownloadTopCount.HasValue OrElse c <= DownloadTopCount.Value Then
-                                ThrowAny(Token)
-                                r = Responser.GetResponse(u.URL,, EDP.ReturnValue)
-                                If Not r.IsEmptyString Then
-                                    n = TitleHtmlConverter(RegexReplace(r, RegExVideoTitle))
-                                    u.Post.ID = u.URL
-                                    If Not n.IsEmptyString Then n = n.Replace("ThisVid.com", String.Empty).StringTrim.StringTrimEnd("-").StringTrim
-                                    If n.IsEmptyString Then n = TitleHtmlConverter(u.URL.Replace("https://thisvid.com/videos/", String.Empty).StringTrim.StringTrimEnd("-").StringTrim)
-                                    If n.IsEmptyString Then n = "VideoFile"
-                                    u.File = $"{n}.mp4"
-                                    u.PictureOption = n
-                                    u.URL = RegexReplace(r, Regex_VideosThumb_OG_IMAGE)
-                                    If u.URL.IsEmptyString Then u.URL = RegexReplace(r, RegExVideosThumb1)
-                                    If u.URL.IsEmptyString Then u.URL = RegexReplace(r, RegExVideosThumb2)
-                                    If Not u.URL.IsEmptyString Then
-                                        u.URL = LinkFormatterSecure(u.URL)
-                                        u.Type = UserMedia.Types.Video
-                                        _TempPostsList.Add(u.Post.ID)
-                                        _TempMediaList(i) = u
-                                        c += 1
-                                    Else
-                                        _TempMediaList.RemoveAt(i)
+                                repeat = False
+                                For ii = 0 To 1
+                                    ThrowAny(Token)
+                                    r = Responser.GetResponse(u.URL,, EDP.ReturnValue)
+                                    If Not r.IsEmptyString Then
+                                        n = TitleHtmlConverter(RegexReplace(r, RegExVideoTitle))
+                                        u.Post.ID = u.URL
+                                        If Not n.IsEmptyString Then n = n.Replace("ThisVid.com", String.Empty).StringTrim.StringTrimEnd("-").StringTrim
+                                        If n.IsEmptyString Then n = TitleHtmlConverter(u.URL.Replace("https://thisvid.com/videos/", String.Empty).StringTrim.StringTrimEnd("-").StringTrim)
+                                        If n.IsEmptyString Then n = "VideoFile"
+                                        u.File = $"{n}.mp4"
+                                        u.PictureOption = n
+                                        u.URL = RegexReplace(r, Regex_VideosThumb_OG_IMAGE)
+                                        If u.URL.IsEmptyString And Not repeat And ii = 0 Then
+                                            Thread.Sleep(250)
+                                            u = _TempMediaList(i)
+                                            repeat = True
+                                            Continue For
+                                        End If
+                                        If u.URL.IsEmptyString Then u.URL = RegexReplace(r, RegExVideosThumb1)
+                                        If u.URL.IsEmptyString Then u.URL = RegexReplace(r, RegExVideosThumb2)
+                                        If Not u.URL.IsEmptyString Then
+                                            u.URL = LinkFormatterSecure(u.URL)
+                                            u.Type = UserMedia.Types.Video
+                                            _TempPostsList.Add(u.Post.ID)
+                                            _TempMediaList(i) = u
+                                            c += 1
+                                        Else
+                                            _TempMediaList.RemoveAt(i)
+                                        End If
                                     End If
-                                End If
+                                    If Not repeat Then Exit For
+                                Next
                             Else
                                 _TempMediaList.RemoveAt(i)
                             End If

SCrawler/API/ThreadsNet/UserData.vb

@@ -115,6 +115,7 @@ Namespace API.ThreadsNet
                     Responser.Method = "POST"
                     UpdateResponser()
                     MySettings.UpdateResponserData(Responser)
+                    ValidateExtension()
                     If Not errorFound Then LoadSavePostsKV(False)
                 End Try
             End If

SCrawler/API/Twitter/Declarations.vb

@@ -16,6 +16,7 @@ Namespace API.Twitter
         Friend ReadOnly DateProvider As ADateTime = GetDateProvider()
         Friend ReadOnly VideoSizeRegEx As RParams = RParams.DMS("\d+x(\d+)", 1, EDP.ReturnValue)
         Friend ReadOnly StatusRegEx As RParams = RParams.DM(".*?(twitter|x)\.com/\S+/status/\d+", 0, EDP.ReturnValue)
+        Friend ReadOnly BroadcastsUrls As Object() = {"entities", "urls", 0, "expanded_url"}
         Private Function GetDateProvider() As ADateTime
             Dim n As DateTimeFormatInfo = CultureInfo.GetCultureInfo("en-us").DateTimeFormat.Clone
             n.FullDateTimePattern = "ddd MMM dd HH:mm:ss +ffff yyyy"

SCrawler/API/Twitter/EditorExchangeOptions.vb

@@ -8,6 +8,7 @@
 ' but WITHOUT ANY WARRANTY
 Imports SCrawler.Plugin.Attributes
 Imports DModels = SCrawler.API.Twitter.UserData.DownloadModels
+Imports DN = SCrawler.API.Base.DeclaredNames
 Namespace API.Twitter
     Friend Class EditorExchangeOptions
         Private Const DefaultOffset As Integer = 100
@@ -42,10 +43,16 @@ Namespace API.Twitter
                   Caption:="Download model 'Likes'",
                   ToolTip:="Download the data using the 'https://x.com/UserName/likes' command.", LeftOffset:=DefaultOffset)>
         Friend Overridable Property DownloadModelLikes As Boolean = False
+        <PSetting(Address:=SettingAddress.User,
+                  Caption:="Download 'Broadcasts'",
+                  ToolTip:="Download broadcasts posted by the user using the 'https://x.com/i/broadcasts/abcdef1234567' URLs", LeftOffset:=DefaultOffset)>
+        Friend Overridable Property DownloadBroadcasts As Boolean = False
         <PSetting(Address:=SettingAddress.User,
                   Caption:="Force apply",
                   ToolTip:="Force overrides the default parameters for the first download." & vbCr & "Applies to first download only.", LeftOffset:=DefaultOffset)>
         Friend Overridable Property DownloadModelForceApply As Boolean = False
+        <PSetting(Address:=SettingAddress.User, Caption:=DN.UserNameChangeCaption, ToolTip:=DN.UserNameChangeToolTip, LeftOffset:=DefaultOffset)>
+        Friend Overridable Property UserName As String = String.Empty
         Private ReadOnly Property MySettings As Object
         Friend Sub New(ByVal s As SiteSettings)
             GifsDownload = s.GifsDownload.Value
@@ -72,6 +79,7 @@ Namespace API.Twitter
             MediaModelAllowNonUserTweets = u.MediaModelAllowNonUserTweets
             If Not TypeOf u Is Mastodon.UserData Then
                 DownloadModelForceApply = u.DownloadModelForceApply
+                DownloadBroadcasts = u.DownloadBroadcasts
                 Dim dm As DModels() = EnumExtract(Of DModels)(u.DownloadModel)
                 If dm.ListExists Then
                     DownloadModelMedia = dm.Contains(DModels.Media)
@@ -80,6 +88,7 @@ Namespace API.Twitter
                     DownloadModelLikes = dm.Contains(DModels.Likes)
                 End If
             End If
+            UserName = u.NameTrue(True)
             MySettings = u.HOST.Source
         End Sub
     End Class

SCrawler/API/Twitter/SiteSettings.vb

@@ -162,6 +162,13 @@ Namespace API.Twitter
                 Return Nothing
             End If
         End Function
+        Friend Overrides Function IsMyImageVideo(ByVal URL As String) As ExchangeOptions
+            If Not URL.IsEmptyString AndAlso (URL.Contains("twitter") Or URL.Contains("x.com")) Then
+                Return New ExchangeOptions(Site, String.Empty) With {.Exists = True}
+            Else
+                Return Nothing
+            End If
+        End Function
         Friend Overrides Function GetUserUrl(ByVal User As IPluginContentProvider) As String
             Return DirectCast(User, UserData).GetUserUrl
         End Function

SCrawler/API/Twitter/UserData.vb

@@ -7,6 +7,7 @@
 ' This program is distributed in the hope that it will be useful,
 ' but WITHOUT ANY WARRANTY
 Imports System.Threading
+Imports System.Text.RegularExpressions
 Imports SCrawler.API.Base
 Imports SCrawler.API.YouTube.Objects
 Imports PersonalUtilities.Functions.XML
@@ -16,6 +17,7 @@ Imports PersonalUtilities.Tools.Web.Documents
 Imports PersonalUtilities.Tools.Web.Documents.JSON
 Imports UStates = SCrawler.API.Base.UserMedia.States
 Imports UTypes = SCrawler.API.Base.UserMedia.Types
+Imports PKV = SCrawler.API.Instagram.UserData.PostKV
 Namespace API.Twitter
     Friend Class UserData : Inherits UserDataBase
 #Region "XML names"
@@ -23,17 +25,20 @@ Namespace API.Twitter
         Private Const Name_DownloadModel As String = "DownloadModel"
         Private Const Name_DownloadModelForceApply As String = "DownloadModelForceApply"
         Private Const Name_MediaModelAllowNonUserTweets As String = "MediaModelAllowNonUserTweets"
+        Private Const Name_DownloadBroadcasts As String = "DownloadBroadcasts"
         Private Const Name_GifsDownload As String = "GifsDownload"
         Private Const Name_GifsSpecialFolder As String = "GifsSpecialFolder"
         Private Const Name_GifsPrefix As String = "GifsPrefix"
         Private Const Name_IsCommunity As String = "IsCommunity"
+        Private Const Name_DownloadModelChanged As String = "DownloadModelChanged"
 #End Region
 #Region "Declarations"
+        Private Const BroadCastPartUrl As String = "i/broadcasts"
         Private Const Label_Community As String = "Community"
         Private _NameTrue As String = String.Empty
-        Friend Property NameTrue As String
+        Friend Property NameTrue(Optional ByVal Exact As Boolean = False) As String
             Get
-                Return _NameTrue.IfNullOrEmpty(Name)
+                Return If(Exact, _NameTrue, _NameTrue.IfNullOrEmpty(Name))
             End Get
             Set(ByVal NewName As String)
                 _NameTrue = NewName
@@ -54,12 +59,20 @@ Namespace API.Twitter
         Private FirstDownloadComplete As Boolean = False
         Friend Property DownloadModelForceApply As Boolean = False
         Friend Property DownloadModel As DownloadModels = DownloadModels.Undefined
+        Private ReadOnly Property IsMultiMode As Boolean
+            Get
+                Return EnumExtract(Of DownloadModels)(DownloadModel).ListIfNothing.Count > 1
+            End Get
+        End Property
+        Private Property DownloadModelChanged As Boolean = False
         Friend Property MediaModelAllowNonUserTweets As Boolean = False
+        Friend Property DownloadBroadcasts As Boolean = False
         Friend Property GifsDownload As Boolean = True
         Friend Property GifsSpecialFolder As String = String.Empty
         Friend Property GifsPrefix As String = String.Empty
         Friend Property IsCommunity As Boolean = False
         Private ReadOnly LikesPosts As List(Of String)
+        Private ReadOnly PostsKV As List(Of PKV)
         Private ReadOnly _DataNames As List(Of String)
         Private ReadOnly Property MySettings As SiteSettings
             Get
@@ -90,13 +103,18 @@ Namespace API.Twitter
                     GifsPrefix = .GifsPrefix
                     UseMD5Comparison = .UseMD5Comparison
                     RemoveExistingDuplicates = .RemoveExistingDuplicates
+                    If RemoveExistingDuplicates Then StartMD5Checked = False
                     DownloadModel = DownloadModels.Undefined
                     DownloadModelForceApply = .DownloadModelForceApply
                     MediaModelAllowNonUserTweets = .MediaModelAllowNonUserTweets
+                    DownloadBroadcasts = .DownloadBroadcasts
+                    Dim dModel As DownloadModels = DownloadModel
                     If .DownloadModelMedia Then DownloadModel += DownloadModels.Media
-                    If .DownloadModelProfile Then DownloadModel += DownloadModels.Profile
+                    If .DownloadModelProfile Or .DownloadBroadcasts Then DownloadModel += DownloadModels.Profile
                     If .DownloadModelSearch Then DownloadModel += DownloadModels.Search
                     If .DownloadModelLikes Then DownloadModel += DownloadModels.Likes
+                    If Not dModel = DownloadModel Then DownloadModelChanged = True
+                    _NameTrue = .UserName
                 End With
             End If
         End Sub
@@ -105,11 +123,15 @@ Namespace API.Twitter
         Friend Sub New()
             _DataNames = New List(Of String)
             LikesPosts = New List(Of String)
+            PostsKV = New List(Of PKV)
+            UseInternalM3U8Function = True
         End Sub
         Protected Overrides Sub LoadUserInformation_OptionalFields(ByRef Container As XmlFile, ByVal Loading As Boolean)
             With Container
                 If Loading Then
+                    DownloadBroadcasts = .Value(Name_DownloadBroadcasts).FromXML(Of Boolean)(False)
                     DownloadModelForceApply = .Value(Name_DownloadModelForceApply).FromXML(Of Boolean)(False)
+                    DownloadModelChanged = .Value(Name_DownloadModelChanged).FromXML(Of Boolean)(False)
                     If .Contains(Name_FirstDownloadComplete) Then
                         FirstDownloadComplete = .Value(Name_FirstDownloadComplete).FromXML(Of Boolean)(False)
                         DownloadModel = .Value(Name_DownloadModel).FromXML(Of Integer)(DownloadModels.Undefined)
@@ -157,7 +179,9 @@ Namespace API.Twitter
                     End If
                     .Add(Name_FirstDownloadComplete, FirstDownloadComplete.BoolToInteger)
                     .Add(Name_DownloadModelForceApply, DownloadModelForceApply.BoolToInteger)
+                    .Add(Name_DownloadModelChanged, DownloadModelChanged.BoolToInteger)
                     .Add(Name_DownloadModel, CInt(DownloadModel))
+                    .Add(Name_DownloadBroadcasts, DownloadBroadcasts.BoolToInteger)
                     .Add(Name_GifsDownload, GifsDownload.BoolToInteger)
                     .Add(Name_GifsSpecialFolder, GifsSpecialFolder)
                     .Add(Name_GifsPrefix, GifsPrefix)
@@ -180,6 +204,68 @@ Namespace API.Twitter
                 {{"item", "itemContent", "tweet_results", "result", "tweet", "legacy"}}
             }
         End Function
+        Private Function ExtractBroadcast(ByVal e As EContainer, Optional ByVal PostID As String = Nothing, Optional ByVal PostDate As String = Nothing,
+                                          Optional ByVal Nodes As List(Of String()) = Nothing,
+                                          Optional ByVal IgnoreNodes As Boolean = False) As UserMedia
+            If e.ListExists Then
+                Dim __nodes As List(Of String()) = If(Nodes, GetContainerSubnodes())
+                Dim urlValue$
+                Dim m As UserMedia = Nothing
+                Dim __parseContainer As Func(Of EContainer, Boolean) =
+                    Function(ByVal ee As EContainer) As Boolean
+                        With ee
+                            If .ListExists Then
+                                urlValue = .ItemF(BroadcastsUrls, EDP.ReturnValue).XmlIfNothingValue
+                                If Not urlValue.IsEmptyString AndAlso urlValue.Contains(BroadCastPartUrl) Then
+                                    m = MediaFromData(urlValue, PostID, PostDate,,, UTypes.m3u8)
+                                    If Not IsSingleObjectDownload Then m.SpecialFolder = "Broadcasts*"
+                                    Return True
+                                End If
+                            End If
+                        End With
+                        Return False
+                    End Function
+                If IgnoreNodes Then
+                    If __parseContainer(e) Then Return m
+                Else
+                    For Each n As String() In __nodes
+                        If __parseContainer(e(n)) Then Return m
+                    Next
+                End If
+                m = ExtractBroadcast(e.ItemF(Of Object)({0}), PostID, PostDate, Nodes)
+                If Not m.URL.IsEmptyString Then Return m
+            End If
+            Return Nothing
+        End Function
+        Private ReadOnly Property MyFilePostsKV As SFile
+            Get
+                Dim f As SFile = MyFilePosts
+                If Not f.IsEmptyString Then
+                    f.Name &= "_KV"
+                    f.Extension = "xml"
+                    Return f
+                Else
+                    Return Nothing
+                End If
+            End Get
+        End Property
+        Protected Sub LoadSavePostsKV(ByVal Load As Boolean)
+            Instagram.UserData.LoadSavePostsKV(Load, MyFilePostsKV, PostsKV)
+        End Sub
+        Private Function PostKVExists(ByVal PID As String, ByVal Model As DownloadModels,
+                                      ByVal MultiMode As Boolean, ByVal IgnorePKV As Boolean, ByVal AutoAdd As Boolean) As Boolean
+            Dim result As Boolean
+            If IgnorePKV Or PostsKV.Count = 0 Then
+                result = _TempPostsList.Contains(PID)
+            Else
+                result = PostsKV.Contains(New PKV(PID, PID, Model)) Or (Not MultiMode AndAlso _TempPostsList.Contains(PID))
+            End If
+            If Not result And AutoAdd Then
+                PostsKV.ListAddValue(New PKV(PID, PID, Model), LNC)
+                _TempPostsList.ListAddValue(PID, LNC)
+            End If
+            Return result
+        End Function
         Protected Overrides Sub DownloadDataF(ByVal Token As CancellationToken)
             Try
                 If MySettings.LIMIT_ABORT Then
@@ -189,9 +275,17 @@ Namespace API.Twitter
                         If _ContentList.Count > 0 Then _DataNames.ListAddList(_ContentList.Select(Function(c) c.Post.ID), LAP.ClearBeforeAdd, LAP.NotContainsOnly)
                         DownloadData_SavedPosts(Token)
                     Else
+                        LoadSavePostsKV(True)
+                        If PostsKV.Count = 0 And (_ContentList.Count > 0 Or _TempPostsList.Count > 0) Then
+                            Dim m As DownloadModels = IIf(IsMultiMode, DownloadModels.Media, DownloadModel)
+                            PostsKV.ListAddList(_TempPostsList.Select(Function(p) New PKV(p, p, m)), LNC)
+                            PostsKV.ListAddList(_ContentList.Select(Function(p) New PKV(p.Post.ID, p.Post.ID, m)), LNC)
+                            _ForceSaveUserData = True
+                        End If
                         LikesPosts.Clear()
                         If _ContentList.Count > 0 Then _DataNames.ListAddList(_ContentList.Select(Function(c) c.File.File), LAP.ClearBeforeAdd, LAP.NotContainsOnly)
                         DownloadData_Timeline(Token)
+                        LoadSavePostsKV(False)
                         If LikesPosts.Count > 0 Then
                             _ReparseLikes = True
                             ReparseMissing(Token)
@@ -226,6 +320,8 @@ Namespace API.Twitter
                 Dim indxChanged As Boolean = False
                 Dim isOneNode As Boolean, isPins As Boolean, ExistsDetected As Boolean, userInfoParsed As Boolean = False
                 Dim j As EContainer, rootNode As EContainer, optionalNode As EContainer, workingNode As EContainer, tmpNode As EContainer, nn As EContainer = Nothing
+                Dim multiMode As Boolean = IsMultiMode
+                Dim currentModel As DownloadModels = DownloadModels.Undefined
 
                 Dim __parseContainer As Func(Of EContainer, Boolean) =
                     Function(ByVal ee As EContainer) As Boolean
@@ -248,14 +344,13 @@ Namespace API.Twitter
                                 Case DateResult.Skip, DateResult.Exit : Return False
                             End Select
 
-                            If Not _TempPostsList.Contains(PostID) Then
-                                _TempPostsList.Add(PostID)
+                            If Not PostKVExists(PostID, currentModel, multiMode, False, True) Then
                             ElseIf dirIndx = 3 Then
                             ElseIf isPins Then
                                 Return False
                             Else
-                                ExistsDetected = True
-                                Return False
+                                ExistsDetected = Not multiMode
+                                Return multiMode
                             End If
 
                             tmpUserId = nn({"retweeted_status_result", "result", "legacy", "user_id_str"}).XmlIfNothingValue
@@ -266,12 +361,21 @@ Namespace API.Twitter
                             If (Not ParseUserMediaOnly Or dirIndx = 3) OrElse
                                (dirIndx = 0 AndAlso MediaModelAllowNonUserTweets) OrElse
                                (Not ID.IsEmptyString AndAlso tmpUserId = ID) Then
+                                If dirIndx = 1 And DownloadBroadcasts Then
+                                    Dim m As UserMedia = ExtractBroadcast(nn, PostID, PostDate, nodes)
+                                    If Not m.URL.IsEmptyString Then
+                                        _TempMediaList.ListAddValue(m, LNC)
+                                    Else
+                                        m = ExtractBroadcast(ee, PostID, PostDate, nodes)
+                                        If Not m.URL.IsEmptyString Then _TempMediaList.ListAddValue(m, LNC)
+                                    End If
+                                End If
                                 If dirIndx = 3 Then
                                     Dim lUrl$ = nn.ItemF({"content", "itemContent", "tweet_results", "result", "legacy", "entities", "media", 0}, "expanded_url").XmlIfNothingValue
                                     If Not lUrl.IsEmptyString Then
                                         lUrl = RegexReplace(lUrl, StatusRegEx)
                                         If Not lUrl.IsEmptyString Then
-                                            If Not _TempPostsList.Contains(lUrl) Then _TempPostsList.Add(lUrl) Else Return False
+                                            If PostKVExists(lUrl, currentModel, multiMode, False, True) Then Return multiMode
                                             LikesPosts.ListAddValue(lUrl, LNC)
                                         End If
                                     End If
@@ -285,11 +389,23 @@ Namespace API.Twitter
 
                 tCache = CreateCache()
 
+                '0 - media
+                '1 - profile
+                '2 - search
+                '3 - likes
                 Dim dirs As List(Of SFile) = GetTimelineFromGalleryDL(tCache, Token)
                 If dirs.ListExists Then
                     For Each dir As SFile In dirs
                         dirIndx += 1
 
+                        Select Case dirIndx
+                            Case 0 : currentModel = DownloadModels.Media
+                            Case 1 : currentModel = DownloadModels.Profile
+                            Case 2 : currentModel = DownloadModels.Search
+                            Case 3 : currentModel = DownloadModels.Likes
+                            Case Else : currentModel = DownloadModels.Undefined
+                        End Select
+
                         If dirIndx = 3 Then likesDetected = True
 
                         ExistsDetected = False
@@ -429,7 +545,7 @@ Namespace API.Twitter
                                                         ProgressPre.ChangeMax(If(isOneNode, 1, .Count))
                                                         If isOneNode Then
                                                             ProgressPre.Perform()
-                                                            If Not __parseContainer(.Self) Then Exit For
+                                                            If Not __parseContainer(.Self) Then Continue For 'Exit For
                                                         Else
                                                             For nodeIndx = 0 To 1
                                                                 If nodeIndx = 0 Then
@@ -444,14 +560,19 @@ Namespace API.Twitter
                                                                                                   .ItemF(newTwitterNodes),
                                                                                                   .Self)
                                                                             ProgressPre.Perform()
-                                                                            If Not __parseContainer(tmpNode) Then Exit For
+                                                                            If Not __parseContainer(tmpNode) Then
+                                                                                If isPins Then GoTo nextpIndx
+                                                                                Exit For
+                                                                            End If
                                                                         Next
                                                                     End With
                                                                 End If
+nextNodeIndx:
                                                             Next
                                                         End If
                                                     End With
                                                 End If
+nextpIndx:
                                             Next
 
                                             If ExistsDetected And i = 1 Then Exit For Else ExistsDetected = False
@@ -471,6 +592,7 @@ Namespace API.Twitter
                     If DownloadModel = DownloadModels.Undefined Then
                         If ParseUserMediaOnly Then
                             DownloadModel = DownloadModels.Media
+                            If DownloadBroadcasts Then DownloadModel += DownloadModels.Profile
                         Else
                             DownloadModel = DownloadModels.Media + DownloadModels.Profile + DownloadModels.Search
                         End If
@@ -729,7 +851,9 @@ Namespace API.Twitter
                 Dim conf As SFile = GdlCreateConf(confCache.RootDirectory)
 
                 If DownloadModel = DownloadModels.Undefined And Not FirstDownloadComplete And DownloadModelForceApply Then
-                    If ParseUserMediaOnly Then
+                    If ParseUserMediaOnly And DownloadBroadcasts Then
+                        DownloadModel = DownloadModels.Media + DownloadModels.Profile
+                    ElseIf ParseUserMediaOnly Then
                         DownloadModel = DownloadModels.Media
                     Else
                         DownloadModel = DownloadModels.Media + DownloadModels.Profile + DownloadModels.Search
@@ -740,11 +864,15 @@ Namespace API.Twitter
                 Dim rootDir As CacheKeeper = Cache.NewInstance
                 Dim dir As SFile
                 Dim dm As List(Of DownloadModels) = EnumExtract(Of DownloadModels)(DownloadModel).ListIfNothing
-                Dim process As Boolean
+                Dim process As Boolean, multiMode As Boolean
+                Dim currentModel As DownloadModels
                 Dim urlPrePattern$ = $"https://x.com{IIf(IsCommunity, SiteSettings.CommunitiesUser, String.Empty)}/"
 
+                If DownloadBroadcasts AndAlso Not dm.Contains(DownloadModels.Profile) Then dm.Add(DownloadModels.Profile)
+
+                multiMode = dm.Count > 1
+
                 Using tgdl As New TwitterGDL(Nothing, Token, MySettings.AbortOnLimit.Value) With {
-                    .TempPostsList = _TempPostsList,
                     .AutoClear = True,
                     .AutoReset = True,
                     .CommandPermanent = $"chcp {BatchExecutor.UnicodeEncoding}",
@@ -758,12 +886,16 @@ Namespace API.Twitter
                         outList.Add(dir)
                         tgdl.ChangeDirectory(dir)
                         command = $"""{Settings.GalleryDLFile}"" --verbose --no-download --no-skip --config ""{conf}"" --write-pages "
-                        command &= GdlGetIdFilterString()
+                        If multiMode Then
+                            command &= "{0}"
+                        Else
+                            command &= GdlGetIdFilterString()
+                        End If
                         Select Case i
-                            Case 0 : command &= $"{urlPrePattern}{NameTrue}/media" : process = dm.Contains(DownloadModels.Media) Or IsCommunity
-                            Case 1 : command &= $"{urlPrePattern}{NameTrue}" : process = dm.Contains(DownloadModels.Profile)
-                            Case 2 : command &= $"-o search-endpoint=graphql https://x.com/search?q=from:{NameTrue}+include:nativeretweets" : process = dm.Contains(DownloadModels.Search) And Not IsCommunity
-                            Case 3 : command &= $"{urlPrePattern}{NameTrue}/likes" : process = dm.Contains(DownloadModels.Likes)
+                            Case 0 : command &= $"{urlPrePattern}{NameTrue}/media" : currentModel = DownloadModels.Media : process = dm.Contains(currentModel) Or IsCommunity
+                            Case 1 : command &= $"{urlPrePattern}{NameTrue}" : currentModel = DownloadModels.Profile : process = dm.Contains(currentModel)
+                            Case 2 : command &= $"-o search-endpoint=graphql https://x.com/search?q=from:{NameTrue}+include:nativeretweets" : currentModel = DownloadModels.Search : process = dm.Contains(currentModel) And Not IsCommunity
+                            Case 3 : command &= $"{urlPrePattern}{NameTrue}/likes" : currentModel = DownloadModels.Likes : process = dm.Contains(currentModel)
                             Case Else : process = False
                         End Select
                         '#If DEBUG Then
@@ -771,6 +903,16 @@ Namespace API.Twitter
                         '#End If
                         ThrowAny(Token)
                         If process Then
+                            If multiMode Then
+                                If PostsKV.Count = 0 Then
+                                    tgdl.TempPostsList = New List(Of String)
+                                Else
+                                    tgdl.TempPostsList = (From p As PKV In PostsKV Where p.Section = currentModel Select p.ID).ListIfNothing
+                                End If
+                                command = String.Format(command, GdlGetIdFilterString(tgdl.TempPostsList))
+                            Else
+                                tgdl.TempPostsList = _TempPostsList
+                            End If
                             tgdl.Execute(command)
                             If tgdl.LimitReached Then
                                 If CBool(MySettings.DownloadAlreadyParsed.Value) And
@@ -796,8 +938,9 @@ Namespace API.Twitter
                 Return Nothing
             End Try
         End Function
-        Private Function GdlGetIdFilterString() As String
-            Return If(_TempPostsList.Count > 0, $"--filter ""int(tweet_id) > {_TempPostsList.Last} or abort()"" ", String.Empty)
+        Private Function GdlGetIdFilterString(Optional ByVal TL As List(Of String) = Nothing) As String
+            If TL.ListExists Then TL.Sort()
+            With If(TL, _TempPostsList) : Return If(.Count > 0, $"--filter ""int(tweet_id) > { .Last} or abort()"" ", String.Empty) : End With
         End Function
         Private Function GdlCreateConf(ByVal Path As SFile) As SFile
             Try
@@ -822,7 +965,7 @@ Namespace API.Twitter
             Dim cache As CacheKeeper = Nothing
             Try
                 If ContentMissingExists Or (_ReparseLikes And LikesPosts.Count > 0) Then
-                    Dim m As UserMedia
+                    Dim m As UserMedia, mTmp As UserMedia
                     Dim PostDate$
                     Dim nodes As List(Of String()) = GetContainerSubnodes()
                     Dim node$()
@@ -842,7 +985,11 @@ Namespace API.Twitter
                             m = If(_ReparseLikes, Nothing, _ContentList(i))
                             If Not m.Post.ID.IsEmptyString Or (IsSingleObjectDownload And Not m.URL_BASE.IsEmptyString) Or _ReparseLikes Then
                                 ThrowAny(Token)
-                                If IsSingleObjectDownload Then
+                                If m.Type = UTypes.m3u8 Then
+                                    _TempMediaList.Add(m)
+                                    rList.ListAddValue(i, LNC)
+                                    Continue For
+                                ElseIf IsSingleObjectDownload Then
                                     URL = m.URL_BASE
                                 ElseIf _ReparseLikes Then
                                     URL = LikesPosts(i)
@@ -859,6 +1006,13 @@ Namespace API.Twitter
                                             If Not j Is Nothing Then
                                                 With j.ItemF({"data", 0, "instructions", 0, "entries"})
                                                     If .ListExists Then
+                                                        If IsSingleObjectDownload Or DownloadBroadcasts Then
+                                                            mTmp = ExtractBroadcast(.Self, m.Post.ID, String.Empty, nodes)
+                                                            If Not mTmp.URL.IsEmptyString Then
+                                                                _TempMediaList.ListAddValue(mTmp, LNC)
+                                                                rList.ListAddValue(i, LNC)
+                                                            End If
+                                                        End If
                                                         For Each n In .Self
                                                             For Each node In nodes
                                                                 With n(node)
@@ -896,7 +1050,9 @@ Namespace API.Twitter
 #End Region
 #Region "DownloadSingleObject"
         Protected Overrides Sub DownloadSingleObject_GetPosts(ByVal Data As IYouTubeMediaContainer, ByVal Token As CancellationToken)
-            _ContentList.Add(New UserMedia(Data.URL) With {.State = UStates.Missing})
+            Dim um As New UserMedia(Data.URL) With {.State = UStates.Missing}
+            If Not Data.URL.IsEmptyString AndAlso Data.URL.Contains(BroadCastPartUrl) Then um.Type = UTypes.m3u8
+            _ContentList.Add(um)
             ReparseMissing(Token)
         End Sub
 #End Region
@@ -953,6 +1109,13 @@ Namespace API.Twitter
             End Try
         End Function
 #End Region
+#Region "Clear"
+        Protected Overrides Sub EraseData_AdditionalDataFiles()
+            MyFilePostsKV.Delete(SFO.File, SFODelete.DeleteToRecycleBin, EDP.SendToLog + EDP.ReturnValue)
+            _DataNames.Clear()
+            MyBase.EraseData_AdditionalDataFiles()
+        End Sub
+#End Region
 #Region "Create media"
         Private Function MediaFromData(ByVal _URL As String, ByVal PostID As String, ByVal PostDate As String,
                                        Optional ByVal _PictureOption As String = Nothing,
@@ -975,6 +1138,31 @@ Namespace API.Twitter
         Protected Overrides Sub DownloadContent(ByVal Token As CancellationToken)
             DownloadContentDefault(Token)
         End Sub
+        Protected Overrides Function DownloadM3U8(ByVal URL As String, ByVal Media As UserMedia, ByVal DestinationFile As SFile, ByVal Token As CancellationToken) As SFile
+            Const ytDest$ = "[download] destination"
+            Dim f As SFile = Nothing
+            If MySettings.CookiesNetscapeFile.Exists And Settings.YtdlpFile.Exists And (Not URL.IsEmptyString AndAlso URL.Contains(BroadCastPartUrl)) Then
+                Dim destPath$ = DestinationFile.PathWithSeparator.Replace("\", "\\")
+                Dim rr As RParams = RParams.DM($"{destPath}.+mp4", 0, RegexOptions.IgnoreCase, EDP.ReturnValue)
+                Dim cmd$ = $"""{Settings.YtdlpFile.File}"" --no-cookies-from-browser --cookies ""{MySettings.CookiesNetscapeFile}"" "
+                cmd &= $"{URL} -P ""{destPath}"" --no-mtime"
+                Using ytdlp As New YTDLP.YTDLPBatch(Token)
+                    With ytdlp
+                        .Execute(cmd)
+                        If .OutputData.Count > 0 Then
+                            For Each outStr$ In .OutputData
+                                If Not outStr.IsEmptyString AndAlso outStr.ToLower.Trim.StartsWith(ytDest) Then
+                                    f = CStr(RegexReplace(outStr, rr))
+                                    If Not f.Exists Then f = Nothing
+                                    Exit For
+                                End If
+                            Next
+                        End If
+                    End With
+                End Using
+            End If
+            Return f
+        End Function
 #End Region
 #Region "Exception"
         Protected Overrides Function DownloadingException(ByVal ex As Exception, ByVal Message As String, Optional ByVal FromPE As Boolean = False,
@@ -984,7 +1172,7 @@ Namespace API.Twitter
 #End Region
 #Region "IDisposable support"
         Protected Overrides Sub Dispose(ByVal disposing As Boolean)
-            If Not disposedValue And disposing Then _DataNames.Clear() : LikesPosts.Clear()
+            If Not disposedValue And disposing Then _DataNames.Clear() : LikesPosts.Clear() : PostsKV.Clear()
             MyBase.Dispose(disposing)
         End Sub
 #End Region

SCrawler/API/UserDataBind.vb

@@ -299,6 +299,24 @@ Namespace API
                 End If
             End Get
         End Property
+        Friend ReadOnly Property ContextDownLimit As ToolStripMenuItem()
+            Get
+                If Count > 0 Then
+                    Return Collections.Select(Function(c) DirectCast(c, UserDataBase).BTT_CONTEXT_DOWN_LIMIT).ToArray
+                Else
+                    Return New ToolStripMenuItem() {}
+                End If
+            End Get
+        End Property
+        Friend ReadOnly Property ContextDownDate As ToolStripMenuItem()
+            Get
+                If Count > 0 Then
+                    Return Collections.Select(Function(c) DirectCast(c, UserDataBase).BTT_CONTEXT_DOWN_DATE).ToArray
+                Else
+                    Return New ToolStripMenuItem() {}
+                End If
+            End Get
+        End Property
         Friend ReadOnly Property ContextEdit As ToolStripMenuItem()
             Get
                 If Count > 0 Then

SCrawler/API/Xhamster/M3U8.vb

@@ -93,7 +93,11 @@ Namespace API.Xhamster
                         Dim position% = InStr(URL, sk)
                         If position > 0 Then appender = URL.Remove(position - 1)
                     End If
-                    URL = M3U8Base.CreateUrl(appender, file)
+                    If file.StartsWith("//") Then
+                        URL = LinkFormatterSecure(file.TrimStart("/"))
+                    Else
+                        URL = M3U8Base.CreateUrl(appender, file)
+                    End If
                     Dim l As List(Of M3U8URL) = ParseSecondM3U8(URL, Responser, appender)
                     If l.ListExists Then Return l
                 End If

SCrawler/API/YouTube/SiteSettings.vb

@@ -10,36 +10,52 @@ Imports SCrawler.Plugin
 Imports SCrawler.Plugin.Attributes
 Imports SCrawler.API.Base
 Imports SCrawler.API.YouTube.Base
+Imports DN = SCrawler.API.Base.DeclaredNames
 Namespace API.YouTube
     <Manifest(YouTubeSiteKey), SpecialForm(True), SpecialForm(False), SeparatedTasks(1)>
     Friend Class SiteSettings : Inherits SiteSettingsBase
+#Region "Categories"
+        Private Const CAT_COMMUNITY As String = "Communities"
+#End Region
 #Region "Declarations"
-        <PXML, PropertyOption(ControlText:="Download user videos"), PClonable>
-        Friend ReadOnly Property DownloadVideos As PropertyValue
-        <PXML, PropertyOption(ControlText:="Download user shorts"), PClonable>
-        Friend ReadOnly Property DownloadShorts As PropertyValue
-        <PXML, PropertyOption(ControlText:="Download user playlists"), PClonable>
-        Friend ReadOnly Property DownloadPlaylists As PropertyValue
-        <PXML, PropertyOption(ControlText:="Download user community: images"), PClonable>
-        Friend ReadOnly Property DownloadCommunityImages As PropertyValue
-        <PXML, PropertyOption(ControlText:="Download user community: videos"), PClonable>
-        Friend ReadOnly Property DownloadCommunityVideos As PropertyValue
-        <PXML, PropertyOption(ControlText:="Ignore community errors", ControlToolTip:="If true, community errors will not be added to the log."), PClonable>
-        Friend ReadOnly Property IgnoreCommunityErrors As PropertyValue
-        <PXML, PropertyOption(ControlText:="Use cookies", ControlToolTip:="Default value for new users." & vbCr & "Use cookies when downloading data."), PClonable>
+        <PXML, PropertyOption(ControlText:="Use cookies", ControlToolTip:="Default value for new users." & vbCr & "Use cookies when downloading data.", IsAuth:=True), PClonable>
         Friend ReadOnly Property UseCookies As PropertyValue
+#Region "New user defaults"
+        <PXML, PropertyOption(ControlText:="Download user videos", Category:=DN.CAT_UserDefs), PClonable>
+        Friend ReadOnly Property DownloadVideos As PropertyValue
+        <PXML, PropertyOption(ControlText:="Download user shorts", Category:=DN.CAT_UserDefs), PClonable>
+        Friend ReadOnly Property DownloadShorts As PropertyValue
+        <PXML, PropertyOption(ControlText:="Download user playlists", Category:=DN.CAT_UserDefs), PClonable>
+        Friend ReadOnly Property DownloadPlaylists As PropertyValue
+        <PXML, PropertyOption(ControlText:="Download user community: images", Category:=DN.CAT_UserDefs), PClonable>
+        Friend ReadOnly Property DownloadCommunityImages As PropertyValue
+        <PXML, PropertyOption(ControlText:="Download user community: videos", Category:=DN.CAT_UserDefs), PClonable>
+        Friend ReadOnly Property DownloadCommunityVideos As PropertyValue
+#End Region
+#Region "Communities"
+        <PXML, PropertyOption(ControlText:="YouTube API host",
+                              ControlToolTip:="YouTube API instance host (YouTube-operational-API). Example: 'localhost/YouTube-operational-API', 'http://localhost/YouTube-operational-API'.",
+                              Category:=CAT_COMMUNITY), PClonable>
+        Friend ReadOnly Property CommunityHost As PropertyValue
+        <PXML, PropertyOption(ControlText:="YouTube API key", ControlToolTip:="YouTube Data API v3 developer key", Category:=CAT_COMMUNITY), PClonable>
+        Friend ReadOnly Property YouTubeAPIKey As PropertyValue
+        <PXML, PropertyOption(ControlText:="Ignore community errors", ControlToolTip:="If true, community errors will not be added to the log.", Category:=CAT_COMMUNITY), PClonable>
+        Friend ReadOnly Property IgnoreCommunityErrors As PropertyValue
+#End Region
 #End Region
 #Region "Initializer"
         Friend Sub New(ByVal AccName As String, ByVal Temp As Boolean)
             MyBase.New(YouTubeSite, "youtube.com", AccName, Temp, My.Resources.SiteYouTube.YouTubeIcon_32, My.Resources.SiteYouTube.YouTubePic_96)
             Responser.Cookies.ChangedAllowInternalDrop = False
+            UseCookies = New PropertyValue(False)
             DownloadVideos = New PropertyValue(True)
             DownloadShorts = New PropertyValue(False)
             DownloadPlaylists = New PropertyValue(False)
             DownloadCommunityImages = New PropertyValue(False)
             DownloadCommunityVideos = New PropertyValue(False)
+            CommunityHost = New PropertyValue(String.Empty, GetType(String))
+            YouTubeAPIKey = New PropertyValue(String.Empty, GetType(String))
             IgnoreCommunityErrors = New PropertyValue(False)
-            UseCookies = New PropertyValue(False)
             _SubscriptionsAllowed = True
             UseNetscapeCookies = True
         End Sub

SCrawler/API/YouTube/UserData.vb

@@ -33,6 +33,11 @@ Namespace API.YouTube
         Private Const Name_LastDownloadDatePlaylist As String = "YTLastDownloadDatePlaylist"
 #End Region
 #Region "Declarations"
+        Private ReadOnly Property MySettings As SiteSettings
+            Get
+                Return HOST.Source
+            End Get
+        End Property
         Friend Property DownloadYTVideos As Boolean = True
         Friend Property DownloadYTShorts As Boolean = False
         Friend Property DownloadYTPlaylists As Boolean = False
@@ -203,7 +208,7 @@ Namespace API.YouTube
                     If IsMusic Or DownloadYTVideos Then
                         maxDate = Nothing
                         LastDownloadDateVideos = nDate(LastDownloadDateVideos)
-                        url = $"https://{IIf(IsMusic, "music", "www")}.youtube.com/{IIf(IsMusic Or IsChannelUser, $"{YouTubeFunctions.UserChannelOption}/", "@")}{ID}"
+                        url = $"https://{IIf(IsMusic, "music", "www")}.youtube.com/{IIf(IsMusic Or IsChannelUser, $"{YouTubeFunctions.UserChannelOption}/", "@")}{ID}/videos"
                         container = YouTubeFunctions.Parse(url, YTUseCookies, Token, pr, __getMinDate(LastDownloadDateVideos), __maxDate,, True)
                         applySpecFolder.Invoke(IIf(IsMusic, String.Empty, "Videos"), False)
                         If fillList.Invoke(LastDownloadDateVideos, False) Then LastDownloadDateVideos = If(maxDate, Now)
@@ -263,7 +268,17 @@ Namespace API.YouTube
                 If ChannelID.IsEmptyString Then GetChannelID()
                 If ChannelID.IsEmptyString Then Throw New ArgumentNullException("ChannelID", "Channel ID cannot be null")
 
-                URL = $"https://yt.lemnoslife.com/channels?part=community&id={ChannelID}"
+                URL = MySettings.CommunityHost.Value
+                If URL.IsEmptyString Then
+                    If Not CBool(MySettings.IgnoreCommunityErrors.Value) Then _
+                       MyMainLOG = $"{ToStringForLog()}: YouTube API instance host is not specified for downloading communities"
+                    Exit Sub
+                Else
+                    URL = LinkFormatterSecure(URL.Trim, "http").TrimEnd("/")
+                End If
+
+                URL = $"{URL}/channels?part=community&id={ChannelID}"
+                If Not CStr(MySettings.YouTubeAPIKey.Value).IsEmptyString Then URL &= $"&key={CStr(MySettings.YouTubeAPIKey.Value).Trim}"
                 If Not Cursor.IsEmptyString Then URL &= $"&pageToken={Cursor}"
 
                 ProgressPre.ChangeMax(1)
@@ -345,6 +360,8 @@ Namespace API.YouTube
                         If resp.Status = Net.WebExceptionStatus.ConnectFailure And Round < 2 Then
                             Thread.Sleep(1000)
                             DownloadCommunity(Cursor, Token, Round + 1)
+                        ElseIf resp.StatusCode = Net.HttpStatusCode.NotFound Then
+                            MyMainLOG = $"{ToStringForLog()} {errMsg} (not found)"
                         Else
                             Throw resp.ErrorException
                         End If

SCrawler/Download/Feed/DownloadFeedForm.vb

@@ -542,6 +542,7 @@ Namespace DownloadObjects
             End Try
         End Sub
 #End Region
+#Region "Move/Copy"
         Private Sub BTT_COPY_MOVE_TO_Click(sender As Object, e As EventArgs) Handles BTT_COPY_TO.Click, BTT_MOVE_TO.Click
             MoveCopyFiles(True, sender, Nothing, Nothing)
         End Sub
@@ -550,7 +551,7 @@ Namespace DownloadObjects
         End Sub
         Private Function MoveCopyFiles(ByVal IsInternal As Boolean, ByVal Sender As Object, ByVal MCTOptions As FeedMoveCopyTo,
                                        ByVal FeedMediaData As FeedMedia, Optional ByVal GetChecked As Boolean = True) As Boolean
-            Const MsgTitle$ = "Copy/Move checked files"
+            Dim MsgTitle$ = "Copy/Move checked files"
             Try
                 Dim isCopy As Boolean = Not Sender Is Nothing AndAlso (Sender Is BTT_COPY_TO OrElse Sender Is BTT_COPY_SPEC_TO)
                 Dim moveOptions As FeedMoveCopyTo = Nothing
@@ -574,6 +575,7 @@ Namespace DownloadObjects
                 Dim sesFilesReplaced As Boolean = False
                 Dim filesReplace As New List(Of KeyValuePair(Of SFile, SFile))
                 Dim updateFileLocations As Boolean = Settings.FeedMoveCopyUpdateFileLocationOnMove
+                Dim postUrl$
                 Dim result As Boolean = False
 
                 If FeedMediaData Is Nothing Then
@@ -590,7 +592,18 @@ Namespace DownloadObjects
                     data = {FeedMediaData.Media}
                     data_files = {FeedMediaData.File}
                 End If
+
+                MsgTitle = $"{IIf(isCopy, "Copy", "Move")} {IIf(Not FeedMediaData Is Nothing Or GetChecked, "checked", "ALL")} files"
+
                 If data.ListExists Then
+
+                    If (FeedMediaData Is Nothing And Not GetChecked And Not isCopy) AndAlso
+                       MsgBoxE({$"YOU ARE TRYING TO MOVE ALL FEED/SESSION DATA.{vbCr}EVERY FILE WILL BE MOVED, NOT JUST THE SELECTED ONES.", MsgTitle},
+                               vbExclamation,,, {"Process", "Cancel"}) = 1 Then
+                        ShowOperationCanceledMsg(MsgTitle)
+                        Return False
+                    End If
+
                     If MCTOptions.Destination.IsEmptyString Then
                         Using f As New FeedCopyToForm(data_files, isCopy)
                             f.ShowDialog()
@@ -678,7 +691,11 @@ Namespace DownloadObjects
                                                 mm_data = mm.Data
                                                 mm_data.File = df
                                                 __isSavedPosts = mm.IsSavedPosts And moveOptions.ReplaceUserProfile_Profile Is Nothing
-                                                mm = New UserMediaD(mm_data, If(moveOptions.ReplaceUserProfile_Profile, mm.User), mm.Session, mm.Date) With {.IsSavedPosts = __isSavedPosts}
+                                                postUrl = mm.PostUrl(True)
+                                                mm = New UserMediaD(mm_data, If(moveOptions.ReplaceUserProfile_Profile, mm.User), mm.Session, mm.Date) With {
+                                                    .IsSavedPosts = __isSavedPosts,
+                                                    .PostUrl = postUrl
+                                                }
                                                 If __isSavedPosts Then mm.UserInfo = __user
                                                 Downloader.Files(indx) = mm
                                                 downloaderFilesUpdated = True
@@ -709,7 +726,11 @@ Namespace DownloadObjects
                                                 mm_data = mm.Data
                                                 mm_data.File = df
                                                 __isSavedPosts = mm.IsSavedPosts And moveOptions.ReplaceUserProfile_Profile Is Nothing
-                                                mm = New UserMediaD(mm_data, If(moveOptions.ReplaceUserProfile_Profile, mm.User), mm.Session, mm.Date) With {.IsSavedPosts = __isSavedPosts}
+                                                postUrl = mm.PostUrl(True)
+                                                mm = New UserMediaD(mm_data, If(moveOptions.ReplaceUserProfile_Profile, mm.User), mm.Session, mm.Date) With {
+                                                    .IsSavedPosts = __isSavedPosts,
+                                                    .PostUrl = postUrl
+                                                }
                                                 If __isSavedPosts Then mm.UserInfo = __user
                                                 sessionData(indx) = mm
                                                 sesFilesReplaced = True
@@ -749,6 +770,7 @@ Namespace DownloadObjects
                 Settings.Feeds.UpdateWhereDataReplaced()
             End Try
         End Function
+#End Region
 #Region "Load fav, spec"
         Private Sub BTT_LOAD_FAV_Click(sender As Object, e As EventArgs) Handles BTT_LOAD_FAV.Click
             FeedChangeMode(FeedModes.Special, {FeedSpecial.FavoriteName})
@@ -1292,32 +1314,36 @@ Namespace DownloadObjects
             End Try
         End Sub
         Private Sub RefillAfterDelete()
-            With MyRange
-                Dim indx% = .CurrentIndex
-                Dim indxChanged As Boolean = False
-                .HandlersSuspended = True
-                .Update()
-                If .Count > 0 Then
-                    If indx.ValueBetween(0, .Count - 1) Then
-                        .CurrentIndex = indx
-                    ElseIf (indx - 1).ValueBetween(0, .Count - 1) Then
-                        .CurrentIndex = indx - 1
-                        indxChanged = True
-                    Else
-                        .CurrentIndex = .Count - 1
-                        indxChanged = Not indx = .CurrentIndex
+            Try
+                With MyRange
+                    Dim indx% = .CurrentIndex
+                    Dim indxChanged As Boolean = False
+                    .HandlersSuspended = True
+                    .Update()
+                    If .Count > 0 Then
+                        If indx.ValueBetween(0, .Count - 1) Then
+                            .CurrentIndex = indx
+                        ElseIf (indx - 1).ValueBetween(0, .Count - 1) Then
+                            .CurrentIndex = indx - 1
+                            indxChanged = True
+                        Else
+                            .CurrentIndex = .Count - 1
+                            indxChanged = Not indx = .CurrentIndex
+                        End If
+                        .UpdateControls()
+                        .HandlersSuspended = False
+                        If Not indxChanged Then LatestScrollValueDisabled = True
+                        DirectCast(MyRange.Switcher, RangeSwitcher(Of UserMediaD)).PerformIndexChanged()
+                        If Not indxChanged Then
+                            LatestScrollValueDisabled = False
+                            SetScrollValue(True)
+                        End If
                     End If
-                    .UpdateControls()
                     .HandlersSuspended = False
-                    If Not indxChanged Then LatestScrollValueDisabled = True
-                    DirectCast(MyRange.Switcher, RangeSwitcher(Of UserMediaD)).PerformIndexChanged()
-                    If Not indxChanged Then
-                        LatestScrollValueDisabled = False
-                        SetScrollValue(True)
-                    End If
-                End If
-                .HandlersSuspended = False
-            End With
+                End With
+            Catch ex As Exception
+                ErrorsDescriber.Execute(EDP.SendToLog, ex, "[DownloadFeedForm.RefillAfterDelete]")
+            End Try
         End Sub
 #End Region
 #Region "Range"

SCrawler/Download/Feed/FeedMedia.Designer.vb

@@ -27,7 +27,6 @@ Namespace DownloadObjects
             Dim TP_LBL As System.Windows.Forms.TableLayoutPanel
             Dim CONTEXT_SEP_3 As System.Windows.Forms.ToolStripSeparator
             Dim CONTEXT_SEP_4 As System.Windows.Forms.ToolStripSeparator
-            Me.CONTEXT_SEP_2 = New System.Windows.Forms.ToolStripSeparator()
             Me.CH_CHECKED = New System.Windows.Forms.CheckBox()
             Me.LBL_INFO = New System.Windows.Forms.Label()
             Me.CONTEXT_DATA = New System.Windows.Forms.ContextMenuStrip(Me.components)
@@ -37,6 +36,7 @@ Namespace DownloadObjects
             Me.BTT_CONTEXT_OPEN_USER = New System.Windows.Forms.ToolStripMenuItem()
             Me.BTT_CONTEXT_OPEN_USER_URL = New System.Windows.Forms.ToolStripMenuItem()
             Me.BTT_CONTEXT_OPEN_USER_POST = New System.Windows.Forms.ToolStripMenuItem()
+            Me.CONTEXT_SEP_2 = New System.Windows.Forms.ToolStripSeparator()
             Me.BTT_COPY_TO = New System.Windows.Forms.ToolStripMenuItem()
             Me.BTT_MOVE_TO = New System.Windows.Forms.ToolStripMenuItem()
             Me.BTT_FEED_ADD_FAV = New System.Windows.Forms.ToolStripMenuItem()
@@ -52,6 +52,7 @@ Namespace DownloadObjects
             Me.ICON_SITE = New System.Windows.Forms.PictureBox()
             Me.TP_MAIN = New System.Windows.Forms.TableLayoutPanel()
             Me.LBL_TITLE = New System.Windows.Forms.Label()
+            Me.BTT_CONTEXT_OPEN_FILE_FOLDER = New System.Windows.Forms.ToolStripMenuItem()
             CONTEXT_SEP_1 = New System.Windows.Forms.ToolStripSeparator()
             TP_LBL = New System.Windows.Forms.TableLayoutPanel()
             CONTEXT_SEP_3 = New System.Windows.Forms.ToolStripSeparator()
@@ -67,11 +68,6 @@ Namespace DownloadObjects
             CONTEXT_SEP_1.Name = "CONTEXT_SEP_1"
             CONTEXT_SEP_1.Size = New System.Drawing.Size(302, 6)
             '
-            'CONTEXT_SEP_2
-            '
-            Me.CONTEXT_SEP_2.Name = "CONTEXT_SEP_2"
-            Me.CONTEXT_SEP_2.Size = New System.Drawing.Size(302, 6)
-            '
             'TP_LBL
             '
             TP_LBL.ColumnCount = 3
@@ -114,9 +110,9 @@ Namespace DownloadObjects
             '
             'CONTEXT_DATA
             '
-            Me.CONTEXT_DATA.Items.AddRange(New System.Windows.Forms.ToolStripItem() {Me.BTT_CONTEXT_DOWN, Me.CONTEXT_SEP_0, Me.BTT_CONTEXT_OPEN_MEDIA, Me.BTT_CONTEXT_OPEN_USER, CONTEXT_SEP_1, Me.BTT_CONTEXT_OPEN_USER_URL, Me.BTT_CONTEXT_OPEN_USER_POST, Me.CONTEXT_SEP_2, Me.BTT_COPY_TO, Me.BTT_MOVE_TO, CONTEXT_SEP_3, Me.BTT_FEED_ADD_FAV, Me.BTT_FEED_ADD_FAV_REMOVE, Me.BTT_FEED_ADD_SPEC, Me.BTT_FEED_ADD_SPEC_REMOVE, Me.BTT_FEED_REMOVE_FAV, Me.BTT_FEED_REMOVE_SPEC, CONTEXT_SEP_4, Me.BTT_CONTEXT_FIND_USER, Me.BTT_CONTEXT_INFO, Me.CONTEXT_SEP_5, Me.BTT_CONTEXT_DELETE})
+            Me.CONTEXT_DATA.Items.AddRange(New System.Windows.Forms.ToolStripItem() {Me.BTT_CONTEXT_DOWN, Me.CONTEXT_SEP_0, Me.BTT_CONTEXT_OPEN_MEDIA, Me.BTT_CONTEXT_OPEN_USER, Me.BTT_CONTEXT_OPEN_FILE_FOLDER, CONTEXT_SEP_1, Me.BTT_CONTEXT_OPEN_USER_URL, Me.BTT_CONTEXT_OPEN_USER_POST, Me.CONTEXT_SEP_2, Me.BTT_COPY_TO, Me.BTT_MOVE_TO, CONTEXT_SEP_3, Me.BTT_FEED_ADD_FAV, Me.BTT_FEED_ADD_FAV_REMOVE, Me.BTT_FEED_ADD_SPEC, Me.BTT_FEED_ADD_SPEC_REMOVE, Me.BTT_FEED_REMOVE_FAV, Me.BTT_FEED_REMOVE_SPEC, CONTEXT_SEP_4, Me.BTT_CONTEXT_FIND_USER, Me.BTT_CONTEXT_INFO, Me.CONTEXT_SEP_5, Me.BTT_CONTEXT_DELETE})
             Me.CONTEXT_DATA.Name = "CONTEXT_PIC"
-            Me.CONTEXT_DATA.Size = New System.Drawing.Size(306, 414)
+            Me.CONTEXT_DATA.Size = New System.Drawing.Size(306, 436)
             '
             'BTT_CONTEXT_DOWN
             '
@@ -160,6 +156,11 @@ Namespace DownloadObjects
             Me.BTT_CONTEXT_OPEN_USER_POST.Size = New System.Drawing.Size(305, 22)
             Me.BTT_CONTEXT_OPEN_USER_POST.Text = "Open post"
             '
+            'CONTEXT_SEP_2
+            '
+            Me.CONTEXT_SEP_2.Name = "CONTEXT_SEP_2"
+            Me.CONTEXT_SEP_2.Size = New System.Drawing.Size(302, 6)
+            '
             'BTT_COPY_TO
             '
             Me.BTT_COPY_TO.Image = Global.SCrawler.My.Resources.Resources.PastePic_32
@@ -289,6 +290,13 @@ Namespace DownloadObjects
             Me.LBL_TITLE.Size = New System.Drawing.Size(140, 25)
             Me.LBL_TITLE.TabIndex = 1
             '
+            'BTT_CONTEXT_OPEN_FILE_FOLDER
+            '
+            Me.BTT_CONTEXT_OPEN_FILE_FOLDER.Image = Global.SCrawler.My.Resources.Resources.FolderPic_32
+            Me.BTT_CONTEXT_OPEN_FILE_FOLDER.Name = "BTT_CONTEXT_OPEN_FILE_FOLDER"
+            Me.BTT_CONTEXT_OPEN_FILE_FOLDER.Size = New System.Drawing.Size(305, 22)
+            Me.BTT_CONTEXT_OPEN_FILE_FOLDER.Text = "Open file folder"
+            '
             'FeedMedia
             '
             Me.AutoScaleDimensions = New System.Drawing.SizeF(6.0!, 13.0!)
@@ -335,5 +343,6 @@ Namespace DownloadObjects
         Private WithEvents BTT_MOVE_TO As ToolStripMenuItem
         Private WithEvents CONTEXT_SEP_5 As ToolStripSeparator
         Private WithEvents CONTEXT_SEP_2 As ToolStripSeparator
+        Private WithEvents BTT_CONTEXT_OPEN_FILE_FOLDER As ToolStripMenuItem
     End Class
 End Namespace

SCrawler/Download/Feed/FeedMedia.vb

@@ -178,6 +178,7 @@ Namespace DownloadObjects
                     BTT_CONTEXT_DOWN.Visible = True
                     CONTEXT_SEP_0.Visible = True
                     BTT_CONTEXT_OPEN_USER.Visible = False
+                    BTT_CONTEXT_OPEN_FILE_FOLDER.Visible = False
                     CONTEXT_SEP_5.Visible = False
                     BTT_CONTEXT_DELETE.Visible = False
 
@@ -416,8 +417,12 @@ Namespace DownloadObjects
         End Sub
 #End Region
 #Region "Open media, folder"
-        Private Sub BTT_CONTEXT_OPEN_MEDIA_Click(sender As Object, e As EventArgs) Handles BTT_CONTEXT_OPEN_MEDIA.Click
-            File.Open()
+        Private Sub BTT_CONTEXT_OPEN_MEDIA_Click(sender As Object, e As EventArgs) Handles BTT_CONTEXT_OPEN_MEDIA.Click, BTT_CONTEXT_OPEN_FILE_FOLDER.Click
+            If Not sender Is Nothing AndAlso sender Is BTT_CONTEXT_OPEN_FILE_FOLDER Then
+                GlobalOpenPath(File)
+            Else
+                File.Open()
+            End If
         End Sub
         Private Sub BTT_CONTEXT_OPEN_USER_Click(sender As Object, e As EventArgs) Handles BTT_CONTEXT_OPEN_USER.Click
             If Not UserKey.IsEmptyString Then
@@ -455,6 +460,8 @@ Namespace DownloadObjects
                 Dim url$ = String.Empty
                 If IsSubscription Then
                     url = Post.URL_BASE
+                ElseIf Not Media.PostUrl.IsEmptyString Then
+                    url = Media.PostUrl
                 Else
                     If Not UserKey.IsEmptyString And Not Post.Post.ID.IsEmptyString Then
                         Dim u As IUserData

SCrawler/Download/Feed/FeedSpecial.vb

@@ -195,6 +195,7 @@ Namespace DownloadObjects
 #Region "Add"
         Friend Overloads Function Add(ByVal Item As UserMediaD, Optional ByVal AutoSave As Boolean = True) As Boolean
             If Not Items.Contains(Item) Then
+                Item.PostUrl = Item.PostUrl(True)
                 Items.Add(Item)
                 If AutoSave Then Save()
                 Return True
@@ -242,6 +243,7 @@ Namespace DownloadObjects
                     Dim m As UserMedia
                     Dim f As SFile = Nothing
                     Dim ff As SFile
+                    Dim postUrl$ = String.Empty
                     Dim user As IUserData
                     Dim processRemove As Boolean
                     Dim userArr As New List(Of IUserData)
@@ -254,7 +256,8 @@ Namespace DownloadObjects
                                     m = d.Data
                                     m.File = ff
                                     d = New UserMediaD(m, If(replaceUser, d.User), d.Session, d.Date) With {
-                                        .IsSavedPosts = If(replaceUser Is Nothing, d.IsSavedPosts, DirectCast(replaceUser, UserDataBase).IsSavedPosts)
+                                        .IsSavedPosts = If(replaceUser Is Nothing, d.IsSavedPosts, DirectCast(replaceUser, UserDataBase).IsSavedPosts),
+                                        .PostUrl = postUrl
                                     }
                                     Items(i) = d
                                     ri += 1
@@ -268,6 +271,7 @@ Namespace DownloadObjects
                     For i = Count - 1 To 0 Step -1
                         If p.Invoke(Items(i)) Then
                             d = Items(i)
+                            postUrl = d.PostUrl(True)
                             f = Nothing
                             ff = Nothing
                             processRemove = True

SCrawler/Download/TDownloader.vb

@@ -36,6 +36,7 @@ Namespace DownloadObjects
             Private Const Name_Session As String = "Session"
             Private Const Name_File As String = "File"
             Private Const Name_IsSavedPosts As String = "IsSavedPosts"
+            Private Const Name_PostUrl As String = "PostUrl"
 #End Region
             Friend ReadOnly User As IUserData
             Friend ReadOnly Data As UserMedia
@@ -43,6 +44,48 @@ Namespace DownloadObjects
             Friend ReadOnly [Date] As Date
             Friend Session As Integer
             Friend IsSavedPosts As Boolean
+            Private _PostUrl As String
+            Friend Property PostUrl(Optional ByVal Generate As Boolean = False) As String
+                Get
+                    Try
+                        If Not _PostUrl.IsEmptyString Then
+                            Return _PostUrl
+                        ElseIf Generate Then
+                            Dim url$ = String.Empty
+                            With UserInfo
+                                If Not .Plugin.IfNullOrEmpty(.Site).IsEmptyString And Not .Name.IsEmptyString And Not Data.Post.ID.IsEmptyString Then
+                                    Dim u As IUserData
+                                    If IsSavedPosts Then
+                                        If Not .Plugin.IsEmptyString Then
+                                            Dim host As SettingsHostCollection = Settings(.Plugin)
+                                            If Not host Is Nothing Then
+                                                u = host.Default.GetInstance(Download.SavedPosts, UserInfo, False, False)
+                                                If Not u Is Nothing AndAlso Not u.HOST Is Nothing Then
+                                                    With DirectCast(u, UserDataBase)
+                                                        .IsSavedPosts = True
+                                                        .HostStatic = True
+                                                    End With
+                                                    Try : url = u.HOST.Source.GetUserPostUrl(u, Data) : Catch : End Try
+                                                    u.Dispose()
+                                                End If
+                                            End If
+                                        End If
+                                    Else
+                                        u = Settings.GetUser(UserInfo)
+                                        If Not u Is Nothing Then url = UserDataBase.GetPostUrl(u, Data)
+                                    End If
+                                End If
+                            End With
+                            Return url
+                        End If
+                    Catch
+                    End Try
+                    Return String.Empty
+                End Get
+                Set(ByVal _PostUrl As String)
+                    Me._PostUrl = _PostUrl
+                End Set
+            End Property
             Friend Sub New(ByVal Data As UserMedia, ByVal User As IUserData, ByVal Session As Integer)
                 Me.Data = Data
                 Me.User = User
@@ -78,6 +121,7 @@ Namespace DownloadObjects
                     Data = New UserMedia(e(Name_Media), User)
                     [Date] = AConvert(Of Date)(e.Value(Name_Date), DateTimeDefaultProvider, Now)
                     Session = e.Value(Name_Session).FromXML(Of Integer)(0)
+                    _PostUrl = e.Value(Name_PostUrl)
                     Dim f As SFile = e.Value(Name_File)
                     If f.Exists Then Data.File = f
                 End If
@@ -106,7 +150,8 @@ Namespace DownloadObjects
                                         New EContainer(Name_Date, AConvert(Of String)([Date], DateTimeDefaultProvider, String.Empty)),
                                         New EContainer(Name_Session, Session),
                                         New EContainer(Name_File, Data.File),
-                                        New EContainer(Name_IsSavedPosts, IsSavedPosts.BoolToInteger)},
+                                        New EContainer(Name_IsSavedPosts, IsSavedPosts.BoolToInteger),
+                                        New EContainer(Name_PostUrl, _PostUrl)},
                                     If(IsSavedPosts, UserInfo.ToEContainer, If(Not User Is Nothing, DirectCast(User, UserDataBase).User.ToEContainer, Nothing)), LAP.IgnoreICopier)
             End Function
         End Structure

SCrawler/Editors/GlobalSettingsForm.Designer.vb

@@ -24,16 +24,16 @@ Namespace Editors
         Private Sub InitializeComponent()
             Me.components = New System.ComponentModel.Container()
             Dim TP_BASIS As System.Windows.Forms.TableLayoutPanel
-            Dim ActionButton39 As PersonalUtilities.Forms.Controls.Base.ActionButton = New PersonalUtilities.Forms.Controls.Base.ActionButton()
+            Dim ActionButton1 As PersonalUtilities.Forms.Controls.Base.ActionButton = New PersonalUtilities.Forms.Controls.Base.ActionButton()
             Dim resources As System.ComponentModel.ComponentResourceManager = New System.ComponentModel.ComponentResourceManager(GetType(GlobalSettingsForm))
-            Dim ActionButton40 As PersonalUtilities.Forms.Controls.Base.ActionButton = New PersonalUtilities.Forms.Controls.Base.ActionButton()
+            Dim ActionButton2 As PersonalUtilities.Forms.Controls.Base.ActionButton = New PersonalUtilities.Forms.Controls.Base.ActionButton()
             Dim TP_IMAGES As System.Windows.Forms.TableLayoutPanel
-            Dim ActionButton41 As PersonalUtilities.Forms.Controls.Base.ActionButton = New PersonalUtilities.Forms.Controls.Base.ActionButton()
-            Dim ActionButton42 As PersonalUtilities.Forms.Controls.Base.ActionButton = New PersonalUtilities.Forms.Controls.Base.ActionButton()
-            Dim ActionButton43 As PersonalUtilities.Forms.Controls.Base.ActionButton = New PersonalUtilities.Forms.Controls.Base.ActionButton()
-            Dim ActionButton44 As PersonalUtilities.Forms.Controls.Base.ActionButton = New PersonalUtilities.Forms.Controls.Base.ActionButton()
-            Dim ActionButton45 As PersonalUtilities.Forms.Controls.Base.ActionButton = New PersonalUtilities.Forms.Controls.Base.ActionButton()
-            Dim ActionButton46 As PersonalUtilities.Forms.Controls.Base.ActionButton = New PersonalUtilities.Forms.Controls.Base.ActionButton()
+            Dim ActionButton3 As PersonalUtilities.Forms.Controls.Base.ActionButton = New PersonalUtilities.Forms.Controls.Base.ActionButton()
+            Dim ActionButton4 As PersonalUtilities.Forms.Controls.Base.ActionButton = New PersonalUtilities.Forms.Controls.Base.ActionButton()
+            Dim ActionButton5 As PersonalUtilities.Forms.Controls.Base.ActionButton = New PersonalUtilities.Forms.Controls.Base.ActionButton()
+            Dim ActionButton6 As PersonalUtilities.Forms.Controls.Base.ActionButton = New PersonalUtilities.Forms.Controls.Base.ActionButton()
+            Dim ActionButton7 As PersonalUtilities.Forms.Controls.Base.ActionButton = New PersonalUtilities.Forms.Controls.Base.ActionButton()
+            Dim ActionButton8 As PersonalUtilities.Forms.Controls.Base.ActionButton = New PersonalUtilities.Forms.Controls.Base.ActionButton()
             Dim TP_FILE_NAME As System.Windows.Forms.TableLayoutPanel
             Dim TP_FILE_PATTERNS As System.Windows.Forms.TableLayoutPanel
             Dim LBL_DATE_POS As System.Windows.Forms.Label
@@ -46,58 +46,58 @@ Namespace Editors
             Dim TP_CHANNELS As System.Windows.Forms.TableLayoutPanel
             Dim TAB_BEHAVIOR As System.Windows.Forms.TabPage
             Dim TP_BEHAVIOR As System.Windows.Forms.TableLayoutPanel
-            Dim ActionButton47 As PersonalUtilities.Forms.Controls.Base.ActionButton = New PersonalUtilities.Forms.Controls.Base.ActionButton()
-            Dim ActionButton48 As PersonalUtilities.Forms.Controls.Base.ActionButton = New PersonalUtilities.Forms.Controls.Base.ActionButton()
+            Dim ActionButton9 As PersonalUtilities.Forms.Controls.Base.ActionButton = New PersonalUtilities.Forms.Controls.Base.ActionButton()
+            Dim ActionButton10 As PersonalUtilities.Forms.Controls.Base.ActionButton = New PersonalUtilities.Forms.Controls.Base.ActionButton()
             Dim TP_OPEN_INFO As System.Windows.Forms.TableLayoutPanel
             Dim TP_OPEN_PROGRESS As System.Windows.Forms.TableLayoutPanel
             Dim TP_BEHAVIOR_F6 As System.Windows.Forms.TableLayoutPanel
             Dim TAB_DOWN As System.Windows.Forms.TabPage
             Dim TP_DOWNLOADING As System.Windows.Forms.TableLayoutPanel
-            Dim ActionButton49 As PersonalUtilities.Forms.Controls.Base.ActionButton = New PersonalUtilities.Forms.Controls.Base.ActionButton()
-            Dim ActionButton50 As PersonalUtilities.Forms.Controls.Base.ActionButton = New PersonalUtilities.Forms.Controls.Base.ActionButton()
+            Dim ActionButton11 As PersonalUtilities.Forms.Controls.Base.ActionButton = New PersonalUtilities.Forms.Controls.Base.ActionButton()
+            Dim ActionButton12 As PersonalUtilities.Forms.Controls.Base.ActionButton = New PersonalUtilities.Forms.Controls.Base.ActionButton()
             Dim TP_MISSING_DATA As System.Windows.Forms.TableLayoutPanel
             Dim TAB_FEED As System.Windows.Forms.TabPage
             Dim TP_FEED As System.Windows.Forms.TableLayoutPanel
             Dim TP_FEED_IMG_COUNT As System.Windows.Forms.TableLayoutPanel
             Dim TP_FEED_SES As System.Windows.Forms.TableLayoutPanel
-            Dim ActionButton51 As PersonalUtilities.Forms.Controls.Base.ActionButton = New PersonalUtilities.Forms.Controls.Base.ActionButton()
-            Dim ActionButton52 As PersonalUtilities.Forms.Controls.Base.ActionButton = New PersonalUtilities.Forms.Controls.Base.ActionButton()
+            Dim ActionButton13 As PersonalUtilities.Forms.Controls.Base.ActionButton = New PersonalUtilities.Forms.Controls.Base.ActionButton()
+            Dim ActionButton14 As PersonalUtilities.Forms.Controls.Base.ActionButton = New PersonalUtilities.Forms.Controls.Base.ActionButton()
+            Dim TP_FEED_SPEC_SEARCH As System.Windows.Forms.TableLayoutPanel
             Dim TAB_NOTIFY As System.Windows.Forms.TabPage
             Dim TP_NOTIFY_MAIN As System.Windows.Forms.TableLayoutPanel
             Dim TP_ENVIR As System.Windows.Forms.TableLayoutPanel
-            Dim ActionButton53 As PersonalUtilities.Forms.Controls.Base.ActionButton = New PersonalUtilities.Forms.Controls.Base.ActionButton()
-            Dim ActionButton54 As PersonalUtilities.Forms.Controls.Base.ActionButton = New PersonalUtilities.Forms.Controls.Base.ActionButton()
-            Dim ActionButton55 As PersonalUtilities.Forms.Controls.Base.ActionButton = New PersonalUtilities.Forms.Controls.Base.ActionButton()
-            Dim ActionButton56 As PersonalUtilities.Forms.Controls.Base.ActionButton = New PersonalUtilities.Forms.Controls.Base.ActionButton()
-            Dim ActionButton57 As PersonalUtilities.Forms.Controls.Base.ActionButton = New PersonalUtilities.Forms.Controls.Base.ActionButton()
-            Dim ActionButton58 As PersonalUtilities.Forms.Controls.Base.ActionButton = New PersonalUtilities.Forms.Controls.Base.ActionButton()
-            Dim ActionButton59 As PersonalUtilities.Forms.Controls.Base.ActionButton = New PersonalUtilities.Forms.Controls.Base.ActionButton()
-            Dim ActionButton60 As PersonalUtilities.Forms.Controls.Base.ActionButton = New PersonalUtilities.Forms.Controls.Base.ActionButton()
-            Dim ActionButton61 As PersonalUtilities.Forms.Controls.Base.ActionButton = New PersonalUtilities.Forms.Controls.Base.ActionButton()
-            Dim ActionButton62 As PersonalUtilities.Forms.Controls.Base.ActionButton = New PersonalUtilities.Forms.Controls.Base.ActionButton()
-            Dim ActionButton63 As PersonalUtilities.Forms.Controls.Base.ActionButton = New PersonalUtilities.Forms.Controls.Base.ActionButton()
-            Dim ActionButton64 As PersonalUtilities.Forms.Controls.Base.ActionButton = New PersonalUtilities.Forms.Controls.Base.ActionButton()
-            Dim ActionButton65 As PersonalUtilities.Forms.Controls.Base.ActionButton = New PersonalUtilities.Forms.Controls.Base.ActionButton()
-            Dim ActionButton66 As PersonalUtilities.Forms.Controls.Base.ActionButton = New PersonalUtilities.Forms.Controls.Base.ActionButton()
+            Dim ActionButton15 As PersonalUtilities.Forms.Controls.Base.ActionButton = New PersonalUtilities.Forms.Controls.Base.ActionButton()
+            Dim ActionButton16 As PersonalUtilities.Forms.Controls.Base.ActionButton = New PersonalUtilities.Forms.Controls.Base.ActionButton()
+            Dim ActionButton17 As PersonalUtilities.Forms.Controls.Base.ActionButton = New PersonalUtilities.Forms.Controls.Base.ActionButton()
+            Dim ActionButton18 As PersonalUtilities.Forms.Controls.Base.ActionButton = New PersonalUtilities.Forms.Controls.Base.ActionButton()
+            Dim ActionButton19 As PersonalUtilities.Forms.Controls.Base.ActionButton = New PersonalUtilities.Forms.Controls.Base.ActionButton()
+            Dim ActionButton20 As PersonalUtilities.Forms.Controls.Base.ActionButton = New PersonalUtilities.Forms.Controls.Base.ActionButton()
+            Dim ActionButton21 As PersonalUtilities.Forms.Controls.Base.ActionButton = New PersonalUtilities.Forms.Controls.Base.ActionButton()
+            Dim ActionButton22 As PersonalUtilities.Forms.Controls.Base.ActionButton = New PersonalUtilities.Forms.Controls.Base.ActionButton()
+            Dim ActionButton23 As PersonalUtilities.Forms.Controls.Base.ActionButton = New PersonalUtilities.Forms.Controls.Base.ActionButton()
+            Dim ActionButton24 As PersonalUtilities.Forms.Controls.Base.ActionButton = New PersonalUtilities.Forms.Controls.Base.ActionButton()
+            Dim ActionButton25 As PersonalUtilities.Forms.Controls.Base.ActionButton = New PersonalUtilities.Forms.Controls.Base.ActionButton()
+            Dim ActionButton26 As PersonalUtilities.Forms.Controls.Base.ActionButton = New PersonalUtilities.Forms.Controls.Base.ActionButton()
+            Dim ActionButton27 As PersonalUtilities.Forms.Controls.Base.ActionButton = New PersonalUtilities.Forms.Controls.Base.ActionButton()
+            Dim ActionButton28 As PersonalUtilities.Forms.Controls.Base.ActionButton = New PersonalUtilities.Forms.Controls.Base.ActionButton()
             Dim TAB_STD As System.Windows.Forms.TabPage
             Dim TP_STD As System.Windows.Forms.TableLayoutPanel
-            Dim ActionButton67 As PersonalUtilities.Forms.Controls.Base.ActionButton = New PersonalUtilities.Forms.Controls.Base.ActionButton()
-            Dim ListColumn3 As PersonalUtilities.Forms.Controls.Base.ListColumn = New PersonalUtilities.Forms.Controls.Base.ListColumn()
-            Dim ListColumn4 As PersonalUtilities.Forms.Controls.Base.ListColumn = New PersonalUtilities.Forms.Controls.Base.ListColumn()
+            Dim ActionButton29 As PersonalUtilities.Forms.Controls.Base.ActionButton = New PersonalUtilities.Forms.Controls.Base.ActionButton()
+            Dim ListColumn1 As PersonalUtilities.Forms.Controls.Base.ListColumn = New PersonalUtilities.Forms.Controls.Base.ListColumn()
+            Dim ListColumn2 As PersonalUtilities.Forms.Controls.Base.ListColumn = New PersonalUtilities.Forms.Controls.Base.ListColumn()
             Dim TAB_DESIGN As System.Windows.Forms.TabPage
             Dim TP_DESIGN As System.Windows.Forms.TableLayoutPanel
-            Dim ActionButton68 As PersonalUtilities.Forms.Controls.Base.ActionButton = New PersonalUtilities.Forms.Controls.Base.ActionButton()
-            Dim ActionButton69 As PersonalUtilities.Forms.Controls.Base.ActionButton = New PersonalUtilities.Forms.Controls.Base.ActionButton()
-            Dim ActionButton70 As PersonalUtilities.Forms.Controls.Base.ActionButton = New PersonalUtilities.Forms.Controls.Base.ActionButton()
-            Dim ActionButton71 As PersonalUtilities.Forms.Controls.Base.ActionButton = New PersonalUtilities.Forms.Controls.Base.ActionButton()
+            Dim ActionButton30 As PersonalUtilities.Forms.Controls.Base.ActionButton = New PersonalUtilities.Forms.Controls.Base.ActionButton()
+            Dim ActionButton31 As PersonalUtilities.Forms.Controls.Base.ActionButton = New PersonalUtilities.Forms.Controls.Base.ActionButton()
+            Dim ActionButton32 As PersonalUtilities.Forms.Controls.Base.ActionButton = New PersonalUtilities.Forms.Controls.Base.ActionButton()
+            Dim ActionButton33 As PersonalUtilities.Forms.Controls.Base.ActionButton = New PersonalUtilities.Forms.Controls.Base.ActionButton()
             Dim TP_HEADERS_DEF As System.Windows.Forms.TableLayoutPanel
-            Dim ActionButton72 As PersonalUtilities.Forms.Controls.Base.ActionButton = New PersonalUtilities.Forms.Controls.Base.ActionButton()
-            Dim ActionButton73 As PersonalUtilities.Forms.Controls.Base.ActionButton = New PersonalUtilities.Forms.Controls.Base.ActionButton()
-            Dim ActionButton74 As PersonalUtilities.Forms.Controls.Base.ActionButton = New PersonalUtilities.Forms.Controls.Base.ActionButton()
-            Dim ActionButton75 As PersonalUtilities.Forms.Controls.Base.ActionButton = New PersonalUtilities.Forms.Controls.Base.ActionButton()
-            Dim ActionButton76 As PersonalUtilities.Forms.Controls.Base.ActionButton = New PersonalUtilities.Forms.Controls.Base.ActionButton()
+            Dim ActionButton34 As PersonalUtilities.Forms.Controls.Base.ActionButton = New PersonalUtilities.Forms.Controls.Base.ActionButton()
+            Dim ActionButton35 As PersonalUtilities.Forms.Controls.Base.ActionButton = New PersonalUtilities.Forms.Controls.Base.ActionButton()
+            Dim ActionButton36 As PersonalUtilities.Forms.Controls.Base.ActionButton = New PersonalUtilities.Forms.Controls.Base.ActionButton()
+            Dim ActionButton37 As PersonalUtilities.Forms.Controls.Base.ActionButton = New PersonalUtilities.Forms.Controls.Base.ActionButton()
+            Dim ActionButton38 As PersonalUtilities.Forms.Controls.Base.ActionButton = New PersonalUtilities.Forms.Controls.Base.ActionButton()
             Dim TAB_HEADERS As System.Windows.Forms.TabPage
-            Dim TP_FEED_SPEC_SEARCH As System.Windows.Forms.TableLayoutPanel
             Me.TXT_GLOBAL_PATH = New PersonalUtilities.Forms.Controls.TextBoxExtended()
             Me.TXT_IMAGE_LARGE = New PersonalUtilities.Forms.Controls.TextBoxExtended()
             Me.TXT_IMAGE_SMALL = New PersonalUtilities.Forms.Controls.TextBoxExtended()
@@ -151,6 +151,8 @@ Namespace Editors
             Me.CH_FEED_UP_FILE_LOC_MOVE = New System.Windows.Forms.CheckBox()
             Me.CH_DOWN_ALL_F6_NOTIFY = New System.Windows.Forms.CheckBox()
             Me.CH_DOWN_ALL_NOTIFY = New System.Windows.Forms.CheckBox()
+            Me.CH_FEED_SPEC_SEARCH = New System.Windows.Forms.CheckBox()
+            Me.CH_FEED_SPEC_SEARCH_DEEP = New System.Windows.Forms.CheckBox()
             Me.TXT_CHANNELS_ROWS = New PersonalUtilities.Forms.Controls.TextBoxExtended()
             Me.TXT_CHANNELS_COLUMNS = New PersonalUtilities.Forms.Controls.TextBoxExtended()
             Me.CH_DOWN_IMAGES_NATIVE = New System.Windows.Forms.CheckBox()
@@ -210,8 +212,7 @@ Namespace Editors
             Me.TAB_MAIN = New System.Windows.Forms.TabControl()
             Me.TAB_ENVIR = New System.Windows.Forms.TabPage()
             Me.CONTAINER_MAIN = New System.Windows.Forms.ToolStripContainer()
-            Me.CH_FEED_SPEC_SEARCH = New System.Windows.Forms.CheckBox()
-            Me.CH_FEED_SPEC_SEARCH_DEEP = New System.Windows.Forms.CheckBox()
+            Me.CH_FEED_OPEN_CTRLF = New System.Windows.Forms.CheckBox()
             TP_BASIS = New System.Windows.Forms.TableLayoutPanel()
             TP_IMAGES = New System.Windows.Forms.TableLayoutPanel()
             TP_FILE_NAME = New System.Windows.Forms.TableLayoutPanel()
@@ -236,6 +237,7 @@ Namespace Editors
             TP_FEED = New System.Windows.Forms.TableLayoutPanel()
             TP_FEED_IMG_COUNT = New System.Windows.Forms.TableLayoutPanel()
             TP_FEED_SES = New System.Windows.Forms.TableLayoutPanel()
+            TP_FEED_SPEC_SEARCH = New System.Windows.Forms.TableLayoutPanel()
             TAB_NOTIFY = New System.Windows.Forms.TabPage()
             TP_NOTIFY_MAIN = New System.Windows.Forms.TableLayoutPanel()
             TP_ENVIR = New System.Windows.Forms.TableLayoutPanel()
@@ -245,7 +247,6 @@ Namespace Editors
             TP_DESIGN = New System.Windows.Forms.TableLayoutPanel()
             TP_HEADERS_DEF = New System.Windows.Forms.TableLayoutPanel()
             TAB_HEADERS = New System.Windows.Forms.TabPage()
-            TP_FEED_SPEC_SEARCH = New System.Windows.Forms.TableLayoutPanel()
             TP_BASIS.SuspendLayout()
             CType(Me.TXT_GLOBAL_PATH, System.ComponentModel.ISupportInitialize).BeginInit()
             TP_IMAGES.SuspendLayout()
@@ -290,6 +291,7 @@ Namespace Editors
             TP_FEED_SES.SuspendLayout()
             CType(Me.NUM_FEED_STORE_SESSION_DATA, System.ComponentModel.ISupportInitialize).BeginInit()
             CType(Me.NUM_FEED_SES_CURR_LOAD_LAST, System.ComponentModel.ISupportInitialize).BeginInit()
+            TP_FEED_SPEC_SEARCH.SuspendLayout()
             TAB_NOTIFY.SuspendLayout()
             TP_NOTIFY_MAIN.SuspendLayout()
             TP_ENVIR.SuspendLayout()
@@ -318,7 +320,6 @@ Namespace Editors
             Me.TAB_ENVIR.SuspendLayout()
             Me.CONTAINER_MAIN.ContentPanel.SuspendLayout()
             Me.CONTAINER_MAIN.SuspendLayout()
-            TP_FEED_SPEC_SEARCH.SuspendLayout()
             Me.SuspendLayout()
             '
             'TP_BASIS
@@ -349,17 +350,17 @@ Namespace Editors
             TP_BASIS.RowStyles.Add(New System.Windows.Forms.RowStyle(System.Windows.Forms.SizeType.Percent, 100.0!))
             TP_BASIS.RowStyles.Add(New System.Windows.Forms.RowStyle(System.Windows.Forms.SizeType.Absolute, 20.0!))
             TP_BASIS.RowStyles.Add(New System.Windows.Forms.RowStyle(System.Windows.Forms.SizeType.Absolute, 20.0!))
-            TP_BASIS.Size = New System.Drawing.Size(615, 393)
+            TP_BASIS.Size = New System.Drawing.Size(615, 418)
             TP_BASIS.TabIndex = 0
             '
             'TXT_GLOBAL_PATH
             '
-            ActionButton39.BackgroundImage = CType(resources.GetObject("ActionButton39.BackgroundImage"), System.Drawing.Image)
-            ActionButton39.Name = "Open"
-            ActionButton40.BackgroundImage = CType(resources.GetObject("ActionButton40.BackgroundImage"), System.Drawing.Image)
-            ActionButton40.Name = "Clear"
-            Me.TXT_GLOBAL_PATH.Buttons.Add(ActionButton39)
-            Me.TXT_GLOBAL_PATH.Buttons.Add(ActionButton40)
+            ActionButton1.BackgroundImage = CType(resources.GetObject("ActionButton1.BackgroundImage"), System.Drawing.Image)
+            ActionButton1.Name = "Open"
+            ActionButton2.BackgroundImage = CType(resources.GetObject("ActionButton2.BackgroundImage"), System.Drawing.Image)
+            ActionButton2.Name = "Clear"
+            Me.TXT_GLOBAL_PATH.Buttons.Add(ActionButton1)
+            Me.TXT_GLOBAL_PATH.Buttons.Add(ActionButton2)
             Me.TXT_GLOBAL_PATH.CaptionText = "Data Path"
             Me.TXT_GLOBAL_PATH.CaptionToolTipEnabled = True
             Me.TXT_GLOBAL_PATH.CaptionToolTipText = "Root path for storing users' data"
@@ -420,9 +421,9 @@ Namespace Editors
             '
             'TXT_COLLECTIONS_PATH
             '
-            ActionButton41.BackgroundImage = CType(resources.GetObject("ActionButton41.BackgroundImage"), System.Drawing.Image)
-            ActionButton41.Name = "Clear"
-            Me.TXT_COLLECTIONS_PATH.Buttons.Add(ActionButton41)
+            ActionButton3.BackgroundImage = CType(resources.GetObject("ActionButton3.BackgroundImage"), System.Drawing.Image)
+            ActionButton3.Name = "Clear"
+            Me.TXT_COLLECTIONS_PATH.Buttons.Add(ActionButton3)
             Me.TXT_COLLECTIONS_PATH.CaptionText = "Collections folder"
             Me.TXT_COLLECTIONS_PATH.CaptionToolTipEnabled = True
             Me.TXT_COLLECTIONS_PATH.CaptionToolTipText = "Set collections folder name (name only)"
@@ -434,10 +435,10 @@ Namespace Editors
             '
             'TXT_MAX_JOBS_USERS
             '
-            ActionButton42.BackgroundImage = CType(resources.GetObject("ActionButton42.BackgroundImage"), System.Drawing.Image)
-            ActionButton42.Name = "Refresh"
-            ActionButton42.ToolTipText = "Set to default"
-            Me.TXT_MAX_JOBS_USERS.Buttons.Add(ActionButton42)
+            ActionButton4.BackgroundImage = CType(resources.GetObject("ActionButton4.BackgroundImage"), System.Drawing.Image)
+            ActionButton4.Name = "Refresh"
+            ActionButton4.ToolTipText = "Set to default"
+            Me.TXT_MAX_JOBS_USERS.Buttons.Add(ActionButton4)
             Me.TXT_MAX_JOBS_USERS.CaptionSizeType = System.Windows.Forms.SizeType.Percent
             Me.TXT_MAX_JOBS_USERS.CaptionText = "Maximum downloading tasks of users"
             Me.TXT_MAX_JOBS_USERS.CaptionWidth = 50.0R
@@ -453,10 +454,10 @@ Namespace Editors
             '
             'TXT_MAX_JOBS_CHANNELS
             '
-            ActionButton43.BackgroundImage = CType(resources.GetObject("ActionButton43.BackgroundImage"), System.Drawing.Image)
-            ActionButton43.Name = "Refresh"
-            ActionButton43.ToolTipText = "Set to default"
-            Me.TXT_MAX_JOBS_CHANNELS.Buttons.Add(ActionButton43)
+            ActionButton5.BackgroundImage = CType(resources.GetObject("ActionButton5.BackgroundImage"), System.Drawing.Image)
+            ActionButton5.Name = "Refresh"
+            ActionButton5.ToolTipText = "Set to default"
+            Me.TXT_MAX_JOBS_CHANNELS.Buttons.Add(ActionButton5)
             Me.TXT_MAX_JOBS_CHANNELS.CaptionSizeType = System.Windows.Forms.SizeType.Percent
             Me.TXT_MAX_JOBS_CHANNELS.CaptionText = "Maximum downloading tasks of channels"
             Me.TXT_MAX_JOBS_CHANNELS.CaptionWidth = 50.0R
@@ -483,9 +484,9 @@ Namespace Editors
             '
             'TXT_IMGUR_CLIENT_ID
             '
-            ActionButton44.BackgroundImage = CType(resources.GetObject("ActionButton44.BackgroundImage"), System.Drawing.Image)
-            ActionButton44.Name = "Clear"
-            Me.TXT_IMGUR_CLIENT_ID.Buttons.Add(ActionButton44)
+            ActionButton6.BackgroundImage = CType(resources.GetObject("ActionButton6.BackgroundImage"), System.Drawing.Image)
+            ActionButton6.Name = "Clear"
+            Me.TXT_IMGUR_CLIENT_ID.Buttons.Add(ActionButton6)
             Me.TXT_IMGUR_CLIENT_ID.CaptionText = "Imgur Client ID"
             Me.TXT_IMGUR_CLIENT_ID.Dock = System.Windows.Forms.DockStyle.Fill
             Me.TXT_IMGUR_CLIENT_ID.Location = New System.Drawing.Point(4, 204)
@@ -495,14 +496,14 @@ Namespace Editors
             '
             'TXT_USER_AGENT
             '
-            ActionButton45.BackgroundImage = CType(resources.GetObject("ActionButton45.BackgroundImage"), System.Drawing.Image)
-            ActionButton45.Name = "Refresh"
-            ActionButton45.Tag = PersonalUtilities.Forms.Controls.Base.ActionButton.DefaultButtons.Refresh
-            ActionButton46.BackgroundImage = CType(resources.GetObject("ActionButton46.BackgroundImage"), System.Drawing.Image)
-            ActionButton46.Name = "Clear"
-            ActionButton46.Tag = PersonalUtilities.Forms.Controls.Base.ActionButton.DefaultButtons.Clear
-            Me.TXT_USER_AGENT.Buttons.Add(ActionButton45)
-            Me.TXT_USER_AGENT.Buttons.Add(ActionButton46)
+            ActionButton7.BackgroundImage = CType(resources.GetObject("ActionButton7.BackgroundImage"), System.Drawing.Image)
+            ActionButton7.Name = "Refresh"
+            ActionButton7.Tag = PersonalUtilities.Forms.Controls.Base.ActionButton.DefaultButtons.Refresh
+            ActionButton8.BackgroundImage = CType(resources.GetObject("ActionButton8.BackgroundImage"), System.Drawing.Image)
+            ActionButton8.Name = "Clear"
+            ActionButton8.Tag = PersonalUtilities.Forms.Controls.Base.ActionButton.DefaultButtons.Clear
+            Me.TXT_USER_AGENT.Buttons.Add(ActionButton7)
+            Me.TXT_USER_AGENT.Buttons.Add(ActionButton8)
             Me.TXT_USER_AGENT.CaptionText = "UserAgent"
             Me.TXT_USER_AGENT.CaptionToolTipEnabled = True
             Me.TXT_USER_AGENT.CaptionToolTipText = "Default user agent to use in requests"
@@ -1105,6 +1106,31 @@ Namespace Editors
             TT_MAIN.SetToolTip(Me.CH_DOWN_ALL_NOTIFY, "Request confirmation to download all users anyway")
             Me.CH_DOWN_ALL_NOTIFY.UseVisualStyleBackColor = True
             '
+            'CH_FEED_SPEC_SEARCH
+            '
+            Me.CH_FEED_SPEC_SEARCH.AutoSize = True
+            Me.CH_FEED_SPEC_SEARCH.Dock = System.Windows.Forms.DockStyle.Fill
+            Me.CH_FEED_SPEC_SEARCH.Location = New System.Drawing.Point(3, 3)
+            Me.CH_FEED_SPEC_SEARCH.Name = "CH_FEED_SPEC_SEARCH"
+            Me.CH_FEED_SPEC_SEARCH.Size = New System.Drawing.Size(303, 19)
+            Me.CH_FEED_SPEC_SEARCH.TabIndex = 0
+            Me.CH_FEED_SPEC_SEARCH.Text = "Search missing files (special feeds)"
+            TT_MAIN.SetToolTip(Me.CH_FEED_SPEC_SEARCH, "Search for missing file in the entire user folder")
+            Me.CH_FEED_SPEC_SEARCH.UseVisualStyleBackColor = True
+            '
+            'CH_FEED_SPEC_SEARCH_DEEP
+            '
+            Me.CH_FEED_SPEC_SEARCH_DEEP.AutoSize = True
+            Me.CH_FEED_SPEC_SEARCH_DEEP.Dock = System.Windows.Forms.DockStyle.Fill
+            Me.CH_FEED_SPEC_SEARCH_DEEP.Location = New System.Drawing.Point(312, 3)
+            Me.CH_FEED_SPEC_SEARCH_DEEP.Name = "CH_FEED_SPEC_SEARCH_DEEP"
+            Me.CH_FEED_SPEC_SEARCH_DEEP.Size = New System.Drawing.Size(304, 19)
+            Me.CH_FEED_SPEC_SEARCH_DEEP.TabIndex = 1
+            Me.CH_FEED_SPEC_SEARCH_DEEP.Text = "Search missing files (special feeds): deep search"
+            TT_MAIN.SetToolTip(Me.CH_FEED_SPEC_SEARCH_DEEP, "Deep search means that the missing file will be searched in other users' location" &
+        "s as well.")
+            Me.CH_FEED_SPEC_SEARCH_DEEP.UseVisualStyleBackColor = True
+            '
             'TP_CHANNELS_IMGS
             '
             TP_CHANNELS_IMGS.ColumnCount = 2
@@ -1156,7 +1182,7 @@ Namespace Editors
             TAB_BASIS.Location = New System.Drawing.Point(4, 22)
             TAB_BASIS.Name = "TAB_BASIS"
             TAB_BASIS.Padding = New System.Windows.Forms.Padding(3)
-            TAB_BASIS.Size = New System.Drawing.Size(621, 399)
+            TAB_BASIS.Size = New System.Drawing.Size(621, 424)
             TAB_BASIS.TabIndex = 0
             TAB_BASIS.Text = "Basis"
             '
@@ -1166,7 +1192,7 @@ Namespace Editors
             TAB_DEFAULTS.Location = New System.Drawing.Point(4, 22)
             TAB_DEFAULTS.Name = "TAB_DEFAULTS"
             TAB_DEFAULTS.Padding = New System.Windows.Forms.Padding(3)
-            TAB_DEFAULTS.Size = New System.Drawing.Size(621, 399)
+            TAB_DEFAULTS.Size = New System.Drawing.Size(621, 424)
             TAB_DEFAULTS.TabIndex = 1
             TAB_DEFAULTS.Text = "Defaults"
             '
@@ -1192,7 +1218,7 @@ Namespace Editors
             TP_DEFS.RowStyles.Add(New System.Windows.Forms.RowStyle(System.Windows.Forms.SizeType.Absolute, 25.0!))
             TP_DEFS.RowStyles.Add(New System.Windows.Forms.RowStyle(System.Windows.Forms.SizeType.Absolute, 25.0!))
             TP_DEFS.RowStyles.Add(New System.Windows.Forms.RowStyle(System.Windows.Forms.SizeType.Percent, 100.0!))
-            TP_DEFS.Size = New System.Drawing.Size(615, 393)
+            TP_DEFS.Size = New System.Drawing.Size(615, 418)
             TP_DEFS.TabIndex = 0
             '
             'CH_DOWN_IMAGES_NATIVE
@@ -1212,7 +1238,7 @@ Namespace Editors
             TAB_DEFS_CHANNELS.Location = New System.Drawing.Point(4, 22)
             TAB_DEFS_CHANNELS.Name = "TAB_DEFS_CHANNELS"
             TAB_DEFS_CHANNELS.Padding = New System.Windows.Forms.Padding(3)
-            TAB_DEFS_CHANNELS.Size = New System.Drawing.Size(621, 399)
+            TAB_DEFS_CHANNELS.Size = New System.Drawing.Size(621, 424)
             TAB_DEFS_CHANNELS.TabIndex = 4
             TAB_DEFS_CHANNELS.Text = "Channels"
             '
@@ -1238,7 +1264,7 @@ Namespace Editors
             TP_CHANNELS.RowStyles.Add(New System.Windows.Forms.RowStyle(System.Windows.Forms.SizeType.Absolute, 25.0!))
             TP_CHANNELS.RowStyles.Add(New System.Windows.Forms.RowStyle(System.Windows.Forms.SizeType.Absolute, 25.0!))
             TP_CHANNELS.RowStyles.Add(New System.Windows.Forms.RowStyle(System.Windows.Forms.SizeType.Percent, 100.0!))
-            TP_CHANNELS.Size = New System.Drawing.Size(615, 393)
+            TP_CHANNELS.Size = New System.Drawing.Size(615, 418)
             TP_CHANNELS.TabIndex = 0
             '
             'TXT_CHANNEL_USER_POST_LIMIT
@@ -1277,7 +1303,7 @@ Namespace Editors
             TAB_BEHAVIOR.Controls.Add(TP_BEHAVIOR)
             TAB_BEHAVIOR.Location = New System.Drawing.Point(4, 22)
             TAB_BEHAVIOR.Name = "TAB_BEHAVIOR"
-            TAB_BEHAVIOR.Size = New System.Drawing.Size(621, 399)
+            TAB_BEHAVIOR.Size = New System.Drawing.Size(621, 424)
             TAB_BEHAVIOR.TabIndex = 5
             TAB_BEHAVIOR.Text = "Behavior"
             '
@@ -1297,10 +1323,11 @@ Namespace Editors
             TP_BEHAVIOR.Controls.Add(TP_BEHAVIOR_F6, 0, 8)
             TP_BEHAVIOR.Controls.Add(Me.TXT_SCHEDULER_SCRIPT, 0, 9)
             TP_BEHAVIOR.Controls.Add(Me.CH_SCHEDULER_SCRIPT_EX_MANUAL, 0, 10)
+            TP_BEHAVIOR.Controls.Add(Me.CH_FEED_OPEN_CTRLF, 0, 11)
             TP_BEHAVIOR.Dock = System.Windows.Forms.DockStyle.Fill
             TP_BEHAVIOR.Location = New System.Drawing.Point(0, 0)
             TP_BEHAVIOR.Name = "TP_BEHAVIOR"
-            TP_BEHAVIOR.RowCount = 12
+            TP_BEHAVIOR.RowCount = 13
             TP_BEHAVIOR.RowStyles.Add(New System.Windows.Forms.RowStyle(System.Windows.Forms.SizeType.Absolute, 25.0!))
             TP_BEHAVIOR.RowStyles.Add(New System.Windows.Forms.RowStyle(System.Windows.Forms.SizeType.Absolute, 25.0!))
             TP_BEHAVIOR.RowStyles.Add(New System.Windows.Forms.RowStyle(System.Windows.Forms.SizeType.Absolute, 25.0!))
@@ -1312,18 +1339,19 @@ Namespace Editors
             TP_BEHAVIOR.RowStyles.Add(New System.Windows.Forms.RowStyle(System.Windows.Forms.SizeType.Absolute, 25.0!))
             TP_BEHAVIOR.RowStyles.Add(New System.Windows.Forms.RowStyle(System.Windows.Forms.SizeType.Absolute, 28.0!))
             TP_BEHAVIOR.RowStyles.Add(New System.Windows.Forms.RowStyle(System.Windows.Forms.SizeType.Absolute, 25.0!))
+            TP_BEHAVIOR.RowStyles.Add(New System.Windows.Forms.RowStyle(System.Windows.Forms.SizeType.Absolute, 25.0!))
             TP_BEHAVIOR.RowStyles.Add(New System.Windows.Forms.RowStyle(System.Windows.Forms.SizeType.Percent, 100.0!))
-            TP_BEHAVIOR.Size = New System.Drawing.Size(621, 399)
+            TP_BEHAVIOR.Size = New System.Drawing.Size(621, 424)
             TP_BEHAVIOR.TabIndex = 0
             '
             'TXT_FOLDER_CMD
             '
             Me.TXT_FOLDER_CMD.AutoShowClearButton = True
-            ActionButton47.BackgroundImage = CType(resources.GetObject("ActionButton47.BackgroundImage"), System.Drawing.Image)
-            ActionButton47.Enabled = False
-            ActionButton47.Name = "Clear"
-            ActionButton47.Visible = False
-            Me.TXT_FOLDER_CMD.Buttons.Add(ActionButton47)
+            ActionButton9.BackgroundImage = CType(resources.GetObject("ActionButton9.BackgroundImage"), System.Drawing.Image)
+            ActionButton9.Enabled = False
+            ActionButton9.Name = "Clear"
+            ActionButton9.Visible = False
+            Me.TXT_FOLDER_CMD.Buttons.Add(ActionButton9)
             Me.TXT_FOLDER_CMD.CaptionMode = PersonalUtilities.Forms.Controls.Base.ICaptionControl.Modes.CheckBox
             Me.TXT_FOLDER_CMD.CaptionText = "Folder cmd"
             Me.TXT_FOLDER_CMD.CaptionToolTipEnabled = True
@@ -1362,11 +1390,11 @@ Namespace Editors
             'TXT_CLOSE_SCRIPT
             '
             Me.TXT_CLOSE_SCRIPT.AutoShowClearButton = True
-            ActionButton48.BackgroundImage = CType(resources.GetObject("ActionButton48.BackgroundImage"), System.Drawing.Image)
-            ActionButton48.Enabled = False
-            ActionButton48.Name = "Clear"
-            ActionButton48.Visible = False
-            Me.TXT_CLOSE_SCRIPT.Buttons.Add(ActionButton48)
+            ActionButton10.BackgroundImage = CType(resources.GetObject("ActionButton10.BackgroundImage"), System.Drawing.Image)
+            ActionButton10.Enabled = False
+            ActionButton10.Name = "Clear"
+            ActionButton10.Visible = False
+            Me.TXT_CLOSE_SCRIPT.Buttons.Add(ActionButton10)
             Me.TXT_CLOSE_SCRIPT.CaptionMode = PersonalUtilities.Forms.Controls.Base.ICaptionControl.Modes.CheckBox
             Me.TXT_CLOSE_SCRIPT.CaptionText = "Close cmd"
             Me.TXT_CLOSE_SCRIPT.CaptionToolTipEnabled = True
@@ -1509,7 +1537,7 @@ Namespace Editors
             TAB_DOWN.Controls.Add(TP_DOWNLOADING)
             TAB_DOWN.Location = New System.Drawing.Point(4, 22)
             TAB_DOWN.Name = "TAB_DOWN"
-            TAB_DOWN.Size = New System.Drawing.Size(621, 399)
+            TAB_DOWN.Size = New System.Drawing.Size(621, 424)
             TAB_DOWN.TabIndex = 6
             TAB_DOWN.Text = "Downloading"
             '
@@ -1545,17 +1573,17 @@ Namespace Editors
             TP_DOWNLOADING.RowStyles.Add(New System.Windows.Forms.RowStyle(System.Windows.Forms.SizeType.Absolute, 25.0!))
             TP_DOWNLOADING.RowStyles.Add(New System.Windows.Forms.RowStyle(System.Windows.Forms.SizeType.Absolute, 28.0!))
             TP_DOWNLOADING.RowStyles.Add(New System.Windows.Forms.RowStyle(System.Windows.Forms.SizeType.Percent, 100.0!))
-            TP_DOWNLOADING.Size = New System.Drawing.Size(621, 399)
+            TP_DOWNLOADING.Size = New System.Drawing.Size(621, 424)
             TP_DOWNLOADING.TabIndex = 1
             '
             'TXT_SCRIPT
             '
-            ActionButton49.BackgroundImage = CType(resources.GetObject("ActionButton49.BackgroundImage"), System.Drawing.Image)
-            ActionButton49.Name = "Open"
-            ActionButton50.BackgroundImage = CType(resources.GetObject("ActionButton50.BackgroundImage"), System.Drawing.Image)
-            ActionButton50.Name = "Clear"
-            Me.TXT_SCRIPT.Buttons.Add(ActionButton49)
-            Me.TXT_SCRIPT.Buttons.Add(ActionButton50)
+            ActionButton11.BackgroundImage = CType(resources.GetObject("ActionButton11.BackgroundImage"), System.Drawing.Image)
+            ActionButton11.Name = "Open"
+            ActionButton12.BackgroundImage = CType(resources.GetObject("ActionButton12.BackgroundImage"), System.Drawing.Image)
+            ActionButton12.Name = "Clear"
+            Me.TXT_SCRIPT.Buttons.Add(ActionButton11)
+            Me.TXT_SCRIPT.Buttons.Add(ActionButton12)
             Me.TXT_SCRIPT.CaptionMode = PersonalUtilities.Forms.Controls.Base.ICaptionControl.Modes.CheckBox
             Me.TXT_SCRIPT.CaptionText = "Script"
             Me.TXT_SCRIPT.CaptionToolTipEnabled = True
@@ -1649,7 +1677,7 @@ Namespace Editors
             TAB_FEED.Controls.Add(TP_FEED)
             TAB_FEED.Location = New System.Drawing.Point(4, 22)
             TAB_FEED.Name = "TAB_FEED"
-            TAB_FEED.Size = New System.Drawing.Size(621, 399)
+            TAB_FEED.Size = New System.Drawing.Size(621, 424)
             TAB_FEED.TabIndex = 7
             TAB_FEED.Text = "Feed"
             '
@@ -1694,7 +1722,7 @@ Namespace Editors
             TP_FEED.RowStyles.Add(New System.Windows.Forms.RowStyle(System.Windows.Forms.SizeType.Absolute, 25.0!))
             TP_FEED.RowStyles.Add(New System.Windows.Forms.RowStyle(System.Windows.Forms.SizeType.Percent, 100.0!))
             TP_FEED.RowStyles.Add(New System.Windows.Forms.RowStyle(System.Windows.Forms.SizeType.Absolute, 20.0!))
-            TP_FEED.Size = New System.Drawing.Size(621, 399)
+            TP_FEED.Size = New System.Drawing.Size(621, 424)
             TP_FEED.TabIndex = 0
             '
             'TP_FEED_IMG_COUNT
@@ -1873,14 +1901,14 @@ Namespace Editors
             '
             'NUM_FEED_SES_CURR_LOAD_LAST
             '
-            ActionButton51.BackgroundImage = CType(resources.GetObject("ActionButton51.BackgroundImage"), System.Drawing.Image)
-            ActionButton51.Name = "Refresh"
-            ActionButton51.Tag = PersonalUtilities.Forms.Controls.Base.ActionButton.DefaultButtons.Refresh
-            ActionButton52.BackgroundImage = CType(resources.GetObject("ActionButton52.BackgroundImage"), System.Drawing.Image)
-            ActionButton52.Name = "Clear"
-            ActionButton52.Tag = PersonalUtilities.Forms.Controls.Base.ActionButton.DefaultButtons.Clear
-            Me.NUM_FEED_SES_CURR_LOAD_LAST.Buttons.Add(ActionButton51)
-            Me.NUM_FEED_SES_CURR_LOAD_LAST.Buttons.Add(ActionButton52)
+            ActionButton13.BackgroundImage = CType(resources.GetObject("ActionButton13.BackgroundImage"), System.Drawing.Image)
+            ActionButton13.Name = "Refresh"
+            ActionButton13.Tag = PersonalUtilities.Forms.Controls.Base.ActionButton.DefaultButtons.Refresh
+            ActionButton14.BackgroundImage = CType(resources.GetObject("ActionButton14.BackgroundImage"), System.Drawing.Image)
+            ActionButton14.Name = "Clear"
+            ActionButton14.Tag = PersonalUtilities.Forms.Controls.Base.ActionButton.DefaultButtons.Clear
+            Me.NUM_FEED_SES_CURR_LOAD_LAST.Buttons.Add(ActionButton13)
+            Me.NUM_FEED_SES_CURR_LOAD_LAST.Buttons.Add(ActionButton14)
             Me.NUM_FEED_SES_CURR_LOAD_LAST.CaptionText = "Load last session"
             Me.NUM_FEED_SES_CURR_LOAD_LAST.CaptionToolTipEnabled = True
             Me.NUM_FEED_SES_CURR_LOAD_LAST.CaptionToolTipText = resources.GetString("NUM_FEED_SES_CURR_LOAD_LAST.CaptionToolTipText")
@@ -1930,12 +1958,29 @@ Namespace Editors
             Me.CH_FEED_ESC_TO_CLOSE.Text = "Use the 'Esc' key to close the form"
             Me.CH_FEED_ESC_TO_CLOSE.UseVisualStyleBackColor = True
             '
+            'TP_FEED_SPEC_SEARCH
+            '
+            TP_FEED_SPEC_SEARCH.ColumnCount = 2
+            TP_FEED_SPEC_SEARCH.ColumnStyles.Add(New System.Windows.Forms.ColumnStyle(System.Windows.Forms.SizeType.Percent, 50.0!))
+            TP_FEED_SPEC_SEARCH.ColumnStyles.Add(New System.Windows.Forms.ColumnStyle(System.Windows.Forms.SizeType.Percent, 50.0!))
+            TP_FEED_SPEC_SEARCH.Controls.Add(Me.CH_FEED_SPEC_SEARCH, 0, 0)
+            TP_FEED_SPEC_SEARCH.Controls.Add(Me.CH_FEED_SPEC_SEARCH_DEEP, 1, 0)
+            TP_FEED_SPEC_SEARCH.Dock = System.Windows.Forms.DockStyle.Fill
+            TP_FEED_SPEC_SEARCH.Location = New System.Drawing.Point(1, 374)
+            TP_FEED_SPEC_SEARCH.Margin = New System.Windows.Forms.Padding(0)
+            TP_FEED_SPEC_SEARCH.Name = "TP_FEED_SPEC_SEARCH"
+            TP_FEED_SPEC_SEARCH.RowCount = 1
+            TP_FEED_SPEC_SEARCH.RowStyles.Add(New System.Windows.Forms.RowStyle(System.Windows.Forms.SizeType.Percent, 100.0!))
+            TP_FEED_SPEC_SEARCH.RowStyles.Add(New System.Windows.Forms.RowStyle(System.Windows.Forms.SizeType.Absolute, 25.0!))
+            TP_FEED_SPEC_SEARCH.Size = New System.Drawing.Size(619, 25)
+            TP_FEED_SPEC_SEARCH.TabIndex = 14
+            '
             'TAB_NOTIFY
             '
             TAB_NOTIFY.Controls.Add(TP_NOTIFY_MAIN)
             TAB_NOTIFY.Location = New System.Drawing.Point(4, 22)
             TAB_NOTIFY.Name = "TAB_NOTIFY"
-            TAB_NOTIFY.Size = New System.Drawing.Size(621, 399)
+            TAB_NOTIFY.Size = New System.Drawing.Size(621, 424)
             TAB_NOTIFY.TabIndex = 8
             TAB_NOTIFY.Text = "Notifications"
             '
@@ -1967,7 +2012,7 @@ Namespace Editors
             TP_NOTIFY_MAIN.RowStyles.Add(New System.Windows.Forms.RowStyle(System.Windows.Forms.SizeType.Absolute, 25.0!))
             TP_NOTIFY_MAIN.RowStyles.Add(New System.Windows.Forms.RowStyle(System.Windows.Forms.SizeType.Absolute, 25.0!))
             TP_NOTIFY_MAIN.RowStyles.Add(New System.Windows.Forms.RowStyle(System.Windows.Forms.SizeType.Percent, 100.0!))
-            TP_NOTIFY_MAIN.Size = New System.Drawing.Size(621, 399)
+            TP_NOTIFY_MAIN.Size = New System.Drawing.Size(621, 424)
             TP_NOTIFY_MAIN.TabIndex = 0
             '
             'TP_ENVIR
@@ -1990,24 +2035,24 @@ Namespace Editors
             TP_ENVIR.RowStyles.Add(New System.Windows.Forms.RowStyle(System.Windows.Forms.SizeType.Absolute, 28.0!))
             TP_ENVIR.RowStyles.Add(New System.Windows.Forms.RowStyle(System.Windows.Forms.SizeType.Absolute, 28.0!))
             TP_ENVIR.RowStyles.Add(New System.Windows.Forms.RowStyle(System.Windows.Forms.SizeType.Percent, 100.0!))
-            TP_ENVIR.Size = New System.Drawing.Size(621, 399)
+            TP_ENVIR.Size = New System.Drawing.Size(621, 424)
             TP_ENVIR.TabIndex = 0
             '
             'TXT_YTDLP
             '
-            ActionButton53.BackgroundImage = CType(resources.GetObject("ActionButton53.BackgroundImage"), System.Drawing.Image)
-            ActionButton53.Name = "Open"
-            ActionButton53.Tag = PersonalUtilities.Forms.Controls.Base.ActionButton.DefaultButtons.Open
-            ActionButton54.BackgroundImage = CType(resources.GetObject("ActionButton54.BackgroundImage"), System.Drawing.Image)
-            ActionButton54.Name = "Refresh"
-            ActionButton54.Tag = PersonalUtilities.Forms.Controls.Base.ActionButton.DefaultButtons.Refresh
-            ActionButton54.ToolTipText = "Try to find this program automatically (in SCrawler and/or system environment)"
-            ActionButton55.BackgroundImage = CType(resources.GetObject("ActionButton55.BackgroundImage"), System.Drawing.Image)
-            ActionButton55.Name = "Clear"
-            ActionButton55.Tag = PersonalUtilities.Forms.Controls.Base.ActionButton.DefaultButtons.Clear
-            Me.TXT_YTDLP.Buttons.Add(ActionButton53)
-            Me.TXT_YTDLP.Buttons.Add(ActionButton54)
-            Me.TXT_YTDLP.Buttons.Add(ActionButton55)
+            ActionButton15.BackgroundImage = CType(resources.GetObject("ActionButton15.BackgroundImage"), System.Drawing.Image)
+            ActionButton15.Name = "Open"
+            ActionButton15.Tag = PersonalUtilities.Forms.Controls.Base.ActionButton.DefaultButtons.Open
+            ActionButton16.BackgroundImage = CType(resources.GetObject("ActionButton16.BackgroundImage"), System.Drawing.Image)
+            ActionButton16.Name = "Refresh"
+            ActionButton16.Tag = PersonalUtilities.Forms.Controls.Base.ActionButton.DefaultButtons.Refresh
+            ActionButton16.ToolTipText = "Try to find this program automatically (in SCrawler and/or system environment)"
+            ActionButton17.BackgroundImage = CType(resources.GetObject("ActionButton17.BackgroundImage"), System.Drawing.Image)
+            ActionButton17.Name = "Clear"
+            ActionButton17.Tag = PersonalUtilities.Forms.Controls.Base.ActionButton.DefaultButtons.Clear
+            Me.TXT_YTDLP.Buttons.Add(ActionButton15)
+            Me.TXT_YTDLP.Buttons.Add(ActionButton16)
+            Me.TXT_YTDLP.Buttons.Add(ActionButton17)
             Me.TXT_YTDLP.CaptionText = "yt-dlp"
             Me.TXT_YTDLP.CaptionToolTipEnabled = True
             Me.TXT_YTDLP.CaptionToolTipText = "Path to yt-dlp.exe file"
@@ -2021,19 +2066,19 @@ Namespace Editors
             '
             'TXT_FFMPEG
             '
-            ActionButton56.BackgroundImage = CType(resources.GetObject("ActionButton56.BackgroundImage"), System.Drawing.Image)
-            ActionButton56.Name = "Open"
-            ActionButton56.Tag = PersonalUtilities.Forms.Controls.Base.ActionButton.DefaultButtons.Open
-            ActionButton57.BackgroundImage = CType(resources.GetObject("ActionButton57.BackgroundImage"), System.Drawing.Image)
-            ActionButton57.Name = "Refresh"
-            ActionButton57.Tag = PersonalUtilities.Forms.Controls.Base.ActionButton.DefaultButtons.Refresh
-            ActionButton57.ToolTipText = "Try to find this program automatically (in SCrawler and/or system environment)"
-            ActionButton58.BackgroundImage = CType(resources.GetObject("ActionButton58.BackgroundImage"), System.Drawing.Image)
-            ActionButton58.Name = "Clear"
-            ActionButton58.Tag = PersonalUtilities.Forms.Controls.Base.ActionButton.DefaultButtons.Clear
-            Me.TXT_FFMPEG.Buttons.Add(ActionButton56)
-            Me.TXT_FFMPEG.Buttons.Add(ActionButton57)
-            Me.TXT_FFMPEG.Buttons.Add(ActionButton58)
+            ActionButton18.BackgroundImage = CType(resources.GetObject("ActionButton18.BackgroundImage"), System.Drawing.Image)
+            ActionButton18.Name = "Open"
+            ActionButton18.Tag = PersonalUtilities.Forms.Controls.Base.ActionButton.DefaultButtons.Open
+            ActionButton19.BackgroundImage = CType(resources.GetObject("ActionButton19.BackgroundImage"), System.Drawing.Image)
+            ActionButton19.Name = "Refresh"
+            ActionButton19.Tag = PersonalUtilities.Forms.Controls.Base.ActionButton.DefaultButtons.Refresh
+            ActionButton19.ToolTipText = "Try to find this program automatically (in SCrawler and/or system environment)"
+            ActionButton20.BackgroundImage = CType(resources.GetObject("ActionButton20.BackgroundImage"), System.Drawing.Image)
+            ActionButton20.Name = "Clear"
+            ActionButton20.Tag = PersonalUtilities.Forms.Controls.Base.ActionButton.DefaultButtons.Clear
+            Me.TXT_FFMPEG.Buttons.Add(ActionButton18)
+            Me.TXT_FFMPEG.Buttons.Add(ActionButton19)
+            Me.TXT_FFMPEG.Buttons.Add(ActionButton20)
             Me.TXT_FFMPEG.CaptionText = "ffmpeg"
             Me.TXT_FFMPEG.CaptionToolTipEnabled = True
             Me.TXT_FFMPEG.CaptionToolTipText = "Path to ffmpeg.exe file"
@@ -2047,19 +2092,19 @@ Namespace Editors
             '
             'TXT_CURL
             '
-            ActionButton59.BackgroundImage = CType(resources.GetObject("ActionButton59.BackgroundImage"), System.Drawing.Image)
-            ActionButton59.Name = "Open"
-            ActionButton59.Tag = PersonalUtilities.Forms.Controls.Base.ActionButton.DefaultButtons.Open
-            ActionButton60.BackgroundImage = CType(resources.GetObject("ActionButton60.BackgroundImage"), System.Drawing.Image)
-            ActionButton60.Name = "Refresh"
-            ActionButton60.Tag = PersonalUtilities.Forms.Controls.Base.ActionButton.DefaultButtons.Refresh
-            ActionButton60.ToolTipText = "Try to find this program automatically (in SCrawler and/or system environment)"
-            ActionButton61.BackgroundImage = CType(resources.GetObject("ActionButton61.BackgroundImage"), System.Drawing.Image)
-            ActionButton61.Name = "Clear"
-            ActionButton61.Tag = PersonalUtilities.Forms.Controls.Base.ActionButton.DefaultButtons.Clear
-            Me.TXT_CURL.Buttons.Add(ActionButton59)
-            Me.TXT_CURL.Buttons.Add(ActionButton60)
-            Me.TXT_CURL.Buttons.Add(ActionButton61)
+            ActionButton21.BackgroundImage = CType(resources.GetObject("ActionButton21.BackgroundImage"), System.Drawing.Image)
+            ActionButton21.Name = "Open"
+            ActionButton21.Tag = PersonalUtilities.Forms.Controls.Base.ActionButton.DefaultButtons.Open
+            ActionButton22.BackgroundImage = CType(resources.GetObject("ActionButton22.BackgroundImage"), System.Drawing.Image)
+            ActionButton22.Name = "Refresh"
+            ActionButton22.Tag = PersonalUtilities.Forms.Controls.Base.ActionButton.DefaultButtons.Refresh
+            ActionButton22.ToolTipText = "Try to find this program automatically (in SCrawler and/or system environment)"
+            ActionButton23.BackgroundImage = CType(resources.GetObject("ActionButton23.BackgroundImage"), System.Drawing.Image)
+            ActionButton23.Name = "Clear"
+            ActionButton23.Tag = PersonalUtilities.Forms.Controls.Base.ActionButton.DefaultButtons.Clear
+            Me.TXT_CURL.Buttons.Add(ActionButton21)
+            Me.TXT_CURL.Buttons.Add(ActionButton22)
+            Me.TXT_CURL.Buttons.Add(ActionButton23)
             Me.TXT_CURL.CaptionText = "cURL"
             Me.TXT_CURL.CaptionToolTipEnabled = True
             Me.TXT_CURL.CaptionToolTipText = "Path to curl.exe file"
@@ -2073,19 +2118,19 @@ Namespace Editors
             '
             'TXT_GALLERYDL
             '
-            ActionButton62.BackgroundImage = CType(resources.GetObject("ActionButton62.BackgroundImage"), System.Drawing.Image)
-            ActionButton62.Name = "Open"
-            ActionButton62.Tag = PersonalUtilities.Forms.Controls.Base.ActionButton.DefaultButtons.Open
-            ActionButton63.BackgroundImage = CType(resources.GetObject("ActionButton63.BackgroundImage"), System.Drawing.Image)
-            ActionButton63.Name = "Refresh"
-            ActionButton63.Tag = PersonalUtilities.Forms.Controls.Base.ActionButton.DefaultButtons.Refresh
-            ActionButton63.ToolTipText = "Try to find this program automatically (in SCrawler and/or system environment)"
-            ActionButton64.BackgroundImage = CType(resources.GetObject("ActionButton64.BackgroundImage"), System.Drawing.Image)
-            ActionButton64.Name = "Clear"
-            ActionButton64.Tag = PersonalUtilities.Forms.Controls.Base.ActionButton.DefaultButtons.Clear
-            Me.TXT_GALLERYDL.Buttons.Add(ActionButton62)
-            Me.TXT_GALLERYDL.Buttons.Add(ActionButton63)
-            Me.TXT_GALLERYDL.Buttons.Add(ActionButton64)
+            ActionButton24.BackgroundImage = CType(resources.GetObject("ActionButton24.BackgroundImage"), System.Drawing.Image)
+            ActionButton24.Name = "Open"
+            ActionButton24.Tag = PersonalUtilities.Forms.Controls.Base.ActionButton.DefaultButtons.Open
+            ActionButton25.BackgroundImage = CType(resources.GetObject("ActionButton25.BackgroundImage"), System.Drawing.Image)
+            ActionButton25.Name = "Refresh"
+            ActionButton25.Tag = PersonalUtilities.Forms.Controls.Base.ActionButton.DefaultButtons.Refresh
+            ActionButton25.ToolTipText = "Try to find this program automatically (in SCrawler and/or system environment)"
+            ActionButton26.BackgroundImage = CType(resources.GetObject("ActionButton26.BackgroundImage"), System.Drawing.Image)
+            ActionButton26.Name = "Clear"
+            ActionButton26.Tag = PersonalUtilities.Forms.Controls.Base.ActionButton.DefaultButtons.Clear
+            Me.TXT_GALLERYDL.Buttons.Add(ActionButton24)
+            Me.TXT_GALLERYDL.Buttons.Add(ActionButton25)
+            Me.TXT_GALLERYDL.Buttons.Add(ActionButton26)
             Me.TXT_GALLERYDL.CaptionText = "gallery-dl"
             Me.TXT_GALLERYDL.CaptionToolTipText = "Path to gallery-dl.exe file"
             Me.TXT_GALLERYDL.CaptionWidth = 80.0R
@@ -2098,14 +2143,14 @@ Namespace Editors
             '
             'TXT_CMD_ENCODING
             '
-            ActionButton65.BackgroundImage = CType(resources.GetObject("ActionButton65.BackgroundImage"), System.Drawing.Image)
-            ActionButton65.Name = "Refresh"
-            ActionButton65.Tag = PersonalUtilities.Forms.Controls.Base.ActionButton.DefaultButtons.Refresh
-            ActionButton66.BackgroundImage = CType(resources.GetObject("ActionButton66.BackgroundImage"), System.Drawing.Image)
-            ActionButton66.Name = "Clear"
-            ActionButton66.Tag = PersonalUtilities.Forms.Controls.Base.ActionButton.DefaultButtons.Clear
-            Me.TXT_CMD_ENCODING.Buttons.Add(ActionButton65)
-            Me.TXT_CMD_ENCODING.Buttons.Add(ActionButton66)
+            ActionButton27.BackgroundImage = CType(resources.GetObject("ActionButton27.BackgroundImage"), System.Drawing.Image)
+            ActionButton27.Name = "Refresh"
+            ActionButton27.Tag = PersonalUtilities.Forms.Controls.Base.ActionButton.DefaultButtons.Refresh
+            ActionButton28.BackgroundImage = CType(resources.GetObject("ActionButton28.BackgroundImage"), System.Drawing.Image)
+            ActionButton28.Name = "Clear"
+            ActionButton28.Tag = PersonalUtilities.Forms.Controls.Base.ActionButton.DefaultButtons.Clear
+            Me.TXT_CMD_ENCODING.Buttons.Add(ActionButton27)
+            Me.TXT_CMD_ENCODING.Buttons.Add(ActionButton28)
             Me.TXT_CMD_ENCODING.CaptionText = "CMD Encoding"
             Me.TXT_CMD_ENCODING.CaptionToolTipEnabled = True
             Me.TXT_CMD_ENCODING.CaptionToolTipText = "Command line encoding"
@@ -2121,7 +2166,7 @@ Namespace Editors
             TAB_STD.Controls.Add(TP_STD)
             TAB_STD.Location = New System.Drawing.Point(4, 22)
             TAB_STD.Name = "TAB_STD"
-            TAB_STD.Size = New System.Drawing.Size(621, 399)
+            TAB_STD.Size = New System.Drawing.Size(621, 424)
             TAB_STD.TabIndex = 10
             TAB_STD.Text = "Downloader"
             '
@@ -2163,7 +2208,7 @@ Namespace Editors
             TP_STD.RowStyles.Add(New System.Windows.Forms.RowStyle(System.Windows.Forms.SizeType.Absolute, 25.0!))
             TP_STD.RowStyles.Add(New System.Windows.Forms.RowStyle(System.Windows.Forms.SizeType.Absolute, 28.0!))
             TP_STD.RowStyles.Add(New System.Windows.Forms.RowStyle(System.Windows.Forms.SizeType.Percent, 100.0!))
-            TP_STD.Size = New System.Drawing.Size(621, 399)
+            TP_STD.Size = New System.Drawing.Size(621, 424)
             TP_STD.TabIndex = 0
             '
             'TXT_STD_MAX_JOBS_COUNT
@@ -2208,24 +2253,24 @@ Namespace Editors
             '
             'CMB_STD_OPEN_DBL
             '
-            ActionButton67.BackgroundImage = CType(resources.GetObject("ActionButton67.BackgroundImage"), System.Drawing.Image)
-            ActionButton67.Name = "ArrowDown"
-            ActionButton67.Tag = PersonalUtilities.Forms.Controls.Base.ActionButton.DefaultButtons.ArrowDown
-            Me.CMB_STD_OPEN_DBL.Buttons.Add(ActionButton67)
+            ActionButton29.BackgroundImage = CType(resources.GetObject("ActionButton29.BackgroundImage"), System.Drawing.Image)
+            ActionButton29.Name = "ArrowDown"
+            ActionButton29.Tag = PersonalUtilities.Forms.Controls.Base.ActionButton.DefaultButtons.ArrowDown
+            Me.CMB_STD_OPEN_DBL.Buttons.Add(ActionButton29)
             Me.CMB_STD_OPEN_DBL.CaptionMode = PersonalUtilities.Forms.Controls.Base.ICaptionControl.Modes.Label
             Me.CMB_STD_OPEN_DBL.CaptionText = "DoubleClick opens"
             Me.CMB_STD_OPEN_DBL.CaptionToolTipEnabled = True
             Me.CMB_STD_OPEN_DBL.CaptionToolTipText = "What do you want to open when you double click on an item"
             Me.CMB_STD_OPEN_DBL.CaptionVisible = True
-            ListColumn3.DisplayMember = True
-            ListColumn3.Name = "STD_CMB_COL_TEXT"
-            ListColumn3.Text = "Text"
-            ListColumn4.Name = "STD_CMB_COL_VALUE"
-            ListColumn4.Text = "Value"
-            ListColumn4.ValueMember = True
-            ListColumn4.Visible = False
-            Me.CMB_STD_OPEN_DBL.Columns.Add(ListColumn3)
-            Me.CMB_STD_OPEN_DBL.Columns.Add(ListColumn4)
+            ListColumn1.DisplayMember = True
+            ListColumn1.Name = "STD_CMB_COL_TEXT"
+            ListColumn1.Text = "Text"
+            ListColumn2.Name = "STD_CMB_COL_VALUE"
+            ListColumn2.Text = "Value"
+            ListColumn2.ValueMember = True
+            ListColumn2.Visible = False
+            Me.CMB_STD_OPEN_DBL.Columns.Add(ListColumn1)
+            Me.CMB_STD_OPEN_DBL.Columns.Add(ListColumn2)
             Me.CMB_STD_OPEN_DBL.Dock = System.Windows.Forms.DockStyle.Fill
             Me.CMB_STD_OPEN_DBL.Location = New System.Drawing.Point(4, 85)
             Me.CMB_STD_OPEN_DBL.Name = "CMB_STD_OPEN_DBL"
@@ -2262,7 +2307,7 @@ Namespace Editors
             TAB_DESIGN.Controls.Add(TP_DESIGN)
             TAB_DESIGN.Location = New System.Drawing.Point(4, 22)
             TAB_DESIGN.Name = "TAB_DESIGN"
-            TAB_DESIGN.Size = New System.Drawing.Size(621, 399)
+            TAB_DESIGN.Size = New System.Drawing.Size(621, 424)
             TAB_DESIGN.TabIndex = 11
             TAB_DESIGN.Text = "Design"
             '
@@ -2288,15 +2333,15 @@ Namespace Editors
             TP_DESIGN.RowStyles.Add(New System.Windows.Forms.RowStyle(System.Windows.Forms.SizeType.Absolute, 25.0!))
             TP_DESIGN.RowStyles.Add(New System.Windows.Forms.RowStyle(System.Windows.Forms.SizeType.Absolute, 25.0!))
             TP_DESIGN.RowStyles.Add(New System.Windows.Forms.RowStyle(System.Windows.Forms.SizeType.Percent, 100.0!))
-            TP_DESIGN.Size = New System.Drawing.Size(621, 399)
+            TP_DESIGN.Size = New System.Drawing.Size(621, 424)
             TP_DESIGN.TabIndex = 0
             '
             'TXT_PRG_TITLE
             '
-            ActionButton68.BackgroundImage = CType(resources.GetObject("ActionButton68.BackgroundImage"), System.Drawing.Image)
-            ActionButton68.Name = "Clear"
-            ActionButton68.Tag = PersonalUtilities.Forms.Controls.Base.ActionButton.DefaultButtons.Clear
-            Me.TXT_PRG_TITLE.Buttons.Add(ActionButton68)
+            ActionButton30.BackgroundImage = CType(resources.GetObject("ActionButton30.BackgroundImage"), System.Drawing.Image)
+            ActionButton30.Name = "Clear"
+            ActionButton30.Tag = PersonalUtilities.Forms.Controls.Base.ActionButton.DefaultButtons.Clear
+            Me.TXT_PRG_TITLE.Buttons.Add(ActionButton30)
             Me.TXT_PRG_TITLE.CaptionText = "Program title"
             Me.TXT_PRG_TITLE.CaptionToolTipEnabled = True
             Me.TXT_PRG_TITLE.CaptionToolTipText = "Change the title of the main window if you need to"
@@ -2308,10 +2353,10 @@ Namespace Editors
             '
             'TXT_PRG_DESCR
             '
-            ActionButton69.BackgroundImage = CType(resources.GetObject("ActionButton69.BackgroundImage"), System.Drawing.Image)
-            ActionButton69.Name = "Clear"
-            ActionButton69.Tag = PersonalUtilities.Forms.Controls.Base.ActionButton.DefaultButtons.Clear
-            Me.TXT_PRG_DESCR.Buttons.Add(ActionButton69)
+            ActionButton31.BackgroundImage = CType(resources.GetObject("ActionButton31.BackgroundImage"), System.Drawing.Image)
+            ActionButton31.Name = "Clear"
+            ActionButton31.Tag = PersonalUtilities.Forms.Controls.Base.ActionButton.DefaultButtons.Clear
+            Me.TXT_PRG_DESCR.Buttons.Add(ActionButton31)
             Me.TXT_PRG_DESCR.CaptionText = "Program description"
             Me.TXT_PRG_DESCR.CaptionToolTipEnabled = True
             Me.TXT_PRG_DESCR.CaptionToolTipText = "Add some additional info to the program info if you need"
@@ -2323,14 +2368,14 @@ Namespace Editors
             '
             'TXT_USER_LIST_IMAGE
             '
-            ActionButton70.BackgroundImage = CType(resources.GetObject("ActionButton70.BackgroundImage"), System.Drawing.Image)
-            ActionButton70.Name = "Open"
-            ActionButton70.Tag = PersonalUtilities.Forms.Controls.Base.ActionButton.DefaultButtons.Open
-            ActionButton71.BackgroundImage = CType(resources.GetObject("ActionButton71.BackgroundImage"), System.Drawing.Image)
-            ActionButton71.Name = "Clear"
-            ActionButton71.Tag = PersonalUtilities.Forms.Controls.Base.ActionButton.DefaultButtons.Clear
-            Me.TXT_USER_LIST_IMAGE.Buttons.Add(ActionButton70)
-            Me.TXT_USER_LIST_IMAGE.Buttons.Add(ActionButton71)
+            ActionButton32.BackgroundImage = CType(resources.GetObject("ActionButton32.BackgroundImage"), System.Drawing.Image)
+            ActionButton32.Name = "Open"
+            ActionButton32.Tag = PersonalUtilities.Forms.Controls.Base.ActionButton.DefaultButtons.Open
+            ActionButton33.BackgroundImage = CType(resources.GetObject("ActionButton33.BackgroundImage"), System.Drawing.Image)
+            ActionButton33.Name = "Clear"
+            ActionButton33.Tag = PersonalUtilities.Forms.Controls.Base.ActionButton.DefaultButtons.Clear
+            Me.TXT_USER_LIST_IMAGE.Buttons.Add(ActionButton32)
+            Me.TXT_USER_LIST_IMAGE.Buttons.Add(ActionButton33)
             Me.TXT_USER_LIST_IMAGE.CaptionText = "Userlist image"
             Me.TXT_USER_LIST_IMAGE.CaptionToolTipEnabled = True
             Me.TXT_USER_LIST_IMAGE.CaptionToolTipText = "Background image for user list"
@@ -2399,15 +2444,15 @@ Namespace Editors
             TP_HEADERS_DEF.RowStyles.Add(New System.Windows.Forms.RowStyle(System.Windows.Forms.SizeType.Absolute, 28.0!))
             TP_HEADERS_DEF.RowStyles.Add(New System.Windows.Forms.RowStyle(System.Windows.Forms.SizeType.Percent, 100.0!))
             TP_HEADERS_DEF.RowStyles.Add(New System.Windows.Forms.RowStyle(System.Windows.Forms.SizeType.Absolute, 20.0!))
-            TP_HEADERS_DEF.Size = New System.Drawing.Size(621, 399)
+            TP_HEADERS_DEF.Size = New System.Drawing.Size(621, 424)
             TP_HEADERS_DEF.TabIndex = 0
             '
             'TXT_H_DEF_UserAgent
             '
-            ActionButton72.BackgroundImage = CType(resources.GetObject("ActionButton72.BackgroundImage"), System.Drawing.Image)
-            ActionButton72.Name = "Clear"
-            ActionButton72.Tag = PersonalUtilities.Forms.Controls.Base.ActionButton.DefaultButtons.Clear
-            Me.TXT_H_DEF_UserAgent.Buttons.Add(ActionButton72)
+            ActionButton34.BackgroundImage = CType(resources.GetObject("ActionButton34.BackgroundImage"), System.Drawing.Image)
+            ActionButton34.Name = "Clear"
+            ActionButton34.Tag = PersonalUtilities.Forms.Controls.Base.ActionButton.DefaultButtons.Clear
+            Me.TXT_H_DEF_UserAgent.Buttons.Add(ActionButton34)
             Me.TXT_H_DEF_UserAgent.CaptionText = "UserAgent"
             Me.TXT_H_DEF_UserAgent.CaptionWidth = 140.0R
             Me.TXT_H_DEF_UserAgent.Dock = System.Windows.Forms.DockStyle.Fill
@@ -2418,10 +2463,10 @@ Namespace Editors
             '
             'TXT_H_DEF_sec_ch_ua
             '
-            ActionButton73.BackgroundImage = CType(resources.GetObject("ActionButton73.BackgroundImage"), System.Drawing.Image)
-            ActionButton73.Name = "Clear"
-            ActionButton73.Tag = PersonalUtilities.Forms.Controls.Base.ActionButton.DefaultButtons.Clear
-            Me.TXT_H_DEF_sec_ch_ua.Buttons.Add(ActionButton73)
+            ActionButton35.BackgroundImage = CType(resources.GetObject("ActionButton35.BackgroundImage"), System.Drawing.Image)
+            ActionButton35.Name = "Clear"
+            ActionButton35.Tag = PersonalUtilities.Forms.Controls.Base.ActionButton.DefaultButtons.Clear
+            Me.TXT_H_DEF_sec_ch_ua.Buttons.Add(ActionButton35)
             Me.TXT_H_DEF_sec_ch_ua.CaptionText = "sec-ch-ua"
             Me.TXT_H_DEF_sec_ch_ua.CaptionWidth = 140.0R
             Me.TXT_H_DEF_sec_ch_ua.Dock = System.Windows.Forms.DockStyle.Fill
@@ -2432,10 +2477,10 @@ Namespace Editors
             '
             'TXT_H_DEF_sec_ch_ua_full_version_list
             '
-            ActionButton74.BackgroundImage = CType(resources.GetObject("ActionButton74.BackgroundImage"), System.Drawing.Image)
-            ActionButton74.Name = "Clear"
-            ActionButton74.Tag = PersonalUtilities.Forms.Controls.Base.ActionButton.DefaultButtons.Clear
-            Me.TXT_H_DEF_sec_ch_ua_full_version_list.Buttons.Add(ActionButton74)
+            ActionButton36.BackgroundImage = CType(resources.GetObject("ActionButton36.BackgroundImage"), System.Drawing.Image)
+            ActionButton36.Name = "Clear"
+            ActionButton36.Tag = PersonalUtilities.Forms.Controls.Base.ActionButton.DefaultButtons.Clear
+            Me.TXT_H_DEF_sec_ch_ua_full_version_list.Buttons.Add(ActionButton36)
             Me.TXT_H_DEF_sec_ch_ua_full_version_list.CaptionText = "sec-ch-ua-full-version-list"
             Me.TXT_H_DEF_sec_ch_ua_full_version_list.CaptionWidth = 140.0R
             Me.TXT_H_DEF_sec_ch_ua_full_version_list.Dock = System.Windows.Forms.DockStyle.Fill
@@ -2446,10 +2491,10 @@ Namespace Editors
             '
             'TXT_H_DEF_sec_ch_ua_platform
             '
-            ActionButton75.BackgroundImage = CType(resources.GetObject("ActionButton75.BackgroundImage"), System.Drawing.Image)
-            ActionButton75.Name = "Clear"
-            ActionButton75.Tag = PersonalUtilities.Forms.Controls.Base.ActionButton.DefaultButtons.Clear
-            Me.TXT_H_DEF_sec_ch_ua_platform.Buttons.Add(ActionButton75)
+            ActionButton37.BackgroundImage = CType(resources.GetObject("ActionButton37.BackgroundImage"), System.Drawing.Image)
+            ActionButton37.Name = "Clear"
+            ActionButton37.Tag = PersonalUtilities.Forms.Controls.Base.ActionButton.DefaultButtons.Clear
+            Me.TXT_H_DEF_sec_ch_ua_platform.Buttons.Add(ActionButton37)
             Me.TXT_H_DEF_sec_ch_ua_platform.CaptionText = "sec-ch-ua-platform"
             Me.TXT_H_DEF_sec_ch_ua_platform.CaptionWidth = 140.0R
             Me.TXT_H_DEF_sec_ch_ua_platform.Dock = System.Windows.Forms.DockStyle.Fill
@@ -2460,10 +2505,10 @@ Namespace Editors
             '
             'TXT_H_DEF_sec_ch_ua_platform_version
             '
-            ActionButton76.BackgroundImage = CType(resources.GetObject("ActionButton76.BackgroundImage"), System.Drawing.Image)
-            ActionButton76.Name = "Clear"
-            ActionButton76.Tag = PersonalUtilities.Forms.Controls.Base.ActionButton.DefaultButtons.Clear
-            Me.TXT_H_DEF_sec_ch_ua_platform_version.Buttons.Add(ActionButton76)
+            ActionButton38.BackgroundImage = CType(resources.GetObject("ActionButton38.BackgroundImage"), System.Drawing.Image)
+            ActionButton38.Name = "Clear"
+            ActionButton38.Tag = PersonalUtilities.Forms.Controls.Base.ActionButton.DefaultButtons.Clear
+            Me.TXT_H_DEF_sec_ch_ua_platform_version.Buttons.Add(ActionButton38)
             Me.TXT_H_DEF_sec_ch_ua_platform_version.CaptionText = "sec-ch-ua-platform-version"
             Me.TXT_H_DEF_sec_ch_ua_platform_version.CaptionWidth = 140.0R
             Me.TXT_H_DEF_sec_ch_ua_platform_version.Dock = System.Windows.Forms.DockStyle.Fill
@@ -2477,7 +2522,7 @@ Namespace Editors
             TAB_HEADERS.Controls.Add(TP_HEADERS_DEF)
             TAB_HEADERS.Location = New System.Drawing.Point(4, 22)
             TAB_HEADERS.Name = "TAB_HEADERS"
-            TAB_HEADERS.Size = New System.Drawing.Size(621, 399)
+            TAB_HEADERS.Size = New System.Drawing.Size(621, 424)
             TAB_HEADERS.TabIndex = 12
             TAB_HEADERS.Text = "Headers"
             '
@@ -2498,7 +2543,7 @@ Namespace Editors
             Me.TAB_MAIN.Location = New System.Drawing.Point(0, 0)
             Me.TAB_MAIN.Name = "TAB_MAIN"
             Me.TAB_MAIN.SelectedIndex = 0
-            Me.TAB_MAIN.Size = New System.Drawing.Size(629, 425)
+            Me.TAB_MAIN.Size = New System.Drawing.Size(629, 450)
             Me.TAB_MAIN.TabIndex = 1
             '
             'TAB_ENVIR
@@ -2506,7 +2551,7 @@ Namespace Editors
             Me.TAB_ENVIR.Controls.Add(TP_ENVIR)
             Me.TAB_ENVIR.Location = New System.Drawing.Point(4, 22)
             Me.TAB_ENVIR.Name = "TAB_ENVIR"
-            Me.TAB_ENVIR.Size = New System.Drawing.Size(621, 399)
+            Me.TAB_ENVIR.Size = New System.Drawing.Size(621, 424)
             Me.TAB_ENVIR.TabIndex = 9
             Me.TAB_ENVIR.Text = "Environment"
             '
@@ -2516,7 +2561,7 @@ Namespace Editors
             'CONTAINER_MAIN.ContentPanel
             '
             Me.CONTAINER_MAIN.ContentPanel.Controls.Add(Me.TAB_MAIN)
-            Me.CONTAINER_MAIN.ContentPanel.Size = New System.Drawing.Size(629, 425)
+            Me.CONTAINER_MAIN.ContentPanel.Size = New System.Drawing.Size(629, 450)
             Me.CONTAINER_MAIN.Dock = System.Windows.Forms.DockStyle.Fill
             Me.CONTAINER_MAIN.LeftToolStripPanelVisible = False
             Me.CONTAINER_MAIN.Location = New System.Drawing.Point(0, 0)
@@ -2526,47 +2571,18 @@ Namespace Editors
             Me.CONTAINER_MAIN.TabIndex = 0
             Me.CONTAINER_MAIN.TopToolStripPanelVisible = False
             '
-            'TP_FEED_SPEC_SEARCH
+            'CH_FEED_OPEN_CTRLF
             '
-            TP_FEED_SPEC_SEARCH.ColumnCount = 2
-            TP_FEED_SPEC_SEARCH.ColumnStyles.Add(New System.Windows.Forms.ColumnStyle(System.Windows.Forms.SizeType.Percent, 50.0!))
-            TP_FEED_SPEC_SEARCH.ColumnStyles.Add(New System.Windows.Forms.ColumnStyle(System.Windows.Forms.SizeType.Percent, 50.0!))
-            TP_FEED_SPEC_SEARCH.Controls.Add(Me.CH_FEED_SPEC_SEARCH, 0, 0)
-            TP_FEED_SPEC_SEARCH.Controls.Add(Me.CH_FEED_SPEC_SEARCH_DEEP, 1, 0)
-            TP_FEED_SPEC_SEARCH.Dock = System.Windows.Forms.DockStyle.Fill
-            TP_FEED_SPEC_SEARCH.Location = New System.Drawing.Point(1, 374)
-            TP_FEED_SPEC_SEARCH.Margin = New System.Windows.Forms.Padding(0)
-            TP_FEED_SPEC_SEARCH.Name = "TP_FEED_SPEC_SEARCH"
-            TP_FEED_SPEC_SEARCH.RowCount = 1
-            TP_FEED_SPEC_SEARCH.RowStyles.Add(New System.Windows.Forms.RowStyle(System.Windows.Forms.SizeType.Percent, 100.0!))
-            TP_FEED_SPEC_SEARCH.RowStyles.Add(New System.Windows.Forms.RowStyle(System.Windows.Forms.SizeType.Absolute, 20.0!))
-            TP_FEED_SPEC_SEARCH.Size = New System.Drawing.Size(619, 25)
-            TP_FEED_SPEC_SEARCH.TabIndex = 14
-            '
-            'CH_FEED_SPEC_SEARCH
-            '
-            Me.CH_FEED_SPEC_SEARCH.AutoSize = True
-            Me.CH_FEED_SPEC_SEARCH.Dock = System.Windows.Forms.DockStyle.Fill
-            Me.CH_FEED_SPEC_SEARCH.Location = New System.Drawing.Point(3, 3)
-            Me.CH_FEED_SPEC_SEARCH.Name = "CH_FEED_SPEC_SEARCH"
-            Me.CH_FEED_SPEC_SEARCH.Size = New System.Drawing.Size(303, 19)
-            Me.CH_FEED_SPEC_SEARCH.TabIndex = 0
-            Me.CH_FEED_SPEC_SEARCH.Text = "Search missing files (special feeds)"
-            TT_MAIN.SetToolTip(Me.CH_FEED_SPEC_SEARCH, "Search for missing file in the entire user folder")
-            Me.CH_FEED_SPEC_SEARCH.UseVisualStyleBackColor = True
-            '
-            'CH_FEED_SPEC_SEARCH_DEEP
-            '
-            Me.CH_FEED_SPEC_SEARCH_DEEP.AutoSize = True
-            Me.CH_FEED_SPEC_SEARCH_DEEP.Dock = System.Windows.Forms.DockStyle.Fill
-            Me.CH_FEED_SPEC_SEARCH_DEEP.Location = New System.Drawing.Point(312, 3)
-            Me.CH_FEED_SPEC_SEARCH_DEEP.Name = "CH_FEED_SPEC_SEARCH_DEEP"
-            Me.CH_FEED_SPEC_SEARCH_DEEP.Size = New System.Drawing.Size(304, 19)
-            Me.CH_FEED_SPEC_SEARCH_DEEP.TabIndex = 1
-            Me.CH_FEED_SPEC_SEARCH_DEEP.Text = "Search missing files (special feeds): deep search"
-            TT_MAIN.SetToolTip(Me.CH_FEED_SPEC_SEARCH_DEEP, "Deep search means that the missing file will be searched in other users' location" &
-        "s as well.")
-            Me.CH_FEED_SPEC_SEARCH_DEEP.UseVisualStyleBackColor = True
+            Me.CH_FEED_OPEN_CTRLF.AutoSize = True
+            Me.CH_FEED_OPEN_CTRLF.Dock = System.Windows.Forms.DockStyle.Fill
+            Me.CH_FEED_OPEN_CTRLF.Location = New System.Drawing.Point(4, 299)
+            Me.CH_FEED_OPEN_CTRLF.Name = "CH_FEED_OPEN_CTRLF"
+            Me.CH_FEED_OPEN_CTRLF.Size = New System.Drawing.Size(613, 19)
+            Me.CH_FEED_OPEN_CTRLF.TabIndex = 11
+            Me.CH_FEED_OPEN_CTRLF.Text = "Use 'Ctrl+F' to open the Feed"
+            TT_MAIN.SetToolTip(Me.CH_FEED_OPEN_CTRLF, "If checked, 'Ctrl+F' will be used to open the Feed. Otherwise, 'Alt+F' will be us" &
+        "ed.")
+            Me.CH_FEED_OPEN_CTRLF.UseVisualStyleBackColor = True
             '
             'GlobalSettingsForm
             '
@@ -2641,6 +2657,8 @@ Namespace Editors
             TP_FEED_SES.ResumeLayout(False)
             CType(Me.NUM_FEED_STORE_SESSION_DATA, System.ComponentModel.ISupportInitialize).EndInit()
             CType(Me.NUM_FEED_SES_CURR_LOAD_LAST, System.ComponentModel.ISupportInitialize).EndInit()
+            TP_FEED_SPEC_SEARCH.ResumeLayout(False)
+            TP_FEED_SPEC_SEARCH.PerformLayout()
             TAB_NOTIFY.ResumeLayout(False)
             TP_NOTIFY_MAIN.ResumeLayout(False)
             TP_NOTIFY_MAIN.PerformLayout()
@@ -2672,8 +2690,6 @@ Namespace Editors
             Me.CONTAINER_MAIN.ContentPanel.ResumeLayout(False)
             Me.CONTAINER_MAIN.ResumeLayout(False)
             Me.CONTAINER_MAIN.PerformLayout()
-            TP_FEED_SPEC_SEARCH.ResumeLayout(False)
-            TP_FEED_SPEC_SEARCH.PerformLayout()
             Me.ResumeLayout(False)
 
         End Sub
@@ -2791,5 +2807,6 @@ Namespace Editors
         Private WithEvents CH_SCHEDULER_SCRIPT_EX_MANUAL As CheckBox
         Private WithEvents CH_FEED_SPEC_SEARCH As CheckBox
         Private WithEvents CH_FEED_SPEC_SEARCH_DEEP As CheckBox
+        Private WithEvents CH_FEED_OPEN_CTRLF As CheckBox
     End Class
 End Namespace

SCrawler/Editors/GlobalSettingsForm.resx

@@ -120,11 +120,8 @@
   <metadata name="TP_BASIS.GenerateMember" type="System.Boolean, mscorlib, Version=4.0.0.0, Culture=neutral, PublicKeyToken=b77a5c561934e089">
     <value>False</value>
   </metadata>
-  <metadata name="TP_IMAGES.GenerateMember" type="System.Boolean, mscorlib, Version=4.0.0.0, Culture=neutral, PublicKeyToken=b77a5c561934e089">
-    <value>False</value>
-  </metadata>
   <assembly alias="System.Drawing" name="System.Drawing, Version=4.0.0.0, Culture=neutral, PublicKeyToken=b03f5f7f11d50a3a" />
-  <data name="ActionButton39.BackgroundImage" type="System.Drawing.Bitmap, System.Drawing" mimetype="application/x-microsoft.net.object.bytearray.base64">
+  <data name="ActionButton1.BackgroundImage" type="System.Drawing.Bitmap, System.Drawing" mimetype="application/x-microsoft.net.object.bytearray.base64">
     <value>
         iVBORw0KGgoAAAANSUhEUgAAABAAAAAQCAYAAAAf8/9hAAAABGdBTUEAALGPC/xhBQAAAAlwSFlzAAAO
         wwAADsMBx2+oZAAAAR5JREFUOE+VkjFqwzAUhn2D9iShRyi+QhYbGujg3ZATZPKYdC6FQhPwlAMkg3dP
@@ -135,7 +132,7 @@
         cMaRN0UdBBkAAAAASUVORK5CYII=
 </value>
   </data>
-  <data name="ActionButton40.BackgroundImage" type="System.Drawing.Bitmap, System.Drawing" mimetype="application/x-microsoft.net.object.bytearray.base64">
+  <data name="ActionButton2.BackgroundImage" type="System.Drawing.Bitmap, System.Drawing" mimetype="application/x-microsoft.net.object.bytearray.base64">
     <value>
         iVBORw0KGgoAAAANSUhEUgAAABAAAAAQCAYAAAAf8/9hAAAABGdBTUEAALGPC/xhBQAAAAlwSFlzAAAO
         xAAADsQBlSsOGwAAAIZJREFUOE+1j10KwCAMgz2b755xl/IsvnaL2K20UfbDAmEako+ZROSTafjE12Go
@@ -146,7 +143,7 @@
   <metadata name="TP_IMAGES.GenerateMember" type="System.Boolean, mscorlib, Version=4.0.0.0, Culture=neutral, PublicKeyToken=b77a5c561934e089">
     <value>False</value>
   </metadata>
-  <data name="ActionButton41.BackgroundImage" type="System.Drawing.Bitmap, System.Drawing" mimetype="application/x-microsoft.net.object.bytearray.base64">
+  <data name="ActionButton3.BackgroundImage" type="System.Drawing.Bitmap, System.Drawing" mimetype="application/x-microsoft.net.object.bytearray.base64">
     <value>
         iVBORw0KGgoAAAANSUhEUgAAABAAAAAQCAYAAAAf8/9hAAAABGdBTUEAALGPC/xhBQAAAAlwSFlzAAAO
         xAAADsQBlSsOGwAAAIZJREFUOE+1j10KwCAMgz2b755xl/IsvnaL2K20UfbDAmEako+ZROSTafjE12Go
@@ -154,7 +151,7 @@
         AFuc5QFgn6ClHh5iOQVAKNixyucB8NY0vG9JOzzyhrdq5IRgAAAAAElFTkSuQmCC
 </value>
   </data>
-  <data name="ActionButton42.BackgroundImage" type="System.Drawing.Bitmap, System.Drawing" mimetype="application/x-microsoft.net.object.bytearray.base64">
+  <data name="ActionButton4.BackgroundImage" type="System.Drawing.Bitmap, System.Drawing" mimetype="application/x-microsoft.net.object.bytearray.base64">
     <value>
         iVBORw0KGgoAAAANSUhEUgAAABAAAAAQCAYAAAAf8/9hAAAABGdBTUEAALGOfPtRkwAAACBjSFJNAAB6
         JQAAgIMAAPn/AACA6QAAdTAAAOpgAAA6mAAAF2+SX8VGAAAACXBIWXMAAAsTAAALEwEAmpwYAAACOElE
@@ -170,7 +167,7 @@
         VnR1MIwhwMTCyqEQ37qEmZVDFF0OE/9nAACtFF4Ey6OP+wAAAABJRU5ErkJggg==
 </value>
   </data>
-  <data name="ActionButton43.BackgroundImage" type="System.Drawing.Bitmap, System.Drawing" mimetype="application/x-microsoft.net.object.bytearray.base64">
+  <data name="ActionButton5.BackgroundImage" type="System.Drawing.Bitmap, System.Drawing" mimetype="application/x-microsoft.net.object.bytearray.base64">
     <value>
         iVBORw0KGgoAAAANSUhEUgAAABAAAAAQCAYAAAAf8/9hAAAABGdBTUEAALGOfPtRkwAAACBjSFJNAAB6
         JQAAgIMAAPn/AACA6QAAdTAAAOpgAAA6mAAAF2+SX8VGAAAACXBIWXMAAAsTAAALEwEAmpwYAAACOElE
@@ -186,7 +183,7 @@
         VnR1MIwhwMTCyqEQ37qEmZVDFF0OE/9nAACtFF4Ey6OP+wAAAABJRU5ErkJggg==
 </value>
   </data>
-  <data name="ActionButton44.BackgroundImage" type="System.Drawing.Bitmap, System.Drawing" mimetype="application/x-microsoft.net.object.bytearray.base64">
+  <data name="ActionButton6.BackgroundImage" type="System.Drawing.Bitmap, System.Drawing" mimetype="application/x-microsoft.net.object.bytearray.base64">
     <value>
         iVBORw0KGgoAAAANSUhEUgAAABAAAAAQCAYAAAAf8/9hAAAABGdBTUEAALGPC/xhBQAAAAlwSFlzAAAO
         xAAADsQBlSsOGwAAAIZJREFUOE+1j10KwCAMgz2b755xl/IsvnaL2K20UfbDAmEako+ZROSTafjE12Go
@@ -194,7 +191,7 @@
         AFuc5QFgn6ClHh5iOQVAKNixyucB8NY0vG9JOzzyhrdq5IRgAAAAAElFTkSuQmCC
 </value>
   </data>
-  <data name="ActionButton45.BackgroundImage" type="System.Drawing.Bitmap, System.Drawing" mimetype="application/x-microsoft.net.object.bytearray.base64">
+  <data name="ActionButton7.BackgroundImage" type="System.Drawing.Bitmap, System.Drawing" mimetype="application/x-microsoft.net.object.bytearray.base64">
     <value>
         iVBORw0KGgoAAAANSUhEUgAAABAAAAAQCAYAAAAf8/9hAAAABGdBTUEAALGOfPtRkwAAACBjSFJNAAB6
         JQAAgIMAAPn/AACA6QAAdTAAAOpgAAA6mAAAF2+SX8VGAAAACXBIWXMAAAsTAAALEwEAmpwYAAACOElE
@@ -210,7 +207,7 @@
         VnR1MIwhwMTCyqEQ37qEmZVDFF0OE/9nAACtFF4Ey6OP+wAAAABJRU5ErkJggg==
 </value>
   </data>
-  <data name="ActionButton46.BackgroundImage" type="System.Drawing.Bitmap, System.Drawing" mimetype="application/x-microsoft.net.object.bytearray.base64">
+  <data name="ActionButton8.BackgroundImage" type="System.Drawing.Bitmap, System.Drawing" mimetype="application/x-microsoft.net.object.bytearray.base64">
     <value>
         iVBORw0KGgoAAAANSUhEUgAAABAAAAAQCAYAAAAf8/9hAAAABGdBTUEAALGPC/xhBQAAAAlwSFlzAAAO
         xAAADsQBlSsOGwAAAIZJREFUOE+1j10KwCAMgz2b755xl/IsvnaL2K20UfbDAmEako+ZROSTafjE12Go
@@ -227,9 +224,6 @@
   <metadata name="LBL_DATE_POS.GenerateMember" type="System.Boolean, mscorlib, Version=4.0.0.0, Culture=neutral, PublicKeyToken=b77a5c561934e089">
     <value>False</value>
   </metadata>
-  <metadata name="LBL_DATE_POS.GenerateMember" type="System.Boolean, mscorlib, Version=4.0.0.0, Culture=neutral, PublicKeyToken=b77a5c561934e089">
-    <value>False</value>
-  </metadata>
   <metadata name="TT_MAIN.GenerateMember" type="System.Boolean, mscorlib, Version=4.0.0.0, Culture=neutral, PublicKeyToken=b77a5c561934e089">
     <value>False</value>
   </metadata>
@@ -263,37 +257,19 @@ You can find more detailed information about the missing posts in the form that
   <metadata name="TP_DEFS.GenerateMember" type="System.Boolean, mscorlib, Version=4.0.0.0, Culture=neutral, PublicKeyToken=b77a5c561934e089">
     <value>False</value>
   </metadata>
-  <metadata name="TP_DEFS.GenerateMember" type="System.Boolean, mscorlib, Version=4.0.0.0, Culture=neutral, PublicKeyToken=b77a5c561934e089">
-    <value>False</value>
-  </metadata>
   <metadata name="TAB_DEFS_CHANNELS.GenerateMember" type="System.Boolean, mscorlib, Version=4.0.0.0, Culture=neutral, PublicKeyToken=b77a5c561934e089">
     <value>False</value>
   </metadata>
   <metadata name="TP_CHANNELS.GenerateMember" type="System.Boolean, mscorlib, Version=4.0.0.0, Culture=neutral, PublicKeyToken=b77a5c561934e089">
     <value>False</value>
   </metadata>
-  <metadata name="TP_CHANNELS.GenerateMember" type="System.Boolean, mscorlib, Version=4.0.0.0, Culture=neutral, PublicKeyToken=b77a5c561934e089">
-    <value>False</value>
-  </metadata>
   <metadata name="TAB_BEHAVIOR.GenerateMember" type="System.Boolean, mscorlib, Version=4.0.0.0, Culture=neutral, PublicKeyToken=b77a5c561934e089">
     <value>False</value>
   </metadata>
   <metadata name="TP_BEHAVIOR.GenerateMember" type="System.Boolean, mscorlib, Version=4.0.0.0, Culture=neutral, PublicKeyToken=b77a5c561934e089">
     <value>False</value>
   </metadata>
-  <metadata name="TP_BEHAVIOR.GenerateMember" type="System.Boolean, mscorlib, Version=4.0.0.0, Culture=neutral, PublicKeyToken=b77a5c561934e089">
-    <value>False</value>
-  </metadata>
-  <metadata name="TP_OPEN_INFO.GenerateMember" type="System.Boolean, mscorlib, Version=4.0.0.0, Culture=neutral, PublicKeyToken=b77a5c561934e089">
-    <value>False</value>
-  </metadata>
-  <metadata name="TP_OPEN_PROGRESS.GenerateMember" type="System.Boolean, mscorlib, Version=4.0.0.0, Culture=neutral, PublicKeyToken=b77a5c561934e089">
-    <value>False</value>
-  </metadata>
-  <metadata name="TP_BEHAVIOR_F6.GenerateMember" type="System.Boolean, mscorlib, Version=4.0.0.0, Culture=neutral, PublicKeyToken=b77a5c561934e089">
-    <value>False</value>
-  </metadata>
-  <data name="ActionButton47.BackgroundImage" type="System.Drawing.Bitmap, System.Drawing" mimetype="application/x-microsoft.net.object.bytearray.base64">
+  <data name="ActionButton9.BackgroundImage" type="System.Drawing.Bitmap, System.Drawing" mimetype="application/x-microsoft.net.object.bytearray.base64">
     <value>
         iVBORw0KGgoAAAANSUhEUgAAABAAAAAQCAYAAAAf8/9hAAAABGdBTUEAALGPC/xhBQAAAAlwSFlzAAAO
         xAAADsQBlSsOGwAAAIZJREFUOE+1j10KwCAMgz2b755xl/IsvnaL2K20UfbDAmEako+ZROSTafjE12Go
@@ -301,7 +277,7 @@ You can find more detailed information about the missing posts in the form that
         AFuc5QFgn6ClHh5iOQVAKNixyucB8NY0vG9JOzzyhrdq5IRgAAAAAElFTkSuQmCC
 </value>
   </data>
-  <data name="ActionButton48.BackgroundImage" type="System.Drawing.Bitmap, System.Drawing" mimetype="application/x-microsoft.net.object.bytearray.base64">
+  <data name="ActionButton10.BackgroundImage" type="System.Drawing.Bitmap, System.Drawing" mimetype="application/x-microsoft.net.object.bytearray.base64">
     <value>
         iVBORw0KGgoAAAANSUhEUgAAABAAAAAQCAYAAAAf8/9hAAAABGdBTUEAALGPC/xhBQAAAAlwSFlzAAAO
         xAAADsQBlSsOGwAAAIZJREFUOE+1j10KwCAMgz2b755xl/IsvnaL2K20UfbDAmEako+ZROSTafjE12Go
@@ -324,13 +300,7 @@ You can find more detailed information about the missing posts in the form that
   <metadata name="TP_DOWNLOADING.GenerateMember" type="System.Boolean, mscorlib, Version=4.0.0.0, Culture=neutral, PublicKeyToken=b77a5c561934e089">
     <value>False</value>
   </metadata>
-  <metadata name="TP_DOWNLOADING.GenerateMember" type="System.Boolean, mscorlib, Version=4.0.0.0, Culture=neutral, PublicKeyToken=b77a5c561934e089">
-    <value>False</value>
-  </metadata>
-  <metadata name="TP_MISSING_DATA.GenerateMember" type="System.Boolean, mscorlib, Version=4.0.0.0, Culture=neutral, PublicKeyToken=b77a5c561934e089">
-    <value>False</value>
-  </metadata>
-  <data name="ActionButton49.BackgroundImage" type="System.Drawing.Bitmap, System.Drawing" mimetype="application/x-microsoft.net.object.bytearray.base64">
+  <data name="ActionButton11.BackgroundImage" type="System.Drawing.Bitmap, System.Drawing" mimetype="application/x-microsoft.net.object.bytearray.base64">
     <value>
         iVBORw0KGgoAAAANSUhEUgAAABAAAAAQCAYAAAAf8/9hAAAABGdBTUEAALGPC/xhBQAAAAlwSFlzAAAO
         wwAADsMBx2+oZAAAAR5JREFUOE+VkjFqwzAUhn2D9iShRyi+QhYbGujg3ZATZPKYdC6FQhPwlAMkg3dP
@@ -341,7 +311,7 @@ You can find more detailed information about the missing posts in the form that
         cMaRN0UdBBkAAAAASUVORK5CYII=
 </value>
   </data>
-  <data name="ActionButton50.BackgroundImage" type="System.Drawing.Bitmap, System.Drawing" mimetype="application/x-microsoft.net.object.bytearray.base64">
+  <data name="ActionButton12.BackgroundImage" type="System.Drawing.Bitmap, System.Drawing" mimetype="application/x-microsoft.net.object.bytearray.base64">
     <value>
         iVBORw0KGgoAAAANSUhEUgAAABAAAAAQCAYAAAAf8/9hAAAABGdBTUEAALGPC/xhBQAAAAlwSFlzAAAO
         xAAADsQBlSsOGwAAAIZJREFUOE+1j10KwCAMgz2b755xl/IsvnaL2K20UfbDAmEako+ZROSTafjE12Go
@@ -364,10 +334,7 @@ You can find more detailed information about the missing posts in the form that
   <metadata name="TP_FEED_SES.GenerateMember" type="System.Boolean, mscorlib, Version=4.0.0.0, Culture=neutral, PublicKeyToken=b77a5c561934e089">
     <value>False</value>
   </metadata>
-  <metadata name="TP_FEED_SPEC_SEARCH.GenerateMember" type="System.Boolean, mscorlib, Version=4.0.0.0, Culture=neutral, PublicKeyToken=b77a5c561934e089">
-    <value>False</value>
-  </metadata>
-  <data name="ActionButton51.BackgroundImage" type="System.Drawing.Bitmap, System.Drawing" mimetype="application/x-microsoft.net.object.bytearray.base64">
+  <data name="ActionButton13.BackgroundImage" type="System.Drawing.Bitmap, System.Drawing" mimetype="application/x-microsoft.net.object.bytearray.base64">
     <value>
         iVBORw0KGgoAAAANSUhEUgAAABAAAAAQCAYAAAAf8/9hAAAABGdBTUEAALGOfPtRkwAAACBjSFJNAAB6
         JQAAgIMAAPn/AACA6QAAdTAAAOpgAAA6mAAAF2+SX8VGAAAACXBIWXMAAAsTAAALEwEAmpwYAAACOElE
@@ -383,7 +350,7 @@ You can find more detailed information about the missing posts in the form that
         VnR1MIwhwMTCyqEQ37qEmZVDFF0OE/9nAACtFF4Ey6OP+wAAAABJRU5ErkJggg==
 </value>
   </data>
-  <data name="ActionButton52.BackgroundImage" type="System.Drawing.Bitmap, System.Drawing" mimetype="application/x-microsoft.net.object.bytearray.base64">
+  <data name="ActionButton14.BackgroundImage" type="System.Drawing.Bitmap, System.Drawing" mimetype="application/x-microsoft.net.object.bytearray.base64">
     <value>
         iVBORw0KGgoAAAANSUhEUgAAABAAAAAQCAYAAAAf8/9hAAAABGdBTUEAALGPC/xhBQAAAAlwSFlzAAAO
         xAAADsQBlSsOGwAAAIZJREFUOE+1j10KwCAMgz2b755xl/IsvnaL2K20UfbDAmEako+ZROSTafjE12Go
@@ -397,10 +364,10 @@ You can find more detailed information about the missing posts in the form that
 0 - only the session of the current day.
 &gt;0 - the value (in minutes) that must elapse since last file download in a session for that session to be considered current.</value>
   </data>
-  <metadata name="TAB_NOTIFY.GenerateMember" type="System.Boolean, mscorlib, Version=4.0.0.0, Culture=neutral, PublicKeyToken=b77a5c561934e089">
+  <metadata name="TP_FEED_SPEC_SEARCH.GenerateMember" type="System.Boolean, mscorlib, Version=4.0.0.0, Culture=neutral, PublicKeyToken=b77a5c561934e089">
     <value>False</value>
   </metadata>
-  <metadata name="TP_NOTIFY_MAIN.GenerateMember" type="System.Boolean, mscorlib, Version=4.0.0.0, Culture=neutral, PublicKeyToken=b77a5c561934e089">
+  <metadata name="TAB_NOTIFY.GenerateMember" type="System.Boolean, mscorlib, Version=4.0.0.0, Culture=neutral, PublicKeyToken=b77a5c561934e089">
     <value>False</value>
   </metadata>
   <metadata name="TP_NOTIFY_MAIN.GenerateMember" type="System.Boolean, mscorlib, Version=4.0.0.0, Culture=neutral, PublicKeyToken=b77a5c561934e089">
@@ -409,7 +376,7 @@ You can find more detailed information about the missing posts in the form that
   <metadata name="TP_ENVIR.GenerateMember" type="System.Boolean, mscorlib, Version=4.0.0.0, Culture=neutral, PublicKeyToken=b77a5c561934e089">
     <value>False</value>
   </metadata>
-  <data name="ActionButton53.BackgroundImage" type="System.Drawing.Bitmap, System.Drawing" mimetype="application/x-microsoft.net.object.bytearray.base64">
+  <data name="ActionButton15.BackgroundImage" type="System.Drawing.Bitmap, System.Drawing" mimetype="application/x-microsoft.net.object.bytearray.base64">
     <value>
         iVBORw0KGgoAAAANSUhEUgAAABAAAAAQCAYAAAAf8/9hAAAABGdBTUEAALGPC/xhBQAAAAlwSFlzAAAO
         wwAADsMBx2+oZAAAAR5JREFUOE+VkjFqwzAUhn2D9iShRyi+QhYbGujg3ZATZPKYdC6FQhPwlAMkg3dP
@@ -420,7 +387,7 @@ You can find more detailed information about the missing posts in the form that
         cMaRN0UdBBkAAAAASUVORK5CYII=
 </value>
   </data>
-  <data name="ActionButton54.BackgroundImage" type="System.Drawing.Bitmap, System.Drawing" mimetype="application/x-microsoft.net.object.bytearray.base64">
+  <data name="ActionButton16.BackgroundImage" type="System.Drawing.Bitmap, System.Drawing" mimetype="application/x-microsoft.net.object.bytearray.base64">
     <value>
         iVBORw0KGgoAAAANSUhEUgAAABAAAAAQCAYAAAAf8/9hAAAABGdBTUEAALGOfPtRkwAAACBjSFJNAAB6
         JQAAgIMAAPn/AACA6QAAdTAAAOpgAAA6mAAAF2+SX8VGAAAACXBIWXMAAAsTAAALEwEAmpwYAAACOElE
@@ -436,7 +403,7 @@ You can find more detailed information about the missing posts in the form that
         VnR1MIwhwMTCyqEQ37qEmZVDFF0OE/9nAACtFF4Ey6OP+wAAAABJRU5ErkJggg==
 </value>
   </data>
-  <data name="ActionButton55.BackgroundImage" type="System.Drawing.Bitmap, System.Drawing" mimetype="application/x-microsoft.net.object.bytearray.base64">
+  <data name="ActionButton17.BackgroundImage" type="System.Drawing.Bitmap, System.Drawing" mimetype="application/x-microsoft.net.object.bytearray.base64">
     <value>
         iVBORw0KGgoAAAANSUhEUgAAABAAAAAQCAYAAAAf8/9hAAAABGdBTUEAALGPC/xhBQAAAAlwSFlzAAAO
         xAAADsQBlSsOGwAAAIZJREFUOE+1j10KwCAMgz2b755xl/IsvnaL2K20UfbDAmEako+ZROSTafjE12Go
@@ -444,7 +411,7 @@ You can find more detailed information about the missing posts in the form that
         AFuc5QFgn6ClHh5iOQVAKNixyucB8NY0vG9JOzzyhrdq5IRgAAAAAElFTkSuQmCC
 </value>
   </data>
-  <data name="ActionButton56.BackgroundImage" type="System.Drawing.Bitmap, System.Drawing" mimetype="application/x-microsoft.net.object.bytearray.base64">
+  <data name="ActionButton18.BackgroundImage" type="System.Drawing.Bitmap, System.Drawing" mimetype="application/x-microsoft.net.object.bytearray.base64">
     <value>
         iVBORw0KGgoAAAANSUhEUgAAABAAAAAQCAYAAAAf8/9hAAAABGdBTUEAALGPC/xhBQAAAAlwSFlzAAAO
         wwAADsMBx2+oZAAAAR5JREFUOE+VkjFqwzAUhn2D9iShRyi+QhYbGujg3ZATZPKYdC6FQhPwlAMkg3dP
@@ -455,7 +422,7 @@ You can find more detailed information about the missing posts in the form that
         cMaRN0UdBBkAAAAASUVORK5CYII=
 </value>
   </data>
-  <data name="ActionButton57.BackgroundImage" type="System.Drawing.Bitmap, System.Drawing" mimetype="application/x-microsoft.net.object.bytearray.base64">
+  <data name="ActionButton19.BackgroundImage" type="System.Drawing.Bitmap, System.Drawing" mimetype="application/x-microsoft.net.object.bytearray.base64">
     <value>
         iVBORw0KGgoAAAANSUhEUgAAABAAAAAQCAYAAAAf8/9hAAAABGdBTUEAALGOfPtRkwAAACBjSFJNAAB6
         JQAAgIMAAPn/AACA6QAAdTAAAOpgAAA6mAAAF2+SX8VGAAAACXBIWXMAAAsTAAALEwEAmpwYAAACOElE
@@ -471,7 +438,7 @@ You can find more detailed information about the missing posts in the form that
         VnR1MIwhwMTCyqEQ37qEmZVDFF0OE/9nAACtFF4Ey6OP+wAAAABJRU5ErkJggg==
 </value>
   </data>
-  <data name="ActionButton58.BackgroundImage" type="System.Drawing.Bitmap, System.Drawing" mimetype="application/x-microsoft.net.object.bytearray.base64">
+  <data name="ActionButton20.BackgroundImage" type="System.Drawing.Bitmap, System.Drawing" mimetype="application/x-microsoft.net.object.bytearray.base64">
     <value>
         iVBORw0KGgoAAAANSUhEUgAAABAAAAAQCAYAAAAf8/9hAAAABGdBTUEAALGPC/xhBQAAAAlwSFlzAAAO
         xAAADsQBlSsOGwAAAIZJREFUOE+1j10KwCAMgz2b755xl/IsvnaL2K20UfbDAmEako+ZROSTafjE12Go
@@ -479,7 +446,7 @@ You can find more detailed information about the missing posts in the form that
         AFuc5QFgn6ClHh5iOQVAKNixyucB8NY0vG9JOzzyhrdq5IRgAAAAAElFTkSuQmCC
 </value>
   </data>
-  <data name="ActionButton59.BackgroundImage" type="System.Drawing.Bitmap, System.Drawing" mimetype="application/x-microsoft.net.object.bytearray.base64">
+  <data name="ActionButton21.BackgroundImage" type="System.Drawing.Bitmap, System.Drawing" mimetype="application/x-microsoft.net.object.bytearray.base64">
     <value>
         iVBORw0KGgoAAAANSUhEUgAAABAAAAAQCAYAAAAf8/9hAAAABGdBTUEAALGPC/xhBQAAAAlwSFlzAAAO
         wwAADsMBx2+oZAAAAR5JREFUOE+VkjFqwzAUhn2D9iShRyi+QhYbGujg3ZATZPKYdC6FQhPwlAMkg3dP
@@ -490,7 +457,7 @@ You can find more detailed information about the missing posts in the form that
         cMaRN0UdBBkAAAAASUVORK5CYII=
 </value>
   </data>
-  <data name="ActionButton60.BackgroundImage" type="System.Drawing.Bitmap, System.Drawing" mimetype="application/x-microsoft.net.object.bytearray.base64">
+  <data name="ActionButton22.BackgroundImage" type="System.Drawing.Bitmap, System.Drawing" mimetype="application/x-microsoft.net.object.bytearray.base64">
     <value>
         iVBORw0KGgoAAAANSUhEUgAAABAAAAAQCAYAAAAf8/9hAAAABGdBTUEAALGOfPtRkwAAACBjSFJNAAB6
         JQAAgIMAAPn/AACA6QAAdTAAAOpgAAA6mAAAF2+SX8VGAAAACXBIWXMAAAsTAAALEwEAmpwYAAACOElE
@@ -506,7 +473,7 @@ You can find more detailed information about the missing posts in the form that
         VnR1MIwhwMTCyqEQ37qEmZVDFF0OE/9nAACtFF4Ey6OP+wAAAABJRU5ErkJggg==
 </value>
   </data>
-  <data name="ActionButton61.BackgroundImage" type="System.Drawing.Bitmap, System.Drawing" mimetype="application/x-microsoft.net.object.bytearray.base64">
+  <data name="ActionButton23.BackgroundImage" type="System.Drawing.Bitmap, System.Drawing" mimetype="application/x-microsoft.net.object.bytearray.base64">
     <value>
         iVBORw0KGgoAAAANSUhEUgAAABAAAAAQCAYAAAAf8/9hAAAABGdBTUEAALGPC/xhBQAAAAlwSFlzAAAO
         xAAADsQBlSsOGwAAAIZJREFUOE+1j10KwCAMgz2b755xl/IsvnaL2K20UfbDAmEako+ZROSTafjE12Go
@@ -514,7 +481,7 @@ You can find more detailed information about the missing posts in the form that
         AFuc5QFgn6ClHh5iOQVAKNixyucB8NY0vG9JOzzyhrdq5IRgAAAAAElFTkSuQmCC
 </value>
   </data>
-  <data name="ActionButton62.BackgroundImage" type="System.Drawing.Bitmap, System.Drawing" mimetype="application/x-microsoft.net.object.bytearray.base64">
+  <data name="ActionButton24.BackgroundImage" type="System.Drawing.Bitmap, System.Drawing" mimetype="application/x-microsoft.net.object.bytearray.base64">
     <value>
         iVBORw0KGgoAAAANSUhEUgAAABAAAAAQCAYAAAAf8/9hAAAABGdBTUEAALGPC/xhBQAAAAlwSFlzAAAO
         wwAADsMBx2+oZAAAAR5JREFUOE+VkjFqwzAUhn2D9iShRyi+QhYbGujg3ZATZPKYdC6FQhPwlAMkg3dP
@@ -525,7 +492,7 @@ You can find more detailed information about the missing posts in the form that
         cMaRN0UdBBkAAAAASUVORK5CYII=
 </value>
   </data>
-  <data name="ActionButton63.BackgroundImage" type="System.Drawing.Bitmap, System.Drawing" mimetype="application/x-microsoft.net.object.bytearray.base64">
+  <data name="ActionButton25.BackgroundImage" type="System.Drawing.Bitmap, System.Drawing" mimetype="application/x-microsoft.net.object.bytearray.base64">
     <value>
         iVBORw0KGgoAAAANSUhEUgAAABAAAAAQCAYAAAAf8/9hAAAABGdBTUEAALGOfPtRkwAAACBjSFJNAAB6
         JQAAgIMAAPn/AACA6QAAdTAAAOpgAAA6mAAAF2+SX8VGAAAACXBIWXMAAAsTAAALEwEAmpwYAAACOElE
@@ -541,7 +508,7 @@ You can find more detailed information about the missing posts in the form that
         VnR1MIwhwMTCyqEQ37qEmZVDFF0OE/9nAACtFF4Ey6OP+wAAAABJRU5ErkJggg==
 </value>
   </data>
-  <data name="ActionButton64.BackgroundImage" type="System.Drawing.Bitmap, System.Drawing" mimetype="application/x-microsoft.net.object.bytearray.base64">
+  <data name="ActionButton26.BackgroundImage" type="System.Drawing.Bitmap, System.Drawing" mimetype="application/x-microsoft.net.object.bytearray.base64">
     <value>
         iVBORw0KGgoAAAANSUhEUgAAABAAAAAQCAYAAAAf8/9hAAAABGdBTUEAALGPC/xhBQAAAAlwSFlzAAAO
         xAAADsQBlSsOGwAAAIZJREFUOE+1j10KwCAMgz2b755xl/IsvnaL2K20UfbDAmEako+ZROSTafjE12Go
@@ -549,7 +516,7 @@ You can find more detailed information about the missing posts in the form that
         AFuc5QFgn6ClHh5iOQVAKNixyucB8NY0vG9JOzzyhrdq5IRgAAAAAElFTkSuQmCC
 </value>
   </data>
-  <data name="ActionButton65.BackgroundImage" type="System.Drawing.Bitmap, System.Drawing" mimetype="application/x-microsoft.net.object.bytearray.base64">
+  <data name="ActionButton27.BackgroundImage" type="System.Drawing.Bitmap, System.Drawing" mimetype="application/x-microsoft.net.object.bytearray.base64">
     <value>
         iVBORw0KGgoAAAANSUhEUgAAABAAAAAQCAYAAAAf8/9hAAAABGdBTUEAALGOfPtRkwAAACBjSFJNAAB6
         JQAAgIMAAPn/AACA6QAAdTAAAOpgAAA6mAAAF2+SX8VGAAAACXBIWXMAAAsTAAALEwEAmpwYAAACOElE
@@ -565,7 +532,7 @@ You can find more detailed information about the missing posts in the form that
         VnR1MIwhwMTCyqEQ37qEmZVDFF0OE/9nAACtFF4Ey6OP+wAAAABJRU5ErkJggg==
 </value>
   </data>
-  <data name="ActionButton66.BackgroundImage" type="System.Drawing.Bitmap, System.Drawing" mimetype="application/x-microsoft.net.object.bytearray.base64">
+  <data name="ActionButton28.BackgroundImage" type="System.Drawing.Bitmap, System.Drawing" mimetype="application/x-microsoft.net.object.bytearray.base64">
     <value>
         iVBORw0KGgoAAAANSUhEUgAAABAAAAAQCAYAAAAf8/9hAAAABGdBTUEAALGPC/xhBQAAAAlwSFlzAAAO
         xAAADsQBlSsOGwAAAIZJREFUOE+1j10KwCAMgz2b755xl/IsvnaL2K20UfbDAmEako+ZROSTafjE12Go
@@ -579,10 +546,7 @@ You can find more detailed information about the missing posts in the form that
   <metadata name="TP_STD.GenerateMember" type="System.Boolean, mscorlib, Version=4.0.0.0, Culture=neutral, PublicKeyToken=b77a5c561934e089">
     <value>False</value>
   </metadata>
-  <metadata name="TP_STD.GenerateMember" type="System.Boolean, mscorlib, Version=4.0.0.0, Culture=neutral, PublicKeyToken=b77a5c561934e089">
-    <value>False</value>
-  </metadata>
-  <data name="ActionButton67.BackgroundImage" type="System.Drawing.Bitmap, System.Drawing" mimetype="application/x-microsoft.net.object.bytearray.base64">
+  <data name="ActionButton29.BackgroundImage" type="System.Drawing.Bitmap, System.Drawing" mimetype="application/x-microsoft.net.object.bytearray.base64">
     <value>
         iVBORw0KGgoAAAANSUhEUgAAAgAAAAIACAYAAAD0eNT6AAAABGdBTUEAALGPC/xhBQAAE65JREFUeF7t
         3X2sJWddB/DdLi2lQG2hdOHuvfM887J7Cxca4ELTQMDWKigIFpBAEAgi9g+CJpJo9Q8NJhgBiYZIYspL
@@ -678,10 +642,7 @@ You can find more detailed information about the missing posts in the form that
   <metadata name="TP_DESIGN.GenerateMember" type="System.Boolean, mscorlib, Version=4.0.0.0, Culture=neutral, PublicKeyToken=b77a5c561934e089">
     <value>False</value>
   </metadata>
-  <metadata name="TP_DESIGN.GenerateMember" type="System.Boolean, mscorlib, Version=4.0.0.0, Culture=neutral, PublicKeyToken=b77a5c561934e089">
-    <value>False</value>
-  </metadata>
-  <data name="ActionButton68.BackgroundImage" type="System.Drawing.Bitmap, System.Drawing" mimetype="application/x-microsoft.net.object.bytearray.base64">
+  <data name="ActionButton30.BackgroundImage" type="System.Drawing.Bitmap, System.Drawing" mimetype="application/x-microsoft.net.object.bytearray.base64">
     <value>
         iVBORw0KGgoAAAANSUhEUgAAABAAAAAQCAYAAAAf8/9hAAAABGdBTUEAALGPC/xhBQAAAAlwSFlzAAAO
         xAAADsQBlSsOGwAAAIZJREFUOE+1j10KwCAMgz2b755xl/IsvnaL2K20UfbDAmEako+ZROSTafjE12Go
@@ -689,7 +650,7 @@ You can find more detailed information about the missing posts in the form that
         AFuc5QFgn6ClHh5iOQVAKNixyucB8NY0vG9JOzzyhrdq5IRgAAAAAElFTkSuQmCC
 </value>
   </data>
-  <data name="ActionButton69.BackgroundImage" type="System.Drawing.Bitmap, System.Drawing" mimetype="application/x-microsoft.net.object.bytearray.base64">
+  <data name="ActionButton31.BackgroundImage" type="System.Drawing.Bitmap, System.Drawing" mimetype="application/x-microsoft.net.object.bytearray.base64">
     <value>
         iVBORw0KGgoAAAANSUhEUgAAABAAAAAQCAYAAAAf8/9hAAAABGdBTUEAALGPC/xhBQAAAAlwSFlzAAAO
         xAAADsQBlSsOGwAAAIZJREFUOE+1j10KwCAMgz2b755xl/IsvnaL2K20UfbDAmEako+ZROSTafjE12Go
@@ -697,7 +658,7 @@ You can find more detailed information about the missing posts in the form that
         AFuc5QFgn6ClHh5iOQVAKNixyucB8NY0vG9JOzzyhrdq5IRgAAAAAElFTkSuQmCC
 </value>
   </data>
-  <data name="ActionButton70.BackgroundImage" type="System.Drawing.Bitmap, System.Drawing" mimetype="application/x-microsoft.net.object.bytearray.base64">
+  <data name="ActionButton32.BackgroundImage" type="System.Drawing.Bitmap, System.Drawing" mimetype="application/x-microsoft.net.object.bytearray.base64">
     <value>
         iVBORw0KGgoAAAANSUhEUgAAABAAAAAQCAYAAAAf8/9hAAAABGdBTUEAALGPC/xhBQAAAAlwSFlzAAAO
         wwAADsMBx2+oZAAAAR5JREFUOE+VkjFqwzAUhn2D9iShRyi+QhYbGujg3ZATZPKYdC6FQhPwlAMkg3dP
@@ -708,7 +669,7 @@ You can find more detailed information about the missing posts in the form that
         cMaRN0UdBBkAAAAASUVORK5CYII=
 </value>
   </data>
-  <data name="ActionButton71.BackgroundImage" type="System.Drawing.Bitmap, System.Drawing" mimetype="application/x-microsoft.net.object.bytearray.base64">
+  <data name="ActionButton33.BackgroundImage" type="System.Drawing.Bitmap, System.Drawing" mimetype="application/x-microsoft.net.object.bytearray.base64">
     <value>
         iVBORw0KGgoAAAANSUhEUgAAABAAAAAQCAYAAAAf8/9hAAAABGdBTUEAALGPC/xhBQAAAAlwSFlzAAAO
         xAAADsQBlSsOGwAAAIZJREFUOE+1j10KwCAMgz2b755xl/IsvnaL2K20UfbDAmEako+ZROSTafjE12Go
@@ -719,7 +680,7 @@ You can find more detailed information about the missing posts in the form that
   <metadata name="TP_HEADERS_DEF.GenerateMember" type="System.Boolean, mscorlib, Version=4.0.0.0, Culture=neutral, PublicKeyToken=b77a5c561934e089">
     <value>False</value>
   </metadata>
-  <data name="ActionButton72.BackgroundImage" type="System.Drawing.Bitmap, System.Drawing" mimetype="application/x-microsoft.net.object.bytearray.base64">
+  <data name="ActionButton34.BackgroundImage" type="System.Drawing.Bitmap, System.Drawing" mimetype="application/x-microsoft.net.object.bytearray.base64">
     <value>
         iVBORw0KGgoAAAANSUhEUgAAABAAAAAQCAYAAAAf8/9hAAAABGdBTUEAALGPC/xhBQAAAAlwSFlzAAAO
         xAAADsQBlSsOGwAAAIZJREFUOE+1j10KwCAMgz2b755xl/IsvnaL2K20UfbDAmEako+ZROSTafjE12Go
@@ -727,7 +688,7 @@ You can find more detailed information about the missing posts in the form that
         AFuc5QFgn6ClHh5iOQVAKNixyucB8NY0vG9JOzzyhrdq5IRgAAAAAElFTkSuQmCC
 </value>
   </data>
-  <data name="ActionButton73.BackgroundImage" type="System.Drawing.Bitmap, System.Drawing" mimetype="application/x-microsoft.net.object.bytearray.base64">
+  <data name="ActionButton35.BackgroundImage" type="System.Drawing.Bitmap, System.Drawing" mimetype="application/x-microsoft.net.object.bytearray.base64">
     <value>
         iVBORw0KGgoAAAANSUhEUgAAABAAAAAQCAYAAAAf8/9hAAAABGdBTUEAALGPC/xhBQAAAAlwSFlzAAAO
         xAAADsQBlSsOGwAAAIZJREFUOE+1j10KwCAMgz2b755xl/IsvnaL2K20UfbDAmEako+ZROSTafjE12Go
@@ -735,7 +696,7 @@ You can find more detailed information about the missing posts in the form that
         AFuc5QFgn6ClHh5iOQVAKNixyucB8NY0vG9JOzzyhrdq5IRgAAAAAElFTkSuQmCC
 </value>
   </data>
-  <data name="ActionButton74.BackgroundImage" type="System.Drawing.Bitmap, System.Drawing" mimetype="application/x-microsoft.net.object.bytearray.base64">
+  <data name="ActionButton36.BackgroundImage" type="System.Drawing.Bitmap, System.Drawing" mimetype="application/x-microsoft.net.object.bytearray.base64">
     <value>
         iVBORw0KGgoAAAANSUhEUgAAABAAAAAQCAYAAAAf8/9hAAAABGdBTUEAALGPC/xhBQAAAAlwSFlzAAAO
         xAAADsQBlSsOGwAAAIZJREFUOE+1j10KwCAMgz2b755xl/IsvnaL2K20UfbDAmEako+ZROSTafjE12Go
@@ -743,7 +704,7 @@ You can find more detailed information about the missing posts in the form that
         AFuc5QFgn6ClHh5iOQVAKNixyucB8NY0vG9JOzzyhrdq5IRgAAAAAElFTkSuQmCC
 </value>
   </data>
-  <data name="ActionButton75.BackgroundImage" type="System.Drawing.Bitmap, System.Drawing" mimetype="application/x-microsoft.net.object.bytearray.base64">
+  <data name="ActionButton37.BackgroundImage" type="System.Drawing.Bitmap, System.Drawing" mimetype="application/x-microsoft.net.object.bytearray.base64">
     <value>
         iVBORw0KGgoAAAANSUhEUgAAABAAAAAQCAYAAAAf8/9hAAAABGdBTUEAALGPC/xhBQAAAAlwSFlzAAAO
         xAAADsQBlSsOGwAAAIZJREFUOE+1j10KwCAMgz2b755xl/IsvnaL2K20UfbDAmEako+ZROSTafjE12Go
@@ -751,7 +712,7 @@ You can find more detailed information about the missing posts in the form that
         AFuc5QFgn6ClHh5iOQVAKNixyucB8NY0vG9JOzzyhrdq5IRgAAAAAElFTkSuQmCC
 </value>
   </data>
-  <data name="ActionButton76.BackgroundImage" type="System.Drawing.Bitmap, System.Drawing" mimetype="application/x-microsoft.net.object.bytearray.base64">
+  <data name="ActionButton38.BackgroundImage" type="System.Drawing.Bitmap, System.Drawing" mimetype="application/x-microsoft.net.object.bytearray.base64">
     <value>
         iVBORw0KGgoAAAANSUhEUgAAABAAAAAQCAYAAAAf8/9hAAAABGdBTUEAALGPC/xhBQAAAAlwSFlzAAAO
         xAAADsQBlSsOGwAAAIZJREFUOE+1j10KwCAMgz2b755xl/IsvnaL2K20UfbDAmEako+ZROSTafjE12Go

SCrawler/Editors/GlobalSettingsForm.vb

@@ -80,6 +80,7 @@ Namespace Editors
                         TXT_SCHEDULER_SCRIPT.Text = .AutomationScript
                         TXT_SCHEDULER_SCRIPT.Checked = .AutomationScript.Use
                         CH_SCHEDULER_SCRIPT_EX_MANUAL.Checked = .AutomationScript_ExcludeManual
+                        CH_FEED_OPEN_CTRLF.Checked = .FeedOpenCtrlF
                         'Notifications
                         CH_NOTIFY_SILENT.Checked = .NotificationsSilentMode
                         CH_NOTIFY_SHOW_BASE.Checked = .ShowNotifications
@@ -300,6 +301,7 @@ Namespace Editors
                     .AutomationScript.Value = TXT_SCHEDULER_SCRIPT.Text
                     .AutomationScript.Use = TXT_SCHEDULER_SCRIPT.Checked
                     .AutomationScript_ExcludeManual.Value = CH_SCHEDULER_SCRIPT_EX_MANUAL.Checked
+                    .FeedOpenCtrlF.Value = CH_FEED_OPEN_CTRLF.Checked
                     'Notifications
                     .NotificationsSilentMode = CH_NOTIFY_SILENT.Checked
                     .ShowNotifications.Value = CH_NOTIFY_SHOW_BASE.Checked

SCrawler/Editors/SiteEditorForm.vb

@@ -357,6 +357,9 @@ Namespace Editors
                 MyDefs.InvokeLoaderError(ex)
             End Try
         End Sub
+        Private Sub SiteEditorForm_KeyDown(sender As Object, e As KeyEventArgs) Handles Me.KeyDown
+            If e.Control And e.KeyCode = Keys.Enter Then MyDefs_ButtonOkClick(sender, New KeyHandleEventArgs With {.KeyEventArgs = e})
+        End Sub
         Private Sub SiteEditorForm_Disposed(sender As Object, e As EventArgs) Handles Me.Disposed
             If Host.PropList.Count > 0 Then Host.PropList.ForEach(Sub(p) p.DisposeControl())
             If Not SpecialButton Is Nothing Then SpecialButton.Dispose()
@@ -366,7 +369,11 @@ Namespace Editors
             If Not Cookies Is Nothing Then Cookies.Dispose()
         End Sub
         Private Sub MyDefs_ButtonOkClick(ByVal Sender As Object, ByVal e As KeyHandleEventArgs) Handles MyDefs.ButtonOkClick
-            If MyDefs.MyFieldsChecker.AllParamsOK Then
+            Dim ctrl As Boolean = Not e Is Nothing AndAlso (If(e.KeyEventArgs?.Control, False) OrElse e.Key.Control)
+            If ctrl OrElse MyDefs.MyFieldsChecker.AllParamsOK Then
+                If (Not MyDefs.MyFieldsCheckerE.AllParamsOK(EDP.ReturnValue) And ctrl) AndAlso
+                   MsgBoxE({$"Some required fields are not filled in!{vbCr}{vbCr}{MyDefs.MyFieldsChecker.ComparisonInformation}
+                            {vbCr}{vbCr}Are you sure you want to process?", "Required fields are missing"}, vbCritical,,, {"Process", "Cancel"}) = 1 Then Exit Sub
                 Dim i%, ii%
                 With Host
                     Dim indxList As New List(Of Integer)
@@ -376,6 +383,7 @@ Namespace Editors
                     If indxList.Count > 0 Then
                         Dim pList As New List(Of PropertyData)
                         Dim n$()
+                        Dim errorsDetected As Boolean = False
                         For i = 0 To indxList.Count - 1
                             n = .PropList(indxList(i)).PropertiesChecking
                             For ii = 0 To .PropList.Count - 1
@@ -383,8 +391,13 @@ Namespace Editors
                                     If n.Contains(.Name) Then pList.Add(New PropertyData(.Name, .GetControlValue))
                                 End With
                             Next
-                            If pList.Count > 0 AndAlso Not CBool(.PropList(indxList(i)).PropertiesCheckingMethod.Invoke(.Source, {pList})) Then Exit Sub
+                            If pList.Count > 0 AndAlso Not CBool(.PropList(indxList(i)).PropertiesCheckingMethod.Invoke(.Source, {pList})) Then
+                                If ctrl Then errorsDetected = True Else Exit Sub
+                            End If
                         Next
+                        If (ctrl And errorsDetected) AndAlso MsgBoxE({$"Some settings may be incorrect. Do you still want to save?",
+                                                                      "Incorrect settings detected"},
+                                                                     vbCritical,,, {"Process", "Cancel"}) = 1 Then Exit Sub
                     End If
 
                     If TXT_PATH.Text.IsEmptyString Then TXT_PATH.Text = .PathGenerate.CSFilePS

SCrawler/Editors/UserCreatorForm.vb

@@ -103,7 +103,7 @@ Namespace Editors
 #End Region
 #Region "Exchange, Path, Labels"
         Friend Property MyExchangeOptions As Object = Nothing
-        Private ReadOnly _SpecPathPattern As RParams = RParams.DM("\w:\\.*", 0, EDP.ReturnValue)
+        Private ReadOnly _SpecPathPattern As RParams = RParams.DM("(\w:\\|\\\\).*", 0, EDP.ReturnValue)
         Private ReadOnly Property SpecialPath(ByVal s As SettingsHost) As SFile
             Get
                 If TXT_SPEC_FOLDER.IsEmptyString Then

SCrawler/MainFrame.Designer.vb

@@ -40,12 +40,14 @@ Partial Public Class MainFrame : Inherits System.Windows.Forms.Form
         Dim MENU_DOWN_ALL_SEP_3 As System.Windows.Forms.ToolStripSeparator
         Dim MENU_DOWN_ALL_SEP_4 As System.Windows.Forms.ToolStripSeparator
         Dim MENU_INFO As System.Windows.Forms.ToolStripDropDownButton
+        Dim MENU_INFO_SEP_1 As System.Windows.Forms.ToolStripSeparator
         Dim MENU_VIEW_SEP_1 As System.Windows.Forms.ToolStripSeparator
         Dim resources As System.ComponentModel.ComponentResourceManager = New System.ComponentModel.ComponentResourceManager(GetType(MainFrame))
         Me.MENU_INFO_SHOW_INFO = New System.Windows.Forms.ToolStripMenuItem()
         Me.MENU_INFO_SHOW_QUEUE = New System.Windows.Forms.ToolStripMenuItem()
         Me.MENU_INFO_SHOW_MISSING = New System.Windows.Forms.ToolStripMenuItem()
         Me.MENU_INFO_SHOW_USER_METRICS = New System.Windows.Forms.ToolStripMenuItem()
+        Me.MENU_INFO_USER_SEARCH = New System.Windows.Forms.ToolStripMenuItem()
         Me.MENU_SETTINGS = New System.Windows.Forms.ToolStripDropDownButton()
         Me.BTT_SETTINGS = New System.Windows.Forms.ToolStripMenuItem()
         Me.Toolbar_TOP = New System.Windows.Forms.ToolStrip()
@@ -140,6 +142,7 @@ Partial Public Class MainFrame : Inherits System.Windows.Forms.Form
         MENU_DOWN_ALL_SEP_3 = New System.Windows.Forms.ToolStripSeparator()
         MENU_DOWN_ALL_SEP_4 = New System.Windows.Forms.ToolStripSeparator()
         MENU_INFO = New System.Windows.Forms.ToolStripDropDownButton()
+        MENU_INFO_SEP_1 = New System.Windows.Forms.ToolStripSeparator()
         MENU_VIEW_SEP_1 = New System.Windows.Forms.ToolStripSeparator()
         Me.Toolbar_TOP.SuspendLayout()
         Me.Toolbar_BOTTOM.SuspendLayout()
@@ -235,7 +238,7 @@ Partial Public Class MainFrame : Inherits System.Windows.Forms.Form
         'MENU_INFO
         '
         MENU_INFO.AutoToolTip = False
-        MENU_INFO.DropDownItems.AddRange(New System.Windows.Forms.ToolStripItem() {Me.MENU_INFO_SHOW_INFO, Me.MENU_INFO_SHOW_QUEUE, Me.MENU_INFO_SHOW_MISSING, Me.MENU_INFO_SHOW_USER_METRICS})
+        MENU_INFO.DropDownItems.AddRange(New System.Windows.Forms.ToolStripItem() {Me.MENU_INFO_SHOW_INFO, Me.MENU_INFO_SHOW_QUEUE, Me.MENU_INFO_SHOW_MISSING, MENU_INFO_SEP_1, Me.MENU_INFO_SHOW_USER_METRICS, Me.MENU_INFO_USER_SEARCH})
         MENU_INFO.Image = Global.SCrawler.My.Resources.Resources.InfoPic_32
         MENU_INFO.ImageTransparentColor = System.Drawing.Color.Magenta
         MENU_INFO.Name = "MENU_INFO"
@@ -268,6 +271,11 @@ Partial Public Class MainFrame : Inherits System.Windows.Forms.Form
         Me.MENU_INFO_SHOW_MISSING.Text = "Missing posts"
         Me.MENU_INFO_SHOW_MISSING.ToolTipText = "Open the 'Missing' form (show information about missing posts)."
         '
+        'MENU_INFO_SEP_1
+        '
+        MENU_INFO_SEP_1.Name = "MENU_INFO_SEP_1"
+        MENU_INFO_SEP_1.Size = New System.Drawing.Size(209, 6)
+        '
         'MENU_INFO_SHOW_USER_METRICS
         '
         Me.MENU_INFO_SHOW_USER_METRICS.AutoToolTip = True
@@ -277,6 +285,13 @@ Partial Public Class MainFrame : Inherits System.Windows.Forms.Form
         Me.MENU_INFO_SHOW_USER_METRICS.Text = "User metrics"
         Me.MENU_INFO_SHOW_USER_METRICS.ToolTipText = "Open the ""User metrics' form (show information about the user's metrics (such as " &
     "size, number of files, etc.))."
+        '
+        'MENU_INFO_USER_SEARCH
+        '
+        Me.MENU_INFO_USER_SEARCH.Image = Global.SCrawler.My.Resources.Resources.FindPic_16
+        Me.MENU_INFO_USER_SEARCH.Name = "MENU_INFO_USER_SEARCH"
+        Me.MENU_INFO_USER_SEARCH.Size = New System.Drawing.Size(212, 22)
+        Me.MENU_INFO_USER_SEARCH.Text = "Find user"
         '
         'MENU_VIEW_SEP_1
         '
@@ -664,7 +679,7 @@ Partial Public Class MainFrame : Inherits System.Windows.Forms.Form
         Me.BTT_CONTEXT_DOWN.Image = Global.SCrawler.My.Resources.Resources.StartPic_Green_16
         Me.BTT_CONTEXT_DOWN.Name = "BTT_CONTEXT_DOWN"
         Me.BTT_CONTEXT_DOWN.Size = New System.Drawing.Size(221, 22)
-        Me.BTT_CONTEXT_DOWN.Text = "Download data"
+        Me.BTT_CONTEXT_DOWN.Text = "Download"
         Me.BTT_CONTEXT_DOWN.ToolTipText = ""
         '
         'BTT_CONTEXT_DOWN_LIMITED
@@ -673,7 +688,7 @@ Partial Public Class MainFrame : Inherits System.Windows.Forms.Form
         Me.BTT_CONTEXT_DOWN_LIMITED.Image = Global.SCrawler.My.Resources.Resources.StartPic_Green_16
         Me.BTT_CONTEXT_DOWN_LIMITED.Name = "BTT_CONTEXT_DOWN_LIMITED"
         Me.BTT_CONTEXT_DOWN_LIMITED.Size = New System.Drawing.Size(221, 22)
-        Me.BTT_CONTEXT_DOWN_LIMITED.Text = "Download data limited"
+        Me.BTT_CONTEXT_DOWN_LIMITED.Text = "Download (limited)"
         Me.BTT_CONTEXT_DOWN_LIMITED.ToolTipText = "Download top ... posts"
         '
         'BTT_CONTEXT_DOWN_DATE_LIMIT
@@ -681,7 +696,7 @@ Partial Public Class MainFrame : Inherits System.Windows.Forms.Form
         Me.BTT_CONTEXT_DOWN_DATE_LIMIT.Image = Global.SCrawler.My.Resources.Resources.StartPic_Green_16
         Me.BTT_CONTEXT_DOWN_DATE_LIMIT.Name = "BTT_CONTEXT_DOWN_DATE_LIMIT"
         Me.BTT_CONTEXT_DOWN_DATE_LIMIT.Size = New System.Drawing.Size(221, 22)
-        Me.BTT_CONTEXT_DOWN_DATE_LIMIT.Text = "Download data to the date"
+        Me.BTT_CONTEXT_DOWN_DATE_LIMIT.Text = "Download (to the date)"
         Me.BTT_CONTEXT_DOWN_DATE_LIMIT.ToolTipText = ""
         '
         'BTT_CONTEXT_EDIT
@@ -993,4 +1008,5 @@ Partial Public Class MainFrame : Inherits System.Windows.Forms.Form
     Private WithEvents BTT_VIEW_FILTER_SAVE As ToolStripMenuItem
     Private WithEvents BTT_VIEW_FILTER_LOAD As ToolStripMenuItem
     Private WithEvents BTT_VIEW_FILTER_SAVE_AS_GROUP As ToolStripMenuItem
+    Private WithEvents MENU_INFO_USER_SEARCH As ToolStripMenuItem
 End Class

SCrawler/MainFrame.resx

@@ -171,6 +171,9 @@
   <metadata name="MENU_INFO.GenerateMember" type="System.Boolean, mscorlib, Version=4.0.0.0, Culture=neutral, PublicKeyToken=b77a5c561934e089">
     <value>False</value>
   </metadata>
+  <metadata name="MENU_INFO_SEP_1.GenerateMember" type="System.Boolean, mscorlib, Version=4.0.0.0, Culture=neutral, PublicKeyToken=b77a5c561934e089">
+    <value>False</value>
+  </metadata>
   <metadata name="MENU_VIEW_SEP_1.GenerateMember" type="System.Boolean, mscorlib, Version=4.0.0.0, Culture=neutral, PublicKeyToken=b77a5c561934e089">
     <value>False</value>
   </metadata>

SCrawler/MainFrame.vb

@@ -241,13 +241,13 @@ CloseResume:
 
         If Not b Then
             b = True
-            If e.Control And e.KeyCode = Keys.F Then
+            If Settings.ShortcutOpenFeed = e Then
                 BTT_FEED.PerformClick()
             ElseIf e.Alt And e.KeyCode = Keys.A Then
                 BTT_DOWN_AUTOMATION.PerformClick()
             ElseIf e.Alt And e.KeyCode = Keys.P Then
                 BTT_PR_INFO.PerformClick()
-            ElseIf e.Alt And e.KeyCode = Keys.F Then
+            ElseIf Settings.ShortcutOpenSearch = e Or (e.Alt And e.KeyCode = Keys.U) Or (e.Control And e.KeyCode = Keys.U) Then
                 MySearch.FormShow()
             Else
                 b = False
@@ -479,6 +479,9 @@ CloseResume:
     Private Sub MENU_INFO_SHOW_USER_METRICS_Click(sender As Object, e As EventArgs) Handles MENU_INFO_SHOW_USER_METRICS.Click
         MyUserMetrics.FormShow(EDP.LogMessageValue)
     End Sub
+    Private Sub MENU_INFO_USER_SEARCH_Click(sender As Object, e As EventArgs) Handles MENU_INFO_USER_SEARCH.Click
+        MySearch.FormShow()
+    End Sub
 #End Region
     Friend Sub ShowFeed() Handles BTT_FEED.Click, BTT_TRAY_FEED_SHOW.Click
         If MyFeed Is Nothing Then
@@ -1517,6 +1520,8 @@ CloseResume:
                 If Not user Is Nothing AndAlso user.IsCollection Then
                     With DirectCast(user, UserDataBind)
                         BTT_CONTEXT_DOWN.DropDownItems.AddRange(.ContextDown)
+                        BTT_CONTEXT_DOWN_LIMITED.DropDownItems.AddRange(.ContextDownLimit)
+                        BTT_CONTEXT_DOWN_DATE_LIMIT.DropDownItems.AddRange(.ContextDownDate)
                         BTT_CONTEXT_EDIT.DropDownItems.AddRange(.ContextEdit)
                         BTT_CONTEXT_DELETE.DropDownItems.AddRange(.ContextDelete)
                         BTT_CONTEXT_ERASE.DropDownItems.AddRange(.ContextErase)
@@ -1526,6 +1531,8 @@ CloseResume:
                 End If
             Else
                 BTT_CONTEXT_DOWN.DropDownItems.Clear()
+                BTT_CONTEXT_DOWN_LIMITED.DropDownItems.Clear()
+                BTT_CONTEXT_DOWN_DATE_LIMIT.DropDownItems.Clear()
                 BTT_CONTEXT_EDIT.DropDownItems.Clear()
                 BTT_CONTEXT_DELETE.DropDownItems.Clear()
                 BTT_CONTEXT_ERASE.DropDownItems.Clear()
@@ -1631,10 +1638,11 @@ CloseResume:
             Return ErrorsDescriber.Execute(EDP.SendToLog + EDP.ReturnValue, ex, "[MainFrame.GetSelectedUserArray]", New List(Of IUserData))
         End Try
     End Function
-    Private Enum DownUserLimits : None : Number : [Date] : End Enum
-    Private Sub DownloadSelectedUser(ByVal UseLimits As DownUserLimits, Optional ByVal IncludeInTheFeed As Boolean = True)
+    Friend Enum DownUserLimits : None : Number : [Date] : End Enum
+    Friend Sub DownloadSelectedUser(ByVal UseLimits As DownUserLimits, Optional ByVal IncludeInTheFeed As Boolean = True,
+                                    Optional ByVal SUser As IUserData = Nothing)
         Const MsgTitle$ = "Download limit"
-        Dim users As List(Of IUserData) = GetSelectedUserArray()
+        Dim users As List(Of IUserData) = If(SUser Is Nothing, GetSelectedUserArray(), New List(Of IUserData) From {SUser})
         If users.ListExists Then
             Dim limit%? = Nothing
             Dim _from As Date? = Nothing
@@ -1701,7 +1709,7 @@ ResumeDownloadingOperation:
                                                $"Do you want to download them all{fStr}?{vbNewLine.StringDup(2)}" &
                                                $"Selected users:{vbNewLine}{uStr}", "Multiple users selected"},
                                               MsgBoxStyle.Question + MsgBoxStyle.YesNo) = MsgBoxResult.Yes Then
-                users.ForEach(Sub(u)
+                users.ForEach(Sub(ByVal u As IUserData)
                                   u.DownloadTopCount = limit
                                   u.DownloadDateFrom = _from
                                   u.DownloadDateTo = _to

SCrawler/My Project/AssemblyInfo.vb

@@ -13,7 +13,7 @@ Imports System.Runtime.InteropServices
 <Assembly: AssemblyDescription("Social networks media downloader")>
 <Assembly: AssemblyCompany("AndyProgram")>
 <Assembly: AssemblyProduct("SCrawler")>
-<Assembly: AssemblyCopyright("Copyright © 2024")>
+<Assembly: AssemblyCopyright("Copyright © 2025")>
 <Assembly: AssemblyTrademark("AndyProgram")>
 
 <Assembly: ComVisible(False)>
@@ -32,6 +32,6 @@ Imports System.Runtime.InteropServices
 ' by using the '*' as shown below:
 ' <Assembly: AssemblyVersion("1.0.*")>
 
-<Assembly: AssemblyVersion("2024.7.24.0")>
-<Assembly: AssemblyFileVersion("2024.7.24.0")>
+<Assembly: AssemblyVersion("2025.1.12.0")>
+<Assembly: AssemblyFileVersion("2025.1.12.0")>
 <Assembly: NeutralResourcesLanguage("en")>

SCrawler/My Project/Resources.Designer.vb

@@ -150,6 +150,16 @@ Namespace My.Resources
             End Get
         End Property
         
+        '''<summary>
+        '''  Looks up a localized resource of type System.Drawing.Bitmap.
+        '''</summary>
+        Friend ReadOnly Property FindPic_16() As System.Drawing.Bitmap
+            Get
+                Dim obj As Object = ResourceManager.GetObject("FindPic_16", resourceCulture)
+                Return CType(obj,System.Drawing.Bitmap)
+            End Get
+        End Property
+        
         '''<summary>
         '''  Looks up a localized resource of type System.Drawing.Bitmap.
         '''</summary>

SCrawler/My Project/Resources.resx

@@ -223,4 +223,7 @@
   <data name="CutPic_48" type="System.Resources.ResXFileRef, System.Windows.Forms">
     <value>..\Content\Pictures\CutPic_48.png;System.Drawing.Bitmap, System.Drawing, Version=4.0.0.0, Culture=neutral, PublicKeyToken=b03f5f7f11d50a3a</value>
   </data>
+  <data name="FindPic_16" type="System.Resources.ResXFileRef, System.Windows.Forms">
+    <value>..\Content\Pictures\FindPic_16.png;System.Drawing.Bitmap, System.Drawing, Version=4.0.0.0, Culture=neutral, PublicKeyToken=b03f5f7f11d50a3a</value>
+  </data>
 </root>

SCrawler/PluginsEnvironment/Attributes/Attributes.vb

@@ -60,4 +60,7 @@ Namespace Plugin.Attributes
             PropertyName = _PropertyName
         End Sub
     End Class
+    <AttributeUsage(AttributeTargets.Class, AllowMultiple:=False)>
+    Public Class UseDownDetectorAttribute : Inherits Attribute
+    End Class
 End Namespace

SCrawler/PluginsEnvironment/Hosts/SettingsHost.vb

@@ -184,6 +184,16 @@ Namespace Plugin.Hosts
         End Sub
         Friend ReadOnly Property IsSeparatedTasks As Boolean = False
         Friend ReadOnly Property IsSavedPostsCompatible As Boolean = False
+        Friend ReadOnly Property IsDownDetectorCompatible As Boolean = False
+        Friend ReadOnly Property DownDetectorValue As Integer
+            Get
+                If IsDownDetectorCompatible Then
+                    Return DirectCast(Source, DownDetector.IDownDetector).Value
+                Else
+                    Return -1
+                End If
+            End Get
+        End Property
         Private ReadOnly _TaskCountDefined As Integer? = Nothing
         Friend ReadOnly Property TaskCount As Integer
             Get
@@ -296,6 +306,8 @@ Namespace Plugin.Hosts
                         End With
                     ElseIf TypeOf a Is ReplaceInternalPluginAttribute Then
                         Replacer = a
+                    ElseIf TypeOf a Is UseDownDetectorAttribute Then
+                        IsDownDetectorCompatible = True
                     End If
                 Next
             End If
@@ -521,18 +533,34 @@ Namespace Plugin.Hosts
         Friend Function GetUserPostUrl(ByVal User As IPluginContentProvider, ByVal Media As IUserMedia) As String
             Return Source.GetUserPostUrl(User, Media)
         End Function
-        Private _AvailableValue As Boolean = True
-        Private _AvailableAsked As Boolean = False
+        Friend Property AvailableValue As Boolean = True
+        Friend Property AvailableAsked As Boolean = False
+        Friend Property AvailableDownDetectorAsked As Boolean = False
         Private _ActiveTaskCount As Integer = 0
         Friend Property AvailableText As String = String.Empty
+        Friend Function AvailableDownDetector(ByVal What As Download, ByVal Silent As Boolean) As Boolean
+            If Not AvailableDownDetectorAsked Then
+                AvailableDownDetectorAsked = True
+                If IsDownDetectorCompatible Then
+                    AvailableValue = DirectCast(Source, DownDetector.IDownDetector).Available(What, Silent)
+                    If Not AvailableValue Then AvailableText = Source.AvailableText : AvailableAsked = True
+                    Return AvailableValue
+                Else
+                    Return True
+                End If
+            Else
+                Return AvailableValue
+            End If
+        End Function
         Friend Function Available(ByVal What As Download, ByVal Silent As Boolean) As Boolean
             If DownloadSiteData Then
-                If Not _AvailableAsked Then
-                    _AvailableValue = Source.Available(What, Silent)
+                If Not AvailableDownDetectorAsked AndAlso Not AvailableDownDetector(What, Silent) Then Return AvailableValue
+                If Not AvailableAsked Then
+                    AvailableValue = Source.Available(What, Silent)
                     AvailableText = Source.AvailableText
-                    _AvailableAsked = True
+                    AvailableAsked = True
                 End If
-                Return _AvailableValue
+                Return AvailableValue
             Else
                 AvailableText = $"Downloading data for the site {Name} - {AccountName.IfNullOrEmpty(NameAccountNameDefault)} has been disabled by you."
                 If Not Silent Then MsgBoxE({AvailableText, $"{Name} downloading disabled"}, vbExclamation)
@@ -551,7 +579,7 @@ Namespace Plugin.Hosts
         End Sub
         Friend Sub DownloadDone(ByVal What As Download)
             _ActiveTaskCount -= 1
-            If _ActiveTaskCount = 0 Then _AvailableAsked = False : AvailableText = String.Empty
+            If _ActiveTaskCount = 0 Then AvailableAsked = False : AvailableDownDetectorAsked = False : AvailableText = String.Empty
             Source.DownloadDone(What)
         End Sub
         Private Function ConvertUser(ByVal User As IUserData) As Object

SCrawler/PluginsEnvironment/Hosts/SettingsHostCollection.vb

@@ -335,7 +335,7 @@ Namespace Plugin.Hosts
                                                         ByVal ColNameOld As String, ByVal ColNameNew As String) As Boolean
             Dim p As PauseModes = NoPauseMode
             Try
-                If UpdateHostPath_CheckDownloader() Then Return False
+                If Not UpdateHostPath_CheckDownloader() Then Return False
                 If Not AEquals(Of String)(PathOld.PathWithSeparator, PathNew.PathWithSeparator) Or Not AEquals(Of String)(ColNameOld, ColNameNew) Then
                     p = Settings.Automation.Pause
                     Settings.Automation.Pause = PauseModes.Unlimited
@@ -365,7 +365,7 @@ Namespace Plugin.Hosts
                                                         Optional ByVal ForceCollections As Boolean = False) As Boolean
             Dim p As PauseModes = NoPauseMode
             Try
-                If UpdateHostPath_CheckDownloader() Then Return False
+                If Not UpdateHostPath_CheckDownloader() Then Return False
                 If Not PathNew.IsEmptyString And Settings.UsersList.Count > 0 Then
                     Dim hp As SFile = Host.Path(False, True)
                     Dim diffPaths As Boolean = (Abs And hp.PathWithSeparator = PathOld.PathWithSeparator) Or
@@ -469,37 +469,59 @@ Namespace Plugin.Hosts
                     Return False
                 End If
             Else
-                Dim a As Boolean = False, n As Boolean = False
+                Dim a As Boolean = False, n As Boolean = False, aDown As Boolean = True
                 Dim t$ = String.Empty
                 Dim tExists As Boolean = False
                 Dim singleHost As Boolean = hnExists AndAlso HostNames.Count = 1
                 Dim m As New MMessage("", "Some of the hosts are unavailable",, vbExclamation)
-                For i% = 0 To Count - 1
-                    If Not hnExists OrElse HostNames.Contains(Hosts(i).AccountName) Then
-                        If Hosts(i).Available(What, True) Then
-                            a = True
-                        Else
-                            n = True
-                            If Not Hosts(i).AvailableText.IsEmptyString Then
-                                t &= vbCr
-                                t.StringAppendLine($"{Name} - {Hosts(i).AccountName.IfNullOrEmpty(SettingsHost.NameAccountNameDefault)}:")
-                                t.StringAppendLine(Hosts(i).AvailableText)
-                                tExists = True
+                If [Default].IsDownDetectorCompatible Then
+                    Dim sh As SettingsHost = Nothing
+                    Dim defdvalue% = [Default].DownDetectorValue
+                    If hnExists AndAlso Not Hosts.All(Function(h) h.DownDetectorValue = defdvalue) Then _
+                       sh = Hosts.Find(Function(h) h.AccountName = HostNames(0))
+                    If sh Is Nothing Then sh = [Default]
+                    aDown = sh.AvailableDownDetector(What, Silent)
+                    Hosts.ForEach(Sub(ByVal h As SettingsHost)
+                                      h.AvailableDownDetectorAsked = True
+                                      If Not aDown And Not Silent Then h.AvailableValue = False : h.AvailableAsked = True
+                                  End Sub)
+                End If
+                If aDown Then
+                    For i% = 0 To Count - 1
+                        If Not hnExists OrElse HostNames.Contains(Hosts(i).AccountName) Then
+                            If Hosts(i).Available(What, True) Then
+                                a = True
                             Else
-                                t.StringAppendLine($"{Name} - {Hosts(i).AccountName.IfNullOrEmpty(SettingsHost.NameAccountNameDefault)}")
+                                n = True
+                                If Not Hosts(i).AvailableText.IsEmptyString Then
+                                    t &= vbCr
+                                    t.StringAppendLine($"{Name} - {Hosts(i).AccountName.IfNullOrEmpty(SettingsHost.NameAccountNameDefault)}:")
+                                    t.StringAppendLine(Hosts(i).AvailableText)
+                                    tExists = True
+                                Else
+                                    t.StringAppendLine($"{Name} - {Hosts(i).AccountName.IfNullOrEmpty(SettingsHost.NameAccountNameDefault)}")
+                                End If
+                                If FillIndexes Then HostsUnavailableIndexes.Add(i)
                             End If
-                            If FillIndexes Then HostsUnavailableIndexes.Add(i)
                         End If
-                    End If
-                Next
+                    Next
+                Else
+                    If Not Silent Then Silent = True
+                    a = False
+                    n = True
+                    If Not [Default].AvailableText.IsEmptyString Then t = [Default].AvailableText : tExists = Not t.IsEmptyString
+                End If
+
                 t = t.StringTrim
                 If singleHost Then
                     m.Text = "The host is unavailable."
                 Else
                     m.Text = "Some of the hosts are unavailable."
                 End If
-                If HostNamesPassed And Not hnExists Then Silent = True
-                If a And Not n Then
+                If HostNamesPassed And Not hnExists And aDown Then Silent = True
+                If Not aDown And Not Silent Then
+                    Return False
+                ElseIf a And Not n Then
                     Return True
                 ElseIf Not a And n Then
                     If Not Silent And tExists Then m.Text &= $"{vbCr}{vbCr}{t}" : m.Show()

SCrawler/SCrawler.vbproj

@@ -798,6 +798,7 @@
     <Content Include="API\OnlyFans\DynamicRulesAll.txt" />
     <Content Include="API\OnlyFans\OFScraperConfigPatternConstants.txt" />
     <Content Include="Content\Pictures\CutPic_48.png" />
+    <Content Include="Content\Pictures\FindPic_16.png" />
   </ItemGroup>
   <Import Project="$(MSBuildToolsPath)\Microsoft.VisualBasic.targets" />
   <Target Name="EnsureNuGetPackageBuildImports" BeforeTargets="PrepareForBuild">

SCrawler/SettingsCLS.vb

@@ -10,6 +10,7 @@ Imports PersonalUtilities.Functions.Messaging
 Imports PersonalUtilities.Functions.XML
 Imports PersonalUtilities.Functions.XML.Base
 Imports PersonalUtilities.Functions.XML.Objects
+Imports PersonalUtilities.Forms
 Imports PersonalUtilities.Forms.Controls
 Imports PersonalUtilities.Forms.Controls.Base
 Imports PersonalUtilities.Tools
@@ -193,6 +194,17 @@ Friend Class SettingsCLS : Implements IDownloaderSettings, IDisposable
     Private ReadOnly UsersSettingsFile As SFile = $"{SettingsFolderName}\Users.xml"
     Private ReadOnly Property SettingsVersion As XMLValue(Of Integer)
     Private Const SettingsVersionCurrent As Integer = 1
+    Friend ShortcutOpenFeed As New ButtonKey(Keys.F, True)
+    Friend ShortcutOpenSearch As New ButtonKey(Keys.F,, True)
+    Private Sub ChangeFeedOpenMode()
+        If FeedOpenCtrlF Then
+            ShortcutOpenFeed = New ButtonKey(Keys.F, True)
+            ShortcutOpenSearch = New ButtonKey(Keys.F,, True)
+        Else
+            ShortcutOpenFeed = New ButtonKey(Keys.F,, True)
+            ShortcutOpenSearch = New ButtonKey(Keys.F, True)
+        End If
+    End Sub
 #End Region
 #Region "Initializer"
     Friend Sub New()
@@ -299,6 +311,9 @@ Friend Class SettingsCLS : Implements IDownloaderSettings, IDisposable
         DownloadAll_UseF6 = New XMLValue(Of Boolean)("DownloadAll_UseF6", True, MyXML, n)
         DownloadAll_UseF6_Confirm = New XMLValue(Of Boolean)("DownloadAll_UseF6_Confirm", False, MyXML, n)
         DownloadAll_Confirm = New XMLValue(Of Boolean)("DownloadAll_Confirm", False, MyXML, n)
+        FeedOpenCtrlF = New XMLValue(Of Boolean)("FeedOpenCtrlF", True, MyXML, n)
+        AddHandler FeedOpenCtrlF.ValueChanged, AddressOf ChangeFeedOpenMode
+        ChangeFeedOpenMode()
 
         'Notifications
         n = {"Notifications"}
@@ -351,6 +366,7 @@ Friend Class SettingsCLS : Implements IDownloaderSettings, IDisposable
         ReparseMissingInTheRoutine = New XMLValue(Of Boolean)("ReparseMissingInTheRoutine", False, MyXML, n)
         UseDefaultAccountIfMissing = New XMLValue(Of Boolean)("UseDefaultAccountIfMissing", True, MyXML, n)
         AutomationBrushUndownloadedPlansMinutes = New XMLValue(Of Integer)("AutomationBrushUndownloadedPlansMinutes", 10080, MyXML, n)
+        DownDetectorEnabled = New XMLValue(Of Boolean)("DownDetectorEnabled", True, MyXML, n)
 
         'Downloading: file naming
         n = {"Downloading", "FileName"}
@@ -925,6 +941,7 @@ Friend Class SettingsCLS : Implements IDownloaderSettings, IDisposable
     Friend ReadOnly Property DownloadAll_UseF6 As XMLValue(Of Boolean)
     Friend ReadOnly Property DownloadAll_UseF6_Confirm As XMLValue(Of Boolean)
     Friend ReadOnly Property DownloadAll_Confirm As XMLValue(Of Boolean)
+    Friend ReadOnly Property FeedOpenCtrlF As XMLValue(Of Boolean)
 #End Region
 #Region "Notifications"
     Friend Enum NotificationObjects
@@ -1048,6 +1065,7 @@ Friend Class SettingsCLS : Implements IDownloaderSettings, IDisposable
     Friend ReadOnly Property ReparseMissingInTheRoutine As XMLValue(Of Boolean)
     Friend ReadOnly Property UseDefaultAccountIfMissing As XMLValue(Of Boolean)
     Friend ReadOnly Property AutomationBrushUndownloadedPlansMinutes As XMLValue(Of Integer)
+    Friend ReadOnly Property DownDetectorEnabled As XMLValue(Of Boolean)
 #End Region
 #Region "Downloading: file naming"
     Friend ReadOnly Property FileAddDateToFileName As XMLValue(Of Boolean)

SCrawler/UserImage.vb

@@ -13,6 +13,25 @@ Friend Class UserImage : Inherits ImageRenderer
     Friend Const ImagePostfix_Small As String = "_Small"
     Private _LargeAddress As SFile
     Private _SmallAddress As SFile
+    Private _ForceSaveOrig As Boolean = False
+    Friend Shared Function NewUserPicture(ByVal ImageOrig As SFile, ByVal Destination As SFile,
+                                          Optional ByVal Save As Boolean = True, Optional ByVal GetInstance As Boolean = False) As UserImage
+        Dim uImg As New UserImage(ImageOrig, Destination)
+        With uImg
+            ._ForceSaveOrig = ImageOrig.Extension.IsEmptyString OrElse ImageOrig.Extension.ToLower = "gif" OrElse Not {"jpg", "jpeg", "png"}.Contains(ImageOrig.Extension.ToLower)
+            If Not ._ForceSaveOrig Then
+                If .Address.Exists AndAlso Not .Address.Delete(SFO.File,, EDP.ReturnValue) Then ._ForceSaveOrig = True
+                If Not ._ForceSaveOrig AndAlso Not ImageOrig.Copy(.Address) Then ._ForceSaveOrig = True
+            End If
+            If Not ._ForceSaveOrig Then
+                ._SmallAddress.Extension = .Address.Extension
+                ._LargeAddress.Extension = .Address.Extension
+            End If
+            If Save Then .Save()
+        End With
+        If Not GetInstance Then uImg.Dispose() : uImg = Nothing
+        Return uImg
+    End Function
     Friend Sub New(ByVal _ImgOriginal As SFile, ByVal Destination As SFile, Optional ByVal GenerateLargeSmallPictures As Boolean = True)
         MyBase.New(_ImgOriginal)
         Dim f As SFile = Destination
@@ -71,7 +90,7 @@ Friend Class UserImage : Inherits ImageRenderer
         End With
     End Function
     Public Overrides Sub Save()
-        MyBase.Save()
+        If _ForceSaveOrig Then MyBase.Save()
         Small.Save(_SmallAddress)
         Large.Save(_LargeAddress)
     End Sub

Tools/ArchiveSCrawlerUsersDataFiles.bat

@@ -4,4 +4,8 @@ REM Replace 'd:\Downloads\SocialNetworks\' with the path to your SCrawler data f
 REM THIS SCRIPT IS NOT SUITABLE FOR 7ZIP OR OTHER ARCHIVING PROGRAMS.
 REM But I believe 7Zip also has CLI commands
 
-"C:\Program Files\WinRAR\WinRAR.exe" a -r -ep1 -o+ -ag_YYYYMMDD_HHMMSS -m5 -tl -n*.txt -n*.xml "d:\Downloads\SocialNetworks\SCrawlerBackup.rar" "d:\Downloads\SocialNetworks\"
+REM This line archives SCrawler settings files.
+"C:\Program Files\WinRAR\WinRAR.exe" a -r -ep1 -o+ -ag_YYYYMMDD_HHMMSS -m5 -tl "D:\MyPrograms\SCrawler\Backup\Settings.rar" "D:\MyPrograms\SCrawler\Settings\"
+
+REM This line archives SCrawler users' settings files.
+"C:\Program Files\WinRAR\WinRAR.exe" a -r -ep1 -o+ -ag_YYYYMMDD_HHMMSS -m5 -tl -n*.txt -n*.xml "D:\MyPrograms\SCrawler\Backup\SCrawlerBackup.rar" "D:\MyPrograms\SCrawler\Data\"