3.0.0.1

Added DownloadLimitDate, update and Reset functions in the plugin, DateLimit property in the IPluginContentProvider
Fixed donation button link, images loading error, cookies error, instagram settings form, minor bugs.

.github/FUNDING.yml

@@ -0,0 +1,13 @@
+# These are supported funding model platforms
+
+github: # Replace with up to 4 GitHub Sponsors-enabled usernames e.g., [user1, user2]
+patreon: # Replace with a single Patreon username
+open_collective: # Replace with a single Open Collective username
+ko_fi: andyprogram
+tidelift: # Replace with a single Tidelift platform-name/package-name e.g., npm/babel
+community_bridge: # Replace with a single Community Bridge project-name e.g., cloud-foundry
+liberapay: # Replace with a single Liberapay username
+issuehunt: # Replace with a single IssueHunt username
+otechie: # Replace with a single Otechie username
+lfx_crowdfunding: # Replace with a single LFX Crowdfunding project-name e.g., cloud-foundry
+custom: ['https://blockchair.com/bitcoin/address/BC1Q0NH839FT5TA44DD7L7RLR97XDQAG9V8D6N7XET']

.github/ISSUE_TEMPLATE/bug_report.md

@@ -0,0 +1,33 @@
+---
+name: Bug report
+about: Create a report to help us improve
+title: "[BUG]"
+labels: bug
+assignees: ''
+
+---
+
+**Describe the bug**
+A clear and concise description of what the bug is.
+
+**To Reproduce**
+Steps to reproduce the behavior:
+1. Profile URL: 
+2. Do something
+3. See error
+
+**Log data**
+If the program log contains any data.
+
+**Expected behavior**
+A clear and concise description of what you expected to happen.
+
+**Screenshots**
+If applicable, add screenshots to help explain your problem.
+
+**Release information (please complete the following information):**
+ - Architecture [e.g. x86, x64]
+ - Version [e.g. 2.0.0.0]
+
+**Additional context**
+Add any other context about the problem here.

.github/ISSUE_TEMPLATE/custom.md

@@ -0,0 +1,10 @@
+---
+name: Custom issue template
+about: Describe this issue template's purpose here.
+title: ''
+labels: ''
+assignees: ''
+
+---
+
+

.github/ISSUE_TEMPLATE/feature_request.md

@@ -0,0 +1,20 @@
+---
+name: Feature request
+about: Suggest an idea for this project
+title: "[REQUEST]"
+labels: enhancement
+assignees: ''
+
+---
+
+**Is your feature request related to a problem? Please describe.**
+A clear and concise description of what the problem is. Ex. I'm always frustrated when [...]
+
+**Describe the solution you'd like**
+A clear and concise description of what you want to happen.
+
+**Describe alternatives you've considered**
+A clear and concise description of any alternative solutions or features you've considered.
+
+**Additional context**
+Add any other context or screenshots about the feature request here.

.github/ISSUE_TEMPLATE/plugin_add.md

@@ -0,0 +1,12 @@
+---
+name: Add plugin
+about: Add plugin to plugin list
+title: "[NEW PLUGIN]"
+labels: 'New Plugin'
+assignees: ''
+
+---
+
+Plugin address:
+Plugin name:
+Plugin site:

CONTRIBUTING.md

@@ -0,0 +1,41 @@
+# Contributor's Guide
+
+I welcome requests! Follow these steps to contribute:
+
+1. Find an [issue](https://github.com/AAndyProgram/SCrawler/issues) that needs assistance.
+2. Let me know you are working on it by posting a comment on the issue.
+3. If you find an error in the code, please provide a link to the file and the line number.
+4. If you have a suggestion to change the code, you can post a block of code to replace. I don't currently have time to learn pull requests, so it might work this way.
+
+# How to build from source
+
+1. Delete the "PersonalUtilities" project from the solution.
+2. Add the latest version of the "PersonalUtilities.dll" library (from the [latest release](https://github.com/AAndyProgram/SCrawler/releases/latest)).
+3. Import PersonalUtilities.Functions for the whole project.
+
+**Always use the correct "PersonalUtilities.dll" library. You must download this library from the release of the code you downloaded.**
+
+# How to request a new site
+
+1. Check [issues](https://github.com/AAndyProgram/SCrawler/issues) (open and [closed](https://github.com/AAndyProgram/SCrawler/issues?q=is%3Aissue+is%3Aclosed)) and [discussions](https://github.com/AAndyProgram/SCrawler/discussions) to find your issue. Perhaps I have already answered your request.
+2. If you don't find anything, create a new issue with your request. I usually reply as soon as possible (within the next few hours).
+    - If I'm interested in a site you want to add, it may be added in future releases.
+      - If the site has an API that does not require authorization, it may be added in the coming releases.
+      - You can make it faster by posting a link to the API. **I don't use OAuth authentication** in my application, so if it's not too hard to make a new parsing algorithm **without OAuth** authorization, I can start developing it in the coming days. Otherwise, I need time to figure out how to do it.
+      - If the site does not have an API that does not require authorization, this may take some time.
+	- If you will be posting request urls **without OAuth** authentication, I might consider adding your site if I have time.
+    - If I'm **not** interested in the site you want to add, you can pay to have it added by making a donation of approximately $10. **But before that, you still need to create an issue. If I'm not interested, you can offer me a deal to develop it for money. I'll check the site you want to add, check the availability of the API and tell you how much time I need to develop it and the price. If you agree, I will do it.** [![ko-fi](https://www.ko-fi.com/img/githubbutton_sm.svg)](https://ko-fi.com/andyprogram)
+    
+    
+# Sites I will never develop
+
+- Facebook
+
+# Sites requested by users
+
+- TikTok
+  - API for receiving data without authorization was not found. Therefore, I don't have time to start developing this site parsing algorithm. If anyone knows of requests that may collect data without OAuth authentication, please let me know.
+  
+# Contact me
+
+[![matrix](https://img.shields.io/badge/Matrix-%40andyprogram%3Amatrix.org-informational)](https://matrix.to/#/@andyprogram:matrix.org)

Changelog.md

@@ -1,3 +1,132 @@
+# 3.0.0.1
+
+- Added
+  - Download data up to a specific date
+  - Update and Reset functions in the plugin (ISiteSettings)
+  - PostsDateLimit propperty in the plugin (IPluginContentProvider)
+- Fixed
+  - The donation button redirects to a broken link
+  - In some cases, an error occurs when fast loading images
+  - In some cases, cookies are not saved
+  - Some design fixes
+  - Minor bugs
+
+# 3.0.0.0
+
+**Attention! This version of the program makes changes user data file (Users.xml). Once you start using this version, you will not be able to use previous versions of the program. Therefore, it is highly recommended to archive the program settings folder and archive the users' data files (you can use the [```ArchiveSCrawlerUsersDataFiles.bat```](Tools/ArchiveSCrawlerUsersDataFiles.bat) tool to archive the data files of all users).**
+
+- Added
+  - **PLUGINS SUPPORT**
+  - **Gfycat** site support
+  - Description of Twitter and Reddit user profiles
+  - Filter users by profile status "Suspended"
+  - Filter users by profile status "Deleted"
+  - Filter profiles that haven't downloaded new data since specific date
+  - Collections that contain non-existent profiles will be marked in blue
+  - Ability to find and activate a user in the main window from the Info form
+  - Ability to copy user images from all channels you have when adding a user from a channel
+  - Reddit default option "Get user media only" if now also used when creating new users from channels
+  - Ability to update user description every time
+  - ```Enter``` hotkey in the download info form to open the user's folder
+  - ```Enter``` hotkey in the main window to open the user's folder
+  - Channel statistics are supplemented by "existing users"
+  - ```Up``` and ```Down``` navigation buttons in the Info form
+  - ```Find``` button on the Info form to find the user in the main window
+  - "Details" view mode
+  - Fast loading of profiles in the main window. **Be careful with this setting. Fast loading leads to the highest CPU usage.**
+  - Reddit availability check with DownDetector
+  - Ability to [open folders with a specific program](https://github.com/AAndyProgram/SCrawler/wiki/Settings#folder-command)
+  - (Request #16) Ability to remove a user from the collection without deletion
+  - (Request #17) **Instagram Tagged** photos downloading
+  - (Request #17) **Instagram Stories** downloading
+  - Deleting data to recycle bin
+- Updated
+  - "List" view mode
+- Fixed
+  - Twitter reloads existing media
+  - Reddit saved posts downloader downloads all posts every time
+  - Minor bug that caused Instagram tasks timers to run longer
+  - A library error that in some cases leads to a fatal program error
+  - (Issue #16) Cannot delete a user that is in the collection.
+
+At the requests of some users, I added [screenshots](ProgramScreenshots) of the program and added screenshots to [ReadMe](README.md) and the [guide](https://github.com/AAndyProgram/SCrawler/wiki).
+
+# 2.0.0.4
+
+**Removed compatibility of program settings with version 1.0.0.4 and lower.**
+
+**If your program version is 1.0.0.4 and lower, it is strongly recommended that you upgrade to release 2.0.0.1 to update the program settings (and run the program). Then update to this release. Otherwise, you will have to configure the program settings again**
+
+**If your program version is 1.0.1.0 or higher, you should not pay attention to this message.**
+
+- Added
+  - Ability to specify the path to store saved posts
+- Fixed
+  - **Error when specifying network paths**
+  - Minor bugs
+
+# 2.0.0.3
+
+**Removed compatibility of program settings with version 1.0.0.4 and lower.**
+
+**If your program version is 1.0.0.4 and lower, it is strongly recommended that you upgrade to release 2.0.0.1 to update the program settings (and run the program). Then update to this release. Otherwise, you will have to configure the program settings again**
+
+**If your program version is 1.0.1.0 or higher, you should not pay attention to this message.**
+
+- Added
+  - The "Get User Media Only" setting is now available for Reddit. If checked then "CrossPosts" will be skipped, otherwise "CrossPosts" will be included.
+- Fixed
+  - In some cases, the program did not parse all Reddit posts.
+  - Collection ignored when validated when creating a new user
+  - Incorrect number of Instagram profiles downloads per session
+
+# 2.0.0.2
+
+**This is the last release that supports program settings of version 1.0.0.4 and lower. Compatibility of program settings with version 1.0.0.4 and lower will be removed in future releases. It is strongly recommended that you upgrade to this release before future releases. Otherwise, you will have to configure the program settings again. If your program version is 1.0.1.0 or higher, you should not pay attention to this message.**
+
+- Added
+  - Tray icon
+  - Close program to tray
+  - Close confirmation dialog
+  - **Separated thread for downloading Instagram profiles**
+  - **Wait timers to bypass Instagram error "Too Many Requests" (429)**
+  - **Downloading saved Instagram posts** *(requires a second InstaHash)*
+  - Downloading saved posts (from Reddit and Instagram) form
+  - Tray notification when download is complete (Instagram notification separate from other)
+  - Downloading not downloaded Instagram posts when a 429 error is encountered and/or the user stops downloading
+  - Separate progress bar for downloading Instagram profiles
+  - Clear information about downloaded profiles of the current session in the "Download info form"
+  - Increased the number of Instagram posts (from 12 to 50) received per request
+  - Channels' statistics
+  - **RedGifs profiles support**
+- Fixed
+  - The program was showing incorrect information about the total numbers of images and videos downloaded when a Reddit user was created from a channel
+
+# 2.0.0.1
+
+- Added
+  - Download individual Imgur media files (use the "Download video" form).
+- Fixed
+  - Incorrect filling of user parameters in the user creation form
+  - In some cases, the global settings cannot be saved.
+
+# 2.0.0.0
+
+- Added
+  - **Instagram**
+  - Filter by site
+  - Group for regular channels in the main window
+  - Ability to change user/collection path
+  - Imgur albums downloading
+  - NSFW Imgur content bypass (requires 'ClientID')
+  - Special user folder
+  - Remove user while keeping data
+  - Disabled overriding user preferences when creating a new user if it already exists in the destination (in case of deleting a user with saving data).
+  - **Saved Reddit posts downloading**
+- Fixed
+  - Suspended profiles do not change status if the profile is no longer suspended
+  - Limited download for Twitter not implemented
+
 # 1.0.1.0
 
 - Added

FAQ.md

@@ -0,0 +1,67 @@
+# Frequently asked questions
+
+**Please read the [GUIDE](https://github.com/AAndyProgram/SCrawler/wiki/) Before asking a question!**
+
+Most of your questions are already answered. All settings, functions, buttons and everything else described in the guide.
+
+Any other questions I will keep in this file.
+
+----
+
+#### Q: **HOW TO SETUP COOKIES**
+
+A: https://github.com/AAndyProgram/SCrawler/wiki/Settings#how-to-set-up-cookies
+
+----
+
+#### Q: **I can't copy cookies.**
+
+A: Use the mouse. Don't use ```Ctrl``` + ```A```!
+
+----
+
+#### Q: **Does this program have GUI or CLI.**
+
+A: This is a GUI program.
+
+----
+
+#### Q: **Will CLI be added in the future?**
+
+A: I do not think so.
+
+----
+
+#### Q: **I want to add "...." site. How to request.**
+
+A: How to request a new site you can read [here](CONTRIBUTING.md#how-to-request-a-new-site)
+
+----
+
+#### Q: **Twitter/Instagram download failed.**
+
+A: Check your credentials. Both of these sites require cookies. Check your [Twitter tokens](https://github.com/AAndyProgram/SCrawler/wiki/Settings#how-to-find-twitter-tokens) and [Instagram settings](https://github.com/AAndyProgram/SCrawler/wiki/Settings#instagram-settings). If all settings are set, but nothing works, go to [create a new issue](https://github.com/AAndyProgram/SCrawler/issues). Don't forget to attach the LOG.
+
+----
+
+#### Q: **Does the program remember the last download and check for new posts, downloading only new posts? Or does the program download the entire profile every time?**
+
+A: The program stored posts IDs in users' folders. For the first time, the program downloads the entire profile. All subsequent times the program will check for new posts and download **only new posts**!
+
+----
+
+#### Q: **How to redownload all data**
+
+A: Double-click on the user you want to redownload. In the opened window open folder setting. Delete the files ending with ```_Data.xml```  and ```_Posts.txt```. Download this user again.
+
+----
+
+#### Q: **How to remove the label**
+
+A: There is no functionality to remove an individual label. You can open the ```Labels.txt``` file in the program settings folder and delete any label you want. You also can delete this file (```Labels.txt```). In this case, when the program starts, the list of labels list will be updated with only existing labels (from the user data files).
+
+----
+
+#### Q: **How to remove a user from the blacklist**
+
+A: Just add that user back to the program. In the dialog box that opens, click on the ```Add and remove from blacklist```` button.

HowToSupport.md

@@ -0,0 +1,11 @@
+Your support is very valuable to me. Any support is greatly appreciated. Your support encourages me to make new features, update the program, add new sites, etc.
+
+You can support the program by:
+  - **Bitcoin**: bitcoin:BC1Q0NH839FT5TA44DD7L7RLR97XDQAG9V8D6N7XET
+  - :heavy_dollar_sign: making donaion making donations on this site: https://ko-fi.com/andyprogram
+  - :repeat: make a post about my program on your profile (Reddit, Twitter, Instagram and any other social networks)
+  - :speech_balloon: tell your friends about the program
+  - :heart: like the program on this site: https://alternativeto.net/software/scrawler/about/
+  - suggest my program as an alternative ([on this site](https://alternativeto.net/software/scrawler/about/)) to any program you have used before
+
+I would be very grateful for any support! :blush:

Plugins.md

@@ -0,0 +1 @@
+List of available plugins

ProgramsComparison.md

@@ -0,0 +1,78 @@
+# 4K Stogram
+
+https://www.4kdownload.com/products/product-stogram
+
+| Option | SCrawler | 4K Stogram |
+| ---- | ---- | ---- |
+| User managament | **Advanced** | Primitive |
+| Labeling users | **Yes** | No |
+| Filtering | **Yes** | No |
+| Collections | **Yes** | No |
+| Specific user folders | **Yes** | No |
+| Favorite / Temporary user options | **Yes** | No |
+| Plugins support | **Yes** | No |
+| Download posts by username | Yes | Yes |
+| Download posts by hashtag | No | **Yes** |
+| Download posts by location | No | **Yes** |
+| Save Private Instagram Content with Permission| Yes | Yes |
+| Download Instagram Stories and Highlights | Yes | Yes |
+| See Others Instagram Feed As Your Own | No | **Yes** |
+| Download Instagram Video Posts | Yes | Yes |
+| Backup Your Instagram Account | Yes | Yes |
+| Save Instagram Posts by Date | No (only limited download) | **Yes** |
+| Download Instagram Saved Posts | Yes | Yes |
+| Download Instagram Tagged Posts | Yes | Yes |
+| Export and import subscriptions | No | **Yes** |
+| **Paid** | **No** | Yes |
+| **Free options** | **The program is completely free** | Only **ONE** profile downloading and only **200 posts** per day |
+| Permitted Commercial Use | **Yes** | Starting from 43.56 EUR |
+| Automatic Subscriptions Update | **Free** | Paid (43.56 EUR) |
+| Posts and Captions Export | No | Paid (43.56 EUR) |
+| Advertisements free | **No ADs at all for free** | Paid (14.52) |
+| Operating Systems | Windows 7+ | Windows 7+, MacOS 10.13+, Ubuntu x64 |
+| Select want content type to download | **Yes** | No |
+| Instagram support | Yes | Yes |
+| Twitter support | **Yes** | No |
+| Reddit support | **Yes** | No |
+| Other sites support | **Yes** | No |
+| Still supported | Yes | Yes |
+
+# RipMeApp
+
+https://github.com/RipMeApp/ripme
+
+| Option | SCrawler | RipMeApp |
+| ---- | ---- | ---- |
+| User managament | **Advanced** | No |
+| Labeling users | **Yes** | No |
+| Filtering | **Yes** | No |
+| Collections | **Yes** | No |
+| Specific user folders | **Yes** | No |
+| Favorite / Temporary user options | **Yes** | No |
+| Plugins support | **Yes** | No |
+| Download posts by username | Yes | Yes |
+| Download posts by hashtag | No | No |
+| Download posts by location | No | No |
+| Save Private Instagram Content with Permission| Yes | Yes |
+| Download Instagram Stories | Yes | Yes |
+| Download Instagram Video Posts | Yes | Yes |
+| Backup Your Instagram Account | Yes | Yes |
+| Download Instagram Saved Posts | **Yes** | No |
+| Download Instagram Tagged Posts | **Yes** | No |
+| Export and import subscriptions | No | No |
+| **Paid** | **No** | **No** |
+| **Free options** | The program is completely free | The program is completely free, but site limits are not declared |
+| Operating Systems | Windows 7+ | Windows, MacOS, Linux |
+| Select want content type to download | Yes | Yes |
+| Suported sites | 3 internal and any site using plugins | 86+ sites (declared) |
+| Other sites support | **Yes** | No |
+| Still supported | **Yes** | **No (last release date May 4, 2021)** |
+
+# gallery-dl
+
+https://github.com/mikf/gallery-dl
+
+
+**CLI tool**! Configured with JSON files only. Users need to learn complex configuration options, JSON, commands to use that tool. Very difficult to configure.
+
+SCrawler has advanced user management, collections, labels, groups, a beautiful view, GUI, the ability to add plugins for other sites and much more. Just try it and compare.

README.md

@@ -1,64 +1,140 @@
 # Social networks crawler
 
-Program for downloading photo and video from Reddit and Twitter
+[![GitHub release (latest by date)](https://img.shields.io/github/v/release/AAndyProgram/SCrawler)](https://github.com/AAndyProgram/SCrawler/releases/latest)
+[![GitHub](https://img.shields.io/github/license/AAndyProgram/SCrawler)](https://github.com/AAndyProgram/SCrawler/)
+[![FAQ](https://img.shields.io/badge/FAQ-green)](FAQ.md)
+[![GUIDE](https://img.shields.io/badge/GUIDE-green)](https://github.com/AAndyProgram/SCrawler/wiki)
+[![How to support](https://img.shields.io/badge/HowToSupport-green)](HowToSupport.md)
 
-Enjoying the tool? Considering adding to my coffee fund :)
+A program to download photo and video from [any site](#supported-sites) (e.g. Reddit, Twitter, Instagram).
+
+Do you like this program? Consider adding to my coffee fund by making a donation to show your support. :blush:
 
 [![ko-fi](https://www.ko-fi.com/img/githubbutton_sm.svg)](https://ko-fi.com/andyprogram)
 
+**Bitcoin**: bitcoin:BC1Q0NH839FT5TA44DD7L7RLR97XDQAG9V8D6N7XET
+
+![Main window](ProgramScreenshots/MainWindow.png)
+![Channels window](ProgramScreenshots/Channels.png)
+
 # What can program do:
 - Download pictures and videos from users' profiles and subreddits:
   - Reddit images;
   - Reddit galleries of images;
   - Redgifs hosted videos (https://www.redgifs.com/);
-  - Reddit hosted videos (downloading Reddit hosted video is going through ffmpeg);
-  - Twitter images;
-  - Twitter videos.
-- Parse channel and view data.
+  - Reddit hosted videos (downloading Reddit hosted video is going through ffmpeg (**ffmpeg only works with the x64 program**));
+  - Twitter images and videos;
+  - Instagram images and videos.
+  - Imgur images, galleries and videos
+  - Gfycat videos
+  - [Other](#supported-sites) supported sites
+- Parse [channel and view data](https://github.com/AAndyProgram/SCrawler/wiki/Channels).
+- Download [saved Reddit and Instagram posts](https://github.com/AAndyProgram/SCrawler/wiki/Home#saved-posts).
 - Add users from parsed channel.
+- **Advanced user management.**
 - Labeling users.
+- Adding users to favorites and temporary.
 - Filter exists users by label or group.
 - Selection of media types you want to download (images only, videos only, both)
+- Download a special video, image or gallery
+- Making collections (grouping users into collections)
+- Specifying a user folder (for downloading data to another location)
+- Changing user icons
+- Changing view modes
+- ...and many others...
+
+# Supported sites
+
+- **Reddit**
+- **Twitter**
+- **Instagram**
+- RedGifs
+- Imgur
+- Gfycat
+- [Other sites](Plugins.md)
 
 # How does it works:
 
+First, the program downloads the full profile. After the program downloads only new posts. The program remembers downloaded posts.
+
 ## Reddit
 
-The program parsing all user's posts, gathering pictures' MD5 hash and compare with existing for remove duplicates. Then media will be downloaded.
+The program parses all user posts, obtain MD5  images hash and compares them with existing ones to remove duplicates. Then the media will be downloaded.
 
-## Twitter
+## Other sites
 
-The program parsing all user's posts and compare file names with existing for remove duplicates. Then media will be downloaded.
+The program parses all user posts and compares file names with existing ones to remove duplicates. Then the media will be downloaded.
 
-# Requirements:
+You can read about Instagram restrictions [here](https://github.com/AAndyProgram/SCrawler/wiki/Settings#instagram-limits)
+
+## How to request a new site
+
+Read [here](CONTRIBUTING.md#how-to-request-a-new-site) about
+
+# Requirements
 
 - Windows 7, 8, 9, 10, 11 with NET Framework 4.6.1 or higher
 - Authorization cookies and tokens for Twitter (if you want to download data from Twitter)
-- ffmpeg library for download Reddit hosted videos (you can download it from the [official repo](https://github.com/GyanD/codexffmpeg/releases/tag/2021-01-12-git-ca21cb1e36) or [from my first release](https://github.com/AAndyProgram/SCrawler/releases/download/1.0.0.0/ffmpeg.zip))
-- Don't put program in the ```Program Files``` system folder (this is portable program and program settings are stored in the program folder)
-- Just unpack program archive in any folder you want, copy ```ffmpeg.exe``` into and enjoy. :-)
+- Authorization cookies Instagram (if you want to download data from Instagram)
+- ffmpeg library for downloading videos hosted on Reddit (you can download it from the [official repo](https://github.com/GyanD/codexffmpeg/releases/tag/2021-01-12-git-ca21cb1e36) or [from my first release](https://github.com/AAndyProgram/SCrawler/releases/download/1.0.0.0/ffmpeg.zip)). **ffmpeg only works with the x64 version of the program.**
+
+# Guide
+
+**Full guide you can find [here](https://github.com/AAndyProgram/SCrawler/wiki)**
+
+# Installation
+
+**Just unzip the program archive to any folder, copy the file ```ffmpeg.exe``` into it and enjoy.** :blush:
+
+**Don't put program in the ```Program Files``` system folder (this is portable program and program settings are stored in the program folder)**
+
+# Updating
+
+Just download [latest](https://github.com/AAndyProgram/SCrawler/releases/latest) version and unpack it into the program folder. **Before starting a new version, I recommend making a backup copy of the program settings folder.**
+
+# How to build from source
+
+1. Delete the "PersonalUtilities" project from the solution.
+1. Add the latest version of the "PersonalUtilities.dll" library (from the [latest release](https://github.com/AAndyProgram/SCrawler/releases/latest)).
+1. Import PersonalUtilities.Functions for the whole project.
+
+# How to make a plugin
+
+Read about how to make plugin [here](https://github.com/AAndyProgram/SCrawler/wiki/Plugins).
+
+# How to support
+
+Read more about how to support the program [here](HowToSupport.md).
 
 # Settings and usage
 
 The program has an intuitive interface.
 
-Just add user profile and press ```Start downloading``` button.
+Just add a user profile and click the ```Start downloading``` button.
 
-Users can be added by patterns:
+You can add users by patterns:
+- https://www.instagram.com/SomeUserName
 - https://twitter.com/SomeUserName
 - https://reddit.com/user/SomeUserName
 - https://reddit.com/r/SomeSubredditName
+- https://www.redgifs.com/users/SomeUserName
 - u/SomeUserName
 - r/SomeSubredditName
-- SomeUserName (in this case you must to choose user site)
+- SomeUserName (in this case, you need to select the user's site)
 - SomeSubredditName
 
-More about users and subreddits adding [here](https://github.com/AAndyProgram/SCrawler/wiki/Users)
+Read more about adding users and subreddits [here](https://github.com/AAndyProgram/SCrawler/wiki/Users)
 
-**Full guide you can find [here](https://github.com/AAndyProgram/SCrawler/wiki)**
+![Add user](ProgramScreenshots/CreateUserClear.png)
 
-## Using program as just video downloader
+# Using program as just video downloader
 
-Create a shortcut for the program. Open shortcut properties. On the ```Shortcut``` tab in ```Target``` field just add ```v``` at the end through the space.
+Create a shortcut for the program. Open shortcut properties. In the ```Shortcut``` tab, in the ```Target``` field, just add the letter ```v``` at the end across the space.
 
 Example: ```D:\Programs\SCrawler\SCrawler.exe v```
+
+![Separate video downloader](ProgramScreenshots/SeparateVideoDownloader.png)
+
+# Contact me
+
+[![matrix](https://img.shields.io/badge/Matrix-%40andyprogram%3Amatrix.org-informational)](https://matrix.to/#/@andyprogram:matrix.org)

SCrawler.PluginProvider/.editorconfig

@@ -0,0 +1,3 @@
+[*.vb]
+# Modifier preferences
+file_header_template = Copyright (C) 2022  Andy\nThis program is free software: you can redistribute it and/or modify\nit under the terms of the GNU General Public License as published by\nthe Free Software Foundation, either version 3 of the License, or\n(at your option) any later version.\n\nThis program is distributed in the hope that it will be useful,\nbut WITHOUT ANY WARRANTY; without even the implied warranty of\nMERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the\nGNU General Public License for more details.\n\nYou should have received a copy of the GNU General Public License\nalong with this program.  If not, see <https://www.gnu.org/licenses/>

SCrawler.PluginProvider/Attributes/Attributes.vb

@@ -0,0 +1,153 @@
+' Copyright (C) 2022  Andy
+' This program is free software: you can redistribute it and/or modify
+' it under the terms of the GNU General Public License as published by
+' the Free Software Foundation, either version 3 of the License, or
+' (at your option) any later version.
+'
+' This program is distributed in the hope that it will be useful,
+' but WITHOUT ANY WARRANTY
+Imports System.Runtime.CompilerServices
+Namespace Plugin.Attributes
+    ''' <summary>Create a control for a property</summary>
+    <AttributeUsage(AttributeTargets.Property, AllowMultiple:=False, Inherited:=False)> Public NotInheritable Class PropertyOption : Inherits Attribute
+        ''' <summary>Property name</summary>
+        Public ReadOnly Property Name As String
+        ''' <summary>Property value type</summary>
+        Public Property [Type] As Type
+        Private _ControlText As String
+        ''' <summary>This text will be displayed on the control information.<br/>Default: equals the name (property name)</summary>
+        Public Property ControlText As String
+            Get
+                Return If(String.IsNullOrEmpty(_ControlText), Name, _ControlText)
+            End Get
+            Set(ByVal NewText As String)
+                _ControlText = NewText
+            End Set
+        End Property
+        ''' <summary>This tooltip will be displayed on the control.<br/>Default: <see langword="String.Empty"/></summary>
+        Public Property ControlToolTip As String
+        ''' <summary>CheckBox ThreeStates mode</summary>
+        Public Property ThreeStates As Boolean = False
+        ''' <summary>Property allows null values</summary>
+        Public Property AllowNull As Boolean = True
+        ''' <summary>Offset the control from the left border of the form.<br/>Default: 100</summary>
+        Public Property LeftOffset As Integer = 100
+        ''' <summary>This is an authorization property</summary>
+        Public Property IsAuth As Boolean = False
+        ''' <summary>Initialize a new property option attribute</summary>
+        ''' <param name="PropertyName">Property name</param>
+        Public Sub New(<CallerMemberName()> Optional ByVal PropertyName As String = Nothing)
+            Name = PropertyName
+        End Sub
+    End Class
+    ''' <summary>Store property value in settings XML file</summary>
+    <AttributeUsage(AttributeTargets.Property, AllowMultiple:=False, Inherited:=False)> Public NotInheritable Class PXML : Inherits Attribute
+        Public ReadOnly ElementName As String
+        ''' <summary>Initialize a new XML attribute</summary>
+        ''' <param name="XMLElementName">XML element name</param>
+        Public Sub New(<CallerMemberName()> Optional ByVal XMLElementName As String = Nothing)
+            ElementName = XMLElementName
+        End Sub
+    End Class
+    ''' <summary>Special property updater</summary>
+    <AttributeUsage(AttributeTargets.Method, AllowMultiple:=True, Inherited:=False)> Public NotInheritable Class PropertyUpdater : Inherits Attribute
+        Public ReadOnly Name As String
+        Public ReadOnly Dependencies As String()
+        ''' <inheritdoc cref="PropertyUpdater.New(String, String())"/>
+        Public Sub New(ByVal UpdatingPropertyName As String)
+            Name = UpdatingPropertyName
+        End Sub
+        ''' <summary>Initialize a new PropertyUpdater attribute</summary>
+        ''' <param name="UpdatingPropertyName">The name of the property to be updated</param>
+        Public Sub New(ByVal UpdatingPropertyName As String, ByVal Dependent As String())
+            Name = UpdatingPropertyName
+            Dependencies = Dependent
+        End Sub
+    End Class
+    ''' <summary>Plugin key</summary>
+    <AttributeUsage(AttributeTargets.Class, AllowMultiple:=False, Inherited:=False)> Public NotInheritable Class Manifest : Inherits Attribute
+        Public ReadOnly GUID As String
+        ''' <summary>Initialize a new Manifest attribute</summary>
+        ''' <param name="ClassGuid">Plugin key</param>
+        Public Sub New(ByVal ClassGuid As String)
+            GUID = ClassGuid
+        End Sub
+    End Class
+    ''' <summary>Special form attribute for settings forms and user creator form</summary>
+    <AttributeUsage(AttributeTargets.Class, AllowMultiple:=True, Inherited:=False)> Public NotInheritable Class SpecialForm : Inherits Attribute
+        Public ReadOnly SettingsForm As Boolean
+        ''' <summary>Initialize a new SpecialForm attribute</summary>
+        ''' <param name="IsSettingsForm">
+        ''' <see langword="True"/> - for setting form<br/>
+        ''' <see langword="False"/> - for user creator form
+        ''' </param>
+        Public Sub New(ByVal IsSettingsForm As Boolean)
+            SettingsForm = IsSettingsForm
+        End Sub
+    End Class
+    ''' <summary>Property provider</summary>
+    <AttributeUsage(AttributeTargets.Property, AllowMultiple:=True, Inherited:=False)> Public NotInheritable Class Provider : Inherits Attribute
+        Public ReadOnly Name As String
+        ''' <summary>
+        ''' <see langword="True"/> - form field validation provider. Must return null if the value is invalid.<br/>
+        ''' <see langword="False"/> - only for conversion
+        ''' </summary>
+        Public FieldsChecker As Boolean = False
+        ''' <summary>Initialize a new Provider attribute. <see cref="IFormatProvider"/> is only allowed</summary>
+        ''' <param name="PropertyName">The name of the property for which this provider is used</param>
+        Public Sub New(ByVal PropertyName As String)
+            Name = PropertyName
+        End Sub
+    End Class
+    ''' <summary>Sort attribute for settings form</summary>
+    <AttributeUsage(AttributeTargets.Property, AllowMultiple:=False, Inherited:=False)> Public NotInheritable Class ControlNumber : Inherits Attribute
+        Public ReadOnly PropertyNumber As String
+        ''' <summary>Initialize a new sort attribute instance for the settings form</summary>
+        ''' <param name="Number">Object position number in the settings form</param>
+        Public Sub New(ByVal Number As Integer)
+            PropertyNumber = Number
+        End Sub
+    End Class
+    ''' <summary>Attribute for properties values validation methods</summary>
+    <AttributeUsage(AttributeTargets.Method, AllowMultiple:=True, Inherited:=False)> Public NotInheritable Class PropertiesDataChecker : Inherits Attribute
+        Public ReadOnly ComparableNames As String()
+        ''' <summary>Initialize a new PropertiesDataChecker attribute.</summary>
+        ''' <param name="Names">Array of the property names</param>
+        Public Sub New(ByVal Names As String())
+            ComparableNames = Names
+        End Sub
+    End Class
+    ''' <summary>This attribute specifies that users should be downloaded on a separate thread.</summary>
+    <AttributeUsage(AttributeTargets.Class, AllowMultiple:=False, Inherited:=False)> Public NotInheritable Class SeparatedTasks : Inherits Attribute
+        Public ReadOnly TasksCount As Integer
+        ''' <summary>Initialize a new SeparatedTasks attribute.</summary>
+        ''' <param name="JobsCount">
+        ''' Predefined task counter.<br/>
+        ''' <see cref="TaskCounter"/> will take precedence if it is defined.
+        ''' </param>
+        Public Sub New(Optional ByVal JobsCount As Integer = -1)
+            TasksCount = JobsCount
+        End Sub
+    End Class
+    ''' <summary>A property attribute that specifies how many users should be downloaded at the same time in one thread</summary>
+    <AttributeUsage(AttributeTargets.Property, AllowMultiple:=False, Inherited:=False)> Public NotInheritable Class TaskCounter : Inherits Attribute
+    End Class
+    ''' <summary>This attribute indicates that the plugin has a SavedPosts environment</summary>
+    <AttributeUsage(AttributeTargets.Class, AllowMultiple:=False, Inherited:=False)> Public NotInheritable Class SavedPosts : Inherits Attribute
+    End Class
+    ''' <summary>This is an attribute of the UserData instance. Specifies that the default internal SCrawler downloader should be used.</summary>
+    <AttributeUsage(AttributeTargets.Class, AllowMultiple:=False, Inherited:=False)> Public NotInheritable Class UseInternalDownloader : Inherits Attribute
+    End Class
+    ''' <summary>GitHub plugin info</summary>
+    <AttributeUsage(AttributeTargets.Assembly, AllowMultiple:=False, Inherited:=False)> Public NotInheritable Class Github : Inherits Attribute
+        Public ReadOnly UserName As String
+        Public ReadOnly Repository As String
+        ''' <summary>Initialize a new Github attribute.</summary>
+        ''' <param name="Name">Developer GitHub username</param>
+        ''' <param name="RepoName">Plugin repository name</param>
+        Public Sub New(ByVal Name As String, ByVal RepoName As String)
+            UserName = Name
+            Repository = RepoName
+        End Sub
+    End Class
+End Namespace

SCrawler.PluginProvider/Interfaces/IPluginContentProvider.vb

@@ -0,0 +1,37 @@
+' Copyright (C) 2022  Andy
+' This program is free software: you can redistribute it and/or modify
+' it under the terms of the GNU General Public License as published by
+' the Free Software Foundation, either version 3 of the License, or
+' (at your option) any later version.
+'
+' This program is distributed in the hope that it will be useful,
+' but WITHOUT ANY WARRANTY
+Namespace Plugin
+    Public Interface IPluginContentProvider
+        Event ProgressChanged(ByVal Count As Integer)
+        Event TotalCountChanged(ByVal Count As Integer)
+        Property Thrower As IThrower
+        Property LogProvider As ILogProvider
+        Property Settings As ISiteSettings
+        Property Name As String
+        Property ID As String
+        Property ParseUserMediaOnly As Boolean
+        Property UserDescription As String
+        Property ExistingContentList As List(Of PluginUserMedia)
+        Property TempPostsList As List(Of String)
+        Property TempMediaList As List(Of IPluginUserMedia)
+        Property UserExists As Boolean
+        Property UserSuspended As Boolean
+        Property IsSavedPosts As Boolean
+        Property SeparateVideoFolder As Boolean
+        Property DataPath As String
+        Property PostsNumberLimit As Integer?
+        Property PostsDateLimit As Date?
+        Function ExchangeOptionsGet() As Object
+        Sub ExchangeOptionsSet(ByVal Obj As Object)
+        Sub XmlFieldsSet(ByVal Fields As List(Of KeyValuePair(Of String, String)))
+        Function XmlFieldsGet() As List(Of KeyValuePair(Of String, String))
+        Sub GetMedia()
+        Sub Download()
+    End Interface
+End Namespace

SCrawler.PluginProvider/Interfaces/ISiteSettings.vb

@@ -0,0 +1,49 @@
+' Copyright (C) 2022  Andy
+' This program is free software: you can redistribute it and/or modify
+' it under the terms of the GNU General Public License as published by
+' the Free Software Foundation, either version 3 of the License, or
+' (at your option) any later version.
+'
+' This program is distributed in the hope that it will be useful,
+' but WITHOUT ANY WARRANTY
+Imports System.Drawing
+Namespace Plugin
+    Public Interface ISiteSettings
+        Enum Download As Integer
+            Main = 0
+            SavedPosts = 1
+            Channel = 2
+        End Enum
+        ReadOnly Property Icon As Icon
+        ReadOnly Property Image As Image
+        ReadOnly Property Site As String
+        Function GetUserUrl(ByVal UserName As String, ByVal Channel As Boolean) As String
+        Function IsMyUser(ByVal UserURL As String) As ExchangeOptions
+        Function IsMyImageVideo(ByVal URL As String) As ExchangeOptions
+        Function GetSpecialData(ByVal URL As String) As IEnumerable(Of IPluginUserMedia)
+        Function GetInstance(ByVal What As Download) As IPluginContentProvider
+#Region "XML Support"
+        Sub Load(ByVal XMLValues As IEnumerable(Of KeyValuePair(Of String, String)))
+#End Region
+#Region "Initialization"
+        Sub BeginInit()
+        Sub EndInit()
+        Sub BeginUpdate()
+        Sub EndUpdate()
+#End Region
+#Region "Site availability"
+        Function Available(ByVal What As Download) As Boolean
+        Function ReadyToDownload(ByVal What As Download) As Boolean
+#End Region
+#Region "Downloading"
+        Sub DownloadStarted(ByVal What As Download)
+        Sub BeforeStartDownload(ByVal User As Object, ByVal What As Download)
+        Sub AfterDownload(ByVal User As Object, ByVal What As Download)
+        Sub DownloadDone(ByVal What As Download)
+#End Region
+        Sub Update()
+        Sub Reset()
+        Sub OpenSettingsForm()
+        Sub UserOptions(ByRef Options As Object, ByVal OpenForm As Boolean)
+    End Interface
+End Namespace

SCrawler.PluginProvider/My Project/Application.Designer.vb

@@ -0,0 +1,13 @@
+'------------------------------------------------------------------------------
+' <auto-generated>
+'     This code was generated by a tool.
+'     Runtime Version:4.0.30319.42000
+'
+'     Changes to this file may cause incorrect behavior and will be lost if
+'     the code is regenerated.
+' </auto-generated>
+'------------------------------------------------------------------------------
+
+Option Strict On
+Option Explicit On
+

SCrawler.PluginProvider/My Project/Application.myapp

@@ -0,0 +1,10 @@
+<?xml version="1.0" encoding="utf-8"?>
+<MyApplicationData xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xmlns:xsd="http://www.w3.org/2001/XMLSchema">
+  <MySubMain>false</MySubMain>
+  <SingleInstance>false</SingleInstance>
+  <ShutdownMode>0</ShutdownMode>
+  <EnableVisualStyles>true</EnableVisualStyles>
+  <AuthenticationMode>0</AuthenticationMode>
+  <ApplicationType>1</ApplicationType>
+  <SaveMySettingsOnExit>true</SaveMySettingsOnExit>
+</MyApplicationData>

SCrawler.PluginProvider/My Project/AssemblyInfo.vb

@@ -0,0 +1,37 @@
+Imports System.Resources
+Imports System
+Imports System.Reflection
+Imports System.Runtime.InteropServices
+
+' General Information about an assembly is controlled through the following
+' set of attributes. Change these attribute values to modify the information
+' associated with an assembly.
+
+' Review the values of the assembly attributes
+
+<Assembly: AssemblyTitle("SCrawler plugin provider")>
+<Assembly: AssemblyDescription("Plugin provider for SCrawler")>
+<Assembly: AssemblyCompany("AndyProgram")>
+<Assembly: AssemblyProduct("SCrawler.PluginProvider")>
+<Assembly: AssemblyCopyright("Copyright ©  2022")>
+<Assembly: AssemblyTrademark("AndyProgram")>
+
+<Assembly: ComVisible(False)>
+
+'The following GUID is for the ID of the typelib if this project is exposed to COM
+<Assembly: Guid("1f6c9516-360e-4a2b-80d4-ae0d9a4e5cfd")>
+
+' Version information for an assembly consists of the following four values:
+'
+'      Major Version
+'      Minor Version
+'      Build Number
+'      Revision
+'
+' You can specify all the values or you can default the Build and Revision Numbers
+' by using the '*' as shown below:
+' <Assembly: AssemblyVersion("1.0.*")>
+
+<Assembly: AssemblyVersion("3.0.0.1")>
+<Assembly: AssemblyFileVersion("3.0.0.1")>
+<Assembly: NeutralResourcesLanguage("en")>

SCrawler.PluginProvider/My Project/Resources.Designer.vb

@@ -0,0 +1,63 @@
+'------------------------------------------------------------------------------
+' <auto-generated>
+'     This code was generated by a tool.
+'     Runtime Version:4.0.30319.42000
+'
+'     Changes to this file may cause incorrect behavior and will be lost if
+'     the code is regenerated.
+' </auto-generated>
+'------------------------------------------------------------------------------
+
+Option Strict On
+Option Explicit On
+
+Imports System
+
+Namespace My.Resources
+    
+    'This class was auto-generated by the StronglyTypedResourceBuilder
+    'class via a tool like ResGen or Visual Studio.
+    'To add or remove a member, edit your .ResX file then rerun ResGen
+    'with the /str option, or rebuild your VS project.
+    '''<summary>
+    '''  A strongly-typed resource class, for looking up localized strings, etc.
+    '''</summary>
+    <Global.System.CodeDom.Compiler.GeneratedCodeAttribute("System.Resources.Tools.StronglyTypedResourceBuilder", "16.0.0.0"),  _
+     Global.System.Diagnostics.DebuggerNonUserCodeAttribute(),  _
+     Global.System.Runtime.CompilerServices.CompilerGeneratedAttribute(),  _
+     Global.Microsoft.VisualBasic.HideModuleNameAttribute()>  _
+    Friend Module Resources
+        
+        Private resourceMan As Global.System.Resources.ResourceManager
+        
+        Private resourceCulture As Global.System.Globalization.CultureInfo
+        
+        '''<summary>
+        '''  Returns the cached ResourceManager instance used by this class.
+        '''</summary>
+        <Global.System.ComponentModel.EditorBrowsableAttribute(Global.System.ComponentModel.EditorBrowsableState.Advanced)>  _
+        Friend ReadOnly Property ResourceManager() As Global.System.Resources.ResourceManager
+            Get
+                If Object.ReferenceEquals(resourceMan, Nothing) Then
+                    Dim temp As Global.System.Resources.ResourceManager = New Global.System.Resources.ResourceManager("SCrawler.Resources", GetType(Resources).Assembly)
+                    resourceMan = temp
+                End If
+                Return resourceMan
+            End Get
+        End Property
+        
+        '''<summary>
+        '''  Overrides the current thread's CurrentUICulture property for all
+        '''  resource lookups using this strongly typed resource class.
+        '''</summary>
+        <Global.System.ComponentModel.EditorBrowsableAttribute(Global.System.ComponentModel.EditorBrowsableState.Advanced)>  _
+        Friend Property Culture() As Global.System.Globalization.CultureInfo
+            Get
+                Return resourceCulture
+            End Get
+            Set
+                resourceCulture = value
+            End Set
+        End Property
+    End Module
+End Namespace

SCrawler.PluginProvider/My Project/Resources.resx

@@ -0,0 +1,117 @@
+<?xml version="1.0" encoding="utf-8"?>
+<root>
+  <!-- 
+    Microsoft ResX Schema 
+    
+    Version 2.0
+    
+    The primary goals of this format is to allow a simple XML format 
+    that is mostly human readable. The generation and parsing of the 
+    various data types are done through the TypeConverter classes 
+    associated with the data types.
+    
+    Example:
+    
+    ... ado.net/XML headers & schema ...
+    <resheader name="resmimetype">text/microsoft-resx</resheader>
+    <resheader name="version">2.0</resheader>
+    <resheader name="reader">System.Resources.ResXResourceReader, System.Windows.Forms, ...</resheader>
+    <resheader name="writer">System.Resources.ResXResourceWriter, System.Windows.Forms, ...</resheader>
+    <data name="Name1"><value>this is my long string</value><comment>this is a comment</comment></data>
+    <data name="Color1" type="System.Drawing.Color, System.Drawing">Blue</data>
+    <data name="Bitmap1" mimetype="application/x-microsoft.net.object.binary.base64">
+        <value>[base64 mime encoded serialized .NET Framework object]</value>
+    </data>
+    <data name="Icon1" type="System.Drawing.Icon, System.Drawing" mimetype="application/x-microsoft.net.object.bytearray.base64">
+        <value>[base64 mime encoded string representing a byte array form of the .NET Framework object]</value>
+        <comment>This is a comment</comment>
+    </data>
+                
+    There are any number of "resheader" rows that contain simple 
+    name/value pairs.
+    
+    Each data row contains a name, and value. The row also contains a 
+    type or mimetype. Type corresponds to a .NET class that support 
+    text/value conversion through the TypeConverter architecture. 
+    Classes that don't support this are serialized and stored with the 
+    mimetype set.
+    
+    The mimetype is used for serialized objects, and tells the 
+    ResXResourceReader how to depersist the object. This is currently not 
+    extensible. For a given mimetype the value must be set accordingly:
+    
+    Note - application/x-microsoft.net.object.binary.base64 is the format 
+    that the ResXResourceWriter will generate, however the reader can 
+    read any of the formats listed below.
+    
+    mimetype: application/x-microsoft.net.object.binary.base64
+    value   : The object must be serialized with 
+            : System.Serialization.Formatters.Binary.BinaryFormatter
+            : and then encoded with base64 encoding.
+    
+    mimetype: application/x-microsoft.net.object.soap.base64
+    value   : The object must be serialized with 
+            : System.Runtime.Serialization.Formatters.Soap.SoapFormatter
+            : and then encoded with base64 encoding.
+
+    mimetype: application/x-microsoft.net.object.bytearray.base64
+    value   : The object must be serialized into a byte array 
+            : using a System.ComponentModel.TypeConverter
+            : and then encoded with base64 encoding.
+    -->
+  <xsd:schema id="root" xmlns="" xmlns:xsd="http://www.w3.org/2001/XMLSchema" xmlns:msdata="urn:schemas-microsoft-com:xml-msdata">
+    <xsd:element name="root" msdata:IsDataSet="true">
+      <xsd:complexType>
+        <xsd:choice maxOccurs="unbounded">
+          <xsd:element name="metadata">
+            <xsd:complexType>
+              <xsd:sequence>
+                <xsd:element name="value" type="xsd:string" minOccurs="0" />
+              </xsd:sequence>
+              <xsd:attribute name="name" type="xsd:string" />
+              <xsd:attribute name="type" type="xsd:string" />
+              <xsd:attribute name="mimetype" type="xsd:string" />
+            </xsd:complexType>
+          </xsd:element>
+          <xsd:element name="assembly">
+            <xsd:complexType>
+              <xsd:attribute name="alias" type="xsd:string" />
+              <xsd:attribute name="name" type="xsd:string" />
+            </xsd:complexType>
+          </xsd:element>
+          <xsd:element name="data">
+            <xsd:complexType>
+              <xsd:sequence>
+                <xsd:element name="value" type="xsd:string" minOccurs="0" msdata:Ordinal="1" />
+                <xsd:element name="comment" type="xsd:string" minOccurs="0" msdata:Ordinal="2" />
+              </xsd:sequence>
+              <xsd:attribute name="name" type="xsd:string" msdata:Ordinal="1" />
+              <xsd:attribute name="type" type="xsd:string" msdata:Ordinal="3" />
+              <xsd:attribute name="mimetype" type="xsd:string" msdata:Ordinal="4" />
+            </xsd:complexType>
+          </xsd:element>
+          <xsd:element name="resheader">
+            <xsd:complexType>
+              <xsd:sequence>
+                <xsd:element name="value" type="xsd:string" minOccurs="0" msdata:Ordinal="1" />
+              </xsd:sequence>
+              <xsd:attribute name="name" type="xsd:string" use="required" />
+            </xsd:complexType>
+          </xsd:element>
+        </xsd:choice>
+      </xsd:complexType>
+    </xsd:element>
+  </xsd:schema>
+  <resheader name="resmimetype">
+    <value>text/microsoft-resx</value>
+  </resheader>
+  <resheader name="version">
+    <value>2.0</value>
+  </resheader>
+  <resheader name="reader">
+    <value>System.Resources.ResXResourceReader, System.Windows.Forms, Version=2.0.0.0, Culture=neutral, PublicKeyToken=b77a5c561934e089</value>
+  </resheader>
+  <resheader name="writer">
+    <value>System.Resources.ResXResourceWriter, System.Windows.Forms, Version=2.0.0.0, Culture=neutral, PublicKeyToken=b77a5c561934e089</value>
+  </resheader>
+</root>

SCrawler.PluginProvider/My Project/Settings.Designer.vb

@@ -0,0 +1,73 @@
+'------------------------------------------------------------------------------
+' <auto-generated>
+'     This code was generated by a tool.
+'     Runtime Version:4.0.30319.42000
+'
+'     Changes to this file may cause incorrect behavior and will be lost if
+'     the code is regenerated.
+' </auto-generated>
+'------------------------------------------------------------------------------
+
+Option Strict On
+Option Explicit On
+
+
+Namespace My
+    
+    <Global.System.Runtime.CompilerServices.CompilerGeneratedAttribute(),  _
+     Global.System.CodeDom.Compiler.GeneratedCodeAttribute("Microsoft.VisualStudio.Editors.SettingsDesigner.SettingsSingleFileGenerator", "16.10.0.0"),  _
+     Global.System.ComponentModel.EditorBrowsableAttribute(Global.System.ComponentModel.EditorBrowsableState.Advanced)>  _
+    Partial Friend NotInheritable Class MySettings
+        Inherits Global.System.Configuration.ApplicationSettingsBase
+        
+        Private Shared defaultInstance As MySettings = CType(Global.System.Configuration.ApplicationSettingsBase.Synchronized(New MySettings()),MySettings)
+        
+#Region "My.Settings Auto-Save Functionality"
+#If _MyType = "WindowsForms" Then
+    Private Shared addedHandler As Boolean
+
+    Private Shared addedHandlerLockObject As New Object
+
+    <Global.System.Diagnostics.DebuggerNonUserCodeAttribute(), Global.System.ComponentModel.EditorBrowsableAttribute(Global.System.ComponentModel.EditorBrowsableState.Advanced)> _
+    Private Shared Sub AutoSaveSettings(sender As Global.System.Object, e As Global.System.EventArgs)
+        If My.Application.SaveMySettingsOnExit Then
+            My.Settings.Save()
+        End If
+    End Sub
+#End If
+#End Region
+        
+        Public Shared ReadOnly Property [Default]() As MySettings
+            Get
+                
+#If _MyType = "WindowsForms" Then
+               If Not addedHandler Then
+                    SyncLock addedHandlerLockObject
+                        If Not addedHandler Then
+                            AddHandler My.Application.Shutdown, AddressOf AutoSaveSettings
+                            addedHandler = True
+                        End If
+                    End SyncLock
+                End If
+#End If
+                Return defaultInstance
+            End Get
+        End Property
+    End Class
+End Namespace
+
+Namespace My
+    
+    <Global.Microsoft.VisualBasic.HideModuleNameAttribute(),  _
+     Global.System.Diagnostics.DebuggerNonUserCodeAttribute(),  _
+     Global.System.Runtime.CompilerServices.CompilerGeneratedAttribute()>  _
+    Friend Module MySettingsProperty
+        
+        <Global.System.ComponentModel.Design.HelpKeywordAttribute("My.Settings")>  _
+        Friend ReadOnly Property Settings() As Global.SCrawler.My.MySettings
+            Get
+                Return Global.SCrawler.My.MySettings.Default
+            End Get
+        End Property
+    End Module
+End Namespace

SCrawler.PluginProvider/My Project/Settings.settings

@@ -0,0 +1,7 @@
+<?xml version='1.0' encoding='utf-8'?>
+<SettingsFile xmlns="http://schemas.microsoft.com/VisualStudio/2004/01/settings" CurrentProfile="(Default)" UseMySettingsClassName="true">
+  <Profiles>
+    <Profile Name="(Default)" />
+  </Profiles>
+  <Settings />
+</SettingsFile>

SCrawler.PluginProvider/ObjectInterfaces/ILogProvider.vb

@@ -0,0 +1,16 @@
+' Copyright (C) 2022  Andy
+' This program is free software: you can redistribute it and/or modify
+' it under the terms of the GNU General Public License as published by
+' the Free Software Foundation, either version 3 of the License, or
+' (at your option) any later version.
+'
+' This program is distributed in the hope that it will be useful,
+' but WITHOUT ANY WARRANTY
+Namespace Plugin
+    Public Interface ILogProvider
+        Overloads Sub Add(ByVal Message As String)
+        Overloads Sub Add(ByVal ex As Exception, ByVal Message As String,
+                          Optional ByVal ShowMainMsg As Boolean = False, Optional ByVal ShowErrorMsg As Boolean = False,
+                          Optional ByVal SendInLog As Boolean = True)
+    End Interface
+End Namespace

SCrawler.PluginProvider/ObjectInterfaces/IPluginUserMedia.vb

@@ -0,0 +1,40 @@
+' Copyright (C) 2022  Andy
+' This program is free software: you can redistribute it and/or modify
+' it under the terms of the GNU General Public License as published by
+' the Free Software Foundation, either version 3 of the License, or
+' (at your option) any later version.
+'
+' This program is distributed in the hope that it will be useful,
+' but WITHOUT ANY WARRANTY
+Namespace Plugin
+    Public Structure PluginUserMedia : Implements IPluginUserMedia
+        Public Property ContentType As Integer Implements IPluginUserMedia.ContentType
+        Public Property URL As String Implements IPluginUserMedia.URL
+        Public Property MD5 As String Implements IPluginUserMedia.MD5
+        Public Property File As String Implements IPluginUserMedia.File
+        Public Property DownloadState As Integer Implements IPluginUserMedia.DownloadState
+        Public Property PostID As String Implements IPluginUserMedia.PostID
+        Public Property PostDate As Date? Implements IPluginUserMedia.PostDate
+        Public Property SpecialFolder As String Implements IPluginUserMedia.SpecialFolder
+    End Structure
+    Public Interface IPluginUserMedia
+        Enum Types As Integer
+            Undefined = 0
+            [Picture] = 1
+            [Video] = 2
+            [Text] = 3
+            VideoPre = 10
+            GIF = 50
+            m3u8 = 100
+        End Enum
+        Enum States As Integer : Unknown = 0 : Tried = 1 : Downloaded = 2 : Skipped = 3 : End Enum
+        Property ContentType As Integer
+        Property URL As String
+        Property MD5 As String
+        Property File As String
+        Property DownloadState As Integer
+        Property PostID As String
+        Property PostDate As Date?
+        Property SpecialFolder As String
+    End Interface
+End Namespace

SCrawler.PluginProvider/ObjectInterfaces/IThrower.vb

@@ -0,0 +1,13 @@
+' Copyright (C) 2022  Andy
+' This program is free software: you can redistribute it and/or modify
+' it under the terms of the GNU General Public License as published by
+' the Free Software Foundation, either version 3 of the License, or
+' (at your option) any later version.
+'
+' This program is distributed in the hope that it will be useful,
+' but WITHOUT ANY WARRANTY
+Namespace Plugin
+    Public Interface IThrower
+        Sub ThrowAny()
+    End Interface
+End Namespace

SCrawler.PluginProvider/Objects/ExchangeOptions.vb

@@ -0,0 +1,25 @@
+' Copyright (C) 2022  Andy
+' This program is free software: you can redistribute it and/or modify
+' it under the terms of the GNU General Public License as published by
+' the Free Software Foundation, either version 3 of the License, or
+' (at your option) any later version.
+'
+' This program is distributed in the hope that it will be useful,
+' but WITHOUT ANY WARRANTY
+Namespace Plugin
+    Public Structure ExchangeOptions
+        Public UserName As String
+        Public SiteName As String
+        Public HostKey As String
+        Public IsChannel As Boolean
+        Public Exists As Boolean
+        Public Sub New(ByVal Site As String, ByVal _Name As String)
+            UserName = _Name
+            SiteName = Site
+        End Sub
+        Public Sub New(ByVal Site As String, ByVal _Name As String, ByVal _IsChannel As Boolean)
+            Me.New(Site, _Name)
+            IsChannel = _IsChannel
+        End Sub
+    End Structure
+End Namespace

SCrawler.PluginProvider/Objects/PropertyData.vb

@@ -0,0 +1,18 @@
+' Copyright (C) 2022  Andy
+' This program is free software: you can redistribute it and/or modify
+' it under the terms of the GNU General Public License as published by
+' the Free Software Foundation, either version 3 of the License, or
+' (at your option) any later version.
+'
+' This program is distributed in the hope that it will be useful,
+' but WITHOUT ANY WARRANTY
+Namespace Plugin
+    Public Structure PropertyData
+        Public ReadOnly Name As String
+        Public ReadOnly Value As Object
+        Public Sub New(ByVal _Name As String, ByVal _Value As Object)
+            Name = _Name
+            Value = _Value
+        End Sub
+    End Structure
+End Namespace

SCrawler.PluginProvider/Objects/PropertyValue.vb

@@ -0,0 +1,58 @@
+' Copyright (C) 2022  Andy
+' This program is free software: you can redistribute it and/or modify
+' it under the terms of the GNU General Public License as published by
+' the Free Software Foundation, either version 3 of the License, or
+' (at your option) any later version.
+'
+' This program is distributed in the hope that it will be useful,
+' but WITHOUT ANY WARRANTY
+Namespace Plugin
+    Public NotInheritable Class PropertyValue : Implements IPropertyValue
+        Public Event ValueChanged As IPropertyValue.ValueChangedEventHandler Implements IPropertyValue.ValueChanged
+        Public Property [Type] As Type Implements IPropertyValue.Type
+        Public Property OnChangeFunction As IPropertyValue.ValueChangedEventHandler
+        ''' <inheritdoc cref="PropertyValue.New(Object, Type, ByRef IPropertyValue.ValueChangedEventHandler)"/>
+        ''' <exception cref="ArgumentNullException"></exception>
+        Public Sub New(ByVal InitValue As Object)
+            _Value = InitValue
+            If IsNothing(InitValue) Then
+                Throw New ArgumentNullException("InitValue", "InitValue cannot be null")
+            Else
+                [Type] = _Value.GetType
+            End If
+        End Sub
+        ''' <inheritdoc cref="PropertyValue.New(Object, Type, ByRef IPropertyValue.ValueChangedEventHandler)"/>
+        Public Sub New(ByVal InitValue As Object, ByVal T As Type)
+            _Value = InitValue
+            [Type] = T
+        End Sub
+        ''' <summary>New property value instance</summary>
+        ''' <param name="InitValue">Initialization value</param>
+        ''' <param name="T">Value type</param>
+        ''' <param name="RFunction">CallBack function on value change</param>
+        Public Sub New(ByVal InitValue As Object, ByVal T As Type, ByRef RFunction As IPropertyValue.ValueChangedEventHandler)
+            Me.New(InitValue, T)
+            OnChangeFunction = RFunction
+        End Sub
+        Private _Value As Object
+        Public Property Value As Object Implements IPropertyValue.Value
+            Get
+                Return _Value
+            End Get
+            Set(ByVal NewValue As Object)
+                _Value = NewValue
+                If Not OnChangeFunction Is Nothing Then OnChangeFunction.Invoke(Value)
+                RaiseEvent ValueChanged(_Value)
+            End Set
+        End Property
+    End Class
+    Public Interface IPropertyValue
+        ''' <summary>Event for internal exchange</summary>
+        ''' <param name="Value">New value</param>
+        Event ValueChanged(ByVal Value As Object)
+        ''' <summary>Value type</summary>
+        Property [Type] As Type
+        ''' <summary>Property value</summary>
+        Property Value As Object
+    End Interface
+End Namespace

SCrawler.PluginProvider/SCrawler.PluginProvider.vbproj

@@ -0,0 +1,151 @@
+<?xml version="1.0" encoding="utf-8"?>
+<Project ToolsVersion="15.0" xmlns="http://schemas.microsoft.com/developer/msbuild/2003">
+  <Import Project="$(MSBuildExtensionsPath)\$(MSBuildToolsVersion)\Microsoft.Common.props" Condition="Exists('$(MSBuildExtensionsPath)\$(MSBuildToolsVersion)\Microsoft.Common.props')" />
+  <PropertyGroup>
+    <Configuration Condition=" '$(Configuration)' == '' ">Debug</Configuration>
+    <Platform Condition=" '$(Platform)' == '' ">AnyCPU</Platform>
+    <ProjectGuid>{D4650F6B-5A54-44B6-999B-6C675B7116B1}</ProjectGuid>
+    <OutputType>Library</OutputType>
+    <RootNamespace>SCrawler</RootNamespace>
+    <AssemblyName>SCrawler.PluginProvider</AssemblyName>
+    <FileAlignment>512</FileAlignment>
+    <MyType>Windows</MyType>
+    <TargetFrameworkVersion>v4.6.1</TargetFrameworkVersion>
+    <Deterministic>true</Deterministic>
+  </PropertyGroup>
+  <PropertyGroup Condition=" '$(Configuration)|$(Platform)' == 'Debug|AnyCPU' ">
+    <DebugSymbols>true</DebugSymbols>
+    <DebugType>full</DebugType>
+    <DefineDebug>true</DefineDebug>
+    <DefineTrace>true</DefineTrace>
+    <OutputPath>bin\Debug\</OutputPath>
+    <DocumentationFile>
+    </DocumentationFile>
+    <NoWarn>42016,41999,42017,42018,42019,42032,42036,42020,42021,42022</NoWarn>
+  </PropertyGroup>
+  <PropertyGroup Condition=" '$(Configuration)|$(Platform)' == 'Release|AnyCPU' ">
+    <DebugType>pdbonly</DebugType>
+    <DefineDebug>false</DefineDebug>
+    <DefineTrace>true</DefineTrace>
+    <Optimize>true</Optimize>
+    <OutputPath>bin\Release\</OutputPath>
+    <DocumentationFile>
+    </DocumentationFile>
+    <NoWarn>42016,41999,42017,42018,42019,42032,42036,42020,42021,42022</NoWarn>
+  </PropertyGroup>
+  <PropertyGroup>
+    <OptionExplicit>On</OptionExplicit>
+  </PropertyGroup>
+  <PropertyGroup>
+    <OptionCompare>Binary</OptionCompare>
+  </PropertyGroup>
+  <PropertyGroup>
+    <OptionStrict>Off</OptionStrict>
+  </PropertyGroup>
+  <PropertyGroup>
+    <OptionInfer>On</OptionInfer>
+  </PropertyGroup>
+  <PropertyGroup Condition="'$(Configuration)|$(Platform)' == 'Debug|x64'">
+    <DebugSymbols>true</DebugSymbols>
+    <DefineDebug>true</DefineDebug>
+    <DefineTrace>true</DefineTrace>
+    <OutputPath>bin\x64\Debug\</OutputPath>
+    <NoWarn>42016,41999,42017,42018,42019,42032,42036,42020,42021,42022</NoWarn>
+    <DebugType>full</DebugType>
+    <PlatformTarget>x64</PlatformTarget>
+  </PropertyGroup>
+  <PropertyGroup Condition="'$(Configuration)|$(Platform)' == 'Release|x64'">
+    <DefineTrace>true</DefineTrace>
+    <OutputPath>bin\x64\Release\</OutputPath>
+    <Optimize>true</Optimize>
+    <NoWarn>42016,41999,42017,42018,42019,42032,42036,42020,42021,42022</NoWarn>
+    <DebugType>pdbonly</DebugType>
+    <PlatformTarget>x64</PlatformTarget>
+  </PropertyGroup>
+  <PropertyGroup Condition="'$(Configuration)|$(Platform)' == 'Debug|x86'">
+    <DebugSymbols>true</DebugSymbols>
+    <DefineDebug>true</DefineDebug>
+    <DefineTrace>true</DefineTrace>
+    <OutputPath>bin\x86\Debug\</OutputPath>
+    <NoWarn>42016,41999,42017,42018,42019,42032,42036,42020,42021,42022</NoWarn>
+    <DebugType>full</DebugType>
+    <PlatformTarget>x86</PlatformTarget>
+  </PropertyGroup>
+  <PropertyGroup Condition="'$(Configuration)|$(Platform)' == 'Release|x86'">
+    <DefineTrace>true</DefineTrace>
+    <OutputPath>bin\x86\Release\</OutputPath>
+    <Optimize>true</Optimize>
+    <NoWarn>42016,41999,42017,42018,42019,42032,42036,42020,42021,42022</NoWarn>
+    <DebugType>pdbonly</DebugType>
+    <PlatformTarget>x86</PlatformTarget>
+  </PropertyGroup>
+  <ItemGroup>
+    <Reference Include="System" />
+    <Reference Include="System.Data" />
+    <Reference Include="System.Drawing" />
+    <Reference Include="System.Xml" />
+    <Reference Include="System.Core" />
+    <Reference Include="System.Xml.Linq" />
+    <Reference Include="System.Data.DataSetExtensions" />
+    <Reference Include="System.Net.Http" />
+  </ItemGroup>
+  <ItemGroup>
+    <Import Include="Microsoft.VisualBasic" />
+    <Import Include="System" />
+    <Import Include="System.Collections" />
+    <Import Include="System.Collections.Generic" />
+    <Import Include="System.Data" />
+    <Import Include="System.Diagnostics" />
+    <Import Include="System.Linq" />
+    <Import Include="System.Xml.Linq" />
+    <Import Include="System.Threading.Tasks" />
+  </ItemGroup>
+  <ItemGroup>
+    <Compile Include="Attributes\Attributes.vb" />
+    <Compile Include="Objects\ExchangeOptions.vb" />
+    <Compile Include="ObjectInterfaces\ILogProvider.vb" />
+    <Compile Include="Interfaces\IPluginContentProvider.vb" />
+    <Compile Include="ObjectInterfaces\IPluginUserMedia.vb" />
+    <Compile Include="Interfaces\ISiteSettings.vb" />
+    <Compile Include="ObjectInterfaces\IThrower.vb" />
+    <Compile Include="My Project\AssemblyInfo.vb" />
+    <Compile Include="My Project\Application.Designer.vb">
+      <AutoGen>True</AutoGen>
+      <DependentUpon>Application.myapp</DependentUpon>
+      <DesignTime>True</DesignTime>
+    </Compile>
+    <Compile Include="My Project\Resources.Designer.vb">
+      <AutoGen>True</AutoGen>
+      <DesignTime>True</DesignTime>
+      <DependentUpon>Resources.resx</DependentUpon>
+    </Compile>
+    <Compile Include="My Project\Settings.Designer.vb">
+      <AutoGen>True</AutoGen>
+      <DependentUpon>Settings.settings</DependentUpon>
+      <DesignTimeSharedInput>True</DesignTimeSharedInput>
+    </Compile>
+    <Compile Include="Objects\PropertyData.vb" />
+    <Compile Include="Objects\PropertyValue.vb" />
+  </ItemGroup>
+  <ItemGroup>
+    <EmbeddedResource Include="My Project\Resources.resx">
+      <Generator>VbMyResourcesResXFileCodeGenerator</Generator>
+      <LastGenOutput>Resources.Designer.vb</LastGenOutput>
+      <CustomToolNamespace>My.Resources</CustomToolNamespace>
+      <SubType>Designer</SubType>
+    </EmbeddedResource>
+  </ItemGroup>
+  <ItemGroup>
+    <None Include=".editorconfig" />
+    <None Include="My Project\Application.myapp">
+      <Generator>MyApplicationCodeGenerator</Generator>
+      <LastGenOutput>Application.Designer.vb</LastGenOutput>
+    </None>
+    <None Include="My Project\Settings.settings">
+      <Generator>SettingsSingleFileGenerator</Generator>
+      <CustomToolNamespace>My</CustomToolNamespace>
+      <LastGenOutput>Settings.Designer.vb</LastGenOutput>
+    </None>
+  </ItemGroup>
+  <Import Project="$(MSBuildToolsPath)\Microsoft.VisualBasic.targets" />
+</Project>

SCrawler.sln

@@ -12,12 +12,11 @@ Project("{2150E333-8FDC-42A3-9474-1A3956D46DE8}") = "Solution Items", "Solution
 		.gitignore = .gitignore
 		Changelog.md = Changelog.md
 		README.md = README.md
-		Info\RedditUrlsInfo.txt = Info\RedditUrlsInfo.txt
 		ToDo.txt = ToDo.txt
-		Info\TwitterNewAlgo.txt = Info\TwitterNewAlgo.txt
-		Info\TwitterUrlsInfo.txt = Info\TwitterUrlsInfo.txt
 	EndProjectSection
 EndProject
+Project("{F184B08F-C81C-45F6-A57F-5ABD9991F28F}") = "SCrawler.PluginProvider", "SCrawler.PluginProvider\SCrawler.PluginProvider.vbproj", "{D4650F6B-5A54-44B6-999B-6C675B7116B1}"
+EndProject
 Global
 	GlobalSection(SolutionConfigurationPlatforms) = preSolution
 		Debug|Any CPU = Debug|Any CPU
@@ -52,6 +51,18 @@ Global
 		{8405896B-2685-4916-BC93-1FB514C323A9}.Release|x64.Build.0 = Release|x64
 		{8405896B-2685-4916-BC93-1FB514C323A9}.Release|x86.ActiveCfg = Release|x86
 		{8405896B-2685-4916-BC93-1FB514C323A9}.Release|x86.Build.0 = Release|x86
+		{D4650F6B-5A54-44B6-999B-6C675B7116B1}.Debug|Any CPU.ActiveCfg = Debug|Any CPU
+		{D4650F6B-5A54-44B6-999B-6C675B7116B1}.Debug|Any CPU.Build.0 = Debug|Any CPU
+		{D4650F6B-5A54-44B6-999B-6C675B7116B1}.Debug|x64.ActiveCfg = Debug|x64
+		{D4650F6B-5A54-44B6-999B-6C675B7116B1}.Debug|x64.Build.0 = Debug|x64
+		{D4650F6B-5A54-44B6-999B-6C675B7116B1}.Debug|x86.ActiveCfg = Debug|x86
+		{D4650F6B-5A54-44B6-999B-6C675B7116B1}.Debug|x86.Build.0 = Debug|x86
+		{D4650F6B-5A54-44B6-999B-6C675B7116B1}.Release|Any CPU.ActiveCfg = Release|Any CPU
+		{D4650F6B-5A54-44B6-999B-6C675B7116B1}.Release|Any CPU.Build.0 = Release|Any CPU
+		{D4650F6B-5A54-44B6-999B-6C675B7116B1}.Release|x64.ActiveCfg = Release|x64
+		{D4650F6B-5A54-44B6-999B-6C675B7116B1}.Release|x64.Build.0 = Release|x64
+		{D4650F6B-5A54-44B6-999B-6C675B7116B1}.Release|x86.ActiveCfg = Release|x86
+		{D4650F6B-5A54-44B6-999B-6C675B7116B1}.Release|x86.Build.0 = Release|x86
 	EndGlobalSection
 	GlobalSection(SolutionProperties) = preSolution
 		HideSolutionNode = FALSE

SCrawler/API/Base/Declarations.vb

@@ -0,0 +1,13 @@
+' Copyright (C) 2022  Andy
+' This program is free software: you can redistribute it and/or modify
+' it under the terms of the GNU General Public License as published by
+' the Free Software Foundation, either version 3 of the License, or
+' (at your option) any later version.
+'
+' This program is distributed in the hope that it will be useful,
+' but WITHOUT ANY WARRANTY
+Namespace API.Base
+    Friend Module Declarations
+        Friend ReadOnly LNC As New ListAddParams(LAP.NotContainsOnly)
+    End Module
+End Namespace

SCrawler/API/Base/DownDetector.vb

@@ -0,0 +1,60 @@
+' Copyright (C) 2022  Andy
+' This program is free software: you can redistribute it and/or modify
+' it under the terms of the GNU General Public License as published by
+' the Free Software Foundation, either version 3 of the License, or
+' (at your option) any later version.
+'
+' This program is distributed in the hope that it will be useful,
+' but WITHOUT ANY WARRANTY
+Imports System.Net
+Imports PersonalUtilities.Functions.RegularExpressions
+Namespace API.Base
+    Friend NotInheritable Class DownDetector
+        Private Shared ReadOnly Property Params As New RParams("x:.'([\S]+?)',.y:.(\d+)", -1, Nothing, RegexReturn.List)
+        Private Sub New()
+        End Sub
+        Friend Structure Data : Implements IRegExCreator, IComparable(Of Data)
+            Friend [Date] As Date
+            Friend Value As Integer
+            Friend Function CreateFromArray(ByVal ParamsArray() As String) As Object Implements IRegExCreator.CreateFromArray
+                If ParamsArray.ListExists Then
+                    Try : [Date] = Date.Parse(ParamsArray(0)) : Catch : End Try
+                    If ParamsArray.Length > 1 Then Value = AConvert(Of Integer)(ParamsArray(1), 0)
+                End If
+                Return Me
+            End Function
+            Public Overrides Function ToString() As String
+                Return $"{AConvert(Of String)([Date], ADateTime.Formats.BaseDateTime, String.Empty)} [{Value}]"
+            End Function
+            Friend Function CompareTo(ByVal Other As Data) As Integer Implements IComparable(Of Data).CompareTo
+                Return [Date].CompareTo(Other.Date) * -1
+            End Function
+        End Structure
+        Friend Shared Function GetData(ByVal Site As String) As List(Of Data)
+            Try
+                Dim l As List(Of Data) = Nothing
+                Using w As New WebClient
+                    Dim r$ = w.DownloadString($"https://downdetector.co.uk/status/{Site}/")
+                    If Not r.IsEmptyString Then
+                        l = FNF.RegexFields(Of Data)(r, {Params}, {1, 2})
+                        If l.ListExists(2) Then
+                            Dim lDate As Date = l(0).Date
+                            Dim i%
+                            Dim indx% = -1
+                            For i = 1 To l.Count - 1
+                                If l(i).Date < lDate Then indx = i : Exit For Else lDate = l(i).Date
+                            Next
+                            If indx >= 0 Then
+                                For i = indx To 0 Step -1 : l.RemoveAt(i) : Next
+                            End If
+                            l.Sort()
+                        End If
+                    End If
+                End Using
+                Return l
+            Catch ex As Exception
+                Return ErrorsDescriber.Execute(EDP.SendInLog + EDP.ReturnValue, ex, $"[DownDetector.GetData({Site})]")
+            End Try
+        End Function
+    End Class
+End Namespace

SCrawler/API/Base/ProfileSaved.vb

@@ -0,0 +1,61 @@
+' Copyright (C) 2022  Andy
+' This program is free software: you can redistribute it and/or modify
+' it under the terms of the GNU General Public License as published by
+' the Free Software Foundation, either version 3 of the License, or
+' (at your option) any later version.
+'
+' This program is distributed in the hope that it will be useful,
+' but WITHOUT ANY WARRANTY
+Imports SCrawler.Plugin.Hosts
+Imports System.Threading
+Imports PersonalUtilities.Forms.Toolbars
+Imports PDownload = SCrawler.Plugin.ISiteSettings.Download
+Namespace API.Base
+    Friend NotInheritable Class ProfileSaved
+        Private ReadOnly Property HOST As SettingsHost
+        Private ReadOnly Property Progress As MyProgress
+        Friend Sub New(ByRef h As SettingsHost, ByRef Bar As MyProgress)
+            HOST = h
+            Progress = Bar
+        End Sub
+        Friend Sub Download(ByVal Token As CancellationToken)
+            Try
+                If HOST.Source.ReadyToDownload(PDownload.SavedPosts) Then
+                    If HOST.Available(PDownload.SavedPosts) Then
+                        HOST.DownloadStarted(PDownload.SavedPosts)
+                        Dim u As New UserInfo With {.Plugin = HOST.Key, .Site = HOST.Name, .SpecialPath = HOST.SavedPostsPath}
+                        Using user As IUserData = HOST.GetInstance(PDownload.SavedPosts, Nothing, False, False)
+                            If Not user Is Nothing AndAlso (Not user.Name.IsEmptyString Or Not HOST.IsMyClass) Then
+                                u.Name = user.Name
+                                With DirectCast(user, UserDataBase).User
+                                    u.IsChannel = .IsChannel
+                                    u.UpdateUserFile()
+                                End With
+                                With DirectCast(user, UserDataBase)
+                                    .User = u
+                                    .LoadUserInformation()
+                                    .IsSavedPosts = True
+                                    .Progress = Progress
+                                    If Not .FileExists Then .UpdateUserInformation()
+                                End With
+                                HOST.BeforeStartDownload(user, PDownload.SavedPosts)
+                                user.DownloadData(Token)
+                                Progress.InformationTemporary = $"Images: {user.DownloadedPictures(False)}; Videos: {user.DownloadedVideos(False)}"
+                                HOST.AfterDownload(user, PDownload.SavedPosts)
+                            End If
+                        End Using
+                    Else
+                        Progress.InformationTemporary = $"Host [{HOST.Name}] is unavailable"
+                    End If
+                Else
+                    Progress.InformationTemporary = $"Host [{HOST.Name}] is nor ready"
+                End If
+            Catch ex As Exception
+                Progress.InformationTemporary = $"{HOST.Name} downloading error"
+                ErrorsDescriber.Execute(EDP.SendInLog, ex, $"[API.Base.ProfileSaved.Download({HOST.Key})]")
+            Finally
+                HOST.DownloadDone(PDownload.SavedPosts)
+            End Try
+        End Sub
+    End Class
+End Namespace

SCrawler/API/Base/SiteSettings.vb

@@ -1,89 +0,0 @@
-' Copyright (C) 2022  Andy
-' This program is free software: you can redistribute it and/or modify
-' it under the terms of the GNU General Public License as published by
-' the Free Software Foundation, either version 3 of the License, or
-' (at your option) any later version.
-'
-' This program is distributed in the hope that it will be useful,
-' but WITHOUT ANY WARRANTY
-Imports PersonalUtilities.Tools
-Imports PersonalUtilities.Functions.XML
-Imports PersonalUtilities.Functions.XML.Base
-Namespace API.Base
-    Friend Class SiteSettings : Implements IDisposable
-        Friend Const Header_Twitter_Authorization As String = "authorization"
-        Friend Const Header_Twitter_Token As String = "x-csrf-token"
-        Friend ReadOnly Site As Sites
-        Friend ReadOnly Responser As WEB.Response
-        Private ReadOnly _Path As XMLValue(Of SFile)
-        Friend Property Path As SFile
-            Get
-                If _Path.IsEmptyString Then _Path.Value = SFile.GetPath($"{Settings.GlobalPath.Value.PathWithSeparator}{Site}")
-                Return _Path.Value
-            End Get
-            Set(ByVal NewFile As SFile)
-                _Path.Value = NewFile
-            End Set
-        End Property
-        Private ReadOnly SettingsFile As SFile
-        Friend Sub New(ByVal s As Sites, ByRef _XML As XmlFile, ByVal GlobalPath As SFile)
-            Site = s
-            SettingsFile = $"{SettingsFolderName}\Responser_{s}.xml"
-            Responser = New WEB.Response(SettingsFile)
-
-            If SettingsFile.Exists Then
-                Responser.LoadSettings()
-            Else
-                If Site = Sites.Twitter Then
-                    With Responser
-                        .ContentType = "application/json"
-                        .Accept = "*/*"
-                        .CookiesDomain = "twitter.com"
-                        .Decoders.Add(SymbolsConverter.Converters.Unicode)
-                        With .Headers
-                            .Add("sec-ch-ua", " Not;A Brand" & Chr(34) & ";v=" & Chr(34) & "99" & Chr(34) & ", " & Chr(34) &
-                                 "Google Chrome" & Chr(34) & ";v=" & Chr(34) & "91" & Chr(34) & ", " & Chr(34) & "Chromium" &
-                                 Chr(34) & ";v=" & Chr(34) & "91" & Chr(34))
-                            .Add("sec-ch-ua-mobile", "?0")
-                            .Add("sec-fetch-dest", "empty")
-                            .Add("sec-fetch-mode", "cors")
-                            .Add("sec-fetch-site", "same-origin")
-                            .Add(Header_Twitter_Token, String.Empty)
-                            .Add("x-twitter-active-user", "yes")
-                            .Add("x-twitter-auth-type", "OAuth2Session")
-                            .Add(Header_Twitter_Authorization, String.Empty)
-                        End With
-                    End With
-                ElseIf Site = Sites.Reddit Then
-                    Responser.CookiesDomain = "reddit.com"
-                    Responser.Decoders.Add(SymbolsConverter.Converters.Unicode)
-                End If
-                Responser.SaveSettings()
-            End If
-            _Path = New XMLValue(Of SFile)("Path", SFile.GetPath($"{GlobalPath.PathWithSeparator}{Site}"),
-                                           _XML, {SettingsCLS.Name_Node_Sites, Site.ToString}, XMLValue(Of SFile).ToFilePath)
-            _Path.ReplaceByValue("Path", {Site.ToString})
-            _XML.Remove(Site.ToString)
-        End Sub
-        Friend Sub Update()
-            Responser.SaveSettings()
-        End Sub
-#Region "IDisposable Support"
-        Private disposedValue As Boolean = False
-        Protected Overridable Overloads Sub Dispose(ByVal disposing As Boolean)
-            If Not disposedValue Then
-                If disposing Then Responser.Dispose()
-                disposedValue = True
-            End If
-        End Sub
-        Protected Overrides Sub Finalize()
-            Dispose(False)
-            MyBase.Finalize()
-        End Sub
-        Friend Overloads Sub Dispose() Implements IDisposable.Dispose
-            Dispose(True)
-            GC.SuppressFinalize(Me)
-        End Sub
-#End Region
-    End Class
-End Namespace

SCrawler/API/Base/SiteSettingsBase.vb

@@ -0,0 +1,111 @@
+' Copyright (C) 2022  Andy
+' This program is free software: you can redistribute it and/or modify
+' it under the terms of the GNU General Public License as published by
+' the Free Software Foundation, either version 3 of the License, or
+' (at your option) any later version.
+'
+' This program is distributed in the hope that it will be useful,
+' but WITHOUT ANY WARRANTY
+Imports SCrawler.Plugin
+Imports PersonalUtilities.Functions.RegularExpressions
+Imports PersonalUtilities.Tools.WEB
+Imports Download = SCrawler.Plugin.ISiteSettings.Download
+Namespace API.Base
+    Friend MustInherit Class SiteSettingsBase : Implements ISiteSettings, IResponserContainer
+        Friend ReadOnly Property Site As String Implements ISiteSettings.Site
+        Friend Overridable ReadOnly Property Icon As Icon = Nothing Implements ISiteSettings.Icon
+        Friend Overridable ReadOnly Property Image As Image = Nothing Implements ISiteSettings.Image
+        Friend Overridable ReadOnly Property Responser As Response Implements IResponserContainer.Responser
+        Friend MustOverride Function GetInstance(ByVal What As Download) As IPluginContentProvider Implements ISiteSettings.GetInstance
+        Friend Sub New(ByVal SiteName As String)
+            Site = SiteName
+        End Sub
+        Friend Sub New(ByVal SiteName As String, ByVal CookiesDomain As String)
+            Site = SiteName
+            Responser = New Response($"{SettingsFolderName}\Responser_{Site}.xml")
+            With Responser
+                If .File.Exists Then .LoadSettings() Else .CookiesDomain = CookiesDomain : .SaveSettings()
+            End With
+        End Sub
+#Region "XML"
+        Friend Overridable Sub Load(ByVal XMLValues As IEnumerable(Of KeyValuePair(Of String, String))) Implements ISiteSettings.Load
+        End Sub
+#End Region
+#Region "Initialize"
+        Friend Overridable Sub BeginInit() Implements ISiteSettings.BeginInit
+        End Sub
+        Friend Overridable Sub EndInit() Implements ISiteSettings.EndInit
+        End Sub
+        Friend Overridable Sub BeginUpdate() Implements ISiteSettings.BeginUpdate
+        End Sub
+        Friend Overridable Sub EndUpdate() Implements ISiteSettings.EndUpdate
+        End Sub
+#End Region
+#Region "Before and After Download"
+        Friend Overridable Sub DownloadStarted(ByVal What As Download) Implements ISiteSettings.DownloadStarted
+        End Sub
+        Friend Overridable Sub BeforeStartDownload(ByVal User As Object, ByVal What As Download) Implements ISiteSettings.BeforeStartDownload
+        End Sub
+        Friend Overridable Sub AfterDownload(ByVal User As Object, ByVal What As Download) Implements ISiteSettings.AfterDownload
+        End Sub
+        Friend Overridable Sub DownloadDone(ByVal What As Download) Implements ISiteSettings.DownloadDone
+        End Sub
+#End Region
+#Region "User info"
+        Protected UrlPatternUser As String = String.Empty
+        Protected UrlPatternChannel As String = String.Empty
+        Friend Overridable Function GetUserUrl(ByVal UserName As String, ByVal Channel As Boolean) As String Implements ISiteSettings.GetUserUrl
+            If Channel Then
+                If Not UrlPatternChannel.IsEmptyString Then Return String.Format(UrlPatternChannel, UserName)
+            Else
+                If Not UrlPatternUser.IsEmptyString Then Return String.Format(UrlPatternUser, UserName)
+            End If
+            Return String.Empty
+        End Function
+        Protected UserRegex As RParams = Nothing
+        Friend Overridable Function IsMyUser(ByVal UserURL As String) As ExchangeOptions Implements ISiteSettings.IsMyUser
+            Try
+                If Not UserRegex Is Nothing Then
+                    Dim s$ = RegexReplace(UserURL, UserRegex)
+                    If Not s.IsEmptyString Then Return New ExchangeOptions(Site, s)
+                End If
+                Return Nothing
+            Catch ex As Exception
+                Return ErrorsDescriber.Execute(EDP.SendInLog + EDP.ReturnValue, ex, "[API.Base.SiteSettingsBase.IsMyUser]")
+            End Try
+        End Function
+        Protected ImageVideoContains As String = String.Empty
+        Friend Overridable Function IsMyImageVideo(ByVal URL As String) As ExchangeOptions Implements ISiteSettings.IsMyImageVideo
+            If Not ImageVideoContains.IsEmptyString AndAlso URL.Contains(ImageVideoContains) Then
+                Return New ExchangeOptions With {.Exists = True}
+            Else
+                Return Nothing
+            End If
+        End Function
+        Friend Overridable Function GetSpecialData(ByVal URL As String) As IEnumerable(Of IPluginUserMedia) Implements ISiteSettings.GetSpecialData
+            Return Nothing
+        End Function
+        Friend Overridable Function GetSpecialDataF(ByVal URL As String) As IEnumerable(Of UserMedia)
+            Return Nothing
+        End Function
+#End Region
+#Region "Ready, Available"
+        Friend Overridable Function Available(ByVal What As Download) As Boolean Implements ISiteSettings.Available
+            Return True
+        End Function
+        Friend Overridable Function ReadyToDownload(ByVal What As Download) As Boolean Implements ISiteSettings.ReadyToDownload
+            Return True
+        End Function
+#End Region
+        Friend Overridable Sub Update() Implements ISiteSettings.Update
+            If Not Responser Is Nothing Then Responser.SaveSettings()
+        End Sub
+        Friend Overridable Sub Reset() Implements ISiteSettings.Reset
+        End Sub
+        Friend Overridable Sub UserOptions(ByRef Options As Object, ByVal OpenForm As Boolean) Implements ISiteSettings.UserOptions
+            Options = Nothing
+        End Sub
+        Friend Overridable Sub OpenSettingsForm() Implements ISiteSettings.OpenSettingsForm
+        End Sub
+    End Class
+End Namespace

SCrawler/API/Base/Structures.vb

@@ -18,8 +18,8 @@ Namespace API.Base
                 GIF = 50
                 m3u8 = 100
             End Enum
-            Friend Enum States : Unknown : Tried : Downloaded : Skipped : End Enum
-            Friend Type As Types
+            Friend Enum States As Integer : Unknown = 0 : Tried = 1 : Downloaded = 2 : Skipped = 3 : End Enum
+            Friend [Type] As Types
             Friend URL_BASE As String
             Friend URL As String
             Friend MD5 As String
@@ -27,6 +27,11 @@ Namespace API.Base
             Friend Post As UserPost
             Friend PictureOption As String
             Friend State As States
+            ''' <summary>
+            ''' SomeFolder<br/>
+            ''' SomeFolder\SomeFolder2
+            ''' </summary>
+            Friend SpecialFolder As String
             Friend Sub New(ByVal _URL As String)
                 URL = _URL
                 URL_BASE = _URL
@@ -35,7 +40,18 @@ Namespace API.Base
             End Sub
             Friend Sub New(ByVal _URL As String, ByVal _Type As Types)
                 Me.New(_URL)
-                Type = _Type
+                [Type] = _Type
+            End Sub
+            Friend Sub New(ByVal m As Plugin.IPluginUserMedia)
+                If Not IsNothing(m) Then
+                    [Type] = m.ContentType
+                    URL = m.URL
+                    MD5 = m.MD5
+                    File = m.File
+                    Post = New UserPost With {.ID = m.PostID, .[Date] = m.PostDate}
+                    State = m.DownloadState
+                    SpecialFolder = m.SpecialFolder
+                End If
             End Sub
             Public Shared Widening Operator CType(ByVal _URL As String) As UserMedia
                 Return New UserMedia(_URL)
@@ -46,6 +62,18 @@ Namespace API.Base
             Public Overrides Function ToString() As String
                 Return URL
             End Function
+            Friend Function PluginUserMedia() As Plugin.PluginUserMedia
+                Return New Plugin.PluginUserMedia With {
+                    .ContentType = Type,
+                    .DownloadState = State,
+                    .File = File,
+                    .MD5 = MD5,
+                    .URL = URL,
+                    .SpecialFolder = SpecialFolder,
+                    .PostID = Post.ID,
+                    .PostDate = Post.Date
+                }
+            End Function
             Friend Overloads Function Equals(ByVal Other As UserMedia) As Boolean Implements IEquatable(Of UserMedia).Equals
                 Return URL = Other.URL
             End Function
@@ -85,5 +113,21 @@ Namespace API.Base
                 Return v
             End Function
         End Structure
+        Friend Structure Sizes : Implements IComparable(Of Sizes)
+            Friend Value As Integer
+            Friend Data As String
+            Friend ReadOnly HasError As Boolean
+            Friend Sub New(ByVal _Value As String, ByVal _Data As String)
+                Try
+                    Value = _Value
+                    Data = _Data
+                Catch ex As Exception
+                    HasError = True
+                End Try
+            End Sub
+            Friend Function CompareTo(ByVal Other As Sizes) As Integer Implements IComparable(Of Sizes).CompareTo
+                Return Value.CompareTo(Other.Value) * -1
+            End Function
+        End Structure
     End Module
 End Namespace

SCrawler/API/Base/UserDataBase.vb

@@ -7,36 +7,85 @@
 ' This program is distributed in the hope that it will be useful,
 ' but WITHOUT ANY WARRANTY
 Imports PersonalUtilities.Functions.XML
+Imports PersonalUtilities.Functions.RegularExpressions
+Imports PersonalUtilities.Forms.Toolbars
 Imports System.IO
+Imports System.Net
 Imports System.Threading
-Imports UState = SCrawler.API.Base.UserMedia.States
+Imports SCrawler.Plugin
+Imports SCrawler.Plugin.Hosts
+Imports UStates = SCrawler.API.Base.UserMedia.States
+Imports UTypes = SCrawler.API.Base.UserMedia.Types
 Namespace API.Base
-    Friend MustInherit Class UserDataBase : Implements IUserData
+    Friend MustInherit Class UserDataBase : Implements IUserData, IPluginContentProvider, IThrower
         Friend Const UserFileAppender As String = "User"
-        Friend Event OnUserUpdated As IUserData.OnUserUpdatedEventHandler Implements IUserData.OnUserUpdated
-        Protected Sub Raise_OnUserUpdated()
+        Private ReadOnly _OnUserUpdatedHandlers As List(Of IUserData.OnUserUpdatedEventHandler)
+        Friend Custom Event OnUserUpdated As IUserData.OnUserUpdatedEventHandler Implements IUserData.OnUserUpdated
+            AddHandler(ByVal e As IUserData.OnUserUpdatedEventHandler)
+                If Not _OnUserUpdatedHandlers.Contains(e) Then _OnUserUpdatedHandlers.Add(e)
+            End AddHandler
+            RemoveHandler(ByVal e As IUserData.OnUserUpdatedEventHandler)
+                If _OnUserUpdatedHandlers.Contains(e) Then _OnUserUpdatedHandlers.Remove(e)
+            End RemoveHandler
+            RaiseEvent(ByVal User As IUserData)
+                If _OnUserUpdatedHandlers.Count > 0 Then
+                    For Each e As IUserData.OnUserUpdatedEventHandler In _OnUserUpdatedHandlers
+                        Try : e.Invoke(User) : Catch : End Try
+                    Next
+                End If
+            End RaiseEvent
+        End Event
+        Protected Sub RaiseEvent_OnUserUpdated()
             RaiseEvent OnUserUpdated(Me)
         End Sub
+        Friend Sub RemoveUpdateHandlers()
+            _OnUserUpdatedHandlers.Clear()
+        End Sub
 #Region "Collection buttons"
+        Private _CollectionButtonsExists As Boolean = False
+        Private _CollectionButtonsColorsSet As Boolean = False
+        Friend InternalCollectionIndex As Integer = -1
         Friend WithEvents BTT_CONTEXT_DOWN As ToolStripMenuItem
         Friend WithEvents BTT_CONTEXT_EDIT As ToolStripMenuItem
         Friend WithEvents BTT_CONTEXT_DELETE As ToolStripMenuItem
         Friend WithEvents BTT_CONTEXT_OPEN_PATH As ToolStripMenuItem
         Friend WithEvents BTT_CONTEXT_OPEN_SITE As ToolStripMenuItem
         Friend Sub CreateButtons(ByVal CollectionIndex As Integer)
+            InternalCollectionIndex = CollectionIndex
             Dim tn$ = $"[{Site}] - {Name}"
             Dim _tn$ = $"{Site}{Name}"
             Dim tnn As Func(Of String, String) = Function(Input) $"{Input}{_tn}"
             Dim i As Image = Nothing
-            Select Case Site
-                Case Sites.Reddit : i = My.Resources.RedditIcon.ToBitmap
-                Case Sites.Twitter : i = My.Resources.TwitterIcon.ToBitmap
-            End Select
+            With HOST.Source
+                If Not .Icon Is Nothing Then
+                    i = .Icon.ToBitmap
+                ElseIf Not .Image Is Nothing Then
+                    i = .Image
+                End If
+            End With
             BTT_CONTEXT_DOWN = New ToolStripMenuItem(tn, i) With {.Name = tnn("DOWN"), .Tag = CollectionIndex}
             BTT_CONTEXT_EDIT = New ToolStripMenuItem(tn, i) With {.Name = tnn("EDIT"), .Tag = CollectionIndex}
             BTT_CONTEXT_DELETE = New ToolStripMenuItem(tn, i) With {.Name = tnn("DELETE"), .Tag = CollectionIndex}
             BTT_CONTEXT_OPEN_PATH = New ToolStripMenuItem(tn, i) With {.Name = tnn("PATH"), .Tag = CollectionIndex}
             BTT_CONTEXT_OPEN_SITE = New ToolStripMenuItem(tn, i) With {.Name = tnn("SITE"), .Tag = CollectionIndex}
+            UpdateButtonsColor()
+            _CollectionButtonsExists = True
+            If _UserInformationLoaded Then _CollectionButtonsColorsSet = True
+        End Sub
+        Private Sub UpdateButtonsColor()
+            Dim cb As Color = SystemColors.Control
+            Dim cf As Color = SystemColors.ControlText
+            If Not UserExists Then
+                cb = ColorBttDeleteBack
+                cf = ColorBttDeleteFore
+            ElseIf UserSuspended Then
+                cb = ColorBttEditBack
+                cf = ColorBttEditFore
+            End If
+            For Each b As ToolStripMenuItem In {BTT_CONTEXT_DOWN, BTT_CONTEXT_EDIT, BTT_CONTEXT_DELETE, BTT_CONTEXT_OPEN_PATH, BTT_CONTEXT_OPEN_SITE}
+                If Not b Is Nothing Then b.BackColor = cb : b.ForeColor = cf
+            Next
+            If _UserInformationLoaded Then _CollectionButtonsColorsSet = True
         End Sub
 #End Region
 #Region "XML Declarations"
@@ -76,13 +125,17 @@ Namespace API.Base
 #End Region
 #End Region
 #Region "Declarations"
-        Friend MustOverride Property Site As Sites Implements IContentProvider.Site
+        Friend ReadOnly Property Site As String Implements IContentProvider.Site
+            Get
+                Return HOST.Name
+            End Get
+        End Property
+        Friend Property Progress As MyProgress
         Friend User As UserInfo
-        Protected Const NonExistendUserHelp As String = "404"
-        Protected Const SuspendedUserHelp As String = "403"
-        Friend Overridable Property UserExists As Boolean = True Implements IUserData.Exists
-        Friend Overridable Property UserSuspended As Boolean = False Implements IUserData.Suspended
-        Friend Overridable Property Name As String Implements IContentProvider.Name
+        Friend Property IsSavedPosts As Boolean Implements IPluginContentProvider.IsSavedPosts
+        Friend Overridable Property UserExists As Boolean = True Implements IUserData.Exists, IPluginContentProvider.UserExists
+        Friend Overridable Property UserSuspended As Boolean = False Implements IUserData.Suspended, IPluginContentProvider.UserSuspended
+        Friend Overridable Property Name As String Implements IContentProvider.Name, IPluginContentProvider.Name
             Get
                 Return User.Name
             End Get
@@ -92,10 +145,31 @@ Namespace API.Base
                 Settings.UpdateUsersList(User)
             End Set
         End Property
-        Friend Overridable Property ID As String = String.Empty Implements IContentProvider.ID
+        Friend Overridable Property ID As String = String.Empty Implements IContentProvider.ID, IPluginContentProvider.ID
         Friend Overridable Property FriendlyName As String = String.Empty Implements IContentProvider.FriendlyName
-        Friend Property UserDescription As String = String.Empty Implements IContentProvider.Description
-        Friend Property ParseUserMediaOnly As Boolean = False Implements IUserData.ParseUserMediaOnly
+#Region "UserDescription"
+        Friend Property UserDescription As String = String.Empty Implements IContentProvider.Description, IPluginContentProvider.UserDescription
+        Protected _DescriptionEveryTime As Boolean = False
+        Protected _DescriptionChecked As Boolean = False
+        Protected Function UserDescriptionNeedToUpdate() As Boolean
+            Return (UserDescription.IsEmptyString Or _DescriptionEveryTime) And Not _DescriptionChecked
+        End Function
+        Protected Sub UserDescriptionUpdate(ByVal Descr As String)
+            If UserDescriptionNeedToUpdate() Then
+                If UserDescription.IsEmptyString Then
+                    UserDescription = Descr
+                ElseIf Not UserDescription.Contains(Descr) Then
+                    UserDescription &= $"{vbNewLine}----{vbNewLine}{Descr}"
+                End If
+                _DescriptionChecked = True
+            End If
+        End Sub
+        Protected Sub UserDescriptionReset()
+            _DescriptionChecked = False
+            _DescriptionEveryTime = Settings.UpdateUserDescriptionEveryTime
+        End Sub
+#End Region
+        Friend Property ParseUserMediaOnly As Boolean = False Implements IUserData.ParseUserMediaOnly, IPluginContentProvider.ParseUserMediaOnly
         Protected _Favorite As Boolean = False
         Friend Overridable Property Favorite As Boolean Implements IContentProvider.Favorite
             Get
@@ -166,7 +240,7 @@ BlockPictureFolder:
                         p = New UserImage(PicList.First, l, s, MyFile)
                         GoTo BlockReturn
                     Else
-                        f.Delete(SFO.Path, False, False, EDP.None)
+                        f.Delete(SFO.Path, Settings.DeleteMode, EDP.None)
                         DelPath = False
                     End If
                 End If
@@ -186,7 +260,7 @@ BlockDeletePictureFolder:
             On Error GoTo BlockReturn
             If DelPath Then
                 f = SFile.GetPath($"{MyFile.PathWithSeparator}Pictures")
-                If f.Exists(SFO.Path, False) Then f.Delete(SFO.Path, False, False)
+                If f.Exists(SFO.Path, False) Then f.Delete(SFO.Path, Settings.DeleteMode)
             End If
 BlockReturn:
             On Error GoTo BlockNullPicture
@@ -286,89 +360,128 @@ BlockNullPicture:
         End Property
 #End Region
 #Region "Information"
-        Protected _CountVideo As Integer = 0
-        Protected _CountPictures As Integer = 0
         Friend Overridable Property LastUpdated As Date?
-        Friend ReadOnly Property TotalContentCount As Integer
-            Get
-                Return _CountVideo + _CountPictures
-            End Get
-        End Property
         Friend Overridable Property HasError As Boolean = False Implements IUserData.HasError
         Private _DownloadedPicturesTotal As Integer = 0
         Private _DownloadedPicturesSession As Integer = 0
-        Friend Property DownloadedPictures As Integer Implements IUserData.DownloadedPictures
+        Friend Property DownloadedPictures(ByVal Total As Boolean) As Integer Implements IUserData.DownloadedPictures
             Get
-                Return _DownloadedPicturesSession
+                Return IIf(Total, _DownloadedPicturesTotal, _DownloadedPicturesSession)
             End Get
             Set(ByVal NewValue As Integer)
-                _DownloadedPicturesSession = NewValue
+                If Total Then
+                    _DownloadedPicturesTotal = NewValue
+                Else
+                    _DownloadedPicturesSession = NewValue
+                End If
             End Set
         End Property
         Private _DownloadedVideosTotal As Integer = 0
         Private _DownloadedVideosSession As Integer = 0
-        Friend Property DownloadedVideos As Integer Implements IUserData.DownloadedVideos
+        Friend Property DownloadedVideos(ByVal Total As Boolean) As Integer Implements IUserData.DownloadedVideos
             Get
-                Return _DownloadedVideosSession
+                Return IIf(Total, _DownloadedVideosTotal, _DownloadedVideosSession)
             End Get
             Set(ByVal NewValue As Integer)
-                _DownloadedVideosSession = NewValue
+                If Total Then
+                    _DownloadedVideosTotal = NewValue
+                Else
+                    _DownloadedVideosSession = NewValue
+                End If
             End Set
         End Property
         Friend Overridable ReadOnly Property DownloadedTotal(Optional ByVal Total As Boolean = True) As Integer Implements IUserData.DownloadedTotal
             Get
-                If Total Then
-                    Return _DownloadedPicturesTotal + _DownloadedVideosTotal
-                Else
-                    Return _DownloadedPicturesSession + _DownloadedVideosSession
-                End If
+                Return DownloadedPictures(Total) + DownloadedVideos(Total)
             End Get
         End Property
         Friend ReadOnly Property DownloadedInformation As String Implements IUserData.DownloadedInformation
             Get
                 Dim luv$ = String.Empty
                 If LastUpdated.HasValue Then luv = $"{LastUpdated.Value.ToStringDate(ADateTime.Formats.BaseDateTime)}: "
-                Return $"{luv}{Name} [{Site}]{IIf(HasError, " (with errors)", String.Empty)}: P - {_DownloadedPicturesTotal}; V - {_DownloadedVideosTotal}" &
-                    $" (P - {_CountPictures}; V - {_CountVideo})"
+                Return $"{luv}{Name} [{Site}]{IIf(HasError, " (with errors)", String.Empty)}: P - {DownloadedPictures(False)}; V - {DownloadedVideos(False)}" &
+                       $" (P - {DownloadedPictures(True)}; V - {DownloadedVideos(True)})"
             End Get
         End Property
 #End Region
-        Protected ReadOnly LNC As New ListAddParams(LAP.NotContainsOnly)
+#End Region
+#Region "Plugins Support"
+        Protected Event ProgressChanged As IPluginContentProvider.ProgressChangedEventHandler Implements IPluginContentProvider.ProgressChanged
+        Protected Event TotalCountChanged As IPluginContentProvider.TotalCountChangedEventHandler Implements IPluginContentProvider.TotalCountChanged
+        Friend Property HOST As SettingsHost Implements IUserData.HOST
+        Private Property IPluginContentProvider_Settings As ISiteSettings Implements IPluginContentProvider.Settings
+            Get
+                Return HOST.Source
+            End Get
+            Set(ByVal s As ISiteSettings)
+            End Set
+        End Property
+        Private Property IPluginContentProvider_Thrower As IThrower Implements IPluginContentProvider.Thrower
+        Private Property IPluginContentProvider_LogProvider As ILogProvider Implements IPluginContentProvider.LogProvider
+        Friend Property ExternalPlugin As IPluginContentProvider
+        Private Property IPluginContentProvider_ExistingContentList As List(Of PluginUserMedia) Implements IPluginContentProvider.ExistingContentList
+        Private Property IPluginContentProvider_TempPostsList As List(Of String) Implements IPluginContentProvider.TempPostsList
+        Private Property IPluginContentProvider_TempMediaList As List(Of IPluginUserMedia) Implements IPluginContentProvider.TempMediaList
+        Private Property IPluginContentProvider_SeparateVideoFolder As Boolean Implements IPluginContentProvider.SeparateVideoFolder
+        Private Property IPluginContentProvider_DataPath As String Implements IPluginContentProvider.DataPath
+        Private Sub IPluginContentProvider_XmlFieldsSet(ByVal Fields As List(Of KeyValuePair(Of String, String))) Implements IPluginContentProvider.XmlFieldsSet
+        End Sub
+        Private Function IPluginContentProvider_XmlFieldsGet() As List(Of KeyValuePair(Of String, String)) Implements IPluginContentProvider.XmlFieldsGet
+            Return Nothing
+        End Function
+        Private Sub IPluginContentProvider_GetMedia() Implements IPluginContentProvider.GetMedia
+        End Sub
+        Private Sub IPluginContentProvider_Download() Implements IPluginContentProvider.Download
+        End Sub
+        Friend Overridable Function ExchangeOptionsGet() As Object Implements IPluginContentProvider.ExchangeOptionsGet
+            Return Nothing
+        End Function
+        Friend Overridable Sub ExchangeOptionsSet(ByVal Obj As Object) Implements IPluginContentProvider.ExchangeOptionsSet
+        End Sub
+        Private _ExternalCompatibilityToken As CancellationToken
+#End Region
+#Region "IIndexable Support"
+        Friend Property Index As Integer = 0 Implements IIndexable.Index
+        Private Function SetIndex(ByVal Obj As Object, ByVal _Index As Integer) As Object Implements IIndexable.SetIndex
+            DirectCast(Obj, UserDataBase).Index = _Index
+            Return Obj
+        End Function
 #End Region
 #Region "LVI"
-        Friend ReadOnly Property LVIKey As String Implements IUserData.LVIKey
+        Friend ReadOnly Property LVIKey As String Implements IUserData.Key
             Get
                 If Not _IsCollection Then
-                    Return $"{IIf(Site = Sites.Reddit, "R", "T")}_{Name}"
+                    Return $"{IIf(IsChannel, "C", String.Empty)}{Site.ToString.ToUpper}_{Name}"
                 Else
                     Return $"CCCC_{CollectionName}"
                 End If
             End Get
         End Property
-        Private _LVIIndex As Integer = -1
-        Private ReadOnly Property LVIIndex As Integer Implements IUserData.LVIIndex
-            Get
-                Return _LVIIndex
-            End Get
-        End Property
         Friend Function GetLVI(ByVal Destination As ListView) As ListViewItem Implements IUserData.GetLVI
-            _LVIIndex = Destination.Items.Count
             If Settings.ViewModeIsPicture Then
-                Return New ListViewItem(ToString(), LVIKey, GetLVIGroup(Destination)) With {.Name = LVIKey, .Tag = LVIKey}
+                Return ListImagesLoader.ApplyLVIColor(Me, New ListViewItem(ToString(), LVIKey, GetLVIGroup(Destination)) With {.Name = LVIKey, .Tag = LVIKey}, True)
             Else
-                Return New ListViewItem(ToString(), GetLVIGroup(Destination)) With {.Name = LVIKey, .Tag = LVIKey}
+                Return ListImagesLoader.ApplyLVIColor(Me, New ListViewItem(ToString(), GetLVIGroup(Destination)) With {.Name = LVIKey, .Tag = LVIKey}, True)
             End If
         End Function
         Friend Overridable ReadOnly Property FitToAddParams As Boolean Implements IUserData.FitToAddParams
             Get
-                Select Case Settings.ShowingMode.Value
-                    Case ShowingModes.Regular : Return Not Temporary And Not Favorite
-                    Case ShowingModes.Temporary : Return Temporary
-                    Case ShowingModes.Favorite : Return Favorite
-                    Case ShowingModes.Labels : Return Settings.Labels.CurrentSelection.ListContains(Labels)
-                    Case ShowingModes.NoLabels : Return Labels.Count = 0
-                    Case Else : Return True
-                End Select
+                If Settings.LastUpdatedDate.HasValue AndAlso LastUpdated.HasValue AndAlso
+                   LastUpdated.Value.Date > Settings.LastUpdatedDate.Value.Date Then Return False
+                If Settings.SelectedSites.Count = 0 OrElse Settings.SelectedSites.Contains(Site) Then
+                    Select Case Settings.ShowingMode.Value
+                        Case ShowingModes.Regular : Return Not Temporary And Not Favorite
+                        Case ShowingModes.Temporary : Return Temporary
+                        Case ShowingModes.Favorite : Return Favorite
+                        Case ShowingModes.Deleted : Return Not UserExists
+                        Case ShowingModes.Suspended : Return UserSuspended
+                        Case ShowingModes.Labels : Return Settings.Labels.CurrentSelection.ListContains(Labels)
+                        Case ShowingModes.NoLabels : Return Labels.Count = 0
+                        Case Else : Return True
+                    End Select
+                Else
+                    Return False
+                End If
             End Get
         End Property
         Friend Function GetLVIGroup(ByVal Destination As ListView) As ListViewGroup Implements IUserData.GetLVIGroup
@@ -378,12 +491,10 @@ BlockNullPicture:
                         For i% = 0 To Labels.Count - 1
                             If Settings.Labels.CurrentSelection.Contains(Labels(i)) Then Return Destination.Groups.Item(Labels(i))
                         Next
-                        Return Destination.Groups.Item(LabelsKeeper.NoLabeledName)
-                    Else
-                        Return Destination.Groups.Item(LabelsKeeper.NoLabeledName)
                     End If
+                    Return Destination.Groups.Item(LabelsKeeper.NoLabeledName)
                 Else
-                    Return Destination.Groups.Item(GetLviGroupName(Site, Temporary, Favorite, IsCollection))
+                    Return Destination.Groups.Item(GetLviGroupName(HOST, Temporary, Favorite, IsCollection, IsChannel))
                 End If
             Catch ex As Exception
                 Return Destination.Groups.Item(LabelsKeeper.NoLabeledName)
@@ -392,9 +503,9 @@ BlockNullPicture:
         Friend Overridable Function GetUserInformation() As String
             Dim OutStr$ = $"User: {Name}"
             OutStr.StringAppendLine($"Path: {MyFile.CutPath.Path}")
-            OutStr.StringAppendLine($"Total downloaded ({TotalContentCount.NumToString(ANumbers.Formats.Number, 3)}):")
-            OutStr.StringAppendLine($"Pictures: {_CountPictures.NumToString(ANumbers.Formats.Number, 3)}")
-            OutStr.StringAppendLine($"Videos: {_CountVideo.NumToString(ANumbers.Formats.Number, 3)}")
+            OutStr.StringAppendLine($"Total downloaded ({DownloadedTotal(True).NumToString(ANumbers.Formats.Number, 3)}):")
+            OutStr.StringAppendLine($"Pictures: {DownloadedPictures(True).NumToString(ANumbers.Formats.Number, 3)}")
+            OutStr.StringAppendLine($"Videos: {DownloadedVideos(True).NumToString(ANumbers.Formats.Number, 3)}")
             If Not UserDescription.IsEmptyString Then
                 OutStr.StringAppendLine(String.Empty)
                 OutStr.StringAppendLine(UserDescription)
@@ -403,8 +514,8 @@ BlockNullPicture:
             OutStr.StringAppendLine($"Last updated at: {AConvert(Of String)(LastUpdated, ADateTime.Formats.BaseDateTime, "not yet")}")
             If _DataParsed Then
                 OutStr.StringAppendLine("Downloaded now:")
-                OutStr.StringAppendLine($"Pictures: {_CountPictures.NumToString(ANumbers.Formats.Number, 3)}")
-                OutStr.StringAppendLine($"Videos: {_CountVideo.NumToString(ANumbers.Formats.Number, 3)}")
+                OutStr.StringAppendLine($"Pictures: {DownloadedTotal(False).NumToString(ANumbers.Formats.Number, 3)}")
+                OutStr.StringAppendLine($"Videos: {DownloadedVideos(False).NumToString(ANumbers.Formats.Number, 3)}")
             End If
             Return OutStr
         End Function
@@ -419,31 +530,34 @@ BlockNullPicture:
             _TempMediaList = New List(Of UserMedia)
             _TempPostsList = New List(Of String)
             Labels = New List(Of String)
+            _OnUserUpdatedHandlers = New List(Of IUserData.OnUserUpdatedEventHandler)
             If InvokeImageHandler Then ImageHandler(Me)
         End Sub
+        Friend Sub SetEnvironment(ByRef h As SettingsHost, ByVal u As UserInfo, ByVal _LoadUserInformation As Boolean,
+                                  Optional ByVal AttachUserInfo As Boolean = True) Implements IUserData.SetEnvironment
+            HOST = h
+            If AttachUserInfo Then
+                User = u
+                If _LoadUserInformation Then LoadUserInformation()
+            End If
+        End Sub
         ''' <exception cref="ArgumentOutOfRangeException"></exception>
         Friend Overloads Shared Function GetInstance(ByVal u As UserInfo, Optional ByVal _LoadUserInformation As Boolean = True) As IUserData
-            Select Case u.Site
-                Case Sites.Reddit
-                    If u.IsChannel Then
-                        Return New Reddit.Channel(u, _LoadUserInformation)
-                    Else
-                        Return New Reddit.UserData(u, _LoadUserInformation)
-                    End If
-                Case Sites.Twitter : Return New Twitter.UserData(u, _LoadUserInformation)
-                Case Else : Throw New ArgumentOutOfRangeException("Site", $"Site [{u.Site}] information does not recognized by loader")
-            End Select
+            If Not u.Plugin.IsEmptyString Then
+                Return Settings(u.Plugin).GetInstance(u.DownloadOption, u, _LoadUserInformation)
+            Else
+                Throw New ArgumentOutOfRangeException("Plugin", $"Plugin [{u.Plugin}] information does not recognized by loader")
+            End If
         End Function
 #End Region
 #Region "Information & Content data files loader and saver"
 #Region "User information"
+        Private _UserInformationLoaded As Boolean = False
         Friend Overridable Sub LoadUserInformation() Implements IUserData.LoadUserInformation
             Try
                 If MyFile.Exists Then
                     FileExists = True
                     Using x As New XmlFile(MyFile) With {.XmlReadOnly = True}
-                        User.Site = Site
-                        Site = x.Value(Name_Site).FromXML(Of Integer)(0)
                         User.Name = x.Value(Name_UserName)
                         UserExists = x.Value(Name_UserExists).FromXML(Of Boolean)(True)
                         UserSuspended = x.Value(Name_UserSuspended).FromXML(Of Boolean)(False)
@@ -454,18 +568,21 @@ BlockNullPicture:
                         Temporary = x.Value(Name_Temporary).FromXML(Of Boolean)(False)
                         Favorite = x.Value(Name_Favorite).FromXML(Of Boolean)(False)
                         CreatedByChannel = x.Value(Name_CreatedByChannel).FromXML(Of Boolean)(False)
-                        SeparateVideoFolder = AConvert(Of Boolean)(x.Value(Name_SeparateVideoFolder), Nothing)
+                        SeparateVideoFolder = AConvert(Of Boolean)(x.Value(Name_SeparateVideoFolder), AModes.Var, Nothing)
                         ReadyForDownload = x.Value(Name_ReadyForDownload).FromXML(Of Boolean)(True)
                         DownloadImages = x.Value(Name_DownloadImages).FromXML(Of Boolean)(True)
                         DownloadVideos = x.Value(Name_DownloadVideos).FromXML(Of Boolean)(True)
-                        _CountVideo = x.Value(Name_VideoCount).FromXML(Of Integer)(0)
-                        _CountPictures = x.Value(Name_PicturesCount).FromXML(Of Integer)(0)
+                        DownloadedVideos(True) = x.Value(Name_VideoCount).FromXML(Of Integer)(0)
+                        DownloadedPictures(True) = x.Value(Name_PicturesCount).FromXML(Of Integer)(0)
                         LastUpdated = AConvert(Of Date)(x.Value(Name_LastUpdated), ADateTime.Formats.BaseDateTime, Nothing)
                         DataMerging = x.Value(Name_DataMerging).FromXML(Of Boolean)(False)
                         ChangeCollectionName(x.Value(Name_CollectionName), False)
                         Labels.ListAddList(x.Value(Name_LabelsName).StringToList(Of String, List(Of String))("|", EDP.ReturnValue), LAP.NotContainsOnly, LAP.ClearBeforeAdd)
+                        LoadUserInformation_OptionalFields(x, True)
                     End Using
                     UpdateDataFiles()
+                    _UserInformationLoaded = True
+                    If _CollectionButtonsExists And Not _CollectionButtonsColorsSet And (Not UserExists Or UserSuspended) Then UpdateButtonsColor()
                 End If
             Catch ex As Exception
                 LogError(ex, "user information loading error")
@@ -475,7 +592,7 @@ BlockNullPicture:
             Try
                 MyFile.Exists(SFO.Path)
                 Using x As New XmlFile With {.Name = "User"}
-                    x.Add(Name_Site, CInt(Site))
+                    x.Add(Name_Site, Site)
                     x.Add(Name_UserName, User.Name)
                     x.Add(Name_UserExists, UserExists.BoolToInteger)
                     x.Add(Name_UserSuspended, UserSuspended.BoolToInteger)
@@ -494,30 +611,31 @@ BlockNullPicture:
                     x.Add(Name_ReadyForDownload, ReadyForDownload.BoolToInteger)
                     x.Add(Name_DownloadImages, DownloadImages.BoolToInteger)
                     x.Add(Name_DownloadVideos, DownloadVideos.BoolToInteger)
-                    x.Add(Name_VideoCount, _CountVideo)
-                    x.Add(Name_PicturesCount, _CountPictures)
+                    x.Add(Name_VideoCount, DownloadedVideos(True))
+                    x.Add(Name_PicturesCount, DownloadedPictures(True))
                     x.Add(Name_LastUpdated, AConvert(Of String)(LastUpdated, ADateTime.Formats.BaseDateTime, String.Empty))
                     x.Add(Name_CollectionName, CollectionName)
                     x.Add(Name_LabelsName, Labels.ListToString(, "|", EDP.ReturnValue))
                     x.Add(Name_DataMerging, DataMerging.BoolToInteger)
 
+                    LoadUserInformation_OptionalFields(x, False)
+
                     x.Save(MyFile)
                 End Using
-                Settings.UpdateUsersList(User)
+                If Not IsSavedPosts Then Settings.UpdateUsersList(User)
             Catch ex As Exception
                 LogError(ex, "user information saving error")
             End Try
         End Sub
+        ''' <param name="Loading"><see langword="True"/>: Loading; <see langword="False"/>: Saving</param>
+        Protected MustOverride Sub LoadUserInformation_OptionalFields(ByRef Container As XmlFile, ByVal Loading As Boolean)
 #End Region
 #Region "User data"
         Friend Overridable Overloads Sub LoadContentInformation()
-            UpdateDataFiles()
-            LoadContentInformation(_ContentList, MyFileData)
-        End Sub
-        Private Overloads Sub LoadContentInformation(ByRef _CLIST As List(Of UserMedia), ByVal f As SFile)
             Try
-                If Not f.Exists Then Exit Sub
-                Using x As New XmlFile(f, Protector.Modes.All, False) With {.XmlReadOnly = True, .AllowSameNames = True}
+                UpdateDataFiles()
+                If Not MyFileData.Exists Then Exit Sub
+                Using x As New XmlFile(MyFileData, Protector.Modes.All, False) With {.XmlReadOnly = True, .AllowSameNames = True}
                     x.LoadData()
                     If x.Count > 0 Then
                         Dim fs$ = MyFile.CutPath.PathWithSeparator
@@ -533,7 +651,7 @@ BlockNullPicture:
                                                                  End If
                                                              End Function
                         For Each v As EContainer In x
-                            _CLIST.Add(New UserMedia With {
+                            _ContentList.Add(New UserMedia With {
                                            .Type = AConvert(Of Integer)(v.Attribute(Name_MediaType).Value, 0),
                                            .URL = v.Attribute(Name_MediaURL).Value,
                                            .URL_BASE = v.Value,
@@ -551,14 +669,14 @@ BlockNullPicture:
                 LogError(ex, "history loading error")
             End Try
         End Sub
-        Friend Sub UpdateContentInformation(ByRef _CLIST As List(Of UserMedia), ByVal f As SFile)
+        Friend Sub UpdateContentInformation()
             Try
                 UpdateDataFiles()
-                If f.IsEmptyString Then Exit Sub
-                f.Exists(SFO.Path)
+                If MyFileData.IsEmptyString Then Exit Sub
+                MyFileData.Exists(SFO.Path)
                 Using x As New XmlFile With {.AllowSameNames = True, .Name = "Data"}
-                    If _CLIST.Count > 0 Then
-                        For Each i As UserMedia In _CLIST
+                    If _ContentList.Count > 0 Then
+                        For Each i As UserMedia In _ContentList
                             x.Add(New EContainer("MediaData", i.URL_BASE,
                                                  {New EAttribute(Name_MediaType, CInt(i.Type)),
                                                   New EAttribute(Name_MediaURL, i.URL),
@@ -578,38 +696,44 @@ BlockNullPicture:
 #End Region
 #End Region
 #Region "Open site, folder"
-        Friend Overridable Sub OpenSite() Implements IContentProvider.OpenSite
+        Friend Overridable Sub OpenSite(Optional ByVal e As ErrorsDescriber = Nothing) Implements IContentProvider.OpenSite
             Try
-                Dim URL$ = String.Empty
-                Select Case Site
-                    Case Sites.Reddit : URL = $"https://www.reddit.com/{IIf(IsChannel, "r", "user")}/{Name}/"
-                    Case Sites.Twitter : URL = $"https://twitter.com/{Name}"
-                    Case Else : MsgBoxE($"Site [{Site}] opening does not implemented", MsgBoxStyle.Exclamation)
-                End Select
+                Dim URL$ = HOST.Source.GetUserUrl(Name, IsChannel)
                 If Not URL.IsEmptyString Then Process.Start(URL)
             Catch ex As Exception
-                MsgBoxE($"Error on trying to open [{Site}] page of user [{Name}]", MsgBoxStyle.Critical)
+                If Not e.Exists Then e = New ErrorsDescriber(EDP.ShowAllMsg)
+                MsgBoxE($"Error on trying to open [{Site}] page of user [{Name}]", MsgBoxStyle.Critical, e)
             End Try
         End Sub
         Friend Overridable Sub OpenFolder() Implements IUserData.OpenFolder
-            MyFile.CutPath.Open(SFO.Path, EDP.None)
+            GlobalOpenPath(MyFile.CutPath)
         End Sub
 #End Region
 #Region "Download functions and options"
-        Friend Overridable Property DownloadTopCount As Integer? = Nothing Implements IUserData.DownloadTopCount
+        Friend Overridable Property DownloadTopCount As Integer? = Nothing Implements IUserData.DownloadTopCount, IPluginContentProvider.PostsNumberLimit
+        Friend Overridable Property DownloadToDate As Date? = Nothing Implements IUserData.DownloadToDate, IPluginContentProvider.PostsDateLimit
         Protected Responser As PersonalUtilities.Tools.WEB.Response
         Friend Overridable Sub DownloadData(ByVal Token As CancellationToken) Implements IContentProvider.DownloadData
             Dim Canceled As Boolean = False
+            _ExternalCompatibilityToken = Token
             Try
                 UpdateDataFiles()
+                UserDescriptionReset()
                 If Not Responser Is Nothing Then Responser.Dispose()
                 Responser = New PersonalUtilities.Tools.WEB.Response
-                Responser.Copy(Settings.Site(Site).Responser)
+                If TypeOf HOST.Source Is IResponserContainer Then
+                    With DirectCast(HOST.Source, IResponserContainer)
+                        If Not .Responser Is Nothing Then Responser.Copy(.Responser)
+                    End With
+                End If
+
                 Dim UpPic As Boolean = Settings.ViewModeIsPicture AndAlso GetPicture(False) Is Nothing
                 Dim sEnvir() As Boolean = {UserExists, UserSuspended}
                 Dim EnvirChanged As Func(Of Boolean) = Function() Not sEnvir(0) = UserExists Or Not sEnvir(1) = UserSuspended
-                _DownloadedPicturesSession = 0
-                _DownloadedVideosSession = 0
+                UserExists = True
+                UserSuspended = False
+                DownloadedPictures(False) = 0
+                DownloadedVideos(False) = 0
                 _TempMediaList.Clear()
                 _TempPostsList.Clear()
                 Dim __SaveData As Boolean = Not CreatedByChannel Or Not Settings.FromChannelDownloadTopUse
@@ -618,14 +742,15 @@ BlockNullPicture:
 
                 If MyFilePosts.Exists Then _TempPostsList.ListAddList(File.ReadAllLines(MyFilePosts))
                 If _ContentList.Count > 0 Then _TempPostsList.ListAddList(_ContentList.Select(Function(u) u.Post.ID), LNC)
+
                 ThrowAny(Token)
                 DownloadDataF(Token)
                 ThrowAny(Token)
 
                 If _TempMediaList.Count > 0 Then
-                    If Not DownloadImages Then _TempMediaList.RemoveAll(Function(m) m.Type = UserMedia.Types.GIF Or m.Type = UserMedia.Types.Picture)
-                    If Not DownloadVideos Then _TempMediaList.RemoveAll(Function(m) m.Type = UserMedia.Types.Video Or
-                                                                                    m.Type = UserMedia.Types.VideoPre Or m.Type = UserMedia.Types.m3u8)
+                    If Not DownloadImages Then _TempMediaList.RemoveAll(Function(m) m.Type = UTypes.GIF Or m.Type = UTypes.Picture)
+                    If Not DownloadVideos Then _TempMediaList.RemoveAll(Function(m) m.Type = UTypes.Video Or
+                                                                                    m.Type = UTypes.VideoPre Or m.Type = UTypes.m3u8)
                 End If
 
                 ReparseVideo(Token)
@@ -634,27 +759,26 @@ BlockNullPicture:
                 _ContentNew.ListAddList(_TempMediaList, LAP.ClearBeforeAdd)
                 DownloadContent(Token)
                 ThrowIfDisposed()
-                _ContentList.ListAddList(_ContentNew.Where(Function(c) c.State = UState.Downloaded), LNC)
-                _CountPictures = _ContentList.LongCount(Function(c) c.Type = UserMedia.Types.Picture)
-                _CountVideo = _ContentList.LongCount(Function(c) c.Type = UserMedia.Types.Video)
-                If DownloadedPictures + DownloadedVideos > 0 Or EnvirChanged.Invoke Then
+                _ContentList.ListAddList(_ContentNew.Where(Function(c) c.State = UStates.Downloaded), LNC)
+                If DownloadedTotal(False) > 0 Or EnvirChanged.Invoke Then
                     If __SaveData Then
                         LastUpdated = Now
+                        DownloadedPictures(True) = SFile.GetFiles(User.File.CutPath, "*.jpg|*.jpeg|*.png|*.gif|*.webm",, EDP.ReturnValue).Count
+                        DownloadedVideos(True) = SFile.GetFiles(User.File.CutPath, "*.mp4|*.mkv|*.mov", SearchOption.AllDirectories, EDP.ReturnValue).Count
                         If Labels.Contains(LabelsKeeper.NoParsedUser) Then Labels.Remove(LabelsKeeper.NoParsedUser)
-                        UpdateContentInformation(_ContentList, MyFileData)
+                        UpdateContentInformation()
                     Else
-                        _CountVideo = 0
-                        _CountPictures = 0
+                        DownloadedVideos(False) = 0
+                        DownloadedPictures(False) = 0
                         _ContentList.Clear()
                         CreatedByChannel = False
                     End If
                     If Not UserExists Then ReadyForDownload = False
                     UpdateUserInformation()
+                    If _CollectionButtonsExists AndAlso EnvirChanged.Invoke Then UpdateButtonsColor()
                 End If
                 ThrowIfDisposed()
-                _DownloadedPicturesTotal += _DownloadedPicturesSession
-                _DownloadedVideosTotal += _DownloadedVideosSession
-                If UpPic Or EnvirChanged.Invoke Then Raise_OnUserUpdated()
+                If UpPic Or EnvirChanged.Invoke Then RaiseEvent_OnUserUpdated()
             Catch oex As OperationCanceledException When Token.IsCancellationRequested
                 MyMainLOG = $"{Site} - {Name}: downloading canceled"
                 Canceled = True
@@ -668,8 +792,20 @@ BlockNullPicture:
                 If Not Canceled Then _DataParsed = True ': LastUpdated = Now
                 _ContentNew.Clear()
                 DownloadTopCount = Nothing
+                DownloadToDate = Nothing
             End Try
         End Sub
+        Protected Function CheckDatesLimit(ByVal DateString As String, ByVal DateProvider As IFormatProvider) As Boolean
+            Try
+                If DownloadToDate.HasValue And Not DateString.IsEmptyString Then
+                    Dim td As Date? = AConvert(Of Date)(DateString, DateProvider, Nothing)
+                    If td.HasValue Then Return td.Value < DownloadToDate.Value
+                End If
+                Return True
+            Catch ex As Exception
+                Return ErrorsDescriber.Execute(EDP.SendInLog, ex, $"[UserDataBase.CheckDatesLimit({DateString})]", True)
+            End Try
+        End Function
         Protected Sub UpdateDataFiles()
             If Not User.File.IsEmptyString Then
                 MyFileData = User.File
@@ -684,6 +820,104 @@ BlockNullPicture:
         Protected MustOverride Sub DownloadDataF(ByVal Token As CancellationToken)
         Protected MustOverride Sub ReparseVideo(ByVal Token As CancellationToken)
         Protected MustOverride Sub DownloadContent(ByVal Token As CancellationToken)
+        Protected Sub DownloadContentDefault(ByVal Token As CancellationToken)
+            Try
+                Dim i%
+                Dim dCount% = 0, dTotal% = 0
+                ThrowAny(Token)
+                If _ContentNew.Count > 0 Then
+                    _ContentNew.RemoveAll(Function(c) c.URL.IsEmptyString)
+                    If _ContentNew.Count > 0 Then
+                        MyFile.Exists(SFO.Path)
+                        Dim MyDir$ = MyFile.CutPath.PathNoSeparator
+                        Dim vsf As Boolean = SeparateVideoFolderF
+                        Dim __isVideo As Boolean
+                        Dim f As SFile
+                        Dim v As UserMedia
+                        Using w As New WebClient
+                            If vsf Then SFileShares.SFileExists($"{MyDir}\Video\", SFO.Path)
+                            Progress.TotalCount += _ContentNew.Count
+                            For i = 0 To _ContentNew.Count - 1
+                                ThrowAny(Token)
+                                v = _ContentNew(i)
+                                v.State = UStates.Tried
+                                If v.File.IsEmptyString Then
+                                    f = v.URL
+                                Else
+                                    f = v.File
+                                End If
+                                f.Separator = "\"
+                                f.Path = MyDir
+
+                                If v.URL_BASE.IsEmptyString Then v.URL_BASE = v.URL
+
+                                If Not v.File.IsEmptyString And Not v.URL_BASE.IsEmptyString Then
+                                    Try
+                                        __isVideo = v.Type = UTypes.Video Or f.Extension = "mp4"
+
+                                        If f.Extension.IsEmptyString Then
+                                            Select Case v.Type
+                                                Case UTypes.Picture : f.Extension = "jpg"
+                                                Case UTypes.Video : f.Extension = "mp4"
+                                                Case UTypes.GIF : f.Extension = "gif"
+                                            End Select
+                                        End If
+
+                                        If Not v.SpecialFolder.IsEmptyString Then
+                                            f.Path = $"{f.PathWithSeparator}{v.SpecialFolder}\".CSFileP.Path
+                                            f.Exists(SFO.Path)
+                                        End If
+                                        If __isVideo And vsf Then
+                                            f.Path = $"{f.PathWithSeparator}Video"
+                                            If Not v.SpecialFolder.IsEmptyString Then f.Exists(SFO.Path)
+                                        End If
+                                        w.DownloadFile(v.URL_BASE, f.ToString)
+
+                                        If __isVideo Then
+                                            v.Type = UTypes.Video
+                                            DownloadedVideos(False) += 1
+                                        Else
+                                            v.Type = UTypes.Picture
+                                            DownloadedPictures(False) += 1
+                                        End If
+
+                                        v.File = ChangeFileNameByProvider(f, v)
+                                        v.State = UStates.Downloaded
+                                        dCount += 1
+                                    Catch wex As Exception
+                                        ErrorDownloading(f, v.URL_BASE)
+                                    End Try
+                                Else
+                                    v.State = UStates.Skipped
+                                End If
+                                _ContentNew(i) = v
+                                If DownloadTopCount.HasValue AndAlso dCount >= DownloadTopCount.Value Then
+                                    Progress.Perform(_ContentNew.Count - dTotal)
+                                    Exit Sub
+                                Else
+                                    dTotal += 1
+                                    Progress.Perform()
+                                End If
+                            Next
+                        End Using
+                    End If
+                End If
+            Catch oex As OperationCanceledException When Token.IsCancellationRequested
+            Catch dex As ObjectDisposedException When Disposed
+            Catch ex As Exception
+                LogError(ex, "content downloading error")
+                HasError = True
+            End Try
+        End Sub
+        ''' <param name="RDE">Request DownloadingException</param>
+        Protected Sub ProcessException(ByVal ex As Exception, ByVal Token As CancellationToken, ByVal Message As String, Optional ByVal RDE As Boolean = True)
+            If Not ((TypeOf ex Is OperationCanceledException And Token.IsCancellationRequested) Or
+                    (TypeOf ex Is ObjectDisposedException And Disposed)) Then
+                If RDE AndAlso DownloadingException(ex, Message, True) = 0 Then LogError(ex, Message) : HasError = True
+            End If
+        End Sub
+        ''' <summary>0 - Execute LogError and set HasError</summary>
+        Protected MustOverride Function DownloadingException(ByVal ex As Exception, ByVal Message As String, Optional ByVal FromPE As Boolean = False) As Integer
         Protected Function ChangeFileNameByProvider(ByVal f As SFile, ByVal m As UserMedia) As SFile
             Dim ff As SFile = Nothing
             Try
@@ -714,7 +948,7 @@ BlockNullPicture:
         End Function
         Friend Function DeleteF(ByVal Instance As IUserData) As Integer
             Dim f As SFile = SFile.GetPath(MyFile.CutPath.Path)
-            If f.Exists(SFO.Path, False) AndAlso f.Delete(SFO.Path, False, False) Then
+            If f.Exists(SFO.Path, False) AndAlso (User.Merged OrElse f.Delete(SFO.Path, Settings.DeleteMode)) Then
                 ImageHandler(Me, False)
                 Settings.UsersList.Remove(User)
                 Settings.UpdateUsersList()
@@ -760,7 +994,7 @@ BlockNullPicture:
                         _TurnBack = False
                         Return False
                     End If
-                    f.Delete(SFO.Path, False, False, EDP.ThrowException)
+                    f.Delete(SFO.Path, Settings.DeleteMode, EDP.ThrowException)
                 End If
                 f.CutPath.Exists(SFO.Path)
                 Directory.Move(UserBefore.File.CutPath(, EDP.ThrowException).Path, f.Path)
@@ -815,7 +1049,7 @@ BlockNullPicture:
                     FilesMover.Invoke
                     If SFile.GetFiles(UserBefore.File.CutPath,, SearchOption.AllDirectories,
                                       New ErrorsDescriber(False, False, False, New List(Of SFile))).Count = 0 Then
-                        UserBefore.File.CutPath.Delete(SFO.Path, False, False, EDP.SendInLog)
+                        UserBefore.File.CutPath.Delete(SFO.Path, Settings.DeleteMode, EDP.SendInLog)
                     End If
                     UpdateUserInformation()
                 End If
@@ -827,7 +1061,7 @@ BlockNullPicture:
         End Sub
         Private Function CheckFile(ByVal f As SFile, ByRef List As IEnumerable(Of SFile)) As SFile
             If List.ListExists Then
-                Dim p As New RegexStructure(".+?\s{0,1}\((\d+)\)|.+",,,,,,, String.Empty, EDP.ReturnValue)
+                Dim p As RParams = RParams.DMS(".+?\s{0,1}\((\d+)\)|.+", 0, EDP.ReturnValue)
                 Dim i% = List.Where(Function(ff) CStr(RegexReplace(ff.Name, p)).Trim.ToLower = f.Name.Trim.ToLower).Count
                 If i > 0 Then f.Name &= $" ({i + 1})"
             End If
@@ -845,33 +1079,42 @@ BlockNullPicture:
         Protected Sub ThrowIfDisposed()
             If Disposed Then Throw New ObjectDisposedException(ToString(), "Object disposed")
         End Sub
+        ''' <inheritdoc cref="ThrowAny(CancellationToken)"/>
+        Private Overloads Sub ThrowAny() Implements IThrower.ThrowAny
+            ThrowAny(_ExternalCompatibilityToken)
+        End Sub
         ''' <exception cref="OperationCanceledException"></exception>
         ''' <exception cref="ObjectDisposedException"></exception>
-        Protected Sub ThrowAny(ByVal Token As CancellationToken)
+        Friend Overloads Sub ThrowAny(ByVal Token As CancellationToken)
             Token.ThrowIfCancellationRequested()
             ThrowIfDisposed()
         End Sub
 #End Region
         Public Overrides Function ToString() As String
-            If Settings.ViewModeIsPicture Then
-                If IsCollection Then
-                    Return CollectionName
-                Else
-                    Return IIf(FriendlyName.IsEmptyString, Name, FriendlyName)
-                End If
+            If IsCollection Then
+                Return CollectionName
             Else
-                Dim t$ = String.Empty
-                If Temporary Then
-                    t = " (T)"
-                ElseIf Favorite Then
-                    t = " (F)"
-                End If
-                If IsCollection Then
-                    Return $"Collection [{CollectionName}]{t}"
-                Else
-                    Return $"[{Site}]{t} {IIf(FriendlyName.IsEmptyString, Name, FriendlyName)}"
-                End If
+                Return IIf(FriendlyName.IsEmptyString, Name, FriendlyName)
             End If
+            'If Settings.ViewModeIsPicture Then
+            '    If IsCollection Then
+            '        Return CollectionName
+            '    Else
+            '        Return IIf(FriendlyName.IsEmptyString, Name, FriendlyName)
+            '    End If
+            'Else
+            '    Dim t$ = String.Empty
+            '    If Temporary Then
+            '        t = " (T)"
+            '    ElseIf Favorite Then
+            '        t = " (F)"
+            '    End If
+            '    If IsCollection Then
+            '        Return $"Collection [{CollectionName}]{t}"
+            '    Else
+            '        Return $"[{Site}]{t} {IIf(FriendlyName.IsEmptyString, Name, FriendlyName)}"
+            '    End If
+            'End If
         End Function
 #Region "Buttons actions"
         Private Sub BTT_CONTEXT_DOWN_Click(sender As Object, e As EventArgs) Handles BTT_CONTEXT_DOWN.Click
@@ -894,38 +1137,25 @@ BlockNullPicture:
 #End Region
 #Region "IComparable Support"
         Friend Overridable Function CompareTo(ByVal Other As UserDataBase) As Integer Implements IComparable(Of UserDataBase).CompareTo
-            Dim x% = CompareValue(Me)
-            Dim y% = CompareValue(Other)
-            If x.CompareTo(y) = 0 Then
-                Return Name.CompareTo(Other.Name)
-            Else
-                Return x.CompareTo(y)
-            End If
-        End Function
-        Protected Function CompareValue(ByVal x As UserDataBase) As Integer
-            Dim OutValue% = CInt(x.Site) * 10000
-            If x.IsCollection Then OutValue -= 1000
-            If x.Temporary Then OutValue += 2000
-            If x.Favorite Then OutValue -= 500
-            Return OutValue
+            Return Name.CompareTo(Other.Name)
         End Function
         Friend Overridable Function CompareTo(ByVal Obj As Object) As Integer Implements IComparable.CompareTo
-            If TypeOf Obj Is Reddit.Channel Then
-                Return CompareTo(DirectCast(DirectCast(Obj, Reddit.Channel).Instance, UserDataBase))
-            Else
+            If Not Obj Is Nothing AndAlso TypeOf Obj Is UserDataBase Then
                 Return CompareTo(DirectCast(Obj, UserDataBase))
+            Else
+                Return False
             End If
         End Function
 #End Region
 #Region "IEquatable Support"
         Friend Overridable Overloads Function Equals(ByVal Other As UserDataBase) As Boolean Implements IEquatable(Of UserDataBase).Equals
-            Return Site = Other.Site And Name = Other.Name
+            Return LVIKey = Other.LVIKey And IsSavedPosts = Other.IsSavedPosts
         End Function
         Public Overrides Function Equals(ByVal Obj As Object) As Boolean
-            If TypeOf Obj Is Reddit.Channel Then
-                Return Equals(DirectCast(DirectCast(Obj, Reddit.Channel).Instance, UserDataBase))
-            Else
+            If Not Obj Is Nothing AndAlso TypeOf Obj Is UserDataBase Then
                 Return Equals(DirectCast(Obj, UserDataBase))
+            Else
+                Return False
             End If
         End Function
 #End Region
@@ -949,7 +1179,7 @@ BlockNullPicture:
                     If Not BTT_CONTEXT_DELETE Is Nothing Then BTT_CONTEXT_DELETE.Dispose()
                     If Not BTT_CONTEXT_OPEN_PATH Is Nothing Then BTT_CONTEXT_OPEN_PATH.Dispose()
                     If Not BTT_CONTEXT_OPEN_SITE Is Nothing Then BTT_CONTEXT_OPEN_SITE.Dispose()
-                    If _InvokeImageHandler Then ImageHandler(Me, False)
+                    _OnUserUpdatedHandlers.Clear()
                 End If
                 disposedValue = True
             End If
@@ -965,17 +1195,17 @@ BlockNullPicture:
 #End Region
     End Class
     Friend Interface IContentProvider
-        Property Site As Sites
+        ReadOnly Property Site As String
         Property Name As String
         Property ID As String
         Property FriendlyName As String
         Property Description As String
         Property Favorite As Boolean
         Property Temporary As Boolean
-        Sub OpenSite()
+        Sub OpenSite(Optional ByVal e As ErrorsDescriber = Nothing)
         Sub DownloadData(ByVal Token As CancellationToken)
     End Interface
-    Friend Interface IUserData : Inherits IContentProvider, IComparable(Of UserDataBase), IComparable, IEquatable(Of UserDataBase), IDisposable
+    Friend Interface IUserData : Inherits IContentProvider, IComparable(Of UserDataBase), IComparable, IEquatable(Of UserDataBase), IIndexable, IDisposable
         Event OnUserUpdated(ByVal User As IUserData)
         Property ParseUserMediaOnly As Boolean
 #Region "Images"
@@ -992,16 +1222,16 @@ BlockNullPicture:
         Property Exists As Boolean
         Property Suspended As Boolean
         Property ReadyForDownload As Boolean
+        Property HOST As SettingsHost
         Property [File] As SFile
         Property FileExists As Boolean
-        Property DownloadedPictures As Integer
-        Property DownloadedVideos As Integer
+        Property DownloadedPictures(ByVal Total As Boolean) As Integer
+        Property DownloadedVideos(ByVal Total As Boolean) As Integer
         ReadOnly Property DownloadedTotal(Optional ByVal Total As Boolean = True) As Integer
         ReadOnly Property DownloadedInformation As String
         Property HasError As Boolean
         ReadOnly Property FitToAddParams As Boolean
-        ReadOnly Property LVIKey As String
-        ReadOnly Property LVIIndex As Integer
+        ReadOnly Property Key As String
         Property DownloadImages As Boolean
         Property DownloadVideos As Boolean
         Function GetLVI(ByVal Destination As ListView) As ListViewItem
@@ -1012,13 +1242,16 @@ BlockNullPicture:
         ''' 0 - Nothing removed<br/>
         ''' 1 - User removed<br/>
         ''' 2 - Collection removed<br/>
-        ''' 3 - Collection splitted
+        ''' 3 - Collection split
         ''' </summary>
         Function Delete() As Integer
         Function MoveFiles(ByVal CollectionName As String) As Boolean
         Sub OpenFolder()
         ReadOnly Property Self As IUserData
         Property DownloadTopCount As Integer?
+        Property DownloadToDate As Date?
+        Sub SetEnvironment(ByRef h As SettingsHost, ByVal u As UserInfo, ByVal _LoadUserInformation As Boolean,
+                           Optional ByVal AttachUserInfo As Boolean = True)
         ReadOnly Property Disposed As Boolean
     End Interface
     Friend Interface IChannelLimits

SCrawler/API/Gfycat/Envir.vb

@@ -0,0 +1,35 @@
+' Copyright (C) 2022  Andy
+' This program is free software: you can redistribute it and/or modify
+' it under the terms of the GNU General Public License as published by
+' the Free Software Foundation, either version 3 of the License, or
+' (at your option) any later version.
+'
+' This program is distributed in the hope that it will be useful,
+' but WITHOUT ANY WARRANTY
+Imports PersonalUtilities.Functions.RegularExpressions
+Imports System.Net
+Imports SCrawler.API.Base
+Namespace API.Gfycat
+    Friend NotInheritable Class Envir
+        Private Sub New()
+        End Sub
+        Friend Shared Function GetVideo(ByVal URL As String) As String
+            Try
+                Dim r$
+                Using w As New WebClient : r = w.DownloadString(URL) : End Using
+                If Not r.IsEmptyString Then Return RegexReplace(r, RParams.DMS("contentUrl.:.(http.?://[^""]+?\.mp4)", 1)) Else Return String.Empty
+            Catch ex As Exception
+                Dim e As EDP = EDP.ReturnValue
+                If TypeOf ex Is WebException Then
+                    Dim obj As HttpWebResponse = TryCast(DirectCast(ex, WebException).Response, HttpWebResponse)
+                    If Not If(obj?.StatusCode, HttpStatusCode.OK) = HttpStatusCode.NotFound Then e += EDP.SendInLog
+                End If
+                Return ErrorsDescriber.Execute(e, ex, $"[API.Gfycat.Envir.GetVideo({URL})]", String.Empty)
+            End Try
+        End Function
+        Friend Shared Function GetVideoInfo(ByVal URL As String) As IEnumerable(Of UserMedia)
+            Dim u$ = GetVideo(URL)
+            Return If(u.IsEmptyString, Nothing, {New UserMedia(u, UserMedia.Types.Video)})
+        End Function
+    End Class
+End Namespace

SCrawler/API/Imgur/Envir.vb

@@ -0,0 +1,102 @@
+' Copyright (C) 2022  Andy
+' This program is free software: you can redistribute it and/or modify
+' it under the terms of the GNU General Public License as published by
+' the Free Software Foundation, either version 3 of the License, or
+' (at your option) any later version.
+'
+' This program is distributed in the hope that it will be useful,
+' but WITHOUT ANY WARRANTY
+Imports PersonalUtilities.Functions.XML
+Imports PersonalUtilities.Functions.RegularExpressions
+Imports PersonalUtilities.Tools.WebDocuments.JSON
+Imports System.Net
+Imports SCrawler.API.Imgur.Declarations
+Imports SCrawler.API.Base
+Namespace API.Imgur
+    Namespace Declarations
+        Friend Module Imgur_Declarations
+            Friend ReadOnly PostRegex As RParams = RParams.DMS("/([\w\d]+?)(|\.[\w]{0,4})\Z", 1)
+        End Module
+    End Namespace
+    Friend NotInheritable Class Envir
+        Private Sub New()
+        End Sub
+        Friend Shared Function GetGallery(ByVal URL As String, Optional ByVal e As ErrorsDescriber = Nothing) As List(Of String)
+            Try
+                If Not Settings.ImgurClientID.IsEmptyString And Not URL.IsEmptyString Then
+                    Dim __url$ = RegexReplace(URL, PostRegex)
+                    If Not __url.IsEmptyString Then
+                        __url = $"https://api.imgur.com/post/v1/albums/{__url}?client_id={Settings.ImgurClientID.Value}&include=media"
+                        Using w As New WebClient
+                            Dim r$ = w.DownloadString(__url)
+                            If Not r.IsEmptyString Then
+                                Using j As EContainer = JsonDocument.Parse(r).XmlIfNothing
+                                    If j.Contains("media") Then
+                                        Dim UrlsList As New List(Of String)
+                                        Dim tmpUrl$
+                                        For Each m As EContainer In j("media")
+                                            tmpUrl = m.Value("url")
+                                            If Not tmpUrl.IsEmptyString Then UrlsList.ListAddValue(tmpUrl, Base.LNC)
+                                        Next
+                                        Return UrlsList
+                                    End If
+                                End Using
+                            End If
+                        End Using
+                    End If
+                End If
+                Return Nothing
+            Catch ex As Exception
+                Return DownloadingException(ex, $"[API.Imgur.Envir.GetGallery({URL})]", Nothing, e)
+            End Try
+        End Function
+        Friend Shared Function GetImage(ByVal URL As String, Optional ByVal e As ErrorsDescriber = Nothing) As String
+            Try
+                If Not Settings.ImgurClientID.IsEmptyString And Not URL.IsEmptyString Then
+                    Dim __url$ = RegexReplace(URL, PostRegex)
+                    If Not __url.IsEmptyString Then
+                        __url = $"https://api.imgur.com/3/image/{__url}?client_id={Settings.ImgurClientID.Value}&include=media"
+                        Using w As New WebClient
+                            Dim r$ = w.DownloadString(__url)
+                            If Not r.IsEmptyString Then Return JsonDocument.Parse(r).XmlIfNothing.Value({"data"}, "link")
+                        End Using
+                    End If
+                End If
+                Return String.Empty
+            Catch ex As Exception
+                Return DownloadingException(ex, $"[API.Imgur.Envir.GetImage({URL})]", String.Empty, e)
+            End Try
+        End Function
+        Friend Shared Function GetVideoInfo(ByVal URL As String) As IEnumerable(Of UserMedia)
+            Try
+                If Not URL.IsEmptyString AndAlso URL.ToLower.Contains("imgur") AndAlso Not Settings.ImgurClientID.IsEmptyString Then
+                    Dim img$ = GetImage(URL, EDP.ReturnValue)
+                    If Not img.IsEmptyString Then
+                        Return {New UserMedia(img)}
+                    Else
+                        Return GetGallery(URL, EDP.ReturnValue).ListIfNothing.Select(Function(u) New UserMedia(u))
+                    End If
+                End If
+                Return Nothing
+            Catch ex As Exception
+                Return ErrorsDescriber.Execute(EDP.ShowMainMsg + EDP.SendInLog, ex, "Imgur standalone downloader: fetch media error")
+            End Try
+        End Function
+        Private Shared Function DownloadingException(ByVal ex As Exception, ByVal Message As String,
+                                                     ByVal NullArg As Object, ByVal e As ErrorsDescriber) As Object
+            If TypeOf ex Is WebException Then
+                Dim obj As HttpWebResponse = TryCast(DirectCast(ex, WebException).Response, HttpWebResponse)
+                If Not obj Is Nothing Then
+                    If obj.StatusCode = HttpStatusCode.NotFound Then
+                        Return NullArg
+                    ElseIf obj.StatusCode = HttpStatusCode.Unauthorized Then
+                        MyMainLOG = "Imgur credentials expired"
+                        Return NullArg
+                    End If
+                End If
+            End If
+            If Not e.Exists Then e = New ErrorsDescriber(EDP.ReturnValue + EDP.SendInLog)
+            Return ErrorsDescriber.Execute(e, ex, Message, NullArg)
+        End Function
+    End Class
+End Namespace

SCrawler/API/Instagram/AuthNullException.vb

@@ -0,0 +1,36 @@
+' Copyright (C) 2022  Andy
+' This program is free software: you can redistribute it and/or modify
+' it under the terms of the GNU General Public License as published by
+' the Free Software Foundation, either version 3 of the License, or
+' (at your option) any later version.
+'
+' This program is distributed in the hope that it will be useful,
+' but WITHOUT ANY WARRANTY
+Imports Sections = SCrawler.API.Instagram.UserData.Sections
+Namespace API.Instagram
+    Friend Class AuthNullException : Inherits ArgumentNullException
+        Public Overrides ReadOnly Property ParamName As String
+        Public Overrides ReadOnly Property Message As String
+        Friend Sub New(ByVal s As Sections, ByVal IsSavedPosts As Boolean)
+            If IsSavedPosts Then
+                ParamName = "HashSavedPosts"
+            ElseIf s = Sections.Timeline Then
+                ParamName = "Hash"
+            Else
+                ParamName = "IG_APP_ID, IG_WWW_CLAIM"
+            End If
+            Message = $"Instagram auth for [{s}] is not set"
+        End Sub
+        Friend Shared Sub ThrowIfNull(ByVal s As Sections, ByVal IsSavedPosts As Boolean, ByVal Host As SiteSettings)
+            Dim b As Boolean = False
+            If IsSavedPosts Then
+                If Not ACheck(Host.HashSavedPosts.Value) Then b = True
+            ElseIf s = Sections.Timeline Then
+                If Not ACheck(Host.Hash.Value) Then Host.HashUpdateRequired.Value = True : b = True
+            Else
+                If Not Host.StoriesAndTaggedReady Then b = True
+            End If
+            If b Then Throw New AuthNullException(s, IsSavedPosts)
+        End Sub
+    End Class
+End Namespace

SCrawler/API/Instagram/Declarations.vb

@@ -0,0 +1,25 @@
+' Copyright (C) 2022  Andy
+' This program is free software: you can redistribute it and/or modify
+' it under the terms of the GNU General Public License as published by
+' the Free Software Foundation, either version 3 of the License, or
+' (at your option) any later version.
+'
+' This program is distributed in the hope that it will be useful,
+' but WITHOUT ANY WARRANTY
+Imports PersonalUtilities.Functions.RegularExpressions
+Namespace API.Instagram
+    Friend Module Declarations
+        Friend Const InstagramSite As String = "Instagram"
+        Friend ReadOnly FilesPattern As RParams = RParams.DMS(".+?([^/\?]+?\.[\w\d]{3,4})(?=(\?|\Z))", 1, EDP.ReturnValue)
+        Friend ReadOnly Property DateProvider As New JsonDate
+        Friend Class JsonDate : Implements ICustomProvider
+            Friend Function Convert(ByVal Value As Object, ByVal DestinationType As Type, ByVal Provider As IFormatProvider,
+                                    Optional ByVal NothingArg As Object = Nothing, Optional ByVal e As ErrorsDescriber = Nothing) As Object Implements ICustomProvider.Convert
+                Return ADateTime.ParseUnicode(Value)
+            End Function
+            Private Function GetFormat(ByVal FormatType As Type) As Object Implements IFormatProvider.GetFormat
+                Throw New NotImplementedException("GetFormat is not available in this context")
+            End Function
+        End Class
+    End Module
+End Namespace

SCrawler/API/Instagram/EditorExchangeOptions.vb

@@ -0,0 +1,23 @@
+' Copyright (C) 2022  Andy
+' This program is free software: you can redistribute it and/or modify
+' it under the terms of the GNU General Public License as published by
+' the Free Software Foundation, either version 3 of the License, or
+' (at your option) any later version.
+'
+' This program is distributed in the hope that it will be useful,
+' but WITHOUT ANY WARRANTY
+Imports SCrawler.Plugin
+Namespace API.Instagram
+    Friend Class EditorExchangeOptions
+        Friend Property GetStories As Boolean
+        Friend Property GetTagged As Boolean
+        Private ReadOnly Property MySiteSettings As SiteSettings
+        Friend Sub New(ByVal h As ISiteSettings)
+            MySiteSettings = DirectCast(h, SiteSettings)
+            With MySiteSettings
+                GetStories = CBool(.GetStories.Value)
+                GetTagged = CBool(.GetTagged.Value)
+            End With
+        End Sub
+    End Class
+End Namespace

SCrawler/API/Instagram/ExitException.vb

@@ -0,0 +1,15 @@
+' Copyright (C) 2022  Andy
+' This program is free software: you can redistribute it and/or modify
+' it under the terms of the GNU General Public License as published by
+' the Free Software Foundation, either version 3 of the License, or
+' (at your option) any later version.
+'
+' This program is distributed in the hope that it will be useful,
+' but WITHOUT ANY WARRANTY
+Namespace API.Instagram
+    Friend Class ExitException : Inherits Exception
+        Friend Sub New(ByRef CompleteArg As Boolean)
+            CompleteArg = True
+        End Sub
+    End Class
+End Namespace

SCrawler/API/Instagram/OptionsForm.Designer.vb

@@ -0,0 +1,120 @@
+' Copyright (C) 2022  Andy
+' This program is free software: you can redistribute it and/or modify
+' it under the terms of the GNU General Public License as published by
+' the Free Software Foundation, either version 3 of the License, or
+' (at your option) any later version.
+'
+' This program is distributed in the hope that it will be useful,
+' but WITHOUT ANY WARRANTY
+Namespace API.Instagram
+    <Global.Microsoft.VisualBasic.CompilerServices.DesignerGenerated()>
+    Partial Friend Class OptionsForm : Inherits System.Windows.Forms.Form
+        <System.Diagnostics.DebuggerNonUserCode()>
+        Protected Overrides Sub Dispose(ByVal disposing As Boolean)
+            Try
+                If disposing AndAlso components IsNot Nothing Then
+                    components.Dispose()
+                End If
+            Finally
+                MyBase.Dispose(disposing)
+            End Try
+        End Sub
+        Private components As System.ComponentModel.IContainer
+        <System.Diagnostics.DebuggerStepThrough()>
+        Private Sub InitializeComponent()
+            Dim CONTAINER_MAIN As System.Windows.Forms.ToolStripContainer
+            Dim TP_MAIN As System.Windows.Forms.TableLayoutPanel
+            Me.CH_GET_STORIES = New System.Windows.Forms.CheckBox()
+            Me.CH_GET_TAGGED = New System.Windows.Forms.CheckBox()
+            CONTAINER_MAIN = New System.Windows.Forms.ToolStripContainer()
+            TP_MAIN = New System.Windows.Forms.TableLayoutPanel()
+            CONTAINER_MAIN.ContentPanel.SuspendLayout()
+            CONTAINER_MAIN.SuspendLayout()
+            TP_MAIN.SuspendLayout()
+            Me.SuspendLayout()
+            '
+            'CONTAINER_MAIN
+            '
+            '
+            'CONTAINER_MAIN.ContentPanel
+            '
+            CONTAINER_MAIN.ContentPanel.Controls.Add(TP_MAIN)
+            CONTAINER_MAIN.ContentPanel.Size = New System.Drawing.Size(260, 53)
+            CONTAINER_MAIN.Dock = System.Windows.Forms.DockStyle.Fill
+            CONTAINER_MAIN.LeftToolStripPanelVisible = False
+            CONTAINER_MAIN.Location = New System.Drawing.Point(0, 0)
+            CONTAINER_MAIN.Name = "CONTAINER_MAIN"
+            CONTAINER_MAIN.RightToolStripPanelVisible = False
+            CONTAINER_MAIN.Size = New System.Drawing.Size(260, 78)
+            CONTAINER_MAIN.TabIndex = 0
+            CONTAINER_MAIN.TopToolStripPanelVisible = False
+            '
+            'TP_MAIN
+            '
+            TP_MAIN.CellBorderStyle = System.Windows.Forms.TableLayoutPanelCellBorderStyle.[Single]
+            TP_MAIN.ColumnCount = 1
+            TP_MAIN.ColumnStyles.Add(New System.Windows.Forms.ColumnStyle(System.Windows.Forms.SizeType.Percent, 100.0!))
+            TP_MAIN.Controls.Add(Me.CH_GET_STORIES, 0, 0)
+            TP_MAIN.Controls.Add(Me.CH_GET_TAGGED, 0, 1)
+            TP_MAIN.Dock = System.Windows.Forms.DockStyle.Fill
+            TP_MAIN.Location = New System.Drawing.Point(0, 0)
+            TP_MAIN.Name = "TP_MAIN"
+            TP_MAIN.RowCount = 3
+            TP_MAIN.RowStyles.Add(New System.Windows.Forms.RowStyle(System.Windows.Forms.SizeType.Absolute, 25.0!))
+            TP_MAIN.RowStyles.Add(New System.Windows.Forms.RowStyle(System.Windows.Forms.SizeType.Absolute, 25.0!))
+            TP_MAIN.RowStyles.Add(New System.Windows.Forms.RowStyle(System.Windows.Forms.SizeType.Percent, 100.0!))
+            TP_MAIN.Size = New System.Drawing.Size(260, 53)
+            TP_MAIN.TabIndex = 0
+            '
+            'CH_GET_STORIES
+            '
+            Me.CH_GET_STORIES.AutoSize = True
+            Me.CH_GET_STORIES.Dock = System.Windows.Forms.DockStyle.Fill
+            Me.CH_GET_STORIES.Location = New System.Drawing.Point(4, 4)
+            Me.CH_GET_STORIES.Name = "CH_GET_STORIES"
+            Me.CH_GET_STORIES.Size = New System.Drawing.Size(252, 19)
+            Me.CH_GET_STORIES.TabIndex = 0
+            Me.CH_GET_STORIES.Text = "Get stories"
+            Me.CH_GET_STORIES.UseVisualStyleBackColor = True
+            '
+            'CH_GET_TAGGED
+            '
+            Me.CH_GET_TAGGED.AutoSize = True
+            Me.CH_GET_TAGGED.Dock = System.Windows.Forms.DockStyle.Fill
+            Me.CH_GET_TAGGED.Location = New System.Drawing.Point(4, 30)
+            Me.CH_GET_TAGGED.Name = "CH_GET_TAGGED"
+            Me.CH_GET_TAGGED.Size = New System.Drawing.Size(252, 19)
+            Me.CH_GET_TAGGED.TabIndex = 1
+            Me.CH_GET_TAGGED.Text = "Get tagged data"
+            Me.CH_GET_TAGGED.UseVisualStyleBackColor = True
+            '
+            'OptionsForm
+            '
+            Me.AutoScaleDimensions = New System.Drawing.SizeF(6.0!, 13.0!)
+            Me.AutoScaleMode = System.Windows.Forms.AutoScaleMode.Font
+            Me.ClientSize = New System.Drawing.Size(260, 78)
+            Me.Controls.Add(CONTAINER_MAIN)
+            Me.FormBorderStyle = System.Windows.Forms.FormBorderStyle.FixedSingle
+            Me.KeyPreview = True
+            Me.MaximizeBox = False
+            Me.MaximumSize = New System.Drawing.Size(276, 117)
+            Me.MinimizeBox = False
+            Me.MinimumSize = New System.Drawing.Size(276, 117)
+            Me.Name = "OptionsForm"
+            Me.ShowIcon = False
+            Me.ShowInTaskbar = False
+            Me.SizeGripStyle = System.Windows.Forms.SizeGripStyle.Hide
+            Me.Text = "Options"
+            CONTAINER_MAIN.ContentPanel.ResumeLayout(False)
+            CONTAINER_MAIN.ResumeLayout(False)
+            CONTAINER_MAIN.PerformLayout()
+            TP_MAIN.ResumeLayout(False)
+            TP_MAIN.PerformLayout()
+            Me.ResumeLayout(False)
+
+        End Sub
+
+        Private WithEvents CH_GET_STORIES As CheckBox
+        Private WithEvents CH_GET_TAGGED As CheckBox
+    End Class
+End Namespace

SCrawler/API/Instagram/OptionsForm.resx

@@ -117,26 +117,10 @@
   <resheader name="writer">
     <value>System.Resources.ResXResourceWriter, System.Windows.Forms, Version=4.0.0.0, Culture=neutral, PublicKeyToken=b77a5c561934e089</value>
   </resheader>
-  <metadata name="ToolbarTOP.TrayLocation" type="System.Drawing.Point, System.Drawing, Version=4.0.0.0, Culture=neutral, PublicKeyToken=b03f5f7f11d50a3a">
-    <value>17, 17</value>
+  <metadata name="CONTAINER_MAIN.GenerateMember" type="System.Boolean, mscorlib, Version=4.0.0.0, Culture=neutral, PublicKeyToken=b77a5c561934e089">
+    <value>False</value>
   </metadata>
-  <assembly alias="System.Drawing" name="System.Drawing, Version=4.0.0.0, Culture=neutral, PublicKeyToken=b03f5f7f11d50a3a" />
-  <data name="MENU_VIEW.Image" type="System.Drawing.Bitmap, System.Drawing" mimetype="application/x-microsoft.net.object.bytearray.base64">
-    <value>
-        iVBORw0KGgoAAAANSUhEUgAAABAAAAAQCAYAAAAf8/9hAAAAAXNSR0IArs4c6QAAAARnQU1BAACxjwv8
-        YQUAAAAJcEhZcwAADsMAAA7DAcdvqGQAAAIDSURBVDhPpZLrS5NhGMb3j4SWh0oRQVExD4gonkDpg4hG
-        YKxG6WBogkMZKgPNCEVJFBGdGETEvgwyO9DJE5syZw3PIlPEE9pgBCLZ5XvdMB8Ew8gXbl54nuf63dd9
-        0OGSnwCahxbPRNPAPMw9Xpg6ZmF46kZZ0xSKzJPIrhpDWsVnpBhGkKx3nAX8Pv7z1zg8OoY/cITdn4fw
-        bf/C0kYAN3Ma/w3gWfZL5kzTKBxjWyK2DftwI9tyMYCZKXbNHaD91bLYJrDXsYbrWfUKwJrPE9M2M1Oc
-        VzOOpHI7Jr376Hi9ogHqFIANO0/MmmmbmSmm9a8ze+I4MrNWAdjtoJgWcx+PSzg166yZZ8xM8XvXDix9
-        c4jIqFYAjoriBV9AhEPv1mH/sonogha0afbZMMZz+yreTGyhpusHwtNNCsA5U1zS4BLxzJIfg299qO32
-        Ir7UJtZfftyATqeT+8o2D8JSjQrAJblrncYL7ZJ2+bfaFnC/1S1NjL3diRat7qrO7wLRP3HjWsojBeCo
-        mDEo5mNjuweFGvjWg2EBhCbpkW78htSHHwRyNdmgAFzPEee2iFkzayy2OLXzT4gr6UdUnlXrullsxxQ+
-        kx0g8BTA3aZlButjSTyjODq/WcQcW/B/Je4OQhLvKQDnzN1mp0nnkvAhR8VuMzNrpm1mpjgkoVwB/v8D
-        TgDQASA1MVpwzwAAAABJRU5ErkJggg==
-</value>
-  </data>
-  <metadata name="ToolbarBOTTOM.TrayLocation" type="System.Drawing.Point, System.Drawing, Version=4.0.0.0, Culture=neutral, PublicKeyToken=b03f5f7f11d50a3a">
-    <value>133, 17</value>
+  <metadata name="TP_MAIN.GenerateMember" type="System.Boolean, mscorlib, Version=4.0.0.0, Culture=neutral, PublicKeyToken=b77a5c561934e089">
+    <value>False</value>
   </metadata>
 </root>

SCrawler/API/Instagram/OptionsForm.vb

@@ -0,0 +1,44 @@
+' Copyright (C) 2022  Andy
+' This program is free software: you can redistribute it and/or modify
+' it under the terms of the GNU General Public License as published by
+' the Free Software Foundation, either version 3 of the License, or
+' (at your option) any later version.
+'
+' This program is distributed in the hope that it will be useful,
+' but WITHOUT ANY WARRANTY
+Imports PersonalUtilities.Forms
+Imports PersonalUtilities.Forms.Toolbars
+Namespace API.Instagram
+    Friend Class OptionsForm : Implements IOkCancelToolbar
+        Private ReadOnly MyDefs As DefaultFormProps
+        Private ReadOnly Property MyExchangeOptions As EditorExchangeOptions
+        Friend Sub New(ByRef ExchangeOptions As EditorExchangeOptions)
+            InitializeComponent()
+            MyExchangeOptions = ExchangeOptions
+            MyDefs = New DefaultFormProps
+        End Sub
+        Private Sub OptionsForm_Load(sender As Object, e As EventArgs) Handles Me.Load
+            With MyDefs
+                .MyViewInitialize(Me, Settings.Design, True)
+                .AddOkCancelToolbar()
+                .DelegateClosingChecker()
+                .AppendDetectors()
+                With MyExchangeOptions
+                    CH_GET_STORIES.Checked = .GetStories
+                    CH_GET_TAGGED.Checked = .GetTagged
+                End With
+                .EndLoaderOperations()
+            End With
+        End Sub
+        Private Sub ToolbarBttOK() Implements IOkCancelToolbar.ToolbarBttOK
+            With MyExchangeOptions
+                .GetStories = CH_GET_STORIES.Checked
+                .GetTagged = CH_GET_TAGGED.Checked
+            End With
+            MyDefs.CloseForm()
+        End Sub
+        Private Sub ToolbarBttCancel() Implements IOkCancelToolbar.ToolbarBttCancel
+            MyDefs.CloseForm(DialogResult.Cancel)
+        End Sub
+    End Class
+End Namespace

SCrawler/API/Instagram/SiteSettings.vb

@@ -0,0 +1,315 @@
+' Copyright (C) 2022  Andy
+' This program is free software: you can redistribute it and/or modify
+' it under the terms of the GNU General Public License as published by
+' the Free Software Foundation, either version 3 of the License, or
+' (at your option) any later version.
+'
+' This program is distributed in the hope that it will be useful,
+' but WITHOUT ANY WARRANTY
+Imports SCrawler.API.Base
+Imports SCrawler.Plugin
+Imports SCrawler.Plugin.Attributes
+Imports PersonalUtilities.Tools
+Imports PersonalUtilities.Functions.XML
+Imports PersonalUtilities.Functions.XML.Base
+Imports PersonalUtilities.Functions.RegularExpressions
+Imports Download = SCrawler.Plugin.ISiteSettings.Download
+Namespace API.Instagram
+    <Manifest("AndyProgram_Instagram"), UseClassAsIs, SeparatedTasks(1), SavedPosts, SpecialForm(False)>
+    Friend Class SiteSettings : Inherits SiteSettingsBase
+#Region "Interface Declarations"
+        Friend Overrides ReadOnly Property Icon As Icon
+            Get
+                Return My.Resources.InstagramIcon
+            End Get
+        End Property
+        Friend Overrides ReadOnly Property Image As Image
+            Get
+                Return My.Resources.InstagramPic76
+            End Get
+        End Property
+#End Region
+#Region "Providers"
+        Private Class TimersChecker : Implements ICustomProvider
+            Private ReadOnly _LowestValue As Integer
+            Friend Sub New(ByVal LowestValue As Integer)
+                _LowestValue = LowestValue
+            End Sub
+            Private Function Convert(ByVal Value As Object, ByVal DestinationType As Type, ByVal Provider As IFormatProvider,
+                                     Optional ByVal NothingArg As Object = Nothing, Optional ByVal e As ErrorsDescriber = Nothing) As Object Implements ICustomProvider.Convert
+                If ACheck(Of Integer)(Value) AndAlso CInt(Value) >= _LowestValue Then
+                    Return Value
+                Else
+                    Return Nothing
+                End If
+            End Function
+            Private Function GetFormat(ByVal FormatType As Type) As Object Implements IFormatProvider.GetFormat
+                Throw New NotImplementedException()
+            End Function
+        End Class
+#End Region
+#Region "Authorization properties"
+        <PropertyOption(ControlText:="Hash", ControlToolTip:="Instagram session hash", IsAuth:=True), PXML("InstaHash"), ControlNumber(0)>
+        Friend ReadOnly Property Hash As PropertyValue
+        <PropertyOption(ControlText:="Hash 2", ControlToolTip:="Instagram session hash for saved posts", IsAuth:=True), PXML("InstaHashSavedPosts"), ControlNumber(1)>
+        Friend ReadOnly Property HashSavedPosts As PropertyValue
+        <PropertyOption(ControlText:="x-ig-app-id", IsAuth:=True), ControlNumber(2)>
+        Friend Property IG_APP_ID As PropertyValue
+        <PropertyOption(ControlText:="x-ig-www-claim", IsAuth:=True), ControlNumber(3)>
+        Friend Property IG_WWW_CLAIM As PropertyValue
+        <PropertyOption(ControlText:="Saved posts user", IsAuth:=True), PXML("SavedPostsUserName"), ControlNumber(4)>
+        Friend ReadOnly Property SavedPostsUserName As PropertyValue
+        Friend ReadOnly Property StoriesAndTaggedReady As Boolean
+            Get
+                Return ACheck(IG_APP_ID.Value) And ACheck(IG_WWW_CLAIM.Value)
+            End Get
+        End Property
+#End Region
+#Region "Download properties"
+        Friend ReadOnly Property HashUpdateRequired As XMLValue(Of Boolean)
+        <PropertyOption(ControlText:="Request timer", AllowNull:=False), PXML("RequestsWaitTimer"), ControlNumber(5)>
+        Friend ReadOnly Property RequestsWaitTimer As PropertyValue
+        <Provider(NameOf(RequestsWaitTimer), FieldsChecker:=True)>
+        Private ReadOnly Property RequestsWaitTimerProvider As IFormatProvider
+        <PropertyOption(ControlText:="Request timer counter", AllowNull:=False, LeftOffset:=120), PXML("RequestsWaitTimerTaskCount"), ControlNumber(6)>
+        Friend ReadOnly Property RequestsWaitTimerTaskCount As PropertyValue
+        <Provider(NameOf(RequestsWaitTimerTaskCount), FieldsChecker:=True)>
+        Private ReadOnly Property RequestsWaitTimerTaskCountProvider As IFormatProvider
+        <PropertyOption(ControlText:="Posts limit timer", AllowNull:=False), PXML("SleepTimerOnPostsLimit"), ControlNumber(7)>
+        Friend ReadOnly Property SleepTimerOnPostsLimit As PropertyValue
+        <Provider(NameOf(SleepTimerOnPostsLimit), FieldsChecker:=True)>
+        Private ReadOnly Property SleepTimerOnPostsLimitProvider As IFormatProvider
+        <PropertyOption(ControlText:="Get stories"), PXML, ControlNumber(8)>
+        Friend ReadOnly Property GetStories As PropertyValue
+        <PropertyOption(ControlText:="Get tagged photos"), PXML, ControlNumber(9)>
+        Friend ReadOnly Property GetTagged As PropertyValue
+#End Region
+#Region "429 bypass"
+        Friend ReadOnly Property DownloadingErrorDate As XMLValue(Of Date)
+        Friend Property LastApplyingValue As Integer? = Nothing
+        Friend ReadOnly Property ReadyForDownload As Boolean
+            Get
+                With DownloadingErrorDate
+                    If .ValueF.Exists Then
+                        Return .ValueF.Value.AddMinutes(If(LastApplyingValue, 10)) < Now
+                    Else
+                        Return True
+                    End If
+                End With
+            End Get
+        End Property
+        Friend ReadOnly Property LastDownloadDate As XMLValue(Of Date)
+        Friend ReadOnly Property LastRequestsCount As XMLValue(Of Integer)
+        Private TooManyRequestsReadyForCatch As Boolean = True
+        Friend Function GetWaitDate() As Date
+            With DownloadingErrorDate
+                If .ValueF.Exists Then
+                    Return .ValueF.Value.AddMinutes(If(LastApplyingValue, 10))
+                Else
+                    Return Now
+                End If
+            End With
+        End Function
+        Friend Sub TooManyRequests(ByVal Catched As Boolean)
+            With DownloadingErrorDate
+                If Catched Then
+                    If Not .ValueF.Exists Then
+                        .Value = Now
+                        If TooManyRequestsReadyForCatch Then
+                            LastApplyingValue = If(LastApplyingValue, 0) + 10
+                            TooManyRequestsReadyForCatch = False
+                            MyMainLOG = $"Instagram downloading error: too many requests. Try again after {If(LastApplyingValue, 10)} minutes..."
+                        End If
+                    End If
+                Else
+                    .ValueF = Nothing
+                    LastApplyingValue = Nothing
+                    TooManyRequestsReadyForCatch = True
+                End If
+            End With
+        End Sub
+#End Region
+        Friend Overrides ReadOnly Property Responser As WEB.Response
+        Friend Sub New(ByRef _XML As XmlFile, ByVal GlobalPath As SFile)
+            MyBase.New(InstagramSite)
+            Responser = New WEB.Response($"{SettingsFolderName}\Responser_{Site}.xml")
+
+            Dim app_id$ = String.Empty
+            Dim www_claim$ = String.Empty
+
+            With Responser
+                If .File.Exists Then
+                    .LoadSettings()
+                    With .Headers
+                        If .ContainsKey(Header_IG_APP_ID) Then app_id = .Item(Header_IG_APP_ID)
+                        If .ContainsKey(Header_IG_WWW_CLAIM) Then www_claim = .Item(Header_IG_WWW_CLAIM)
+                    End With
+                Else
+                    .CookiesDomain = "instagram.com"
+                    .SaveSettings()
+                End If
+            End With
+
+            Dim n() As String = {SettingsCLS.Name_Node_Sites, Site.ToString}
+
+            SavedPostsUserName = New PropertyValue(String.Empty, GetType(String))
+
+            HashUpdateRequired = New XMLValue(Of Boolean)("InstaHashUpdateRequired", True, _XML, n)
+            Hash = New PropertyValue(String.Empty, GetType(String))
+            HashSavedPosts = New PropertyValue(String.Empty, GetType(String))
+            IG_APP_ID = New PropertyValue(app_id, GetType(String), Sub(v) ChangeResponserFields(NameOf(IG_APP_ID), v))
+            IG_WWW_CLAIM = New PropertyValue(www_claim, GetType(String), Sub(v) ChangeResponserFields(NameOf(IG_WWW_CLAIM), v))
+
+            RequestsWaitTimer = New PropertyValue(1000)
+            RequestsWaitTimerProvider = New TimersChecker(100)
+            RequestsWaitTimerTaskCount = New PropertyValue(1)
+            RequestsWaitTimerTaskCountProvider = New TimersChecker(1)
+            SleepTimerOnPostsLimit = New PropertyValue(6000)
+            SleepTimerOnPostsLimitProvider = New TimersChecker(10000)
+
+            GetStories = New PropertyValue(False)
+            GetTagged = New PropertyValue(False)
+
+            DownloadingErrorDate = New XMLValue(Of Date) With {
+                .Provider = New XMLValueConversionProvider(Function(ss, vv) AConvert(Of String)(vv, AModes.Var, Nothing))}
+            DownloadingErrorDate.SetExtended("InstagramDownloadingErrorDate", Now.AddYears(-10), _XML, n)
+            LastDownloadDate = New XMLValue(Of Date)("LastDownloadDate", Now.AddDays(-1), _XML, n)
+            LastRequestsCount = New XMLValue(Of Integer)("LastRequestsCount", 0, _XML, n)
+
+            UrlPatternUser = "https://www.instagram.com/{0}/"
+            UserRegex = RParams.DMS("[htps:/]{7,8}.*?instagram.com/([^/]+)", 1)
+            ImageVideoContains = "instagram.com"
+        End Sub
+        Friend Overrides Function GetInstance(ByVal What As Download) As IPluginContentProvider
+            Select Case What
+                Case Download.Main : Return New UserData
+                Case Download.SavedPosts
+                    Dim u As New UserData
+                    DirectCast(u, UserDataBase).User = New UserInfo With {.Name = CStr(AConvert(Of String)(SavedPostsUserName.Value, String.Empty))}
+                    Return u
+            End Select
+            Return Nothing
+        End Function
+        Private Const Header_IG_APP_ID As String = "x-ig-app-id"
+        Private Const Header_IG_WWW_CLAIM As String = "x-ig-www-claim"
+        Private Sub ChangeResponserFields(ByVal PropName As String, ByVal Value As Object)
+            If Not PropName.IsEmptyString Then
+                Dim f$ = String.Empty
+                Select Case PropName
+                    Case NameOf(IG_APP_ID) : f = Header_IG_APP_ID
+                    Case NameOf(IG_WWW_CLAIM) : f = Header_IG_WWW_CLAIM
+                End Select
+                If Not f.IsEmptyString Then
+                    If Responser.Headers.Count > 0 AndAlso Responser.Headers.ContainsKey(f) Then Responser.Headers.Remove(f)
+                    If Not CStr(Value).IsEmptyString Then Responser.Headers.Add(f, CStr(Value))
+                    Responser.SaveSettings()
+                End If
+            End If
+        End Sub
+        <PropertiesDataChecker({NameOf(Hash), NameOf(HashSavedPosts)})>
+        Private Function CheckHashControls(ByVal p As IEnumerable(Of PropertyData)) As Boolean
+            If p.ListExists(2) Then
+                Dim h$ = String.Empty
+                Dim hsp$ = String.Empty
+                For Each pp As PropertyData In p
+                    Select Case pp.Name
+                        Case NameOf(Hash) : h = AConvert(Of String)(pp.Value, String.Empty)
+                        Case NameOf(HashSavedPosts) : hsp = AConvert(Of String)(pp.Value, String.Empty)
+                    End Select
+                Next
+                If h.IsEmptyString And hsp.IsEmptyString Then
+                    Return True
+                Else
+                    If h = hsp Then
+                        MsgBoxE({"InstaHash for saved posts must be different from InstaHash!", "InstaHash are equal"}, vbCritical)
+                        Return False
+                    Else
+                        Return True
+                    End If
+                End If
+            Else
+                Return False
+            End If
+        End Function
+        Friend Overrides Sub BeginInit()
+        End Sub
+        Friend Overrides Sub EndInit()
+            If (CStr(Hash.Value).IsEmptyString Or HashUpdateRequired) AndAlso Responser.Cookies.ListExists Then GatherInstaHash()
+        End Sub
+        Friend Overrides Function ReadyToDownload(ByVal What As Download) As Boolean
+            Return ActiveJobs < 2 AndAlso ReadyForDownload
+        End Function
+#Region "Downloading"
+        Private ActiveJobs As Integer = 0
+        Private _NextWNM As UserData.WNM = UserData.WNM.Notify
+        Friend Overrides Sub DownloadStarted(ByVal What As Download)
+            If CStr(Hash.Value).IsEmptyString Or HashUpdateRequired Then GatherInstaHash()
+            ActiveJobs += 1
+        End Sub
+        Friend Overrides Sub BeforeStartDownload(ByVal User As Object, ByVal What As Download)
+            With DirectCast(User, UserData)
+                If What = Download.Main Then .WaitNotificationMode = _NextWNM
+                If LastDownloadDate.Value.AddMinutes(60) > Now Then
+                    .RequestsCount = LastRequestsCount
+                Else
+                    LastRequestsCount.Value = 0
+                    .RequestsCount = 0
+                End If
+            End With
+        End Sub
+        Friend Overrides Sub AfterDownload(ByVal User As Object, ByVal What As Download)
+            With DirectCast(User, UserData)
+                _NextWNM = .WaitNotificationMode
+                If _NextWNM = UserData.WNM.SkipTemp Or _NextWNM = UserData.WNM.SkipCurrent Then _NextWNM = UserData.WNM.Notify
+                LastDownloadDate.Value = Now
+                LastRequestsCount.Value = .RequestsCount
+            End With
+        End Sub
+        Friend Overrides Sub DownloadDone(ByVal What As Download)
+            _NextWNM = UserData.WNM.Notify
+            LastDownloadDate.Value = Now
+            ActiveJobs -= 1
+            If HashUpdateRequired Then MyMainLOG = "Check your Instagram credentials"
+        End Sub
+#End Region
+        <PropertyUpdater(NameOf(Hash))>
+        Friend Function GatherInstaHash() As Boolean
+            Try
+                If Not Responser.Cookies.ListExists Then Throw New Exception("Instagram cookies does not set")
+                Dim rs As New RParams("=""([^""]+?ConsumerLibCommons[^""]+?.js)""", Nothing, 1) With {.MatchTimeOut = 10}
+                Dim r$ = Responser.GetResponse("https://instagram.com",, EDP.ThrowException)
+                If Not r.IsEmptyString Then
+                    Dim hStr$ = RegexReplace(r, rs)
+                    If Not hStr.IsEmptyString Then
+                        Do While Left(hStr, 1) = "/" : hStr = Right(hStr, hStr.Length - 1) : Loop
+                        hStr = $"https://instagram.com/{hStr}"
+                        r = Responser.GetResponse(hStr,, EDP.ThrowException)
+                        If Not r.IsEmptyString Then
+                            rs = New RParams("generatePaginationActionCreators.+?.profilePosts.byUserId.get.+?queryId:.([\d\w\S]+?)""", Nothing, 1) With {.MatchTimeOut = 10}
+                            Dim h$ = RegexReplace(r, rs)
+                            If Not h.IsEmptyString Then
+                                Hash.Value = h
+                                HashUpdateRequired.Value = False
+                                Return True
+                            End If
+                        End If
+                    End If
+                End If
+                Return False
+            Catch ex As Exception
+                HashUpdateRequired.Value = True
+                Hash.Value = String.Empty
+                Return ErrorsDescriber.Execute(EDP.SendInLog + EDP.ReturnValue, ex, "[SiteSettings.GaterInstaHash]", False)
+            End Try
+        End Function
+        Friend Overrides Function GetSpecialDataF(ByVal URL As String) As IEnumerable(Of UserMedia)
+            Return UserData.GetVideoInfo(URL, Responser)
+        End Function
+        Friend Overrides Sub UserOptions(ByRef Options As Object, ByVal OpenForm As Boolean)
+            If Options Is Nothing OrElse Not TypeOf Options Is EditorExchangeOptions Then Options = New EditorExchangeOptions(Me)
+            If OpenForm Then
+                Using f As New OptionsForm(Options) : f.ShowDialog() : End Using
+            End If
+        End Sub
+    End Class
+End Namespace

SCrawler/API/Instagram/UserData.vb

@@ -0,0 +1,588 @@
+' Copyright (C) 2022  Andy
+' This program is free software: you can redistribute it and/or modify
+' it under the terms of the GNU General Public License as published by
+' the Free Software Foundation, either version 3 of the License, or
+' (at your option) any later version.
+'
+' This program is distributed in the hope that it will be useful,
+' but WITHOUT ANY WARRANTY
+Imports PersonalUtilities.Functions.XML
+Imports PersonalUtilities.Functions.Messaging
+Imports PersonalUtilities.Functions.RegularExpressions
+Imports PersonalUtilities.Tools.WEB
+Imports PersonalUtilities.Tools.WebDocuments.JSON
+Imports SCrawler.API.Base
+Imports System.Threading
+Imports System.Net
+Imports UTypes = SCrawler.API.Base.UserMedia.Types
+Namespace API.Instagram
+    Friend Class UserData : Inherits UserDataBase
+        Private Const MaxPostsCount As Integer = 200
+        Private Const Name_LastCursor As String = "LastCursor"
+        Private Const Name_FirstLoadingDone As String = "FirstLoadingDone"
+        Private Const Name_GetStories As String = "GetStories"
+        Private Const Name_GetTagged As String = "GetTaggedData"
+        Private Const Name_TaggedChecked As String = "TaggedChecked"
+        Private ReadOnly Property MySiteSettings As SiteSettings
+            Get
+                Return DirectCast(HOST.Source, SiteSettings)
+            End Get
+        End Property
+        Private ReadOnly _SavedPostsIDs As New List(Of String)
+        Private LastCursor As String = String.Empty
+        Private FirstLoadingDone As Boolean = False
+        Friend Property GetStories As Boolean
+        Friend Property GetTaggedData As Boolean
+        Friend Overrides Function ExchangeOptionsGet() As Object
+            Return New EditorExchangeOptions(HOST.Source) With {.GetStories = GetStories, .GetTagged = GetTaggedData}
+        End Function
+        Friend Overrides Sub ExchangeOptionsSet(ByVal Obj As Object)
+            If Not Obj Is Nothing AndAlso TypeOf Obj Is EditorExchangeOptions Then
+                With DirectCast(Obj, EditorExchangeOptions)
+                    GetStories = .GetStories
+                    GetTaggedData = .GetTagged
+                End With
+            End If
+        End Sub
+        Friend Sub New()
+        End Sub
+        Protected Overrides Sub LoadUserInformation_OptionalFields(ByRef Container As XmlFile, ByVal Loading As Boolean)
+            If Loading Then
+                LastCursor = Container.Value(Name_LastCursor)
+                FirstLoadingDone = Container.Value(Name_FirstLoadingDone).FromXML(Of Boolean)(False)
+                GetStories = Container.Value(Name_GetStories).FromXML(Of Boolean)(CBool(MySiteSettings.GetStories.Value))
+                GetTaggedData = Container.Value(Name_GetTagged).FromXML(Of Boolean)(CBool(MySiteSettings.GetTagged.Value))
+                TaggedChecked = Container.Value(Name_TaggedChecked).FromXML(Of Boolean)(False)
+            Else
+                Container.Add(Name_LastCursor, LastCursor)
+                Container.Add(Name_FirstLoadingDone, FirstLoadingDone.BoolToInteger)
+                Container.Add(Name_GetStories, GetStories.BoolToInteger)
+                Container.Add(Name_GetTagged, GetTaggedData.BoolToInteger)
+                Container.Add(Name_TaggedChecked, TaggedChecked.BoolToInteger)
+            End If
+        End Sub
+#Region "Download data"
+        Protected Overrides Sub DownloadDataF(ByVal Token As CancellationToken)
+            Try
+                _InstaHash = String.Empty
+                HasError = False
+                If Not LastCursor.IsEmptyString Then
+                    DownloadData(LastCursor, Sections.Timeline, Token)
+                    ThrowAny(Token)
+                    If Not HasError Then FirstLoadingDone = True
+                End If
+                If Not HasError Then
+                    DownloadData(String.Empty, Sections.Timeline, Token)
+                    ThrowAny(Token)
+                    If Not HasError Then FirstLoadingDone = True
+                End If
+                If FirstLoadingDone Then LastCursor = String.Empty
+                If IsSavedPosts Then
+                    DownloadPosts(Token)
+                ElseIf MySiteSettings.StoriesAndTaggedReady Then
+                    If GetStories Then DownloadData(String.Empty, Sections.Stories, Token)
+                    If GetTaggedData Then DownloadData(String.Empty, Sections.Tagged, Token)
+                End If
+                If WaitNotificationMode = WNM.SkipTemp Or WaitNotificationMode = WNM.SkipCurrent Then WaitNotificationMode = WNM.Notify
+            Catch eex As ExitException
+            Catch ex As Exception
+                ProcessException(ex, Token, "[API.Instagram.UserData.DownloadDataF", False)
+            End Try
+        End Sub
+        Private _InstaHash As String = String.Empty
+        Friend Enum Sections
+            Timeline
+            Tagged
+            Stories
+        End Enum
+#Region "429 bypass"
+        Friend Property RequestsCount As Integer = 0
+        Friend Enum WNM As Integer
+            Notify = 0
+            SkipCurrent = 1
+            SkipAll = 2
+            SkipTemp = 3
+        End Enum
+        Friend WaitNotificationMode As WNM = WNM.Notify
+        Private Caught429 As Boolean = False
+        Private ProgressTempSet As Boolean = False
+        Private Const InstAborted As String = "InstAborted"
+        Private Function Ready() As Boolean
+            With MySiteSettings
+                If Not .ReadyForDownload Then
+                    If WaitNotificationMode = WNM.Notify Then
+                        Dim m As New MMessage("Instagram [too many requests] error." & vbCr &
+                                              $"The program suggests waiting {If(.LastApplyingValue, 0)} minutes." & vbCr &
+                                              "What do you want to do?", "Waiting for Instagram download...",
+                                              {
+                                               New MsgBoxButton("Wait") With {.ToolTip = "Wait and ask again when the error is found."},
+                                               New MsgBoxButton("Wait (disable current") With {.ToolTip = "Wait and skip future prompts while downloading the current profile."},
+                                               New MsgBoxButton("Abort") With {.ToolTip = "Abort operation"},
+                                               New MsgBoxButton("Wait (disable all)") With {.ToolTip = "Wait and skip future prompts while downloading the current session."}
+                                              },
+                                              vbExclamation) With {.ButtonsPerRow = 2, .DefaultButton = 0, .CancelButton = 2}
+                        Select Case MsgBoxE(m).Index
+                            Case 1 : WaitNotificationMode = WNM.SkipCurrent
+                            Case 2 : Throw New OperationCanceledException("Instagram download operation aborted") With {.HelpLink = InstAborted}
+                            Case 3 : WaitNotificationMode = WNM.SkipAll
+                            Case Else : WaitNotificationMode = WNM.SkipTemp
+                        End Select
+                    End If
+                    If Not ProgressTempSet Then Progress.InformationTemporary = $"Waiting until { .GetWaitDate().ToString(ParsersDataDateProvider)}"
+                    ProgressTempSet = True
+                    Return False
+                Else
+                    Return True
+                End If
+            End With
+        End Function
+        Private Sub ReconfigureAwaiter()
+            If WaitNotificationMode = WNM.SkipTemp Then WaitNotificationMode = WNM.Notify
+            If Caught429 Then Caught429 = False ': RequestsCount = 0
+            ProgressTempSet = False
+        End Sub
+        Private Sub NextRequest(ByVal StartWait As Boolean)
+            With MySiteSettings
+                If StartWait And RequestsCount > 0 And (RequestsCount Mod .RequestsWaitTimerTaskCount.Value) = 0 Then Thread.Sleep(CInt(.RequestsWaitTimer.Value))
+                If RequestsCount >= MaxPostsCount - 5 Then Thread.Sleep(CInt(.SleepTimerOnPostsLimit.Value))
+            End With
+        End Sub
+#End Region
+        Private Const StoriesFolder As String = "Stories"
+        Private Const TaggedFolder As String = "Tagged"
+        Private TaggedChecked As Boolean = False
+        Private Overloads Sub DownloadData(ByVal Cursor As String, ByVal Section As Sections, ByVal Token As CancellationToken)
+            Dim URL$ = String.Empty
+            Dim StoriesList As List(Of String) = Nothing
+            Dim StoriesRequested As Boolean = False
+            Dim _DownloadComplete As Boolean = False
+            LastCursor = Cursor
+            Try
+                Do While Not _DownloadComplete
+                    ThrowAny(Token)
+                    If Not Ready() Then Thread.Sleep(10000) : ThrowAny(Token) : Continue Do
+                    ReconfigureAwaiter()
+
+                    Try
+                        Dim n As EContainer, nn As EContainer, node As EContainer
+                        Dim HasNextPage As Boolean = False
+                        Dim EndCursor$ = String.Empty
+                        Dim PostID$ = String.Empty, PostDate$ = String.Empty, SpecFolder$ = String.Empty
+                        Dim TaggedCount%
+                        Dim ENode() As Object = Nothing
+                        NextRequest(True)
+
+                        'Check environment
+                        If Cursor.IsEmptyString And _InstaHash.IsEmptyString Then _
+                            _InstaHash = CStr(If(IsSavedPosts, MySiteSettings.HashSavedPosts, MySiteSettings.Hash).Value)
+                        AuthNullException.ThrowIfNull(Section, IsSavedPosts, MySiteSettings)
+                        If ID.IsEmptyString Then GetUserId()
+                        If ID.IsEmptyString Then Throw New ArgumentException("User ID is not detected", "ID")
+
+                        'Create query
+                        Select Case Section
+                            Case Sections.Timeline
+                                Dim vars$ = "{""id"":" & ID & ",""first"":50,""after"":""" & Cursor & """}"
+                                vars = SymbolsConverter.ASCII.EncodeSymbolsOnly(vars)
+                                URL = $"https://www.instagram.com/graphql/query/?query_hash={_InstaHash}&variables={vars}"
+                                ENode = {"data", "user", 0}
+                            Case Sections.Tagged
+                                URL = $"https://i.instagram.com/api/v1/usertags/{ID}/feed/?count=50&max_id={Cursor}"
+                                ENode = {"items"}
+                                SpecFolder = TaggedFolder
+                            Case Sections.Stories
+                                If Not StoriesRequested Then
+                                    StoriesList = GetStoriesList()
+                                    MySiteSettings.TooManyRequests(False)
+                                    RequestsCount += 1
+                                    ThrowAny(Token)
+                                End If
+                                If StoriesList.ListExists Then
+                                    GetStoriesData(StoriesList, Token)
+                                    MySiteSettings.TooManyRequests(False)
+                                    RequestsCount += 1
+                                End If
+                                If StoriesList.ListExists Then
+                                    Continue Do
+                                Else
+                                    Throw New ExitException(_DownloadComplete)
+                                End If
+                        End Select
+
+                        'Get response
+                        Dim r$ = Responser.GetResponse(URL,, EDP.ThrowException)
+                        MySiteSettings.TooManyRequests(False)
+                        RequestsCount += 1
+                        ThrowAny(Token)
+
+                        'Data
+                        If Not r.IsEmptyString Then
+                            Using j As EContainer = JsonDocument.Parse(r).XmlIfNothing
+                                n = j.ItemF(ENode).XmlIfNothing
+                                If n.Count > 0 Then
+                                    Select Case Section
+                                        Case Sections.Timeline
+                                            If n.Contains("page_info") Then
+                                                With n("page_info")
+                                                    HasNextPage = .Value("has_next_page").FromXML(Of Boolean)(False)
+                                                    EndCursor = .Value("end_cursor")
+                                                End With
+                                            End If
+                                            n = n("edges").XmlIfNothing
+                                            If n.Count > 0 Then
+                                                For Each nn In n
+                                                    ThrowAny(Token)
+                                                    node = nn(0).XmlIfNothing
+                                                    If IsSavedPosts Then
+                                                        PostID = node.Value("shortcode")
+                                                        If Not PostID.IsEmptyString Then
+                                                            If _TempPostsList.Contains(PostID) Then Throw New ExitException(_DownloadComplete) Else _SavedPostsIDs.Add(PostID)
+                                                        End If
+                                                    Else
+                                                        PostID = node.Value("id")
+                                                        If Not PostID.IsEmptyString And _TempPostsList.Contains(PostID) Then Throw New ExitException(_DownloadComplete)
+                                                        _TempPostsList.Add(PostID)
+                                                        PostDate = node.Value("taken_at_timestamp")
+                                                        If Not CheckDatesLimit(PostDate, DateProvider) Then Throw New ExitException(_DownloadComplete)
+                                                        ObtainMedia(node, PostID, PostDate, SpecFolder)
+                                                    End If
+                                                Next
+                                            End If
+                                        Case Sections.Tagged
+                                            HasNextPage = j.Value("more_available").FromXML(Of Boolean)(False)
+                                            EndCursor = j.Value("next_max_id")
+                                            For Each nn In n
+                                                PostID = $"Tagged_{nn.Value("id")}"
+                                                If Not PostID.IsEmptyString And _TempPostsList.Contains(PostID) Then Throw New ExitException(_DownloadComplete)
+                                                _TempPostsList.Add(PostID)
+                                                ObtainMedia2(nn, PostID, SpecFolder)
+                                            Next
+                                            If Not TaggedChecked Then
+                                                TaggedCount = j.Value("total_count").FromXML(Of Integer)(0)
+                                                TaggedChecked = True
+                                                If TaggedChecked > 200 Then
+                                                    Dim a% = MsgBoxE({$"The number of tagged posts is {TaggedCount.NumToString(New ANumbers With {
+                                                                                                       .FormatOptions = ANumbers.Options.GroupIntegral})}" & vbCr &
+                                                                      "The tagged data download operation can take a long time.", "Too much tagged data"}, vbExclamation,,,
+                                                                      {"Continue",
+                                                                       New MsgBoxButton("Disable and cancel") With {
+                                                                        .ToolTip = "Disable downloading tagged data and cancel downloading tagged data."},
+                                                                       "Cancel"})
+                                                    If a > 0 Then
+                                                        If a = 1 Then GetTaggedData = False
+                                                        Throw New ExitException(_DownloadComplete)
+                                                    End If
+                                                End If
+                                            End If
+                                    End Select
+                                Else
+                                    If j.Value("status") = "ok" AndAlso j({"data", "user"}).XmlIfNothing.Count = 0 AndAlso _TempMediaList.Count = 0 Then
+                                        MySiteSettings.HashUpdateRequired.Value = True
+                                        UserExists = False
+                                        Throw New ExitException(_DownloadComplete)
+                                    End If
+                                End If
+                            End Using
+                        Else
+                            Throw New ExitException(_DownloadComplete)
+                        End If
+                        _DownloadComplete = True
+                        If HasNextPage And Not EndCursor.IsEmptyString Then DownloadData(EndCursor, Section, Token)
+                    Catch iane As AuthNullException
+                        ErrorsDescriber.Execute(EDP.SendInLog, iane)
+                        Throw New ExitException(_DownloadComplete)
+                    Catch eex As ExitException
+                        Throw eex
+                    Catch oex As OperationCanceledException When Token.IsCancellationRequested
+                        Exit Do
+                    Catch dex As ObjectDisposedException When Disposed
+                        Exit Do
+                    Catch ex As Exception
+                        If DownloadingException(ex, $"data downloading error [{URL}]") = 1 Then Continue Do Else Exit Do
+                    End Try
+                Loop
+            Catch eex2 As ExitException
+                If (Section = Sections.Timeline Or Section = Sections.Tagged) And Not Cursor.IsEmptyString Then Throw eex2
+            Catch oex2 As OperationCanceledException When Token.IsCancellationRequested Or oex2.HelpLink = InstAborted
+                If oex2.HelpLink = InstAborted Then HasError = True
+            Catch DoEx As Exception
+                ProcessException(DoEx, Token, $"data downloading error [{URL}]")
+            End Try
+        End Sub
+        Private Sub DownloadPosts(ByVal Token As CancellationToken)
+            Dim URL$ = String.Empty
+            Dim _DownloadComplete As Boolean = False
+            Dim _Index% = 0
+            Try
+                Do While Not _DownloadComplete
+                    ThrowAny(Token)
+                    If Not Ready() Then Thread.Sleep(10000) : ThrowAny(Token) : Continue Do
+                    ReconfigureAwaiter()
+
+                    Try
+                        Dim r$
+                        Dim j As EContainer, jj As EContainer
+                        Dim _MediaObtained As Boolean
+                        If _SavedPostsIDs.Count > 0 And _Index <= _SavedPostsIDs.Count - 1 Then
+                            Dim e As New ErrorsDescriber(EDP.ThrowException)
+                            For i% = _Index To _SavedPostsIDs.Count - 1
+                                _Index = i
+                                URL = $"https://instagram.com/p/{_SavedPostsIDs(i)}/?__a=1"
+                                ThrowAny(Token)
+                                NextRequest(((i + 1) Mod 5) = 0)
+                                ThrowAny(Token)
+                                r = Responser.GetResponse(URL,, e)
+                                MySiteSettings.TooManyRequests(False)
+                                RequestsCount += 1
+                                If Not r.IsEmptyString Then
+                                    j = JsonDocument.Parse(r)
+                                    If Not j Is Nothing Then
+                                        _MediaObtained = False
+                                        If j.Contains({"graphql", "shortcode_media"}) Then
+                                            With j({"graphql", "shortcode_media"}).XmlIfNothing
+                                                If .Count > 0 Then ObtainMedia(.Self, _SavedPostsIDs(i), String.Empty, String.Empty) : _MediaObtained = True
+                                            End With
+                                        End If
+                                        If Not _MediaObtained AndAlso j.Contains("items") Then
+                                            With j("items")
+                                                If .Count > 0 Then
+                                                    For Each jj In .Self : ObtainMedia2(jj, _SavedPostsIDs(i)) : Next
+                                                End If
+                                            End With
+                                        End If
+                                        j.Dispose()
+                                    End If
+                                End If
+                            Next
+                        End If
+                        _DownloadComplete = True
+                    Catch oex As OperationCanceledException When Token.IsCancellationRequested
+                        Exit Do
+                    Catch dex As ObjectDisposedException When Disposed
+                        Exit Do
+                    Catch ex As Exception
+                        If DownloadingException(ex, $"downloading saved posts error [{URL}]") = 1 Then Continue Do Else Exit Do
+                    End Try
+                Loop
+            Catch oex2 As OperationCanceledException When Token.IsCancellationRequested Or oex2.HelpLink = InstAborted
+                If oex2.HelpLink = InstAborted Then HasError = True
+            Catch DoEx As Exception
+                ProcessException(DoEx, Token, $"downloading saved posts error [{URL}]")
+            End Try
+        End Sub
+#End Region
+#Region "Obtain Media"
+        Private Sub ObtainMedia(ByVal node As EContainer, ByVal PostID As String, ByVal PostDate As String, ByVal SpecFolder As String)
+            Dim CreateMedia As Action(Of EContainer) =
+                Sub(ByVal e As EContainer)
+                    Dim t As UTypes = If(e.Value("is_video").FromXML(Of Boolean)(False), UTypes.Video, UTypes.Picture)
+                    Dim tmpValue$
+                    If t = UTypes.Picture Then
+                        tmpValue = e.Value("display_url")
+                    Else
+                        tmpValue = e.Value("video_url")
+                    End If
+                    If Not tmpValue.IsEmptyString Then _TempMediaList.ListAddValue(MediaFromData(t, tmpValue, PostID, PostDate, SpecFolder), LNC)
+                End Sub
+            If node.Contains({"edge_sidecar_to_children", "edges"}) Then
+                For Each edge As EContainer In node({"edge_sidecar_to_children", "edges"}) : CreateMedia(edge("node").XmlIfNothing) : Next
+            Else
+                CreateMedia(node)
+            End If
+        End Sub
+        Private Sub ObtainMedia2(ByVal n As EContainer, ByVal PostID As String, Optional ByVal SpecialFolder As String = Nothing)
+            Try
+                Dim img As Predicate(Of EContainer) = Function(_img) Not _img.Name.IsEmptyString AndAlso _img.Name.StartsWith("image_versions") AndAlso _img.Count > 0
+                Dim vid As Predicate(Of EContainer) = Function(_vid) Not _vid.Name.IsEmptyString AndAlso _vid.Name.StartsWith("video_versions") AndAlso _vid.Count > 0
+                Dim ss As Func(Of EContainer, Sizes) = Function(_ss) New Sizes(_ss.Value("width"), _ss.Value("url"))
+                If n.Count > 0 Then
+                    Dim l As New List(Of Sizes)
+                    Dim d As EContainer
+                    Dim t%
+                    '8 - gallery
+                    '2 - one video
+                    '1 - one picture
+                    t = n.Value("media_type").FromXML(Of Integer)(-1)
+                    If t >= 0 Then
+                        Select Case t
+                            Case 1
+                                If n.Contains(img) Then
+                                    t = n.Value("media_type").FromXML(Of Integer)(-1)
+                                    If t >= 0 Then
+                                        With n.ItemF({img, "candidates"}).XmlIfNothing
+                                            If .Count > 0 Then
+                                                l.Clear()
+                                                l.ListAddList(.Select(ss), LNC)
+                                                If l.Count > 0 Then
+                                                    l.Sort()
+                                                    _TempMediaList.ListAddValue(MediaFromData(UTypes.Picture, l.First.Data, PostID, Nothing, SpecialFolder), LNC)
+                                                    l.Clear()
+                                                End If
+                                            End If
+                                        End With
+                                    End If
+                                End If
+                            Case 2
+                                If n.Contains(vid) Then
+                                    With n.ItemF({vid}).XmlIfNothing
+                                        If .Count > 0 Then
+                                            l.Clear()
+                                            l.ListAddList(.Select(ss), LNC)
+                                            If l.Count > 0 Then
+                                                l.Sort()
+                                                _TempMediaList.ListAddValue(MediaFromData(UTypes.Video, l.First.Data, PostID, Nothing, SpecialFolder), LNC)
+                                                l.Clear()
+                                            End If
+                                        End If
+                                    End With
+                                End If
+                            Case 8
+                                With n("carousel_media").XmlIfNothing
+                                    If .Count > 0 Then
+                                        For Each d In .Self : ObtainMedia2(d, PostID, SpecialFolder) : Next
+                                    End If
+                                End With
+                        End Select
+                    End If
+                    l.Clear()
+                End If
+            Catch ex As Exception
+                ErrorsDescriber.Execute(EDP.SendInLog, ex, "API.Instagram.ObtainMedia2")
+            End Try
+        End Sub
+#End Region
+        Private Sub GetUserId()
+            Try
+                Dim r$ = Responser.GetResponse($"https://www.instagram.com/{Name}/?__a=1",, EDP.ThrowException)
+                If Not r.IsEmptyString Then
+                    Using j As EContainer = JsonDocument.Parse(r).XmlIfNothing
+                        ID = j({"graphql", "user"}, "id").XmlIfNothingValue
+                    End Using
+                End If
+            Catch ex As Exception
+                If Responser.StatusCode = HttpStatusCode.NotFound Or Responser.StatusCode = HttpStatusCode.BadRequest Then
+                    Throw ex
+                Else
+                    LogError(ex, "get Instagram user id")
+                End If
+            End Try
+        End Sub
+#Region "Pinned stories"
+        Private Sub GetStoriesData(ByRef StoriesList As List(Of String), ByVal Token As CancellationToken)
+            Const ReqUrl$ = "https://i.instagram.com/api/v1/feed/reels_media/?{0}"
+            Dim tmpList As IEnumerable(Of String)
+            Dim qStr$, r$, sFolder$, storyID$
+            Dim i% = -1
+            Dim jj As EContainer, s As EContainer
+            ThrowAny(Token)
+            If StoriesList.ListExists Then
+                tmpList = StoriesList.Take(5)
+                If tmpList.ListExists Then
+                    qStr = String.Format(ReqUrl, tmpList.Select(Function(q) $"reel_ids=highlight:{q}").ListToString(, "&"))
+                    r = Responser.GetResponse(qStr,, EDP.ThrowException)
+                    ThrowAny(Token)
+                    If Not r.IsEmptyString Then
+                        Using j As EContainer = JsonDocument.Parse(r).XmlIfNothing
+                            If j.Contains("reels") Then
+                                For Each jj In j("reels")
+                                    i += 1
+                                    sFolder = jj.Value("title")
+                                    storyID = jj.Value("id").Replace("highlight:", String.Empty)
+                                    If sFolder.IsEmptyString Then sFolder = $"Story_{storyID}"
+                                    If sFolder.IsEmptyString Then sFolder = $"Story_{i}"
+                                    sFolder = $"{StoriesFolder}\{sFolder}"
+                                    If Not storyID.IsEmptyString Then storyID &= ":"
+                                    With jj("items").XmlIfNothing
+                                        If .Count > 0 Then
+                                            For Each s In .Self : ThrowAny(Token) : ObtainMedia2(s, storyID & s.Value("id"), sFolder) : Next
+                                        End If
+                                    End With
+                                Next
+                            End If
+                        End Using
+                    End If
+                    StoriesList.RemoveRange(0, tmpList.Count)
+                End If
+            End If
+        End Sub
+        Private Function GetStoriesList() As List(Of String)
+            Try
+                Dim r$ = Responser.GetResponse($"https://i.instagram.com/api/v1/highlights/{ID}/highlights_tray/",, EDP.ThrowException)
+                If Not r.IsEmptyString Then
+                    Using j As EContainer = JsonDocument.Parse(r).XmlIfNothing()("tray").XmlIfNothing
+                        If j.Count > 0 Then Return j.Select(Function(jj) jj.Value("id").Replace("highlight:", String.Empty)).ListIfNothing
+                    End Using
+                End If
+                Return Nothing
+            Catch ex As Exception
+                DownloadingException(ex, "API.Instagram.GetStoriesList")
+                Return Nothing
+            End Try
+        End Function
+#End Region
+        Protected Overrides Sub ReparseVideo(ByVal Token As CancellationToken)
+        End Sub
+        Protected Overrides Sub DownloadContent(ByVal Token As CancellationToken)
+            DownloadContentDefault(Token)
+        End Sub
+        ''' <summary>
+        ''' <inheritdoc cref="UserDataBase.DownloadingException(Exception, String)"/><br/>
+        ''' 1 - continue
+        ''' </summary>
+        Protected Overrides Function DownloadingException(ByVal ex As Exception, ByVal Message As String, Optional ByVal FromPE As Boolean = False) As Integer
+            If Responser.StatusCode = HttpStatusCode.NotFound Then
+                UserExists = False
+            ElseIf Responser.StatusCode = HttpStatusCode.BadRequest Then
+                HasError = True
+                MyMainLOG = "Instagram credentials have expired"
+                MySiteSettings.HashUpdateRequired.Value = True
+            ElseIf Responser.StatusCode = 429 Then
+                With MySiteSettings
+                    Dim WaiterExists As Boolean = .LastApplyingValue.HasValue
+                    .TooManyRequests(True)
+                    If Not WaiterExists Then .LastApplyingValue = 2
+                End With
+                Caught429 = True
+                MyMainLOG = $"Number of requests before error 429: {RequestsCount}"
+                Return 1
+            Else
+                MySiteSettings.HashUpdateRequired.Value = True
+                If Not FromPE Then LogError(ex, Message) : HasError = True
+                Return 0
+            End If
+            Return 2
+        End Function
+        Private Shared Function MediaFromData(ByVal t As UTypes, ByVal _URL As String, ByVal PostID As String, ByVal PostDate As String,
+                                              Optional ByVal SpecialFolder As String = Nothing) As UserMedia
+            _URL = LinkFormatterSecure(RegexReplace(_URL.Replace("\", String.Empty), LinkPattern))
+            Dim m As New UserMedia(_URL, t) With {.Post = New UserPost With {.ID = PostID}}
+            If Not m.URL.IsEmptyString Then m.File = CStr(RegexReplace(m.URL, FilesPattern))
+            If Not PostDate.IsEmptyString Then m.Post.Date = AConvert(Of Date)(PostDate, DateProvider, Nothing) Else m.Post.Date = Nothing
+            m.SpecialFolder = SpecialFolder
+            Return m
+        End Function
+        Friend Shared Function GetVideoInfo(ByVal URL As String, ByVal r As Response) As IEnumerable(Of UserMedia)
+            Try
+                If Not URL.IsEmptyString AndAlso URL.Contains("instagram.com") Then
+                    Dim PID$ = RegexReplace(URL, RParams.DMS(".*?instagram.com/p/([_\w\d]+)", 1))
+                    If Not PID.IsEmptyString Then
+                        Using t As New UserData
+                            t.Responser = New Response
+                            t.Responser.Copy(r)
+                            t._SavedPostsIDs.Add(PID)
+                            t.DownloadPosts(Nothing)
+                            Return ListAddList(Nothing, t._TempMediaList)
+                        End Using
+                    End If
+                End If
+                Return Nothing
+            Catch ex As Exception
+                Return ErrorsDescriber.Execute(EDP.ShowMainMsg + EDP.SendInLog, ex, "Instagram standalone downloader: fetch media error")
+            End Try
+        End Function
+        Protected Overrides Sub Dispose(ByVal disposing As Boolean)
+            If Not disposedValue And disposing Then _SavedPostsIDs.Clear()
+            MyBase.Dispose(disposing)
+        End Sub
+    End Class
+End Namespace

SCrawler/API/Reddit/Channel.vb

@@ -10,262 +10,24 @@ Imports PersonalUtilities.Tools
 Imports PersonalUtilities.Forms.Toolbars
 Imports PersonalUtilities.Functions.XML
 Imports SCrawler.API.Base
+Imports SCrawler.Plugin.Hosts
 Imports System.Threading
 Namespace API.Reddit
     Friend Class Channel : Implements ICollection(Of UserPost), IEquatable(Of Channel), IComparable(Of Channel),
-            IRangeSwitcherContainer(Of UserPost), ILoaderSaver, IMyEnumerator(Of UserPost), IChannelLimits, IUserData, IDisposable
+            IRangeSwitcherContainer(Of UserPost), ILoaderSaver, IMyEnumerator(Of UserPost), IChannelLimits, IDisposable
 #Region "XML Nodes' Names"
         Private Const Name_Name As String = "Name"
         Private Const Name_ID As String = "ID"
         Private Const Name_Date As String = "Date"
         Private Const Name_PostsNode As String = "Posts"
+        Private Const Name_UsersAdded As String = "UsersAdded"
+        Private Const Name_UsersExistent As String = "UsersExistent"
+        Private Const Name_PostsDownloaded As String = "PostsDownloaded"
 #End Region
         Friend Const DefaultDownloadLimitCount As Integer = 1000
-#Region "IUserData Support"
-        Private Event OnUserUpdated As IUserData.OnUserUpdatedEventHandler Implements IUserData.OnUserUpdated
-        Friend Property Instance As IUserData
-        Private Property IUserData_ParseUserMediaOnly As Boolean = False Implements IUserData.ParseUserMediaOnly
-        Private Property IUserData_Exists As Boolean Implements IUserData.Exists
-            Get
-                Return Instance.Exists
-            End Get
-            Set(ByVal e As Boolean)
-            End Set
-        End Property
-        Private Property IUserData_Suspended As Boolean Implements IUserData.Suspended
-            Get
-                Return Instance.Suspended
-            End Get
-            Set(ByVal s As Boolean)
-            End Set
-        End Property
-        Private ReadOnly Property IUserData_IsCollection As Boolean Implements IUserData.IsCollection
-            Get
-                Return Instance.IsCollection
-            End Get
-        End Property
-        Private Property IUserData_CollectionName As String Implements IUserData.CollectionName
-            Get
-                Return Instance.CollectionName
-            End Get
-            Set(ByVal NewName As String)
-                Instance.CollectionName = NewName
-            End Set
-        End Property
-        Private ReadOnly Property IUserData_IncludedInCollection As Boolean Implements IUserData.IncludedInCollection
-            Get
-                Return Instance.IncludedInCollection
-            End Get
-        End Property
-        Private ReadOnly Property IUserData_Labels As List(Of String) Implements IUserData.Labels
-            Get
-                Return Instance.Labels
-            End Get
-        End Property
-        Private ReadOnly Property IUserData_IsChannel As Boolean = True Implements IUserData.IsChannel
-        Private Property IUserData_ReadyForDownload As Boolean Implements IUserData.ReadyForDownload
-            Get
-                Return Instance.ReadyForDownload
-            End Get
-            Set(ByVal IsReady As Boolean)
-                Instance.ReadyForDownload = IsReady
-            End Set
-        End Property
-        Private Property IUserData_File As SFile Implements IUserData.File
-            Get
-                Return Instance.File
-            End Get
-            Set(ByVal NewFile As SFile)
-                Instance.File = NewFile
-            End Set
-        End Property
-        Private Property IUserData_FileExists As Boolean Implements IUserData.FileExists
-            Get
-                Return Instance.FileExists
-            End Get
-            Set(ByVal IsExists As Boolean)
-                Instance.FileExists = IsExists
-            End Set
-        End Property
-        Private Property IUserData_DownloadedPictures As Integer Implements IUserData.DownloadedPictures
-            Get
-                Return Instance.DownloadedPictures
-            End Get
-            Set(ByVal c As Integer)
-                Instance.DownloadedPictures = c
-            End Set
-        End Property
-        Private Property IUserData_DownloadedVideos As Integer Implements IUserData.DownloadedVideos
-            Get
-                Return Instance.DownloadedVideos
-            End Get
-            Set(ByVal c As Integer)
-                Instance.DownloadedVideos = c
-            End Set
-        End Property
-        Private ReadOnly Property IUserData_DownloadedTotal(Optional Total As Boolean = True) As Integer Implements IUserData.DownloadedTotal
-            Get
-                Return Instance.DownloadedTotal
-            End Get
-        End Property
-        Private ReadOnly Property IUserData_DownloadedInformation As String Implements IUserData.DownloadedInformation
-            Get
-                Return Instance.DownloadedInformation
-            End Get
-        End Property
-        Private Property IUserData_HasError As Boolean Implements IUserData.HasError
-            Get
-                Return Instance.HasError
-            End Get
-            Set(ByVal e As Boolean)
-                Instance.HasError = e
-            End Set
-        End Property
-        Private ReadOnly Property IUserData_FitToAddParams As Boolean Implements IUserData.FitToAddParams
-            Get
-                Return Instance.FitToAddParams
-            End Get
-        End Property
-        Private ReadOnly Property IUserData_LVIKey As String Implements IUserData.LVIKey
-            Get
-                Return Instance.LVIKey
-            End Get
-        End Property
-        Private ReadOnly Property IUserData_LVIIndex As Integer Implements IUserData.LVIIndex
-            Get
-                Return Instance.LVIIndex
-            End Get
-        End Property
-        Private Property IUserData_DownloadImages As Boolean Implements IUserData.DownloadImages
-            Get
-                Return Instance.DownloadImages
-            End Get
-            Set(ByVal d As Boolean)
-                Instance.DownloadImages = d
-            End Set
-        End Property
-        Private Property IUserData_DownloadVideos As Boolean Implements IUserData.DownloadVideos
-            Get
-                Return Instance.DownloadVideos
-            End Get
-            Set(ByVal d As Boolean)
-                Instance.DownloadVideos = d
-            End Set
-        End Property
-        Private ReadOnly Property IUserData_Self As IUserData Implements IUserData.Self
-            Get
-                Return Instance
-            End Get
-        End Property
-        Private Property IUserData_DownloadTopCount As Integer? Implements IUserData.DownloadTopCount
-            Get
-                Return Instance.DownloadTopCount
-            End Get
-            Set(ByVal c As Integer?)
-                Instance.DownloadTopCount = c
-            End Set
-        End Property
-        Friend Property Site As Sites = Sites.Reddit Implements IContentProvider.Site
-        Private Property IUserData_FriendlyName As String Implements IContentProvider.FriendlyName
-            Get
-                Return Instance.FriendlyName
-            End Get
-            Set(ByVal NewName As String)
-                Instance.FriendlyName = NewName
-            End Set
-        End Property
-        Private Property IUserData_Description As String Implements IContentProvider.Description
-            Get
-                Return Instance.Description
-            End Get
-            Set(ByVal d As String)
-                Instance.Description = d
-            End Set
-        End Property
-        Private Property IUserData_Favorite As Boolean Implements IContentProvider.Favorite
-            Get
-                Return Instance.Favorite
-            End Get
-            Set(ByVal f As Boolean)
-                Instance.Favorite = f
-            End Set
-        End Property
-        Private Property IUserData_Temporary As Boolean Implements IContentProvider.Temporary
-            Get
-                Return Instance.Temporary
-            End Get
-            Set(ByVal t As Boolean)
-                Instance.Temporary = t
-            End Set
-        End Property
-        Private Sub IUserData_SetPicture(ByVal f As SFile) Implements IUserData.SetPicture
-            Instance.SetPicture(f)
-        End Sub
-        Private Sub IUserData_LoadUserInformation() Implements IUserData.LoadUserInformation
-            Instance.LoadUserInformation()
-        End Sub
-        Private Sub IUserData_UpdateUserInformation() Implements IUserData.UpdateUserInformation
-            Instance.UpdateUserInformation()
-        End Sub
-        Private Sub IUserData_OpenFolder() Implements IUserData.OpenFolder
-            Instance.OpenFolder()
-        End Sub
-        Private Sub IUserData_OpenSite() Implements IContentProvider.OpenSite
-            Instance.OpenSite()
-        End Sub
-        Private Sub IUserData_DownloadData(ByVal Token As CancellationToken) Implements IContentProvider.DownloadData
-            DownloadData(Token, False, Nothing)
-        End Sub
-        Private Function IUserData_GetPicture() As Image Implements IUserData.GetPicture
-            Return Instance.GetPicture()
-        End Function
-        Private Function IUserData_GetLVI(ByVal Destination As ListView) As ListViewItem Implements IUserData.GetLVI
-            Return Instance.GetLVI(Destination)
-        End Function
-        Private Function IUserData_GetLVIGroup(ByVal Destination As ListView) As ListViewGroup Implements IUserData.GetLVIGroup
-            Return Instance.GetLVIGroup(Destination)
-        End Function
-        Private Function IUserData_Delete() As Integer Implements IUserData.Delete
-            Return DirectCast(Instance, UserDataBase).DeleteF(Me)
-        End Function
-        Private Function IUserData_MoveFiles(ByVal CollectionName As String) As Boolean Implements IUserData.MoveFiles
-            Return DirectCast(Instance, UserDataBase).MoveFilesF(Me, CollectionName)
-        End Function
-#End Region
-        Private _Name As String = String.Empty
-        Friend Property Name As String Implements IUserData.Name
-            Get
-                If IsRegularChannel Then
-                    Return Instance.Name
-                Else
-                    Return _Name
-                End If
-            End Get
-            Set(ByVal NewName As String)
-                If IsRegularChannel Then
-                    Instance.Name = NewName
-                Else
-                    _Name = NewName
-                End If
-            End Set
-        End Property
-        Private _ID As String = String.Empty
-        Friend Property ID As String Implements IUserData.ID
-            Get
-                If IsRegularChannel Then
-                    Return Instance.ID
-                Else
-                    Return _ID
-                End If
-            End Get
-            Set(ByVal NewID As String)
-                If IsRegularChannel Then
-                    Instance.ID = NewID
-                Else
-                    _ID = NewID
-                End If
-            End Set
-        End Property
+        Friend ReadOnly Property Site As String = RedditSite
+        Friend Property Name As String
+        Friend Property ID As String
         Friend ReadOnly Property CUser As UserInfo
             Get
                 Return New UserInfo(Me)
@@ -311,6 +73,47 @@ Namespace API.Reddit
             End Get
         End Property
         Private ReadOnly Property Range As RangeSwitcher(Of UserPost)
+#Region "Statistics support"
+        Private ReadOnly CountOfAddedUsers As List(Of Integer)
+        Private ReadOnly CountOfLoadedPostsPerSession As List(Of Integer)
+        Friend ReadOnly Property ChannelExistentUserNames As List(Of String)
+        Private _FirstUserAdded As Boolean = False
+        Friend Sub UserAdded(ByVal UserName As String, Optional ByVal IsAdded As Boolean = True)
+            If Not _FirstUserAdded Then CountOfAddedUsers.Add(0) : _FirstUserAdded = True
+            Dim v% = CountOfAddedUsers.Last
+            v += IIf(IsAdded, 1, -1)
+            If v < 0 Then v = 0
+            CountOfAddedUsers(CountOfAddedUsers.Count - 1) = v
+            If Not ChannelExistentUserNames.Contains(UserName) Then ChannelExistentUserNames.Add(UserName)
+        End Sub
+        Friend Sub UpdateUsersStats()
+            If Posts.Count > 0 Or PostsLatest.Count > 0 Then
+                ChannelExistentUserNames.ListAddList((From p As UserPost In PostsAll
+                                                      Where Not p.UserID.IsEmptyString AndAlso
+                                                            Settings.UsersList.Exists(Function(u) u.Site = Site And u.Name = p.UserID)
+                                                      Select p.UserID), LAP.NotContainsOnly)
+                ChannelExistentUserNames.RemoveAll(Function(u) Not Settings.UsersList.Exists(Function(uu) uu.Site = Site And uu.Name = u))
+            End If
+        End Sub
+        Friend Function GetChannelStats(ByVal Extended As Boolean) As String
+            UpdateUsersStats()
+            Dim s$ = String.Empty
+            Dim p As New ANumbers With {.FormatOptions = ANumbers.Options.GroupIntegral}
+            If Extended Then
+                s.StringAppendLine($"Users added from this channel: {CountOfAddedUsers.Sum.NumToString(p)}")
+                s.StringAppendLine($"Users added from this channel (avg): {CountOfAddedUsers.DefaultIfEmpty(0).Average.RoundDown.NumToString(p)}")
+                s.StringAppendLine($"Users added from this channel (session): {CountOfAddedUsers.LastOrDefault.NumToString(p)}")
+                s.StringAppendLine($"Posts downloaded (avg): {CountOfLoadedPostsPerSession.DefaultIfEmpty(0).Average.RoundUp.NumToString(p)}")
+                s.StringAppendLine($"Posts downloaded (session): {CountOfLoadedPostsPerSession.LastOrDefault.NumToString(p)}")
+                s.StringAppendLine($"My users in this channel: {ChannelExistentUserNames.Count.NumToString(p)}")
+            Else
+                s.StringAppend($"Users: {CountOfAddedUsers.Sum.NumToString(p)} (avg: {CountOfAddedUsers.DefaultIfEmpty(0).Average.RoundDown.NumToString(p)}; s: {CountOfAddedUsers.LastOrDefault.NumToString(p)})")
+                s.StringAppend($"Posts: {CountOfLoadedPostsPerSession.DefaultIfEmpty(0).Average.RoundUp.NumToString(p)} (s: {CountOfLoadedPostsPerSession.LastOrDefault.NumToString(p)})", "; ")
+                s.StringAppend($"My users: {ChannelExistentUserNames.Count.NumToString(p)}", "; ")
+            End If
+            Return s
+        End Function
+#End Region
 #Region "Limits Support"
         Private _DownloadLimitCount As Integer? = Nothing
         Friend Property DownloadLimitCount As Integer? Implements IChannelLimits.DownloadLimitCount
@@ -374,29 +177,23 @@ Namespace API.Reddit
         End Sub
         Friend Property AutoGetLimits As Boolean = True Implements IChannelLimits.AutoGetLimits
 #End Region
-        Friend ReadOnly IsRegularChannel As Boolean = False
+        Friend ReadOnly Property HOST As SettingsHost
         Friend Sub New()
             Posts = New List(Of UserPost)
             PostsLatest = New List(Of UserPost)
             Range = New RangeSwitcher(Of UserPost)(Me)
+            CountOfAddedUsers = New List(Of Integer)
+            CountOfLoadedPostsPerSession = New List(Of Integer)
+            ChannelExistentUserNames = New List(Of String)
+            HOST = Settings(RedditSiteKey)
         End Sub
         Friend Sub New(ByVal f As SFile)
             Me.New
             LoadData(f, False)
         End Sub
-        Friend Sub New(ByVal u As UserInfo, Optional ByVal _LoadUserInformation As Boolean = True)
-            Me.New
-            Instance = New UserData(u, _LoadUserInformation) With {.SaveToCache = False, .SkipExistsUsers = False, .ChannelInfo = Me}
-            AutoGetLimits = True
-            DirectCast(Instance, UserData).SetLimit(Me)
-            IsRegularChannel = True
-        End Sub
         Public Shared Widening Operator CType(ByVal f As SFile) As Channel
             Return New Channel(f)
         End Operator
-        Public Shared Widening Operator CType(ByVal c As Channel) As UserDataBase
-            Return DirectCast(c.Instance, UserDataBase)
-        End Operator
         Public Overrides Function ToString() As String
             If Not Name.IsEmptyString Then
                 Return Name
@@ -405,28 +202,29 @@ Namespace API.Reddit
             End If
         End Function
         Friend Sub Delete()
-            If File.Exists Then File.Delete()
+            File.Delete(, SFODelete.DeleteToRecycleBin)
         End Sub
         Friend Sub DownloadData(ByVal Token As CancellationToken, Optional ByVal SkipExists As Boolean = True,
                                 Optional ByVal p As MyProgress = Nothing)
             Try
                 _Downloading = True
-                If Not Instance Is Nothing Then
-                    Instance.DownloadData(Token)
-                Else
-                    Using d As New UserData(CUser, False, False) With {
-                        .Progress = p,
-                        .SaveToCache = True,
-                        .SkipExistsUsers = SkipExists,
-                        .ChannelInfo = Me
-                    }
-                        d.SetLimit(Me)
-                        d.DownloadData(Token)
-                        Posts.ListAddList(d.GetNewChannelPosts(), LAP.NotContainsOnly)
-                        Posts.Sort()
-                        LatestParsedDate = If(Posts.FirstOrDefault(Function(pp) pp.Date.HasValue).Date, LatestParsedDate)
-                    End Using
-                End If
+                Using d As New UserData With {
+                    .Progress = p,
+                    .SaveToCache = True,
+                    .SkipExistsUsers = SkipExists,
+                    .ChannelInfo = Me
+                }
+                    d.SetEnvironment(HOST, CUser, False)
+                    d.RemoveUpdateHandlers()
+                    d.SetLimit(Me)
+                    d.DownloadData(Token)
+                    Dim b% = Posts.Count
+                    Posts.ListAddList(d.GetNewChannelPosts(), LAP.NotContainsOnly)
+                    If Posts.Count - b > 0 Then CountOfLoadedPostsPerSession.Add(Posts.Count - b)
+                    Posts.Sort()
+                    LatestParsedDate = If(Posts.FirstOrDefault(Function(pp) pp.Date.HasValue).Date, LatestParsedDate)
+                    UpdateUsersStats()
+                End Using
             Catch oex As OperationCanceledException When Token.IsCancellationRequested
             Finally
                 _Downloading = False
@@ -467,21 +265,12 @@ Namespace API.Reddit
         Friend Overloads Function Equals(ByVal Other As Channel) As Boolean Implements IEquatable(Of Channel).Equals
             Return ID = Other.ID
         End Function
-        Private Overloads Function Equals(ByVal Other As UserDataBase) As Boolean Implements IEquatable(Of UserDataBase).Equals
-            If Not Instance Is Nothing Then
-                Return Instance.Equals(Other)
-            Else
-                Return False
-            End If
-        End Function
         Public Overloads Overrides Function Equals(ByVal Obj As Object) As Boolean
             If Not Obj Is Nothing Then
                 If TypeOf Obj Is String Then
                     Return ID = CStr(Obj)
                 ElseIf TypeOf Obj Is Channel Then
                     Return Equals(DirectCast(Obj, Channel))
-                ElseIf TypeOf Obj Is UserDataBase Then
-                    Return Equals(DirectCast(Obj, UserDataBase))
                 End If
             End If
             Return False
@@ -495,22 +284,6 @@ Namespace API.Reddit
                 Return ID.CompareTo(Other.ID)
             End If
         End Function
-        Private Overloads Function CompareTo(ByVal Other As UserDataBase) As Integer Implements IComparable(Of UserDataBase).CompareTo
-            If Not Instance Is Nothing Then
-                Return Instance.CompareTo(Other)
-            Else
-                Return 0
-            End If
-        End Function
-        Private Overloads Function CompareTo(ByVal Obj As Object) As Integer Implements IComparable.CompareTo
-            If TypeOf Obj Is Channel Then
-                Return CompareTo(DirectCast(Obj, Channel))
-            ElseIf TypeOf Obj Is UserDataBase And Not Instance Is Nothing Then
-                Return Instance.CompareTo(Obj)
-            Else
-                Return 0
-            End If
-        End Function
 #End Region
 #Region "ILoaderSaver Support"
         Friend Overloads Function LoadData(Optional ByVal f As SFile = Nothing, Optional ByVal e As ErrorsDescriber = Nothing) As Boolean Implements ILoaderSaver.Load
@@ -522,9 +295,13 @@ Namespace API.Reddit
                     x.LoadData()
                     If x.Count > 0 Then
                         Dim XMLDateProvider As New ADateTime(ADateTime.Formats.BaseDateTime)
+                        Dim lc As New ListAddParams(LAP.ClearBeforeAdd)
                         Name = x.Value(Name_Name)
                         ID = x.Value(Name_ID)
                         LatestParsedDate = AConvert(Of Date)(x.Value(Name_Date), XMLDateProvider, Nothing)
+                        CountOfAddedUsers.ListAddList(x.Value(Name_UsersAdded).StringToList(Of Integer)("|"), lc)
+                        CountOfLoadedPostsPerSession.ListAddList(x.Value(Name_PostsDownloaded).StringToList(Of Integer)("|"), lc)
+                        ChannelExistentUserNames.ListAddList(x.Value(Name_UsersExistent).StringToList(Of String)("|"), LNC)
                         If Not PartialLoad Then
                             With x(Name_PostsNode).XmlIfNothing
                                 If .Count > 0 Then .ForEach(Sub(ee) PostsLatest.Add(New UserPost With {
@@ -539,6 +316,7 @@ Namespace API.Reddit
         End Function
         Friend Overloads Function Save(Optional ByVal f As SFile = Nothing, Optional ByVal e As ErrorsDescriber = Nothing) As Boolean Implements ILoaderSaver.Save
             Dim XMLDateProvider As New ADateTime(ADateTime.Formats.BaseDateTime)
+            UpdateUsersStats()
             Using x As New XmlFile With {.AllowSameNames = True, .Name = "Channel"}
                 x.Add(Name_Name, Name)
                 x.Add(Name_ID, ID)
@@ -549,6 +327,9 @@ Namespace API.Reddit
                     LatestParsedDate = tmpPostList.FirstOrDefault(Function(pd) pd.Date.HasValue).Date
                     x.Add(Name_Date, AConvert(Of String)(LatestParsedDate, XMLDateProvider, String.Empty))
                     x.Add(Name_PostsNode, String.Empty)
+                    x.Add(Name_UsersAdded, CountOfAddedUsers.ListToString(, "|"))
+                    x.Add(Name_PostsDownloaded, CountOfLoadedPostsPerSession.ListToString(, "|"))
+                    x.Add(Name_UsersExistent, ChannelExistentUserNames.ListToString(, "|"))
                     With x(Name_PostsNode)
                         tmpPostList.Take(200).ToList.ForEach(Sub(p) .Add(New EContainer("Post",
                                                                                   String.Empty,
@@ -568,19 +349,16 @@ Namespace API.Reddit
 #End Region
 #Region "IDisposable Support"
         Private disposedValue As Boolean = False
-        Friend ReadOnly Property Disposed As Boolean Implements IUserData.Disposed
-            Get
-                Return disposedValue
-            End Get
-        End Property
         Protected Overridable Overloads Sub Dispose(ByVal disposing As Boolean)
             If Not disposedValue Then
                 If disposing Then
                     Posts.Clear()
                     PostsLatest.Clear()
+                    CountOfAddedUsers.Clear()
+                    CountOfLoadedPostsPerSession.Clear()
                     Range.Dispose()
-                    If Not Instance Is Nothing Then Instance.Dispose()
-                    If CachePath.Exists(SFO.Path, False) Then CachePath.Delete(SFO.Path, False, False, EDP.SendInLog)
+                    ChannelExistentUserNames.Clear()
+                    CachePath.Delete(SFO.Path, SFODelete.None, EDP.SendInLog)
                 End If
                 disposedValue = True
             End If

SCrawler/API/Reddit/ChannelsCollection.vb

@@ -15,15 +15,39 @@ Namespace API.Reddit
         Friend Shared ReadOnly Property ChannelsPath As SFile = $"{SettingsFolderName}\Channels\"
         Friend Shared ReadOnly Property ChannelsPathCache As SFile = $"{Settings.GlobalPath.Value.PathWithSeparator}_CachedData\"
         Private ReadOnly Channels As List(Of Channel)
+        Friend Structure ChannelImage : Implements IEquatable(Of ChannelImage)
+            Friend File As SFile
+            Friend Channel As String
+            Friend Sub New(ByVal ChannelName As String, ByVal f As SFile)
+                Channel = ChannelName
+                File = f
+            End Sub
+            Friend Overloads Function Equals(ByVal Other As ChannelImage) As Boolean Implements IEquatable(Of ChannelImage).Equals
+                Return Channel = Other.Channel And File.File = Other.File.File
+            End Function
+            Public Overloads Overrides Function Equals(ByVal Obj As Object) As Boolean
+                Return Equals(DirectCast(Obj, ChannelImage))
+            End Function
+        End Structure
         Friend ReadOnly Property Downloading As Boolean
             Get
-                If Count > 0 Then
-                    Return Channels.Exists(Function(c) c.Downloading)
-                Else
-                    Return False
-                End If
+                Return Count > 0 AndAlso Channels.Exists(Function(c) c.Downloading)
             End Get
         End Property
+        Friend Function GetUserFiles(ByVal UserName As String) As IEnumerable(Of ChannelImage)
+            Try
+                If Settings.ChannelsAddUserImagesFromAllChannels.Value And Count > 0 Then
+                    Return Channels.SelectMany(Function(c) From p As UserPost In c.Posts Where p.UserID = UserName Select New ChannelImage(c.Name, p.CachedFile))
+                Else
+                    Return Nothing
+                End If
+            Catch ex As Exception
+                Return ErrorsDescriber.Execute(EDP.SendInLog + EDP.ReturnValue, ex)
+            End Try
+        End Function
+        Friend Sub UpdateUsersStats()
+            If Channels.Count > 0 Then Channels.ForEach(Sub(c) c.UpdateUsersStats())
+        End Sub
 #Region "Limits Support"
         Friend Property DownloadLimitCount As Integer? Implements IChannelLimits.DownloadLimitCount
         <Obsolete("This property cannot be used in collections", True)> Private Property DownloadLimitPost As String Implements IChannelLimits.DownloadLimitPost
@@ -74,7 +98,6 @@ Namespace API.Reddit
                     Next
                 End If
                 Throw New ArgumentException($"Channel ID [{ChannelID}] does not found in channels collection", "ChannelID") With {.HelpLink = 1}
-                'Return Nothing
             End Get
         End Property
         Friend Sub DownloadData(ByVal Token As CancellationToken, Optional ByVal SkipExists As Boolean = True,
@@ -111,7 +134,7 @@ Namespace API.Reddit
             Return Count > 0 AndAlso Channels.Contains(_Item)
         End Function
         Friend Function Remove(ByVal _Item As Channel) As Boolean Implements ICollection(Of Channel).Remove
-            If Count > 0 Then
+            If Count > 0 And Not _Item Is Nothing Then
                 Dim i% = Channels.IndexOf(_Item)
                 If i >= 0 Then
                     With Channels(i) : .Delete() : .Dispose() : End With

SCrawler/API/Reddit/Declarations.vb

@@ -7,34 +7,35 @@
 ' This program is distributed in the hope that it will be useful,
 ' but WITHOUT ANY WARRANTY
 Imports PersonalUtilities.Functions.XML.Base
+Imports PersonalUtilities.Functions.RegularExpressions
 Namespace API.Reddit
     Friend Module Declarations
+        Friend Const RedditSite As String = "Reddit"
+        Friend Const RedditSiteKey As String = "AndyProgram_Reddit"
         Friend ReadOnly JsonNodesJson() As NodeParams = {New NodeParams("posts", True, True, True, True, 3)}
         Friend ReadOnly ChannelJsonNodes() As NodeParams = {New NodeParams("data", True, True, True, True, 1),
                                                             New NodeParams("children", True, True, True)}
-        Friend ReadOnly UrlBasePattern As New RegexStructure("(?<=/)([^/]+?\.[\w]{3,4})(?=(\?|\Z))", True, False)
-        Friend ReadOnly VideoRegEx As New RegexStructure("http.{0,1}://[^" & Chr(34) & "]+?mp4", True, False)
+        Friend ReadOnly UrlBasePattern As RParams = RParams.DM("(?<=/)([^/]+?\.[\w]{3,4})(?=(\?|\Z))", 0)
+        Friend ReadOnly VideoRegEx As RParams = RParams.DM("http.{0,1}://[^" & Chr(34) & "]+?mp4", 0)
         Friend ReadOnly DateProvider As New JsonDate
         Friend ReadOnly DateProviderChannel As New JsonDateChannel
-        Private ReadOnly EUR_PROVIDER As New ANumbers(ANumbers.Modes.EUR)
+        Private ReadOnly EUR_PROVIDER As New ANumbers(ANumbers.Cultures.EUR)
         Friend Class JsonDate : Implements ICustomProvider
-            ''' <inheritdoc cref="ADateTime.ParseUnicodeJS(Object, Object, ErrorsDescriber)"/>
             Friend Function Convert(ByVal Value As Object, ByVal DestinationType As Type, ByVal Provider As IFormatProvider,
                                     Optional ByVal NothingArg As Object = Nothing, Optional ByVal e As ErrorsDescriber = Nothing) As Object Implements ICustomProvider.Convert
                 Return ADateTime.ParseUnicodeJS(Value, NothingArg, e)
             End Function
             Private Function GetFormat(ByVal FormatType As Type) As Object Implements IFormatProvider.GetFormat
-                Throw New NotImplementedException("GetFormat does not available in this context")
+                Throw New NotImplementedException("GetFormat is not available in this context")
             End Function
         End Class
         Friend Class JsonDateChannel : Implements ICustomProvider
-            ''' <inheritdoc cref="ADateTime.ParseUnicodeJS(Object, Object, ErrorsDescriber)"/>
             Friend Function Convert(ByVal Value As Object, ByVal DestinationType As Type, ByVal Provider As IFormatProvider,
                                     Optional ByVal NothingArg As Object = Nothing, Optional ByVal e As ErrorsDescriber = Nothing) As Object Implements ICustomProvider.Convert
                 Return ADateTime.ParseUnicode(AConvert(Of Integer)(Value, EUR_PROVIDER, Value), NothingArg, e)
             End Function
             Private Function GetFormat(ByVal FormatType As Type) As Object Implements IFormatProvider.GetFormat
-                Throw New NotImplementedException("GetFormat does not available in this context")
+                Throw New NotImplementedException("GetFormat is not available in this context")
             End Function
         End Class
     End Module

SCrawler/API/Reddit/M3U8.vb

@@ -9,26 +9,25 @@
 Imports System.Net
 Imports SCrawler.API.Reddit.M3U8_Declarations
 Imports PersonalUtilities.Tools.WEB
-Namespace API.Reddit.M3U8_Declarations
-    Friend Module M3U8_Declarations
-        Friend ReadOnly BaseUrlPattern As New RegexStructure("([htps:/]{7,8}.+?/.+?)(?=/)", True, False,,,,,, EDP.ReturnValue)
-        Friend ReadOnly PlayListRegEx_1 As New RegexStructure("(#EXT-X-STREAM-INF)(.+)(RESOLUTION=)(\d+)(.+?[\r\n]{1,2})(.+?)([\r\n]{1,2})", True, False,,,
-                                                              RegexReturn.List,, New List(Of String),
-                                                              New ErrorsDescriber(False, False, True, New List(Of String)))
-        Friend ReadOnly PlayListRegEx_2 As New RegexStructure("(?<=#EXT-X-BYTERANGE.+?[\r\n]{1,2})(.+)(?=[\r\n]{0,2})", True, False,,, RegexReturn.List,,
-                                                              New List(Of String),
-                                                              New ErrorsDescriber(False, False, True, New List(Of String)))
-        Friend ReadOnly DPED As New ErrorsDescriber(EDP.SendInLog + EDP.ReturnValue)
-    End Module
-End Namespace
+Imports PersonalUtilities.Functions.RegularExpressions
 Namespace API.Reddit
+    Namespace M3U8_Declarations
+        Friend Module M3U8_Declarations
+            Friend ReadOnly BaseUrlPattern As RParams = RParams.DM("([htps:/]{7,8}.+?/.+?)(?=/)", 0, EDP.ReturnValue)
+            Friend ReadOnly PlayListRegEx_1 As RParams = RParams.DM("(#EXT-X-STREAM-INF)(.+)(RESOLUTION=)(\d+)(.+?[\r\n]{1,2})(.+?)([\r\n]{1,2})", 0,
+                                                                    RegexReturn.List, EDP.SendInLog, EDP.ReturnValue)
+            Friend ReadOnly PlayListRegEx_2 As RParams = RParams.DM("(?<=#EXT-X-BYTERANGE.+?[\r\n]{1,2})(.+)(?=[\r\n]{0,2})", 0,
+                                                                    RegexReturn.List, EDP.SendInLog, EDP.ReturnValue)
+            Friend ReadOnly DPED As New ErrorsDescriber(EDP.SendInLog + EDP.ReturnValue)
+        End Module
+    End Namespace
     Friend NotInheritable Class M3U8
         Private Sub New()
         End Sub
         Private Structure Resolution : Implements IRegExCreator, IComparable(Of Resolution)
             Friend File As String
             Friend Resolution As Integer
-            Friend Function CreateFromArray(ByVal ParamsArray() As String) As IRegExCreator Implements IRegExCreator.CreateFromArray
+            Friend Function CreateFromArray(ByVal ParamsArray() As String) As Object Implements IRegExCreator.CreateFromArray
                 If ParamsArray.ArrayExists Then
                     File = ParamsArray(0)
                     If ParamsArray.Length > 1 Then Resolution = AConvert(Of Integer)(ParamsArray(1), 0)
@@ -45,7 +44,7 @@ Namespace API.Reddit
                     Using w As New WebClient
                         Dim r$ = w.DownloadString(PlayListURL)
                         If Not r.IsEmptyString Then
-                            Dim l As List(Of Resolution) = RegexFields(Of Resolution)(r, {PlayListRegEx_1}, {6, 4})
+                            Dim l As List(Of Resolution) = FNF.RegexFields(Of Resolution)(r, {PlayListRegEx_1}, {6, 4})
                             If l.ListExists Then
                                 l.Sort()
                                 Dim pls$ = $"{BaseUrl}/{l.First.File}"
@@ -74,7 +73,7 @@ Namespace API.Reddit
                     ConcatFile.Extension = "mp4"
                     CachePath = $"{f.PathWithSeparator}_Cache\{SFile.GetDirectories($"{f.PathWithSeparator}_Cache\",,, EDP.ReturnValue).ListIfNothing.Count + 1}\"
                     If CachePath.Exists(SFO.Path) Then
-                        Dim p As New SFileNumbers(ConcatFile.Name,,, New ANumbers(ANumbers.Modes.USA) With {.GroupSeparator = String.Empty, .FormatMode = ANumbers.Formats.General})
+                        Dim p As New SFileNumbers(ConcatFile.Name,,, New ANumbers With {.Format = ANumbers.Formats.General})
                         ConcatFile = SFile.Indexed_IndexFile(ConcatFile,, p, EDP.ReturnValue)
                         Dim i%
                         Dim eFiles As New List(Of SFile)
@@ -97,7 +96,7 @@ Namespace API.Reddit
             Catch ex As Exception
                 Return ErrorsDescriber.Execute(DPED, ex, "[M3U8.Save]", New SFile)
             Finally
-                If Not CachePath.IsEmptyString AndAlso CachePath.Exists(SFO.Path, False) Then CachePath.Delete(SFO.Path, False, False, DPED)
+                CachePath.Delete(SFO.Path, SFODelete.None, DPED)
             End Try
         End Function
         Friend Shared Function Download(ByVal URL As String, ByVal f As SFile) As SFile

SCrawler/API/Reddit/SiteSettings.vb

@@ -0,0 +1,97 @@
+' Copyright (C) 2022  Andy
+' This program is free software: you can redistribute it and/or modify
+' it under the terms of the GNU General Public License as published by
+' the Free Software Foundation, either version 3 of the License, or
+' (at your option) any later version.
+'
+' This program is distributed in the hope that it will be useful,
+' but WITHOUT ANY WARRANTY
+Imports SCrawler.API.Base
+Imports SCrawler.Plugin
+Imports SCrawler.Plugin.Attributes
+Imports PersonalUtilities.Tools
+Imports PersonalUtilities.Functions.RegularExpressions
+Imports DownDetector = SCrawler.API.Base.DownDetector
+Imports Download = SCrawler.Plugin.ISiteSettings.Download
+Namespace API.Reddit
+    <Manifest(RedditSiteKey), UseClassAsIs, SavedPosts>
+    Friend Class SiteSettings : Inherits SiteSettingsBase
+        Friend Overrides ReadOnly Property Icon As Icon
+            Get
+                Return My.Resources.RedditIcon
+            End Get
+        End Property
+        Friend Overrides ReadOnly Property Image As Image
+            Get
+                Return My.Resources.RedditPic512
+            End Get
+        End Property
+        <PropertyOption(ControlText:="Saved posts user"), PXML("SavedPostsUserName")>
+        Friend ReadOnly Property SavedPostsUserName As PropertyValue
+        Friend Overrides ReadOnly Property Responser As WEB.Response
+        Friend Sub New()
+            MyBase.New(RedditSite)
+            Responser = New WEB.Response($"{SettingsFolderName}\Responser_{Site}.xml")
+
+            With Responser
+                If .File.Exists Then
+                    .LoadSettings()
+                Else
+                    .CookiesDomain = "reddit.com"
+                    .Decoders.Add(SymbolsConverter.Converters.Unicode)
+                    .SaveSettings()
+                End If
+            End With
+            SavedPostsUserName = New PropertyValue(String.Empty, GetType(String))
+            UrlPatternUser = "https://www.reddit.com/user/{0}/"
+            UrlPatternChannel = "https://www.reddit.com/r/{0}/"
+            ImageVideoContains = "redgifs"
+        End Sub
+        Friend Overrides Function GetInstance(ByVal What As Download) As IPluginContentProvider
+            Select Case What
+                Case Download.Main : Return New UserData
+                Case Download.Channel : Return New UserData With {.SaveToCache = False, .SkipExistsUsers = False, .AutoGetLimits = True}
+                Case Download.SavedPosts
+                    Dim u As New UserData With {.IsSavedPosts = True}
+                    DirectCast(u, UserDataBase).User = New UserInfo With {.Name = CStr(AConvert(Of String)(SavedPostsUserName.Value, String.Empty))}
+                    Return u
+            End Select
+            Return Nothing
+        End Function
+        Private ReadOnly RedditRegEx1 As RParams = RParams.DMS("[htps:/]{7,8}.*?reddit.com/user/([^/]+)", 1)
+        Private ReadOnly RedditRegEx2 As RParams = RParams.DMS(".?u/([^/]+)", 1)
+        Private ReadOnly RedditChannelRegEx1 As RParams = RParams.DMS("[htps:/]{7,8}.*?reddit.com/r/([^/]+)", 1)
+        Private ReadOnly RedditChannelRegEx2 As RParams = RParams.DMS(".?r/([^/]+)", 1)
+        Friend Overrides Function IsMyUser(ByVal UserURL As String) As ExchangeOptions
+            Dim s$
+            Dim c% = 0
+            For Each r As RParams In {RedditRegEx1, RedditRegEx2, RedditChannelRegEx1, RedditChannelRegEx2}
+                s = RegexReplace(UserURL, r)
+                If Not s.IsEmptyString Then Return New ExchangeOptions(Site, s, c > 1)
+                c += 1
+            Next
+            Return Nothing
+        End Function
+        Friend Overrides Function Available(ByVal What As Download) As Boolean
+            Try
+                Dim dl As List(Of DownDetector.Data) = DownDetector.GetData("reddit")
+                If dl.ListExists Then
+                    dl = dl.Take(4).ToList
+                    Dim avg% = dl.Average(Function(d) d.Value)
+                    If avg > 100 Then
+                        Return MsgBoxE({"Over the past hour, Reddit has received an average of " &
+                                        avg.NumToString(New ANumbers With {.FormatOptions = ANumbers.Options.GroupIntegral}) & " outage reports:" & vbCr &
+                                        dl.ListToString(, vbCr) & vbCr & vbCr &
+                                        "Do you want to continue parsing Reddit data?", "There are outage reports on Reddit"}, vbYesNo) = vbYes
+                    End If
+                End If
+                Return True
+            Catch ex As Exception
+                Return ErrorsDescriber.Execute(EDP.SendInLog + EDP.ReturnValue, ex, "[API.Reddit.SiteSettings.Available]", True)
+            End Try
+        End Function
+        Friend Overrides Function GetSpecialDataF(ByVal URL As String) As IEnumerable(Of UserMedia)
+            Return UserData.GetVideoInfo(URL, Responser)
+        End Function
+    End Class
+End Namespace

SCrawler/API/Reddit/UserData.vb

@@ -7,8 +7,9 @@
 ' This program is distributed in the hope that it will be useful,
 ' but WITHOUT ANY WARRANTY
 Imports PersonalUtilities.Functions.XML
-Imports PersonalUtilities.Forms.Toolbars
+Imports PersonalUtilities.Functions.RegularExpressions
 Imports PersonalUtilities.Tools.ImageRenderer
+Imports PersonalUtilities.Tools.WEB
 Imports PersonalUtilities.Tools.WebDocuments.JSON
 Imports System.Net
 Imports System.Threading
@@ -17,7 +18,16 @@ Imports UStates = SCrawler.API.Base.UserMedia.States
 Imports UTypes = SCrawler.API.Base.UserMedia.Types
 Namespace API.Reddit
     Friend Class UserData : Inherits UserDataBase : Implements IChannelData
-        Friend Overrides Property Site As Sites = Sites.Reddit
+        Private ReadOnly Property MySiteSettings As SiteSettings
+            Get
+                Return DirectCast(HOST.Source, SiteSettings)
+            End Get
+        End Property
+        Private Shared ReadOnly Property DateTrueProvider(ByVal IsChannel As Boolean) As IFormatProvider
+            Get
+                Return If(IsChannel, DateProviderChannel, DateProvider)
+            End Get
+        End Property
 #Region "Channels Support"
 #Region "IChannelLimits Support"
         Friend Property DownloadLimitCount As Integer? Implements IChannelLimits.DownloadLimitCount
@@ -50,36 +60,25 @@ Namespace API.Reddit
                                                   Select c.Post) Else Return Nothing
         End Function
 #End Region
-        Private _Progress As MyProgress
-        Friend Property Progress As MyProgress
-            Get
-                If _Progress Is Nothing Then Return MainProgress Else Return _Progress
-            End Get
-            Set(ByVal p As MyProgress)
-                _Progress = p
-            End Set
-        End Property
-#Region "Initializers"
-        ''' <summary>Video downloader initializer</summary>
-        Private Sub New()
+#Region "Initializer"
+        Friend Sub New()
             ChannelPostsNames = New List(Of String)
             _ExistsUsersNames = New List(Of String)
+            _CrossPosts = New List(Of String)
         End Sub
-        ''' <summary>Default initializer</summary>
-        Friend Sub New(ByVal u As UserInfo, Optional ByVal _LoadUserInformation As Boolean = True, Optional ByVal InvokeImageHandler As Boolean = True)
-            MyBase.New(InvokeImageHandler)
-            ChannelPostsNames = New List(Of String)
-            _ExistsUsersNames = New List(Of String)
-            User = u
-            If _LoadUserInformation Then LoadUserInformation()
+#End Region
+#Region "Load and Update user info"
+        Protected Overrides Sub LoadUserInformation_OptionalFields(ByRef Container As XmlFile, ByVal Loading As Boolean)
         End Sub
 #End Region
 #Region "Download Overrides"
         Friend Overrides Sub DownloadData(ByVal Token As CancellationToken)
-            If IsChannel AndAlso Not ChannelInfo.IsRegularChannel Then
+            UserDescriptionReset()
+            _CrossPosts.Clear()
+            If Not IsSavedPosts AndAlso (IsChannel AndAlso Not ChannelInfo Is Nothing) Then
                 If Not Responser Is Nothing Then Responser.Dispose()
-                Responser = New PersonalUtilities.Tools.WEB.Response
-                Responser.Copy(Settings.Site(Sites.Reddit).Responser)
+                Responser = New Response
+                Responser.Copy(MySiteSettings.Responser)
                 ChannelPostsNames.ListAddList(ChannelInfo.PostsAll.Select(Function(p) p.ID), LNC)
                 If SkipExistsUsers Then _ExistsUsersNames.ListAddList(Settings.UsersList.Select(Function(p) p.Name), LNC)
                 DownloadDataF(Token)
@@ -92,8 +91,10 @@ Namespace API.Reddit
         End Sub
         Protected Overrides Sub DownloadDataF(ByVal Token As CancellationToken)
             _TotalPostsDownloaded = 0
-            If IsChannel Then
-                If ChannelInfo.IsRegularChannel Then
+            If IsSavedPosts Then
+                DownloadDataChannel(String.Empty, Token)
+            ElseIf IsChannel Then
+                If ChannelInfo Is Nothing Then
                     ChannelPostsNames.ListAddList(_TempPostsList, LNC)
                     If ChannelPostsNames.Count > 0 Then
                         DownloadLimitCount = Nothing
@@ -104,7 +105,7 @@ Namespace API.Reddit
                     If DownloadTopCount.HasValue Then DownloadLimitCount = DownloadTopCount
                 End If
                 DownloadDataChannel(String.Empty, Token)
-                If ChannelInfo.IsRegularChannel Then _TempPostsList.ListAddList(_TempMediaList.Select(Function(m) m.Post.ID), LNC)
+                If ChannelInfo Is Nothing Then _TempPostsList.ListAddList(_TempMediaList.Select(Function(m) m.Post.ID), LNC)
             Else
                 DownloadDataUser(String.Empty, Token)
             End If
@@ -112,10 +113,13 @@ Namespace API.Reddit
 #End Region
 #Region "Download Functions (User, Channel)"
         Private _TotalPostsDownloaded As Integer = 0
+        Private ReadOnly _CrossPosts As List(Of String)
         Private Sub DownloadDataUser(ByVal POST As String, ByVal Token As CancellationToken)
+            Const CPRI$ = "crosspostRootId"
+            Const CPPI$ = "crosspostParentId"
             Dim URL$ = String.Empty
             Try
-                Dim PostID$ = String.Empty
+                Dim PostID$ = String.Empty, PostTmp$ = String.Empty
                 Dim PostDate$
                 Dim n As EContainer, nn As EContainer, s As EContainer
                 Dim NewPostDetected As Boolean = False
@@ -124,53 +128,69 @@ Namespace API.Reddit
                 Dim added As Boolean
                 Dim __ItemType$
                 Dim tmpType As UTypes
-                Dim CheckNode As Predicate(Of EContainer) = Function(e) e("author").XmlIfNothingValue("/").ToLower.Equals(Name.ToLower)
+                Dim IsCrossPost As Predicate(Of EContainer) = Function(e) Not (e.Value(CPRI).IsEmptyString And e.Value(CPPI).IsEmptyString)
+                Dim CheckNode As Predicate(Of EContainer) = Function(e) Not ParseUserMediaOnly OrElse e("author").XmlIfNothingValue("/").ToLower.Equals(Name.ToLower)
                 Dim UPicType As Func(Of String, UTypes) = Function(input) IIf(input = "image", UTypes.Picture, UTypes.GIF)
+                Dim _PostID As Func(Of String) = Function() IIf(PostTmp.IsEmptyString, PostID, PostTmp)
 
                 URL = $"https://gateway.reddit.com/desktopapi/v1/user/{Name}/posts?rtj=only&allow_quarantined=true&allow_over18=1&include=identity&after={POST}&dist=25&sort=new&t=all&layout=classic"
                 ThrowAny(Token)
-                Dim r$ = GetSiteResponse(URL)
+                Dim r$ = Responser.GetResponse(URL,, EDP.ThrowException)
                 If Not r.IsEmptyString Then
                     Using w As EContainer = JsonDocument.Parse(r).XmlIfNothing
                         If w.Count > 0 Then
+                            If UserDescriptionNeedToUpdate() Then UserDescriptionUpdate(w.ItemF({"subredditAboutInfo", 0, "publicDescription"}).XmlIfNothingValue)
                             n = w.GetNode(JsonNodesJson)
                             If Not n Is Nothing AndAlso n.Count > 0 Then
                                 For Each nn In n
                                     ThrowAny(Token)
                                     If nn.Count > 0 Then
-                                        PostID = nn.Name
-                                        If PostID.IsEmptyString AndAlso nn.Contains("id") Then PostID = nn("id").Value
-                                        If nn.Contains("created") Then PostDate = nn("created").Value Else PostDate = String.Empty
-                                        If Not _TempPostsList.Contains(PostID) Then
-                                            NewPostDetected = True
-                                            _TempPostsList.Add(PostID)
-                                        Else
-                                            ExistsDetected = True
-                                            Continue For
-                                        End If
-
                                         If CheckNode(nn) Then
+
+                                            'Obtain post ID
+                                            PostTmp = nn.Name
+                                            If PostTmp.IsEmptyString Then PostTmp = nn.Value("id")
+                                            If PostTmp.IsEmptyString Then Continue For
+                                            'Check for CrossPost
+                                            If IsCrossPost(nn) Then
+                                                _CrossPosts.ListAddList({nn.Value(CPRI), nn.Value(CPPI)}, LNC)
+                                                Continue For
+                                            Else
+                                                If Not _CrossPosts.Contains(PostTmp) Then PostID = PostTmp : PostTmp = String.Empty
+                                            End If
+
+                                            'Download decision
+                                            If Not _TempPostsList.Contains(_PostID()) Then
+                                                NewPostDetected = True
+                                                _TempPostsList.Add(_PostID())
+                                            Else
+                                                If Not _CrossPosts.Contains(_PostID()) Then ExistsDetected = True
+                                                Continue For
+                                            End If
+                                            If nn.Contains("created") Then PostDate = nn("created").Value Else PostDate = String.Empty
+                                            If DownloadToDate.HasValue AndAlso Not CheckDatesLimit(PostDate, DateTrueProvider(IsChannel)) Then Exit Sub
+
                                             _ItemsBefore = _TempMediaList.Count
                                             added = True
                                             s = nn.ItemF({"source", "url"})
-                                            If s.XmlIfNothingValue("/").Contains("redgifs.com") Then
-                                                _TempMediaList.ListAddValue(MediaFromData(UTypes.VideoPre, s.Value, PostID, PostDate,, IsChannel), LNC)
-                                            ElseIf Not CreateImgurMedia(s.XmlIfNothingValue, PostID, PostDate,, IsChannel) Then
+                                            If s.XmlIfNothingValue("/").StringContains({"redgifs.com", "gfycat.com"}) Then
+                                                _TempMediaList.ListAddValue(MediaFromData(UTypes.VideoPre, s.Value, _PostID(), PostDate,, IsChannel), LNC)
+                                            ElseIf Not CreateImgurMedia(s.XmlIfNothingValue, _PostID(), PostDate,, IsChannel) Then
                                                 s = nn.ItemF({"media"}).XmlIfNothing
                                                 __ItemType = s("type").XmlIfNothingValue
                                                 Select Case __ItemType
-                                                    Case "gallery" : If Not DownloadGallery(s, PostID, PostDate) Then added = False
+                                                    Case "gallery" : If Not DownloadGallery(s, _PostID(), PostDate) Then added = False
                                                     Case "image", "gifvideo"
                                                         If s.Contains("content") Then
                                                             _TempMediaList.ListAddValue(MediaFromData(UPicType(__ItemType), s.Value("content"),
-                                                                                                      PostID, PostDate,, IsChannel), LNC)
+                                                                                                      _PostID(), PostDate,, IsChannel), LNC)
                                                         Else
                                                             added = False
                                                         End If
                                                     Case "video"
                                                         If Settings.UseM3U8 AndAlso s("hlsUrl").XmlIfNothingValue("/").ToLower.Contains("m3u8") Then
                                                             _TempMediaList.ListAddValue(MediaFromData(UTypes.m3u8, s.Value("hlsUrl"),
-                                                                                                      PostID, PostDate,, IsChannel), LNC)
+                                                                                                      _PostID(), PostDate,, IsChannel), LNC)
                                                         Else
                                                             added = False
                                                         End If
@@ -182,7 +202,7 @@ Namespace API.Reddit
                                                 If Not s.IsEmptyString AndAlso TryFile(s.Value) Then
                                                     With s.Value.ToLower
                                                         Select Case True
-                                                            Case .Contains("redgifs") : tmpType = UTypes.VideoPre
+                                                            Case .Contains("redgifs"), .Contains("gfycat") : tmpType = UTypes.VideoPre
                                                             Case .Contains("m3u8") : If Settings.UseM3U8 Then tmpType = UTypes.m3u8
                                                             Case .Contains(".gif") And TryFile(s.Value) : tmpType = UTypes.GIF
                                                             Case TryFile(s.Value) : tmpType = UTypes.Picture
@@ -190,7 +210,7 @@ Namespace API.Reddit
                                                         End Select
                                                     End With
                                                     If Not tmpType = UTypes.Undefined Then
-                                                        _TempMediaList.ListAddValue(MediaFromData(tmpType, s.Value, PostID, PostDate,, IsChannel), LNC)
+                                                        _TempMediaList.ListAddValue(MediaFromData(tmpType, s.Value, _PostID(), PostDate,, IsChannel), LNC)
                                                     End If
                                                 End If
                                             End If
@@ -203,17 +223,8 @@ Namespace API.Reddit
                     If POST.IsEmptyString And ExistsDetected Then Exit Sub
                     If Not PostID.IsEmptyString And NewPostDetected Then DownloadDataUser(PostID, Token)
                 End If
-            Catch oex As OperationCanceledException When Token.IsCancellationRequested
-            Catch dex As ObjectDisposedException When Disposed
             Catch ex As Exception
-                If ex.HelpLink = NonExistendUserHelp Then
-                    UserExists = False
-                ElseIf ex.HelpLink = SuspendedUserHelp Then
-                    UserSuspended = True
-                Else
-                    LogError(ex, $"data downloading error [{URL}]")
-                    HasError = True
-                End If
+                ProcessException(ex, Token, $"data downloading error [{URL}]")
             End Try
         End Sub
         Private Sub DownloadDataChannel(ByVal POST As String, ByVal Token As CancellationToken)
@@ -227,9 +238,14 @@ Namespace API.Reddit
                 Dim eCount As Predicate(Of EContainer) = Function(e) e.Count > 0
                 Dim lDate As Date?
 
-                URL = $"https://reddit.com/r/{Name}/new.json?allow_quarantined=true&allow_over18=1&include=identity&after={POST}&dist=25&sort=new&t=all&layout=classic"
+                If IsSavedPosts Then
+                    URL = $"https://www.reddit.com/user/{Name}/saved.json?after={POST}"
+                Else
+                    URL = $"https://reddit.com/r/{Name}/new.json?allow_quarantined=true&allow_over18=1&include=identity&after={POST}&dist=25&sort=new&t=all&layout=classic"
+                End If
+
                 ThrowAny(Token)
-                Dim r$ = GetSiteResponse(URL)
+                Dim r$ = Responser.GetResponse(URL,, EDP.ThrowException)
                 If Not r.IsEmptyString Then
                     Using w As EContainer = JsonDocument.Parse(r).XmlIfNothing
                         If w.Count > 0 Then
@@ -251,13 +267,28 @@ Namespace API.Reddit
                                             End With
                                             If lDate.HasValue AndAlso lDate.Value <= DownloadLimitDate.Value Then Exit Sub
                                         End If
-                                        NewPostDetected = True
+
+                                        If IsSavedPosts Then
+                                            If Not _TempPostsList.Contains(PostID) Then
+                                                NewPostDetected = True
+                                                _TempPostsList.Add(PostID)
+                                            Else
+                                                ExistsDetected = True
+                                                Continue For
+                                            End If
+                                        Else
+                                            NewPostDetected = True
+                                        End If
 
                                         If s.Contains("created") Then PostDate = s("created").Value Else PostDate = String.Empty
                                         _UserID = s.Value("author")
 
                                         If SkipExistsUsers AndAlso _ExistsUsersNames.Count > 0 AndAlso
-                                           Not _UserID.IsEmptyString AndAlso _ExistsUsersNames.Contains(_UserID) Then Continue For
+                                           Not _UserID.IsEmptyString AndAlso _ExistsUsersNames.Contains(_UserID) Then
+                                            If Not IsSavedPosts AndAlso Not ChannelInfo Is Nothing Then _
+                                               ChannelInfo.ChannelExistentUserNames.ListAddValue(_UserID, LNC)
+                                            Continue For
+                                        End If
 
                                         tmpUrl = s.Value("url")
                                         If Not tmpUrl.IsEmptyString AndAlso tmpUrl.Contains("redgifs.com") Then
@@ -271,6 +302,18 @@ Namespace API.Reddit
                                                 _TempMediaList.ListAddValue(MediaFromData(UTypes.VideoPre, tmpUrl, PostID, PostDate, _UserID, IsChannel), LNC)
                                                 _TotalPostsDownloaded += 1
                                             End If
+                                        ElseIf Not s.Value({"media", "reddit_video"}, "fallback_url").IsEmptyString Then
+                                            tmpUrl = s.Value({"media", "reddit_video"}, "fallback_url")
+                                            If SaveToCache Then
+                                                tmpUrl = s.Value("thumbnail")
+                                                If Not tmpUrl.IsEmptyString Then
+                                                    _TempMediaList.ListAddValue(MediaFromData(UTypes.Picture, tmpUrl, PostID, PostDate, _UserID, IsChannel), LNC)
+                                                    _TotalPostsDownloaded += 1
+                                                End If
+                                            Else
+                                                _TempMediaList.ListAddValue(MediaFromData(UTypes.VideoPre + UTypes.m3u8, tmpUrl, PostID, PostDate, _UserID, IsChannel), LNC)
+                                                _TotalPostsDownloaded += 1
+                                            End If
                                         ElseIf CreateImgurMedia(tmpUrl, PostID, PostDate, _UserID, IsChannel) Then
                                             _TotalPostsDownloaded += 1
                                         ElseIf s.Item("media_metadata").XmlIfNothing.Count > 0 Then
@@ -291,17 +334,8 @@ Namespace API.Reddit
                     If POST.IsEmptyString And ExistsDetected Then Exit Sub
                     If Not PostID.IsEmptyString And NewPostDetected Then DownloadDataChannel(PostID, Token)
                 End If
-            Catch oex As OperationCanceledException When Token.IsCancellationRequested
-            Catch dex As ObjectDisposedException When Disposed
             Catch ex As Exception
-                If ex.HelpLink = NonExistendUserHelp Then
-                    UserExists = False
-                ElseIf ex.HelpLink = SuspendedUserHelp Then
-                    UserSuspended = True
-                Else
-                    LogError(ex, $"channel data downloading error [{URL}]")
-                    HasError = True
-                End If
+                ProcessException(ex, Token, $"channel data downloading error [{URL}]")
             End Try
         End Sub
 #End Region
@@ -361,23 +395,31 @@ Namespace API.Reddit
                 End If
                 Return added
             Catch ex As Exception
-                LogError(ex, "gallery parsing error")
-                HasError = True
+                ProcessException(ex, Nothing, "gallery parsing error", False)
                 Return False
             End Try
         End Function
         Protected Overrides Sub ReparseVideo(ByVal Token As CancellationToken)
             Try
                 ThrowAny(Token)
-                If _TempMediaList.Count > 0 AndAlso _TempMediaList.Exists(Function(p) p.Type = UTypes.VideoPre) Then
+                Const v2 As UTypes = UTypes.VideoPre + UTypes.m3u8
+                If _TempMediaList.Count > 0 AndAlso _TempMediaList.Exists(Function(p) p.Type = UTypes.VideoPre Or p.Type = v2) Then
                     Dim r$, v$
                     Dim e As New ErrorsDescriber(EDP.ReturnValue)
                     Dim m As UserMedia
                     For i% = _TempMediaList.Count - 1 To 0 Step -1
                         ThrowAny(Token)
-                        If _TempMediaList(i).Type = UTypes.VideoPre Then
+                        If _TempMediaList(i).Type = UTypes.VideoPre Or _TempMediaList(i).Type = v2 Then
                             m = _TempMediaList(i)
-                            r = GetSiteResponse(m.URL, e)
+                            If _TempMediaList(i).Type = UTypes.VideoPre Then
+                                If m.URL.Contains("gfycat.com") Then
+                                    r = Gfycat.Envir.GetVideo(m.URL)
+                                Else
+                                    r = Responser.GetResponse(m.URL,, e)
+                                End If
+                            Else
+                                r = m.URL
+                            End If
                             _TempMediaList(i) = New UserMedia
                             If Not r.IsEmptyString Then
                                 v = RegexReplace(r, VideoRegEx)
@@ -390,21 +432,19 @@ Namespace API.Reddit
                         End If
                     Next
                 End If
-            Catch oex As OperationCanceledException When Token.IsCancellationRequested
-            Catch dex As ObjectDisposedException When Disposed
             Catch ex As Exception
-                LogError(ex, "video reparsing error")
+                ProcessException(ex, Token, "video reparsing error", False)
             End Try
         End Sub
-        Friend Shared Function GetVideoInfo(ByVal URL As String) As UserMedia
+        Friend Shared Function GetVideoInfo(ByVal URL As String, ByVal resp As Response) As IEnumerable(Of UserMedia)
             Try
                 If Not URL.IsEmptyString AndAlso URL.Contains("redgifs") Then
                     Using r As New UserData
                         r._TempMediaList.Add(MediaFromData(UTypes.VideoPre, URL, String.Empty, String.Empty,, False))
-                        r.Responser = New PersonalUtilities.Tools.WEB.Response
-                        r.Responser.Copy(Settings.Site(Sites.Reddit).Responser)
+                        r.Responser = New Response
+                        r.Responser.Copy(resp)
                         r.ReparseVideo(Nothing)
-                        If r._TempMediaList.ListExists Then Return r._TempMediaList(0)
+                        If r._TempMediaList.ListExists Then Return {r._TempMediaList(0)}
                     End Using
                 End If
                 Return Nothing
@@ -421,14 +461,14 @@ Namespace API.Reddit
             Dim m As New UserMedia(_URL, t) With {.Post = New UserPost With {.ID = PostID, .UserID = _UserID}}
             If t = UTypes.Picture Or t = UTypes.GIF Then m.File = UrlToFile(m.URL) Else m.File = Nothing
             If m.URL.Contains("preview") Then m.URL = $"https://i.redd.it/{m.File.File}"
-            If Not PostDate.IsEmptyString Then m.Post.Date = AConvert(Of Date)(PostDate, If(IsChannel, DateProviderChannel, DateProvider), Nothing) Else m.Post.Date = Nothing
+            If Not PostDate.IsEmptyString Then m.Post.Date = AConvert(Of Date)(PostDate, DateTrueProvider(IsChannel), Nothing) Else m.Post.Date = Nothing
             Return m
         End Function
         Private Function TryFile(ByVal URL As String) As Boolean
             Try
                 If Not URL.IsEmptyString AndAlso URL.StringContains({".jpg", ".png", ".jpeg"}) Then
                     Dim f As SFile = CStr(RegexReplace(URL, FilesPattern))
-                    Return Not f.IsEmptyString And Not f.File.IsEmptyString
+                    Return Not f.File.IsEmptyString
                 End If
                 Return False
             Catch ex As Exception
@@ -441,6 +481,8 @@ Namespace API.Reddit
 #End Region
         Protected Overrides Sub DownloadContent(ByVal Token As CancellationToken)
             Try
+                Const _RFN$ = "RedditVideo"
+                Const RFN$ = _RFN & "{0}"
                 Dim i%
                 Dim dCount% = 0, dTotal% = 0
                 ThrowAny(Token)
@@ -449,24 +491,38 @@ Namespace API.Reddit
                     If _ContentNew.Count > 0 Then
                         MyFile.Exists(SFO.Path)
                         Dim MyDir$
-                        If IsChannel And SaveToCache Then
+                        If Not IsSavedPosts AndAlso (IsChannel And SaveToCache And Not ChannelInfo Is Nothing) Then
                             MyDir = ChannelInfo.CachePath.PathNoSeparator
                         Else
                             MyDir = MyFile.CutPath.PathNoSeparator
                         End If
+                        Dim StartRFN% = 0
+                        If _ContentNew.Exists(Function(c) c.Type = UTypes.Video And c.URL.Contains("redd.it")) Then
+                            StartRFN = SFile.Indexed_GetMaxIndex($"{MyDir}\{IIf(SeparateVideoFolderF, "Video\", String.Empty)}{_RFN}.mp4",, New SFileNumbers(_RFN, String.Empty), EDP.ReturnValue)
+                        End If
                         Dim HashList As New List(Of String)
                         If _ContentList.Count > 0 Then HashList.ListAddList((From h In _ContentList Where Not h.MD5.IsEmptyString Select h.MD5), LNC)
                         Dim f As SFile
                         Dim v As UserMedia
                         Dim cached As Boolean = IsChannel And SaveToCache
                         Dim vsf As Boolean = SeparateVideoFolderF
-                        Dim ImgFormat As Imaging.ImageFormat
                         Dim UseMD5 As Boolean = Not IsChannel Or (Not cached And Settings.ChannelsRegularCheckMD5)
                         Dim bDP As New ErrorsDescriber(EDP.None)
+                        Dim ImgurUrls As New List(Of String)
+                        Dim TryBytes As Func(Of String, Imaging.ImageFormat, String) =
+                            Function(ByVal __URL As String, ByVal ImgFormat As Imaging.ImageFormat) As String
+                                Try
+                                    Return ByteArrayToString(GetMD5(SFile.GetBytesFromNet(__URL, bDP), ImgFormat))
+                                Catch hash_ex As Exception
+                                    Return String.Empty
+                                End Try
+                            End Function
                         Dim MD5BS As Func(Of String, UTypes,
                                              SFile, Boolean, String) = Function(ByVal __URL As String, ByVal __MT As UTypes,
                                                                                 ByVal __File As SFile, ByVal __IsBase As Boolean) As String
                                                                            Try
+                                                                               ImgurUrls.Clear()
+                                                                               Dim ImgFormat As Imaging.ImageFormat
                                                                                If __MT = UTypes.GIF Then
                                                                                    ImgFormat = Imaging.ImageFormat.Gif
                                                                                ElseIf __IsBase Then
@@ -474,7 +530,27 @@ Namespace API.Reddit
                                                                                Else
                                                                                    ImgFormat = GetImageFormat(__File)
                                                                                End If
-                                                                               Return ByteArrayToString(GetMD5(SFile.GetBytesFromNet(__URL, bDP), ImgFormat))
+
+                                                                               Dim tmpBytes$ = TryBytes(__URL, ImgFormat)
+                                                                               If tmpBytes.IsEmptyString And Not __MT = UTypes.GIF Then
+                                                                                   ImgFormat = Imaging.ImageFormat.Png
+                                                                                   tmpBytes = TryBytes(__URL, ImgFormat)
+                                                                                   If Not tmpBytes.IsEmptyString Then Return tmpBytes
+                                                                               Else
+                                                                                   Return tmpBytes
+                                                                               End If
+
+                                                                               If tmpBytes.IsEmptyString And Not __MT = UTypes.GIF And __URL.Contains("imgur.com") Then
+                                                                                   For c% = 0 To 1
+                                                                                       If c = 0 Then
+                                                                                           ImgurUrls.ListAddList(Imgur.Envir.GetGallery(__URL))
+                                                                                       Else
+                                                                                           ImgurUrls.ListAddValue(Imgur.Envir.GetImage(__URL))
+                                                                                       End If
+                                                                                       If ImgurUrls.Count > 0 Then Exit For
+                                                                                   Next
+                                                                               End If
+                                                                               Return tmpBytes
                                                                            Catch hash_ex As Exception
                                                                                Return String.Empty
                                                                            End Try
@@ -496,41 +572,61 @@ Namespace API.Reddit
                                 m = String.Empty
                                 If (v.Type = UTypes.Picture Or v.Type = UTypes.GIF) And UseMD5 Then
                                     m = MD5BS(v.URL, v.Type, f, False)
-                                    If m.IsEmptyString AndAlso Not v.URL_BASE.IsEmptyString AndAlso Not v.URL_BASE = v.URL Then
+                                    If ImgurUrls.Count = 0 AndAlso m.IsEmptyString AndAlso Not v.URL_BASE.IsEmptyString AndAlso Not v.URL_BASE = v.URL Then
                                         m = MD5BS(v.URL_BASE, v.Type, f, True)
                                         If Not m.IsEmptyString Then v.URL = v.URL_BASE
                                     End If
                                 End If
 
                                 If (Not m.IsEmptyString AndAlso Not HashList.Contains(m)) Or Not (v.Type = UTypes.Picture Or
-                                                                                                  v.Type = UTypes.GIF) Or Not UseMD5 Then
-                                    If Not cached Then HashList.Add(m)
-                                    v.MD5 = m
-                                    f.Path = MyDir
-                                    Try
-                                        If (v.Type = UTypes.Video Or v.Type = UTypes.m3u8) And vsf Then f.Path = $"{f.PathWithSeparator}Video"
-                                        If v.Type = UTypes.m3u8 Then
-                                            f = M3U8.Download(v.URL, f)
-                                        Else
-                                            w.DownloadFile(v.URL, f.ToString)
-                                        End If
-                                        If Not v.Type = UTypes.m3u8 Or Not f.IsEmptyString Then
-                                            Select Case v.Type
-                                                Case UTypes.Picture : DownloadedPictures += 1 : _CountPictures += 1
-                                                Case UTypes.Video, UTypes.m3u8 : DownloadedVideos += 1 : _CountVideo += 1
-                                            End Select
-                                            If Not IsChannel Or Not SaveToCache Then
-                                                v.File = ChangeFileNameByProvider(f, v)
-                                            Else
-                                                v.File = f
+                                                                                                  v.Type = UTypes.GIF) Or Not UseMD5 Or ImgurUrls.Count > 0 Then
+                                    Do
+                                        If Not cached And Not m.IsEmptyString Then HashList.Add(m)
+                                        v.MD5 = m
+                                        If ImgurUrls.Count > 0 Then
+                                            If ImgurUrls(0).IsEmptyString Then ImgurUrls.RemoveAt(0) : Continue Do
+                                            f = UrlToFile(ImgurUrls(0))
+                                            If f.Extension.IsEmptyString Then f.Extension = "gif"
+                                            If f.Name.IsEmptyString Then
+                                                f.Path = MyDir
+                                                f.Name = $"ImgurImg_{v.File.Name}"
+                                                f = SFile.Indexed_IndexFile(f,,, EDP.ReturnValue)
                                             End If
-                                            v.Post.CachedFile = f
-                                            v.State = UStates.Downloaded
-                                            dCount += 1
                                         End If
-                                    Catch wex As Exception
-                                        If Not IsChannel Then ErrorDownloading(f, v.URL)
-                                    End Try
+                                        f.Path = MyDir
+                                        Try
+                                            If (v.Type = UTypes.Video Or v.Type = UTypes.m3u8 Or (ImgurUrls.Count > 0 AndAlso f.Extension = "mp4")) And
+                                                vsf Then f.Path = $"{f.PathWithSeparator}Video"
+                                            If v.Type = UTypes.Video AndAlso v.URL.Contains("redd.it") Then
+                                                StartRFN += 1
+                                                f.Name = String.Format(RFN, StartRFN)
+                                            End If
+                                            If v.Type = UTypes.m3u8 Then
+                                                f = M3U8.Download(v.URL, f)
+                                            ElseIf ImgurUrls.Count > 0 Then
+                                                w.DownloadFile(ImgurUrls(0), f.ToString)
+                                            Else
+                                                w.DownloadFile(v.URL, f.ToString)
+                                            End If
+                                            If Not v.Type = UTypes.m3u8 Or Not f.IsEmptyString Then
+                                                Select Case v.Type
+                                                    Case UTypes.Picture : DownloadedPictures(False) += 1
+                                                    Case UTypes.Video, UTypes.m3u8 : DownloadedVideos(False) += 1
+                                                End Select
+                                                If Not IsChannel Or Not SaveToCache Then
+                                                    v.File = ChangeFileNameByProvider(f, v)
+                                                Else
+                                                    v.File = f
+                                                End If
+                                                v.Post.CachedFile = f
+                                                v.State = UStates.Downloaded
+                                                dCount += 1
+                                            End If
+                                        Catch wex As Exception
+                                            If Not IsChannel Then ErrorDownloading(f, v.URL)
+                                        End Try
+                                        If ImgurUrls.Count > 0 Then ImgurUrls.RemoveAt(0)
+                                    Loop While ImgurUrls.Count > 0
                                 Else
                                     v.State = UStates.Skipped
                                 End If
@@ -554,32 +650,23 @@ Namespace API.Reddit
                 HasError = True
             End Try
         End Sub
-        Protected Function GetSiteResponse(ByVal URL As String, Optional ByVal e As ErrorsDescriber = Nothing) As String
-            Try
-                Return Responser.GetResponse(URL,, EDP.ThrowException)
-            Catch ex As Exception
-                HasError = True
-                Dim OptText$ = String.Empty
-                If Not e.Exists Then
-                    Dim ee As EDP = EDP.SendInLog
-                    If Responser.StatusCode = HttpStatusCode.NotFound Then
-                        ee = EDP.ThrowException
-                        OptText = ": USER NOT FOUND"
-                        ex.HelpLink = NonExistendUserHelp
-                    ElseIf Responser.StatusCode = HttpStatusCode.Forbidden Then
-                        ee = EDP.ThrowException
-                        OptText = ": USER PROFILE SUSPENDED"
-                        ex.HelpLink = SuspendedUserHelp
-                    Else
-                        ee += EDP.ReturnValue
-                    End If
-                    e = New ErrorsDescriber(ee)
-                End If
-                Return ErrorsDescriber.Execute(e, ex, $"[{Site} - {Name}: GetSiteResponse([{URL}])]{OptText}", String.Empty)
-            End Try
+        Protected Overrides Function DownloadingException(ByVal ex As Exception, ByVal Message As String, Optional ByVal FromPE As Boolean = False) As Integer
+            If Responser.StatusCode = HttpStatusCode.NotFound Then
+                UserExists = False
+            ElseIf Responser.StatusCode = HttpStatusCode.Forbidden Then
+                UserSuspended = True
+            ElseIf Responser.StatusCode = HttpStatusCode.BadGateway Or
+                   Responser.StatusCode = HttpStatusCode.ServiceUnavailable Or
+                   Responser.StatusCode = HttpStatusCode.GatewayTimeout Then
+                MyMainLOG = "Reddit is currently unavailable"
+            Else
+                If Not FromPE Then LogError(ex, Message) : HasError = True
+                Return 0
+            End If
+            Return 1
         End Function
         Protected Overrides Sub Dispose(ByVal disposing As Boolean)
-            If Not disposedValue And disposing Then ChannelPostsNames.Clear() : _ExistsUsersNames.Clear()
+            If Not disposedValue And disposing Then ChannelPostsNames.Clear() : _ExistsUsersNames.Clear() : _CrossPosts.Clear()
             MyBase.Dispose(disposing)
         End Sub
     End Class

SCrawler/API/Redgifs/Declarations.vb

@@ -0,0 +1,23 @@
+' Copyright (C) 2022  Andy
+' This program is free software: you can redistribute it and/or modify
+' it under the terms of the GNU General Public License as published by
+' the Free Software Foundation, either version 3 of the License, or
+' (at your option) any later version.
+'
+' This program is distributed in the hope that it will be useful,
+' but WITHOUT ANY WARRANTY
+Namespace API.RedGifs
+    Friend Module Declarations
+        Friend Const RedGifsSite As String = "RedGifs"
+        Friend ReadOnly DateProvider As New JsonDate
+        Friend Class JsonDate : Implements ICustomProvider
+            Friend Function Convert(ByVal Value As Object, ByVal DestinationType As Type, ByVal Provider As IFormatProvider,
+                                    Optional ByVal NothingArg As Object = Nothing, Optional ByVal e As ErrorsDescriber = Nothing) As Object Implements ICustomProvider.Convert
+                Return ADateTime.ParseUnicode(Value, NothingArg, e)
+            End Function
+            Private Function GetFormat(ByVal FormatType As Type) As Object Implements IFormatProvider.GetFormat
+                Throw New NotImplementedException("GetFormat is not available in this context")
+            End Function
+        End Class
+    End Module
+End Namespace

SCrawler/API/Redgifs/SiteSettings.vb

@@ -0,0 +1,29 @@
+' Copyright (C) 2022  Andy
+' This program is free software: you can redistribute it and/or modify
+' it under the terms of the GNU General Public License as published by
+' the Free Software Foundation, either version 3 of the License, or
+' (at your option) any later version.
+'
+' This program is distributed in the hope that it will be useful,
+' but WITHOUT ANY WARRANTY
+Imports SCrawler.Plugin
+Imports SCrawler.Plugin.Attributes
+Imports SCrawler.API.Base
+Imports PersonalUtilities.Functions.RegularExpressions
+Namespace API.RedGifs
+    <Manifest("AndyProgram_RedGifs"), UseClassAsIs>
+    Friend Class SiteSettings : Inherits SiteSettingsBase
+        Friend Sub New()
+            MyBase.New(RedGifsSite, "redgifs.com")
+            UrlPatternUser = "https://www.redgifs.com/users/{0}/"
+            UserRegex = RParams.DMS("[htps:/]{7,8}.*?redgifs.com/users/([^/]+)", 1)
+            ImageVideoContains = "redgifs"
+        End Sub
+        Friend Overrides Function GetInstance(ByVal What As ISiteSettings.Download) As IPluginContentProvider
+            Return New UserData
+        End Function
+        Friend Overrides Function GetSpecialDataF(ByVal URL As String) As IEnumerable(Of UserMedia)
+            Return Reddit.UserData.GetVideoInfo(URL, Nothing)
+        End Function
+    End Class
+End Namespace

SCrawler/API/Redgifs/UserData.vb

@@ -0,0 +1,89 @@
+' Copyright (C) 2022  Andy
+' This program is free software: you can redistribute it and/or modify
+' it under the terms of the GNU General Public License as published by
+' the Free Software Foundation, either version 3 of the License, or
+' (at your option) any later version.
+'
+' This program is distributed in the hope that it will be useful,
+' but WITHOUT ANY WARRANTY
+Imports PersonalUtilities.Functions.XML
+Imports PersonalUtilities.Functions.RegularExpressions
+Imports PersonalUtilities.Tools.WebDocuments.JSON
+Imports System.Threading
+Imports System.Net
+Imports SCrawler.API.Base
+Imports UTypes = SCrawler.API.Base.UserMedia.Types
+Namespace API.RedGifs
+    Friend Class UserData : Inherits UserDataBase
+        Friend Sub New()
+        End Sub
+        Protected Overrides Sub LoadUserInformation_OptionalFields(ByRef Container As XmlFile, ByVal Loading As Boolean)
+        End Sub
+        Protected Overrides Sub DownloadDataF(ByVal Token As CancellationToken)
+            DownloadData(1, Token)
+        End Sub
+        Private Overloads Sub DownloadData(ByVal Page As Integer, ByVal Token As CancellationToken)
+            Dim URL$ = String.Empty
+            Try
+                URL = $"https://api.redgifs.com/v2/users/{Name}/search?order=recent&page={Page}"
+                Dim r$ = Responser.GetResponse(URL,, EDP.ThrowException)
+                Dim postDate$, postID$
+                Dim pTotal% = 0
+                Dim u$
+                Dim ut As UTypes
+                If Not r.IsEmptyString Then
+                    Using j As EContainer = JsonDocument.Parse(r).XmlIfNothing
+                        If j.Contains("gifs") Then
+                            pTotal = j.Value("pages").FromXML(Of Integer)(0)
+                            For Each g As EContainer In j("gifs")
+                                postDate = g.Value("createDate")
+                                If Not CheckDatesLimit(postDate, DateProvider) Then Exit Sub
+                                postID = g.Value("id")
+                                If Not _TempPostsList.Contains(postID) Then _TempPostsList.Add(postID) Else Exit For
+                                With g("urls")
+                                    If .ListExists Then
+                                        u = If(.Item("hd"), .Item("sd")).XmlIfNothingValue
+                                        If Not u.IsEmptyString Then
+                                            ut = UTypes.Undefined
+                                            'Type 1: video
+                                            'Type 2: image
+                                            Select Case g.Value("type").FromXML(Of Integer)(0)
+                                                Case 1 : ut = UTypes.Video
+                                                Case 2 : ut = UTypes.Picture
+                                            End Select
+                                            If Not ut = UTypes.Undefined Then _TempMediaList.ListAddValue(MediaFromData(ut, u, postID, postDate))
+                                        End If
+                                    End If
+                                End With
+                            Next
+                        End If
+                    End Using
+                End If
+                If pTotal > 0 And Page < pTotal Then DownloadData(Page + 1, Token)
+            Catch ex As Exception
+                ProcessException(ex, Token, $"data downloading error [{URL}]")
+            End Try
+        End Sub
+        Protected Overrides Sub ReparseVideo(ByVal Token As CancellationToken)
+        End Sub
+        Protected Overrides Sub DownloadContent(ByVal Token As CancellationToken)
+            DownloadContentDefault(Token)
+        End Sub
+        Private Shared Function MediaFromData(ByVal t As UTypes, ByVal _URL As String, ByVal PostID As String, ByVal PostDate As String) As UserMedia
+            _URL = LinkFormatterSecure(RegexReplace(_URL.Replace("\", String.Empty), LinkPattern))
+            Dim m As New UserMedia(_URL, t) With {.Post = New UserPost With {.ID = PostID}}
+            If Not m.URL.IsEmptyString Then m.File = CStr(RegexReplace(m.URL, FilesPattern)) : m.URL_BASE = m.URL
+            If Not PostDate.IsEmptyString Then m.Post.Date = AConvert(Of Date)(PostDate, DateProvider, Nothing) Else m.Post.Date = Nothing
+            Return m
+        End Function
+        Protected Overrides Function DownloadingException(ByVal ex As Exception, ByVal Message As String, Optional ByVal FromPE As Boolean = False) As Integer
+            If Responser.StatusCode = HttpStatusCode.NotFound Then
+                UserExists = False
+            Else
+                If Not FromPE Then LogError(ex, Message) : HasError = True
+                Return 0
+            End If
+            Return 1
+        End Function
+    End Class
+End Namespace

SCrawler/API/Twitter/Declarations.vb

@@ -7,11 +7,13 @@
 ' This program is distributed in the hope that it will be useful,
 ' but WITHOUT ANY WARRANTY
 Imports PersonalUtilities.Functions.XML.Base
+Imports PersonalUtilities.Functions.RegularExpressions
 Namespace API.Twitter
     Friend Module Declarations
+        Friend Const TwitterSite As String = "Twitter"
         Friend DateProvider As New ADateTime(ADateTime.Formats.BaseDateTime)
         Friend ReadOnly VideoNode As NodeParams() = {New NodeParams("video_info", True, True, True, True, 10)}
-        Friend ReadOnly VideoSizeRegEx As New RegexStructure("\d+x(\d+)",,,, 1,,, String.Empty, EDP.ReturnValue)
-        Friend ReadOnly UserIdRegEx As New RegexStructure("user_id.:.(\d+)",,,, 1,,, String.Empty, EDP.ReturnValue)
+        Friend ReadOnly VideoSizeRegEx As RParams = RParams.DMS("\d+x(\d+)", 1, EDP.ReturnValue)
+        Friend ReadOnly UserIdRegEx As RParams = RParams.DMS("user_id.:.(\d+)", 1, EDP.ReturnValue)
     End Module
 End Namespace

SCrawler/API/Twitter/SiteSettings.vb

@@ -0,0 +1,99 @@
+' Copyright (C) 2022  Andy
+' This program is free software: you can redistribute it and/or modify
+' it under the terms of the GNU General Public License as published by
+' the Free Software Foundation, either version 3 of the License, or
+' (at your option) any later version.
+'
+' This program is distributed in the hope that it will be useful,
+' but WITHOUT ANY WARRANTY
+Imports SCrawler.Plugin
+Imports SCrawler.Plugin.Attributes
+Imports PersonalUtilities.Tools
+Imports PersonalUtilities.Functions.RegularExpressions
+Imports SCrawler.API.Base
+Namespace API.Twitter
+    <Manifest("AndyProgram_Twitter"), UseClassAsIs>
+    Friend Class SiteSettings : Inherits SiteSettingsBase
+        Friend Const Header_Authorization As String = "authorization"
+        Friend Const Header_Token As String = "x-csrf-token"
+        Friend Overrides ReadOnly Property Icon As Icon
+            Get
+                Return My.Resources.TwitterIcon
+            End Get
+        End Property
+        Friend Overrides ReadOnly Property Image As Image
+            Get
+                Return My.Resources.TwitterPic400
+            End Get
+        End Property
+        <PropertyOption(AllowNull:=False, ControlText:="Authorization",
+                        ControlToolTip:="Set authorization from [authorization] response header. This field must start from [Bearer] key word")>
+        Private ReadOnly Property Auth As PropertyValue
+        <PropertyOption(AllowNull:=False, ControlText:="Token", ControlToolTip:="Set token from [x-csrf-token] response header")>
+        Private ReadOnly Property Token As PropertyValue
+        Friend Overrides ReadOnly Property Responser As WEB.Response
+        Friend Sub New()
+            MyBase.New(TwitterSite)
+            Responser = New WEB.Response($"{SettingsFolderName}\Responser_{Site}.xml")
+
+            Dim a$ = String.Empty
+            Dim t$ = String.Empty
+
+            With Responser
+                If .File.Exists Then
+                    .LoadSettings()
+                    With .Headers
+                        If .ContainsKey(Header_Authorization) Then a = .Item(Header_Authorization)
+                        If .ContainsKey(Header_Token) Then t = .Item(Header_Token)
+                    End With
+                Else
+                    .ContentType = "application/json"
+                    .Accept = "*/*"
+                    .CookiesDomain = "twitter.com"
+                    .Decoders.Add(SymbolsConverter.Converters.Unicode)
+                    With .Headers
+                        .Add("sec-ch-ua", " Not;A Brand" & Chr(34) & ";v=" & Chr(34) & "99" & Chr(34) & ", " & Chr(34) &
+                             "Google Chrome" & Chr(34) & ";v=" & Chr(34) & "91" & Chr(34) & ", " & Chr(34) & "Chromium" &
+                             Chr(34) & ";v=" & Chr(34) & "91" & Chr(34))
+                        .Add("sec-ch-ua-mobile", "?0")
+                        .Add("sec-fetch-dest", "empty")
+                        .Add("sec-fetch-mode", "cors")
+                        .Add("sec-fetch-site", "same-origin")
+                        .Add(Header_Token, String.Empty)
+                        .Add("x-twitter-active-user", "yes")
+                        .Add("x-twitter-auth-type", "OAuth2Session")
+                        .Add(Header_Authorization, String.Empty)
+                    End With
+                    .SaveSettings()
+                End If
+            End With
+
+            Auth = New PropertyValue(a, GetType(String), Sub(v) ChangeResponserFields(NameOf(Auth), v))
+            Token = New PropertyValue(t, GetType(String), Sub(v) ChangeResponserFields(NameOf(Token), v))
+
+            UserRegex = RParams.DMS("[htps:/]{7,8}.*?twitter.com/([^/]+)", 1)
+            UrlPatternUser = "https://twitter.com/{0}"
+            ImageVideoContains = "twitter"
+        End Sub
+        Private Sub ChangeResponserFields(ByVal PropName As String, ByVal Value As Object)
+            If Not PropName.IsEmptyString Then
+                Dim f$ = String.Empty
+                Select Case PropName
+                    Case NameOf(Auth) : f = Header_Authorization
+                    Case NameOf(Token) : f = Header_Token
+                End Select
+                If Not f.IsEmptyString Then
+                    If Responser.Headers.Count > 0 AndAlso Responser.Headers.ContainsKey(f) Then Responser.Headers.Remove(f)
+                    If Not CStr(Value).IsEmptyString Then Responser.Headers.Add(f, CStr(Value))
+                    Responser.SaveSettings()
+                End If
+            End If
+        End Sub
+        Friend Overrides Function GetInstance(ByVal What As ISiteSettings.Download) As IPluginContentProvider
+            Return New UserData
+        End Function
+        Friend Overrides Function GetSpecialDataF(ByVal URL As String) As IEnumerable(Of UserMedia)
+            Return UserData.GetVideoInfo(URL, Responser)
+        End Function
+    End Class
+End Namespace

SCrawler/API/Twitter/UserData.vb

@@ -9,54 +9,32 @@
 Imports PersonalUtilities.Tools.WEB
 Imports PersonalUtilities.Tools.WebDocuments.JSON
 Imports PersonalUtilities.Functions.XML
+Imports PersonalUtilities.Functions.RegularExpressions
 Imports System.Net
 Imports System.Threading
 Imports SCrawler.API.Base
-Imports UStates = SCrawler.API.Base.UserMedia.States
 Namespace API.Twitter
     Friend Class UserData : Inherits UserDataBase
 #Region "Declarations"
-        Friend Overrides Property Site As Sites = Sites.Twitter
-        Private Structure Sizes : Implements IComparable(Of Sizes)
-            Friend Value As Integer
-            Friend Name As String
-            Friend ReadOnly HasError As Boolean
-            Friend Sub New(ByVal _Value As String, ByVal _Name As String)
-                Try
-                    Value = _Value
-                    Name = _Name
-                Catch ex As Exception
-                    HasError = True
-                End Try
-            End Sub
-            Friend Function CompareTo(ByVal Other As Sizes) As Integer Implements IComparable(Of Sizes).CompareTo
-                Return Value.CompareTo(Other.Value) * -1
-            End Function
-            Friend Shared Function Reparse(ByRef Current As Sizes, ByVal Other As Sizes, ByVal LargeContained As Boolean) As Sizes
-                If LargeContained And Current.Name.IsEmptyString And Current.Value > Other.Value Then Current.Name = "large"
-                Return Current
-            End Function
-            Friend Shared Function ApplyLarge(ByRef s As Sizes) As Sizes
-                s.Name = "large"
-                Return s
-            End Function
-        End Structure
+        Private ReadOnly _DataNames As List(Of String)
 #End Region
 #Region "Initializer"
-        Friend Sub New(ByVal u As UserInfo, Optional ByVal _LoadUserInformation As Boolean = True)
-            User = u
-            If _LoadUserInformation Then LoadUserInformation()
+        Friend Sub New()
+            _DataNames = New List(Of String)
         End Sub
 #End Region
+        Protected Overrides Sub LoadUserInformation_OptionalFields(ByRef Container As XmlFile, ByVal Loading As Boolean)
+        End Sub
 #Region "Download functions"
         Protected Overrides Sub DownloadDataF(ByVal Token As CancellationToken)
+            If _ContentList.Count > 0 Then _DataNames.ListAddList(_ContentList.Select(Function(c) c.File.File), LAP.ClearBeforeAdd, LAP.NotContainsOnly)
             DownloadData(String.Empty, Token)
         End Sub
         Private Overloads Sub DownloadData(ByVal POST As String, ByVal Token As CancellationToken)
             Dim URL$ = String.Empty
             Try
                 Dim PostID$ = String.Empty
-                Dim PostDate$
+                Dim PostDate$, dName$
                 Dim m As EContainer, nn As EContainer, s As EContainer
                 Dim NewPostDetected As Boolean = False
                 Dim ExistsDetected As Boolean = False
@@ -81,9 +59,12 @@ Namespace API.Twitter
                                         If Not ID.IsEmptyString Then UpdateUserInformation()
                                     End If
 
+                                    If UserDescriptionNeedToUpdate() AndAlso nn.Value({"user"}, "screen_name") = Name Then UserDescriptionUpdate(nn.Value({"user"}, "description"))
+
                                     'Date Pattern:
                                     'Sat Jan 01 01:10:15 +0000 2000
                                     If nn.Contains("created_at") Then PostDate = nn("created_at").Value Else PostDate = String.Empty
+                                    If Not CheckDatesLimit(PostDate, Declarations.DateProvider) Then Exit Sub
 
                                     If Not _TempPostsList.Contains(PostID) Then
                                         NewPostDetected = True
@@ -101,8 +82,12 @@ Namespace API.Twitter
                                             If Not s Is Nothing AndAlso s.Count > 0 Then
                                                 For Each m In s
                                                     If m.Count > 0 AndAlso m.Contains("media_url") Then
-                                                        _TempMediaList.ListAddValue(MediaFromData(m("media_url").Value,
-                                                                                                  PostID, PostDate, GetPictureOption(m)), LNC)
+                                                        dName = UrlFile(m("media_url").Value)
+                                                        If Not dName.IsEmptyString AndAlso Not _DataNames.Contains(dName) Then
+                                                            _DataNames.Add(dName)
+                                                            _TempMediaList.ListAddValue(MediaFromData(m("media_url").Value,
+                                                                                                      PostID, PostDate, GetPictureOption(m)), LNC)
+                                                        End If
                                                     End If
                                                 Next
                                             End If
@@ -115,33 +100,22 @@ Namespace API.Twitter
                     If POST.IsEmptyString And ExistsDetected Then Exit Sub
                     If Not PostID.IsEmptyString And NewPostDetected Then DownloadData(PostID, Token)
                 End If
-            Catch oex As OperationCanceledException When Token.IsCancellationRequested
-            Catch dex As ObjectDisposedException When Disposed
             Catch ex As Exception
-                If Responser.StatusCode = HttpStatusCode.NotFound Then
-                    UserExists = False
-                ElseIf Responser.StatusCode = HttpStatusCode.Unauthorized Then
-                    UserSuspended = True
-                ElseIf Responser.StatusCode = HttpStatusCode.BadRequest Then
-                    MyMainLOG = "Twitter has invalid credentials"
-                Else
-                    LogError(ex, $"data downloading error [{URL}]")
-                    HasError = True
-                End If
+                ProcessException(ex, Token, $"data downloading error [{URL}]")
             End Try
         End Sub
-        Friend Shared Function GetVideoInfo(ByVal URL As String) As UserMedia
+        Friend Shared Function GetVideoInfo(ByVal URL As String, ByVal resp As Response) As IEnumerable(Of UserMedia)
             Try
                 If URL.Contains("twitter") Then
-                    Dim PostID$ = RegexReplace(URL, New RegexStructure("(?<=/)\d+", True, False,,,,, String.Empty))
+                    Dim PostID$ = RegexReplace(URL, RParams.DM("(?<=/)\d+", 0))
                     If Not PostID.IsEmptyString Then
-                        Dim r$ = DirectCast(Settings.Site(Sites.Twitter).Responser.Copy(), Response).
+                        Dim r$ = DirectCast(resp.Copy(), Response).
                                             GetResponse($"https://api.twitter.com/1.1/statuses/show.json?id={PostID}",, EDP.ReturnValue)
                         If Not r.IsEmptyString Then
                             Using j As EContainer = JsonDocument.Parse(r)
                                 If j.ListExists Then
                                     Dim u$ = GetVideoNodeURL(j)
-                                    If Not u.IsEmptyString Then Return MediaFromData(u, PostID, String.Empty)
+                                    If Not u.IsEmptyString Then Return {MediaFromData(u, PostID, String.Empty)}
                                 End If
                             End Using
                         End If
@@ -164,12 +138,12 @@ Namespace API.Twitter
                     Next
                     If l.Count > 0 Then
                         l.Sort()
-                        If l(0).Name.IsEmptyString And LargeContained Then Return "large" Else Return l(0).Name
+                        If l(0).Data.IsEmptyString And LargeContained Then Return "large" Else Return l(0).Data
                     End If
                 End If
                 Return String.Empty
             Catch ex As Exception
-                LogError(ex, "[GetPictureOption]")
+                LogError(ex, "[API.Twitter.UserData.GetPictureOption]")
                 Return String.Empty
             End Try
         End Function
@@ -178,10 +152,17 @@ Namespace API.Twitter
         Private Function CheckVideoNode(ByVal w As EContainer, ByVal PostID As String, ByVal PostDate As String) As Boolean
             Try
                 Dim URL$ = GetVideoNodeURL(w)
-                If Not URL.IsEmptyString Then _TempMediaList.ListAddValue(MediaFromData(URL, PostID, PostDate), LNC) : Return True
+                If Not URL.IsEmptyString Then
+                    Dim f$ = UrlFile(URL)
+                    If Not f.IsEmptyString AndAlso Not _DataNames.Contains(f) Then
+                        _DataNames.Add(f)
+                        _TempMediaList.ListAddValue(MediaFromData(URL, PostID, PostDate), LNC)
+                    End If
+                    Return True
+                End If
                 Return False
             Catch ex As Exception
-                LogError(ex, "[CheckVideoNode]")
+                LogError(ex, "[API.Twitter.UserData.CheckVideoNode]")
                 Return False
             End Try
         End Function
@@ -202,12 +183,20 @@ Namespace API.Twitter
                     End If
                 Next
                 If l.Count > 0 Then l.RemoveAll(Function(s) s.HasError)
-                If l.Count > 0 Then l.Sort() : Return l(0).Name
+                If l.Count > 0 Then l.Sort() : Return l(0).Data
             End If
             Return String.Empty
         End Function
         Protected Overrides Sub ReparseVideo(ByVal Token As CancellationToken)
         End Sub
+        Private Function UrlFile(ByVal URL As String) As String
+            Try
+                Dim f As SFile = CStr(RegexReplace(LinkFormatterSecure(RegexReplace(URL.Replace("\", String.Empty), LinkPattern)), FilesPattern))
+                If Not f.IsEmptyString Then Return f.File Else Return String.Empty
+            Catch ex As Exception
+                Return String.Empty
+            End Try
+        End Function
 #End Region
         Private Shared Function MediaFromData(ByVal _URL As String, ByVal PostID As String, ByVal PostDate As String,
                                               Optional ByVal _PictureOption As String = "") As UserMedia
@@ -222,62 +211,24 @@ Namespace API.Twitter
         End Function
 #End Region
         Protected Overrides Sub DownloadContent(ByVal Token As CancellationToken)
-            Try
-                Dim i%
-                ThrowAny(Token)
-                If _ContentNew.Count > 0 Then
-                    _ContentNew.RemoveAll(Function(c) c.URL.IsEmptyString)
-                    If _ContentNew.Count > 0 Then
-                        MyFile.Exists(SFO.Path)
-                        Dim MyDir$ = MyFile.CutPath.Path
-                        Dim vsf As Boolean = SeparateVideoFolderF
-                        Dim f As SFile
-                        Dim v As UserMedia
-                        Using w As New WebClient
-                            If vsf Then SFileShares.SFileExists($"{MyDir}\Video\", SFO.Path)
-                            MainProgress.TotalCount += _ContentNew.Count
-                            For i = 0 To _ContentNew.Count - 1
-                                ThrowAny(Token)
-                                v = _ContentNew(i)
-                                v.State = UStates.Tried
-                                If v.File.IsEmptyString Then
-                                    f = v.URL
-                                Else
-                                    f = v.File
-                                End If
-                                f.Separator = "\"
-                                f.Path = MyDir
-
-                                If v.URL_BASE.IsEmptyString Then v.URL_BASE = v.URL
-
-                                If Not v.File.IsEmptyString AndAlso Not v.URL_BASE.IsEmptyString Then
-                                    Try
-                                        If f.Extension = "mp4" And vsf Then f.Path = $"{f.PathWithSeparator}Video"
-                                        w.DownloadFile(v.URL_BASE, f.ToString)
-                                        Select Case f.Extension
-                                            Case "mp4" : v.Type = UserMedia.Types.Video : DownloadedVideos += 1 : _CountVideo += 1
-                                            Case Else : v.Type = UserMedia.Types.Picture : DownloadedPictures += 1 : _CountPictures += 1
-                                        End Select
-                                        v.File = ChangeFileNameByProvider(f, v)
-                                        v.State = UStates.Downloaded
-                                    Catch wex As Exception
-                                        ErrorDownloading(f, v.URL_BASE)
-                                    End Try
-                                Else
-                                    v.State = UStates.Skipped
-                                End If
-                                _ContentNew(i) = v
-                                MainProgress.Perform()
-                            Next
-                        End Using
-                    End If
-                End If
-            Catch oex As OperationCanceledException When Token.IsCancellationRequested
-            Catch dex As ObjectDisposedException When Disposed
-            Catch ex As Exception
-                LogError(ex, "content downloading error")
-                HasError = True
-            End Try
+            DownloadContentDefault(Token)
+        End Sub
+        Protected Overrides Function DownloadingException(ByVal ex As Exception, ByVal Message As String, Optional ByVal FromPE As Boolean = False) As Integer
+            If Responser.StatusCode = HttpStatusCode.NotFound Then
+                UserExists = False
+            ElseIf Responser.StatusCode = HttpStatusCode.Unauthorized Then
+                UserSuspended = True
+            ElseIf Responser.StatusCode = HttpStatusCode.BadRequest Then
+                MyMainLOG = "Twitter has invalid credentials"
+            Else
+                If Not FromPE Then LogError(ex, Message) : HasError = True
+                Return 0
+            End If
+            Return 1
+        End Function
+        Protected Overrides Sub Dispose(ByVal disposing As Boolean)
+            If Not disposedValue And disposing Then _DataNames.Clear()
+            MyBase.Dispose(disposing)
         End Sub
     End Class
 End Namespace

SCrawler/API/UserDataBind.vb

@@ -7,13 +7,15 @@
 ' This program is distributed in the hope that it will be useful,
 ' but WITHOUT ANY WARRANTY
 Imports PersonalUtilities.Tools
+Imports PersonalUtilities.Functions.XML
+Imports PersonalUtilities.Functions.Messaging
 Imports System.Threading
 Imports SCrawler.API.Base
 Namespace API
     Friend Class UserDataBind : Inherits UserDataBase : Implements ICollection(Of IUserData), IMyEnumerator(Of IUserData)
-        Friend Event OnCollectionSelfRemoved()
+        Friend Event OnCollectionSelfRemoved(ByVal Collection As IUserData)
+        Friend Event OnUserRemoved(ByVal User As IUserData)
 #Region "Declarations"
-        Friend Overrides Property Site As Sites = Sites.Undefined
         Friend ReadOnly Property Collections As List(Of IUserData)
         Private _CollectionName As String = String.Empty
         Friend Overrides Property CollectionName As String
@@ -120,7 +122,7 @@ Namespace API
         Friend Overrides Property DataMerging As Boolean
             Get
                 If Count > 0 Then
-                    Return DirectCast(Collections(0).Self, UserDataBase).DataMerging
+                    Return DirectCast(Collections(0), UserDataBase).DataMerging
                 Else
                     Return False
                 End If
@@ -183,15 +185,15 @@ Namespace API
         End Property
         Friend Overrides Function GetUserInformation() As String
             Dim OutStr$ = String.Empty
-            If Count > 0 Then Collections.ForEach(Sub(c) OutStr.StringAppendLine(DirectCast(c.Self, UserDataBase).GetUserInformation(), $"{vbCrLf}{vbCrLf}"))
+            If Count > 0 Then Collections.ForEach(Sub(c) OutStr.StringAppendLine(DirectCast(c, UserDataBase).GetUserInformation(), $"{vbCrLf}{vbCrLf}"))
             Return OutStr
         End Function
         Friend Overrides Property LastUpdated As Date?
             Get
                 If Count > 0 Then
-                    With If((From c In Collections
-                             Where DirectCast(c.Self, UserDataBase).LastUpdated.HasValue
-                             Select DirectCast(c.Self, UserDataBase).LastUpdated.Value).ToList, New List(Of Date))
+                    With If((From c As IUserData In Collections
+                             Where DirectCast(c, UserDataBase).LastUpdated.HasValue
+                             Select DirectCast(c, UserDataBase).LastUpdated.Value).ToList, New List(Of Date))
                         If .Count > 0 Then Return .Max
                     End With
                 End If
@@ -209,7 +211,7 @@ Namespace API
         Friend ReadOnly Property ContextDown As ToolStripMenuItem()
             Get
                 If Count > 0 Then
-                    Return Collections.Select(Function(c) DirectCast(c.Self, UserDataBase).BTT_CONTEXT_DOWN).ToArray
+                    Return Collections.Select(Function(c) DirectCast(c, UserDataBase).BTT_CONTEXT_DOWN).ToArray
                 Else
                     Return New ToolStripMenuItem() {}
                 End If
@@ -218,7 +220,7 @@ Namespace API
         Friend ReadOnly Property ContextEdit As ToolStripMenuItem()
             Get
                 If Count > 0 Then
-                    Return Collections.Select(Function(c) DirectCast(c.Self, UserDataBase).BTT_CONTEXT_EDIT).ToArray
+                    Return Collections.Select(Function(c) DirectCast(c, UserDataBase).BTT_CONTEXT_EDIT).ToArray
                 Else
                     Return New ToolStripMenuItem() {}
                 End If
@@ -227,7 +229,7 @@ Namespace API
         Friend ReadOnly Property ContextDelete As ToolStripMenuItem()
             Get
                 If Count > 0 Then
-                    Return Collections.Select(Function(c) DirectCast(c.Self, UserDataBase).BTT_CONTEXT_DELETE).ToArray
+                    Return Collections.Select(Function(c) DirectCast(c, UserDataBase).BTT_CONTEXT_DELETE).ToArray
                 Else
                     Return New ToolStripMenuItem() {}
                 End If
@@ -236,7 +238,7 @@ Namespace API
         Friend ReadOnly Property ContextPath As ToolStripMenuItem()
             Get
                 If Count > 0 Then
-                    Return Collections.Select(Function(c) DirectCast(c.Self, UserDataBase).BTT_CONTEXT_OPEN_PATH).ToArray
+                    Return Collections.Select(Function(c) DirectCast(c, UserDataBase).BTT_CONTEXT_OPEN_PATH).ToArray
                 Else
                     Return New ToolStripMenuItem() {}
                 End If
@@ -245,7 +247,7 @@ Namespace API
         Friend ReadOnly Property ContextSite As ToolStripMenuItem()
             Get
                 If Count > 0 Then
-                    Return Collections.Select(Function(c) DirectCast(c.Self, UserDataBase).BTT_CONTEXT_OPEN_SITE).ToArray
+                    Return Collections.Select(Function(c) DirectCast(c, UserDataBase).BTT_CONTEXT_OPEN_SITE).ToArray
                 Else
                     Return New ToolStripMenuItem() {}
                 End If
@@ -269,7 +271,9 @@ Namespace API
             If Count > 0 Then Collections.ForEach(Sub(c) c.UpdateUserInformation())
         End Sub
         Friend Overrides Sub LoadContentInformation()
-            If Count > 0 Then Collections.ForEach(Sub(c) DirectCast(c.Self, UserDataBase).LoadContentInformation())
+            If Count > 0 Then Collections.ForEach(Sub(c) DirectCast(c, UserDataBase).LoadContentInformation())
+        End Sub
+        Protected Overrides Sub LoadUserInformation_OptionalFields(ByRef Container As XmlFile, ByVal Loading As Boolean)
         End Sub
         Friend Overrides Property DownloadTopCount As Integer?
             Get
@@ -292,15 +296,19 @@ Namespace API
         End Sub
         Protected Overrides Sub DownloadContent(ByVal Token As CancellationToken)
         End Sub
+        Protected Overrides Function DownloadingException(ByVal ex As Exception, ByVal Message As String, Optional ByVal FromPE As Boolean = False) As Integer
+            Return 0
+        End Function
         Private Sub User_OnUserUpdated(ByVal User As IUserData)
-            Raise_OnUserUpdated()
+            RaiseEvent_OnUserUpdated()
         End Sub
-        Friend Overrides Sub OpenSite()
-            If Count > 0 Then Collections(0).OpenSite()
+        Friend Overrides Sub OpenSite(Optional ByVal e As ErrorsDescriber = Nothing)
+            If Not e.Exists Then e = New ErrorsDescriber(EDP.SendInLog)
+            If Count > 0 Then Collections.ForEach(Sub(c) c.OpenSite(e))
         End Sub
         Friend Overrides Sub OpenFolder()
             Try
-                If Count > 0 Then Collections(0).File.CutPath(2).Open(SFO.Path, EDP.None)
+                If Count > 0 Then GlobalOpenPath(Collections(0).File.CutPath(2))
             Catch ex As Exception
             End Try
         End Sub
@@ -322,32 +330,56 @@ Namespace API
                     If DataMerging Then DirectCast(.Self, UserDataBase).MergeData()
                     Collections.Add(_Item)
                     With Collections.Last
-                        If Collections.Count - 1 > 0 Then
+                        If Count > 1 Then
+                            If _CollectionName.IsEmptyString Then _CollectionName = .CollectionName
                             .Temporary = Temporary
                             .Favorite = Favorite
+                            .ReadyForDownload = ReadyForDownload
+                            ConsolidateLabels()
                             .UpdateUserInformation()
                         End If
                         ImageHandler(_Item, False)
+                        AddRemoveBttDeleteHandler(.Self, True)
                         AddHandler .Self.OnUserUpdated, AddressOf User_OnUserUpdated
-                        DirectCast(.Self, UserDataBase).CreateButtons(Count - 1)
                     End With
                 Else
-                    Throw New InvalidOperationException("User data doe not move to the collection folder")
+                    Throw New InvalidOperationException("User data was not moved to the collection folder")
                 End If
             End With
         End Sub
         ''' <summary>FOR SETTINGS START LOADING ONLY</summary>
         Friend Overloads Sub Add(ByVal u As UserInfo, Optional ByVal _LoadData As Boolean = True)
-            Select Case u.Site
-                Case Sites.Reddit : Collections.Add(New Reddit.UserData(u, _LoadData))
-                Case Sites.Twitter : Collections.Add(New Twitter.UserData(u, _LoadData))
-                Case Else : Exit Sub
-            End Select
-            With DirectCast(Collections.Last.Self, UserDataBase)
-                .CreateButtons(Count - 1)
-                AddHandler .BTT_CONTEXT_DELETE.Click, AddressOf BTT_CONTEXT_DELETE_Click
-            End With
-            AddHandler Collections.Last.OnUserUpdated, AddressOf User_OnUserUpdated
+            Collections.Add(GetInstance(u, _LoadData))
+            If Not Collections.Last Is Nothing Then
+                With Collections.Last
+                    If _CollectionName.IsEmptyString Then _CollectionName = .CollectionName
+                    AddRemoveBttDeleteHandler(.Self, True)
+                    AddHandler .OnUserUpdated, AddressOf User_OnUserUpdated
+                End With
+            Else
+                Collections.RemoveAt(Count - 1)
+            End If
+        End Sub
+        Private Sub AddRemoveBttDeleteHandler(ByRef User As IUserData, ByVal IsAdd As Boolean)
+            Try
+                With DirectCast(User, UserDataBase)
+                    If IsAdd Then
+                        .CreateButtons(Count - 1)
+                        AddHandler .BTT_CONTEXT_DELETE.Click, AddressOf DeleteRemoveUserFromCollection
+                    Else
+                        RemoveHandler .BTT_CONTEXT_DELETE.Click, AddressOf DeleteRemoveUserFromCollection
+                    End If
+                End With
+            Catch ex As Exception
+            End Try
+        End Sub
+        Private Sub ConsolidateLabels()
+            If Count > 1 Then
+                Dim l As New List(Of String)
+                Dim lp As New ListAddParams(LAP.ClearBeforeAdd)
+                l.ListAddList(Collections.SelectMany(Function(c) c.Labels), LNC)
+                Collections.ForEach(Sub(c) c.Labels.ListAddList(l, lp))
+            End If
         End Sub
         Friend Sub AddRange(ByVal _Items As IEnumerable(Of IUserData))
             If Not _Items Is Nothing AndAlso _Items.Count > 0 Then
@@ -355,7 +387,7 @@ Namespace API
             End If
         End Sub
         Friend Overrides Function MoveFiles(ByVal __CollectionName As String) As Boolean
-            Throw New NotImplementedException("Files moving does not available if collection context")
+            Throw New NotImplementedException("Move files is not available in the collection context")
         End Function
         Friend Overloads Sub MergeData(ByVal Merging As Boolean)
             If Count > 0 Then
@@ -364,7 +396,7 @@ Namespace API
                         MsgBoxE($"Collection [{CollectionName}] data already merged")
                     Else
                         If Collections.Count > 1 Then
-                            Collections.ForEach(Sub(c) DirectCast(c.Self, UserDataBase).MergeData())
+                            Collections.ForEach(Sub(c) DirectCast(c, UserDataBase).MergeData())
                             MsgBoxE($"Collection [{CollectionName}] data merged")
                         Else
                             MsgBoxE($"Collection [{CollectionName}] contains only one user profile" & vbCr &
@@ -397,8 +429,10 @@ Namespace API
                         "Operation canceled", MsgBoxStyle.Critical)
                 Return False
             Else
-                DirectCast(_Item.Self, UserDataBase).MoveFiles(String.Empty)
+                DirectCast(_Item, UserDataBase).MoveFiles(String.Empty)
                 ImageHandler(_Item)
+                AddRemoveBttDeleteHandler(_Item, False)
+                RaiseEvent OnUserRemoved(_Item)
                 Return Collections.Remove(_Item)
             End If
         End Function
@@ -407,21 +441,23 @@ Namespace API
                 Dim f As SFile
                 If MsgBoxE({$"Collection may contain data{vbCr}Do you really want to delete collection and all of it files?", "Collection deleting"},
                            MsgBoxStyle.Exclamation + MsgBoxStyle.YesNo) = MsgBoxResult.Yes Then
-                    f = Collections(0).File.CutPath(2).PathWithSeparator
+                    f = Collections(0).File.CutPath(IIf(DataMerging, 1, 2)).PathWithSeparator
                     Settings.Users.Remove(Me)
                     Collections.ForEach(Sub(c) c.Delete())
                     Downloader.UserRemove(Me)
                     ImageHandler(Me, False)
                     Collections.ListClearDispose
                     Dispose(False)
-                    If f.Exists(SFO.Path, False) Then f.Delete(SFO.Path, True, False, EDP.SendInLog)
+                    f.Delete(SFO.Path, SFODelete.EmptyOnly + Settings.DeleteMode, EDP.SendInLog)
                     Return 2
                 Else
                     If DataMerging Then
                         MsgBoxE($"Collection [{CollectionName}] data are already merged{vbCr}Cannot split merged collection{vbCr}Operation canceled", MsgBoxStyle.Exclamation)
                         Return 0
                     End If
-                    If MsgBoxE({$"Do you want to delete collection only?{vbCr}Users will not be deleted", "Collection deleting"},
+                    If MsgBoxE({"Do you want to delete only the collection and split users' profiles??" & vbCr &
+                                "Users will be removed from the collection and split by sites." & vbCr &
+                                "All user data will remain.", "Collection deleting"},
                                MsgBoxStyle.Question + MsgBoxStyle.YesNo) = MsgBoxResult.Yes Then
                         f = Collections(0).File.CutPath(2)
                         Settings.Users.Remove(Me)
@@ -430,7 +466,7 @@ Namespace API
                                                 ImageHandler(c)
                                             End Sub)
                         Collections.Clear()
-                        f.Delete(SFO.Path,,, EDP.SendInLog)
+                        f.Delete(SFO.Path, SFODelete.Default + Settings.DeleteMode, EDP.SendInLog)
                         Downloader.UserRemove(Me)
                         ImageHandler(Me, False)
                         Dispose(False)
@@ -442,28 +478,45 @@ Namespace API
             End If
             Return 0
         End Function
-        Private Sub BTT_CONTEXT_DELETE_Click(sender As Object, e As EventArgs)
+        Private Sub DeleteRemoveUserFromCollection(sender As Object, e As EventArgs)
             With DirectCast(sender, ToolStripMenuItem)
                 Dim i% = AConvert(Of Integer)(.Tag, -1)
                 If i >= 0 Then
                     Dim n$ = Collections(i).Name
                     Dim s$ = Collections(i).Site.ToString
-                    If MsgBoxE({$"Do you really want to delete user profile [{n}] of site [{s}]?" & vbCr &
-                                "This profile will be removed from collection and all data will be erased",
-                                "Profile removing"}, MsgBoxStyle.Exclamation,,, {"Process", "Cancel"}) = 0 Then
-                        Collections(i).Delete()
-                        Collections(i).Dispose()
-                        Collections.RemoveAt(i)
-                        MsgBoxE($"User profile [{n}] of site [{s}] has been removed")
-                        If Count = 0 Then
-                            Settings.Users.Remove(Me)
-                            ImageHandler(Me, False)
-                            RaiseEvent OnCollectionSelfRemoved()
-                            Dispose(False)
-                        End If
-                    Else
-                        MsgBoxE("Operation canceled")
-                    End If
+                    Dim RemoveMeIfNull As Action = Sub()
+                                                       If Count = 0 Then
+                                                           Settings.Users.Remove(Me)
+                                                           ImageHandler(Me, False)
+                                                           RaiseEvent OnCollectionSelfRemoved(Me)
+                                                           Dispose(False)
+                                                       End If
+                                                   End Sub
+                    Select Case MsgBoxE({$"Are you sure you want to remove user profile [{n}] of site [{s}] from collection [{Name}]?" & vbCr &
+                                         "You can remove a user from the collection while keeping data (Remove) or deleting the data (Delete)" & vbCr &
+                                         "Deleting this profile will remove it from the collection and all its data will be erased." & vbCr &
+                                         "Removing this profile will remove it from the collection and all its data will remain." &
+                                         "This user will still appear in the program, but not in the collection.",
+                                         "Deleting a user"}, vbExclamation,,,
+                                         {
+                                          New MsgBoxButton("Remove") With {
+                                            .ToolTip = "Remove a user from the collection only. All its data will remain. The user will appear in the program."},
+                                          New MsgBoxButton("Delete") With {
+                                            .ToolTip = "Delete a user from the collection and erase their data."},
+                                          "Cancel"
+                                         }).Index
+                        Case 0
+                            Remove(Collections(i))
+                            MsgBoxE($"User [{s} - {n}] has been removed from the collection. Now it should be displayed in the program.")
+                            RemoveMeIfNull.Invoke
+                        Case 1
+                            Collections(i).Delete()
+                            Collections(i).Dispose()
+                            Collections.RemoveAt(i)
+                            MsgBoxE($"User profile [{n}] of site [{s}] has been deleted")
+                            RemoveMeIfNull.Invoke
+                        Case Else : MsgBoxE("Operation canceled")
+                    End Select
                 End If
             End With
         End Sub
@@ -476,26 +529,6 @@ Namespace API
         End Function
 #End Region
 #End Region
-        Friend Overrides Function CompareTo(ByVal Other As UserDataBase) As Integer
-            If TypeOf Other Is UserDataBind Then
-                Dim x% = CompareValue(Me)
-                Dim y% = CompareValue(Other)
-                If x.CompareTo(y) = 0 Then
-                    Return CollectionName.CompareTo(Other.CollectionName)
-                Else
-                    Return x.CompareTo(y)
-                End If
-            Else
-                Return -1
-            End If
-        End Function
-        Friend Overrides Function CompareTo(ByVal Obj As Object) As Integer
-            If TypeOf Obj Is UserDataBind Then
-                Return CompareTo(DirectCast(Obj, UserDataBind))
-            Else
-                Return -1
-            End If
-        End Function
         Friend Overrides Function Equals(ByVal Other As UserDataBase) As Boolean
             If Other.IsCollection Then
                 Return CollectionName = Other.CollectionName

SCrawler/Channels/ChannelViewForm.vb

@@ -15,24 +15,31 @@ Imports System.ComponentModel
 Imports System.Threading
 Imports SCrawler.API.Base
 Imports SCrawler.API.Reddit
+Imports SCrawler.Plugin.Hosts
 Imports CmbDefaultButtons = PersonalUtilities.Forms.Controls.Base.ActionButton.DefaultButtons
 Imports RButton = PersonalUtilities.Tools.RangeSwitcherButton.Types
 Friend Class ChannelViewForm : Implements IChannelLimits
     Friend Event OnUsersAdded(ByVal StartIndex As Integer)
+    Friend Event OnDownloadDone(ByVal Message As String)
 #Region "Appended user structure"
     Private Structure PendingUser
         Friend ID As String
         Friend File As SFile
-        Friend Sub New(ByVal _ID As String, Optional ByVal _File As SFile = Nothing)
+        Friend Channel As Channel
+        Friend Sub New(ByVal _ID As String, ByRef _Channel As Channel, Optional ByVal _File As SFile = Nothing)
             ID = _ID
+            Channel = _Channel
             If Settings.FromChannelCopyImageToUser Then File = _File
         End Sub
         Public Shared Widening Operator CType(ByVal _ID As String) As PendingUser
-            Return New PendingUser(_ID, False)
+            Return New PendingUser(_ID, Nothing)
         End Operator
         Public Shared Widening Operator CType(ByVal u As PendingUser) As String
             Return u.ToString
         End Operator
+        Friend Sub ChannelUserAdded(Optional ByVal IsAdded As Boolean = True)
+            If Not Channel Is Nothing Then Channel.UserAdded(ID, IsAdded)
+        End Sub
         Public Overrides Function ToString() As String
             Return ID
         End Function
@@ -53,6 +60,7 @@ Friend Class ChannelViewForm : Implements IChannelLimits
     Private WithEvents OPT_LIMITS_COUNT As RadioButton
     Private WithEvents OPT_LIMITS_POST As RadioButton
     Private WithEvents OPT_LIMITS_DATE As RadioButton
+    Private WithEvents BTT_SHOW_STATS As ToolStripButton
 #End Region
     Private ReadOnly CProvider As ANumbers
     Private ReadOnly CProgress As MyProgress
@@ -78,7 +86,7 @@ Friend Class ChannelViewForm : Implements IChannelLimits
     Private Property DownloadLimitCount As Integer? Implements IChannelLimits.DownloadLimitCount
         Get
             If OPT_LIMITS_COUNT.Checked Then
-                Return AConvert(Of Integer)(TXT_LIMIT.Text, Nothing)
+                Return AConvert(Of Integer)(TXT_LIMIT.Text, AModes.Var, Nothing)
             Else
                 Return Nothing
             End If
@@ -100,7 +108,7 @@ Friend Class ChannelViewForm : Implements IChannelLimits
     Private Property DownloadLimitDate As Date? Implements IChannelLimits.DownloadLimitDate
         Get
             If OPT_LIMITS_DATE.Checked Then
-                Return AConvert(Of Date)(TXT_LIMIT.Value, Nothing)
+                Return AConvert(Of Date)(TXT_LIMIT.Value, AModes.Var, Nothing)
             Else
                 Return Nothing
             End If
@@ -114,6 +122,7 @@ Friend Class ChannelViewForm : Implements IChannelLimits
     Private Sub SetLimit(ByVal Source As IChannelLimits) Implements IChannelLimits.SetLimit
     End Sub
 #End Region
+    Private ReadOnly HOST As SettingsHost
     Private ReadOnly PendingUsers As List(Of PendingUser)
     Private ReadOnly LNC As New ListAddParams(LAP.NotContainsOnly)
     Private WithEvents MyRange As RangeSwitcher(Of UserPost)
@@ -134,9 +143,10 @@ Friend Class ChannelViewForm : Implements IChannelLimits
         InitializeComponent()
         MyDefs = New DefaultFormProps
         CProgress = New MyProgress(ToolbarBOTTOM, PR_CN, LBL_STATUS, "Downloading data") With {.PerformMod = 10, .DropCurrentProgressOnTotalChange = False}
-        CProvider = New ANumbers(ANumbers.Modes.USA) With {.GroupSize = 3, .DecimalDigits = 0}
+        CProvider = New ANumbers With {.FormatOptions = ANumbers.Options.GroupIntegral}
         LimitProvider = New ADateTime("dd.MM.yyyy HH:mm")
         PendingUsers = New List(Of PendingUser)
+        HOST = Settings(RedditSiteKey)
 
         CMB_CHANNELS = New ComboBoxExtended With {
             .CaptionMode = ICaptionControl.Modes.CheckBox,
@@ -149,7 +159,8 @@ Friend Class ChannelViewForm : Implements IChannelLimits
         }
         CMB_CHANNELS.Buttons.AddRange({CmbDefaultButtons.Refresh, CmbDefaultButtons.Add, CmbDefaultButtons.Delete,
                                        New ActionButton(CmbDefaultButtons.Up) With {.ToolTipText = "Previous item (F1)"},
-                                       New ActionButton(CmbDefaultButtons.Down) With {.ToolTipText = "Next item (F4)"}})
+                                       New ActionButton(CmbDefaultButtons.Down) With {.ToolTipText = "Next item (F4)"},
+                                       CmbDefaultButtons.Info})
         TXT_LIMIT = New TextBoxExtended With {
             .CaptionText = "Limit",
             .Margin = New Padding(2),
@@ -168,6 +179,9 @@ Friend Class ChannelViewForm : Implements IChannelLimits
         OPT_LIMITS_DATE = New RadioButton With {.Text = "Date", .BackColor = Color.Transparent, .Margin = New Padding(2)}
         CH_HIDE_EXISTS_USERS = New CheckBox With {.Text = "Hide exists users", .BackColor = Color.Transparent, .Margin = New Padding(2),
                                                   .Checked = Settings.ChannelsHideExistsUser}
+        BTT_SHOW_STATS = New ToolStripButton With {.Text = "Info", .Image = PersonalUtilities.My.Resources.InfoPic_32,
+                                                   .DisplayStyle = ToolStripItemDisplayStyle.ImageAndText, .Alignment = ToolStripItemAlignment.Right,
+                                                   .AutoToolTip = True, .ToolTipText = "Show channels statistic"}
 
         TT_MAIN.SetToolTip(CH_HIDE_EXISTS_USERS, "Hide users which already exists in collection")
         TT_MAIN.SetToolTip(OPT_LIMITS_COUNT, "Total posts count limit")
@@ -182,8 +196,9 @@ Friend Class ChannelViewForm : Implements IChannelLimits
                                   TXT_LIMIT.GetControlHost,
                                   LBL_LIMIT_TEXT,
                                   New ToolStripSeparator,
-                                  New ToolStripControlHost(CH_HIDE_EXISTS_USERS)})
-        MyRange = New RangeSwitcher(Of UserPost) With {.Selector = Function(p) Not Settings.UserExists(Sites.Reddit, p.UserID)}
+                                  New ToolStripControlHost(CH_HIDE_EXISTS_USERS),
+                                  BTT_SHOW_STATS})
+        MyRange = New RangeSwitcher(Of UserPost) With {.Selector = SelectorExpression}
         With MyRange
             .Limit = ImagesInRow * ImagesRows
             .InsertButtons(ToolbarTOP, {RButton.Previous, RButton.Next}, 5)
@@ -192,7 +207,6 @@ Friend Class ChannelViewForm : Implements IChannelLimits
             .BindForm(Me)
             .LabelNumbersProvider = CProvider
             .UpdateControls()
-            .Selector = SelectorExpression
         End With
         AddHandler Settings.ChannelsImagesColumns.OnValueChanged, AddressOf ImagesCountChanged
         AddHandler Settings.ChannelsImagesRows.OnValueChanged, AddressOf ImagesCountChanged
@@ -225,6 +239,8 @@ Friend Class ChannelViewForm : Implements IChannelLimits
         OPT_LIMITS_COUNT.Dispose()
         OPT_LIMITS_POST.Dispose()
         LBL_LIMIT_TEXT.Dispose()
+        BTT_SHOW_STATS.Dispose()
+        MyRange.Dispose()
         PendingUsers.Clear()
         MyDefs.Dispose()
     End Sub
@@ -266,9 +282,11 @@ Friend Class ChannelViewForm : Implements IChannelLimits
 #Region "Images refill methods"
     Private Sub AppendPendingUsers()
         If LIST_POSTS.CheckedIndices.Count > 0 Then
+            Dim c As Channel = GetCurrentChannel(False)
+            Dim lp As New ListAddParams(LAP.NotContainsOnly) With {.OnAddAction = Sub(ByVal u As PendingUser) u.ChannelUserAdded()}
             PendingUsers.ListAddList((From p As ListViewItem In LIST_POSTS.Items
                                       Where p.Checked
-                                      Select New PendingUser(p.Text, GetPostBySelected(CStr(p.Tag)).CachedFile)), LNC)
+                                      Select New PendingUser(p.Text, c, GetPostBySelected(CStr(p.Tag)).CachedFile)), lp)
             Dim a As Action = Sub() BTT_ADD_USERS.Text = $"Add ({PendingUsers.Count.ToString(CProvider)})"
             If ToolbarTOP.InvokeRequired Then ToolbarTOP.Invoke(a) Else a.Invoke
         End If
@@ -308,7 +326,7 @@ Friend Class ChannelViewForm : Implements IChannelLimits
     Private Async Sub BTT_DOWNLOAD_Click(sender As Object, e As EventArgs) Handles BTT_DOWNLOAD.Click
         Try
             AppendPendingUsers()
-            If Not TokenSource Is Nothing Then Exit Sub
+            If Not TokenSource Is Nothing OrElse Not HOST.Source.Available(Plugin.ISiteSettings.Download.Channel) Then Exit Sub
             Dim InvokeToken As Action = Sub()
                                             If TokenSource Is Nothing Then
                                                 CProgress.TotalCount = 0
@@ -324,6 +342,7 @@ Friend Class ChannelViewForm : Implements IChannelLimits
                                                 TXT_LIMIT.Enabled = False
                                                 CH_HIDE_EXISTS_USERS.Enabled = False
                                                 CMB_CHANNELS.Enabled(True) = False
+                                                BTT_SHOW_STATS.Enabled = False
                                                 MyRange.EnableButton(RButton.Previous, False)
                                                 MyRange.EnableButton(RButton.Next, False)
                                             End If
@@ -337,6 +356,8 @@ Friend Class ChannelViewForm : Implements IChannelLimits
                     _CollectionDownloading = True
                     Settings.Channels.SetLimit(Me)
                     Await Task.Run(Sub() Settings.Channels.DownloadData(Token, CH_HIDE_EXISTS_USERS.Checked, CProgress))
+                    Settings.Channels.UpdateUsersStats()
+                    RaiseEvent OnDownloadDone("All channels downloaded")
                     Token.ThrowIfCancellationRequested()
                     c = GetCurrentChannel()
                 Else
@@ -345,6 +366,8 @@ Friend Class ChannelViewForm : Implements IChannelLimits
                         InvokeToken.Invoke()
                         c.SetLimit(Me)
                         Await Task.Run(Sub() c.DownloadData(Token, CH_HIDE_EXISTS_USERS.Checked, CProgress))
+                        c.UpdateUsersStats()
+                        RaiseEvent OnDownloadDone($"Channel [{c.Name}] downloaded")
                         Token.ThrowIfCancellationRequested()
                     End If
                 End If
@@ -377,6 +400,7 @@ Friend Class ChannelViewForm : Implements IChannelLimits
                 TXT_LIMIT.Enabled = True
                 CH_HIDE_EXISTS_USERS.Enabled = True
                 CMB_CHANNELS.Enabled(True) = True
+                BTT_SHOW_STATS.Enabled = True
                 CMB_CHANNELS_ActionOnCheckedChange(CMB_CHANNELS.Checked)
                 With MyRange
                     .EnableButton(RButton.Previous, .Count > 0 AndAlso .CurrentIndex > 0)
@@ -414,25 +438,34 @@ Friend Class ChannelViewForm : Implements IChannelLimits
             Dim Added% = 0, Skipped% = 0
             Dim StartIndex% = Settings.Users.Count
             Dim f As SFile
+            Dim umo As Boolean = HOST.GetUserMediaOnly
             Settings.Labels.Add(CannelsLabelName)
             Settings.Labels.Add(LabelsKeeper.NoParsedUser)
             Dim rUsers$() = UserBanned(PendingUsers.Select(Function(u) u.ID).ToArray)
             If rUsers.ListExists Then PendingUsers.RemoveAll(Function(u) rUsers.Contains(u))
             If PendingUsers.Count > 0 Then
-                With PendingUsers.Select(Function(u) New UserInfo(u, Sites.Reddit))
+                Dim c As New ListAddParams(LAP.NotContainsOnly)
+                Dim cn$
+                Dim tmpUser As IUserData
+                With PendingUsers.Select(Function(u) New UserInfo(u, HOST))
                     For i = 0 To .Count - 1
                         If Not Settings.UsersList.Contains(.ElementAt(i)) Then
                             f = PendingUsers(i).File
+                            cn = If(PendingUsers(i).Channel?.Name, String.Empty)
                             Settings.UpdateUsersList(.ElementAt(i))
-                            Settings.Users.Add(New UserData(.ElementAt(i), False) With {
-                                               .Temporary = Settings.ChannelsDefaultTemporary,
-                                               .CreatedByChannel = True,
-                                               .ReadyForDownload = Settings.ChannelsDefaultReadyForDownload
-                                               })
+                            tmpUser = HOST.GetInstance(Plugin.ISiteSettings.Download.Main, .ElementAt(i), False)
+                            With DirectCast(tmpUser, UserData)
+                                .Temporary = Settings.ChannelsDefaultTemporary
+                                .CreatedByChannel = True
+                                .ReadyForDownload = Settings.ChannelsDefaultReadyForDownload
+                                .ParseUserMediaOnly = umo
+                            End With
+                            Settings.Users.Add(tmpUser)
                             With Settings.Users.Last
                                 .Labels.Add(CannelsLabelName)
                                 .UpdateUserInformation()
-                                If Settings.FromChannelCopyImageToUser And Not f.IsEmptyString And Not .File.IsEmptyString Then CopyFile(f, .File)
+                                If Settings.FromChannelCopyImageToUser And Not f.IsEmptyString And Not .File.IsEmptyString Then _
+                                   CopyFile(ListAddValue(Nothing, New ChannelsCollection.ChannelImage(cn, f)).ListAddList(Settings.Channels.GetUserFiles(.Name), c), .File)
                             End With
                             Added += 1
                         Else
@@ -445,17 +478,26 @@ Friend Class ChannelViewForm : Implements IChannelLimits
             BTT_ADD_USERS.Text = "Add"
             MsgBoxE($"Added users: {Added.ToString(CProvider)}{vbCr}Skipped users: {Skipped.ToString(CProvider)}{vbCr}Total: {PendingUsers.Count.ToString(CProvider)}")
             RaiseEvent OnUsersAdded(StartIndex)
+            Settings.Channels.UpdateUsersStats()
         Else
             MsgBoxE("No one users selected for add to collection")
         End If
     End Sub
-    Private Sub CopyFile(ByVal Source As SFile, ByVal Destination As SFile)
+    Private Sub CopyFile(ByVal Source As IEnumerable(Of ChannelsCollection.ChannelImage), ByVal Destination As SFile)
         Try
-            If Not Source.IsEmptyString And Not Destination.IsEmptyString Then
+            If Source.ListExists And Not Destination.IsEmptyString Then
                 Destination = Destination.CutPath.PathWithSeparator & "ChannelImage\"
-                Destination.Name = Source.Name
-                Destination.Extension = Source.Extension
-                If Source.Exists AndAlso Destination.Exists(SFO.Path) Then IO.File.Copy(Source, Destination)
+                Dim f As SFile
+                Dim i% = 0
+                If Destination.Exists(SFO.Path) Then
+                    For Each ff As ChannelsCollection.ChannelImage In Source
+                        f = Destination
+                        f.Extension = ff.File.Extension
+                        f.Name = $"{IIf(i = 0, "!", String.Empty)}{ff.Channel}_{ff.File.Name}"
+                        If ff.File.Exists Then IO.File.Copy(ff.File, f)
+                        i += 1
+                    Next
+                End If
             End If
         Catch ex As Exception
         End Try
@@ -524,12 +566,13 @@ Friend Class ChannelViewForm : Implements IChannelLimits
         If Not c Is Nothing Then MyRange.ChangeSource(c, EDP.SendInLog)
     End Sub
     Private Sub CMB_CHANNELS_ActionOnButtonClick(ByVal Sender As ActionButton) Handles CMB_CHANNELS.ActionOnButtonClick
+        Dim c As Channel
         Select Case Sender.DefaultButton
             Case CmbDefaultButtons.Refresh : RefillChannels()
             Case CmbDefaultButtons.Add : AddNewChannel()
             Case CmbDefaultButtons.Delete
                 Try
-                    Dim c As Channel = GetCurrentChannel()
+                    c = GetCurrentChannel()
                     If Not c Is Nothing AndAlso MsgBoxE($"Do you really want to delete channel [{c}]?", MsgBoxStyle.Exclamation + MsgBoxStyle.YesNo) = 0 Then
                         Settings.Channels.Remove(c)
                         RefillChannels()
@@ -539,6 +582,13 @@ Friend Class ChannelViewForm : Implements IChannelLimits
                 End Try
             Case CmbDefaultButtons.Up : ChangeComboIndex(-1)
             Case CmbDefaultButtons.Down : ChangeComboIndex(1)
+            Case CmbDefaultButtons.Info
+                Try
+                    c = GetCurrentChannel()
+                    If Not c Is Nothing Then MsgBoxE({c.GetChannelStats(True), "Channel statistics"})
+                Catch info_ex As Exception
+                    ErrorsDescriber.Execute(EDP.LogMessageValue, info_ex, "Error on trying to show channel info")
+                End Try
         End Select
     End Sub
     Private Sub CMB_CHANNELS_ActionOnCheckedChange(ByVal Mode As Boolean) Handles CMB_CHANNELS.ActionOnCheckedChange
@@ -602,6 +652,12 @@ Friend Class ChannelViewForm : Implements IChannelLimits
             MyRange.Update()
         End If
     End Sub
+    Private Sub BTT_SHOW_STATS_Click(sender As Object, e As EventArgs) Handles BTT_SHOW_STATS.Click
+        Using f As New ChannelsStatsForm
+            f.ShowDialog()
+            If f.DeletedChannels > 0 Then RefillChannels()
+        End Using
+    End Sub
 #End Region
 #Region "CONTEXT"
     Private Sub BTT_C_OPEN_USER_Click(sender As Object, e As EventArgs) Handles BTT_C_OPEN_USER.Click
@@ -627,17 +683,21 @@ Friend Class ChannelViewForm : Implements IChannelLimits
     End Sub
     Private Sub BTT_C_OPEN_FOLDER_Click(sender As Object, e As EventArgs) Handles BTT_C_OPEN_FOLDER.Click
         Dim f As SFile = GetPostBySelected().CachedFile
-        If Not f.IsEmptyString Then f.Open(SFO.Path)
+        If Not f.IsEmptyString Then GlobalOpenPath(f, EDP.LogMessageValue)
     End Sub
     Private Sub BTT_C_REMOVE_FROM_SELECTED_Click(sender As Object, e As EventArgs) Handles BTT_C_REMOVE_FROM_SELECTED.Click
         Try
             Dim u$ = GetPostBySelected().UserID
             If Not u.IsEmptyString Then
                 Dim uRemoved As Boolean = False
-                If PendingUsers.Contains(u) Then PendingUsers.Remove(u) : uRemoved = True
+                Dim i% = PendingUsers.IndexOf(u)
+                If i >= 0 Then
+                    PendingUsers(i).ChannelUserAdded(False)
+                    PendingUsers.RemoveAt(i)
+                    uRemoved = True
+                End If
                 With LIST_POSTS
                     If .Items.Count > 0 Then
-                        Dim i%
                         Dim a As Action = Sub() .Items(i).Checked = False
                         For i = 0 To .Items.Count - 1
                             If .Items(i).Text = u And .Items(i).Checked Then

SCrawler/Channels/ChannelsStatsForm.Designer.vb

@@ -0,0 +1,112 @@
+' Copyright (C) 2022  Andy
+' This program is free software: you can redistribute it and/or modify
+' it under the terms of the GNU General Public License as published by
+' the Free Software Foundation, either version 3 of the License, or
+' (at your option) any later version.
+'
+' This program is distributed in the hope that it will be useful,
+' but WITHOUT ANY WARRANTY
+
+<Global.Microsoft.VisualBasic.CompilerServices.DesignerGenerated()>
+Partial Friend Class ChannelsStatsForm : Inherits System.Windows.Forms.Form
+    <System.Diagnostics.DebuggerNonUserCode()>
+    Protected Overrides Sub Dispose(ByVal disposing As Boolean)
+        Try
+            If disposing AndAlso components IsNot Nothing Then
+                components.Dispose()
+            End If
+        Finally
+            MyBase.Dispose(disposing)
+        End Try
+    End Sub
+    Private components As System.ComponentModel.IContainer
+    <System.Diagnostics.DebuggerStepThrough()>
+    Private Sub InitializeComponent()
+        Dim CONTAINER_MAIN As System.Windows.Forms.ToolStripContainer
+        Dim ActionButton1 As PersonalUtilities.Forms.Controls.Base.ActionButton = New PersonalUtilities.Forms.Controls.Base.ActionButton()
+        Dim resources As System.ComponentModel.ComponentResourceManager = New System.ComponentModel.ComponentResourceManager(GetType(ChannelsStatsForm))
+        Dim ActionButton2 As PersonalUtilities.Forms.Controls.Base.ActionButton = New PersonalUtilities.Forms.Controls.Base.ActionButton()
+        Dim ActionButton3 As PersonalUtilities.Forms.Controls.Base.ActionButton = New PersonalUtilities.Forms.Controls.Base.ActionButton()
+        Dim ListColumn1 As PersonalUtilities.Forms.Controls.Base.ListColumn = New PersonalUtilities.Forms.Controls.Base.ListColumn()
+        Dim ListColumn2 As PersonalUtilities.Forms.Controls.Base.ListColumn = New PersonalUtilities.Forms.Controls.Base.ListColumn()
+        Me.CMB_CHANNELS = New PersonalUtilities.Forms.Controls.ComboBoxExtended()
+        CONTAINER_MAIN = New System.Windows.Forms.ToolStripContainer()
+        CONTAINER_MAIN.ContentPanel.SuspendLayout()
+        CONTAINER_MAIN.SuspendLayout()
+        CType(Me.CMB_CHANNELS, System.ComponentModel.ISupportInitialize).BeginInit()
+        Me.SuspendLayout()
+        '
+        'CONTAINER_MAIN
+        '
+        '
+        'CONTAINER_MAIN.ContentPanel
+        '
+        CONTAINER_MAIN.ContentPanel.Controls.Add(Me.CMB_CHANNELS)
+        CONTAINER_MAIN.ContentPanel.Size = New System.Drawing.Size(384, 261)
+        CONTAINER_MAIN.Dock = System.Windows.Forms.DockStyle.Fill
+        CONTAINER_MAIN.LeftToolStripPanelVisible = False
+        CONTAINER_MAIN.Location = New System.Drawing.Point(0, 0)
+        CONTAINER_MAIN.Name = "CONTAINER_MAIN"
+        CONTAINER_MAIN.RightToolStripPanelVisible = False
+        CONTAINER_MAIN.Size = New System.Drawing.Size(384, 261)
+        CONTAINER_MAIN.TabIndex = 0
+        CONTAINER_MAIN.TopToolStripPanelVisible = False
+        '
+        'CMB_CHANNELS
+        '
+        ActionButton1.BackgroundImage = CType(resources.GetObject("ActionButton1.BackgroundImage"), System.Drawing.Image)
+        ActionButton1.Index = 0
+        ActionButton1.Name = "BTT_COMBOBOX_ARROW"
+        ActionButton1.Visible = False
+        ActionButton2.BackgroundImage = CType(resources.GetObject("ActionButton2.BackgroundImage"), System.Drawing.Image)
+        ActionButton2.Index = 1
+        ActionButton2.Name = "BTT_CLEAR"
+        ActionButton3.BackgroundImage = CType(resources.GetObject("ActionButton3.BackgroundImage"), System.Drawing.Image)
+        ActionButton3.Index = 2
+        ActionButton3.Name = "BTT_DELETE"
+        Me.CMB_CHANNELS.Buttons.Add(ActionButton1)
+        Me.CMB_CHANNELS.Buttons.Add(ActionButton2)
+        Me.CMB_CHANNELS.Buttons.Add(ActionButton3)
+        Me.CMB_CHANNELS.ClearTextByButtonClear = False
+        ListColumn1.DisplayMember = True
+        ListColumn1.Name = "COL_INFO"
+        ListColumn1.Text = "Information"
+        ListColumn1.Width = -2
+        ListColumn2.Name = "COL_VALUE"
+        ListColumn2.Text = "Channel"
+        ListColumn2.ValueMember = True
+        ListColumn2.Visible = False
+        Me.CMB_CHANNELS.Columns.Add(ListColumn1)
+        Me.CMB_CHANNELS.Columns.Add(ListColumn2)
+        Me.CMB_CHANNELS.Dock = System.Windows.Forms.DockStyle.Fill
+        Me.CMB_CHANNELS.ListCheckBoxes = True
+        Me.CMB_CHANNELS.ListDropDownStyle = PersonalUtilities.Forms.Controls.ComboBoxExtended.ListMode.Simple
+        Me.CMB_CHANNELS.ListGridVisible = True
+        Me.CMB_CHANNELS.ListMultiSelect = True
+        Me.CMB_CHANNELS.Location = New System.Drawing.Point(0, 0)
+        Me.CMB_CHANNELS.Name = "CMB_CHANNELS"
+        Me.CMB_CHANNELS.Size = New System.Drawing.Size(386, 262)
+        Me.CMB_CHANNELS.TabIndex = 0
+        '
+        'ChannelsStatsForm
+        '
+        Me.AutoScaleDimensions = New System.Drawing.SizeF(6.0!, 13.0!)
+        Me.AutoScaleMode = System.Windows.Forms.AutoScaleMode.Font
+        Me.ClientSize = New System.Drawing.Size(384, 261)
+        Me.Controls.Add(CONTAINER_MAIN)
+        Me.Icon = CType(resources.GetObject("$this.Icon"), System.Drawing.Icon)
+        Me.KeyPreview = True
+        Me.MinimizeBox = False
+        Me.MinimumSize = New System.Drawing.Size(400, 300)
+        Me.Name = "ChannelsStatsForm"
+        Me.ShowInTaskbar = False
+        Me.Text = "Channels statistics"
+        CONTAINER_MAIN.ContentPanel.ResumeLayout(False)
+        CONTAINER_MAIN.ResumeLayout(False)
+        CONTAINER_MAIN.PerformLayout()
+        CType(Me.CMB_CHANNELS, System.ComponentModel.ISupportInitialize).EndInit()
+        Me.ResumeLayout(False)
+
+    End Sub
+    Private WithEvents CMB_CHANNELS As PersonalUtilities.Forms.Controls.ComboBoxExtended
+End Class

SCrawler/Channels/ChannelsStatsForm.resx

@@ -117,19 +117,98 @@
   <resheader name="writer">
     <value>System.Resources.ResXResourceWriter, System.Windows.Forms, Version=4.0.0.0, Culture=neutral, PublicKeyToken=b77a5c561934e089</value>
   </resheader>
-  <metadata name="TP_MAIN.GenerateMember" type="System.Boolean, mscorlib, Version=4.0.0.0, Culture=neutral, PublicKeyToken=b77a5c561934e089">
+  <metadata name="CONTAINER_MAIN.GenerateMember" type="System.Boolean, mscorlib, Version=4.0.0.0, Culture=neutral, PublicKeyToken=b77a5c561934e089">
     <value>False</value>
   </metadata>
   <assembly alias="System.Drawing" name="System.Drawing, Version=4.0.0.0, Culture=neutral, PublicKeyToken=b03f5f7f11d50a3a" />
   <data name="ActionButton1.BackgroundImage" type="System.Drawing.Bitmap, System.Drawing" mimetype="application/x-microsoft.net.object.bytearray.base64">
     <value>
-        iVBORw0KGgoAAAANSUhEUgAAABAAAAAQCAYAAAAf8/9hAAAABGdBTUEAALGPC/xhBQAAAAlwSFlzAAAO
-        wwAADsMBx2+oZAAAAR5JREFUOE+VkjFqwzAUhn2D9iShRyi+QhYbGujg3ZATZPKYdC6FQhPwlAMkg3dP
-        WQwhyWIyJIUW5NqyPb7oCVtIlhVTwYf8nv7/t2zJagel9KmqKsIACYL9RjI8UHz5zshougZr/AEvbxEP
-        aZCDBY3VslixaJvX3wzkkDiOwbZtDRGA5vdNAg+TL27qgmt5XkBG/gTdAG7Gt+3PP9oOaEGFCVEC6rp+
-        5g9MfM/c5e4OsEZMZkQEtGL5H2DdZ5JRArDwPA+iKII0TfkC9vroC9j5vq8JTWw3WzWgLMtZGIaa0MR8
-        vlAD8PYlSaIJTTiOowY0p0Bc19XEJo6HE59FAPuMzyAINKGJ1XLFZxHALtMrnkBXOIQIIIQ8YvF/KrgB
-        cMaRN0UdBBkAAAAASUVORK5CYII=
+        iVBORw0KGgoAAAANSUhEUgAAAgAAAAIACAYAAAD0eNT6AAAABGdBTUEAALGPC/xhBQAAE65JREFUeF7t
+        3X2sJWddB/DdLi2lQG2hdOHuvfM887J7Cxca4ELTQMDWKigIFpBAEAgi9g+CJpJo9Q8NJhgBiYZIYspL
+        GlAKCkhEC4KgQlsLQkqhKi/lrYWWlxaw3dLddrerz/Q89+7dc2fbfTn3npf5fJJv2rS758z85nnOzJz5
+        nZktAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAMK3O3r79wVUIz65jfGNVxI/VIX69CvGO9M//a9P+e8o3B/8v
+        vKn9s+3fyX8dAJgmaWd+fl3E96Wd/E9XdvZHkfbvXNa+Rn45AGCS3bvjj/E/h3box5OrmxjPyy8PAEyS
+        XXO7zqhCeH/HDnwUOdCE+J6zdux4eH47YIrEGE8uy/Ls9Bnx/LooL0oH9b9Th/I1TVG+rCqKC+q6Xsh/
+        FJgmO8vy6WknfdPQTnsjckMdwlPy2wITLO3wF6si/lGas1ekuXvX0Fzuyg9S3psOCl6qDwimQB3ji9Ok
+        3btmEm907kpnEa/Mbw9Mlq1pB/6cdHZ/ZcfcPZrcXoXyrVVVFfl1gUmSdsS/libqPUMTd5NSvjktwrbB
+        kgDjVi1UT26K+Nnu+XrMuaud60uPWHpIfhtg3JqyfEaanHcPTdZNTRPCPy4uLj40LxIwBudt2fKAtOP/
+        0zQnN+5koIg3tpca81sC49J+LZcm5a3rJulYEq6LSV40YBOFEB6V5uFV6+flRiTsSwf9r81vDYzBCSO4
+        vjfq/KAuiqfm5QM2QRPjuWnubUbz71DCn6W33zpYCmDT1EX5m92Tcuy5q47xFXkxgQ3UduqnOXfn0Bzc
+        xJSvz4sCbIb2pzlp8v1w/WScnKSzkjekRT1hsMTAKC0vL5/Ydud3zb1NT1FelBcL2GiDm3d0TMTJy0ea
+        pjk1LzYwAu3NvtLc+uTQXBtn7tYYCJtja/vQno5JOJFpQrzWb4hhNJoQnpjm1Q3D82wCcnNRFKfnxQQ2
+        Qttk1zH5JjzhFmcIcHzyzb6O5aFem5J0sP/OvKjARmg7b7sm3xRkT3vDorwawJHb1t6Ep2NOTVoOtDch
+        yssMjFr6IPh8x8SbnsT4lrQamgPhCMzPzz+sifHjnXNpMnN5XnRglJaWlk5KE2z/0ISbxnzQQ0bgvlXz
+        1ePSXPnG0NyZ+DRF8Zi8CsCo7Azh0V0TbkrzRc2B0G3wIJ9429CcmZLce4MgYJTyff87JtzU5uayLM/J
+        qwcM7vD5+jQ3DgzNlWnKDXldgFFJZwW/2jHZpj1727uZ5VWE3mofqJXmw4eG5sdUpqqqXXm1gFGoQnhJ
+        12SbgRxoYvzjtIruK04vxRjPSvPgK0PzYmqTPqtemVcNGIU6xgu7JtusJH1ovH9ubu6UvLrQC2ncPyuN
+        /58Mz4fpTvnmvHrAKJQL5dO6J9ssJXxucWFhLq8yzLKtaUf5h2ncb9zz+8eUKsYP53UERmHX/PyOrsk2
+        g7nJDUWYZUuPWHpIE8oPdIz92UiMn86rCoxIOmOYta8KD5uftk2Peb1hZtTzdVOHcF3HmJ+ZVCF+Ia8u
+        MCppcl0+PNlmOG1zYPtYYc2BzIQ0np+ZxvWPh8b5LObqvMrAqEzRo4BHmctijCfnEsBUqkP5u2ksz8Kd
+        PI8g5SfyagOj0jbIpQk2c01DR5Brmh3NfC4DTI324LWO8V0dY3pm48mAsEGm7OEgo0sRb9wZ4+NzGWDi
+        lWUZ0ti9Zt1YnvUU8fdyCYBRmsFbAh9xqhDvqEN4Xi4FTKz8s93vD4/hPiSdpJyXywCMWPtrgKuGJ12P
+        ck/6gPmDXAuYOHVR/lY6UN3XMXb7kDv17MAGqhaqJ6WJ1sdegDUJ726a5oG5JDB2917vL+Kl3eO1N/lQ
+        LgewUdIO8E0dk69vubosy+25JDA2bYNuFeJnOsZovxLjhbkkwEZZXl4+0QfOvfl2Ogg4O5cFNl1dFE9N
+        4/B7Q+Oyj7mh/VzKZQE2UtM0j6iL+LWOidizhN3OPBiHuigvSmPwrvVjsn9pQnh1LguwGQa3Fo3fHp6M
+        Pcw97c1WcllgQy0tLZ2UDr7/qmMc9jJNiF/WkwNjMHhQ0GzfX/yIU8RLfRCxkdq+kzTfrugcf/3MgZ1l
+        +fRcHmCztU8Yq2P8h47J2cdcpTmQjdCE8IQ0vnzjdkjKP8nlAcZoWxXin3dP0n4l1eGb9UL92FwXOG51
+        Ub48ja09w2Otz2nvTJpKs21QIWDs0lnKb6TJqTEphN3NQvncXBY4VtvSju4N3WOs17l6cXHxoblGwKRo
+        r8mlHeAtHZO2b9mfDohem8sCR2XX3K4z0hj65NCYklSTGONpuUzApNlVFFWaqP81NHF7mvD2tnM7lwbu
+        V/vwqTR2vrV+LPU7VSjf4ff+MAU0B65NeWVd12fm0sBhpTnzosHDp7rGUV8T9lVFvDiXCJgSrmEezDea
+        onhMrgsM25rmyuvSODkwNG56nvZyYvi5XCNg2mgOXM3tVVH9ci4L3KtpmlN9W7Y+VYhfiEkuEzCt8n3L
+        fzA8yXuY/b7OZEVZlovt3ew6xknf8965ublTcpmAaac5cG3C2zQ09Vv7bVAaC/+7fmz0Og6QYVZpDlyT
+        GD/dPlgpl4b+2Nru5NIYuGfdmOhxmhB/VBblL+QaATNKc+DBfH1nCI/OdWHGtTewSdv874fGgIT4xfYb
+        wlwmYNZpDlzNbVUIz85lYUblJ2i6BDacGP/u7O3bH5zLBPSF5sDV7K+L+Nu5LMyYtJP7xbSNfzy0zfue
+        A+03gak8WwdVAnpHc+CaxHiJ5sCZsnK9f/+6bd3v3JZ2/r+SawT0mebAg0kfjB93v/Pp136t3X693bWN
+        e56v6nsBhmkOXE24Ph0EnJXrwpSp63qhDuXnu7dtn1P+U1VVP5PLBHAozYGDtD+LchvU6TN4Iqa+lqGs
+        XO8/YVAlgMPQHLiSsC+dNb0ml4UJVxflRWm73b1+O/Y5YXcVwvNziQDun+bANYnxkvO2bHlALg0TJsZ4
+        cl3ESzu3Xa8Trm+KYimXCeDIaQ48mKqIH9McOHl2zc/vaIr42a5t1vN8tCiK03OZAI6J5sCVFPFr7QNk
+        cl0Ys3yp6nvrtlO/s3K9f9ugSgDHSXPgILk58PxcFsYkX+93J8s1qUK8oynKF+YSAYyO5sCVhH3pgOjV
+        uSxsoqZpHpjq//bu7dLjFPHGND+Xc5kARk9z4JrE+JZUEl+1bpLFhYW5VPf/WLcd5N/ruj4zlwlg42gO
+        PCQfdXOVjdeE8MRU6xuGai9uXw2MgebA1YTrFkMoc10YsaYoX5rqfOf6uvc6e9LO/xW5RACbT3Pgam5N
+        B0Q/m8vCCLT3XnCQ2ZXwnWqhenIuE8D4aA5czV3OykZj19yuM1I9PzlUXwnhirIst+cyAYyf5sA1GTQH
+        uu/6MdoZ4+NTHb+1rq59j+v9wKTSHHhIPtI0zam5NByhNH5enGr306Fa9j1720ttuUQAE0tz4Epi/FJM
+        cl24b8ZNd25KdTk31whg8mkOXEm4pX1EbS4LHebn5x+WdnIf765fr3NVCOFRuUwA00Nz4Gr21kX58lwW
+        1qjmq8el+nxjqF4S4yVLS0sn5TIBTB/NgWuiOfAQTVE+J9XltnV16nXCvqqIF+cSAUw3zYGH5INnb9/+
+        4Fyavtra7uRSLe4Zqk3f88MmxvNyjQBmhiavg/liVVVFrkuvLC4uPjSt/4eG6iEhXlOWZchlApg9mgNX
+        c3P6wD8nl6UXqvlqZ1rv/xmqQ+/ThPJv5ufnH5TLBDC7NAeuZm97n/tclplWhfCstL4/GVr/nsf1fqCH
+        NAeu5kB7aSSVZFabA13v786tVVFckGsE0C+aAw8mnSG/f25u7pRcmpnQbt8mlB/oWt8+pwnxWk+PBNAc
+        uJoqxC/MSnNgs7BQ1yFc17WePc97Z+1AD+C4aA5czU3T/qjXdED3zLQePx5ar75nf77ev3VQJQBWaQ5c
+        zZ4qhJfkskyVuigvapvbOtapt2lC/FFTls/IJQKgi+bA1aw0B07FGWOM8eQ6xnd1rEe/E+OX2jGdywTA
+        fdEcuCYx/u2kXzNudjTz6az/c53L3+NUMX7YI6EBjp7mwIO5pt3J5rpMlHKhfFpavu8PLW/fM+s/7QTY
+        eJoDV/PduiiWc1kmwuB6f7x7aDn7ntvrGC/MJQLgeGgOHKQK8Y46hOflsoxN0zQPbEJ8Z9cy9jxf3RnC
+        o3OZABgFzYGrab9efl0qyViaAxcXFubSgchnOpar77k8xnhaLhMAo6Q5cE2K+L7NfoBMHcJT0nvfvG5Z
+        +h3X+wE2iebAg7m6LMvtuS4bKl/v14txSMLuKoQX5BIBsBk0B64kfCfV4om5LCN33pYtD3DA1ZVwfb1Q
+        PzaXCYDNpDlwJWH3RnSe75rbdUZ6/X9b/369z0eLojg9lwmAcdAcuJqV5sCRaEJ4QnrNbw+9R9+zcr1/
+        26BKAIyV5sBDcll7W95cmmPSPocgvc6dQ6/b9+xpivJluUQATBDNgQdz1TE2B6phV4p446TdhAmAIens
+        9ZXpQ1tz4KA58Am5LPfrrB07Hp7+zr90v1Z/UxXxU3Vdn5nLBMAk0xy4krC7WSifm8tyWGVZnl2F+M3u
+        1+hxYrxkeXn5xFwmAKaB5sDV7E9nsRfnsqyTdnIvGtxiuPPv9jV7Ul1ekUsEwLTRHHgwVSjfsbS0dFIu
+        TWtr+6uB9P8ODP/Znue7ZVmek2sEwBTT2Laa8sr2enb7jHoHRl0JV8QYH5nHDQCzwJ0DV/P1tKO7vuO/
+        9zpVKN/qej/AjNIcKB3Z24TyVXmIADCrNAfKmtzUxHhuHhoAzDrNgZJyVQjhUXlIANAjmgN7m/Du471d
+        MgBTzp0D+5Sw777uiQBAz2gO7EPCLSnn500OAAOaA2c615RlGfKmBoBDaQ6cvTQhvmd+fv5BeRMDwGFp
+        DpyJuN4PwDHQHDjVubUqigvypgSAo6M5cPrShHjtYghl3oQAcGw0B05Rivi+ubm5U/KmA4Djozlw4rM/
+        X+/fOthiADA6mgMnME2IP2rK8hl5GwHAxtAcOFH5SozxrLxpAGBjaQ4cf6oYP9w0zal5kwDA5tAcOLYc
+        aC/FpE1wwmBLAMAm0xy46bk91fvCXH4AGCvNgZuRIn6tKYrH5JoDwGTQHLihuTzGeFouNQBMFs2BI4/r
+        /QBMB82Bo0rYXYXwglxWAJh8mgOPN+H6eqF+bC4nAEwVzYHHkiL+c1EUp+caAsB00hx4FInxLalk2waV
+        A4AppznwfrOnLsqX53IBwOzQHHiYFPHGaqF6Ui4TAMwezYGHpirip+q6PjOXBwBmmubANjFesry8fGKu
+        CQD0Q4+bA/dWMf56LgMA9E8PmwO/W5blOXn1AaC/+tMcWF4ZY3xkXm0AYOabA2O8ZGlp6aS8ugDAGrPY
+        HLi3CeWr8voBAIczQ82BN6UDmnPzagEA92f6mwPLz1dVVeTVAQCO1LQ2B1Yh/PX8/PyD8moAAEdrupoD
+        w76qiBfnRQcAjtMUNAeGW1LOz8sLAIzKBDcHXlOWZciLCQCM2gQ2B142Nzd3Sl48AGCjTEhz4H7X+wFg
+        k425OfDWqqh+Pi8KALDJtqWDgDemHfKBoR30hqUJ8dqY5PcHAMalKcrnpJ3z94Z31qNO+/t+1/sBYIKk
+        k/LT6hD+Mu2oR/4rgXTW/+X02r+U3woAmDTtz/GaIv5F2nH/ZHhHfpS5J+Vf01n/S9LLbhu8OgAw0dpb
+        8TYL5XPTmfvb0o78v/MOvWtHvybtzXzKT1Qx/n5d1wv5pQCAaXXvAUFRLLXd+3WMFzZF+cKUl7X/rIri
+        gsWFhbn8RwEAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA6LEtW/4flgYiLD1qeX0A
+        AAAASUVORK5CYII=
 </value>
   </data>
   <data name="ActionButton2.BackgroundImage" type="System.Drawing.Bitmap, System.Drawing" mimetype="application/x-microsoft.net.object.bytearray.base64">
@@ -142,68 +221,31 @@
   </data>
   <data name="ActionButton3.BackgroundImage" type="System.Drawing.Bitmap, System.Drawing" mimetype="application/x-microsoft.net.object.bytearray.base64">
     <value>
-        iVBORw0KGgoAAAANSUhEUgAAABAAAAAQCAYAAAAf8/9hAAAABGdBTUEAALGOfPtRkwAAACBjSFJNAACH
-        DwAAjA8AAP1SAACBQAAAfXkAAOmLAAA85QAAGcxzPIV3AAAKOWlDQ1BQaG90b3Nob3AgSUNDIHByb2Zp
-        bGUAAEjHnZZ3VFTXFofPvXd6oc0w0hl6ky4wgPQuIB0EURhmBhjKAMMMTWyIqEBEEREBRZCggAGjoUis
-        iGIhKKhgD0gQUGIwiqioZEbWSnx5ee/l5ffHvd/aZ+9z99l7n7UuACRPHy4vBZYCIJkn4Ad6ONNXhUfQ
-        sf0ABniAAaYAMFnpqb5B7sFAJC83F3q6yAn8i94MAUj8vmXo6U+ng/9P0qxUvgAAyF/E5mxOOkvE+SJO
-        yhSkiu0zIqbGJIoZRomZL0pQxHJijlvkpZ99FtlRzOxkHlvE4pxT2clsMfeIeHuGkCNixEfEBRlcTqaI
-        b4tYM0mYzBXxW3FsMoeZDgCKJLYLOKx4EZuImMQPDnQR8XIAcKS4LzjmCxZwsgTiQ7mkpGbzuXHxArou
-        S49uam3NoHtyMpM4AoGhP5OVyOSz6S4pyalMXjYAi2f+LBlxbemiIluaWltaGpoZmX5RqP+6+Dcl7u0i
-        vQr43DOI1veH7a/8UuoAYMyKarPrD1vMfgA6tgIgd/8Pm+YhACRFfWu/8cV5aOJ5iRcIUm2MjTMzM424
-        HJaRuKC/6386/A198T0j8Xa/l4fuyollCpMEdHHdWClJKUI+PT2VyeLQDf88xP848K/zWBrIieXwOTxR
-        RKhoyri8OFG7eWyugJvCo3N5/6mJ/zDsT1qca5Eo9Z8ANcoISN2gAuTnPoCiEAESeVDc9d/75oMPBeKb
-        F6Y6sTj3nwX9+65wifiRzo37HOcSGExnCfkZi2viawnQgAAkARXIAxWgAXSBITADVsAWOAI3sAL4gWAQ
-        DtYCFogHyYAPMkEu2AwKQBHYBfaCSlAD6kEjaAEnQAc4DS6Ay+A6uAnugAdgBIyD52AGvAHzEARhITJE
-        geQhVUgLMoDMIAZkD7lBPlAgFA5FQ3EQDxJCudAWqAgqhSqhWqgR+hY6BV2ArkID0D1oFJqCfoXewwhM
-        gqmwMqwNG8MM2An2hoPhNXAcnAbnwPnwTrgCroOPwe3wBfg6fAcegZ/DswhAiAgNUUMMEQbigvghEUgs
-        wkc2IIVIOVKHtCBdSC9yCxlBppF3KAyKgqKjDFG2KE9UCIqFSkNtQBWjKlFHUe2oHtQt1ChqBvUJTUYr
-        oQ3QNmgv9Cp0HDoTXYAuRzeg29CX0HfQ4+g3GAyGhtHBWGE8MeGYBMw6TDHmAKYVcx4zgBnDzGKxWHms
-        AdYO64dlYgXYAux+7DHsOewgdhz7FkfEqeLMcO64CBwPl4crxzXhzuIGcRO4ebwUXgtvg/fDs/HZ+BJ8
-        Pb4LfwM/jp8nSBN0CHaEYEICYTOhgtBCuER4SHhFJBLVidbEACKXuIlYQTxOvEIcJb4jyZD0SS6kSJKQ
-        tJN0hHSedI/0ikwma5MdyRFkAXknuZF8kfyY/FaCImEk4SXBltgoUSXRLjEo8UISL6kl6SS5VjJHslzy
-        pOQNyWkpvJS2lIsUU2qDVJXUKalhqVlpirSptJ90snSxdJP0VelJGayMtoybDFsmX+awzEWZMQpC0aC4
-        UFiULZR6yiXKOBVD1aF6UROoRdRvqP3UGVkZ2WWyobJZslWyZ2RHaAhNm+ZFS6KV0E7QhmjvlygvcVrC
-        WbJjScuSwSVzcopyjnIcuUK5Vrk7cu/l6fJu8onyu+U75B8poBT0FQIUMhUOKlxSmFakKtoqshQLFU8o
-        3leClfSVApXWKR1W6lOaVVZR9lBOVd6vfFF5WoWm4qiSoFKmclZlSpWiaq/KVS1TPaf6jC5Ld6In0Svo
-        PfQZNSU1TzWhWq1av9q8uo56iHqeeqv6Iw2CBkMjVqNMo1tjRlNV01czV7NZ874WXouhFa+1T6tXa05b
-        RztMe5t2h/akjpyOl06OTrPOQ12yroNumm6d7m09jB5DL1HvgN5NfVjfQj9ev0r/hgFsYGnANThgMLAU
-        vdR6KW9p3dJhQ5Khk2GGYbPhqBHNyMcoz6jD6IWxpnGE8W7jXuNPJhYmSSb1Jg9MZUxXmOaZdpn+aqZv
-        xjKrMrttTjZ3N99o3mn+cpnBMs6yg8vuWlAsfC22WXRbfLS0suRbtlhOWWlaRVtVWw0zqAx/RjHjijXa
-        2tl6o/Vp63c2ljYCmxM2v9ga2ibaNtlOLtdZzllev3zMTt2OaVdrN2JPt4+2P2Q/4qDmwHSoc3jiqOHI
-        dmxwnHDSc0pwOub0wtnEme/c5jznYuOy3uW8K+Lq4Vro2u8m4xbiVun22F3dPc692X3Gw8Jjncd5T7Sn
-        t+duz2EvZS+WV6PXzAqrFetX9HiTvIO8K72f+Oj78H26fGHfFb57fB+u1FrJW9nhB/y8/Pb4PfLX8U/z
-        /z4AE+AfUBXwNNA0MDewN4gSFBXUFPQm2Dm4JPhBiG6IMKQ7VDI0MrQxdC7MNaw0bGSV8ar1q66HK4Rz
-        wzsjsBGhEQ0Rs6vdVu9dPR5pEVkQObRGZ03WmqtrFdYmrT0TJRnFjDoZjY4Oi26K/sD0Y9YxZ2O8Yqpj
-        ZlgurH2s52xHdhl7imPHKeVMxNrFlsZOxtnF7YmbineIL4+f5rpwK7kvEzwTahLmEv0SjyQuJIUltSbj
-        kqOTT/FkeIm8nhSVlKyUgVSD1ILUkTSbtL1pM3xvfkM6lL4mvVNAFf1M9Ql1hVuFoxn2GVUZbzNDM09m
-        SWfxsvqy9bN3ZE/kuOd8vQ61jrWuO1ctd3Pu6Hqn9bUboA0xG7o3amzM3zi+yWPT0c2EzYmbf8gzySvN
-        e70lbEtXvnL+pvyxrR5bmwskCvgFw9tst9VsR23nbu/fYb5j/45PhezCa0UmReVFH4pZxde+Mv2q4quF
-        nbE7+0ssSw7uwuzi7Rra7bD7aKl0aU7p2B7fPe1l9LLCstd7o/ZeLV9WXrOPsE+4b6TCp6Jzv+b+Xfs/
-        VMZX3qlyrmqtVqreUT13gH1g8KDjwZYa5ZqimveHuIfu1nrUttdp15UfxhzOOPy0PrS+92vG140NCg1F
-        DR+P8I6MHA082tNo1djYpNRU0gw3C5unjkUeu/mN6zedLYYtta201qLj4Ljw+LNvo78dOuF9ovsk42TL
-        d1rfVbdR2grbofbs9pmO+I6RzvDOgVMrTnV32Xa1fW/0/ZHTaqerzsieKTlLOJt/duFczrnZ86nnpy/E
-        XRjrjup+cHHVxds9AT39l7wvXbnsfvlir1PvuSt2V05ftbl66hrjWsd1y+vtfRZ9bT9Y/NDWb9nffsPq
-        RudN65tdA8sHzg46DF645Xrr8m2v29fvrLwzMBQydHc4cnjkLvvu5L2key/vZ9yff7DpIfph4SOpR+WP
-        lR7X/aj3Y+uI5ciZUdfRvidBTx6Mscae/5T+04fx/Kfkp+UTqhONk2aTp6fcp24+W/1s/Hnq8/npgp+l
-        f65+ofviu18cf+mbWTUz/pL/cuHX4lfyr468Xva6e9Z/9vGb5Dfzc4Vv5d8efcd41/s+7P3EfOYH7IeK
-        j3ofuz55f3q4kLyw8Bv3hPP74uYdwgAAAAlwSFlzAAALEwAACxMBAJqcGAAAAahJREFUOE9j+P//P8l4
-        vaOjPYyNIYkPO1lZsa1wdNy42sHh3Hxb22KQGFaF2LC4qjjroUP7n97s6vx/Ny/3/ypn54+LbGwisSpG
-        x+aaouwZren/u5f2/3/18tX/qzNn/l/i4XGSgYFBFasGZKwjzcJ6YVnU152blvw3LHH53zCl/ufatWu+
-        T+1vDALJY9UEwxrijExHZgd+/Xy1Hcg98BNkCMglMM0gjKEJhuX5GVh2TvD+/O5c0///P9b///qo819P
-        lgmKZhBG0QTDMjwMzJs7XT+9OVHz///XFf+/PWj7j00zCKNwQFiah4FtXbPjp8d78////7bo/4/79Tg1
-        gzAKR1mUg3lOocXbe9uz/v9/M/H/1zuVeDWDMJwhJcDBvK4p4tb1DQn//r/u+f/zRh5BzSAMZyyrdVh9
-        c33B9//32159vZr2hxjNIAwm1GUE3e+ur/n9/+Ls/592Nf9fUun3khjNIMzAysTAv6g6+OT/E33/j09N
-        +zWpMuImsZpBmMHIQK9x19T8/03x1ufE+TkqsCnChxmUlFWuyEpJtAHTtT42BfjxfwYAtlm0ShMkSB4A
-        AAAASUVORK5CYII=
-</value>
-  </data>
-  <data name="ActionButton4.BackgroundImage" type="System.Drawing.Bitmap, System.Drawing" mimetype="application/x-microsoft.net.object.bytearray.base64">
-    <value>
-        iVBORw0KGgoAAAANSUhEUgAAABAAAAAQCAYAAAAf8/9hAAAABGdBTUEAALGPC/xhBQAAAAlwSFlzAAAO
-        xAAADsQBlSsOGwAAAIZJREFUOE+1j10KwCAMgz2b755xl/IsvnaL2K20UfbDAmEako+ZROSTafjE12Go
-        tbbB43rK5xSAQq1VYFtmeQBoqZTSreVZvgTknM8yyyjA/qodsDF9gspD2Bj6B+DH+NqzhQQAG+POMnSX
-        AFuc5QFgn6ClHh5iOQVAKNixyucB8NY0vG9JOzzyhrdq5IRgAAAAAElFTkSuQmCC
+        iVBORw0KGgoAAAANSUhEUgAAABgAAAAYCAYAAADgdz34AAAABGdBTUEAALGPC/xhBQAAABl0RVh0U29m
+        dHdhcmUAQWRvYmUgSW1hZ2VSZWFkeXHJZTwAAAVoSURBVEhLhZVrTJNXGMdfrtNSQIoadKRz2o0CorU3
+        WkDIVBRaaGNbwAteh+AARRQlitEYTTRekiX7sH3YPmyZH9wtziybigLRCWTaCW5sCBWhlrb0Ci9zSxbo
+        2f+UliGX7SS/tO85z/k9T57zXhhCCPO7Wh3VIhB83JKQ0Nu4bNlHm5YseZ1hmHC69n+Y5HLFcz7/ft/S
+        pY+vr1hhwL4oEBJcZ0x793If5uZ+1VNfT/qvXCHP6+p8tzMymqRxcW8hMGKqbDo9MlmWddu2AfbiRTJ6
+        +TIZKC52fyAUVi2JiYkLJmGaBYIPnx4+TPrOnCH9p08TC4LNx46RWwrF/ZXR0W/PleRZZuY669atZvbS
+        JcJiL9vQQEZPnSKmwkLPjcTE97GPB8KZlvh4C5X31dWRgRMniAVBtvPnyWB9ve+2XP7jmtjYpOlJTOnp
+        G60lJRZaOZWPQs4ePUpGUZh3xw7SnJDQhT0KEM3c5fOv9paVkX4kMAPL8ePEig1D584RG9rVpFS2rY6J
+        EQaTmKTSjbbiYsvIhQuERTGjKIrFvtHaWjK8fz9plsudexYu/BLxKsBj9ALBGzel0vt9e/b4XiBoENhQ
+        zRDOxIWWOY4cIS0KRZs4Nja5QyLJtRoM1pGzZ/0tYVExi/ayNTVkBPJ76enuJA7nM4j3gVWAHjgTIYqL
+        E96SStvMu3YR64EDxF5dTYYOHSJOJPNA5Kiu9rUrlZ1mrdbCnjzpr5jFGotYtqpqQi6TuVM4nKvwlYHU
+        gDzU31OMSGl8fPJtsbjVsn27z15RQRzAVVlJ3BB4kcx78CAZQbUjVIxrFtd+OdrbmpHhEXG5VE4rTwHz
+        wMRdFDw4jEgFj5dyRyRqsxYVEcfu3cQFPPv2ES8qHEbCYRzgsFZLvO+8Q7xKJXGDVoXCK46Ovob95YBW
+        Ph/8+xwE/wSTyHi81OZVq9qsGs2Ye8sW4srPJy6JhDgTE4kzOpo4IyKIMyyMOLhcX9Py5R4lj0cPtAKs
+        BBwwKfc7p174J5BEhHY9FIk6bBDaIRuiQkDFfsLDSbdU+pdBKPwe8e+BNDBD7vdNn6BYd+6stK5da7bP
+        nz9TDujcoEAw1lJY+CyFz9dCHDubnDJjwltRccS5fr3TjurnlIMBYE5NJY8Nhq7SrCwREsz6xL9y4S4v
+        b3Bt2uSyR0XNkDvQe9ouKu8HvaGh5FfQIxL5OgyG30qUStqmGUkm/3jKy0+48vLcs1XuiI8nL/Ly/rYl
+        JfmovCcgN4JW+l8iGe8oKuoqzcyckSQob3CpVB47l+sXv9KWxYtJt0r1x9ns7HZjQYHNnJxMfoH0EXgA
+        7oFm0CmTjRsNhs6Na9bQF+Tkq57xlJXVu9Rqz9Bs8kWLSG9BwcsqieQONlXnpaaWdul0z7rR+6C8CTSC
+        m8Aol4+36/XGT7VaevCRIIRx6/WWoQULZq2cyveLxY0IrAT0IHm1OTmZT3Q6U2da2qT8B/Ad+BZ05OSM
+        GXW6p4hdBiIZZ1FRt5vPn6vyuwiqCsj9Xyq6qXbDBkWnXm/6OS3NN1X+dUgIeZSdPXZPoxlEXC6IY9pL
+        S7faNBqXC9Iplf95YBb5ZF+RpGbdunQcbO/D1avJ9YC8LT19/Iv8/BeqpKRPEDORAGNeY3HxSYtG43Eq
+        FL5etfpljUzWhPlZ5VOTlGVliR+hHUbs+0mpHP9GpRqM5XAuY20zmGgRRohYKIx9rNd/3qfTOa7l5uLu
+        C63BvARw6fp0eRCMyBslJe8+2bx58EFhoVMlFNJvgQ4kgggQEgykvV0ApEAd+J3z8Z8KxmuA3pr0zikA
+        b4LJZ2FqYBigFdOPNf0NC679Fxi0OPr+XxiAJgwURph/AJfOQQebMR8TAAAAAElFTkSuQmCC
 </value>
   </data>
   <data name="$this.Icon" type="System.Drawing.Icon, System.Drawing" mimetype="application/x-microsoft.net.object.bytearray.base64">

SCrawler/Channels/ChannelsStatsForm.vb

@@ -0,0 +1,84 @@
+' Copyright (C) 2022  Andy
+' This program is free software: you can redistribute it and/or modify
+' it under the terms of the GNU General Public License as published by
+' the Free Software Foundation, either version 3 of the License, or
+' (at your option) any later version.
+'
+' This program is distributed in the hope that it will be useful,
+' but WITHOUT ANY WARRANTY
+Imports System.ComponentModel
+Imports PersonalUtilities.Forms
+Imports PersonalUtilities.Forms.Controls.Base
+Imports PersonalUtilities.Forms.Toolbars
+Friend Class ChannelsStatsForm : Implements IOkCancelDeleteToolbar
+    Private ReadOnly MyDefs As DefaultFormProps
+    Friend Property DeletedChannels As Integer = 0
+    Friend Sub New()
+        InitializeComponent()
+        MyDefs = New DefaultFormProps
+    End Sub
+    Private Sub ChannelsStatsForm_Load(sender As Object, e As EventArgs) Handles Me.Load
+        Try
+            With MyDefs
+                .MyViewInitialize(Me, Settings.Design)
+                .AddOkCancelToolbar()
+                .DelegateClosingChecker()
+                .MyOkCancel.EnableDelete = False
+                If Settings.Channels.Count > 0 Then
+                    RefillList()
+                Else
+                    MsgBoxE("Channels not found", vbExclamation)
+                End If
+                .AppendDetectors()
+                .EndLoaderOperations()
+            End With
+        Catch ex As Exception
+            MyDefs.InvokeLoaderError(ex)
+        End Try
+    End Sub
+    Private Sub ChannelsStatsForm_Closing(sender As Object, e As CancelEventArgs) Handles Me.Closing
+        MyDefs.Dispose()
+    End Sub
+    Private Sub RefillList()
+        CMB_CHANNELS.Items.Clear()
+        If Settings.Channels.Count > 0 Then
+            CMB_CHANNELS.BeginUpdate()
+            CMB_CHANNELS.Items.AddRange(Settings.Channels.Select(Function(c) New ListItem({$"[{c.ID}]: {c.GetChannelStats(False)}", c.ID})))
+            CMB_CHANNELS.EndUpdate()
+        End If
+    End Sub
+    Private Sub ToolbarBttOK() Implements IOkCancelToolbar.ToolbarBttOK
+        MyDefs.CloseForm()
+    End Sub
+    Private Sub ToolbarBttCancel() Implements IOkCancelToolbar.ToolbarBttCancel
+        MyDefs.CloseForm(DialogResult.Cancel)
+    End Sub
+    Private Sub ToolbarBttDelete() Implements IOkCancelDeleteToolbar.ToolbarBttDelete
+        Try
+            Dim c As List(Of String) = CMB_CHANNELS.Items.CheckedItems.Select(Function(cc) CStr(cc.Value(1))).ListIfNothing
+            If c.ListExists Then
+                If MsgBoxE({$"The following channels will be deleted:{vbCr}{c.ListToString(, vbCr)}", "Deleting channels"}, vbExclamation,,, {"Confirm", "Cancel"}) = 0 Then
+                    For Each CID$ In c : Settings.Channels.Remove(Settings.Channels.Find(CID)) : Next
+                    MyMainLOG = $"Deleted channels:{vbNewLine}{c.ListToString(, vbNewLine)}"
+                    MsgBoxE("Channels deleted")
+                    DeletedChannels += c.Count
+                    c.Clear()
+                    MyDefs.ChangesDetected = False
+                    RefillList()
+                Else
+                    MsgBoxE("Operation canceled")
+                End If
+            Else
+                MsgBoxE("No one channel checked", vbExclamation)
+            End If
+        Catch ex As Exception
+            ErrorsDescriber.Execute(EDP.LogMessageValue, ex, "Deleting channels")
+        End Try
+    End Sub
+    Private Sub CMB_CHANNELS_ActionOnChangeDetected(ByVal c As Boolean) Handles CMB_CHANNELS.ActionOnChangeDetected
+        If Not MyDefs.Initializing Then MyDefs.MyOkCancel.EnableDelete = CMB_CHANNELS.ListCheckedIndexes.Count > 0
+    End Sub
+    Private Sub CMB_CHANNELS_ActionOnButtonClearClick() Handles CMB_CHANNELS.ActionOnButtonClearClick
+        CMB_CHANNELS.ListCheckedIndexes = Nothing
+    End Sub
+End Class

SCrawler/Download/ActiveDownloadingProgress.Designer.vb

@@ -0,0 +1,61 @@
+' Copyright (C) 2022  Andy
+' This program is free software: you can redistribute it and/or modify
+' it under the terms of the GNU General Public License as published by
+' the Free Software Foundation, either version 3 of the License, or
+' (at your option) any later version.
+'
+' This program is distributed in the hope that it will be useful,
+' but WITHOUT ANY WARRANTY
+Namespace DownloadObjects
+    <Global.Microsoft.VisualBasic.CompilerServices.DesignerGenerated()>
+    Partial Friend Class ActiveDownloadingProgress : Inherits System.Windows.Forms.Form
+        <System.Diagnostics.DebuggerNonUserCode()>
+        Protected Overrides Sub Dispose(ByVal disposing As Boolean)
+            Try
+                If disposing AndAlso components IsNot Nothing Then
+                    components.Dispose()
+                End If
+            Finally
+                MyBase.Dispose(disposing)
+            End Try
+        End Sub
+        Private components As System.ComponentModel.IContainer
+        <System.Diagnostics.DebuggerStepThrough()>
+        Private Sub InitializeComponent()
+            Dim resources As System.ComponentModel.ComponentResourceManager = New System.ComponentModel.ComponentResourceManager(GetType(ActiveDownloadingProgress))
+            Me.TP_MAIN = New System.Windows.Forms.TableLayoutPanel()
+            Me.SuspendLayout()
+            '
+            'TP_MAIN
+            '
+            Me.TP_MAIN.CellBorderStyle = System.Windows.Forms.TableLayoutPanelCellBorderStyle.[Single]
+            Me.TP_MAIN.ColumnCount = 1
+            Me.TP_MAIN.ColumnStyles.Add(New System.Windows.Forms.ColumnStyle(System.Windows.Forms.SizeType.Percent, 100.0!))
+            Me.TP_MAIN.ColumnStyles.Add(New System.Windows.Forms.ColumnStyle(System.Windows.Forms.SizeType.Absolute, 20.0!))
+            Me.TP_MAIN.Dock = System.Windows.Forms.DockStyle.Fill
+            Me.TP_MAIN.Location = New System.Drawing.Point(0, 0)
+            Me.TP_MAIN.Name = "TP_MAIN"
+            Me.TP_MAIN.RowCount = 1
+            Me.TP_MAIN.RowStyles.Add(New System.Windows.Forms.RowStyle(System.Windows.Forms.SizeType.Absolute, 62.0!))
+            Me.TP_MAIN.RowStyles.Add(New System.Windows.Forms.RowStyle(System.Windows.Forms.SizeType.Absolute, 62.0!))
+            Me.TP_MAIN.Size = New System.Drawing.Size(434, 61)
+            Me.TP_MAIN.TabIndex = 0
+            '
+            'ActiveDownloadingProgress
+            '
+            Me.AutoScaleDimensions = New System.Drawing.SizeF(6.0!, 13.0!)
+            Me.AutoScaleMode = System.Windows.Forms.AutoScaleMode.Font
+            Me.ClientSize = New System.Drawing.Size(434, 61)
+            Me.Controls.Add(Me.TP_MAIN)
+            Me.Icon = CType(resources.GetObject("$this.Icon"), System.Drawing.Icon)
+            Me.KeyPreview = True
+            Me.MinimumSize = New System.Drawing.Size(450, 100)
+            Me.Name = "ActiveDownloadingProgress"
+            Me.Text = "Active downloading progress"
+            Me.ResumeLayout(False)
+
+        End Sub
+
+        Private WithEvents TP_MAIN As TableLayoutPanel
+    End Class
+End Namespace

SCrawler/Download/ActiveDownloadingProgress.resx

@@ -0,0 +1,624 @@
+<?xml version="1.0" encoding="utf-8"?>
+<root>
+  <!-- 
+    Microsoft ResX Schema 
+    
+    Version 2.0
+    
+    The primary goals of this format is to allow a simple XML format 
+    that is mostly human readable. The generation and parsing of the 
+    various data types are done through the TypeConverter classes 
+    associated with the data types.
+    
+    Example:
+    
+    ... ado.net/XML headers & schema ...
+    <resheader name="resmimetype">text/microsoft-resx</resheader>
+    <resheader name="version">2.0</resheader>
+    <resheader name="reader">System.Resources.ResXResourceReader, System.Windows.Forms, ...</resheader>
+    <resheader name="writer">System.Resources.ResXResourceWriter, System.Windows.Forms, ...</resheader>
+    <data name="Name1"><value>this is my long string</value><comment>this is a comment</comment></data>
+    <data name="Color1" type="System.Drawing.Color, System.Drawing">Blue</data>
+    <data name="Bitmap1" mimetype="application/x-microsoft.net.object.binary.base64">
+        <value>[base64 mime encoded serialized .NET Framework object]</value>
+    </data>
+    <data name="Icon1" type="System.Drawing.Icon, System.Drawing" mimetype="application/x-microsoft.net.object.bytearray.base64">
+        <value>[base64 mime encoded string representing a byte array form of the .NET Framework object]</value>
+        <comment>This is a comment</comment>
+    </data>
+                
+    There are any number of "resheader" rows that contain simple 
+    name/value pairs.
+    
+    Each data row contains a name, and value. The row also contains a 
+    type or mimetype. Type corresponds to a .NET class that support 
+    text/value conversion through the TypeConverter architecture. 
+    Classes that don't support this are serialized and stored with the 
+    mimetype set.
+    
+    The mimetype is used for serialized objects, and tells the 
+    ResXResourceReader how to depersist the object. This is currently not 
+    extensible. For a given mimetype the value must be set accordingly:
+    
+    Note - application/x-microsoft.net.object.binary.base64 is the format 
+    that the ResXResourceWriter will generate, however the reader can 
+    read any of the formats listed below.
+    
+    mimetype: application/x-microsoft.net.object.binary.base64
+    value   : The object must be serialized with 
+            : System.Runtime.Serialization.Formatters.Binary.BinaryFormatter
+            : and then encoded with base64 encoding.
+    
+    mimetype: application/x-microsoft.net.object.soap.base64
+    value   : The object must be serialized with 
+            : System.Runtime.Serialization.Formatters.Soap.SoapFormatter
+            : and then encoded with base64 encoding.
+
+    mimetype: application/x-microsoft.net.object.bytearray.base64
+    value   : The object must be serialized into a byte array 
+            : using a System.ComponentModel.TypeConverter
+            : and then encoded with base64 encoding.
+    -->
+  <xsd:schema id="root" xmlns="" xmlns:xsd="http://www.w3.org/2001/XMLSchema" xmlns:msdata="urn:schemas-microsoft-com:xml-msdata">
+    <xsd:import namespace="http://www.w3.org/XML/1998/namespace" />
+    <xsd:element name="root" msdata:IsDataSet="true">
+      <xsd:complexType>
+        <xsd:choice maxOccurs="unbounded">
+          <xsd:element name="metadata">
+            <xsd:complexType>
+              <xsd:sequence>
+                <xsd:element name="value" type="xsd:string" minOccurs="0" />
+              </xsd:sequence>
+              <xsd:attribute name="name" use="required" type="xsd:string" />
+              <xsd:attribute name="type" type="xsd:string" />
+              <xsd:attribute name="mimetype" type="xsd:string" />
+              <xsd:attribute ref="xml:space" />
+            </xsd:complexType>
+          </xsd:element>
+          <xsd:element name="assembly">
+            <xsd:complexType>
+              <xsd:attribute name="alias" type="xsd:string" />
+              <xsd:attribute name="name" type="xsd:string" />
+            </xsd:complexType>
+          </xsd:element>
+          <xsd:element name="data">
+            <xsd:complexType>
+              <xsd:sequence>
+                <xsd:element name="value" type="xsd:string" minOccurs="0" msdata:Ordinal="1" />
+                <xsd:element name="comment" type="xsd:string" minOccurs="0" msdata:Ordinal="2" />
+              </xsd:sequence>
+              <xsd:attribute name="name" type="xsd:string" use="required" msdata:Ordinal="1" />
+              <xsd:attribute name="type" type="xsd:string" msdata:Ordinal="3" />
+              <xsd:attribute name="mimetype" type="xsd:string" msdata:Ordinal="4" />
+              <xsd:attribute ref="xml:space" />
+            </xsd:complexType>
+          </xsd:element>
+          <xsd:element name="resheader">
+            <xsd:complexType>
+              <xsd:sequence>
+                <xsd:element name="value" type="xsd:string" minOccurs="0" msdata:Ordinal="1" />
+              </xsd:sequence>
+              <xsd:attribute name="name" type="xsd:string" use="required" />
+            </xsd:complexType>
+          </xsd:element>
+        </xsd:choice>
+      </xsd:complexType>
+    </xsd:element>
+  </xsd:schema>
+  <resheader name="resmimetype">
+    <value>text/microsoft-resx</value>
+  </resheader>
+  <resheader name="version">
+    <value>2.0</value>
+  </resheader>
+  <resheader name="reader">
+    <value>System.Resources.ResXResourceReader, System.Windows.Forms, Version=4.0.0.0, Culture=neutral, PublicKeyToken=b77a5c561934e089</value>
+  </resheader>
+  <resheader name="writer">
+    <value>System.Resources.ResXResourceWriter, System.Windows.Forms, Version=4.0.0.0, Culture=neutral, PublicKeyToken=b77a5c561934e089</value>
+  </resheader>
+  <assembly alias="System.Drawing" name="System.Drawing, Version=4.0.0.0, Culture=neutral, PublicKeyToken=b03f5f7f11d50a3a" />
+  <data name="$this.Icon" type="System.Drawing.Icon, System.Drawing" mimetype="application/x-microsoft.net.object.bytearray.base64">
+    <value>
+        AAABAAwAMDAQAAEABABoBgAAxgAAACAgEAABAAQA6AIAAC4HAAAYGBAAAQAEAOgBAAAWCgAAEBAQAAEA
+        BAAoAQAA/gsAADAwAAABAAgAqA4AACYNAAAgIAAAAQAIAKgIAADOGwAAGBgAAAEACADIBgAAdiQAABAQ
+        AAABAAgAaAUAAD4rAAAwMAAAAQAgAKglAACmMAAAICAAAAEAIACoEAAATlYAABgYAAABACAAiAkAAPZm
+        AAAQEAAAAQAgAGgEAAB+cAAAKAAAADAAAABgAAAAAQAEAAAAAACABAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAIAAAIAAAACAgACAAAAAgACAAICAAACAgIAAwMDAAAAA/wAA/wAAAP//AP8AAAD/AP8A//8AAP//
+        /wAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAB4YAAAAAAAAAAAAAAAAAAAAAAAAAAAAAjsjgAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAIbOh4AAAAAAAAAAAAAAAAAAAAAAAAAAAH5mfsgAAAAAAAAAAAAAAAAAAAAAAAAAB+
+        xs54YAAAAAAAAAAAAAAAAAAAAAAAAAfsbmxo5wAAAAAAAAAAAAAAAAAAAAAAAIbObObOeMAAAAAAAAAA
+        AAAAAAAAAAAACG5+zmzsaOgAAAAAAAAAAAAAAAAAAAAABn7ObOZmbneAAAAAAAAAAAAAAAAAAAAAfs5s
+        5+zs7I7AAAAAAAAAAAAAAAAAAAAH7Ofm7G7GbGiOAAAAAAAAAAAAAAAAAAB+fs7Ofs5+zmzngAAAAAAA
+        AAAAAAAAAAhn7Ojs5uzm7OZ4yAAAAAAAAAAAAAAAAAaOfm7Obsfsbs7OjnAAAAAAAAAAAAAAAH7Ojs7n
+        7O7ObOZs54AAAAAAAAAAAAAABn6Ozuduzn5uznzmyOcAAAAAAAAAAAAAfn7I6M7s5+zn7Obs5oyAAAAA
+        AAAAAAAIZ+jujuzo7Obs5uxubOjnAAAAAAAAAAAG586M5+js7n7OfOfs5s54cAAAAAAAAABnzo7o5+zu
+        fs5+5uzmzmzowAAAAAAAAAdujn5+fu7Ozuzs7Ofs5+bI6AAAAAAAAHzn7OjOjI5+5+jufs5uzs5ueOAA
+        AAAAAG6M6O6O7n7Ofs7Ozo7Ofmzs53gAAAAAB+zo7IznyOzuzufufs6Ofo6Ofn4AAAAACEdsZ2Z87o5+
+        js7O7O5cjHx8jIgAAAAAAAAAAAAAfOfs7Ojs6OfgAAAAAAAAAAAAAAAAAAAAbo7O6O7O7OfAAAAAAAAA
+        AAAAAAAAAAAAfsjm7Obo7s6AAAAAAAAAAAAAAAAAAAAAaO5+zo7OyO5wAAAAAAAAAAAAAAAAAAAAzn7O
+        js7n7sjAAAAAAAAAAAAAAAAAAAAAaM6Ozuzuzu5wAAAAAAAAAAAAAAAAAAAAbn7Obn5+jshgAAAAAAAA
+        AAAAAAAAAAAAbOjn7Ozs7O5wAAAAAAAAAAAAAAAAAAAAfnzn5+bn7n7AAAAAAAAAAAAAAAAAAAAAbOjs
+        7OzuzshgAAAAAAAAAAAAAAAAAAAAaOyOfn7I5+5wAAAAAAAAAAAAAAAAAAAAbOfs7Ozm7OfAAAAAAAAA
+        AAAAAAAAAAAAbnzn5+bs5u5wAAAAAAAAAAAAAAAAAAAAfOfsjOx+zn7AAAAAAAAAAAAAAAAAAAAAbnzn
+        5o7OfshgAAAAAAAAAAAAAAAAAAAAx+Z+zs5uzm5gAAAAAAAAAAAAAAAAAAAAbs7H5+fObsjAAAAAAAAA
+        AAAAAAAAAAAAZ2js585s7O5wAAAAAAAAAAAAAAAAAAAAjOyH5+jn53aAAAAAAAAAAAAAAAAAAAAACGZs
+        bHxsfGgAAAAAAAAAAAD///////8AAP///////wAA////////AAD///j///8AAP//8H///wAA///gP///
+        AAD//+Af//8AAP//wB///wAA//+AD///AAD//wAH//8AAP/+AAP//wAA//4AAf//AAD//AAB//8AAP/4
+        AAD//wAA//AAAH//AAD/4AAAP/8AAP/gAAAf/wAA/8AAAB//AAD/gAAAD/8AAP8AAAAH/wAA/gAAAAP/
+        AAD+AAAAAf8AAPwAAAAB/wAA+AAAAAD/AADwAAAAAH8AAPAAAAAAPwAA4AAAAAA/AADgAAAAAD8AAP/8
+        AAH//wAA//wAAf//AAD//AAB//8AAP/8AAH//wAA//wAAf//AAD//AAB//8AAP/8AAH//wAA//wAAf//
+        AAD//AAB//8AAP/8AAH//wAA//wAAf//AAD//AAB//8AAP/8AAH//wAA//wAAf//AAD//AAB//8AAP/8
+        AAH//wAA//wAAf//AAD//AAB//8AAP/8AAH//wAA//4AA///AAAoAAAAIAAAAEAAAAABAAQAAAAAAAAC
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAgAAAgAAAAICAAIAAAACAAIAAgIAAAICAgADAwMAAAAD/AAD/
+        AAAA//8A/wAAAP8A/wD//wAA////AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA5+AAAAAAAAAAAAAAAAAA
+        BoyHAAAAAAAAAAAAAAAAAOfn7AAAAAAAAAAAAAAAAAjIzn6AAAAAAAAAAAAAAAAO5uxo7AAAAAAAAAAA
+        AAAAaM7ObI6AAAAAAAAAAAAADn5ubOboyAAAAAAAAAAAAH7Ozs5sbo4AAAAAAAAAAAjI5+fn7saM4AAA
+        AAAAAAAO7n7Ozsbs6OcAAAAAAAAAaH7O5+bn5s6MgAAAAAAABo7o5+zs7Ozm6OAAAAAAAH7I7Ozufn5u
+        zsfsAAAAAAjOjn6Ofs7s5+bsjnAAAAAG6Ozo7O7n5+zs5ujnAAAAaOyOjo587Ozo6I7IjIAAAGxmxsZ+
+        7o7uzsbG7O4AAAAAAAAM587OyOhgAAAAAAAAAAAABo7n5+7OYAAAAAAAAAAAAAzozuzujsAAAAAAAAAA
+        AAAGjufuzs5wAAAAAAAAAAAADOfOyOfowAAAAAAAAAAAAAaOfm7O7mAAAAAAAAAAAAAM7Ofs5sjAAAAA
+        AAAAAAAABn585+7oYAAAAAAAAAAAAAyM6Oxs58AAAAAAAAAAAAAG5+zm5+5gAAAAAAAAAAAABOx+fs7I
+        wAAAAAAAAAAAAAZ+Z8hs7kAAAAAAAAAAAAAMjOjm52fAAAAAAAAAAAAAAGbExsbOAAAAAAAA///////8
+        f///+D////A////gH///4A///8AH//+AA///AAP//gAB//4AAP/8AAB/+AAAf/AAAD/gAAAf4AAAD8AA
+        AAfAAAAP/4AH//+AB///gAf//4AH//+AB///gAf//4AH//+AB///gAf//4AH//+AB///gAf//4AH///A
+        D/8oAAAAGAAAADAAAAABAAQAAAAAACABAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAgAAAgAAAAICAAIAA
+        AACAAIAAgIAAAICAgADAwMAAAAD/AAD/AAAA//8A/wAAAP8A/wD//wAA////AAAAAAAAAAAAAAAAAAAA
+        AAAABgAAAAAAAAAAAAAAeOAAAAAAAAAAAAAG7IcAAAAAAAAAAAB+fujgAAAAAAAAAAbs7OyHAAAAAAAA
+        AGjufm7oYAAAAAAABo7OzsfOhwAAAAAAaO5+5+7s6GAAAAAG5+zs7Ozn7PYAAABo6Ojo7n6IjojgAAAM
+        bGzs7OyOx+wAAAAAAAfo7o7nAAAAAAAAAAaM7OyGAAAAAAAAAAbufu6MAAAAAAAAAAd+zn6GAAAAAAAA
+        AAzn7OznAAAAAAAAAAaOzuiGAAAAAAAAAAbn587sAAAAAAAAAAZ87m6GAAAAAAAAAAzozs6MAAAAAAAA
+        AAaOh+eGAAAAAAAAAABsbGxgAAAAAAAAAAAAAAAAAAAAAP///wD/7/8A/8f/AP+D/wD/Af8A/gD/APwA
+        fwD4AD8A8AAfAOAADwDAAAcA4AAPAP4A/wD+AP8A/gD/AP4A/wD+AP8A/gD/AP4A/wD+AP8A/gD/AP4A
+        /wD/Af8A////ACgAAAAQAAAAIAAAAAEABAAAAAAAgAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAACAAACA
+        AAAAgIAAgAAAAIAAgACAgAAAgICAAMDAwAAAAP8AAP8AAAD//wD/AAAA/wD/AP//AAD///8AAAAABgAA
+        AAAAAABoYAAAAAAABo6MAAAAAABozshgAAAABo5uboYAAABo7OfOeGAABo5+fn6OhgB2xs7O6MfHgAAA
+        aOfIYAAAAABuzujgAAAAAGjn6MAAAAAAzs5+cAAAAABo5+jAAAAAAG7OyOAAAAAAaI6OcAAAAAAMbGYA
+        AAD+/wAA/H8AAPg/AADwHwAA4A8AAMAHAACAAwAAAAEAAPAfAADwHwAA8B8AAPAfAADwHwAA8B8AAPAf
+        AAD4PwAAKAAAADAAAABgAAAAAQAIAAAAAAAACQAAAAAAAAAAAAAAAQAAAAEAAAAAAACjaB0ApmsgAKlt
+        IwCrcCYArXMqALF1LACzeC4ArHYwALR6MQC4fTQAt385AMh1AADJdwQAy3gAAM17AADOfQEAy3oHAM5/
+        CQDMfA0A0H4BAMt/GQC7gDcAvoI6ALmBPADRgAIA0oIEANSDBADVhQUA1ogGANaMBwDZiQYA3I0GANKE
+        CgDWhwkA0YIMANaMCwDZiggA2o0JANyOCQDbkgsA3pAKAN6UCwDekg0A3ZQNAM+EGgDRhhUA1YkSANiN
+        EgDajhcA2pISANqSHgDalh4A3ZgaAOGUCgDgkg0A4ZUOAOSWDgDhmA4A5ZgPAOicDgDklxAA45cVAOGY
+        EADlmRAA5ZwRAOSdFwDonRIA550YAOmfGwDpoBIA6qEUAO2iFADrpBQA7qUWAO6mGADvqBgA8KUXAPCm
+        GADxqRgA9KsZAPKsGgD0rBoA9a0cAPiuGgD1sBsA+bEbAPixHADOhycAzo0lAMqKKwDRjCIA0Y8lANSP
+        JgDTji0A05ImANiRIwDdnScA1JQpANmVKwDXmCoA25stAMGJNQDAhj0A0I84AM2VPwDTmTYA3JwyANKR
+        OQDSlDgA2Js6AOGeIADknS8A3qAxANyiPwDopCAA7qogAOKiLQDtqykA8asjAPOxJwD6syAA+LMkAPq1
+        JwD2tSoA+rYsAPq4LgDiozEA6qUzAOepNQDpqTEA66wyAOmrNwDtqjUA6qw2AO2vNQDjpjoA6aw4AOir
+        PwDwrDgA67A3AO2xOQDssT8A8rIwAPazMwD2tzEA8bE2APq7NgDytDoA+Lc6APW5PAD5uToA+bw7APi7
+        PQD5vD0A/L49APzAPgCxgEMAv4VAALaFSAC5h0sAvJZmALyacgC5mnYAxYlBAMOLRgDHi0QAyY1GAMaO
+        SgDJj0oAyZBEAMyQSgDPlEkAypFNAM6TTADNlE4A0pVHANebQwDUnUUA0JRNANaaSgDDkVUAzpZWAM2X
+        WwDOmVsAzZpdANGZVgDUmlcA0ppaANOcWwDQnF4A16BHANqiSADapUkA3adLAN2lTQDbo1QA1KFeANql
+        WwDgpkMA4KtOAO6sSwDxrUYA8rdAAPGxRQD1uUAA+r1AAPSySADirl0Ax5ljAMOYZgDFmWUAz51gAM+f
+        ZADBnG4AxJ1uANGeYgDQnmUA0aBjANalYwDVoWQA2KRgAN+sYwDbqWYA3aplAN2sZwDRo2sA1KdrANWl
+        bADZqmoA3q5qAMWhcgDNpHMAzKV1AMmmeQDUqXAA1Kp5ANuwcADhrWAA569jAOCvaQDismgA5LRoAOGy
+        bADitGwA+8BDALGchQCxnokAxa2OAMqwkQDPs5MA1LiXAN3AngDjwJYAAAAAAP///wAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAADc2b4AAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAOy6sLjRAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAA+7oVbN2+ogAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAulgR
+        DLTFuvYAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAC6aCMREQzGvroAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAALisLxsUERET4Nm4AAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAA6awxJhsbGxERLuC+0QAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAD6rGArJiYdGxsREV7gvqIAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAACoYz4+NyYm
+        GxsbERGx3Lr2AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAKhsREM3PjcpJh8bGxQRw9y6AAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAtapFSEhGOzc3KSYfGxsbE+DauAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAADXpYJIT0hIRkY3NzcmJhsbGS7w2dEAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        APqeipBPT01IRkZGPjc3JiYbGxFg8L6iAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAJ5yzZdPT09NSEZG
+        Ozc3NyYmGxsZbvC49gAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAGGnLzpd5T09PTk1GRkZDNzcmJh0bEcHj
+        ugAAAAAAAAAAAAAAAAAAAAAAAAAAAACgnsuX9fV5V1dPT05NRkZGNzc3Jh8fGyPu47cAAAAAAAAAAAAA
+        AAAAAAAAAAAAAKELjs719fV+V09XT05OTkhGRjdDNyYmHxsv8dnRAAAAAAAAAAAAAAAAAAAAAAAA+AmI
+        l/X1l/WTV1dXV09PTk5IRkY3NzcpJh0bYPG+ogAAAAAAAAAAAAAAAAAAAAAACGrLl8719fWXeVdXT1RX
+        Tk5NSEZGRjc3KSYdG27tvvcAAAAAAAAAAAAAAAAAAAAIZo7Ll87OzvX1fldXVFRTT1dOTUhGRjs+NyYm
+        JhvC67YAAAAAAAAAAAAAAAAAAJ0JgZDLy8uczs7Ofld5eVdPVE9PTk1IRkY7NzcpJh8i0Ou4AAAAAAAA
+        AAAAAAAA1whxjI6Qy5PLl/XOl3l5V3l5eVdPV05NTUZGRjs3KSYfMPHj6QAAAAAAAAAAAAAABGOBjIyU
+        k8uXnJf1l3l5eXl5V1dXT1dOTU1GRjw7NzYfHzPxvvwAAAAAAAAAAACfWnFwf4CAgoyLy4yXznlPeVR5
+        V1dXV05XTneLz8/Pz8/Pz8/J79wAAAAAAAAAAADqAQECAgMDAwQEBAaXznx5VHl5V1dXV1dPV5WkpKam
+        pqarp6ezs/0AAAAAAAAAAAAAAAAAAAAAAAAAAASXy5NQVXlUeXlXV1dXTpWkAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAASXy5NPVVVUeXlXV1dXV5dnAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAASQy8t4UFVVeVR5eVdXV5dnAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAOQjst8TFBV
+        VVR5eXlXeZeeAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAKMjJCOUFBQT1V5VHl5eZcWAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAKCjI6MdEhPVU95VXlUeZwKAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAKCgoKOdkh0UE9VVXlUeZwKAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAJ/f4KCgkhITExPT1VVeZwJAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAF/f4GMjHNG
+        SExPVU95VZwJAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAF1cXF/iHVGRkh0UFBQT5wJAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAFlZXF/f4FDQ0ZGSExPVZcGAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAFlZWVxdX9vLENGRnRQT5cJAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAFvY2VlcXFxKT9BRkZMTMsEAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAFjY2RlZXFx
+        NSwsRkZGTJMEAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAFgY2NkZWVxYSksPz9GRssEAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAFgWVlkY2RxcTIoLCxGRowEAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAFZWWRZZGRkcTQdLCw/Q4wDAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAFYWVljWWRjZGQyHSgogYECAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAOcBv7+/wcHB
+        wsjHZXFxdQHnAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAADnAQEBAQEBAQEBAQEBAecAAAAA
+        AAAAAAAAAAAAAAAAAAD///////8AAP///////wAA////////AAD///j///8AAP//8H///wAA///gP///
+        AAD//+Af//8AAP//wB///wAA//+AD///AAD//wAH//8AAP/+AAP//wAA//4AAf//AAD//AAB//8AAP/4
+        AAD//wAA//AAAH//AAD/4AAAP/8AAP/gAAAf/wAA/8AAAB//AAD/gAAAD/8AAP8AAAAH/wAA/gAAAAP/
+        AAD+AAAAAf8AAPwAAAAB/wAA+AAAAAD/AADwAAAAAH8AAPAAAAAAPwAA4AAAAAA/AADgAAAAAD8AAP/8
+        AAH//wAA//wAAf//AAD//AAB//8AAP/8AAH//wAA//wAAf//AAD//AAB//8AAP/8AAH//wAA//wAAf//
+        AAD//AAB//8AAP/8AAH//wAA//wAAf//AAD//AAB//8AAP/8AAH//wAA//wAAf//AAD//AAB//8AAP/8
+        AAH//wAA//wAAf//AAD//AAB//8AAP/8AAH//wAA//4AA///AAAoAAAAIAAAAEAAAAABAAgAAAAAAAAE
+        AAAAAAAAAAAAAAABAAAAAQAAAAAAAKdIAACpSgAArU0AALBSAACxVQAAtFYAALdYAAC5WwAAuVwAALxe
+        AAC/YQAAvGgNALllFwC5Zx8AtWUpAMJkAADFaAAAyGsAAMxuAgDOcQYA0nYJANR5DQDFdREAz34aANd8
+        EADafxMA0IAGANSDBQDThAYA1YUFANiJBwDThg8A2YoIANqNCQDcjQoA25AKAN2QCgDekQ0A35UNAN2A
+        FgDXjxAA2Y4UAN6DGQDWjBsA3ZEQAN6UFgDdmBgA4JMKAOCSDQDhlQ4A5ZcPAOSZDgDghhsA44geAOSW
+        EADjmxEA5ZoQAOScEQDnnxQA6Z0SAOWcGgDpoBIA6aEUAO2iFADtpBYA5qAZAO+oGgDwphcA8acYAPGp
+        GAD0qxkA86waAPSsGgD1rhwA9rAbAPawHAD4sBoA+LEcAMyAIADXhSMA0IUnAN+NKgDRkScA2pYhAN2b
+        IwDcmyUA05MoANWWKQDali8A2ZksANucLQDcnS4A3Z0xAN2TOwDblT8A1po7ANKYPADVmj0A154+AOaO
+        JADjkCoA5ZIuAOqTKgDtkysA7ZQrAOiTLQDulSwA4pIxAOmWMQDrlzUA6J02AOOaOQDgnTwA6pw5APCa
+        NADynj0A36AvAN6hMADdoDgA2aE/AOSgIQDioSYA7KchAO2oJgDgoCkA6agrAPewIAD5tCIA+bQnAPOx
+        KAD5tigA+bcvAOOmMgDjpjQA5KU0AOepNQDnrD8A6Ko4AOyvOADprj8A86A/AO+zOgDysjAA8LE3APe4
+        NgD7ujEA8rY7APCzPQDytj4A9Lg6APW6PQD7vDoA+b0+AMWARADPkEUA3ZlEANmbTQDPnF8A0phUAOqe
+        QgDdoEEA2aJGAN2kRADep0kA3aVOANuiUADdplQA4ahGAO2qRwDooEgA4alKAOOtTQDzoUAA869EAPap
+        TgDsskAA77JGAOewTgDusUoA6rBMAPC1QwD0ukUA9rxGAPm9QQDwskkA8rVNAPe+SAD1uk8A+L5IAPWp
+        UADyqlQA6rRRAO22UgDuuFQA47BbAPCyUQD0vFAA8r5WAPC2XAD4sV0AyZ5nAMSlfwDfr3MA2K19AOWt
+        YgDltmcA67NgAOm5YQDsu2oA77ptAPW+awDwvm0A+bhpAOizcQDiu34A7Lt9APS9cAD7wEIA+8FGAPnA
+        SAD4wk4A+MNZAPnEWgD6w2AA/ctkAMOnhQAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAA////AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAABta58AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAbc2/a8oAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAKpvpabIawAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAADWcqgdHaa/awAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAG2JLR8dIM6tXgAAAAAAAAAAAAAAAAAAAAAAAAAAAABlsT0xIx8dLNJzngAAAAAA
+        AAAAAAAAAAAAAAAAAAAAUq58PDMxIyMdWdVr4gAAAAAAAAAAAAAAAAAAAAAAAJypj0REMzMxJSMdochr
+        AAAAAAAAAAAAAAAAAAAAAADLcN9KRURERDMxJSMjw69lAAAAAAAAAAAAAAAAAAAAAFDhuH9KSkQzRDMx
+        JSMq0o1fAAAAAAAAAAAAAAAAAAAY4Nu4gUdHQ0VEM0QlJSNU2XPJAAAAAAAAAAAAAAAAT8TcuNuSTUpK
+        R0REMzsxJSNd1WsAAAAAAAAAAAAAAJtw3bi425hNTUpKSkRERDMzMSOryGsAAAAAAAAAAADMUd2Vl7i4
+        mIFNTU1KSkRERDMzMSXQr2wAAAAAAAAAABfBsJOXmLi4g01NTU1KSkRERDk5MS3ZdJ0AAAAAAAAMz7S0
+        urrFxbiETYFNTU1KSo+xlbq6tMfTa9gAAAAAAJoGBgYGCQkL35FLTU2BTU1KthkZKys1NmSgAAAAAAAA
+        AAAAAAAAAAnfl0pLTU1NgU29FgAAAAAAAAAAAAAAAAAAAAAAAAAABt2VgkpNgU1NTdwVAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAGxrGPSkpKTU2B2xQAAAAAAAAAAAAAAAAAAAAAAAAAAAbCi5BDREpLTU3cEwAAAAAA
+        AAAAAAAAAAAAAAAAAAAABMGIi3xAR0pLTdwTAAAAAAAAAAAAAAAAAAAAAAAAAAADsoWKjzlEQ0pL3BEA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAOrhYWFOztEREq7EQAAAAAAAAAAAAAAAAAAAAAAAAAAA6tdXIV5OTtE
+        Q7YLAAAAAAAAAAAAAAAAAAAAAAAAAAABpVxcdn0nMztEtgkAAAAAAAAAAAAAAAAAAAAAAAAAAAGhWFpd
+        di8nMzu1CQAAAAAAAAAAAAAAAAAAAAAAAAAAAaVTWFxdViUnJ7EGAAAAAAAAAAAAAAAAAAAAAAAAAAAB
+        YFNYWFhcKSQnsAYAAAAAAAAAAAAAAAAAAAAAAAAAAA/XYWBjoaF3VFZWDQAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAA8BAQEBAQEEBA4AAAAAAAAAAAAAAAD///////x////4P///8D///+Af///gD///wAf//4AD//8A
+        A//+AAH//gAA//wAAH/4AAB/8AAAP+AAAB/gAAAPwAAAB8AAAA//gAf//4AH//+AB///gAf//4AH//+A
+        B///gAf//4AH//+AB///gAf//4AH//+AB///gAf//8AP/ygAAAAYAAAAMAAAAAEACAAAAAAAQAIAAAAA
+        AAAAAAAAAAEAAAABAAAAAAAApWYWAKhpGQCqbBsAqm0dAKxuHgCucCEAsHMjALJ2JgC2eioAuH4uALyC
+        MgC9gzQAvoU1AN+YEwDklw8A5ZkQAOmdEgDooBIA6aEUAO2hFQDtpRYA8KYXAPGqFwDxpxgA8qoZAPSr
+        GgD0rRoA86wcAPauHAD3sBoA97AcAPmwGgD4sRwAwIY3AMGJOQDDizwAxIs8AMWNPgDjnSUA5J4nAN6g
+        MADnoyAA5aAnAOSjKQDgoi8A7awpAPCsIwD6syIA+rcrAOKlMwDqqzIA6Kk3AOSpOgDpqz0A+rozAPq6
+        NADytjsA97s+APe8PAD5uzgA36VCAN+sVADgqUQA5axHAOmuQADkrUoA6bNKAO63TgDws0EA9btDAPS6
+        RQD6vkEA9LxMAPm+SADhrlUA5LJZAPK7UAD7wEMA+8NOAPbBUAD6xFIA+8VUAPDDaQD0xmwA9shtAPjK
+        bgD6zW8A8cmCAPPMhAD0zoYA99CHAPDPmQDw0JkAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAD///8AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAmAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAACZcJgAAAAAAAAAAAAAAAAAAAAAAAAAAJjYnXSYAAAAAAAAAAAAAAAAAAAAA
+        AAAiRREPJ10mAAAAAAAAAAAAAAAAAAAAAAtHFhYQECddJgAAAAAAAAAAAAAAAAAACkobGxYRERAnXSYA
+        AAAAAAAAAAAAAAAJUjAbGxgbFhEQKF0mAAAAAAAAAAAAAAhSTjEgGxsbFhYRECtdJgAAAAAAAAAABjpI
+        SDggICAbGBgWERAnXSYAAAAAAAAFOVBSUk84IDAgGxtUW1paWlwmAAAAAAAABQUGBgg8IDAgMBtWCwsL
+        IiIAAAAAAAAAAAAAAAY6HiAgMCBXCgAAAAAAAAAAAAAAAAAAAAVHGx4wICBXCgAAAAAAAAAAAAAAAAAA
+        AAVJGxseMCBXCQAAAAAAAAAAAAAAAAAAAAVJLxsbHjBXCAAAAAAAAAAAAAAAAAAAAAFELhYcGx5XCAAA
+        AAAAAAAAAAAAAAAAAAFDMxMVGxtXBgAAAAAAAAAAAAAAAAAAAAFANCsWFhxVBgAAAAAAAAAAAAAAAAAA
+        AAE/MisOEBZVBQAAAAAAAAAAAAAAAAAAAAE9KS0OEBNUAwAAAAAAAAAAAAAAAAAAAAE+S0xAND9TAwAA
+        AAAAAAAAAAAAAAAAAAABAQEBAwEBAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA////AP/v
+        /wD/x/8A/4P/AP8B/wD+AP8A/AB/APgAPwDwAB8A4AAPAMAABwDgAA8A/gD/AP4A/wD+AP8A/gD/AP4A
+        /wD+AP8A/gD/AP4A/wD+AP8A/gD/AP8B/wD///8AKAAAABAAAAAgAAAAAQAIAAAAAAAAAQAAAAAAAAAA
+        AAAAAQAAAAEAAAAAAAClZhYAsnYmALN4KQC4fi8A1Y0XANWOGADXkBkA2pUbANuVHADclhwA3poeAOCc
+        HwDgmyAA46EiAOaiIwDmpiMA56cnAOilIwDppiUA66omAO2rJwDuricA46YsAOyrKADurikA7q4sAPCv
+        KQDvsS4A8LAqAO2vMQDkpjgA5q8+AOqwOADwszIA4qtBAOi0TwDyvEoA7LlSAOSyXADnt18Aw5ljAMui
+        bQDqumEA5LhoAOa7cADpv3MA78FlAPDFdgDyyXkA88x6APXNegD20IAA6MeQAOnIkQDpyZcAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAP///wAAAAAAAAAAAwAAAAAAAAAAAAAAAAAAAzcCAAAAAAAAAAAAAAAAAycFNQIAAAAA
+        AAAAAAAAAysLCAY1BAAAAAAAAAAAAy8SDg0IBjUEAAAAAAAAAzMaFBIODQgINQQAAAAAAzQlIhQaEg4f
+        Li01BAAAKQEBAQEbGhQUMAQEBAQqAAAAAAABGxsbFDMEAAAAAAAAAAAAARwbGxszBAAAAAAAAAAAAAEe
+        FBsbMwQAAAAAAAAAAAABIRQcHDMEAAAAAAAAAAAAASARFBQzBAAAAAAAAAAAAAEjFw4WMwQAAAAAAAAA
+        AAABLCgkJjMDAAAAAAAAAAAAAAEBAQEBAAAAAAAA/v8AAPx/AAD4PwAA8B8AAOAPAADABwAAgAMAAAAB
+        AADwHwAA8B8AAPAfAADwHwAA8B8AAPAfAADwHwAA+D8AACgAAAAwAAAAYAAAAAEAIAAAAAAAgCUAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAEAAAADAAAABgAAAAgAAAAGAAAAAwAA
+        AAEAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAQAAAAMAAAAFgAA
+        ABsAAAAWAAAACwAAAAQAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAwAA
+        AAwAAAAfAAAAMwAAADwAAAAyAAAAHQAAAAsAAAACAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAACAAAACSccDyHPllLiypFQ4M2UUesdFQtZAAAANQAAABoAAAAJAAAAAgAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAEAAAAHAAAAF8aOTb/RlU3z0pVH/82UU/K/iUvcAAAAUAAAADAAAAAWAAAABgAA
+        AAEAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAQAAAAUAAAATs4BGjtOXUfXLfxn/0pE5/9ikYP7Rl1T3pXdBvQAA
+        AEoAAAAqAAAAEgAAAAUAAAABAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAABAAAAA+RaDhc0ZdR+M6HJv3Legf/yHUA/9aa
+        Sv/Tn1v51JlU+nxZMZcAAABDAAAAJAAAAA4AAAADAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAACAAAADFg/ITLPlE/1z4wz+NGC
+        DP/NewD/y3gA/8l3BP/apVv/zZdV89OYU/hHMxxzAAAAPAAAAB8AAAALAAAAAgAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAIAAAAJJxwOIMiO
+        SuHNj0Dy1YkR/9ODBf/QfwH/zXsA/8t4AP/MfA3/3apl/8yXV/DLklDuHBQLXQAAADYAAAAaAAAACAAA
+        AAEAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAQAA
+        AAcAAAAXu4VEvMuPRvPajhf/2osK/9aIBv/UgwX/0YAD/819Af/LeQD/z4Qa/92sZ//OmFfyvYhL2QAA
+        AE8AAAAvAAAAFQAAAAYAAAABAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAABAAAABQAAABOodjyMyY5H9tuTH//ekg7/3Y4K/9qLCP/Whwb/1IMF/9GAA//PfQD/y3kA/9OO
+        Lf/bqWX90plW96R2QbsAAABJAAAAKQAAABEAAAAFAAAAAQAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAEAAAAD4hfL1rHjEb42ZUq/eOXFf/jlQ7/35IN/92OCv/aiwn/14gG/9SE
+        Bf/SgQT/z34B/8t6AP/Xm0P/1qNg+dKYU/p6WDCVAAAAQgAAACMAAAAOAAAAAwAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAIAAAALUzkcMsSJQvPRkTL3550Y/+ecEf/lmBD/45UP/+CS
+        Df/djgr/24sJ/9eIB//VhAb/0oED/9B+Af/NfAP/26NU/9CcXPPSllP4RzMccwAAADsAAAAeAAAACgAA
+        AAIAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAgAAAAkUDgYeu4I938eLO/Lpnxv/7qIU/+qg
+        E//onRL/5pkR/+SWDv/gkw3/3o8L/9uMCf/ZiQf/1YUG/9OBBP/QfwP/zn8J/9+sY//Nmlvwy5JQ7RYQ
+        CVoAAAA0AAAAGQAAAAgAAAABAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAABAAAABwAAABaueDe4wYY98+qq
+        Mf/vphb/8KYX/+2iFf/roBP/6J0S/+aZEf/klw//4JQO/96QCv/bjQn/2YoI/9WFBv/TgwT/0H8D/9GG
+        Ff/gr2n/z5pb87qHSdYAAABOAAAALgAAABQAAAAGAAAAAQAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAEAAAAFAAAAEpxr
+        MIe9gjr36Ks///azM//zqRj/8agY//CkF//uoxX/66AU/+mdEv/mmhD/5JcP/+GUDf/ekAr/240K/9mJ
+        B//Whwb/04IE/9B/Af/Ujyb/3q5p/dKZV/ifcj62AAAARwAAACgAAAARAAAABAAAAAEAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAMAAAAOfVUkV7p/N/jcoT389rlB//m4Of/1rBv/86oZ//GoGP/wphf/7qMV/+ugE//pnhL/55oR/+SX
+        EP/hlQ7/3pIL/9yNCf/aiwf/1ocF/9ODBP/RgAP/2Js6/9ioZvjTmFT6dlYukQAAAEEAAAAjAAAADQAA
+        AAMAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAgAAAAtGMBQvtXsz8sySOPb1uUD/+75B//q8Pf/4sB//9Kwa//OrGv/yqRn/8KYX/+6j
+        Ff/roBT/6Z4T/+ecEf/kmBD/4ZUO/9+SC//djgn/2ooI/9aHBv/UgwT/0YAC/9ylT//So2Tzz5VR90Mw
+        GnAAAAA6AAAAHQAAAAoAAAACAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAACAAAACRIMBR2udS/cvYI08/K3QP/7v0H/+79B//u+Qf/4syX/9q0a//Ws
+        G//zqxr/8akZ//GmGP/uoxX/7aEU/+qeE//nnBH/5ZgP/+GVDv/fkg3/3I4K/9qLB//WiAf/1IQF/9KE
+        Cv/hrWD/z55i8MmPTusPCwZXAAAAMwAAABgAAAAIAAAAAQAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAEAAAAHAAAAFqJtKba0eTDz7LE///q+Qf/7v0H/+79B//vA
+        Q//6tiz/+K4a//auG//1rRr/9Ksa//KpGf/wpxj/76MX/+2hFP/pnxP/6JwS/+WYD//hlQ//35IN/92O
+        Cv/aiwn/14gH/9SEBf/ViRP/4rJo/8+cXfS4hEjVAAAATQAAAC0AAAAUAAAABgAAAAEAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAQAAAAUAAAASjl8jgq91LPfjpjr/+Ls///q+
+        Qf/7v0H/+79B//vAQ//7vDb/+bEc//iwHP/2rhz/9a0b//SrGv/yqhn/8agY/++kF//toRT/6p8T/+ic
+        Ev/lmRD/45YO/9+TDf/djwv/2owI/9eJB//UhQT/2JEj/+Gya/zRmVf5mm48sQAAAEYAAAAnAAAAEAAA
+        AAQAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAwAAAA5zTBtTrXIp+NOY
+        NPzytz3/+bw+//q9QP/6vkH/+79B//u/Qf/7vj7/+rMg//mxHP/4sBz/9q4c//WsG//0rBr/86oZ//Go
+        GP/vpBf/7aEV/+qfE//onRH/5ZkQ/+OWD//gkw7/3Y8J/9uMCP/XiQf/1YQG/9uaNv/armz30phU+nJR
+        LI0AAABAAAAAIgAAAAwAAAADAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAACAAAACzom
+        DSyobyXxv4Ut9e2wOv/1ujz/+Ls9//m8QP/6vUD/+r5B//u/Qf/7v0L/+rUn//mxG//5sR3/+LAc//au
+        HP/1rRv/9Kwa//OqGf/xqBj/76QX/+6iFf/roBP/6JwS/+aZEP/klg//4JMN/96OC//bjQn/2YkI/9WF
+        Bv/fpkz/06Zp8s2TUPY/LRhtAAAAOQAAABwAAAAJAAAAAgAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAEGRAFFKRqI9mwdibx56o3//G0Ov/ztjv/9bo8//a7Pv/5vED/+r1A//q+Qf/7wEP/+rgu//mx
+        G//5sh3/+bId//ixHP/2sBz/9a0b//SrGv/yqhn/8agY//CmF//uoxX/6qAT/+mdEf/mmRD/5JYP/+CT
+        Dv/ejwr/3IwK/9mJB//Whwn/4q5d/9GiZ+7Hj0znEg0HSAAAACcAAAAPAAAAAwAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAGoGcgpaluIvLdoDP/6q03/++yOf/xtDr/87Y7//S4PP/2uz3/+bw+//m9
+        QP/6vkL/+rs3//myHP/5sh3/+bId//myHf/5sR3/+LAc//WtHP/0rRv/9KsZ//KpGP/wphf/7qMV/+ug
+        E//onhL/55oR/+SXD//hlA3/3pAL/9yNCf/Zigf/2I0S/+S0aP/ToGPwvolJxAAAACcAAAARAAAABQAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAACiaB9ppmsg9dKVL//nqjX/67A3/+6yOP/wtDr/87Y7//W4
+        PP/4uz3/+b0+//m9QP/5vUD/+rw7//myHv/5sh3/+bId//myHf/5sh3/+LEd//iwHP/2rhv/9awb//Or
+        Gv/xqBn/8KYY/+6jFf/roBP/6p4Q/+icDv/llw3/4ZQK/9+QCf/cjQb/2okF/9mRHf/ismj40ZVQ9MGK
+        SogAAAALAAAAAwAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAACmaR7PyYgn+uSdL//loDD/56Iy/+qk
+        M//rpjT/7qk3//CrOP/xrTn/8a05//CxOP/4vD7/+bxA//izJP/4sRz/+bId//myHf/5sh3/+bId//mx
+        Hf/4sBz/9q4c//WsG//zqxr/8qkY//GrI//xsDr/8bFF//W0Sf/2s0n/9LJI//OwSP/yr0f/8a1G//Cs
+        R//urEv/5ahV6dGVT+AAAAAEAAAAAQAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAACkaR2XpGoe/6Vq
+        H/+mayD/pmwh/6hsIv+pbSP/qW4k/6twJf+scCf/rXIn/65zKf/6vDz/+LxA//a1Kv/2sBr/+bEd//my
+        Hf/5sh3/+bId//myHf/5sR3/+LAc//auHP/1rRv/9Ksa//a3Ov/EiED/xYlB/8aKQ//Hi0T/yY1G/8qO
+        R//Lj0n/zJBK/82RS//Ok0z/0JRN/9GVTpcAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAK1yJ//5uzv/9rs+//a3
+        Mf/1rhr/9rAc//iyHf/5sh3/+bId//myHf/5sh3/+bEd//iwHP/2rhz/9a0b//m5Ov/Chj//AAAAKwAA
+        AA4AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAKtw
+        Jf/4tzr/9Lg9//W3OP/0rRz/9a4b//awHP/4sh3/+bId//myHf/5sh3/+bId//mxHf/4sBz/9q4c//q8
+        O//AhT3/AAAAKwAAAA4AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAKpvJP/0tTn/8rU8//O2Pf/zsSf/86wZ//WuG//2sBz/+LEd//myHf/5sh3/+bId//my
+        Hf/5sh3/+LEc//u9PP+/gzv/AAAAKwAAAA4AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAKluI//yszf/77M6//K1Pf/ysjD/8aoY//SsGv/1rhz/9rAc//ix
+        Hf/5sh3/+bId//myHf/5sh3/+bId//y+Pf+9gTn/AAAAKwAAAA4AAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAKdtIv/wsDb/7bA5//CzO//xszj/8Kkb//Gq
+        Gf/yqxr/9a4b//awHP/4sR3/+bId//myHf/5sh3/+bId//y/Pv+7gDf/AAAAKwAAAA4AAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAKZrIf/tqzT/6qw3/+2w
+        OP/vsjr/7qog/+6nFf/xqhn/86wa//StG//2sBz/+LEd//myHf/5sh3/+bId//zAPv+5fjX/AAAAKwAA
+        AA4AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAKZq
+        IP/pqTL/56k0/+qsN//tsDn/7asp/+2jFP/vqBj/8aoZ//KsGv/1rhv/9rAc//ixHP/5sh3/+bId//zA
+        Pv+4fDT/AAAAKwAAAA4AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAKRqHv/mpC//5KYz/+epNP/pqzf/66wy/+mhFf/rpBT/7qcY//CqGf/zrBr/9K0b//Ww
+        HP/2sRz/+LId//zAPv+2ezL/AAAAKwAAAA4AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAKRoHf/koi//4KIx/+SmMv/nqDb/6aw4/+ikIP/ooBL/7aQV/+6n
+        F//xqRn/8qwa//StG//1rhz/9rAc//zAPv+1eTD/AAAAKwAAAA4AAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAKNoHf/goC3/36Aw/+CiMP/kpDP/56k2/+en
+        Lv/mnRL/6KAT/+ujFf/uphj/8KkY//KrGv/0rRv/9a4c//y+Pf+zeC7/AAAAKwAAAA4AAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAKNoHf/enSz/3J0v/96f
+        L//goTD/5KYy/+anM//knRf/5Z0R/+igE//qoxX/7qYX//CpGP/yqxn/86wb//q9Pf+ydi3/AAAAKwAA
+        AA4AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAKNo
+        Hf/dnCr/25wt/9ydLv/eny//4KIw/+OmM//hniD/4ZgO/+WdEv/ooBP/6qIU/+6mF//wqBj/8qsa//m9
+        O/+wdCv/AAAAKwAAAA4AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAKNoHf/bmCj/2Zgs/9qaLf/bnC7/3p8v/+CiMf/goCn/3pUO/+GZD//lnRL/6KAT/+qi
+        Ff/uphf/8KgY//a5O/+ucyn/AAAAKwAAAA4AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAKNoHf/XlSf/1ZYq/9mYLP/ami3/25wu/92eL//goTH/3Zga/96U
+        C//hmBD/5ZwS/+efE//qohX/7aYX//W4Ov+tcij/AAAAKwAAAA4AAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAKNoHf/WlCb/1JQo/9WVKf/XmCr/2pot/9uc
+        Lv/enzH/3Z0n/9uSC//elQ3/4ZgQ/+ScEf/nnxP/6qIU//K1OP+rcCb/AAAAJwAAAA0AAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAKNoHf/TkiX/0pIo/9OU
+        KP/VlSj/15cq/9qaLf/bnC//3Z4v/9qSEv/ajwn/3ZUO/+CXD//knBH/558S//GyNv+qbyX/AAAAHwAA
+        AAkAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAKNo
+        Hf/SjyT/0I8m/9KSJ//TlCj/1JUp/9eXKv/ZmS3/250w/9qWHv/WjAf/25IL/92UDf/hmBD/5JwR/+2v
+        Nf+pbiP/AAAAEwAAAAUAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAKNoHf/RjCL/zY0l/8+OJv/RkCf/05Mo/9SUKf/Wlyn/2pkt/9qaLP/WjQ//1owI/9qP
+        Cv/dlA7/5aYz/+qsNP+obCL/AAAACAAAAAIAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAKNoHZ6jaB3/1J1G/9SeRf/XoEf/2qJI/9qlSf/bpkn/3adL/+Cr
+        Tv/gpkP/25wr/92eLP/goi//46Uv/6ZqIP+jaR+gAAAAAgAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAACjaB2eo2gd/6NoHf+jaB3/o2gd/6No
+        Hf+jaB3/o2gd/6NoHf+jaB3/o2gd/6NoHf+jaB7/pWke/6RpHp4AAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAD///Af//8AAP//
+        8B///wAA///gD///AAD//8AH//8AAP//gAP//wAA//8AAf//AAD//wAB//8AAP/+AAD//wAA//wAAH//
+        AAD/+AAAP/8AAP/wAAAf/wAA//AAAB//AAD/4AAAD/8AAP/AAAAH/wAA/4AAAAP/AAD/AAAAAf8AAP8A
+        AAAB/wAA/gAAAAD/AAD8AAAAAH8AAPgAAAAAPwAA8AAAAAA/AADwAAAAAB8AAOAAAAAADwAA4AAAAAAP
+        AADgAAAAAA8AAOAAAAAADwAA4AAAAAAPAADgAAAAAD8AAP/8AAB//wAA//wAAH//AAD//AAAf/8AAP/8
+        AAB//wAA//wAAH//AAD//AAAf/8AAP/8AAB//wAA//wAAH//AAD//AAAf/8AAP/8AAB//wAA//wAAH//
+        AAD//AAAf/8AAP/8AAB//wAA//wAAH//AAD//AAAf/8AAP/8AAB//wAA//wAAH//AAD//AAAf/8AAP/8
+        AAD//wAA//4AA///AAAoAAAAIAAAAEAAAAABACAAAAAAAIAQAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAJCKQwWOiQLMQAA
+        ADAAAAAfAAAACgAAAAEAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAACyHwmPemQ
+        KPPulSz/w3YbvwAAADgAAAAcAAAABwAAAAEAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAatq
+        Hh3qkirx5a1i//KqVP/vly7/klgQiAAAADMAAAAXAAAABQAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AABOMA0J5I4l1eidNv/dpU7/26JQ//iyXv/ulCz+SisDXQAAAC0AAAARAAAAAwAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAABNyJIaPqmzb64ahG/9OEBv/QgAb/3aZU//WpUP/okCj4EgoARAAAACcAAAANAAAAAgAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAALOfhxj6JUt+eesP//dkRD/2IkH/9SDBf/Thg//5bZn//OhQP/ZhSHgAAAAPQAA
+        ACEAAAAKAAAAAQAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAACsWgUMeONJPjvskb/5Zwa/+CSDf/djgr/2IkH/9WEBf/WjBv/77pt//Ca
+        NP+6cRiwAAAAOAAAABsAAAAHAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAY5RDBfdhRrt869E/+2oJv/onRL/5ZgQ/+GUDf/djgv/2ooI/9WF
+        Bv/ali//+Lhp/++XLv+IUQyAAAAAMgAAABUAAAAEAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAG1YAVy+2pRfvzsjD/76UX/+yhFP/onRP/5ZkQ/+GU
+        Dv/dkAr/2osI/9aGBv/doEH/+bJd/+2TK/4rGQBQAAAALAAAABAAAAACAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAABMl2D5TjmTb7+sVa//WsHP/yqRj/8KYX/+2i
+        FP/pnhL/5pkR/+KVDv/dkQv/24sI/9iJCv/jsFv/9qlO/+SOJfQAAABAAAAAJgAAAA0AAAACAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAK7bAtd14Qg+/3LZP/6vkH/97Ag//Sr
+        Gf/yqhn/8KYX/+2iFf/qnhP/5psR/+KWDv/fkQv/24wJ/9mOFP/su2r/86A//9WCHdgAAAA8AAAAIAAA
+        AAkAAAABAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAABl1EBKc56Evb6w2D/+8FG//u/
+        Q//5tCf/9q0Z//SsGv/yqRr/8KYX/+6iFf/qnxP/55sR/+KWD//ekQz/24wJ/9uVIf/0vXD/8Jo0/6xo
+        EqMAAAA3AAAAGgAAAAYAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAVIrAA7Hcwjm8LJR//rB
+        S//7v0H/+8BD//u6Mf/4sBr/9q4c//WsG//zqhn/8acY/+6jFf/qnxP/55sR/+OXDv/fkg3/240J/96e
+        Mv/6uGn/7ZUs/2Y+BWoAAAAxAAAAFQAAAAQAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAFv2sHv+Cd
+        PP74wk7/+r1A//q+Qf/7wEL/+7w6//mxHf/5sRz/964c//StGv/0qxr/8agY/+6iFv/rnxP/6JwR/+SW
+        EP/gkg3/3I0J/+KoSv/4sFz/6pIo/DokA1MAAAArAAAAEAAAAAIAAAAAAAAAAAAAAAAAAAAAAAAAA7Zj
+        CYbQhCT7879V//S4O//2uz7/+bxA//q+Qv/7vj//+bQi//mxG//5sh3/968c//WtG//zqhn/8agY/++l
+        Fv/roBP/6JwR/+WXD//gkg3/3pAP/+m5Yf/2qU7/4Ioi7QAAAD8AAAAlAAAADAAAAAIAAAAAAAAAAAAA
+        AACtWQRFxXMO++22Uv/vszr/8rY7//W5PP/4vD3/+r5B//q+Qf/5tij/+bEb//myHf/5sR3/97Ac//Wu
+        G//0qxr/8akZ/++kFv/roRT/6J0Q/+WYDf/gkwr/3pQW//C+bf/ynj3/z38axgAAACkAAAASAAAAAwAA
+        AAAAAAAAvWoGQrpiA/Trs2D/6rBL/e2ySv3xtEz987dN/fW6Tv30vE/9+L1A//m3L//4sRv/+bId//my
+        Hf/5sh3/+LAc//atHP/zqxv/87Iw//G1Q/7ws0f987VL/fGySv3vsEn98LZc/vW+a/7tlCv/4I0mmAAA
+        AAkAAAACAAAAAAAAAACtTgBIsVQCvLNXAP+xVQD/tFcA/7dYAP+5WwD/vF4A/71fAP/5wlLz97g2//aw
+        G//5sR3/+bId//myHf/5sh3/+LAc//auHP/3vEb/13wQ/9p/E//dgBb/3oMZ/+CGG//jiB7/5o4k/+eO
+        ItrnjiVwAAAAAQAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAulwA//jA
+        UfL1uTr/9K8e//awG//5sh3/+bId//myHf/5sh3/+LAd//i+SP/UeQ3/AAAALgAAAA0AAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAC3WgD/87xP8vK2Pv/zsSj/9KwZ//awHP/4sR3/+bId//myHf/5sh3/+cBI/9J2Cf8AAAAuAAAADQAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAALRXAP/xuU3y8LM9//KyMv/xqhj/9K0b//avHP/4sh3/+bId//myHf/6wUj/znEG/wAA
+        AC4AAAANAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAsVQA/+61S/Lsrzn/8LE3/++oGv/xqhj/9K0a//awHP/4sR3/+bId//rB
+        SP/MbgL/AAAALgAAAA0AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAACwUgD/6bBI8ueqNv/srzj/7Kch/+2lFP/wqhn/9K0b//av
+        HP/4shz/+sFI/8hrAP8AAAAuAAAADQAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAK9PAP/mrEXy46Yy/+iqOP/pqCv/6aET/+2m
+        Fv/xqRn/86wa//SuHP/5wEj/xWgA/wAAAC4AAAANAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAArUwA/+KpRPLfoTD/5KU0/+ep
+        Nf/moBn/6aAS/+2lF//wqRj/86wa//e+SP/CZAD/AAAALgAAAA0AAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAACqSwD/4KZC8tyd
+        L//foC//46Y0/+SgIf/kmw//6KEU/+ykFv/wqRj/9bxH/79hAP8AAAAuAAAADQAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAKdJ
+        AP/do0Dy2Zot/9ydLv/fojL/4KAp/9+WD//knBH/6KAT/+2lFv/0ukX/vF8A/wAAAC4AAAANAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAp0gA/9mfPvLWliv/2Zos/9ydL//eoDD/3ZgY/9+VDP/kmxL/558U//C2Q/+5XAD/AAAALgAA
+        AA4AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAACnSAD/2J498tOTKP/Wlin/2Zks/9ydMf/cmyX/25AK/9+WDv/jmxH/7LJA/7dY
+        AP8AAAAsAAAADAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAKdIAP/Wmjr90ZEn/9OTKP/Vlin/2Zkt/9ucLf/XjxD/2Y8J/9+V
+        Dv/prj//tFUA/wAAAB4AAAAHAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAp0gA1tWcRK/SmDz/1Zo9/9eePv/ZoT//3aRE/92g
+        OP/alyH/3Zsj/+KhJv+zVgHoAAAACwAAAAIAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAACnSABLp0gA1qdIAP+nSAD/p0gA/6dI
+        AP+nSQD/qUkA/6pLAP+sTgD/sFIA4KJGAE0AAAABAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAP/4D///8Af//+AH///gA///wAH//4AA//8AAP/+AAB//gAAP/wAAB/4AAAP8AAAD+AA
+        AAfgAAADwAAAAcAAAAGAAAABgAAAA/+AAf//gAH//4AB//+AAf//gAH//4AB//+AAf//gAH//4AB//+A
+        Af//gAH//4AB//+AAf//gAP/KAAAABgAAAAwAAAAAQAgAAAAAABgCQAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAADGjj9nxo4//8aOP2cAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAMSMPGfFjD7/8M+Z/8aO
+        P//Gjj9nAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAwok5Z8OKO//pqz3/450m//DQmf/Gjj//xo4/ZwAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAC+hTZnwIY3//Cz
+        Qf/onBH/5JcP/+OdJf/w0Jn/xY4+/8aOP2cAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAALuBMme8gzP/9LpF/++mFv/soRT/6JwS/+WYEP/jnyb/8dCZ/8WN
+        Pv/Gjj9nAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAuH0tZ7l/
+        L//5vkj/9Kwa//KpGf/wphf/7aEV/+meEv/lmRD/5J4n//DQmv/FjT3/xY0/ZwAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAC0eClntnoq//vFU//6syL/964a//WsG//yqhr/8acY/+2i
+        Ff/qnhP/5ZkQ/+SfJ//x0Jr/xY09/8WOPmcAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAALF0
+        JGeydib/+8ZU//vAQ//6tyv/+bAa//evHP/1rRv/86sZ//GnGP/tohb/6p8T/+aaEP/loCf/8dGZ/8SM
+        Pf/FjT5nAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAArXAgZ69xIv/3uz7/+r1A//q/Q//6ujP/+bEb//my
+        Hf/3sBz/9a0b//OqGv/xpxj/7qMV/+qfE//nmhD/5Z8n//HQmv/Dizz/xY09ZwAAAAAAAAAAAAAAAAAA
+        AAAAAAAAq24e//K2O//2wVD/+sRS//vFVf/7w07/+ro0//myHf/5sh3/+LAc//WuHP/0qxr/9shs//fQ
+        h//0zob/88yE//HJgv/x0Zj/xIs8/wAAAAAAAAAAAAAAAAAAAAAAAAAAqWscdaptHf+sbx7/rnAg/69y
+        Iv+wcyP/+bs4//mxHP/5sh3/+bId//mxHf/2rhz/+Mpu/7yCMv+9gzT/voU1/8CGN//AiDj/wok6dQAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAACucCH/97w8//ewGv/5sh3/+bId//my
+        Hf/5sRz/+cxv/7l/L/8AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAACsbh7/9btD//WtGf/3sRz/+bId//myHf/5sh3/+81v/7h8Lf8AAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAACqbB3/9LxM//Os
+        HP/1rRr/97Ed//myHf/5sh3/+85v/7Z6Kv8AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAACpahr/8rtQ//CsI//xqhf/9K4b//exHf/5sh3/+85v/7N3
+        J/8AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AACoaRn/7rdO/+2sKf/uphX/8qsa//StG//3sBz/+85v/7F1Jf8AAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAACmZxf/6bNK/+qrMv/qohX/7qYW//Kr
+        Gv/0rRv/+c1v/69yIv8AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAClZhb/5axH/+ipN//noyD/6aAR/+2lF//xqhn/98pu/61wIP8AAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAClZhb/4KlE/+Kl
+        M//koyn/5JsQ/+igFP/tpRb/9sht/6ttHv8AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAClZhb/36VC/96gMP/goi//35gT/+SbEP/ooBP/9MZs/6ps
+        G/8AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAClZhb/36xU/+GuVf/ksln/5K1K/+SpOv/prkD/8MNp/6hqGv8AAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAClZhZ1pWYW/6VmFv+lZhb/pWYW/6Vm
+        Fv+lZhb/pmcX/6doGHUAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAP///wD/x/8A/4P/AP8B/wD+AP8A/AB/APgAPwDwAB8A4AAPAMAA
+        BwDAAAcAwAAHAP4A/wD+AP8A/gD/AP4A/wD+AP8A/gD/AP4A/wD+AP8A/gD/AP4A/wD+AP8A////ACgA
+        AAAQAAAAIAAAAAEAIAAAAAAAQAQAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AACxcSJds3gp/76DM18AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AACycSJds3gp/+nJl/+ydib/voMzXwAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AACxcSJds3gp/+SyXP/VjRf/6MeQ/7J2Jv++gzNfAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AACxciJds3gp/+q6Yf/emh7/2pUb/9WOGP/ox5H/uH4v/76DNF0AAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AACycyNfs3gp/+/BZf/opSP/46Ei/+CbIP/blRz/1Y8Z/+jHkf+4fi//voM0XQAAAAAAAAAAAAAAAAAA
+        AACxciJes3gp//TNe//uriz/66om/+mmJf/moiP/4Jwf/9yWHP/XkBn/6ceR/7h+L/++gzRdAAAAAAAA
+        AACwcSJes3gp//bQgP/yvEr/8LMy/+6uJ//sqyj/6acm/+aiI//kpjj/6b9z/+a7cP/pyJH/uH4v/76D
+        NF0AAAAApWYWqqVmFv+lZhb/pWYW/6VmFv/wryj/764p/+yrKP/qpyX/8MV2/7h+L/+4fi//uH4v/7h+
+        L/+xdCWqAAAAAAAAAAAAAAAAAAAAAAAAAAClZhb/8LAr//CwKf/vryr/7asn//LJef+4fi//AAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAApWYW/++xLv/wryn/8LAq//CvKv/0zHr/uH4v/wAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAKVmFv/trzH/7q4n//CwKv/wsCr/9s17/7h+
+        L/8AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAClZhb/6rA4/+urJv/urin/768q//bO
+        e/+4fi//AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAApWYW/+avPv/npyf/66om/+6u
+        KP/2z3r/uH4v/wAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAKVmFv/iq0H/46Ys/+am
+        I//rqyf/9M16/7h+L/8AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAClZhb/5Lho/+e3
+        X//otE//7LlS//PMev+4fi//AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAu4Eyd6Vm
+        Fv+lZhb/pWYW/6VmFv+lZhb/wIc5dwAAAAAAAAAAAAAAAAAAAAAAAAAA/H8AAPg/AADwHwAA4A8AAMAH
+        AACAAwAAAAEAAAABAADwHwAA8B8AAPAfAADwHwAA8B8AAPAfAADwHwAA8B8AAA==
+</value>
+  </data>
+</root>

SCrawler/Download/ActiveDownloadingProgress.vb

@@ -0,0 +1,77 @@
+' Copyright (C) 2022  Andy
+' This program is free software: you can redistribute it and/or modify
+' it under the terms of the GNU General Public License as published by
+' the Free Software Foundation, either version 3 of the License, or
+' (at your option) any later version.
+'
+' This program is distributed in the hope that it will be useful,
+' but WITHOUT ANY WARRANTY
+Imports System.ComponentModel
+Imports PersonalUtilities.Forms
+Namespace DownloadObjects
+    Friend Class ActiveDownloadingProgress
+        Private Const MinWidth As Integer = 450
+        Private MyView As FormsView
+        Friend Property Opened As Boolean = False
+        Private ReadOnly JobsList As List(Of DownloadProgress)
+        Friend Property DisableProgressChange As Boolean = False
+        Friend Sub New()
+            InitializeComponent()
+            JobsList = New List(Of DownloadProgress)
+            AddHandler Downloader.OnReconfigured, AddressOf Downloader_OnReconfigured
+            Downloader_OnReconfigured()
+        End Sub
+        Private Sub ActiveDownloadingProgress_Load(sender As Object, e As EventArgs) Handles Me.Load
+            MyView = New FormsView(Me)
+            MyView.ImportFromXML(Settings.Design)
+            MyView.SetMeSize()
+            Opened = True
+        End Sub
+        Private Sub ActiveDownloadingProgress_Closing(sender As Object, e As CancelEventArgs) Handles Me.Closing
+            MyView.ExportToXML(Settings.Design)
+            e.Cancel = True
+            Hide()
+        End Sub
+        Private Sub Downloader_OnReconfigured()
+            Const RowHeight% = 30
+            With TP_MAIN
+                If .Controls.Count > 0 Then
+                    For Each c As Control In .Controls
+                        If Not c Is Nothing Then c.Dispose()
+                    Next
+                    .Controls.Clear()
+                End If
+                .RowStyles.Clear()
+                .RowCount = 0
+            End With
+            JobsList.ListClearDispose
+            With Downloader
+                If .Pool.Count > 0 Then
+                    For Each j As TDownloader.Job In .Pool
+                        With TP_MAIN
+                            .RowStyles.Add(New RowStyle(SizeType.Absolute, RowHeight))
+                            .RowCount += 1
+                            JobsList.Add(New DownloadProgress(j))
+                            AddHandler JobsList.Last.OnTotalCountChange, AddressOf Jobs_OnTotalCountChange
+                            .Controls.Add(JobsList.Last.Get, 0, .RowStyles.Count - 1)
+                        End With
+                    Next
+                    TP_MAIN.RowStyles.Add(New RowStyle(SizeType.Percent, 100))
+                    TP_MAIN.RowCount += 1
+                End If
+                Dim s As Size = Size
+                s.Height = TP_MAIN.RowStyles.Count * RowHeight + PaddingE.GetOf({TP_MAIN}).Vertical(TP_MAIN.RowStyles.Count) - TP_MAIN.RowStyles.Count * 2
+                MinimumSize = New Size(MinWidth, s.Height)
+                Size = s
+            End With
+            TP_MAIN.Refresh()
+        End Sub
+        Private Sub Jobs_OnTotalCountChange()
+            If JobsList.Count > 0 And Not DisableProgressChange Then
+                MainProgress.TotalCount = JobsList.Sum(Function(j) CLng(j.Job.Progress.TotalCount))
+                MainProgress.CurrentCounter = Math.Max(JobsList.Sum(Function(j) CLng(j.Job.Progress.CurrentCounter)) - 1, 0)
+                If MainProgress.CurrentCounter > 0 Then MainProgress.Perform()
+            End If
+        End Sub
+    End Class
+End Namespace

SCrawler/Download/DownloadProgress.vb

@@ -0,0 +1,190 @@
+' Copyright (C) 2022  Andy
+' This program is free software: you can redistribute it and/or modify
+' it under the terms of the GNU General Public License as published by
+' the Free Software Foundation, either version 3 of the License, or
+' (at your option) any later version.
+'
+' This program is distributed in the hope that it will be useful,
+' but WITHOUT ANY WARRANTY
+Imports PersonalUtilities.Forms.Toolbars
+Imports Download = SCrawler.Plugin.ISiteSettings.Download
+Imports TDJob = SCrawler.DownloadObjects.TDownloader.Job
+Namespace DownloadObjects
+    Friend Class DownloadProgress : Implements IDisposable
+        Friend Event OnDownloadDone(ByVal Message As String)
+        Friend Event OnTotalCountChange()
+        Private ReadOnly TP_MAIN As TableLayoutPanel
+        Private ReadOnly TP_CONTROLS As TableLayoutPanel
+        Private WithEvents BTT_START As Button
+        Private WithEvents BTT_STOP As Button
+        Private WithEvents BTT_OPEN As Button
+        Private ReadOnly PR_MAIN As ProgressBar
+        Private ReadOnly LBL_INFO As Label
+        Private ReadOnly Property Instance As API.Base.ProfileSaved
+        Friend ReadOnly Property Job As TDJob
+#Region "Initializer"
+        Friend Sub New(ByVal _Job As TDJob)
+            Job = _Job
+
+            TP_MAIN = New TableLayoutPanel With {.Margin = New Padding(0), .Dock = DockStyle.Fill}
+            TP_MAIN.ColumnStyles.Add(New ColumnStyle(SizeType.Percent, 100))
+            TP_MAIN.ColumnCount = 1
+            TP_CONTROLS = New TableLayoutPanel With {.Margin = New Padding(0), .Dock = DockStyle.Fill}
+            PR_MAIN = New ProgressBar With {.Dock = DockStyle.Fill}
+            LBL_INFO = New Label With {.Text = String.Empty, .Dock = DockStyle.Fill}
+            CreateButton(BTT_STOP, My.Resources.Delete)
+
+            If Job.Type = Download.Main Then
+                LBL_INFO.Margin = New Padding(3)
+                LBL_INFO.TextAlign = ContentAlignment.MiddleLeft
+                With TP_MAIN
+                    .RowStyles.Add(New RowStyle(SizeType.Percent, 100))
+                    .RowCount = 1
+                End With
+                With TP_CONTROLS
+                    .ColumnStyles.Add(New ColumnStyle(SizeType.Absolute, 30))
+                    .ColumnStyles.Add(New ColumnStyle(SizeType.Absolute, 150))
+                    .ColumnStyles.Add(New ColumnStyle(SizeType.Percent, 100))
+                    .ColumnCount = .ColumnStyles.Count
+                    .RowStyles.Add(New RowStyle(SizeType.Percent, 100))
+                    .RowCount = 1
+                    With .Controls
+                        .Add(BTT_STOP, 0, 0)
+                        .Add(PR_MAIN, 1, 0)
+                        .Add(LBL_INFO, 2, 0)
+                    End With
+                End With
+                TP_MAIN.Controls.Add(TP_CONTROLS, 0, 0)
+            Else
+                LBL_INFO.Padding = New Padding(3, 0, 3, 0)
+                LBL_INFO.TextAlign = ContentAlignment.TopCenter
+                CreateButton(BTT_START, My.Resources.StartPic_01_Green_16)
+                CreateButton(BTT_OPEN, PersonalUtilities.My.Resources.OpenFolderPic)
+                With TP_CONTROLS
+                    With .ColumnStyles
+                        .Add(New ColumnStyle(SizeType.Absolute, 30))
+                        .Add(New ColumnStyle(SizeType.Absolute, 30))
+                        .Add(New ColumnStyle(SizeType.Absolute, 30))
+                        .Add(New ColumnStyle(SizeType.Percent, 100))
+                    End With
+                    .ColumnCount = 4
+                    .RowStyles.Add(New RowStyle(SizeType.Percent, 50))
+                    .RowCount = 1
+                    With .Controls
+                        .Add(BTT_START, 0, 0)
+                        .Add(BTT_STOP, 1, 0)
+                        .Add(BTT_OPEN, 2, 0)
+                        .Add(PR_MAIN, 3, 0)
+                    End With
+                End With
+                With TP_MAIN
+                    With .RowStyles
+                        .Add(New RowStyle(SizeType.Absolute, 30))
+                        .Add(New RowStyle(SizeType.Percent, 100))
+                    End With
+                    .RowCount = 2
+                End With
+                TP_MAIN.Controls.Add(TP_CONTROLS, 0, 0)
+                TP_MAIN.Controls.Add(LBL_INFO, 0, 1)
+            End If
+
+            With Job
+                .Progress = New MyProgress(PR_MAIN, LBL_INFO) With {.DropCurrentProgressOnTotalChange = False}
+                With .Progress
+                    AddHandler .OnProgressChange, AddressOf JobProgress_OnProgressChange
+                    AddHandler .OnTotalCountChange, AddressOf JobProgress_OnTotalCountChange
+                End With
+            End With
+
+            If Job.Type = Download.SavedPosts And Not Job.Progress Is Nothing Then Job.Progress.InformationTemporary = Job.Host.Name
+            Instance = New API.Base.ProfileSaved(Job.Host, Job.Progress)
+        End Sub
+        Private Sub CreateButton(ByRef BTT As Button, ByVal Img As Image)
+            BTT = New Button With {
+                .BackgroundImage = Img,
+                .BackgroundImageLayout = ImageLayout.Zoom,
+                .Text = String.Empty,
+                .Dock = DockStyle.Fill
+            }
+        End Sub
+#End Region
+        Friend Function [Get]() As TableLayoutPanel
+            Return TP_MAIN
+        End Function
+#Region "Buttons"
+        Private Sub BTT_START_Click(sender As Object, e As EventArgs) Handles BTT_START.Click
+            Start()
+        End Sub
+        Private Sub BTT_STOP_Click(sender As Object, e As EventArgs) Handles BTT_STOP.Click
+            [Stop]()
+        End Sub
+        Private Sub BTT_OPEN_Click(sender As Object, e As EventArgs) Handles BTT_OPEN.Click
+            GlobalOpenPath(Job.Host.SavedPostsPath)
+        End Sub
+#End Region
+#Region "Start, Stop"
+        Friend Sub Start()
+            Job.Start(AddressOf DownloadData)
+        End Sub
+        Friend Sub [Stop]()
+            Job.Stop()
+        End Sub
+#End Region
+#Region "SavedPosts downloading"
+        Private Sub DownloadData()
+            Dim btte As Action(Of Button, Boolean) = Sub(b, e) If b.InvokeRequired Then b.Invoke(Sub() b.Enabled = e) Else b.Enabled = e
+            Try
+                btte.Invoke(BTT_START, False)
+                btte.Invoke(BTT_STOP, True)
+                Job.Progress.InformationTemporary = $"{Job.Host.Name} downloading started"
+                Job.Start()
+                Instance.Download(Job.Token)
+                RaiseEvent OnDownloadDone($"Downloading saved {Job.Host.Name} posts is completed")
+            Catch ex As Exception
+                Job.Progress.InformationTemporary = $"{Job.Host.Name} downloading error"
+                ErrorsDescriber.Execute(EDP.LogMessageValue, ex, {$"{Job.Host.Name} saved posts downloading error", "Saved posts"})
+            Finally
+                btte.Invoke(BTT_START, True)
+                btte.Invoke(BTT_STOP, False)
+                Job.Stopped()
+                If Job.Type = Download.SavedPosts Then Job.Progress.TotalCount = 0 : Job.Progress.CurrentCounter = 0
+            End Try
+        End Sub
+#End Region
+#Region "Progress, Jobs count"
+        Private Sub JobProgress_OnTotalCountChange(ByVal Source As IMyProgress, ByVal Index As Integer)
+            RaiseEvent OnTotalCountChange()
+        End Sub
+        Private Sub JobProgress_OnProgressChange(ByVal Source As IMyProgress, ByVal Index As Integer)
+            MainProgress.Perform()
+        End Sub
+#End Region
+#Region "IDisposable Support"
+        Private disposedValue As Boolean = False
+        Protected Overridable Overloads Sub Dispose(ByVal disposing As Boolean)
+            If Not disposedValue Then
+                If disposing Then
+                    If Not BTT_START Is Nothing Then BTT_START.Dispose()
+                    If Not BTT_STOP Is Nothing Then BTT_STOP.Dispose()
+                    If Not BTT_OPEN Is Nothing Then BTT_OPEN.Dispose()
+                    PR_MAIN.Dispose()
+                    LBL_INFO.Dispose()
+                    TP_CONTROLS.Controls.Clear()
+                    TP_CONTROLS.Dispose()
+                    TP_MAIN.Controls.Clear()
+                    TP_MAIN.Dispose()
+                End If
+                disposedValue = True
+            End If
+        End Sub
+        Protected Overrides Sub Finalize()
+            Dispose(False)
+            MyBase.Finalize()
+        End Sub
+        Friend Overloads Sub Dispose() Implements IDisposable.Dispose
+            Dispose(True)
+            GC.SuppressFinalize(Me)
+        End Sub
+#End Region
+    End Class
+End Namespace

SCrawler/Download/DownloadSavedPostsForm.Designer.vb

@@ -0,0 +1,110 @@
+' Copyright (C) 2022  Andy
+' This program is free software: you can redistribute it and/or modify
+' it under the terms of the GNU General Public License as published by
+' the Free Software Foundation, either version 3 of the License, or
+' (at your option) any later version.
+'
+' This program is distributed in the hope that it will be useful,
+' but WITHOUT ANY WARRANTY
+<Global.Microsoft.VisualBasic.CompilerServices.DesignerGenerated()>
+Partial Friend Class DownloadSavedPostsForm : Inherits System.Windows.Forms.Form
+    <System.Diagnostics.DebuggerNonUserCode()>
+    Protected Overrides Sub Dispose(ByVal disposing As Boolean)
+        Try
+            If disposing AndAlso components IsNot Nothing Then
+                components.Dispose()
+            End If
+        Finally
+            MyBase.Dispose(disposing)
+        End Try
+    End Sub
+    Private components As System.ComponentModel.IContainer
+    <System.Diagnostics.DebuggerStepThrough()>
+    Private Sub InitializeComponent()
+        Me.components = New System.ComponentModel.Container()
+        Dim TP_BUTTONS As System.Windows.Forms.TableLayoutPanel
+        Dim TT_MAIN As System.Windows.Forms.ToolTip
+        Dim resources As System.ComponentModel.ComponentResourceManager = New System.ComponentModel.ComponentResourceManager(GetType(DownloadSavedPostsForm))
+        Me.BTT_DOWN_ALL = New System.Windows.Forms.Button()
+        Me.BTT_STOP_ALL = New System.Windows.Forms.Button()
+        Me.TP_MAIN = New System.Windows.Forms.TableLayoutPanel()
+        TP_BUTTONS = New System.Windows.Forms.TableLayoutPanel()
+        TT_MAIN = New System.Windows.Forms.ToolTip(Me.components)
+        TP_BUTTONS.SuspendLayout()
+        Me.TP_MAIN.SuspendLayout()
+        Me.SuspendLayout()
+        '
+        'TP_BUTTONS
+        '
+        TP_BUTTONS.ColumnCount = 2
+        TP_BUTTONS.ColumnStyles.Add(New System.Windows.Forms.ColumnStyle(System.Windows.Forms.SizeType.Percent, 50.0!))
+        TP_BUTTONS.ColumnStyles.Add(New System.Windows.Forms.ColumnStyle(System.Windows.Forms.SizeType.Percent, 50.0!))
+        TP_BUTTONS.ColumnStyles.Add(New System.Windows.Forms.ColumnStyle(System.Windows.Forms.SizeType.Absolute, 20.0!))
+        TP_BUTTONS.Controls.Add(Me.BTT_DOWN_ALL, 0, 0)
+        TP_BUTTONS.Controls.Add(Me.BTT_STOP_ALL, 1, 0)
+        TP_BUTTONS.Dock = System.Windows.Forms.DockStyle.Fill
+        TP_BUTTONS.Location = New System.Drawing.Point(2, 2)
+        TP_BUTTONS.Margin = New System.Windows.Forms.Padding(0)
+        TP_BUTTONS.Name = "TP_BUTTONS"
+        TP_BUTTONS.RowCount = 1
+        TP_BUTTONS.RowStyles.Add(New System.Windows.Forms.RowStyle(System.Windows.Forms.SizeType.Percent, 100.0!))
+        TP_BUTTONS.Size = New System.Drawing.Size(480, 37)
+        TP_BUTTONS.TabIndex = 0
+        '
+        'BTT_DOWN_ALL
+        '
+        Me.BTT_DOWN_ALL.Dock = System.Windows.Forms.DockStyle.Fill
+        Me.BTT_DOWN_ALL.Location = New System.Drawing.Point(3, 3)
+        Me.BTT_DOWN_ALL.Name = "BTT_DOWN_ALL"
+        Me.BTT_DOWN_ALL.Size = New System.Drawing.Size(234, 31)
+        Me.BTT_DOWN_ALL.TabIndex = 0
+        Me.BTT_DOWN_ALL.Text = "Download ALL"
+        Me.BTT_DOWN_ALL.UseVisualStyleBackColor = True
+        '
+        'BTT_STOP_ALL
+        '
+        Me.BTT_STOP_ALL.Dock = System.Windows.Forms.DockStyle.Fill
+        Me.BTT_STOP_ALL.Location = New System.Drawing.Point(243, 3)
+        Me.BTT_STOP_ALL.Name = "BTT_STOP_ALL"
+        Me.BTT_STOP_ALL.Size = New System.Drawing.Size(234, 31)
+        Me.BTT_STOP_ALL.TabIndex = 1
+        Me.BTT_STOP_ALL.Text = "Stop ALL"
+        Me.BTT_STOP_ALL.UseVisualStyleBackColor = True
+        '
+        'TP_MAIN
+        '
+        Me.TP_MAIN.CellBorderStyle = System.Windows.Forms.TableLayoutPanelCellBorderStyle.Inset
+        Me.TP_MAIN.ColumnCount = 1
+        Me.TP_MAIN.ColumnStyles.Add(New System.Windows.Forms.ColumnStyle(System.Windows.Forms.SizeType.Percent, 100.0!))
+        Me.TP_MAIN.Controls.Add(TP_BUTTONS, 0, 0)
+        Me.TP_MAIN.Dock = System.Windows.Forms.DockStyle.Fill
+        Me.TP_MAIN.Location = New System.Drawing.Point(0, 0)
+        Me.TP_MAIN.Name = "TP_MAIN"
+        Me.TP_MAIN.RowCount = 1
+        Me.TP_MAIN.RowStyles.Add(New System.Windows.Forms.RowStyle(System.Windows.Forms.SizeType.Absolute, 30.0!))
+        Me.TP_MAIN.Size = New System.Drawing.Size(484, 41)
+        Me.TP_MAIN.TabIndex = 0
+        '
+        'DownloadSavedPostsForm
+        '
+        Me.AutoScaleDimensions = New System.Drawing.SizeF(6.0!, 13.0!)
+        Me.AutoScaleMode = System.Windows.Forms.AutoScaleMode.Font
+        Me.ClientSize = New System.Drawing.Size(484, 41)
+        Me.Controls.Add(Me.TP_MAIN)
+        Me.FormBorderStyle = System.Windows.Forms.FormBorderStyle.FixedSingle
+        Me.Icon = CType(resources.GetObject("$this.Icon"), System.Drawing.Icon)
+        Me.MaximizeBox = False
+        Me.MaximumSize = New System.Drawing.Size(500, 80)
+        Me.MinimumSize = New System.Drawing.Size(500, 80)
+        Me.Name = "DownloadSavedPostsForm"
+        Me.SizeGripStyle = System.Windows.Forms.SizeGripStyle.Hide
+        Me.Text = "Saved posts"
+        TP_BUTTONS.ResumeLayout(False)
+        Me.TP_MAIN.ResumeLayout(False)
+        Me.ResumeLayout(False)
+
+    End Sub
+    Private WithEvents BTT_DOWN_ALL As Button
+    Private WithEvents BTT_STOP_ALL As Button
+    Private WithEvents TP_MAIN As TableLayoutPanel
+End Class