3.0.0.0

Parsing profiles descriptions (Reddit and Twitter) and updating it
Filters: deleted, suspended, dates
Collections containing deleted profiles are marked in blue
Marked collection context elements
Find profile in the main window from the info form
New hotkeys in the info form: up, down, find, enter
New hotkey in the main window: enter
New list refill algo
Added copying user pictures from all channels
Changed view modes
Changed comparer and ToString of UserDataBase
New parameter added to channels stats (my users)
Added view mode "details"
Fixed twitter files overriding
Fixed full parsing of reddit posts
Fixed Insta timers and minors
Fixed library fatal
Removed UserDataBind comparer override
Added GetUserMediaOnly for reddit users from channels
Added Reddit availability check with DownDetector
Added PLUGINS

.github/FUNDING.yml

@@ -0,0 +1,13 @@
+# These are supported funding model platforms
+
+github: # Replace with up to 4 GitHub Sponsors-enabled usernames e.g., [user1, user2]
+patreon: # Replace with a single Patreon username
+open_collective: # Replace with a single Open Collective username
+ko_fi: andyprogram
+tidelift: # Replace with a single Tidelift platform-name/package-name e.g., npm/babel
+community_bridge: # Replace with a single Community Bridge project-name e.g., cloud-foundry
+liberapay: # Replace with a single Liberapay username
+issuehunt: # Replace with a single IssueHunt username
+otechie: # Replace with a single Otechie username
+lfx_crowdfunding: # Replace with a single LFX Crowdfunding project-name e.g., cloud-foundry
+custom: ['https://blockchair.com/bitcoin/address/BC1Q0NH839FT5TA44DD7L7RLR97XDQAG9V8D6N7XET']

.github/ISSUE_TEMPLATE/bug_report.md

@@ -0,0 +1,33 @@
+---
+name: Bug report
+about: Create a report to help us improve
+title: "[BUG]"
+labels: bug
+assignees: ''
+
+---
+
+**Describe the bug**
+A clear and concise description of what the bug is.
+
+**To Reproduce**
+Steps to reproduce the behavior:
+1. Profile URL: 
+2. Do something
+3. See error
+
+**Log data**
+If the program log contains any data.
+
+**Expected behavior**
+A clear and concise description of what you expected to happen.
+
+**Screenshots**
+If applicable, add screenshots to help explain your problem.
+
+**Release information (please complete the following information):**
+ - Architecture [e.g. x86, x64]
+ - Version [e.g. 2.0.0.0]
+
+**Additional context**
+Add any other context about the problem here.

.github/ISSUE_TEMPLATE/custom.md

@@ -0,0 +1,10 @@
+---
+name: Custom issue template
+about: Describe this issue template's purpose here.
+title: ''
+labels: ''
+assignees: ''
+
+---
+
+

.github/ISSUE_TEMPLATE/feature_request.md

@@ -0,0 +1,20 @@
+---
+name: Feature request
+about: Suggest an idea for this project
+title: "[REQUEST]"
+labels: enhancement
+assignees: ''
+
+---
+
+**Is your feature request related to a problem? Please describe.**
+A clear and concise description of what the problem is. Ex. I'm always frustrated when [...]
+
+**Describe the solution you'd like**
+A clear and concise description of what you want to happen.
+
+**Describe alternatives you've considered**
+A clear and concise description of any alternative solutions or features you've considered.
+
+**Additional context**
+Add any other context or screenshots about the feature request here.

.github/ISSUE_TEMPLATE/plugin_add.md

@@ -0,0 +1,12 @@
+---
+name: Add plugin
+about: Add plugin to plugin list
+title: "[NEW PLUGIN]"
+labels: 'New Plugin'
+assignees: ''
+
+---
+
+Plugin address:
+Plugin name:
+Plugin site:

CONTRIBUTING.md

@@ -0,0 +1,41 @@
+# Contributor's Guide
+
+I welcome requests! Follow these steps to contribute:
+
+1. Find an [issue](https://github.com/AAndyProgram/SCrawler/issues) that needs assistance.
+2. Let me know you are working on it by posting a comment on the issue.
+3. If you find an error in the code, please provide a link to the file and the line number.
+4. If you have a suggestion to change the code, you can post a block of code to replace. I don't currently have time to learn pull requests, so it might work this way.
+
+# How to build from source
+
+1. Delete the "PersonalUtilities" project from the solution.
+2. Add the latest version of the "PersonalUtilities.dll" library (from the [latest release](https://github.com/AAndyProgram/SCrawler/releases/latest)).
+3. Import PersonalUtilities.Functions for the whole project.
+
+**Always use the correct "PersonalUtilities.dll" library. You must download this library from the release of the code you downloaded.**
+
+# How to request a new site
+
+1. Check [issues](https://github.com/AAndyProgram/SCrawler/issues) (open and [closed](https://github.com/AAndyProgram/SCrawler/issues?q=is%3Aissue+is%3Aclosed)) and [discussions](https://github.com/AAndyProgram/SCrawler/discussions) to find your issue. Perhaps I have already answered your request.
+2. If you don't find anything, create a new issue with your request. I usually reply as soon as possible (within the next few hours).
+    - If I'm interested in a site you want to add, it may be added in future releases.
+      - If the site has an API that does not require authorization, it may be added in the coming releases.
+      - You can make it faster by posting a link to the API. **I don't use OAuth authentication** in my application, so if it's not too hard to make a new parsing algorithm **without OAuth** authorization, I can start developing it in the coming days. Otherwise, I need time to figure out how to do it.
+      - If the site does not have an API that does not require authorization, this may take some time.
+	- If you will be posting request urls **without OAuth** authentication, I might consider adding your site if I have time.
+    - If I'm **not** interested in the site you want to add, you can pay to have it added by making a donation of approximately $10. **But before that, you still need to create an issue. If I'm not interested, you can offer me a deal to develop it for money. I'll check the site you want to add, check the availability of the API and tell you how much time I need to develop it and the price. If you agree, I will do it.** [![ko-fi](https://www.ko-fi.com/img/githubbutton_sm.svg)](https://ko-fi.com/andyprogram)
+    
+    
+# Sites I will never develop
+
+- Facebook
+
+# Sites requested by users
+
+- TikTok
+  - API for receiving data without authorization was not found. Therefore, I don't have time to start developing this site parsing algorithm. If anyone knows of requests that may collect data without OAuth authentication, please let me know.
+  
+# Contact me
+
+[![matrix](https://img.shields.io/badge/Matrix-%40andyprogram%3Amatrix.org-informational)](https://matrix.to/#/@andyprogram:matrix.org)

Changelog.md

@@ -1,3 +1,140 @@
+# 3.0.0.0
+
+**Attention! This version of the program makes changes user data file (Users.xml). Once you start using this version, you will not be able to use previous versions of the program. Therefore, it is highly recommended to archive the program settings folder and archive the users' data files (you can use the [```ArchiveSCrawlerUsersDataFiles.bat```](Tools/ArchiveSCrawlerUsersDataFiles.bat) tool to archive the data files of all users).**
+
+- Added
+  - **PLUGINS SUPPORT**
+  - **Gfycat** site support
+  - Description of Twitter and Reddit user profiles
+  - Filter users by profile status "Suspended"
+  - Filter users by profile status "Deleted"
+  - Filter profiles that haven't downloaded new data since specific date
+  - Collections that contain non-existent profiles will be marked in blue
+  - Ability to find and activate a user in the main window from the Info form
+  - Ability to copy user images from all channels you have when adding a user from a channel
+  - Reddit default option "Get user media only" if now also used when creating new users from channels
+  - Ability to update user description every time
+  - ```Enter``` hotkey in the download info form to open the user's folder
+  - ```Enter``` hotkey in the main window to open the user's folder
+  - Channel statistics are supplemented by "existing users"
+  - ```Up``` and ```Down``` navigation buttons in the Info form
+  - ```Find``` button on the Info form to find the user in the main window
+  - "Details" view mode
+  - Fast loading of profiles in the main window. **Be careful with this setting. Fast loading leads to the highest CPU usage.**
+  - Reddit availability check with DownDetector
+  - Ability to [open folders with a specific program](https://github.com/AAndyProgram/SCrawler/wiki/Settings#folder-command)
+  - (Request #16) Ability to remove a user from the collection without deletion
+  - (Request #17) **Instagram Tagged** photos downloading
+  - (Request #17) **Instagram Stories** downloading
+  - Deleting data to recycle bin
+- Updated
+  - "List" view mode
+- Fixed
+  - Twitter reloads existing media
+  - Reddit saved posts downloader downloads all posts every time
+  - Minor bug that caused Instagram tasks timers to run longer
+  - A library error that in some cases leads to a fatal program error
+  - (Issue #16) Cannot delete a user that is in the collection.
+
+At the requests of some users, I added [screenshots](ProgramScreenshots) of the program and added screenshots to [ReadMe](README.md) and the [guide](https://github.com/AAndyProgram/SCrawler/wiki).
+
+# 2.0.0.4
+
+**Removed compatibility of program settings with version 1.0.0.4 and lower.**
+
+**If your program version is 1.0.0.4 and lower, it is strongly recommended that you upgrade to release 2.0.0.1 to update the program settings (and run the program). Then update to this release. Otherwise, you will have to configure the program settings again**
+
+**If your program version is 1.0.1.0 or higher, you should not pay attention to this message.**
+
+- Added
+  - Ability to specify the path to store saved posts
+- Fixed
+  - **Error when specifying network paths**
+  - Minor bugs
+
+# 2.0.0.3
+
+**Removed compatibility of program settings with version 1.0.0.4 and lower.**
+
+**If your program version is 1.0.0.4 and lower, it is strongly recommended that you upgrade to release 2.0.0.1 to update the program settings (and run the program). Then update to this release. Otherwise, you will have to configure the program settings again**
+
+**If your program version is 1.0.1.0 or higher, you should not pay attention to this message.**
+
+- Added
+  - The "Get User Media Only" setting is now available for Reddit. If checked then "CrossPosts" will be skipped, otherwise "CrossPosts" will be included.
+- Fixed
+  - In some cases, the program did not parse all Reddit posts.
+  - Collection ignored when validated when creating a new user
+  - Incorrect number of Instagram profiles downloads per session
+
+# 2.0.0.2
+
+**This is the last release that supports program settings of version 1.0.0.4 and lower. Compatibility of program settings with version 1.0.0.4 and lower will be removed in future releases. It is strongly recommended that you upgrade to this release before future releases. Otherwise, you will have to configure the program settings again. If your program version is 1.0.1.0 or higher, you should not pay attention to this message.**
+
+- Added
+  - Tray icon
+  - Close program to tray
+  - Close confirmation dialog
+  - **Separated thread for downloading Instagram profiles**
+  - **Wait timers to bypass Instagram error "Too Many Requests" (429)**
+  - **Downloading saved Instagram posts** *(requires a second InstaHash)*
+  - Downloading saved posts (from Reddit and Instagram) form
+  - Tray notification when download is complete (Instagram notification separate from other)
+  - Downloading not downloaded Instagram posts when a 429 error is encountered and/or the user stops downloading
+  - Separate progress bar for downloading Instagram profiles
+  - Clear information about downloaded profiles of the current session in the "Download info form"
+  - Increased the number of Instagram posts (from 12 to 50) received per request
+  - Channels' statistics
+  - **RedGifs profiles support**
+- Fixed
+  - The program was showing incorrect information about the total numbers of images and videos downloaded when a Reddit user was created from a channel
+
+# 2.0.0.1
+
+- Added
+  - Download individual Imgur media files (use the "Download video" form).
+- Fixed
+  - Incorrect filling of user parameters in the user creation form
+  - In some cases, the global settings cannot be saved.
+
+# 2.0.0.0
+
+- Added
+  - **Instagram**
+  - Filter by site
+  - Group for regular channels in the main window
+  - Ability to change user/collection path
+  - Imgur albums downloading
+  - NSFW Imgur content bypass (requires 'ClientID')
+  - Special user folder
+  - Remove user while keeping data
+  - Disabled overriding user preferences when creating a new user if it already exists in the destination (in case of deleting a user with saving data).
+  - **Saved Reddit posts downloading**
+- Fixed
+  - Suspended profiles do not change status if the profile is no longer suspended
+  - Limited download for Twitter not implemented
+
+# 1.0.1.0
+
+- Added
+  - Extended site settings
+  - Non-existend users will be marked in red
+  - Suspended users' profiles will be marked in yellow
+  - Automatically disable 'Ready for download' if user does not exist.
+  - Ability to disable MD5 check when downloading regular (added to the main window) channels
+  - Ability to create a user from a channel with the default option 'Ready to download' (setting in the 'Settings')
+  - Ability to change default 'Temporary' parameter on create a user from a channel (setting in the 'Settings')
+  - Advanced defaults for each site (download images, download videos and temporary)
+  - By checking the 'Temporary' checkbox in the user creation form, the 'Ready for download' checkbox became unchecked
+  - Automatically disable 'Ready for download' if profile does not exists or has been deleted
+- Change
+  - Removed extended twitter invalid credentials error and replaced with a simple line in the log
+  - Redesigned settings form
+- Fixed
+  - In some cases, the image of the channel post is not copied to the user's folder
+  - Users in the main window are not refreshed if new users are added by a list that includes banned and/or unrecognized users.
+  - Minor bugs
+
 # 1.0.0.4
 
 - Added

FAQ.md

@@ -0,0 +1,67 @@
+# Frequently asked questions
+
+**Please read the [GUIDE](https://github.com/AAndyProgram/SCrawler/wiki/) Before asking a question!**
+
+Most of your questions are already answered. All settings, functions, buttons and everything else described in the guide.
+
+Any other questions I will keep in this file.
+
+----
+
+#### Q: **HOW TO SETUP COOKIES**
+
+A: https://github.com/AAndyProgram/SCrawler/wiki/Settings#how-to-set-up-cookies
+
+----
+
+#### Q: **I can't copy cookies.**
+
+A: Use the mouse. Don't use ```Ctrl``` + ```A```!
+
+----
+
+#### Q: **Does this program have GUI or CLI.**
+
+A: This is a GUI program.
+
+----
+
+#### Q: **Will CLI be added in the future?**
+
+A: I do not think so.
+
+----
+
+#### Q: **I want to add "...." site. How to request.**
+
+A: How to request a new site you can read [here](CONTRIBUTING.md#how-to-request-a-new-site)
+
+----
+
+#### Q: **Twitter/Instagram download failed.**
+
+A: Check your credentials. Both of these sites require cookies. Check your [Twitter tokens](https://github.com/AAndyProgram/SCrawler/wiki/Settings#how-to-find-twitter-tokens) and [Instagram settings](https://github.com/AAndyProgram/SCrawler/wiki/Settings#instagram-settings). If all settings are set, but nothing works, go to [create a new issue](https://github.com/AAndyProgram/SCrawler/issues). Don't forget to attach the LOG.
+
+----
+
+#### Q: **Does the program remember the last download and check for new posts, downloading only new posts? Or does the program download the entire profile every time?**
+
+A: The program stored posts IDs in users' folders. For the first time, the program downloads the entire profile. All subsequent times the program will check for new posts and download **only new posts**!
+
+----
+
+#### Q: **How to redownload all data**
+
+A: Double-click on the user you want to redownload. In the opened window open folder setting. Delete the files ending with ```_Data.xml```  and ```_Posts.txt```. Download this user again.
+
+----
+
+#### Q: **How to remove the label**
+
+A: There is no functionality to remove an individual label. You can open the ```Labels.txt``` file in the program settings folder and delete any label you want. You also can delete this file (```Labels.txt```). In this case, when the program starts, the list of labels list will be updated with only existing labels (from the user data files).
+
+----
+
+#### Q: **How to remove a user from the blacklist**
+
+A: Just add that user back to the program. In the dialog box that opens, click on the ```Add and remove from blacklist```` button.

HowToSupport.md

@@ -0,0 +1,11 @@
+Your support is very valuable to me. Any support is greatly appreciated. Your support encourages me to make new features, update the program, add new sites, etc.
+
+You can support the program by:
+  - **Bitcoin**: bitcoin:BC1Q0NH839FT5TA44DD7L7RLR97XDQAG9V8D6N7XET
+  - :heavy_dollar_sign: making donaion making donations on this site: https://ko-fi.com/andyprogram
+  - :repeat: make a post about my program on your profile (Reddit, Twitter, Instagram and any other social networks)
+  - :speech_balloon: tell your friends about the program
+  - :heart: like the program on this site: https://alternativeto.net/software/scrawler/about/
+  - suggest my program as an alternative ([on this site](https://alternativeto.net/software/scrawler/about/)) to any program you have used before
+
+I would be very grateful for any support! :blush:

LICENSE

@@ -0,0 +1,674 @@
+                    GNU GENERAL PUBLIC LICENSE
+                       Version 3, 29 June 2007
+
+ Copyright (C) 2007 Free Software Foundation, Inc. <https://fsf.org/>
+ Everyone is permitted to copy and distribute verbatim copies
+ of this license document, but changing it is not allowed.
+
+                            Preamble
+
+  The GNU General Public License is a free, copyleft license for
+software and other kinds of works.
+
+  The licenses for most software and other practical works are designed
+to take away your freedom to share and change the works.  By contrast,
+the GNU General Public License is intended to guarantee your freedom to
+share and change all versions of a program--to make sure it remains free
+software for all its users.  We, the Free Software Foundation, use the
+GNU General Public License for most of our software; it applies also to
+any other work released this way by its authors.  You can apply it to
+your programs, too.
+
+  When we speak of free software, we are referring to freedom, not
+price.  Our General Public Licenses are designed to make sure that you
+have the freedom to distribute copies of free software (and charge for
+them if you wish), that you receive source code or can get it if you
+want it, that you can change the software or use pieces of it in new
+free programs, and that you know you can do these things.
+
+  To protect your rights, we need to prevent others from denying you
+these rights or asking you to surrender the rights.  Therefore, you have
+certain responsibilities if you distribute copies of the software, or if
+you modify it: responsibilities to respect the freedom of others.
+
+  For example, if you distribute copies of such a program, whether
+gratis or for a fee, you must pass on to the recipients the same
+freedoms that you received.  You must make sure that they, too, receive
+or can get the source code.  And you must show them these terms so they
+know their rights.
+
+  Developers that use the GNU GPL protect your rights with two steps:
+(1) assert copyright on the software, and (2) offer you this License
+giving you legal permission to copy, distribute and/or modify it.
+
+  For the developers' and authors' protection, the GPL clearly explains
+that there is no warranty for this free software.  For both users' and
+authors' sake, the GPL requires that modified versions be marked as
+changed, so that their problems will not be attributed erroneously to
+authors of previous versions.
+
+  Some devices are designed to deny users access to install or run
+modified versions of the software inside them, although the manufacturer
+can do so.  This is fundamentally incompatible with the aim of
+protecting users' freedom to change the software.  The systematic
+pattern of such abuse occurs in the area of products for individuals to
+use, which is precisely where it is most unacceptable.  Therefore, we
+have designed this version of the GPL to prohibit the practice for those
+products.  If such problems arise substantially in other domains, we
+stand ready to extend this provision to those domains in future versions
+of the GPL, as needed to protect the freedom of users.
+
+  Finally, every program is threatened constantly by software patents.
+States should not allow patents to restrict development and use of
+software on general-purpose computers, but in those that do, we wish to
+avoid the special danger that patents applied to a free program could
+make it effectively proprietary.  To prevent this, the GPL assures that
+patents cannot be used to render the program non-free.
+
+  The precise terms and conditions for copying, distribution and
+modification follow.
+
+                       TERMS AND CONDITIONS
+
+  0. Definitions.
+
+  "This License" refers to version 3 of the GNU General Public License.
+
+  "Copyright" also means copyright-like laws that apply to other kinds of
+works, such as semiconductor masks.
+
+  "The Program" refers to any copyrightable work licensed under this
+License.  Each licensee is addressed as "you".  "Licensees" and
+"recipients" may be individuals or organizations.
+
+  To "modify" a work means to copy from or adapt all or part of the work
+in a fashion requiring copyright permission, other than the making of an
+exact copy.  The resulting work is called a "modified version" of the
+earlier work or a work "based on" the earlier work.
+
+  A "covered work" means either the unmodified Program or a work based
+on the Program.
+
+  To "propagate" a work means to do anything with it that, without
+permission, would make you directly or secondarily liable for
+infringement under applicable copyright law, except executing it on a
+computer or modifying a private copy.  Propagation includes copying,
+distribution (with or without modification), making available to the
+public, and in some countries other activities as well.
+
+  To "convey" a work means any kind of propagation that enables other
+parties to make or receive copies.  Mere interaction with a user through
+a computer network, with no transfer of a copy, is not conveying.
+
+  An interactive user interface displays "Appropriate Legal Notices"
+to the extent that it includes a convenient and prominently visible
+feature that (1) displays an appropriate copyright notice, and (2)
+tells the user that there is no warranty for the work (except to the
+extent that warranties are provided), that licensees may convey the
+work under this License, and how to view a copy of this License.  If
+the interface presents a list of user commands or options, such as a
+menu, a prominent item in the list meets this criterion.
+
+  1. Source Code.
+
+  The "source code" for a work means the preferred form of the work
+for making modifications to it.  "Object code" means any non-source
+form of a work.
+
+  A "Standard Interface" means an interface that either is an official
+standard defined by a recognized standards body, or, in the case of
+interfaces specified for a particular programming language, one that
+is widely used among developers working in that language.
+
+  The "System Libraries" of an executable work include anything, other
+than the work as a whole, that (a) is included in the normal form of
+packaging a Major Component, but which is not part of that Major
+Component, and (b) serves only to enable use of the work with that
+Major Component, or to implement a Standard Interface for which an
+implementation is available to the public in source code form.  A
+"Major Component", in this context, means a major essential component
+(kernel, window system, and so on) of the specific operating system
+(if any) on which the executable work runs, or a compiler used to
+produce the work, or an object code interpreter used to run it.
+
+  The "Corresponding Source" for a work in object code form means all
+the source code needed to generate, install, and (for an executable
+work) run the object code and to modify the work, including scripts to
+control those activities.  However, it does not include the work's
+System Libraries, or general-purpose tools or generally available free
+programs which are used unmodified in performing those activities but
+which are not part of the work.  For example, Corresponding Source
+includes interface definition files associated with source files for
+the work, and the source code for shared libraries and dynamically
+linked subprograms that the work is specifically designed to require,
+such as by intimate data communication or control flow between those
+subprograms and other parts of the work.
+
+  The Corresponding Source need not include anything that users
+can regenerate automatically from other parts of the Corresponding
+Source.
+
+  The Corresponding Source for a work in source code form is that
+same work.
+
+  2. Basic Permissions.
+
+  All rights granted under this License are granted for the term of
+copyright on the Program, and are irrevocable provided the stated
+conditions are met.  This License explicitly affirms your unlimited
+permission to run the unmodified Program.  The output from running a
+covered work is covered by this License only if the output, given its
+content, constitutes a covered work.  This License acknowledges your
+rights of fair use or other equivalent, as provided by copyright law.
+
+  You may make, run and propagate covered works that you do not
+convey, without conditions so long as your license otherwise remains
+in force.  You may convey covered works to others for the sole purpose
+of having them make modifications exclusively for you, or provide you
+with facilities for running those works, provided that you comply with
+the terms of this License in conveying all material for which you do
+not control copyright.  Those thus making or running the covered works
+for you must do so exclusively on your behalf, under your direction
+and control, on terms that prohibit them from making any copies of
+your copyrighted material outside their relationship with you.
+
+  Conveying under any other circumstances is permitted solely under
+the conditions stated below.  Sublicensing is not allowed; section 10
+makes it unnecessary.
+
+  3. Protecting Users' Legal Rights From Anti-Circumvention Law.
+
+  No covered work shall be deemed part of an effective technological
+measure under any applicable law fulfilling obligations under article
+11 of the WIPO copyright treaty adopted on 20 December 1996, or
+similar laws prohibiting or restricting circumvention of such
+measures.
+
+  When you convey a covered work, you waive any legal power to forbid
+circumvention of technological measures to the extent such circumvention
+is effected by exercising rights under this License with respect to
+the covered work, and you disclaim any intention to limit operation or
+modification of the work as a means of enforcing, against the work's
+users, your or third parties' legal rights to forbid circumvention of
+technological measures.
+
+  4. Conveying Verbatim Copies.
+
+  You may convey verbatim copies of the Program's source code as you
+receive it, in any medium, provided that you conspicuously and
+appropriately publish on each copy an appropriate copyright notice;
+keep intact all notices stating that this License and any
+non-permissive terms added in accord with section 7 apply to the code;
+keep intact all notices of the absence of any warranty; and give all
+recipients a copy of this License along with the Program.
+
+  You may charge any price or no price for each copy that you convey,
+and you may offer support or warranty protection for a fee.
+
+  5. Conveying Modified Source Versions.
+
+  You may convey a work based on the Program, or the modifications to
+produce it from the Program, in the form of source code under the
+terms of section 4, provided that you also meet all of these conditions:
+
+    a) The work must carry prominent notices stating that you modified
+    it, and giving a relevant date.
+
+    b) The work must carry prominent notices stating that it is
+    released under this License and any conditions added under section
+    7.  This requirement modifies the requirement in section 4 to
+    "keep intact all notices".
+
+    c) You must license the entire work, as a whole, under this
+    License to anyone who comes into possession of a copy.  This
+    License will therefore apply, along with any applicable section 7
+    additional terms, to the whole of the work, and all its parts,
+    regardless of how they are packaged.  This License gives no
+    permission to license the work in any other way, but it does not
+    invalidate such permission if you have separately received it.
+
+    d) If the work has interactive user interfaces, each must display
+    Appropriate Legal Notices; however, if the Program has interactive
+    interfaces that do not display Appropriate Legal Notices, your
+    work need not make them do so.
+
+  A compilation of a covered work with other separate and independent
+works, which are not by their nature extensions of the covered work,
+and which are not combined with it such as to form a larger program,
+in or on a volume of a storage or distribution medium, is called an
+"aggregate" if the compilation and its resulting copyright are not
+used to limit the access or legal rights of the compilation's users
+beyond what the individual works permit.  Inclusion of a covered work
+in an aggregate does not cause this License to apply to the other
+parts of the aggregate.
+
+  6. Conveying Non-Source Forms.
+
+  You may convey a covered work in object code form under the terms
+of sections 4 and 5, provided that you also convey the
+machine-readable Corresponding Source under the terms of this License,
+in one of these ways:
+
+    a) Convey the object code in, or embodied in, a physical product
+    (including a physical distribution medium), accompanied by the
+    Corresponding Source fixed on a durable physical medium
+    customarily used for software interchange.
+
+    b) Convey the object code in, or embodied in, a physical product
+    (including a physical distribution medium), accompanied by a
+    written offer, valid for at least three years and valid for as
+    long as you offer spare parts or customer support for that product
+    model, to give anyone who possesses the object code either (1) a
+    copy of the Corresponding Source for all the software in the
+    product that is covered by this License, on a durable physical
+    medium customarily used for software interchange, for a price no
+    more than your reasonable cost of physically performing this
+    conveying of source, or (2) access to copy the
+    Corresponding Source from a network server at no charge.
+
+    c) Convey individual copies of the object code with a copy of the
+    written offer to provide the Corresponding Source.  This
+    alternative is allowed only occasionally and noncommercially, and
+    only if you received the object code with such an offer, in accord
+    with subsection 6b.
+
+    d) Convey the object code by offering access from a designated
+    place (gratis or for a charge), and offer equivalent access to the
+    Corresponding Source in the same way through the same place at no
+    further charge.  You need not require recipients to copy the
+    Corresponding Source along with the object code.  If the place to
+    copy the object code is a network server, the Corresponding Source
+    may be on a different server (operated by you or a third party)
+    that supports equivalent copying facilities, provided you maintain
+    clear directions next to the object code saying where to find the
+    Corresponding Source.  Regardless of what server hosts the
+    Corresponding Source, you remain obligated to ensure that it is
+    available for as long as needed to satisfy these requirements.
+
+    e) Convey the object code using peer-to-peer transmission, provided
+    you inform other peers where the object code and Corresponding
+    Source of the work are being offered to the general public at no
+    charge under subsection 6d.
+
+  A separable portion of the object code, whose source code is excluded
+from the Corresponding Source as a System Library, need not be
+included in conveying the object code work.
+
+  A "User Product" is either (1) a "consumer product", which means any
+tangible personal property which is normally used for personal, family,
+or household purposes, or (2) anything designed or sold for incorporation
+into a dwelling.  In determining whether a product is a consumer product,
+doubtful cases shall be resolved in favor of coverage.  For a particular
+product received by a particular user, "normally used" refers to a
+typical or common use of that class of product, regardless of the status
+of the particular user or of the way in which the particular user
+actually uses, or expects or is expected to use, the product.  A product
+is a consumer product regardless of whether the product has substantial
+commercial, industrial or non-consumer uses, unless such uses represent
+the only significant mode of use of the product.
+
+  "Installation Information" for a User Product means any methods,
+procedures, authorization keys, or other information required to install
+and execute modified versions of a covered work in that User Product from
+a modified version of its Corresponding Source.  The information must
+suffice to ensure that the continued functioning of the modified object
+code is in no case prevented or interfered with solely because
+modification has been made.
+
+  If you convey an object code work under this section in, or with, or
+specifically for use in, a User Product, and the conveying occurs as
+part of a transaction in which the right of possession and use of the
+User Product is transferred to the recipient in perpetuity or for a
+fixed term (regardless of how the transaction is characterized), the
+Corresponding Source conveyed under this section must be accompanied
+by the Installation Information.  But this requirement does not apply
+if neither you nor any third party retains the ability to install
+modified object code on the User Product (for example, the work has
+been installed in ROM).
+
+  The requirement to provide Installation Information does not include a
+requirement to continue to provide support service, warranty, or updates
+for a work that has been modified or installed by the recipient, or for
+the User Product in which it has been modified or installed.  Access to a
+network may be denied when the modification itself materially and
+adversely affects the operation of the network or violates the rules and
+protocols for communication across the network.
+
+  Corresponding Source conveyed, and Installation Information provided,
+in accord with this section must be in a format that is publicly
+documented (and with an implementation available to the public in
+source code form), and must require no special password or key for
+unpacking, reading or copying.
+
+  7. Additional Terms.
+
+  "Additional permissions" are terms that supplement the terms of this
+License by making exceptions from one or more of its conditions.
+Additional permissions that are applicable to the entire Program shall
+be treated as though they were included in this License, to the extent
+that they are valid under applicable law.  If additional permissions
+apply only to part of the Program, that part may be used separately
+under those permissions, but the entire Program remains governed by
+this License without regard to the additional permissions.
+
+  When you convey a copy of a covered work, you may at your option
+remove any additional permissions from that copy, or from any part of
+it.  (Additional permissions may be written to require their own
+removal in certain cases when you modify the work.)  You may place
+additional permissions on material, added by you to a covered work,
+for which you have or can give appropriate copyright permission.
+
+  Notwithstanding any other provision of this License, for material you
+add to a covered work, you may (if authorized by the copyright holders of
+that material) supplement the terms of this License with terms:
+
+    a) Disclaiming warranty or limiting liability differently from the
+    terms of sections 15 and 16 of this License; or
+
+    b) Requiring preservation of specified reasonable legal notices or
+    author attributions in that material or in the Appropriate Legal
+    Notices displayed by works containing it; or
+
+    c) Prohibiting misrepresentation of the origin of that material, or
+    requiring that modified versions of such material be marked in
+    reasonable ways as different from the original version; or
+
+    d) Limiting the use for publicity purposes of names of licensors or
+    authors of the material; or
+
+    e) Declining to grant rights under trademark law for use of some
+    trade names, trademarks, or service marks; or
+
+    f) Requiring indemnification of licensors and authors of that
+    material by anyone who conveys the material (or modified versions of
+    it) with contractual assumptions of liability to the recipient, for
+    any liability that these contractual assumptions directly impose on
+    those licensors and authors.
+
+  All other non-permissive additional terms are considered "further
+restrictions" within the meaning of section 10.  If the Program as you
+received it, or any part of it, contains a notice stating that it is
+governed by this License along with a term that is a further
+restriction, you may remove that term.  If a license document contains
+a further restriction but permits relicensing or conveying under this
+License, you may add to a covered work material governed by the terms
+of that license document, provided that the further restriction does
+not survive such relicensing or conveying.
+
+  If you add terms to a covered work in accord with this section, you
+must place, in the relevant source files, a statement of the
+additional terms that apply to those files, or a notice indicating
+where to find the applicable terms.
+
+  Additional terms, permissive or non-permissive, may be stated in the
+form of a separately written license, or stated as exceptions;
+the above requirements apply either way.
+
+  8. Termination.
+
+  You may not propagate or modify a covered work except as expressly
+provided under this License.  Any attempt otherwise to propagate or
+modify it is void, and will automatically terminate your rights under
+this License (including any patent licenses granted under the third
+paragraph of section 11).
+
+  However, if you cease all violation of this License, then your
+license from a particular copyright holder is reinstated (a)
+provisionally, unless and until the copyright holder explicitly and
+finally terminates your license, and (b) permanently, if the copyright
+holder fails to notify you of the violation by some reasonable means
+prior to 60 days after the cessation.
+
+  Moreover, your license from a particular copyright holder is
+reinstated permanently if the copyright holder notifies you of the
+violation by some reasonable means, this is the first time you have
+received notice of violation of this License (for any work) from that
+copyright holder, and you cure the violation prior to 30 days after
+your receipt of the notice.
+
+  Termination of your rights under this section does not terminate the
+licenses of parties who have received copies or rights from you under
+this License.  If your rights have been terminated and not permanently
+reinstated, you do not qualify to receive new licenses for the same
+material under section 10.
+
+  9. Acceptance Not Required for Having Copies.
+
+  You are not required to accept this License in order to receive or
+run a copy of the Program.  Ancillary propagation of a covered work
+occurring solely as a consequence of using peer-to-peer transmission
+to receive a copy likewise does not require acceptance.  However,
+nothing other than this License grants you permission to propagate or
+modify any covered work.  These actions infringe copyright if you do
+not accept this License.  Therefore, by modifying or propagating a
+covered work, you indicate your acceptance of this License to do so.
+
+  10. Automatic Licensing of Downstream Recipients.
+
+  Each time you convey a covered work, the recipient automatically
+receives a license from the original licensors, to run, modify and
+propagate that work, subject to this License.  You are not responsible
+for enforcing compliance by third parties with this License.
+
+  An "entity transaction" is a transaction transferring control of an
+organization, or substantially all assets of one, or subdividing an
+organization, or merging organizations.  If propagation of a covered
+work results from an entity transaction, each party to that
+transaction who receives a copy of the work also receives whatever
+licenses to the work the party's predecessor in interest had or could
+give under the previous paragraph, plus a right to possession of the
+Corresponding Source of the work from the predecessor in interest, if
+the predecessor has it or can get it with reasonable efforts.
+
+  You may not impose any further restrictions on the exercise of the
+rights granted or affirmed under this License.  For example, you may
+not impose a license fee, royalty, or other charge for exercise of
+rights granted under this License, and you may not initiate litigation
+(including a cross-claim or counterclaim in a lawsuit) alleging that
+any patent claim is infringed by making, using, selling, offering for
+sale, or importing the Program or any portion of it.
+
+  11. Patents.
+
+  A "contributor" is a copyright holder who authorizes use under this
+License of the Program or a work on which the Program is based.  The
+work thus licensed is called the contributor's "contributor version".
+
+  A contributor's "essential patent claims" are all patent claims
+owned or controlled by the contributor, whether already acquired or
+hereafter acquired, that would be infringed by some manner, permitted
+by this License, of making, using, or selling its contributor version,
+but do not include claims that would be infringed only as a
+consequence of further modification of the contributor version.  For
+purposes of this definition, "control" includes the right to grant
+patent sublicenses in a manner consistent with the requirements of
+this License.
+
+  Each contributor grants you a non-exclusive, worldwide, royalty-free
+patent license under the contributor's essential patent claims, to
+make, use, sell, offer for sale, import and otherwise run, modify and
+propagate the contents of its contributor version.
+
+  In the following three paragraphs, a "patent license" is any express
+agreement or commitment, however denominated, not to enforce a patent
+(such as an express permission to practice a patent or covenant not to
+sue for patent infringement).  To "grant" such a patent license to a
+party means to make such an agreement or commitment not to enforce a
+patent against the party.
+
+  If you convey a covered work, knowingly relying on a patent license,
+and the Corresponding Source of the work is not available for anyone
+to copy, free of charge and under the terms of this License, through a
+publicly available network server or other readily accessible means,
+then you must either (1) cause the Corresponding Source to be so
+available, or (2) arrange to deprive yourself of the benefit of the
+patent license for this particular work, or (3) arrange, in a manner
+consistent with the requirements of this License, to extend the patent
+license to downstream recipients.  "Knowingly relying" means you have
+actual knowledge that, but for the patent license, your conveying the
+covered work in a country, or your recipient's use of the covered work
+in a country, would infringe one or more identifiable patents in that
+country that you have reason to believe are valid.
+
+  If, pursuant to or in connection with a single transaction or
+arrangement, you convey, or propagate by procuring conveyance of, a
+covered work, and grant a patent license to some of the parties
+receiving the covered work authorizing them to use, propagate, modify
+or convey a specific copy of the covered work, then the patent license
+you grant is automatically extended to all recipients of the covered
+work and works based on it.
+
+  A patent license is "discriminatory" if it does not include within
+the scope of its coverage, prohibits the exercise of, or is
+conditioned on the non-exercise of one or more of the rights that are
+specifically granted under this License.  You may not convey a covered
+work if you are a party to an arrangement with a third party that is
+in the business of distributing software, under which you make payment
+to the third party based on the extent of your activity of conveying
+the work, and under which the third party grants, to any of the
+parties who would receive the covered work from you, a discriminatory
+patent license (a) in connection with copies of the covered work
+conveyed by you (or copies made from those copies), or (b) primarily
+for and in connection with specific products or compilations that
+contain the covered work, unless you entered into that arrangement,
+or that patent license was granted, prior to 28 March 2007.
+
+  Nothing in this License shall be construed as excluding or limiting
+any implied license or other defenses to infringement that may
+otherwise be available to you under applicable patent law.
+
+  12. No Surrender of Others' Freedom.
+
+  If conditions are imposed on you (whether by court order, agreement or
+otherwise) that contradict the conditions of this License, they do not
+excuse you from the conditions of this License.  If you cannot convey a
+covered work so as to satisfy simultaneously your obligations under this
+License and any other pertinent obligations, then as a consequence you may
+not convey it at all.  For example, if you agree to terms that obligate you
+to collect a royalty for further conveying from those to whom you convey
+the Program, the only way you could satisfy both those terms and this
+License would be to refrain entirely from conveying the Program.
+
+  13. Use with the GNU Affero General Public License.
+
+  Notwithstanding any other provision of this License, you have
+permission to link or combine any covered work with a work licensed
+under version 3 of the GNU Affero General Public License into a single
+combined work, and to convey the resulting work.  The terms of this
+License will continue to apply to the part which is the covered work,
+but the special requirements of the GNU Affero General Public License,
+section 13, concerning interaction through a network will apply to the
+combination as such.
+
+  14. Revised Versions of this License.
+
+  The Free Software Foundation may publish revised and/or new versions of
+the GNU General Public License from time to time.  Such new versions will
+be similar in spirit to the present version, but may differ in detail to
+address new problems or concerns.
+
+  Each version is given a distinguishing version number.  If the
+Program specifies that a certain numbered version of the GNU General
+Public License "or any later version" applies to it, you have the
+option of following the terms and conditions either of that numbered
+version or of any later version published by the Free Software
+Foundation.  If the Program does not specify a version number of the
+GNU General Public License, you may choose any version ever published
+by the Free Software Foundation.
+
+  If the Program specifies that a proxy can decide which future
+versions of the GNU General Public License can be used, that proxy's
+public statement of acceptance of a version permanently authorizes you
+to choose that version for the Program.
+
+  Later license versions may give you additional or different
+permissions.  However, no additional obligations are imposed on any
+author or copyright holder as a result of your choosing to follow a
+later version.
+
+  15. Disclaimer of Warranty.
+
+  THERE IS NO WARRANTY FOR THE PROGRAM, TO THE EXTENT PERMITTED BY
+APPLICABLE LAW.  EXCEPT WHEN OTHERWISE STATED IN WRITING THE COPYRIGHT
+HOLDERS AND/OR OTHER PARTIES PROVIDE THE PROGRAM "AS IS" WITHOUT WARRANTY
+OF ANY KIND, EITHER EXPRESSED OR IMPLIED, INCLUDING, BUT NOT LIMITED TO,
+THE IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR
+PURPOSE.  THE ENTIRE RISK AS TO THE QUALITY AND PERFORMANCE OF THE PROGRAM
+IS WITH YOU.  SHOULD THE PROGRAM PROVE DEFECTIVE, YOU ASSUME THE COST OF
+ALL NECESSARY SERVICING, REPAIR OR CORRECTION.
+
+  16. Limitation of Liability.
+
+  IN NO EVENT UNLESS REQUIRED BY APPLICABLE LAW OR AGREED TO IN WRITING
+WILL ANY COPYRIGHT HOLDER, OR ANY OTHER PARTY WHO MODIFIES AND/OR CONVEYS
+THE PROGRAM AS PERMITTED ABOVE, BE LIABLE TO YOU FOR DAMAGES, INCLUDING ANY
+GENERAL, SPECIAL, INCIDENTAL OR CONSEQUENTIAL DAMAGES ARISING OUT OF THE
+USE OR INABILITY TO USE THE PROGRAM (INCLUDING BUT NOT LIMITED TO LOSS OF
+DATA OR DATA BEING RENDERED INACCURATE OR LOSSES SUSTAINED BY YOU OR THIRD
+PARTIES OR A FAILURE OF THE PROGRAM TO OPERATE WITH ANY OTHER PROGRAMS),
+EVEN IF SUCH HOLDER OR OTHER PARTY HAS BEEN ADVISED OF THE POSSIBILITY OF
+SUCH DAMAGES.
+
+  17. Interpretation of Sections 15 and 16.
+
+  If the disclaimer of warranty and limitation of liability provided
+above cannot be given local legal effect according to their terms,
+reviewing courts shall apply local law that most closely approximates
+an absolute waiver of all civil liability in connection with the
+Program, unless a warranty or assumption of liability accompanies a
+copy of the Program in return for a fee.
+
+                     END OF TERMS AND CONDITIONS
+
+            How to Apply These Terms to Your New Programs
+
+  If you develop a new program, and you want it to be of the greatest
+possible use to the public, the best way to achieve this is to make it
+free software which everyone can redistribute and change under these terms.
+
+  To do so, attach the following notices to the program.  It is safest
+to attach them to the start of each source file to most effectively
+state the exclusion of warranty; and each file should have at least
+the "copyright" line and a pointer to where the full notice is found.
+
+    <one line to give the program's name and a brief idea of what it does.>
+    Copyright (C) <year>  <name of author>
+
+    This program is free software: you can redistribute it and/or modify
+    it under the terms of the GNU General Public License as published by
+    the Free Software Foundation, either version 3 of the License, or
+    (at your option) any later version.
+
+    This program is distributed in the hope that it will be useful,
+    but WITHOUT ANY WARRANTY; without even the implied warranty of
+    MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
+    GNU General Public License for more details.
+
+    You should have received a copy of the GNU General Public License
+    along with this program.  If not, see <https://www.gnu.org/licenses/>.
+
+Also add information on how to contact you by electronic and paper mail.
+
+  If the program does terminal interaction, make it output a short
+notice like this when it starts in an interactive mode:
+
+    <program>  Copyright (C) <year>  <name of author>
+    This program comes with ABSOLUTELY NO WARRANTY; for details type `show w'.
+    This is free software, and you are welcome to redistribute it
+    under certain conditions; type `show c' for details.
+
+The hypothetical commands `show w' and `show c' should show the appropriate
+parts of the General Public License.  Of course, your program's commands
+might be different; for a GUI interface, you would use an "about box".
+
+  You should also get your employer (if you work as a programmer) or school,
+if any, to sign a "copyright disclaimer" for the program, if necessary.
+For more information on this, and how to apply and follow the GNU GPL, see
+<https://www.gnu.org/licenses/>.
+
+  The GNU General Public License does not permit incorporating your program
+into proprietary programs.  If your program is a subroutine library, you
+may consider it more useful to permit linking proprietary applications with
+the library.  If this is what you want to do, use the GNU Lesser General
+Public License instead of this License.  But first, please read
+<https://www.gnu.org/licenses/why-not-lgpl.html>.

Plugins.md

@@ -0,0 +1 @@
+List of available plugins

ProgramsComparison.md

@@ -0,0 +1,69 @@
+# 4K Stogram
+
+https://www.4kdownload.com/products/product-stogram
+
+| Option | SCrawler | 4K Stogram |
+| ---- | ---- | ---- |
+| User managament | **Advanced** | Primitive |
+| Labeling users | **Yes** | No |
+| Filtering | **Yes** | No |
+| Collections | **Yes** | No |
+| Specific user folders | **Yes** | No |
+| Favorite / Temporary user options | **Yes** | No |
+| Plugins support | **Yes** | No |
+| Download posts by username | Yes | Yes |
+| Download posts by hashtag | No | **Yes** |
+| Download posts by location | No | **Yes** |
+| Save Private Instagram Content with Permission| Yes | Yes |
+| Download Instagram Stories and Highlights | Yes | Yes |
+| See Others Instagram Feed As Your Own | No | **Yes** |
+| Download Instagram Video Posts | Yes | Yes |
+| Backup Your Instagram Account | Yes | Yes |
+| Save Instagram Posts by Date | No (only limited download) | **Yes** |
+| Download Instagram Saved Posts | Yes | Yes |
+| Download Instagram Tagged Posts | Yes | Yes |
+| Export and import subscriptions | No | **Yes** |
+| **Paid** | **No** | Yes |
+| **Free options** | **The program is completely free** | Only **ONE** profile downloading and only **200 posts** per day |
+| Permitted Commercial Use | **Yes** | Starting from 43.56 EUR |
+| Automatic Subscriptions Update | **Free** | Paid (43.56 EUR) |
+| Posts and Captions Export | No | Paid (43.56 EUR) |
+| Advertisements free | **No ADs at all for free** | Paid (14.52) |
+| Operating Systems | Windows 7+ | Windows 7+, MacOS 10.13+, Ubuntu x64 |
+| Select want content type to download | **Yes** | No |
+| Instagram support | Yes | Yes |
+| Twitter support | **Yes** | No |
+| Reddit support | **Yes** | No |
+| Other sites support | **Yes** | No |
+| Still supported | Yes | Yes |
+
+# RipMeApp
+
+https://github.com/RipMeApp/ripme
+
+| Option | SCrawler | 4K Stogram |
+| ---- | ---- | ---- |
+| User managament | **Advanced** | No |
+| Labeling users | **Yes** | No |
+| Filtering | **Yes** | No |
+| Collections | **Yes** | No |
+| Specific user folders | **Yes** | No |
+| Favorite / Temporary user options | **Yes** | No |
+| Plugins support | **Yes** | No |
+| Download posts by username | Yes | Yes |
+| Download posts by hashtag | No | No |
+| Download posts by location | No | No |
+| Save Private Instagram Content with Permission| Yes | Yes |
+| Download Instagram Stories | Yes | Yes |
+| Download Instagram Video Posts | Yes | Yes |
+| Backup Your Instagram Account | Yes | Yes |
+| Download Instagram Saved Posts | **Yes** | No |
+| Download Instagram Tagged Posts | **Yes** | No |
+| Export and import subscriptions | No | No |
+| **Paid** | **No** | **No** |
+| **Free options** | The program is completely free | The program is completely free, but site limits are not declared |
+| Operating Systems | Windows 7+ | Windows, MacOS, Linux |
+| Select want content type to download | Yes | Yes |
+| Suported sites | 3 internal and any site using plugins | 86+ sites (declared) |
+| Other sites support | **Yes** | No |
+| Still supported | **Yes** | **No (last release date May 4, 2021)** |

README.md

@@ -1,64 +1,140 @@
 # Social networks crawler
 
-Program for downloading photo and video from Reddit and Twitter
+[![GitHub release (latest by date)](https://img.shields.io/github/v/release/AAndyProgram/SCrawler)](https://github.com/AAndyProgram/SCrawler/releases/latest)
+[![GitHub](https://img.shields.io/github/license/AAndyProgram/SCrawler)](https://github.com/AAndyProgram/SCrawler/)
+[![FAQ](https://img.shields.io/badge/FAQ-green)](FAQ.md)
+[![GUIDE](https://img.shields.io/badge/GUIDE-green)](https://github.com/AAndyProgram/SCrawler/wiki)
+[![How to support](https://img.shields.io/badge/HowToSupport-green)](HowToSupport.md)
 
-Enjoying the tool? Considering adding to my coffee fund :)
+A program to download photo and video from [any site](#supported-sites) (e.g. Reddit, Twitter, Instagram).
+
+Do you like this program? Consider adding to my coffee fund by making a donation to show your support. :blush:
 
 [![ko-fi](https://www.ko-fi.com/img/githubbutton_sm.svg)](https://ko-fi.com/andyprogram)
 
+**Bitcoin**: bitcoin:BC1Q0NH839FT5TA44DD7L7RLR97XDQAG9V8D6N7XET
+
+![Main window](ProgramScreenshots/MainWindow.png)
+![Channels window](ProgramScreenshots/Channels.png)
+
 # What can program do:
 - Download pictures and videos from users' profiles and subreddits:
   - Reddit images;
   - Reddit galleries of images;
   - Redgifs hosted videos (https://www.redgifs.com/);
-  - Reddit hosted videos (downloading Reddit hosted video is going through ffmpeg);
+  - Reddit hosted videos (downloading Reddit hosted video is going through ffmpeg (**ffmpeg only works with the x64 program**));
-  - Twitter images;
+  - Twitter images and videos;
-  - Twitter videos.
+  - Instagram images and videos.
-- Parse channel and view data.
+  - Imgur images, galleries and videos
+  - Gfycat videos
+  - [Other](#supported-sites) supported sites
+- Parse [channel and view data](https://github.com/AAndyProgram/SCrawler/wiki/Channels).
+- Download [saved Reddit and Instagram posts](https://github.com/AAndyProgram/SCrawler/wiki/Home#saved-posts).
 - Add users from parsed channel.
+- **Advanced user management.**
 - Labeling users.
+- Adding users to favorites and temporary.
 - Filter exists users by label or group.
 - Selection of media types you want to download (images only, videos only, both)
+- Download a special video, image or gallery
+- Making collections (grouping users into collections)
+- Specifying a user folder (for downloading data to another location)
+- Changing user icons
+- Changing view modes
+- ...and many others...
+
+# Supported sites
+
+- **Reddit**
+- **Twitter**
+- **Instagram**
+- RedGifs
+- Imgur
+- Gfycat
+- [Other sites](Plugins.md)
 
 # How does it works:
 
+First, the program downloads the full profile. After the program downloads only new posts. The program remembers downloaded posts.
+
 ## Reddit
 
-The program parsing all user's posts, gathering pictures' MD5 hash and compare with existing for remove duplicates. Then media will be downloaded.
+The program parses all user posts, obtain MD5  images hash and compares them with existing ones to remove duplicates. Then the media will be downloaded.
 
-## Twitter
+## Other sites
 
-The program parsing all user's posts and compare file names with existing for remove duplicates. Then media will be downloaded.
+The program parses all user posts and compares file names with existing ones to remove duplicates. Then the media will be downloaded.
 
-# Requirements:
+You can read about Instagram restrictions [here](https://github.com/AAndyProgram/SCrawler/wiki/Settings#instagram-limits)
+
+## How to request a new site
+
+Read [here](CONTRIBUTING.md#how-to-request-a-new-site) about
+
+# Requirements
 
 - Windows 7, 8, 9, 10, 11 with NET Framework 4.6.1 or higher
 - Authorization cookies and tokens for Twitter (if you want to download data from Twitter)
-- ffmpeg library for download Reddit hosted videos (you can download it from the [official repo](https://github.com/GyanD/codexffmpeg/releases/tag/2021-01-12-git-ca21cb1e36) or [from my first release](https://github.com/AAndyProgram/SCrawler/releases/download/1.0.0.0/ffmpeg.zip))
+- Authorization cookies Instagram (if you want to download data from Instagram)
-- Don't put program in the ```Program Files``` system folder (this is portable program and program settings are stored in the program folder)
+- ffmpeg library for downloading videos hosted on Reddit (you can download it from the [official repo](https://github.com/GyanD/codexffmpeg/releases/tag/2021-01-12-git-ca21cb1e36) or [from my first release](https://github.com/AAndyProgram/SCrawler/releases/download/1.0.0.0/ffmpeg.zip)). **ffmpeg only works with the x64 version of the program.**
-- Just unpack program archive in any folder you want, copy ```ffmpeg.exe``` into and enjoy. :-)
+
+# Guide
+
+**Full guide you can find [here](https://github.com/AAndyProgram/SCrawler/wiki)**
+
+# Installation
+
+**Just unzip the program archive to any folder, copy the file ```ffmpeg.exe``` into it and enjoy.** :blush:
+
+**Don't put program in the ```Program Files``` system folder (this is portable program and program settings are stored in the program folder)**
+
+# Updating
+
+Just download [latest](https://github.com/AAndyProgram/SCrawler/releases/latest) version and unpack it into the program folder. **Before starting a new version, I recommend making a backup copy of the program settings folder.**
+
+# How to build from source
+
+1. Delete the "PersonalUtilities" project from the solution.
+1. Add the latest version of the "PersonalUtilities.dll" library (from the [latest release](https://github.com/AAndyProgram/SCrawler/releases/latest)).
+1. Import PersonalUtilities.Functions for the whole project.
+
+# How to make a plugin
+
+Read about how to make plugin [here](https://github.com/AAndyProgram/SCrawler/wiki/Plugins).
+
+# How to support
+
+Read more about how to support the program [here](HowToSupport.md).
 
 # Settings and usage
 
 The program has an intuitive interface.
 
-Just add user profile and press ```Start downloading``` button.
+Just add a user profile and click the ```Start downloading``` button.
 
-Users can be added by patterns:
+You can add users by patterns:
+- https://www.instagram.com/SomeUserName
 - https://twitter.com/SomeUserName
 - https://reddit.com/user/SomeUserName
 - https://reddit.com/r/SomeSubredditName
+- https://www.redgifs.com/users/SomeUserName
 - u/SomeUserName
 - r/SomeSubredditName
-- SomeUserName (in this case you must to choose user site)
+- SomeUserName (in this case, you need to select the user's site)
 - SomeSubredditName
 
-More about users and subreddits adding [here](https://github.com/AAndyProgram/SCrawler/wiki/Users)
+Read more about adding users and subreddits [here](https://github.com/AAndyProgram/SCrawler/wiki/Users)
 
-**Full guide you can find [here](https://github.com/AAndyProgram/SCrawler/wiki)**
+![Add user](ProgramScreenshots/CreateUserClear.png)
 
-## Using program as just video downloader
+# Using program as just video downloader
 
-Create a shortcut for the program. Open shortcut properties. On the ```Shortcut``` tab in ```Target``` field just add ```v``` at the end through the space.
+Create a shortcut for the program. Open shortcut properties. In the ```Shortcut``` tab, in the ```Target``` field, just add the letter ```v``` at the end across the space.
 
 Example: ```D:\Programs\SCrawler\SCrawler.exe v```
+
+![Separate video downloader](ProgramScreenshots/SeparateVideoDownloader.png)
+
+# Contact me
+
+[![matrix](https://img.shields.io/badge/Matrix-%40andyprogram%3Amatrix.org-informational)](https://matrix.to/#/@andyprogram:matrix.org)

SCrawler.PluginProvider/.editorconfig

@@ -0,0 +1,3 @@
+[*.vb]
+# Modifier preferences
+file_header_template = Copyright (C) 2022  Andy\nThis program is free software: you can redistribute it and/or modify\nit under the terms of the GNU General Public License as published by\nthe Free Software Foundation, either version 3 of the License, or\n(at your option) any later version.\n\nThis program is distributed in the hope that it will be useful,\nbut WITHOUT ANY WARRANTY; without even the implied warranty of\nMERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the\nGNU General Public License for more details.\n\nYou should have received a copy of the GNU General Public License\nalong with this program.  If not, see <https://www.gnu.org/licenses/>

SCrawler.PluginProvider/Attributes/Attributes.vb

@@ -0,0 +1,153 @@
+' Copyright (C) 2022  Andy
+' This program is free software: you can redistribute it and/or modify
+' it under the terms of the GNU General Public License as published by
+' the Free Software Foundation, either version 3 of the License, or
+' (at your option) any later version.
+'
+' This program is distributed in the hope that it will be useful,
+' but WITHOUT ANY WARRANTY
+Imports System.Runtime.CompilerServices
+Namespace Plugin.Attributes
+    ''' <summary>Create a control for a property</summary>
+    <AttributeUsage(AttributeTargets.Property, AllowMultiple:=False, Inherited:=False)> Public NotInheritable Class PropertyOption : Inherits Attribute
+        ''' <summary>Property name</summary>
+        Public ReadOnly Property Name As String
+        ''' <summary>Property value type</summary>
+        Public Property [Type] As Type
+        Private _ControlText As String
+        ''' <summary>This text will be displayed on the control information.<br/>Default: equals the name (property name)</summary>
+        Public Property ControlText As String
+            Get
+                Return If(String.IsNullOrEmpty(_ControlText), Name, _ControlText)
+            End Get
+            Set(ByVal NewText As String)
+                _ControlText = NewText
+            End Set
+        End Property
+        ''' <summary>This tooltip will be displayed on the control.<br/>Default: <see langword="String.Empty"/></summary>
+        Public Property ControlToolTip As String
+        ''' <summary>CheckBox ThreeStates mode</summary>
+        Public Property ThreeStates As Boolean = False
+        ''' <summary>Property allows null values</summary>
+        Public Property AllowNull As Boolean = True
+        ''' <summary>Offset the control from the left border of the form.<br/>Default: 100</summary>
+        Public Property LeftOffset As Integer = 100
+        ''' <summary>This is an authorization property</summary>
+        Public Property IsAuth As Boolean = False
+        ''' <summary>Initialize a new property option attribute</summary>
+        ''' <param name="PropertyName">Property name</param>
+        Public Sub New(<CallerMemberName()> Optional ByVal PropertyName As String = Nothing)
+            Name = PropertyName
+        End Sub
+    End Class
+    ''' <summary>Store property value in settings XML file</summary>
+    <AttributeUsage(AttributeTargets.Property, AllowMultiple:=False, Inherited:=False)> Public NotInheritable Class PXML : Inherits Attribute
+        Public ReadOnly ElementName As String
+        ''' <summary>Initialize a new XML attribute</summary>
+        ''' <param name="XMLElementName">XML element name</param>
+        Public Sub New(<CallerMemberName()> Optional ByVal XMLElementName As String = Nothing)
+            ElementName = XMLElementName
+        End Sub
+    End Class
+    ''' <summary>Special property updater</summary>
+    <AttributeUsage(AttributeTargets.Method, AllowMultiple:=True, Inherited:=False)> Public NotInheritable Class PropertyUpdater : Inherits Attribute
+        Public ReadOnly Name As String
+        Public ReadOnly Dependencies As String()
+        ''' <inheritdoc cref="PropertyUpdater.New(String, String())"/>
+        Public Sub New(ByVal UpdatingPropertyName As String)
+            Name = UpdatingPropertyName
+        End Sub
+        ''' <summary>Initialize a new PropertyUpdater attribute</summary>
+        ''' <param name="UpdatingPropertyName">The name of the property to be updated</param>
+        Public Sub New(ByVal UpdatingPropertyName As String, ByVal Dependent As String())
+            Name = UpdatingPropertyName
+            Dependencies = Dependent
+        End Sub
+    End Class
+    ''' <summary>Plugin key</summary>
+    <AttributeUsage(AttributeTargets.Class, AllowMultiple:=False, Inherited:=False)> Public NotInheritable Class Manifest : Inherits Attribute
+        Public ReadOnly GUID As String
+        ''' <summary>Initialize a new Manifest attribute</summary>
+        ''' <param name="ClassGuid">Plugin key</param>
+        Public Sub New(ByVal ClassGuid As String)
+            GUID = ClassGuid
+        End Sub
+    End Class
+    ''' <summary>Special form attribute for settings forms and user creator form</summary>
+    <AttributeUsage(AttributeTargets.Class, AllowMultiple:=True, Inherited:=False)> Public NotInheritable Class SpecialForm : Inherits Attribute
+        Public ReadOnly SettingsForm As Boolean
+        ''' <summary>Initialize a new SpecialForm attribute</summary>
+        ''' <param name="IsSettingsForm">
+        ''' <see langword="True"/> - for setting form<br/>
+        ''' <see langword="False"/> - for user creator form
+        ''' </param>
+        Public Sub New(ByVal IsSettingsForm As Boolean)
+            SettingsForm = IsSettingsForm
+        End Sub
+    End Class
+    ''' <summary>Property provider</summary>
+    <AttributeUsage(AttributeTargets.Property, AllowMultiple:=True, Inherited:=False)> Public NotInheritable Class Provider : Inherits Attribute
+        Public ReadOnly Name As String
+        ''' <summary>
+        ''' <see langword="True"/> - form field validation provider. Must return null if the value is invalid.<br/>
+        ''' <see langword="False"/> - only for conversion
+        ''' </summary>
+        Public FieldsChecker As Boolean = False
+        ''' <summary>Initialize a new Provider attribute. <see cref="IFormatProvider"/> is only allowed</summary>
+        ''' <param name="PropertyName">The name of the property for which this provider is used</param>
+        Public Sub New(ByVal PropertyName As String)
+            Name = PropertyName
+        End Sub
+    End Class
+    ''' <summary>Sort attribute for settings form</summary>
+    <AttributeUsage(AttributeTargets.Property, AllowMultiple:=False, Inherited:=False)> Public NotInheritable Class ControlNumber : Inherits Attribute
+        Public ReadOnly PropertyNumber As String
+        ''' <summary>Initialize a new sort attribute instance for the settings form</summary>
+        ''' <param name="Number">Object position number in the settings form</param>
+        Public Sub New(ByVal Number As Integer)
+            PropertyNumber = Number
+        End Sub
+    End Class
+    ''' <summary>Attribute for properties values validation methods</summary>
+    <AttributeUsage(AttributeTargets.Method, AllowMultiple:=True, Inherited:=False)> Public NotInheritable Class PropertiesDataChecker : Inherits Attribute
+        Public ReadOnly ComparableNames As String()
+        ''' <summary>Initialize a new PropertiesDataChecker attribute.</summary>
+        ''' <param name="Names">Array of the property names</param>
+        Public Sub New(ByVal Names As String())
+            ComparableNames = Names
+        End Sub
+    End Class
+    ''' <summary>This attribute specifies that users should be downloaded on a separate thread.</summary>
+    <AttributeUsage(AttributeTargets.Class, AllowMultiple:=False, Inherited:=False)> Public NotInheritable Class SeparatedTasks : Inherits Attribute
+        Public ReadOnly TasksCount As Integer
+        ''' <summary>Initialize a new SeparatedTasks attribute.</summary>
+        ''' <param name="JobsCount">
+        ''' Predefined task counter.<br/>
+        ''' <see cref="TaskCounter"/> will take precedence if it is defined.
+        ''' </param>
+        Public Sub New(Optional ByVal JobsCount As Integer = -1)
+            TasksCount = JobsCount
+        End Sub
+    End Class
+    ''' <summary>A property attribute that specifies how many users should be downloaded at the same time in one thread</summary>
+    <AttributeUsage(AttributeTargets.Property, AllowMultiple:=False, Inherited:=False)> Public NotInheritable Class TaskCounter : Inherits Attribute
+    End Class
+    ''' <summary>This attribute indicates that the plugin has a SavedPosts environment</summary>
+    <AttributeUsage(AttributeTargets.Class, AllowMultiple:=False, Inherited:=False)> Public NotInheritable Class SavedPosts : Inherits Attribute
+    End Class
+    ''' <summary>This is an attribute of the UserData instance. Specifies that the default internal SCrawler downloader should be used.</summary>
+    <AttributeUsage(AttributeTargets.Class, AllowMultiple:=False, Inherited:=False)> Public NotInheritable Class UseInternalDownloader : Inherits Attribute
+    End Class
+    ''' <summary>GitHub plugin info</summary>
+    <AttributeUsage(AttributeTargets.Assembly, AllowMultiple:=False, Inherited:=False)> Public NotInheritable Class Github : Inherits Attribute
+        Public ReadOnly UserName As String
+        Public ReadOnly Repository As String
+        ''' <summary>Initialize a new Github attribute.</summary>
+        ''' <param name="Name">Developer GitHub username</param>
+        ''' <param name="RepoName">Plugin repository name</param>
+        Public Sub New(ByVal Name As String, ByVal RepoName As String)
+            UserName = Name
+            Repository = RepoName
+        End Sub
+    End Class
+End Namespace

SCrawler.PluginProvider/Interfaces/IPluginContentProvider.vb

@@ -0,0 +1,36 @@
+' Copyright (C) 2022  Andy
+' This program is free software: you can redistribute it and/or modify
+' it under the terms of the GNU General Public License as published by
+' the Free Software Foundation, either version 3 of the License, or
+' (at your option) any later version.
+'
+' This program is distributed in the hope that it will be useful,
+' but WITHOUT ANY WARRANTY
+Namespace Plugin
+    Public Interface IPluginContentProvider
+        Event ProgressChanged(ByVal Count As Integer)
+        Event TotalCountChanged(ByVal Count As Integer)
+        Property Thrower As IThrower
+        Property LogProvider As ILogProvider
+        Property Settings As ISiteSettings
+        Property Name As String
+        Property ID As String
+        Property ParseUserMediaOnly As Boolean
+        Property UserDescription As String
+        Property ExistingContentList As List(Of PluginUserMedia)
+        Property TempPostsList As List(Of String)
+        Property TempMediaList As List(Of IPluginUserMedia)
+        Property UserExists As Boolean
+        Property UserSuspended As Boolean
+        Property IsSavedPosts As Boolean
+        Property SeparateVideoFolder As Boolean
+        Property DataPath As String
+        Property PostsNumberLimit As Integer?
+        Function ExchangeOptionsGet() As Object
+        Sub ExchangeOptionsSet(ByVal Obj As Object)
+        Sub XmlFieldsSet(ByVal Fields As List(Of KeyValuePair(Of String, String)))
+        Function XmlFieldsGet() As List(Of KeyValuePair(Of String, String))
+        Sub GetMedia()
+        Sub Download()
+    End Interface
+End Namespace

SCrawler.PluginProvider/Interfaces/ISiteSettings.vb

@@ -0,0 +1,47 @@
+' Copyright (C) 2022  Andy
+' This program is free software: you can redistribute it and/or modify
+' it under the terms of the GNU General Public License as published by
+' the Free Software Foundation, either version 3 of the License, or
+' (at your option) any later version.
+'
+' This program is distributed in the hope that it will be useful,
+' but WITHOUT ANY WARRANTY
+Imports System.Drawing
+Namespace Plugin
+    Public Interface ISiteSettings
+        Enum Download As Integer
+            Main = 0
+            SavedPosts = 1
+            Channel = 2
+        End Enum
+        ReadOnly Property Icon As Icon
+        ReadOnly Property Image As Image
+        ReadOnly Property Site As String
+        Function GetUserUrl(ByVal UserName As String, ByVal Channel As Boolean) As String
+        Function IsMyUser(ByVal UserURL As String) As ExchangeOptions
+        Function IsMyImageVideo(ByVal URL As String) As ExchangeOptions
+        Function GetSpecialData(ByVal URL As String) As IEnumerable(Of IPluginUserMedia)
+        Function GetInstance(ByVal What As Download) As IPluginContentProvider
+#Region "XML Support"
+        Sub Load(ByVal XMLValues As IEnumerable(Of KeyValuePair(Of String, String)))
+#End Region
+#Region "Initialization"
+        Sub BeginInit()
+        Sub EndInit()
+        Sub BeginUpdate()
+        Sub EndUpdate()
+#End Region
+#Region "Site availability"
+        Function Available(ByVal What As Download) As Boolean
+        Function ReadyToDownload(ByVal What As Download) As Boolean
+#End Region
+#Region "Downloading"
+        Sub DownloadStarted(ByVal What As Download)
+        Sub BeforeStartDownload(ByVal User As Object, ByVal What As Download)
+        Sub AfterDownload(ByVal User As Object, ByVal What As Download)
+        Sub DownloadDone(ByVal What As Download)
+#End Region
+        Sub OpenSettingsForm()
+        Sub UserOptions(ByRef Options As Object, ByVal OpenForm As Boolean)
+    End Interface
+End Namespace

SCrawler.PluginProvider/My Project/Application.Designer.vb

@@ -0,0 +1,13 @@
+'------------------------------------------------------------------------------
+' <auto-generated>
+'     This code was generated by a tool.
+'     Runtime Version:4.0.30319.42000
+'
+'     Changes to this file may cause incorrect behavior and will be lost if
+'     the code is regenerated.
+' </auto-generated>
+'------------------------------------------------------------------------------
+
+Option Strict On
+Option Explicit On
+

SCrawler.PluginProvider/My Project/Application.myapp

@@ -0,0 +1,10 @@
+<?xml version="1.0" encoding="utf-8"?>
+<MyApplicationData xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xmlns:xsd="http://www.w3.org/2001/XMLSchema">
+  <MySubMain>false</MySubMain>
+  <SingleInstance>false</SingleInstance>
+  <ShutdownMode>0</ShutdownMode>
+  <EnableVisualStyles>true</EnableVisualStyles>
+  <AuthenticationMode>0</AuthenticationMode>
+  <ApplicationType>1</ApplicationType>
+  <SaveMySettingsOnExit>true</SaveMySettingsOnExit>
+</MyApplicationData>

SCrawler.PluginProvider/My Project/AssemblyInfo.vb

@@ -0,0 +1,37 @@
+Imports System.Resources
+Imports System
+Imports System.Reflection
+Imports System.Runtime.InteropServices
+
+' General Information about an assembly is controlled through the following
+' set of attributes. Change these attribute values to modify the information
+' associated with an assembly.
+
+' Review the values of the assembly attributes
+
+<Assembly: AssemblyTitle("SCrawler plugin provider")>
+<Assembly: AssemblyDescription("Plugin provider for SCrawler")>
+<Assembly: AssemblyCompany("AndyProgram")>
+<Assembly: AssemblyProduct("SCrawler.PluginProvider")>
+<Assembly: AssemblyCopyright("Copyright ©  2022")>
+<Assembly: AssemblyTrademark("AndyProgram")>
+
+<Assembly: ComVisible(False)>
+
+'The following GUID is for the ID of the typelib if this project is exposed to COM
+<Assembly: Guid("1f6c9516-360e-4a2b-80d4-ae0d9a4e5cfd")>
+
+' Version information for an assembly consists of the following four values:
+'
+'      Major Version
+'      Minor Version
+'      Build Number
+'      Revision
+'
+' You can specify all the values or you can default the Build and Revision Numbers
+' by using the '*' as shown below:
+' <Assembly: AssemblyVersion("1.0.*")>
+
+<Assembly: AssemblyVersion("3.0.0.0")>
+<Assembly: AssemblyFileVersion("3.0.0.0")>
+<Assembly: NeutralResourcesLanguage("en")>

SCrawler.PluginProvider/My Project/Resources.Designer.vb

@@ -0,0 +1,63 @@
+'------------------------------------------------------------------------------
+' <auto-generated>
+'     This code was generated by a tool.
+'     Runtime Version:4.0.30319.42000
+'
+'     Changes to this file may cause incorrect behavior and will be lost if
+'     the code is regenerated.
+' </auto-generated>
+'------------------------------------------------------------------------------
+
+Option Strict On
+Option Explicit On
+
+Imports System
+
+Namespace My.Resources
+    
+    'This class was auto-generated by the StronglyTypedResourceBuilder
+    'class via a tool like ResGen or Visual Studio.
+    'To add or remove a member, edit your .ResX file then rerun ResGen
+    'with the /str option, or rebuild your VS project.
+    '''<summary>
+    '''  A strongly-typed resource class, for looking up localized strings, etc.
+    '''</summary>
+    <Global.System.CodeDom.Compiler.GeneratedCodeAttribute("System.Resources.Tools.StronglyTypedResourceBuilder", "16.0.0.0"),  _
+     Global.System.Diagnostics.DebuggerNonUserCodeAttribute(),  _
+     Global.System.Runtime.CompilerServices.CompilerGeneratedAttribute(),  _
+     Global.Microsoft.VisualBasic.HideModuleNameAttribute()>  _
+    Friend Module Resources
+        
+        Private resourceMan As Global.System.Resources.ResourceManager
+        
+        Private resourceCulture As Global.System.Globalization.CultureInfo
+        
+        '''<summary>
+        '''  Returns the cached ResourceManager instance used by this class.
+        '''</summary>
+        <Global.System.ComponentModel.EditorBrowsableAttribute(Global.System.ComponentModel.EditorBrowsableState.Advanced)>  _
+        Friend ReadOnly Property ResourceManager() As Global.System.Resources.ResourceManager
+            Get
+                If Object.ReferenceEquals(resourceMan, Nothing) Then
+                    Dim temp As Global.System.Resources.ResourceManager = New Global.System.Resources.ResourceManager("SCrawler.Resources", GetType(Resources).Assembly)
+                    resourceMan = temp
+                End If
+                Return resourceMan
+            End Get
+        End Property
+        
+        '''<summary>
+        '''  Overrides the current thread's CurrentUICulture property for all
+        '''  resource lookups using this strongly typed resource class.
+        '''</summary>
+        <Global.System.ComponentModel.EditorBrowsableAttribute(Global.System.ComponentModel.EditorBrowsableState.Advanced)>  _
+        Friend Property Culture() As Global.System.Globalization.CultureInfo
+            Get
+                Return resourceCulture
+            End Get
+            Set
+                resourceCulture = value
+            End Set
+        End Property
+    End Module
+End Namespace

SCrawler.PluginProvider/My Project/Resources.resx

@@ -0,0 +1,117 @@
+<?xml version="1.0" encoding="utf-8"?>
+<root>
+  <!-- 
+    Microsoft ResX Schema 
+    
+    Version 2.0
+    
+    The primary goals of this format is to allow a simple XML format 
+    that is mostly human readable. The generation and parsing of the 
+    various data types are done through the TypeConverter classes 
+    associated with the data types.
+    
+    Example:
+    
+    ... ado.net/XML headers & schema ...
+    <resheader name="resmimetype">text/microsoft-resx</resheader>
+    <resheader name="version">2.0</resheader>
+    <resheader name="reader">System.Resources.ResXResourceReader, System.Windows.Forms, ...</resheader>
+    <resheader name="writer">System.Resources.ResXResourceWriter, System.Windows.Forms, ...</resheader>
+    <data name="Name1"><value>this is my long string</value><comment>this is a comment</comment></data>
+    <data name="Color1" type="System.Drawing.Color, System.Drawing">Blue</data>
+    <data name="Bitmap1" mimetype="application/x-microsoft.net.object.binary.base64">
+        <value>[base64 mime encoded serialized .NET Framework object]</value>
+    </data>
+    <data name="Icon1" type="System.Drawing.Icon, System.Drawing" mimetype="application/x-microsoft.net.object.bytearray.base64">
+        <value>[base64 mime encoded string representing a byte array form of the .NET Framework object]</value>
+        <comment>This is a comment</comment>
+    </data>
+                
+    There are any number of "resheader" rows that contain simple 
+    name/value pairs.
+    
+    Each data row contains a name, and value. The row also contains a 
+    type or mimetype. Type corresponds to a .NET class that support 
+    text/value conversion through the TypeConverter architecture. 
+    Classes that don't support this are serialized and stored with the 
+    mimetype set.
+    
+    The mimetype is used for serialized objects, and tells the 
+    ResXResourceReader how to depersist the object. This is currently not 
+    extensible. For a given mimetype the value must be set accordingly:
+    
+    Note - application/x-microsoft.net.object.binary.base64 is the format 
+    that the ResXResourceWriter will generate, however the reader can 
+    read any of the formats listed below.
+    
+    mimetype: application/x-microsoft.net.object.binary.base64
+    value   : The object must be serialized with 
+            : System.Serialization.Formatters.Binary.BinaryFormatter
+            : and then encoded with base64 encoding.
+    
+    mimetype: application/x-microsoft.net.object.soap.base64
+    value   : The object must be serialized with 
+            : System.Runtime.Serialization.Formatters.Soap.SoapFormatter
+            : and then encoded with base64 encoding.
+
+    mimetype: application/x-microsoft.net.object.bytearray.base64
+    value   : The object must be serialized into a byte array 
+            : using a System.ComponentModel.TypeConverter
+            : and then encoded with base64 encoding.
+    -->
+  <xsd:schema id="root" xmlns="" xmlns:xsd="http://www.w3.org/2001/XMLSchema" xmlns:msdata="urn:schemas-microsoft-com:xml-msdata">
+    <xsd:element name="root" msdata:IsDataSet="true">
+      <xsd:complexType>
+        <xsd:choice maxOccurs="unbounded">
+          <xsd:element name="metadata">
+            <xsd:complexType>
+              <xsd:sequence>
+                <xsd:element name="value" type="xsd:string" minOccurs="0" />
+              </xsd:sequence>
+              <xsd:attribute name="name" type="xsd:string" />
+              <xsd:attribute name="type" type="xsd:string" />
+              <xsd:attribute name="mimetype" type="xsd:string" />
+            </xsd:complexType>
+          </xsd:element>
+          <xsd:element name="assembly">
+            <xsd:complexType>
+              <xsd:attribute name="alias" type="xsd:string" />
+              <xsd:attribute name="name" type="xsd:string" />
+            </xsd:complexType>
+          </xsd:element>
+          <xsd:element name="data">
+            <xsd:complexType>
+              <xsd:sequence>
+                <xsd:element name="value" type="xsd:string" minOccurs="0" msdata:Ordinal="1" />
+                <xsd:element name="comment" type="xsd:string" minOccurs="0" msdata:Ordinal="2" />
+              </xsd:sequence>
+              <xsd:attribute name="name" type="xsd:string" msdata:Ordinal="1" />
+              <xsd:attribute name="type" type="xsd:string" msdata:Ordinal="3" />
+              <xsd:attribute name="mimetype" type="xsd:string" msdata:Ordinal="4" />
+            </xsd:complexType>
+          </xsd:element>
+          <xsd:element name="resheader">
+            <xsd:complexType>
+              <xsd:sequence>
+                <xsd:element name="value" type="xsd:string" minOccurs="0" msdata:Ordinal="1" />
+              </xsd:sequence>
+              <xsd:attribute name="name" type="xsd:string" use="required" />
+            </xsd:complexType>
+          </xsd:element>
+        </xsd:choice>
+      </xsd:complexType>
+    </xsd:element>
+  </xsd:schema>
+  <resheader name="resmimetype">
+    <value>text/microsoft-resx</value>
+  </resheader>
+  <resheader name="version">
+    <value>2.0</value>
+  </resheader>
+  <resheader name="reader">
+    <value>System.Resources.ResXResourceReader, System.Windows.Forms, Version=2.0.0.0, Culture=neutral, PublicKeyToken=b77a5c561934e089</value>
+  </resheader>
+  <resheader name="writer">
+    <value>System.Resources.ResXResourceWriter, System.Windows.Forms, Version=2.0.0.0, Culture=neutral, PublicKeyToken=b77a5c561934e089</value>
+  </resheader>
+</root>

SCrawler.PluginProvider/My Project/Settings.Designer.vb

@@ -0,0 +1,73 @@
+'------------------------------------------------------------------------------
+' <auto-generated>
+'     This code was generated by a tool.
+'     Runtime Version:4.0.30319.42000
+'
+'     Changes to this file may cause incorrect behavior and will be lost if
+'     the code is regenerated.
+' </auto-generated>
+'------------------------------------------------------------------------------
+
+Option Strict On
+Option Explicit On
+
+
+Namespace My
+    
+    <Global.System.Runtime.CompilerServices.CompilerGeneratedAttribute(),  _
+     Global.System.CodeDom.Compiler.GeneratedCodeAttribute("Microsoft.VisualStudio.Editors.SettingsDesigner.SettingsSingleFileGenerator", "16.10.0.0"),  _
+     Global.System.ComponentModel.EditorBrowsableAttribute(Global.System.ComponentModel.EditorBrowsableState.Advanced)>  _
+    Partial Friend NotInheritable Class MySettings
+        Inherits Global.System.Configuration.ApplicationSettingsBase
+        
+        Private Shared defaultInstance As MySettings = CType(Global.System.Configuration.ApplicationSettingsBase.Synchronized(New MySettings()),MySettings)
+        
+#Region "My.Settings Auto-Save Functionality"
+#If _MyType = "WindowsForms" Then
+    Private Shared addedHandler As Boolean
+
+    Private Shared addedHandlerLockObject As New Object
+
+    <Global.System.Diagnostics.DebuggerNonUserCodeAttribute(), Global.System.ComponentModel.EditorBrowsableAttribute(Global.System.ComponentModel.EditorBrowsableState.Advanced)> _
+    Private Shared Sub AutoSaveSettings(sender As Global.System.Object, e As Global.System.EventArgs)
+        If My.Application.SaveMySettingsOnExit Then
+            My.Settings.Save()
+        End If
+    End Sub
+#End If
+#End Region
+        
+        Public Shared ReadOnly Property [Default]() As MySettings
+            Get
+                
+#If _MyType = "WindowsForms" Then
+               If Not addedHandler Then
+                    SyncLock addedHandlerLockObject
+                        If Not addedHandler Then
+                            AddHandler My.Application.Shutdown, AddressOf AutoSaveSettings
+                            addedHandler = True
+                        End If
+                    End SyncLock
+                End If
+#End If
+                Return defaultInstance
+            End Get
+        End Property
+    End Class
+End Namespace
+
+Namespace My
+    
+    <Global.Microsoft.VisualBasic.HideModuleNameAttribute(),  _
+     Global.System.Diagnostics.DebuggerNonUserCodeAttribute(),  _
+     Global.System.Runtime.CompilerServices.CompilerGeneratedAttribute()>  _
+    Friend Module MySettingsProperty
+        
+        <Global.System.ComponentModel.Design.HelpKeywordAttribute("My.Settings")>  _
+        Friend ReadOnly Property Settings() As Global.SCrawler.My.MySettings
+            Get
+                Return Global.SCrawler.My.MySettings.Default
+            End Get
+        End Property
+    End Module
+End Namespace

SCrawler.PluginProvider/My Project/Settings.settings

@@ -0,0 +1,7 @@
+<?xml version='1.0' encoding='utf-8'?>
+<SettingsFile xmlns="http://schemas.microsoft.com/VisualStudio/2004/01/settings" CurrentProfile="(Default)" UseMySettingsClassName="true">
+  <Profiles>
+    <Profile Name="(Default)" />
+  </Profiles>
+  <Settings />
+</SettingsFile>

SCrawler.PluginProvider/ObjectInterfaces/ILogProvider.vb

@@ -0,0 +1,16 @@
+' Copyright (C) 2022  Andy
+' This program is free software: you can redistribute it and/or modify
+' it under the terms of the GNU General Public License as published by
+' the Free Software Foundation, either version 3 of the License, or
+' (at your option) any later version.
+'
+' This program is distributed in the hope that it will be useful,
+' but WITHOUT ANY WARRANTY
+Namespace Plugin
+    Public Interface ILogProvider
+        Overloads Sub Add(ByVal Message As String)
+        Overloads Sub Add(ByVal ex As Exception, ByVal Message As String,
+                          Optional ByVal ShowMainMsg As Boolean = False, Optional ByVal ShowErrorMsg As Boolean = False,
+                          Optional ByVal SendInLog As Boolean = True)
+    End Interface
+End Namespace

SCrawler.PluginProvider/ObjectInterfaces/IPluginUserMedia.vb

@@ -0,0 +1,40 @@
+' Copyright (C) 2022  Andy
+' This program is free software: you can redistribute it and/or modify
+' it under the terms of the GNU General Public License as published by
+' the Free Software Foundation, either version 3 of the License, or
+' (at your option) any later version.
+'
+' This program is distributed in the hope that it will be useful,
+' but WITHOUT ANY WARRANTY
+Namespace Plugin
+    Public Structure PluginUserMedia : Implements IPluginUserMedia
+        Public Property ContentType As Integer Implements IPluginUserMedia.ContentType
+        Public Property URL As String Implements IPluginUserMedia.URL
+        Public Property MD5 As String Implements IPluginUserMedia.MD5
+        Public Property File As String Implements IPluginUserMedia.File
+        Public Property DownloadState As Integer Implements IPluginUserMedia.DownloadState
+        Public Property PostID As String Implements IPluginUserMedia.PostID
+        Public Property PostDate As Date? Implements IPluginUserMedia.PostDate
+        Public Property SpecialFolder As String Implements IPluginUserMedia.SpecialFolder
+    End Structure
+    Public Interface IPluginUserMedia
+        Enum Types As Integer
+            Undefined = 0
+            [Picture] = 1
+            [Video] = 2
+            [Text] = 3
+            VideoPre = 10
+            GIF = 50
+            m3u8 = 100
+        End Enum
+        Enum States As Integer : Unknown = 0 : Tried = 1 : Downloaded = 2 : Skipped = 3 : End Enum
+        Property ContentType As Integer
+        Property URL As String
+        Property MD5 As String
+        Property File As String
+        Property DownloadState As Integer
+        Property PostID As String
+        Property PostDate As Date?
+        Property SpecialFolder As String
+    End Interface
+End Namespace

SCrawler.PluginProvider/ObjectInterfaces/IThrower.vb

@@ -0,0 +1,13 @@
+' Copyright (C) 2022  Andy
+' This program is free software: you can redistribute it and/or modify
+' it under the terms of the GNU General Public License as published by
+' the Free Software Foundation, either version 3 of the License, or
+' (at your option) any later version.
+'
+' This program is distributed in the hope that it will be useful,
+' but WITHOUT ANY WARRANTY
+Namespace Plugin
+    Public Interface IThrower
+        Sub ThrowAny()
+    End Interface
+End Namespace

SCrawler.PluginProvider/Objects/ExchangeOptions.vb

@@ -0,0 +1,25 @@
+' Copyright (C) 2022  Andy
+' This program is free software: you can redistribute it and/or modify
+' it under the terms of the GNU General Public License as published by
+' the Free Software Foundation, either version 3 of the License, or
+' (at your option) any later version.
+'
+' This program is distributed in the hope that it will be useful,
+' but WITHOUT ANY WARRANTY
+Namespace Plugin
+    Public Structure ExchangeOptions
+        Public UserName As String
+        Public SiteName As String
+        Public HostKey As String
+        Public IsChannel As Boolean
+        Public Exists As Boolean
+        Public Sub New(ByVal Site As String, ByVal _Name As String)
+            UserName = _Name
+            SiteName = Site
+        End Sub
+        Public Sub New(ByVal Site As String, ByVal _Name As String, ByVal _IsChannel As Boolean)
+            Me.New(Site, _Name)
+            IsChannel = _IsChannel
+        End Sub
+    End Structure
+End Namespace

SCrawler.PluginProvider/Objects/PropertyData.vb

@@ -0,0 +1,18 @@
+' Copyright (C) 2022  Andy
+' This program is free software: you can redistribute it and/or modify
+' it under the terms of the GNU General Public License as published by
+' the Free Software Foundation, either version 3 of the License, or
+' (at your option) any later version.
+'
+' This program is distributed in the hope that it will be useful,
+' but WITHOUT ANY WARRANTY
+Namespace Plugin
+    Public Structure PropertyData
+        Public ReadOnly Name As String
+        Public ReadOnly Value As Object
+        Public Sub New(ByVal _Name As String, ByVal _Value As Object)
+            Name = _Name
+            Value = _Value
+        End Sub
+    End Structure
+End Namespace

SCrawler.PluginProvider/Objects/PropertyValue.vb

@@ -0,0 +1,58 @@
+' Copyright (C) 2022  Andy
+' This program is free software: you can redistribute it and/or modify
+' it under the terms of the GNU General Public License as published by
+' the Free Software Foundation, either version 3 of the License, or
+' (at your option) any later version.
+'
+' This program is distributed in the hope that it will be useful,
+' but WITHOUT ANY WARRANTY
+Namespace Plugin
+    Public NotInheritable Class PropertyValue : Implements IPropertyValue
+        Public Event ValueChanged As IPropertyValue.ValueChangedEventHandler Implements IPropertyValue.ValueChanged
+        Public Property [Type] As Type Implements IPropertyValue.Type
+        Public Property OnChangeFunction As IPropertyValue.ValueChangedEventHandler
+        ''' <inheritdoc cref="PropertyValue.New(Object, Type, ByRef IPropertyValue.ValueChangedEventHandler)"/>
+        ''' <exception cref="ArgumentNullException"></exception>
+        Public Sub New(ByVal InitValue As Object)
+            _Value = InitValue
+            If IsNothing(InitValue) Then
+                Throw New ArgumentNullException("InitValue", "InitValue cannot be null")
+            Else
+                [Type] = _Value.GetType
+            End If
+        End Sub
+        ''' <inheritdoc cref="PropertyValue.New(Object, Type, ByRef IPropertyValue.ValueChangedEventHandler)"/>
+        Public Sub New(ByVal InitValue As Object, ByVal T As Type)
+            _Value = InitValue
+            [Type] = T
+        End Sub
+        ''' <summary>New property value instance</summary>
+        ''' <param name="InitValue">Initialization value</param>
+        ''' <param name="T">Value type</param>
+        ''' <param name="RFunction">CallBack function on value change</param>
+        Public Sub New(ByVal InitValue As Object, ByVal T As Type, ByRef RFunction As IPropertyValue.ValueChangedEventHandler)
+            Me.New(InitValue, T)
+            OnChangeFunction = RFunction
+        End Sub
+        Private _Value As Object
+        Public Property Value As Object Implements IPropertyValue.Value
+            Get
+                Return _Value
+            End Get
+            Set(ByVal NewValue As Object)
+                _Value = NewValue
+                If Not OnChangeFunction Is Nothing Then OnChangeFunction.Invoke(Value)
+                RaiseEvent ValueChanged(_Value)
+            End Set
+        End Property
+    End Class
+    Public Interface IPropertyValue
+        ''' <summary>Event for internal exchange</summary>
+        ''' <param name="Value">New value</param>
+        Event ValueChanged(ByVal Value As Object)
+        ''' <summary>Value type</summary>
+        Property [Type] As Type
+        ''' <summary>Property value</summary>
+        Property Value As Object
+    End Interface
+End Namespace

SCrawler.PluginProvider/SCrawler.PluginProvider.vbproj

@@ -0,0 +1,151 @@
+<?xml version="1.0" encoding="utf-8"?>
+<Project ToolsVersion="15.0" xmlns="http://schemas.microsoft.com/developer/msbuild/2003">
+  <Import Project="$(MSBuildExtensionsPath)\$(MSBuildToolsVersion)\Microsoft.Common.props" Condition="Exists('$(MSBuildExtensionsPath)\$(MSBuildToolsVersion)\Microsoft.Common.props')" />
+  <PropertyGroup>
+    <Configuration Condition=" '$(Configuration)' == '' ">Debug</Configuration>
+    <Platform Condition=" '$(Platform)' == '' ">AnyCPU</Platform>
+    <ProjectGuid>{D4650F6B-5A54-44B6-999B-6C675B7116B1}</ProjectGuid>
+    <OutputType>Library</OutputType>
+    <RootNamespace>SCrawler</RootNamespace>
+    <AssemblyName>SCrawler.PluginProvider</AssemblyName>
+    <FileAlignment>512</FileAlignment>
+    <MyType>Windows</MyType>
+    <TargetFrameworkVersion>v4.6.1</TargetFrameworkVersion>
+    <Deterministic>true</Deterministic>
+  </PropertyGroup>
+  <PropertyGroup Condition=" '$(Configuration)|$(Platform)' == 'Debug|AnyCPU' ">
+    <DebugSymbols>true</DebugSymbols>
+    <DebugType>full</DebugType>
+    <DefineDebug>true</DefineDebug>
+    <DefineTrace>true</DefineTrace>
+    <OutputPath>bin\Debug\</OutputPath>
+    <DocumentationFile>
+    </DocumentationFile>
+    <NoWarn>42016,41999,42017,42018,42019,42032,42036,42020,42021,42022</NoWarn>
+  </PropertyGroup>
+  <PropertyGroup Condition=" '$(Configuration)|$(Platform)' == 'Release|AnyCPU' ">
+    <DebugType>pdbonly</DebugType>
+    <DefineDebug>false</DefineDebug>
+    <DefineTrace>true</DefineTrace>
+    <Optimize>true</Optimize>
+    <OutputPath>bin\Release\</OutputPath>
+    <DocumentationFile>
+    </DocumentationFile>
+    <NoWarn>42016,41999,42017,42018,42019,42032,42036,42020,42021,42022</NoWarn>
+  </PropertyGroup>
+  <PropertyGroup>
+    <OptionExplicit>On</OptionExplicit>
+  </PropertyGroup>
+  <PropertyGroup>
+    <OptionCompare>Binary</OptionCompare>
+  </PropertyGroup>
+  <PropertyGroup>
+    <OptionStrict>Off</OptionStrict>
+  </PropertyGroup>
+  <PropertyGroup>
+    <OptionInfer>On</OptionInfer>
+  </PropertyGroup>
+  <PropertyGroup Condition="'$(Configuration)|$(Platform)' == 'Debug|x64'">
+    <DebugSymbols>true</DebugSymbols>
+    <DefineDebug>true</DefineDebug>
+    <DefineTrace>true</DefineTrace>
+    <OutputPath>bin\x64\Debug\</OutputPath>
+    <NoWarn>42016,41999,42017,42018,42019,42032,42036,42020,42021,42022</NoWarn>
+    <DebugType>full</DebugType>
+    <PlatformTarget>x64</PlatformTarget>
+  </PropertyGroup>
+  <PropertyGroup Condition="'$(Configuration)|$(Platform)' == 'Release|x64'">
+    <DefineTrace>true</DefineTrace>
+    <OutputPath>bin\x64\Release\</OutputPath>
+    <Optimize>true</Optimize>
+    <NoWarn>42016,41999,42017,42018,42019,42032,42036,42020,42021,42022</NoWarn>
+    <DebugType>pdbonly</DebugType>
+    <PlatformTarget>x64</PlatformTarget>
+  </PropertyGroup>
+  <PropertyGroup Condition="'$(Configuration)|$(Platform)' == 'Debug|x86'">
+    <DebugSymbols>true</DebugSymbols>
+    <DefineDebug>true</DefineDebug>
+    <DefineTrace>true</DefineTrace>
+    <OutputPath>bin\x86\Debug\</OutputPath>
+    <NoWarn>42016,41999,42017,42018,42019,42032,42036,42020,42021,42022</NoWarn>
+    <DebugType>full</DebugType>
+    <PlatformTarget>x86</PlatformTarget>
+  </PropertyGroup>
+  <PropertyGroup Condition="'$(Configuration)|$(Platform)' == 'Release|x86'">
+    <DefineTrace>true</DefineTrace>
+    <OutputPath>bin\x86\Release\</OutputPath>
+    <Optimize>true</Optimize>
+    <NoWarn>42016,41999,42017,42018,42019,42032,42036,42020,42021,42022</NoWarn>
+    <DebugType>pdbonly</DebugType>
+    <PlatformTarget>x86</PlatformTarget>
+  </PropertyGroup>
+  <ItemGroup>
+    <Reference Include="System" />
+    <Reference Include="System.Data" />
+    <Reference Include="System.Drawing" />
+    <Reference Include="System.Xml" />
+    <Reference Include="System.Core" />
+    <Reference Include="System.Xml.Linq" />
+    <Reference Include="System.Data.DataSetExtensions" />
+    <Reference Include="System.Net.Http" />
+  </ItemGroup>
+  <ItemGroup>
+    <Import Include="Microsoft.VisualBasic" />
+    <Import Include="System" />
+    <Import Include="System.Collections" />
+    <Import Include="System.Collections.Generic" />
+    <Import Include="System.Data" />
+    <Import Include="System.Diagnostics" />
+    <Import Include="System.Linq" />
+    <Import Include="System.Xml.Linq" />
+    <Import Include="System.Threading.Tasks" />
+  </ItemGroup>
+  <ItemGroup>
+    <Compile Include="Attributes\Attributes.vb" />
+    <Compile Include="Objects\ExchangeOptions.vb" />
+    <Compile Include="ObjectInterfaces\ILogProvider.vb" />
+    <Compile Include="Interfaces\IPluginContentProvider.vb" />
+    <Compile Include="ObjectInterfaces\IPluginUserMedia.vb" />
+    <Compile Include="Interfaces\ISiteSettings.vb" />
+    <Compile Include="ObjectInterfaces\IThrower.vb" />
+    <Compile Include="My Project\AssemblyInfo.vb" />
+    <Compile Include="My Project\Application.Designer.vb">
+      <AutoGen>True</AutoGen>
+      <DependentUpon>Application.myapp</DependentUpon>
+      <DesignTime>True</DesignTime>
+    </Compile>
+    <Compile Include="My Project\Resources.Designer.vb">
+      <AutoGen>True</AutoGen>
+      <DesignTime>True</DesignTime>
+      <DependentUpon>Resources.resx</DependentUpon>
+    </Compile>
+    <Compile Include="My Project\Settings.Designer.vb">
+      <AutoGen>True</AutoGen>
+      <DependentUpon>Settings.settings</DependentUpon>
+      <DesignTimeSharedInput>True</DesignTimeSharedInput>
+    </Compile>
+    <Compile Include="Objects\PropertyData.vb" />
+    <Compile Include="Objects\PropertyValue.vb" />
+  </ItemGroup>
+  <ItemGroup>
+    <EmbeddedResource Include="My Project\Resources.resx">
+      <Generator>VbMyResourcesResXFileCodeGenerator</Generator>
+      <LastGenOutput>Resources.Designer.vb</LastGenOutput>
+      <CustomToolNamespace>My.Resources</CustomToolNamespace>
+      <SubType>Designer</SubType>
+    </EmbeddedResource>
+  </ItemGroup>
+  <ItemGroup>
+    <None Include=".editorconfig" />
+    <None Include="My Project\Application.myapp">
+      <Generator>MyApplicationCodeGenerator</Generator>
+      <LastGenOutput>Application.Designer.vb</LastGenOutput>
+    </None>
+    <None Include="My Project\Settings.settings">
+      <Generator>SettingsSingleFileGenerator</Generator>
+      <CustomToolNamespace>My</CustomToolNamespace>
+      <LastGenOutput>Settings.Designer.vb</LastGenOutput>
+    </None>
+  </ItemGroup>
+  <Import Project="$(MSBuildToolsPath)\Microsoft.VisualBasic.targets" />
+</Project>

SCrawler.sln

@@ -12,12 +12,11 @@ Project("{2150E333-8FDC-42A3-9474-1A3956D46DE8}") = "Solution Items", "Solution
 		.gitignore = .gitignore
 		Changelog.md = Changelog.md
 		README.md = README.md
-		Info\RedditUrlsInfo.txt = Info\RedditUrlsInfo.txt
 		ToDo.txt = ToDo.txt
-		Info\TwitterNewAlgo.txt = Info\TwitterNewAlgo.txt
-		Info\TwitterUrlsInfo.txt = Info\TwitterUrlsInfo.txt
 	EndProjectSection
 EndProject
+Project("{F184B08F-C81C-45F6-A57F-5ABD9991F28F}") = "SCrawler.PluginProvider", "SCrawler.PluginProvider\SCrawler.PluginProvider.vbproj", "{D4650F6B-5A54-44B6-999B-6C675B7116B1}"
+EndProject
 Global
 	GlobalSection(SolutionConfigurationPlatforms) = preSolution
 		Debug|Any CPU = Debug|Any CPU
@@ -52,6 +51,18 @@ Global
 		{8405896B-2685-4916-BC93-1FB514C323A9}.Release|x64.Build.0 = Release|x64
 		{8405896B-2685-4916-BC93-1FB514C323A9}.Release|x86.ActiveCfg = Release|x86
 		{8405896B-2685-4916-BC93-1FB514C323A9}.Release|x86.Build.0 = Release|x86
+		{D4650F6B-5A54-44B6-999B-6C675B7116B1}.Debug|Any CPU.ActiveCfg = Debug|Any CPU
+		{D4650F6B-5A54-44B6-999B-6C675B7116B1}.Debug|Any CPU.Build.0 = Debug|Any CPU
+		{D4650F6B-5A54-44B6-999B-6C675B7116B1}.Debug|x64.ActiveCfg = Debug|x64
+		{D4650F6B-5A54-44B6-999B-6C675B7116B1}.Debug|x64.Build.0 = Debug|x64
+		{D4650F6B-5A54-44B6-999B-6C675B7116B1}.Debug|x86.ActiveCfg = Debug|x86
+		{D4650F6B-5A54-44B6-999B-6C675B7116B1}.Debug|x86.Build.0 = Debug|x86
+		{D4650F6B-5A54-44B6-999B-6C675B7116B1}.Release|Any CPU.ActiveCfg = Release|Any CPU
+		{D4650F6B-5A54-44B6-999B-6C675B7116B1}.Release|Any CPU.Build.0 = Release|Any CPU
+		{D4650F6B-5A54-44B6-999B-6C675B7116B1}.Release|x64.ActiveCfg = Release|x64
+		{D4650F6B-5A54-44B6-999B-6C675B7116B1}.Release|x64.Build.0 = Release|x64
+		{D4650F6B-5A54-44B6-999B-6C675B7116B1}.Release|x86.ActiveCfg = Release|x86
+		{D4650F6B-5A54-44B6-999B-6C675B7116B1}.Release|x86.Build.0 = Release|x86
 	EndGlobalSection
 	GlobalSection(SolutionProperties) = preSolution
 		HideSolutionNode = FALSE

SCrawler/.editorconfig

@@ -0,0 +1,126 @@
+# To learn more about .editorconfig see https://aka.ms/editorconfigdocs
+###############################
+# Core EditorConfig Options   #
+###############################
+root = true
+# All files
+[*]
+indent_style = space
+# Code files
+[*.{cs,csx,vb,vbx}]
+indent_size = 4
+insert_final_newline = false
+charset = utf-8-bom
+###############################
+# .NET Coding Conventions     #
+###############################
+[*.{cs,vb}]
+# Organize usings
+dotnet_sort_system_directives_first = true
+# this. preferences
+dotnet_style_qualification_for_field = false:silent
+dotnet_style_qualification_for_property = false:silent
+dotnet_style_qualification_for_method = false:silent
+dotnet_style_qualification_for_event = false:silent
+# Language keywords vs BCL types preferences
+dotnet_style_predefined_type_for_locals_parameters_members = true:silent
+dotnet_style_predefined_type_for_member_access = true:silent
+# Parentheses preferences
+dotnet_style_parentheses_in_arithmetic_binary_operators = always_for_clarity:silent
+dotnet_style_parentheses_in_relational_binary_operators = always_for_clarity:silent
+dotnet_style_parentheses_in_other_binary_operators = always_for_clarity:silent
+dotnet_style_parentheses_in_other_operators = never_if_unnecessary:silent
+# Modifier preferences
+dotnet_style_require_accessibility_modifiers = for_non_interface_members:silent
+dotnet_style_readonly_field = true:suggestion
+# Expression-level preferences
+dotnet_style_object_initializer = true:suggestion
+dotnet_style_collection_initializer = true:suggestion
+dotnet_style_explicit_tuple_names = true:suggestion
+dotnet_style_null_propagation = true:suggestion
+dotnet_style_coalesce_expression = true:suggestion
+dotnet_style_prefer_is_null_check_over_reference_equality_method = true:silent
+dotnet_style_prefer_inferred_tuple_names = true:suggestion
+dotnet_style_prefer_inferred_anonymous_type_member_names = true:suggestion
+dotnet_style_prefer_auto_properties = true:silent
+dotnet_style_prefer_conditional_expression_over_assignment = true:silent
+dotnet_style_prefer_conditional_expression_over_return = true:silent
+###############################
+# Naming Conventions          #
+###############################
+# Style Definitions
+dotnet_naming_style.pascal_case_style.capitalization             = pascal_case
+# Use PascalCase for constant fields  
+dotnet_naming_rule.constant_fields_should_be_pascal_case.severity = suggestion
+dotnet_naming_rule.constant_fields_should_be_pascal_case.symbols  = constant_fields
+dotnet_naming_rule.constant_fields_should_be_pascal_case.style    = pascal_case_style
+dotnet_naming_symbols.constant_fields.applicable_kinds            = field
+dotnet_naming_symbols.constant_fields.applicable_accessibilities  = *
+dotnet_naming_symbols.constant_fields.required_modifiers          = const
+###############################
+# C# Coding Conventions       #
+###############################
+[*.cs]
+# var preferences
+csharp_style_var_for_built_in_types = true:silent
+csharp_style_var_when_type_is_apparent = true:silent
+csharp_style_var_elsewhere = true:silent
+# Expression-bodied members
+csharp_style_expression_bodied_methods = false:silent
+csharp_style_expression_bodied_constructors = false:silent
+csharp_style_expression_bodied_operators = false:silent
+csharp_style_expression_bodied_properties = true:silent
+csharp_style_expression_bodied_indexers = true:silent
+csharp_style_expression_bodied_accessors = true:silent
+# Pattern matching preferences
+csharp_style_pattern_matching_over_is_with_cast_check = true:suggestion
+csharp_style_pattern_matching_over_as_with_null_check = true:suggestion
+# Null-checking preferences
+csharp_style_throw_expression = true:suggestion
+csharp_style_conditional_delegate_call = true:suggestion
+# Modifier preferences
+csharp_preferred_modifier_order = public,private,protected,internal,static,extern,new,virtual,abstract,sealed,override,readonly,unsafe,volatile,async:suggestion
+# Expression-level preferences
+csharp_prefer_braces = true:silent
+csharp_style_deconstructed_variable_declaration = true:suggestion
+csharp_prefer_simple_default_expression = true:suggestion
+csharp_style_pattern_local_over_anonymous_function = true:suggestion
+csharp_style_inlined_variable_declaration = true:suggestion
+###############################
+# C# Formatting Rules         #
+###############################
+# New line preferences
+csharp_new_line_before_open_brace = all
+csharp_new_line_before_else = true
+csharp_new_line_before_catch = true
+csharp_new_line_before_finally = false
+csharp_new_line_before_members_in_object_initializers = true
+csharp_new_line_before_members_in_anonymous_types = true
+csharp_new_line_between_query_expression_clauses = true
+# Indentation preferences
+csharp_indent_case_contents = true
+csharp_indent_switch_labels = true
+csharp_indent_labels = flush_left
+# Space preferences
+csharp_space_after_cast = false
+csharp_space_after_keywords_in_control_flow_statements = true
+csharp_space_between_method_call_parameter_list_parentheses = false
+csharp_space_between_method_declaration_parameter_list_parentheses = false
+csharp_space_between_parentheses = false
+csharp_space_before_colon_in_inheritance_clause = true
+csharp_space_after_colon_in_inheritance_clause = true
+csharp_space_around_binary_operators = before_and_after
+csharp_space_between_method_declaration_empty_parameter_list_parentheses = false
+csharp_space_between_method_call_name_and_opening_parenthesis = false
+csharp_space_between_method_call_empty_parameter_list_parentheses = false
+# Wrapping preferences
+csharp_preserve_single_line_statements = true
+csharp_preserve_single_line_blocks = true
+insert_final_newline=false
+###############################
+# VB Coding Conventions       #
+###############################
+[*.vb]
+# Modifier preferences
+visual_basic_preferred_modifier_order = Partial,Default,Private,Protected,Public,Friend,NotOverridable,Overridable,MustOverride,Overloads,Overrides,MustInherit,NotInheritable,Static,Shared,Shadows,ReadOnly,WriteOnly,Dim,Const,WithEvents,Widening,Narrowing,Custom,Async:suggestion
+file_header_template = Copyright (C) 2022  Andy\nThis program is free software: you can redistribute it and/or modify\nit under the terms of the GNU General Public License as published by\nthe Free Software Foundation, either version 3 of the License, or\n(at your option) any later version.\n\nThis program is distributed in the hope that it will be useful,\nbut WITHOUT ANY WARRANTY; without even the implied warranty of\nMERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the\nGNU General Public License for more details.\n\nYou should have received a copy of the GNU General Public License\nalong with this program.  If not, see <https://www.gnu.org/licenses/>

SCrawler/API/Base/Declarations.vb

@@ -0,0 +1,13 @@
+' Copyright (C) 2022  Andy
+' This program is free software: you can redistribute it and/or modify
+' it under the terms of the GNU General Public License as published by
+' the Free Software Foundation, either version 3 of the License, or
+' (at your option) any later version.
+'
+' This program is distributed in the hope that it will be useful,
+' but WITHOUT ANY WARRANTY
+Namespace API.Base
+    Friend Module Declarations
+        Friend ReadOnly LNC As New ListAddParams(LAP.NotContainsOnly)
+    End Module
+End Namespace

SCrawler/API/Base/DownDetector.vb

@@ -0,0 +1,60 @@
+' Copyright (C) 2022  Andy
+' This program is free software: you can redistribute it and/or modify
+' it under the terms of the GNU General Public License as published by
+' the Free Software Foundation, either version 3 of the License, or
+' (at your option) any later version.
+'
+' This program is distributed in the hope that it will be useful,
+' but WITHOUT ANY WARRANTY
+Imports System.Net
+Imports PersonalUtilities.Functions.RegularExpressions
+Namespace API.Base
+    Friend NotInheritable Class DownDetector
+        Private Shared ReadOnly Property Params As New RParams("x:.'([\S]+?)',.y:.(\d+)", -1, Nothing, RegexReturn.List)
+        Private Sub New()
+        End Sub
+        Friend Structure Data : Implements IRegExCreator, IComparable(Of Data)
+            Friend [Date] As Date
+            Friend Value As Integer
+            Friend Function CreateFromArray(ByVal ParamsArray() As String) As Object Implements IRegExCreator.CreateFromArray
+                If ParamsArray.ListExists Then
+                    Try : [Date] = Date.Parse(ParamsArray(0)) : Catch : End Try
+                    If ParamsArray.Length > 1 Then Value = AConvert(Of Integer)(ParamsArray(1), 0)
+                End If
+                Return Me
+            End Function
+            Public Overrides Function ToString() As String
+                Return $"{AConvert(Of String)([Date], ADateTime.Formats.BaseDateTime, String.Empty)} [{Value}]"
+            End Function
+            Friend Function CompareTo(ByVal Other As Data) As Integer Implements IComparable(Of Data).CompareTo
+                Return [Date].CompareTo(Other.Date) * -1
+            End Function
+        End Structure
+        Friend Shared Function GetData(ByVal Site As String) As List(Of Data)
+            Try
+                Dim l As List(Of Data) = Nothing
+                Using w As New WebClient
+                    Dim r$ = w.DownloadString($"https://downdetector.co.uk/status/{Site}/")
+                    If Not r.IsEmptyString Then
+                        l = FNF.RegexFields(Of Data)(r, {Params}, {1, 2})
+                        If l.ListExists(2) Then
+                            Dim lDate As Date = l(0).Date
+                            Dim i%
+                            Dim indx% = -1
+                            For i = 1 To l.Count - 1
+                                If l(i).Date < lDate Then indx = i : Exit For Else lDate = l(i).Date
+                            Next
+                            If indx >= 0 Then
+                                For i = indx To 0 Step -1 : l.RemoveAt(i) : Next
+                            End If
+                            l.Sort()
+                        End If
+                    End If
+                End Using
+                Return l
+            Catch ex As Exception
+                Return ErrorsDescriber.Execute(EDP.SendInLog + EDP.ReturnValue, ex, $"[DownDetector.GetData({Site})]")
+            End Try
+        End Function
+    End Class
+End Namespace

SCrawler/API/Base/ProfileSaved.vb

@@ -0,0 +1,61 @@
+' Copyright (C) 2022  Andy
+' This program is free software: you can redistribute it and/or modify
+' it under the terms of the GNU General Public License as published by
+' the Free Software Foundation, either version 3 of the License, or
+' (at your option) any later version.
+'
+' This program is distributed in the hope that it will be useful,
+' but WITHOUT ANY WARRANTY
+Imports SCrawler.Plugin.Hosts
+Imports System.Threading
+Imports PersonalUtilities.Forms.Toolbars
+Imports PDownload = SCrawler.Plugin.ISiteSettings.Download
+Namespace API.Base
+    Friend NotInheritable Class ProfileSaved
+        Private ReadOnly Property HOST As SettingsHost
+        Private ReadOnly Property Progress As MyProgress
+        Friend Sub New(ByRef h As SettingsHost, ByRef Bar As MyProgress)
+            HOST = h
+            Progress = Bar
+        End Sub
+        Friend Sub Download(ByVal Token As CancellationToken)
+            Try
+                If HOST.Source.ReadyToDownload(PDownload.SavedPosts) Then
+                    If HOST.Available(PDownload.SavedPosts) Then
+                        HOST.DownloadStarted(PDownload.SavedPosts)
+                        Dim u As New UserInfo With {.Plugin = HOST.Key, .Site = HOST.Name, .SpecialPath = HOST.SavedPostsPath}
+                        Using user As IUserData = HOST.GetInstance(PDownload.SavedPosts, Nothing, False, False)
+                            If Not user Is Nothing AndAlso (Not user.Name.IsEmptyString Or Not HOST.IsMyClass) Then
+                                u.Name = user.Name
+                                With DirectCast(user, UserDataBase).User
+                                    u.IsChannel = .IsChannel
+                                    u.UpdateUserFile()
+                                End With
+                                With DirectCast(user, UserDataBase)
+                                    .User = u
+                                    .LoadUserInformation()
+                                    .IsSavedPosts = True
+                                    .Progress = Progress
+                                    If Not .FileExists Then .UpdateUserInformation()
+                                End With
+                                HOST.BeforeStartDownload(user, PDownload.SavedPosts)
+                                user.DownloadData(Token)
+                                Progress.InformationTemporary = $"Images: {user.DownloadedPictures(False)}; Videos: {user.DownloadedVideos(False)}"
+                                HOST.AfterDownload(user, PDownload.SavedPosts)
+                            End If
+                        End Using
+                    Else
+                        Progress.InformationTemporary = $"Host [{HOST.Name}] is unavailable"
+                    End If
+                Else
+                    Progress.InformationTemporary = $"Host [{HOST.Name}] is nor ready"
+                End If
+            Catch ex As Exception
+                Progress.InformationTemporary = $"{HOST.Name} downloading error"
+                ErrorsDescriber.Execute(EDP.SendInLog, ex, $"[API.Base.ProfileSaved.Download({HOST.Key})]")
+            Finally
+                HOST.DownloadDone(PDownload.SavedPosts)
+            End Try
+        End Sub
+    End Class
+End Namespace

SCrawler/API/Base/SiteSettings.vb

@@ -1,78 +0,0 @@
-Imports PersonalUtilities.Tools
-Imports PersonalUtilities.Functions.XML
-Imports PersonalUtilities.Functions.XML.Base
-Namespace API.Base
-    Friend Class SiteSettings : Implements IDisposable
-        Friend Const Header_Twitter_Authorization As String = "authorization"
-        Friend Const Header_Twitter_Token As String = "x-csrf-token"
-        Friend ReadOnly Site As Sites
-        Friend ReadOnly Responser As WEB.Response
-        Private ReadOnly _Path As XMLValue(Of SFile)
-        Friend Property Path As SFile
-            Get
-                If _Path.IsEmptyString Then _Path.Value = SFile.GetPath($"{Settings.GlobalPath.Value.PathWithSeparator}{Site}")
-                Return _Path.Value
-            End Get
-            Set(ByVal NewFile As SFile)
-                _Path.Value = NewFile
-            End Set
-        End Property
-        Private ReadOnly SettingsFile As SFile
-        Friend Sub New(ByVal s As Sites, ByRef _XML As XmlFile, ByVal GlobalPath As SFile)
-            Site = s
-            SettingsFile = $"{SettingsFolderName}\Responser_{s}.xml"
-            Responser = New WEB.Response(SettingsFile)
-
-            If SettingsFile.Exists Then
-                Responser.LoadSettings()
-            Else
-                If Site = Sites.Twitter Then
-                    With Responser
-                        .ContentType = "application/json"
-                        .Accept = "*/*"
-                        .CookiesDomain = "twitter.com"
-                        .Decoders.Add(SymbolsConverter.Converters.Unicode)
-                        With .Headers
-                            .Add("sec-ch-ua", " Not;A Brand" & Chr(34) & ";v=" & Chr(34) & "99" & Chr(34) & ", " & Chr(34) &
-                                 "Google Chrome" & Chr(34) & ";v=" & Chr(34) & "91" & Chr(34) & ", " & Chr(34) & "Chromium" &
-                                 Chr(34) & ";v=" & Chr(34) & "91" & Chr(34))
-                            .Add("sec-ch-ua-mobile", "?0")
-                            .Add("sec-fetch-dest", "empty")
-                            .Add("sec-fetch-mode", "cors")
-                            .Add("sec-fetch-site", "same-origin")
-                            .Add(Header_Twitter_Token, String.Empty)
-                            .Add("x-twitter-active-user", "yes")
-                            .Add("x-twitter-auth-type", "OAuth2Session")
-                            .Add(Header_Twitter_Authorization, String.Empty)
-                        End With
-                    End With
-                ElseIf Site = Sites.Reddit Then
-                    Responser.CookiesDomain = "reddit.com"
-                    Responser.Decoders.Add(SymbolsConverter.Converters.Unicode)
-                End If
-                Responser.SaveSettings()
-            End If
-            _Path = New XMLValue(Of SFile)("Path", SFile.GetPath($"{GlobalPath.PathWithSeparator}{Site}"), _XML, {Site.ToString}, XMLValue(Of SFile).ToFilePath)
-        End Sub
-        Friend Sub Update()
-            Responser.SaveSettings()
-        End Sub
-#Region "IDisposable Support"
-        Private disposedValue As Boolean = False
-        Protected Overridable Overloads Sub Dispose(ByVal disposing As Boolean)
-            If Not disposedValue Then
-                If disposing Then Responser.Dispose()
-                disposedValue = True
-            End If
-        End Sub
-        Protected Overrides Sub Finalize()
-            Dispose(False)
-            MyBase.Finalize()
-        End Sub
-        Friend Overloads Sub Dispose() Implements IDisposable.Dispose
-            Dispose(True)
-            GC.SuppressFinalize(Me)
-        End Sub
-#End Region
-    End Class
-End Namespace

SCrawler/API/Base/SiteSettingsBase.vb

@@ -0,0 +1,106 @@
+' Copyright (C) 2022  Andy
+' This program is free software: you can redistribute it and/or modify
+' it under the terms of the GNU General Public License as published by
+' the Free Software Foundation, either version 3 of the License, or
+' (at your option) any later version.
+'
+' This program is distributed in the hope that it will be useful,
+' but WITHOUT ANY WARRANTY
+Imports SCrawler.Plugin
+Imports PersonalUtilities.Functions.RegularExpressions
+Imports PersonalUtilities.Tools.WEB
+Imports Download = SCrawler.Plugin.ISiteSettings.Download
+Namespace API.Base
+    Friend MustInherit Class SiteSettingsBase : Implements ISiteSettings, IResponserContainer
+        Friend ReadOnly Property Site As String Implements ISiteSettings.Site
+        Friend Overridable ReadOnly Property Icon As Icon = Nothing Implements ISiteSettings.Icon
+        Friend Overridable ReadOnly Property Image As Image = Nothing Implements ISiteSettings.Image
+        Friend Overridable ReadOnly Property Responser As Response Implements IResponserContainer.Responser
+        Friend MustOverride Function GetInstance(ByVal What As Download) As IPluginContentProvider Implements ISiteSettings.GetInstance
+        Friend Sub New(ByVal SiteName As String)
+            Site = SiteName
+        End Sub
+        Friend Sub New(ByVal SiteName As String, ByVal CookiesDomain As String)
+            Site = SiteName
+            Responser = New Response($"{SettingsFolderName}\Responser_{Site}.xml")
+            With Responser
+                If .File.Exists Then .LoadSettings() Else .CookiesDomain = CookiesDomain : .SaveSettings()
+            End With
+        End Sub
+#Region "XML"
+        Friend Overridable Sub Load(ByVal XMLValues As IEnumerable(Of KeyValuePair(Of String, String))) Implements ISiteSettings.Load
+        End Sub
+#End Region
+#Region "Initialize"
+        Friend Overridable Sub BeginInit() Implements ISiteSettings.BeginInit
+        End Sub
+        Friend Overridable Sub EndInit() Implements ISiteSettings.EndInit
+        End Sub
+        Friend Overridable Sub BeginUpdate() Implements ISiteSettings.BeginUpdate
+        End Sub
+        Friend Overridable Sub EndUpdate() Implements ISiteSettings.EndUpdate
+        End Sub
+#End Region
+#Region "Before and After Download"
+        Friend Overridable Sub DownloadStarted(ByVal What As Download) Implements ISiteSettings.DownloadStarted
+        End Sub
+        Friend Overridable Sub BeforeStartDownload(ByVal User As Object, ByVal What As Download) Implements ISiteSettings.BeforeStartDownload
+        End Sub
+        Friend Overridable Sub AfterDownload(ByVal User As Object, ByVal What As Download) Implements ISiteSettings.AfterDownload
+        End Sub
+        Friend Overridable Sub DownloadDone(ByVal What As Download) Implements ISiteSettings.DownloadDone
+        End Sub
+#End Region
+#Region "User info"
+        Protected UrlPatternUser As String = String.Empty
+        Protected UrlPatternChannel As String = String.Empty
+        Friend Overridable Function GetUserUrl(ByVal UserName As String, ByVal Channel As Boolean) As String Implements ISiteSettings.GetUserUrl
+            If Channel Then
+                If Not UrlPatternChannel.IsEmptyString Then Return String.Format(UrlPatternChannel, UserName)
+            Else
+                If Not UrlPatternUser.IsEmptyString Then Return String.Format(UrlPatternUser, UserName)
+            End If
+            Return String.Empty
+        End Function
+        Protected UserRegex As RParams = Nothing
+        Friend Overridable Function IsMyUser(ByVal UserURL As String) As ExchangeOptions Implements ISiteSettings.IsMyUser
+            Try
+                If Not UserRegex Is Nothing Then
+                    Dim s$ = RegexReplace(UserURL, UserRegex)
+                    If Not s.IsEmptyString Then Return New ExchangeOptions(Site, s)
+                End If
+                Return Nothing
+            Catch ex As Exception
+                Return ErrorsDescriber.Execute(EDP.SendInLog + EDP.ReturnValue, ex, "[API.Base.SiteSettingsBase.IsMyUser]")
+            End Try
+        End Function
+        Protected ImageVideoContains As String = String.Empty
+        Friend Overridable Function IsMyImageVideo(ByVal URL As String) As ExchangeOptions Implements ISiteSettings.IsMyImageVideo
+            If Not ImageVideoContains.IsEmptyString AndAlso URL.Contains(ImageVideoContains) Then
+                Return New ExchangeOptions With {.Exists = True}
+            Else
+                Return Nothing
+            End If
+        End Function
+        Friend Overridable Function GetSpecialData(ByVal URL As String) As IEnumerable(Of IPluginUserMedia) Implements ISiteSettings.GetSpecialData
+            Return Nothing
+        End Function
+        Friend Overridable Function GetSpecialDataF(ByVal URL As String) As IEnumerable(Of UserMedia)
+            Return Nothing
+        End Function
+#End Region
+#Region "Ready, Available"
+        Friend Overridable Function Available(ByVal What As Download) As Boolean Implements ISiteSettings.Available
+            Return True
+        End Function
+        Friend Overridable Function ReadyToDownload(ByVal What As Download) As Boolean Implements ISiteSettings.ReadyToDownload
+            Return True
+        End Function
+#End Region
+        Friend Overridable Sub UserOptions(ByRef Options As Object, ByVal OpenForm As Boolean) Implements ISiteSettings.UserOptions
+            Options = Nothing
+        End Sub
+        Friend Overridable Sub OpenSettingsForm() Implements ISiteSettings.OpenSettingsForm
+        End Sub
+    End Class
+End Namespace

SCrawler/API/Base/Structures.vb

@@ -1,4 +1,12 @@
-Namespace API.Base
+' Copyright (C) 2022  Andy
+' This program is free software: you can redistribute it and/or modify
+' it under the terms of the GNU General Public License as published by
+' the Free Software Foundation, either version 3 of the License, or
+' (at your option) any later version.
+'
+' This program is distributed in the hope that it will be useful,
+' but WITHOUT ANY WARRANTY
+Namespace API.Base
     Friend Module Structures
         Friend Structure UserMedia : Implements IEquatable(Of UserMedia)
             Friend Enum Types As Integer
@@ -10,8 +18,8 @@
                 GIF = 50
                 m3u8 = 100
             End Enum
-            Friend Enum States : Unknown : Tried : Downloaded : Skipped : End Enum
+            Friend Enum States As Integer : Unknown = 0 : Tried = 1 : Downloaded = 2 : Skipped = 3 : End Enum
-            Friend Type As Types
+            Friend [Type] As Types
             Friend URL_BASE As String
             Friend URL As String
             Friend MD5 As String
@@ -19,6 +27,11 @@
             Friend Post As UserPost
             Friend PictureOption As String
             Friend State As States
+            ''' <summary>
+            ''' SomeFolder<br/>
+            ''' SomeFolder\SomeFolder2
+            ''' </summary>
+            Friend SpecialFolder As String
             Friend Sub New(ByVal _URL As String)
                 URL = _URL
                 URL_BASE = _URL
@@ -27,7 +40,18 @@
             End Sub
             Friend Sub New(ByVal _URL As String, ByVal _Type As Types)
                 Me.New(_URL)
-                Type = _Type
+                [Type] = _Type
+            End Sub
+            Friend Sub New(ByVal m As Plugin.IPluginUserMedia)
+                If Not IsNothing(m) Then
+                    [Type] = m.ContentType
+                    URL = m.URL
+                    MD5 = m.MD5
+                    File = m.File
+                    Post = New UserPost With {.ID = m.PostID, .[Date] = m.PostDate}
+                    State = m.DownloadState
+                    SpecialFolder = m.SpecialFolder
+                End If
             End Sub
             Public Shared Widening Operator CType(ByVal _URL As String) As UserMedia
                 Return New UserMedia(_URL)
@@ -38,6 +62,18 @@
             Public Overrides Function ToString() As String
                 Return URL
             End Function
+            Friend Function PluginUserMedia() As Plugin.PluginUserMedia
+                Return New Plugin.PluginUserMedia With {
+                    .ContentType = Type,
+                    .DownloadState = State,
+                    .File = File,
+                    .MD5 = MD5,
+                    .URL = URL,
+                    .SpecialFolder = SpecialFolder,
+                    .PostID = Post.ID,
+                    .PostDate = Post.Date
+                }
+            End Function
             Friend Overloads Function Equals(ByVal Other As UserMedia) As Boolean Implements IEquatable(Of UserMedia).Equals
                 Return URL = Other.URL
             End Function
@@ -77,5 +113,21 @@
                 Return v
             End Function
         End Structure
+        Friend Structure Sizes : Implements IComparable(Of Sizes)
+            Friend Value As Integer
+            Friend Data As String
+            Friend ReadOnly HasError As Boolean
+            Friend Sub New(ByVal _Value As String, ByVal _Data As String)
+                Try
+                    Value = _Value
+                    Data = _Data
+                Catch ex As Exception
+                    HasError = True
+                End Try
+            End Sub
+            Friend Function CompareTo(ByVal Other As Sizes) As Integer Implements IComparable(Of Sizes).CompareTo
+                Return Value.CompareTo(Other.Value) * -1
+            End Function
+        End Structure
     End Module
 End Namespace

SCrawler/API/Base/UserDataBase.vb

@@ -1,40 +1,99 @@
-Imports PersonalUtilities.Functions.XML
+' Copyright (C) 2022  Andy
+' This program is free software: you can redistribute it and/or modify
+' it under the terms of the GNU General Public License as published by
+' the Free Software Foundation, either version 3 of the License, or
+' (at your option) any later version.
+'
+' This program is distributed in the hope that it will be useful,
+' but WITHOUT ANY WARRANTY
+Imports PersonalUtilities.Functions.XML
+Imports PersonalUtilities.Functions.RegularExpressions
+Imports PersonalUtilities.Forms.Toolbars
 Imports System.IO
+Imports System.Net
 Imports System.Threading
-Imports UState = SCrawler.API.Base.UserMedia.States
+Imports SCrawler.Plugin
+Imports SCrawler.Plugin.Hosts
+Imports UStates = SCrawler.API.Base.UserMedia.States
+Imports UTypes = SCrawler.API.Base.UserMedia.Types
 Namespace API.Base
-    Friend MustInherit Class UserDataBase : Implements IUserData
+    Friend MustInherit Class UserDataBase : Implements IUserData, IPluginContentProvider, IThrower
         Friend Const UserFileAppender As String = "User"
-        Friend Event OnPictureUpdated As IUserData.OnPictureUpdatedEventHandler Implements IUserData.OnPictureUpdated
+        Private ReadOnly _OnUserUpdatedHandlers As List(Of IUserData.OnUserUpdatedEventHandler)
-        Protected Sub Raise_OnPictureUpdated()
+        Friend Custom Event OnUserUpdated As IUserData.OnUserUpdatedEventHandler Implements IUserData.OnUserUpdated
-            RaiseEvent OnPictureUpdated(Me)
+            AddHandler(ByVal e As IUserData.OnUserUpdatedEventHandler)
+                If Not _OnUserUpdatedHandlers.Contains(e) Then _OnUserUpdatedHandlers.Add(e)
+            End AddHandler
+            RemoveHandler(ByVal e As IUserData.OnUserUpdatedEventHandler)
+                If _OnUserUpdatedHandlers.Contains(e) Then _OnUserUpdatedHandlers.Remove(e)
+            End RemoveHandler
+            RaiseEvent(ByVal User As IUserData)
+                If _OnUserUpdatedHandlers.Count > 0 Then
+                    For Each e As IUserData.OnUserUpdatedEventHandler In _OnUserUpdatedHandlers
+                        Try : e.Invoke(User) : Catch : End Try
+                    Next
+                End If
+            End RaiseEvent
+        End Event
+        Protected Sub RaiseEvent_OnUserUpdated()
+            RaiseEvent OnUserUpdated(Me)
+        End Sub
+        Friend Sub RemoveUpdateHandlers()
+            _OnUserUpdatedHandlers.Clear()
         End Sub
 #Region "Collection buttons"
+        Private _CollectionButtonsExists As Boolean = False
+        Private _CollectionButtonsColorsSet As Boolean = False
+        Friend InternalCollectionIndex As Integer = -1
         Friend WithEvents BTT_CONTEXT_DOWN As ToolStripMenuItem
         Friend WithEvents BTT_CONTEXT_EDIT As ToolStripMenuItem
         Friend WithEvents BTT_CONTEXT_DELETE As ToolStripMenuItem
         Friend WithEvents BTT_CONTEXT_OPEN_PATH As ToolStripMenuItem
         Friend WithEvents BTT_CONTEXT_OPEN_SITE As ToolStripMenuItem
         Friend Sub CreateButtons(ByVal CollectionIndex As Integer)
+            InternalCollectionIndex = CollectionIndex
             Dim tn$ = $"[{Site}] - {Name}"
             Dim _tn$ = $"{Site}{Name}"
             Dim tnn As Func(Of String, String) = Function(Input) $"{Input}{_tn}"
             Dim i As Image = Nothing
-            Select Case Site
+            With HOST.Source
-                Case Sites.Reddit : i = My.Resources.RedditIcon.ToBitmap
+                If Not .Icon Is Nothing Then
-                Case Sites.Twitter : i = My.Resources.TwitterIcon.ToBitmap
+                    i = .Icon.ToBitmap
-            End Select
+                ElseIf Not .Image Is Nothing Then
+                    i = .Image
+                End If
+            End With
             BTT_CONTEXT_DOWN = New ToolStripMenuItem(tn, i) With {.Name = tnn("DOWN"), .Tag = CollectionIndex}
             BTT_CONTEXT_EDIT = New ToolStripMenuItem(tn, i) With {.Name = tnn("EDIT"), .Tag = CollectionIndex}
             BTT_CONTEXT_DELETE = New ToolStripMenuItem(tn, i) With {.Name = tnn("DELETE"), .Tag = CollectionIndex}
             BTT_CONTEXT_OPEN_PATH = New ToolStripMenuItem(tn, i) With {.Name = tnn("PATH"), .Tag = CollectionIndex}
             BTT_CONTEXT_OPEN_SITE = New ToolStripMenuItem(tn, i) With {.Name = tnn("SITE"), .Tag = CollectionIndex}
+            UpdateButtonsColor()
+            _CollectionButtonsExists = True
+            If _UserInformationLoaded Then _CollectionButtonsColorsSet = True
+        End Sub
+        Private Sub UpdateButtonsColor()
+            Dim cb As Color = SystemColors.Control
+            Dim cf As Color = SystemColors.ControlText
+            If Not UserExists Then
+                cb = ColorBttDeleteBack
+                cf = ColorBttDeleteFore
+            ElseIf UserSuspended Then
+                cb = ColorBttEditBack
+                cf = ColorBttEditFore
+            End If
+            For Each b As ToolStripMenuItem In {BTT_CONTEXT_DOWN, BTT_CONTEXT_EDIT, BTT_CONTEXT_DELETE, BTT_CONTEXT_OPEN_PATH, BTT_CONTEXT_OPEN_SITE}
+                If Not b Is Nothing Then b.BackColor = cb : b.ForeColor = cf
+            Next
+            If _UserInformationLoaded Then _CollectionButtonsColorsSet = True
         End Sub
 #End Region
 #Region "XML Declarations"
         Private Const Name_Site As String = "Site"
         Private Const Name_IsChannel As String = "IsChannel"
         Private Const Name_UserName As String = "UserName"
+        Private Const Name_UserExists As String = "UserExists"
+        Private Const Name_UserSuspended As String = "UserSuspended"
         Private Const Name_FriendlyName As String = "FriendlyName"
         Private Const Name_UserID As String = "UserID"
         Private Const Name_Description As String = "Description"
@@ -66,9 +125,17 @@ Namespace API.Base
 #End Region
 #End Region
 #Region "Declarations"
-        Friend MustOverride Property Site As Sites Implements IContentProvider.Site
+        Friend ReadOnly Property Site As String Implements IContentProvider.Site
+            Get
+                Return HOST.Name
+            End Get
+        End Property
+        Friend Property Progress As MyProgress
         Friend User As UserInfo
-        Friend Overridable Property Name As String Implements IContentProvider.Name
+        Friend Property IsSavedPosts As Boolean Implements IPluginContentProvider.IsSavedPosts
+        Friend Overridable Property UserExists As Boolean = True Implements IUserData.Exists, IPluginContentProvider.UserExists
+        Friend Overridable Property UserSuspended As Boolean = False Implements IUserData.Suspended, IPluginContentProvider.UserSuspended
+        Friend Overridable Property Name As String Implements IContentProvider.Name, IPluginContentProvider.Name
             Get
                 Return User.Name
             End Get
@@ -78,10 +145,31 @@ Namespace API.Base
                 Settings.UpdateUsersList(User)
             End Set
         End Property
-        Friend Overridable Property ID As String = String.Empty Implements IContentProvider.ID
+        Friend Overridable Property ID As String = String.Empty Implements IContentProvider.ID, IPluginContentProvider.ID
         Friend Overridable Property FriendlyName As String = String.Empty Implements IContentProvider.FriendlyName
-        Friend Property UserDescription As String = String.Empty Implements IContentProvider.Description
+#Region "UserDescription"
-        Friend Property ParseUserMediaOnly As Boolean = False Implements IUserData.ParseUserMediaOnly
+        Friend Property UserDescription As String = String.Empty Implements IContentProvider.Description, IPluginContentProvider.UserDescription
+        Protected _DescriptionEveryTime As Boolean = False
+        Protected _DescriptionChecked As Boolean = False
+        Protected Function UserDescriptionNeedToUpdate() As Boolean
+            Return (UserDescription.IsEmptyString Or _DescriptionEveryTime) And Not _DescriptionChecked
+        End Function
+        Protected Sub UserDescriptionUpdate(ByVal Descr As String)
+            If UserDescriptionNeedToUpdate() Then
+                If UserDescription.IsEmptyString Then
+                    UserDescription = Descr
+                ElseIf Not UserDescription.Contains(Descr) Then
+                    UserDescription &= $"{vbNewLine}----{vbNewLine}{Descr}"
+                End If
+                _DescriptionChecked = True
+            End If
+        End Sub
+        Protected Sub UserDescriptionReset()
+            _DescriptionChecked = False
+            _DescriptionEveryTime = Settings.UpdateUserDescriptionEveryTime
+        End Sub
+#End Region
+        Friend Property ParseUserMediaOnly As Boolean = False Implements IUserData.ParseUserMediaOnly, IPluginContentProvider.ParseUserMediaOnly
         Protected _Favorite As Boolean = False
         Friend Overridable Property Favorite As Boolean Implements IContentProvider.Favorite
             Get
@@ -152,7 +240,7 @@ BlockPictureFolder:
                         p = New UserImage(PicList.First, l, s, MyFile)
                         GoTo BlockReturn
                     Else
-                        f.Delete(SFO.Path, False, False, EDP.None)
+                        f.Delete(SFO.Path, Settings.DeleteMode, EDP.None)
                         DelPath = False
                     End If
                 End If
@@ -172,7 +260,7 @@ BlockDeletePictureFolder:
             On Error GoTo BlockReturn
             If DelPath Then
                 f = SFile.GetPath($"{MyFile.PathWithSeparator}Pictures")
-                If f.Exists(SFO.Path, False) Then f.Delete(SFO.Path, False, False)
+                If f.Exists(SFO.Path, False) Then f.Delete(SFO.Path, Settings.DeleteMode)
             End If
 BlockReturn:
             On Error GoTo BlockNullPicture
@@ -272,89 +360,128 @@ BlockNullPicture:
         End Property
 #End Region
 #Region "Information"
-        Protected _CountVideo As Integer = 0
-        Protected _CountPictures As Integer = 0
         Friend Overridable Property LastUpdated As Date?
-        Friend ReadOnly Property TotalContentCount As Integer
-            Get
-                Return _CountVideo + _CountPictures
-            End Get
-        End Property
         Friend Overridable Property HasError As Boolean = False Implements IUserData.HasError
         Private _DownloadedPicturesTotal As Integer = 0
         Private _DownloadedPicturesSession As Integer = 0
-        Friend Property DownloadedPictures As Integer Implements IUserData.DownloadedPictures
+        Friend Property DownloadedPictures(ByVal Total As Boolean) As Integer Implements IUserData.DownloadedPictures
             Get
-                Return _DownloadedPicturesSession
+                Return IIf(Total, _DownloadedPicturesTotal, _DownloadedPicturesSession)
             End Get
             Set(ByVal NewValue As Integer)
-                _DownloadedPicturesSession = NewValue
+                If Total Then
+                    _DownloadedPicturesTotal = NewValue
+                Else
+                    _DownloadedPicturesSession = NewValue
+                End If
             End Set
         End Property
         Private _DownloadedVideosTotal As Integer = 0
         Private _DownloadedVideosSession As Integer = 0
-        Friend Property DownloadedVideos As Integer Implements IUserData.DownloadedVideos
+        Friend Property DownloadedVideos(ByVal Total As Boolean) As Integer Implements IUserData.DownloadedVideos
             Get
-                Return _DownloadedVideosSession
+                Return IIf(Total, _DownloadedVideosTotal, _DownloadedVideosSession)
             End Get
             Set(ByVal NewValue As Integer)
-                _DownloadedVideosSession = NewValue
+                If Total Then
+                    _DownloadedVideosTotal = NewValue
+                Else
+                    _DownloadedVideosSession = NewValue
+                End If
             End Set
         End Property
         Friend Overridable ReadOnly Property DownloadedTotal(Optional ByVal Total As Boolean = True) As Integer Implements IUserData.DownloadedTotal
             Get
-                If Total Then
+                Return DownloadedPictures(Total) + DownloadedVideos(Total)
-                    Return _DownloadedPicturesTotal + _DownloadedVideosTotal
-                Else
-                    Return _DownloadedPicturesSession + _DownloadedVideosSession
-                End If
             End Get
         End Property
         Friend ReadOnly Property DownloadedInformation As String Implements IUserData.DownloadedInformation
             Get
                 Dim luv$ = String.Empty
                 If LastUpdated.HasValue Then luv = $"{LastUpdated.Value.ToStringDate(ADateTime.Formats.BaseDateTime)}: "
-                Return $"{luv}{Name} [{Site}]{IIf(HasError, " (with errors)", String.Empty)}: P - {_DownloadedPicturesTotal}; V - {_DownloadedVideosTotal}" &
+                Return $"{luv}{Name} [{Site}]{IIf(HasError, " (with errors)", String.Empty)}: P - {DownloadedPictures(False)}; V - {DownloadedVideos(False)}" &
-                    $" (P - {_CountPictures}; V - {_CountVideo})"
+                       $" (P - {DownloadedPictures(True)}; V - {DownloadedVideos(True)})"
             End Get
         End Property
 #End Region
-        Protected ReadOnly LNC As New ListAddParams(LAP.NotContainsOnly)
+#End Region
+#Region "Plugins Support"
+        Protected Event ProgressChanged As IPluginContentProvider.ProgressChangedEventHandler Implements IPluginContentProvider.ProgressChanged
+        Protected Event TotalCountChanged As IPluginContentProvider.TotalCountChangedEventHandler Implements IPluginContentProvider.TotalCountChanged
+        Friend Property HOST As SettingsHost Implements IUserData.HOST
+        Private Property IPluginContentProvider_Settings As ISiteSettings Implements IPluginContentProvider.Settings
+            Get
+                Return HOST.Source
+            End Get
+            Set(ByVal s As ISiteSettings)
+            End Set
+        End Property
+        Private Property IPluginContentProvider_Thrower As IThrower Implements IPluginContentProvider.Thrower
+        Private Property IPluginContentProvider_LogProvider As ILogProvider Implements IPluginContentProvider.LogProvider
+        Friend Property ExternalPlugin As IPluginContentProvider
+        Private Property IPluginContentProvider_ExistingContentList As List(Of PluginUserMedia) Implements IPluginContentProvider.ExistingContentList
+        Private Property IPluginContentProvider_TempPostsList As List(Of String) Implements IPluginContentProvider.TempPostsList
+        Private Property IPluginContentProvider_TempMediaList As List(Of IPluginUserMedia) Implements IPluginContentProvider.TempMediaList
+        Private Property IPluginContentProvider_SeparateVideoFolder As Boolean Implements IPluginContentProvider.SeparateVideoFolder
+        Private Property IPluginContentProvider_DataPath As String Implements IPluginContentProvider.DataPath
+        Private Sub IPluginContentProvider_XmlFieldsSet(ByVal Fields As List(Of KeyValuePair(Of String, String))) Implements IPluginContentProvider.XmlFieldsSet
+        End Sub
+        Private Function IPluginContentProvider_XmlFieldsGet() As List(Of KeyValuePair(Of String, String)) Implements IPluginContentProvider.XmlFieldsGet
+            Return Nothing
+        End Function
+        Private Sub IPluginContentProvider_GetMedia() Implements IPluginContentProvider.GetMedia
+        End Sub
+        Private Sub IPluginContentProvider_Download() Implements IPluginContentProvider.Download
+        End Sub
+        Friend Overridable Function ExchangeOptionsGet() As Object Implements IPluginContentProvider.ExchangeOptionsGet
+            Return Nothing
+        End Function
+        Friend Overridable Sub ExchangeOptionsSet(ByVal Obj As Object) Implements IPluginContentProvider.ExchangeOptionsSet
+        End Sub
+        Private _ExternalCompatibilityToken As CancellationToken
+#End Region
+#Region "IIndexable Support"
+        Friend Property Index As Integer = 0 Implements IIndexable.Index
+        Private Function SetIndex(ByVal Obj As Object, ByVal _Index As Integer) As Object Implements IIndexable.SetIndex
+            DirectCast(Obj, UserDataBase).Index = _Index
+            Return Obj
+        End Function
 #End Region
 #Region "LVI"
-        Friend ReadOnly Property LVIKey As String Implements IUserData.LVIKey
+        Friend ReadOnly Property LVIKey As String Implements IUserData.Key
             Get
                 If Not _IsCollection Then
-                    Return $"{IIf(Site = Sites.Reddit, "R", "T")}_{Name}"
+                    Return $"{IIf(IsChannel, "C", String.Empty)}{Site.ToString.ToUpper}_{Name}"
                 Else
                     Return $"CCCC_{CollectionName}"
                 End If
             End Get
         End Property
-        Private _LVIIndex As Integer = -1
-        Private ReadOnly Property LVIIndex As Integer Implements IUserData.LVIIndex
-            Get
-                Return _LVIIndex
-            End Get
-        End Property
         Friend Function GetLVI(ByVal Destination As ListView) As ListViewItem Implements IUserData.GetLVI
-            _LVIIndex = Destination.Items.Count
             If Settings.ViewModeIsPicture Then
-                Return New ListViewItem(ToString(), LVIKey, GetLVIGroup(Destination)) With {.Name = LVIKey, .Tag = LVIKey}
+                Return ListImagesLoader.ApplyLVIColor(Me, New ListViewItem(ToString(), LVIKey, GetLVIGroup(Destination)) With {.Name = LVIKey, .Tag = LVIKey}, True)
             Else
-                Return New ListViewItem(ToString(), GetLVIGroup(Destination)) With {.Name = LVIKey, .Tag = LVIKey}
+                Return ListImagesLoader.ApplyLVIColor(Me, New ListViewItem(ToString(), GetLVIGroup(Destination)) With {.Name = LVIKey, .Tag = LVIKey}, True)
             End If
         End Function
         Friend Overridable ReadOnly Property FitToAddParams As Boolean Implements IUserData.FitToAddParams
             Get
-                Select Case Settings.ShowingMode.Value
+                If Settings.LastUpdatedDate.HasValue AndAlso LastUpdated.HasValue AndAlso
-                    Case ShowingModes.Regular : Return Not Temporary And Not Favorite
+                   LastUpdated.Value.Date > Settings.LastUpdatedDate.Value.Date Then Return False
-                    Case ShowingModes.Temporary : Return Temporary
+                If Settings.SelectedSites.Count = 0 OrElse Settings.SelectedSites.Contains(Site) Then
-                    Case ShowingModes.Favorite : Return Favorite
+                    Select Case Settings.ShowingMode.Value
-                    Case ShowingModes.Labels : Return Settings.Labels.CurrentSelection.ListContains(Labels)
+                        Case ShowingModes.Regular : Return Not Temporary And Not Favorite
-                    Case ShowingModes.NoLabels : Return Labels.Count = 0
+                        Case ShowingModes.Temporary : Return Temporary
-                    Case Else : Return True
+                        Case ShowingModes.Favorite : Return Favorite
-                End Select
+                        Case ShowingModes.Deleted : Return Not UserExists
+                        Case ShowingModes.Suspended : Return UserSuspended
+                        Case ShowingModes.Labels : Return Settings.Labels.CurrentSelection.ListContains(Labels)
+                        Case ShowingModes.NoLabels : Return Labels.Count = 0
+                        Case Else : Return True
+                    End Select
+                Else
+                    Return False
+                End If
             End Get
         End Property
         Friend Function GetLVIGroup(ByVal Destination As ListView) As ListViewGroup Implements IUserData.GetLVIGroup
@@ -364,12 +491,10 @@ BlockNullPicture:
                         For i% = 0 To Labels.Count - 1
                             If Settings.Labels.CurrentSelection.Contains(Labels(i)) Then Return Destination.Groups.Item(Labels(i))
                         Next
-                        Return Destination.Groups.Item(LabelsKeeper.NoLabeledName)
-                    Else
-                        Return Destination.Groups.Item(LabelsKeeper.NoLabeledName)
                     End If
+                    Return Destination.Groups.Item(LabelsKeeper.NoLabeledName)
                 Else
-                    Return Destination.Groups.Item(GetLviGroupName(Site, Temporary, Favorite, IsCollection))
+                    Return Destination.Groups.Item(GetLviGroupName(HOST, Temporary, Favorite, IsCollection, IsChannel))
                 End If
             Catch ex As Exception
                 Return Destination.Groups.Item(LabelsKeeper.NoLabeledName)
@@ -378,9 +503,9 @@ BlockNullPicture:
         Friend Overridable Function GetUserInformation() As String
             Dim OutStr$ = $"User: {Name}"
             OutStr.StringAppendLine($"Path: {MyFile.CutPath.Path}")
-            OutStr.StringAppendLine($"Total downloaded ({TotalContentCount.NumToString(ANumbers.Formats.Number, 3)}):")
+            OutStr.StringAppendLine($"Total downloaded ({DownloadedTotal(True).NumToString(ANumbers.Formats.Number, 3)}):")
-            OutStr.StringAppendLine($"Pictures: {_CountPictures.NumToString(ANumbers.Formats.Number, 3)}")
+            OutStr.StringAppendLine($"Pictures: {DownloadedPictures(True).NumToString(ANumbers.Formats.Number, 3)}")
-            OutStr.StringAppendLine($"Videos: {_CountVideo.NumToString(ANumbers.Formats.Number, 3)}")
+            OutStr.StringAppendLine($"Videos: {DownloadedVideos(True).NumToString(ANumbers.Formats.Number, 3)}")
             If Not UserDescription.IsEmptyString Then
                 OutStr.StringAppendLine(String.Empty)
                 OutStr.StringAppendLine(UserDescription)
@@ -389,8 +514,8 @@ BlockNullPicture:
             OutStr.StringAppendLine($"Last updated at: {AConvert(Of String)(LastUpdated, ADateTime.Formats.BaseDateTime, "not yet")}")
             If _DataParsed Then
                 OutStr.StringAppendLine("Downloaded now:")
-                OutStr.StringAppendLine($"Pictures: {_CountPictures.NumToString(ANumbers.Formats.Number, 3)}")
+                OutStr.StringAppendLine($"Pictures: {DownloadedTotal(False).NumToString(ANumbers.Formats.Number, 3)}")
-                OutStr.StringAppendLine($"Videos: {_CountVideo.NumToString(ANumbers.Formats.Number, 3)}")
+                OutStr.StringAppendLine($"Videos: {DownloadedVideos(False).NumToString(ANumbers.Formats.Number, 3)}")
             End If
             Return OutStr
         End Function
@@ -405,33 +530,37 @@ BlockNullPicture:
             _TempMediaList = New List(Of UserMedia)
             _TempPostsList = New List(Of String)
             Labels = New List(Of String)
+            _OnUserUpdatedHandlers = New List(Of IUserData.OnUserUpdatedEventHandler)
             If InvokeImageHandler Then ImageHandler(Me)
         End Sub
+        Friend Sub SetEnvironment(ByRef h As SettingsHost, ByVal u As UserInfo, ByVal _LoadUserInformation As Boolean,
+                                  Optional ByVal AttachUserInfo As Boolean = True) Implements IUserData.SetEnvironment
+            HOST = h
+            If AttachUserInfo Then
+                User = u
+                If _LoadUserInformation Then LoadUserInformation()
+            End If
+        End Sub
         ''' <exception cref="ArgumentOutOfRangeException"></exception>
         Friend Overloads Shared Function GetInstance(ByVal u As UserInfo, Optional ByVal _LoadUserInformation As Boolean = True) As IUserData
-            Select Case u.Site
+            If Not u.Plugin.IsEmptyString Then
-                Case Sites.Reddit
+                Return Settings(u.Plugin).GetInstance(u.DownloadOption, u, _LoadUserInformation)
-                    If u.IsChannel Then
+            Else
-                        Return New Reddit.Channel(u, _LoadUserInformation)
+                Throw New ArgumentOutOfRangeException("Plugin", $"Plugin [{u.Plugin}] information does not recognized by loader")
-                    Else
+            End If
-                        Return New Reddit.UserData(u, _LoadUserInformation)
-                    End If
-                Case Sites.Twitter : Return New Twitter.UserData(u, _LoadUserInformation)
-                Case Else : Throw New ArgumentOutOfRangeException("Site", $"Site [{u.Site}] information does not recognized by loader")
-            End Select
         End Function
 #End Region
 #Region "Information & Content data files loader and saver"
 #Region "User information"
+        Private _UserInformationLoaded As Boolean = False
         Friend Overridable Sub LoadUserInformation() Implements IUserData.LoadUserInformation
             Try
                 If MyFile.Exists Then
                     FileExists = True
                     Using x As New XmlFile(MyFile) With {.XmlReadOnly = True}
-                        x.DefaultsLoading(False)
-                        User.Site = Site
-                        Site = x.Value(Name_Site).FromXML(Of Integer)(0)
                         User.Name = x.Value(Name_UserName)
+                        UserExists = x.Value(Name_UserExists).FromXML(Of Boolean)(True)
+                        UserSuspended = x.Value(Name_UserSuspended).FromXML(Of Boolean)(False)
                         ID = x.Value(Name_UserID)
                         FriendlyName = x.Value(Name_FriendlyName)
                         UserDescription = x.Value(Name_Description)
@@ -439,18 +568,21 @@ BlockNullPicture:
                         Temporary = x.Value(Name_Temporary).FromXML(Of Boolean)(False)
                         Favorite = x.Value(Name_Favorite).FromXML(Of Boolean)(False)
                         CreatedByChannel = x.Value(Name_CreatedByChannel).FromXML(Of Boolean)(False)
-                        SeparateVideoFolder = AConvert(Of Boolean)(x.Value(Name_SeparateVideoFolder), Nothing)
+                        SeparateVideoFolder = AConvert(Of Boolean)(x.Value(Name_SeparateVideoFolder), AModes.Var, Nothing)
                         ReadyForDownload = x.Value(Name_ReadyForDownload).FromXML(Of Boolean)(True)
                         DownloadImages = x.Value(Name_DownloadImages).FromXML(Of Boolean)(True)
                         DownloadVideos = x.Value(Name_DownloadVideos).FromXML(Of Boolean)(True)
-                        _CountVideo = x.Value(Name_VideoCount).FromXML(Of Integer)(0)
+                        DownloadedVideos(True) = x.Value(Name_VideoCount).FromXML(Of Integer)(0)
-                        _CountPictures = x.Value(Name_PicturesCount).FromXML(Of Integer)(0)
+                        DownloadedPictures(True) = x.Value(Name_PicturesCount).FromXML(Of Integer)(0)
                         LastUpdated = AConvert(Of Date)(x.Value(Name_LastUpdated), ADateTime.Formats.BaseDateTime, Nothing)
                         DataMerging = x.Value(Name_DataMerging).FromXML(Of Boolean)(False)
                         ChangeCollectionName(x.Value(Name_CollectionName), False)
                         Labels.ListAddList(x.Value(Name_LabelsName).StringToList(Of String, List(Of String))("|", EDP.ReturnValue), LAP.NotContainsOnly, LAP.ClearBeforeAdd)
+                        LoadUserInformation_OptionalFields(x, True)
                     End Using
                     UpdateDataFiles()
+                    _UserInformationLoaded = True
+                    If _CollectionButtonsExists And Not _CollectionButtonsColorsSet And (Not UserExists Or UserSuspended) Then UpdateButtonsColor()
                 End If
             Catch ex As Exception
                 LogError(ex, "user information loading error")
@@ -460,8 +592,10 @@ BlockNullPicture:
             Try
                 MyFile.Exists(SFO.Path)
                 Using x As New XmlFile With {.Name = "User"}
-                    x.Add(Name_Site, CInt(Site))
+                    x.Add(Name_Site, Site)
                     x.Add(Name_UserName, User.Name)
+                    x.Add(Name_UserExists, UserExists.BoolToInteger)
+                    x.Add(Name_UserSuspended, UserSuspended.BoolToInteger)
                     x.Add(Name_UserID, ID)
                     x.Add(Name_FriendlyName, FriendlyName)
                     x.Add(Name_Description, UserDescription)
@@ -477,32 +611,32 @@ BlockNullPicture:
                     x.Add(Name_ReadyForDownload, ReadyForDownload.BoolToInteger)
                     x.Add(Name_DownloadImages, DownloadImages.BoolToInteger)
                     x.Add(Name_DownloadVideos, DownloadVideos.BoolToInteger)
-                    x.Add(Name_VideoCount, _CountVideo)
+                    x.Add(Name_VideoCount, DownloadedVideos(True))
-                    x.Add(Name_PicturesCount, _CountPictures)
+                    x.Add(Name_PicturesCount, DownloadedPictures(True))
                     x.Add(Name_LastUpdated, AConvert(Of String)(LastUpdated, ADateTime.Formats.BaseDateTime, String.Empty))
                     x.Add(Name_CollectionName, CollectionName)
                     x.Add(Name_LabelsName, Labels.ListToString(, "|", EDP.ReturnValue))
                     x.Add(Name_DataMerging, DataMerging.BoolToInteger)
 
+                    LoadUserInformation_OptionalFields(x, False)
+
                     x.Save(MyFile)
                 End Using
-                Settings.UpdateUsersList(User)
+                If Not IsSavedPosts Then Settings.UpdateUsersList(User)
             Catch ex As Exception
                 LogError(ex, "user information saving error")
             End Try
         End Sub
+        ''' <param name="Loading"><see langword="True"/>: Loading; <see langword="False"/>: Saving</param>
+        Protected MustOverride Sub LoadUserInformation_OptionalFields(ByRef Container As XmlFile, ByVal Loading As Boolean)
 #End Region
 #Region "User data"
         Friend Overridable Overloads Sub LoadContentInformation()
-            UpdateDataFiles()
-            LoadContentInformation(_ContentList, MyFileData)
-        End Sub
-        Private Overloads Sub LoadContentInformation(ByRef _CLIST As List(Of UserMedia), ByVal f As SFile)
             Try
-                If Not f.Exists Then Exit Sub
+                UpdateDataFiles()
-                Using x As New XmlFile(f, ProtectionLevels.All, False) With {.XmlReadOnly = True, .AllowSameNames = True}
+                If Not MyFileData.Exists Then Exit Sub
+                Using x As New XmlFile(MyFileData, Protector.Modes.All, False) With {.XmlReadOnly = True, .AllowSameNames = True}
                     x.LoadData()
-                    x.DefaultsLoading(False)
                     If x.Count > 0 Then
                         Dim fs$ = MyFile.CutPath.PathWithSeparator
                         Dim gfn As Func(Of String, String) = Function(ByVal Input As String) As String
@@ -517,7 +651,7 @@ BlockNullPicture:
                                                                  End If
                                                              End Function
                         For Each v As EContainer In x
-                            _CLIST.Add(New UserMedia With {
+                            _ContentList.Add(New UserMedia With {
                                            .Type = AConvert(Of Integer)(v.Attribute(Name_MediaType).Value, 0),
                                            .URL = v.Attribute(Name_MediaURL).Value,
                                            .URL_BASE = v.Value,
@@ -535,14 +669,14 @@ BlockNullPicture:
                 LogError(ex, "history loading error")
             End Try
         End Sub
-        Friend Sub UpdateContentInformation(ByRef _CLIST As List(Of UserMedia), ByVal f As SFile)
+        Friend Sub UpdateContentInformation()
             Try
                 UpdateDataFiles()
-                If f.IsEmptyString Then Exit Sub
+                If MyFileData.IsEmptyString Then Exit Sub
-                f.Exists(SFO.Path)
+                MyFileData.Exists(SFO.Path)
                 Using x As New XmlFile With {.AllowSameNames = True, .Name = "Data"}
-                    If _CLIST.Count > 0 Then
+                    If _ContentList.Count > 0 Then
-                        For Each i As UserMedia In _CLIST
+                        For Each i As UserMedia In _ContentList
                             x.Add(New EContainer("MediaData", i.URL_BASE,
                                                  {New EAttribute(Name_MediaType, CInt(i.Type)),
                                                   New EAttribute(Name_MediaURL, i.URL),
@@ -562,32 +696,43 @@ BlockNullPicture:
 #End Region
 #End Region
 #Region "Open site, folder"
-        Friend Overridable Sub OpenSite() Implements IContentProvider.OpenSite
+        Friend Overridable Sub OpenSite(Optional ByVal e As ErrorsDescriber = Nothing) Implements IContentProvider.OpenSite
             Try
-                Dim URL$ = String.Empty
+                Dim URL$ = HOST.Source.GetUserUrl(Name, IsChannel)
-                Select Case Site
-                    Case Sites.Reddit : URL = $"https://www.reddit.com/{IIf(IsChannel, "r", "user")}/{Name}/"
-                    Case Sites.Twitter : URL = $"https://twitter.com/{Name}"
-                    Case Else : MsgBoxE($"Site [{Site}] opening does not implemented", MsgBoxStyle.Exclamation)
-                End Select
                 If Not URL.IsEmptyString Then Process.Start(URL)
             Catch ex As Exception
-                MsgBoxE($"Error on trying to open [{Site}] page of user [{Name}]", MsgBoxStyle.Critical)
+                If Not e.Exists Then e = New ErrorsDescriber(EDP.ShowAllMsg)
+                MsgBoxE($"Error on trying to open [{Site}] page of user [{Name}]", MsgBoxStyle.Critical, e)
             End Try
         End Sub
         Friend Overridable Sub OpenFolder() Implements IUserData.OpenFolder
-            MyFile.CutPath.Open(SFO.Path, EDP.None)
+            GlobalOpenPath(MyFile.CutPath)
         End Sub
 #End Region
 #Region "Download functions and options"
-        Friend Overridable Property DownloadTopCount As Integer? = Nothing Implements IUserData.DownloadTopCount
+        Friend Overridable Property DownloadTopCount As Integer? = Nothing Implements IUserData.DownloadTopCount, IPluginContentProvider.PostsNumberLimit
+        Protected Responser As PersonalUtilities.Tools.WEB.Response
         Friend Overridable Sub DownloadData(ByVal Token As CancellationToken) Implements IContentProvider.DownloadData
             Dim Canceled As Boolean = False
+            _ExternalCompatibilityToken = Token
             Try
                 UpdateDataFiles()
+                UserDescriptionReset()
+                If Not Responser Is Nothing Then Responser.Dispose()
+                Responser = New PersonalUtilities.Tools.WEB.Response
+                If TypeOf HOST.Source Is IResponserContainer Then
+                    With DirectCast(HOST.Source, IResponserContainer)
+                        If Not .Responser Is Nothing Then Responser.Copy(.Responser)
+                    End With
+                End If
+
                 Dim UpPic As Boolean = Settings.ViewModeIsPicture AndAlso GetPicture(False) Is Nothing
-                _DownloadedPicturesSession = 0
+                Dim sEnvir() As Boolean = {UserExists, UserSuspended}
-                _DownloadedVideosSession = 0
+                Dim EnvirChanged As Func(Of Boolean) = Function() Not sEnvir(0) = UserExists Or Not sEnvir(1) = UserSuspended
+                UserExists = True
+                UserSuspended = False
+                DownloadedPictures(False) = 0
+                DownloadedVideos(False) = 0
                 _TempMediaList.Clear()
                 _TempPostsList.Clear()
                 Dim __SaveData As Boolean = Not CreatedByChannel Or Not Settings.FromChannelDownloadTopUse
@@ -596,14 +741,15 @@ BlockNullPicture:
 
                 If MyFilePosts.Exists Then _TempPostsList.ListAddList(File.ReadAllLines(MyFilePosts))
                 If _ContentList.Count > 0 Then _TempPostsList.ListAddList(_ContentList.Select(Function(u) u.Post.ID), LNC)
+
                 ThrowAny(Token)
                 DownloadDataF(Token)
                 ThrowAny(Token)
 
                 If _TempMediaList.Count > 0 Then
-                    If Not DownloadImages Then _TempMediaList.RemoveAll(Function(m) m.Type = UserMedia.Types.GIF Or m.Type = UserMedia.Types.Picture)
+                    If Not DownloadImages Then _TempMediaList.RemoveAll(Function(m) m.Type = UTypes.GIF Or m.Type = UTypes.Picture)
-                    If Not DownloadVideos Then _TempMediaList.RemoveAll(Function(m) m.Type = UserMedia.Types.Video Or
+                    If Not DownloadVideos Then _TempMediaList.RemoveAll(Function(m) m.Type = UTypes.Video Or
-                                                                                    m.Type = UserMedia.Types.VideoPre Or m.Type = UserMedia.Types.m3u8)
+                                                                                    m.Type = UTypes.VideoPre Or m.Type = UTypes.m3u8)
                 End If
 
                 ReparseVideo(Token)
@@ -612,26 +758,26 @@ BlockNullPicture:
                 _ContentNew.ListAddList(_TempMediaList, LAP.ClearBeforeAdd)
                 DownloadContent(Token)
                 ThrowIfDisposed()
-                _ContentList.ListAddList(_ContentNew.Where(Function(c) c.State = UState.Downloaded), LNC)
+                _ContentList.ListAddList(_ContentNew.Where(Function(c) c.State = UStates.Downloaded), LNC)
-                _CountPictures = _ContentList.LongCount(Function(c) c.Type = UserMedia.Types.Picture)
+                If DownloadedTotal(False) > 0 Or EnvirChanged.Invoke Then
-                _CountVideo = _ContentList.LongCount(Function(c) c.Type = UserMedia.Types.Video)
-                If DownloadedPictures + DownloadedVideos > 0 Then
                     If __SaveData Then
                         LastUpdated = Now
+                        DownloadedPictures(True) = SFile.GetFiles(User.File.CutPath, "*.jpg|*.jpeg|*.png|*.gif|*.webm",, EDP.ReturnValue).Count
+                        DownloadedVideos(True) = SFile.GetFiles(User.File.CutPath, "*.mp4|*.mkv|*.mov", SearchOption.AllDirectories, EDP.ReturnValue).Count
                         If Labels.Contains(LabelsKeeper.NoParsedUser) Then Labels.Remove(LabelsKeeper.NoParsedUser)
-                        UpdateContentInformation(_ContentList, MyFileData)
+                        UpdateContentInformation()
                     Else
-                        _CountVideo = 0
+                        DownloadedVideos(False) = 0
-                        _CountPictures = 0
+                        DownloadedPictures(False) = 0
                         _ContentList.Clear()
                         CreatedByChannel = False
                     End If
+                    If Not UserExists Then ReadyForDownload = False
                     UpdateUserInformation()
+                    If _CollectionButtonsExists AndAlso EnvirChanged.Invoke Then UpdateButtonsColor()
                 End If
                 ThrowIfDisposed()
-                _DownloadedPicturesTotal += _DownloadedPicturesSession
+                If UpPic Or EnvirChanged.Invoke Then RaiseEvent_OnUserUpdated()
-                _DownloadedVideosTotal += _DownloadedVideosSession
-                If UpPic Then Raise_OnPictureUpdated()
             Catch oex As OperationCanceledException When Token.IsCancellationRequested
                 MyMainLOG = $"{Site} - {Name}: downloading canceled"
                 Canceled = True
@@ -641,6 +787,7 @@ BlockNullPicture:
                 LogError(ex, "downloading data error")
                 HasError = True
             Finally
+                If Not Responser Is Nothing Then Responser.Dispose() : Responser = Nothing
                 If Not Canceled Then _DataParsed = True ': LastUpdated = Now
                 _ContentNew.Clear()
                 DownloadTopCount = Nothing
@@ -660,6 +807,104 @@ BlockNullPicture:
         Protected MustOverride Sub DownloadDataF(ByVal Token As CancellationToken)
         Protected MustOverride Sub ReparseVideo(ByVal Token As CancellationToken)
         Protected MustOverride Sub DownloadContent(ByVal Token As CancellationToken)
+        Protected Sub DownloadContentDefault(ByVal Token As CancellationToken)
+            Try
+                Dim i%
+                Dim dCount% = 0, dTotal% = 0
+                ThrowAny(Token)
+                If _ContentNew.Count > 0 Then
+                    _ContentNew.RemoveAll(Function(c) c.URL.IsEmptyString)
+                    If _ContentNew.Count > 0 Then
+                        MyFile.Exists(SFO.Path)
+                        Dim MyDir$ = MyFile.CutPath.PathNoSeparator
+                        Dim vsf As Boolean = SeparateVideoFolderF
+                        Dim __isVideo As Boolean
+                        Dim f As SFile
+                        Dim v As UserMedia
+                        Using w As New WebClient
+                            If vsf Then SFileShares.SFileExists($"{MyDir}\Video\", SFO.Path)
+                            Progress.TotalCount += _ContentNew.Count
+                            For i = 0 To _ContentNew.Count - 1
+                                ThrowAny(Token)
+                                v = _ContentNew(i)
+                                v.State = UStates.Tried
+                                If v.File.IsEmptyString Then
+                                    f = v.URL
+                                Else
+                                    f = v.File
+                                End If
+                                f.Separator = "\"
+                                f.Path = MyDir
+
+                                If v.URL_BASE.IsEmptyString Then v.URL_BASE = v.URL
+
+                                If Not v.File.IsEmptyString And Not v.URL_BASE.IsEmptyString Then
+                                    Try
+                                        __isVideo = v.Type = UTypes.Video Or f.Extension = "mp4"
+
+                                        If f.Extension.IsEmptyString Then
+                                            Select Case v.Type
+                                                Case UTypes.Picture : f.Extension = "jpg"
+                                                Case UTypes.Video : f.Extension = "mp4"
+                                                Case UTypes.GIF : f.Extension = "gif"
+                                            End Select
+                                        End If
+
+                                        If Not v.SpecialFolder.IsEmptyString Then
+                                            f.Path = $"{f.PathWithSeparator}{v.SpecialFolder}\".CSFileP.Path
+                                            f.Exists(SFO.Path)
+                                        End If
+                                        If __isVideo And vsf Then
+                                            f.Path = $"{f.PathWithSeparator}Video"
+                                            If Not v.SpecialFolder.IsEmptyString Then f.Exists(SFO.Path)
+                                        End If
+                                        w.DownloadFile(v.URL_BASE, f.ToString)
+
+                                        If __isVideo Then
+                                            v.Type = UTypes.Video
+                                            DownloadedVideos(False) += 1
+                                        Else
+                                            v.Type = UTypes.Picture
+                                            DownloadedPictures(False) += 1
+                                        End If
+
+                                        v.File = ChangeFileNameByProvider(f, v)
+                                        v.State = UStates.Downloaded
+                                        dCount += 1
+                                    Catch wex As Exception
+                                        ErrorDownloading(f, v.URL_BASE)
+                                    End Try
+                                Else
+                                    v.State = UStates.Skipped
+                                End If
+                                _ContentNew(i) = v
+                                If DownloadTopCount.HasValue AndAlso dCount >= DownloadTopCount.Value Then
+                                    Progress.Perform(_ContentNew.Count - dTotal)
+                                    Exit Sub
+                                Else
+                                    dTotal += 1
+                                    Progress.Perform()
+                                End If
+                            Next
+                        End Using
+                    End If
+                End If
+            Catch oex As OperationCanceledException When Token.IsCancellationRequested
+            Catch dex As ObjectDisposedException When Disposed
+            Catch ex As Exception
+                LogError(ex, "content downloading error")
+                HasError = True
+            End Try
+        End Sub
+        ''' <param name="RDE">Request DownloadingException</param>
+        Protected Sub ProcessException(ByVal ex As Exception, ByVal Token As CancellationToken, ByVal Message As String, Optional ByVal RDE As Boolean = True)
+            If Not ((TypeOf ex Is OperationCanceledException And Token.IsCancellationRequested) Or
+                    (TypeOf ex Is ObjectDisposedException And Disposed)) Then
+                If RDE AndAlso DownloadingException(ex, Message, True) = 0 Then LogError(ex, Message) : HasError = True
+            End If
+        End Sub
+        ''' <summary>0 - Execute LogError and set HasError</summary>
+        Protected MustOverride Function DownloadingException(ByVal ex As Exception, ByVal Message As String, Optional ByVal FromPE As Boolean = False) As Integer
         Protected Function ChangeFileNameByProvider(ByVal f As SFile, ByVal m As UserMedia) As SFile
             Dim ff As SFile = Nothing
             Try
@@ -690,7 +935,7 @@ BlockNullPicture:
         End Function
         Friend Function DeleteF(ByVal Instance As IUserData) As Integer
             Dim f As SFile = SFile.GetPath(MyFile.CutPath.Path)
-            If f.Exists(SFO.Path, False) AndAlso f.Delete(SFO.Path, False, False) Then
+            If f.Exists(SFO.Path, False) AndAlso (User.Merged OrElse f.Delete(SFO.Path, Settings.DeleteMode)) Then
                 ImageHandler(Me, False)
                 Settings.UsersList.Remove(User)
                 Settings.UpdateUsersList()
@@ -736,7 +981,7 @@ BlockNullPicture:
                         _TurnBack = False
                         Return False
                     End If
-                    f.Delete(SFO.Path, False, False, EDP.ThrowException)
+                    f.Delete(SFO.Path, Settings.DeleteMode, EDP.ThrowException)
                 End If
                 f.CutPath.Exists(SFO.Path)
                 Directory.Move(UserBefore.File.CutPath(, EDP.ThrowException).Path, f.Path)
@@ -791,7 +1036,7 @@ BlockNullPicture:
                     FilesMover.Invoke
                     If SFile.GetFiles(UserBefore.File.CutPath,, SearchOption.AllDirectories,
                                       New ErrorsDescriber(False, False, False, New List(Of SFile))).Count = 0 Then
-                        UserBefore.File.CutPath.Delete(SFO.Path, False, False, EDP.SendInLog)
+                        UserBefore.File.CutPath.Delete(SFO.Path, Settings.DeleteMode, EDP.SendInLog)
                     End If
                     UpdateUserInformation()
                 End If
@@ -803,7 +1048,7 @@ BlockNullPicture:
         End Sub
         Private Function CheckFile(ByVal f As SFile, ByRef List As IEnumerable(Of SFile)) As SFile
             If List.ListExists Then
-                Dim p As New RegexStructure(".+?\s{0,1}\((\d+)\)|.+",,,,,,, String.Empty, EDP.ReturnValue)
+                Dim p As RParams = RParams.DMS(".+?\s{0,1}\((\d+)\)|.+", 0, EDP.ReturnValue)
                 Dim i% = List.Where(Function(ff) CStr(RegexReplace(ff.Name, p)).Trim.ToLower = f.Name.Trim.ToLower).Count
                 If i > 0 Then f.Name &= $" ({i + 1})"
             End If
@@ -821,33 +1066,42 @@ BlockNullPicture:
         Protected Sub ThrowIfDisposed()
             If Disposed Then Throw New ObjectDisposedException(ToString(), "Object disposed")
         End Sub
+        ''' <inheritdoc cref="ThrowAny(CancellationToken)"/>
+        Private Overloads Sub ThrowAny() Implements IThrower.ThrowAny
+            ThrowAny(_ExternalCompatibilityToken)
+        End Sub
         ''' <exception cref="OperationCanceledException"></exception>
         ''' <exception cref="ObjectDisposedException"></exception>
-        Protected Sub ThrowAny(ByVal Token As CancellationToken)
+        Friend Overloads Sub ThrowAny(ByVal Token As CancellationToken)
             Token.ThrowIfCancellationRequested()
             ThrowIfDisposed()
         End Sub
 #End Region
         Public Overrides Function ToString() As String
-            If Settings.ViewModeIsPicture Then
+            If IsCollection Then
-                If IsCollection Then
+                Return CollectionName
-                    Return CollectionName
-                Else
-                    Return IIf(FriendlyName.IsEmptyString, Name, FriendlyName)
-                End If
             Else
-                Dim t$ = String.Empty
+                Return IIf(FriendlyName.IsEmptyString, Name, FriendlyName)
-                If Temporary Then
-                    t = " (T)"
-                ElseIf Favorite Then
-                    t = " (F)"
-                End If
-                If IsCollection Then
-                    Return $"Collection [{CollectionName}]{t}"
-                Else
-                    Return $"[{Site}]{t} {IIf(FriendlyName.IsEmptyString, Name, FriendlyName)}"
-                End If
             End If
+            'If Settings.ViewModeIsPicture Then
+            '    If IsCollection Then
+            '        Return CollectionName
+            '    Else
+            '        Return IIf(FriendlyName.IsEmptyString, Name, FriendlyName)
+            '    End If
+            'Else
+            '    Dim t$ = String.Empty
+            '    If Temporary Then
+            '        t = " (T)"
+            '    ElseIf Favorite Then
+            '        t = " (F)"
+            '    End If
+            '    If IsCollection Then
+            '        Return $"Collection [{CollectionName}]{t}"
+            '    Else
+            '        Return $"[{Site}]{t} {IIf(FriendlyName.IsEmptyString, Name, FriendlyName)}"
+            '    End If
+            'End If
         End Function
 #Region "Buttons actions"
         Private Sub BTT_CONTEXT_DOWN_Click(sender As Object, e As EventArgs) Handles BTT_CONTEXT_DOWN.Click
@@ -870,38 +1124,25 @@ BlockNullPicture:
 #End Region
 #Region "IComparable Support"
         Friend Overridable Function CompareTo(ByVal Other As UserDataBase) As Integer Implements IComparable(Of UserDataBase).CompareTo
-            Dim x% = CompareValue(Me)
+            Return Name.CompareTo(Other.Name)
-            Dim y% = CompareValue(Other)
-            If x.CompareTo(y) = 0 Then
-                Return Name.CompareTo(Other.Name)
-            Else
-                Return x.CompareTo(y)
-            End If
-        End Function
-        Protected Function CompareValue(ByVal x As UserDataBase) As Integer
-            Dim OutValue% = CInt(x.Site) * 10000
-            If x.IsCollection Then OutValue -= 1000
-            If x.Temporary Then OutValue += 2000
-            If x.Favorite Then OutValue -= 500
-            Return OutValue
         End Function
         Friend Overridable Function CompareTo(ByVal Obj As Object) As Integer Implements IComparable.CompareTo
-            If TypeOf Obj Is Reddit.Channel Then
+            If Not Obj Is Nothing AndAlso TypeOf Obj Is UserDataBase Then
-                Return CompareTo(DirectCast(DirectCast(Obj, Reddit.Channel).Instance, UserDataBase))
-            Else
                 Return CompareTo(DirectCast(Obj, UserDataBase))
+            Else
+                Return False
             End If
         End Function
 #End Region
 #Region "IEquatable Support"
         Friend Overridable Overloads Function Equals(ByVal Other As UserDataBase) As Boolean Implements IEquatable(Of UserDataBase).Equals
-            Return Site = Other.Site And Name = Other.Name
+            Return LVIKey = Other.LVIKey And IsSavedPosts = Other.IsSavedPosts
         End Function
         Public Overrides Function Equals(ByVal Obj As Object) As Boolean
-            If TypeOf Obj Is Reddit.Channel Then
+            If Not Obj Is Nothing AndAlso TypeOf Obj Is UserDataBase Then
-                Return Equals(DirectCast(DirectCast(Obj, Reddit.Channel).Instance, UserDataBase))
-            Else
                 Return Equals(DirectCast(Obj, UserDataBase))
+            Else
+                Return False
             End If
         End Function
 #End Region
@@ -919,12 +1160,13 @@ BlockNullPicture:
                     _ContentNew.Clear()
                     _TempMediaList.Clear()
                     _TempPostsList.Clear()
+                    If Not Responser Is Nothing Then Responser.Dispose()
                     If Not BTT_CONTEXT_DOWN Is Nothing Then BTT_CONTEXT_DOWN.Dispose()
                     If Not BTT_CONTEXT_EDIT Is Nothing Then BTT_CONTEXT_EDIT.Dispose()
                     If Not BTT_CONTEXT_DELETE Is Nothing Then BTT_CONTEXT_DELETE.Dispose()
                     If Not BTT_CONTEXT_OPEN_PATH Is Nothing Then BTT_CONTEXT_OPEN_PATH.Dispose()
                     If Not BTT_CONTEXT_OPEN_SITE Is Nothing Then BTT_CONTEXT_OPEN_SITE.Dispose()
-                    If _InvokeImageHandler Then ImageHandler(Me, False)
+                    _OnUserUpdatedHandlers.Clear()
                 End If
                 disposedValue = True
             End If
@@ -940,18 +1182,18 @@ BlockNullPicture:
 #End Region
     End Class
     Friend Interface IContentProvider
-        Property Site As Sites
+        ReadOnly Property Site As String
         Property Name As String
         Property ID As String
         Property FriendlyName As String
         Property Description As String
         Property Favorite As Boolean
         Property Temporary As Boolean
-        Sub OpenSite()
+        Sub OpenSite(Optional ByVal e As ErrorsDescriber = Nothing)
         Sub DownloadData(ByVal Token As CancellationToken)
     End Interface
-    Friend Interface IUserData : Inherits IContentProvider, IComparable(Of UserDataBase), IComparable, IEquatable(Of UserDataBase), IDisposable
+    Friend Interface IUserData : Inherits IContentProvider, IComparable(Of UserDataBase), IComparable, IEquatable(Of UserDataBase), IIndexable, IDisposable
-        Event OnPictureUpdated(ByVal User As IUserData)
+        Event OnUserUpdated(ByVal User As IUserData)
         Property ParseUserMediaOnly As Boolean
 #Region "Images"
         Function GetPicture() As Image
@@ -964,17 +1206,19 @@ BlockNullPicture:
         ReadOnly Property Labels As List(Of String)
 #End Region
         ReadOnly Property IsChannel As Boolean
+        Property Exists As Boolean
+        Property Suspended As Boolean
         Property ReadyForDownload As Boolean
+        Property HOST As SettingsHost
         Property [File] As SFile
         Property FileExists As Boolean
-        Property DownloadedPictures As Integer
+        Property DownloadedPictures(ByVal Total As Boolean) As Integer
-        Property DownloadedVideos As Integer
+        Property DownloadedVideos(ByVal Total As Boolean) As Integer
         ReadOnly Property DownloadedTotal(Optional ByVal Total As Boolean = True) As Integer
         ReadOnly Property DownloadedInformation As String
         Property HasError As Boolean
         ReadOnly Property FitToAddParams As Boolean
-        ReadOnly Property LVIKey As String
+        ReadOnly Property Key As String
-        ReadOnly Property LVIIndex As Integer
         Property DownloadImages As Boolean
         Property DownloadVideos As Boolean
         Function GetLVI(ByVal Destination As ListView) As ListViewItem
@@ -985,13 +1229,15 @@ BlockNullPicture:
         ''' 0 - Nothing removed<br/>
         ''' 1 - User removed<br/>
         ''' 2 - Collection removed<br/>
-        ''' 3 - Collection splitted
+        ''' 3 - Collection split
         ''' </summary>
         Function Delete() As Integer
         Function MoveFiles(ByVal CollectionName As String) As Boolean
         Sub OpenFolder()
         ReadOnly Property Self As IUserData
         Property DownloadTopCount As Integer?
+        Sub SetEnvironment(ByRef h As SettingsHost, ByVal u As UserInfo, ByVal _LoadUserInformation As Boolean,
+                           Optional ByVal AttachUserInfo As Boolean = True)
         ReadOnly Property Disposed As Boolean
     End Interface
     Friend Interface IChannelLimits

SCrawler/API/Gfycat/Envir.vb

@@ -0,0 +1,35 @@
+' Copyright (C) 2022  Andy
+' This program is free software: you can redistribute it and/or modify
+' it under the terms of the GNU General Public License as published by
+' the Free Software Foundation, either version 3 of the License, or
+' (at your option) any later version.
+'
+' This program is distributed in the hope that it will be useful,
+' but WITHOUT ANY WARRANTY
+Imports PersonalUtilities.Functions.RegularExpressions
+Imports System.Net
+Imports SCrawler.API.Base
+Namespace API.Gfycat
+    Friend NotInheritable Class Envir
+        Private Sub New()
+        End Sub
+        Friend Shared Function GetVideo(ByVal URL As String) As String
+            Try
+                Dim r$
+                Using w As New WebClient : r = w.DownloadString(URL) : End Using
+                If Not r.IsEmptyString Then Return RegexReplace(r, RParams.DMS("contentUrl.:.(http.?://[^""]+?\.mp4)", 1)) Else Return String.Empty
+            Catch ex As Exception
+                Dim e As EDP = EDP.ReturnValue
+                If TypeOf ex Is WebException Then
+                    Dim obj As HttpWebResponse = TryCast(DirectCast(ex, WebException).Response, HttpWebResponse)
+                    If Not If(obj?.StatusCode, HttpStatusCode.OK) = HttpStatusCode.NotFound Then e += EDP.SendInLog
+                End If
+                Return ErrorsDescriber.Execute(e, ex, $"[API.Gfycat.Envir.GetVideo({URL})]", String.Empty)
+            End Try
+        End Function
+        Friend Shared Function GetVideoInfo(ByVal URL As String) As IEnumerable(Of UserMedia)
+            Dim u$ = GetVideo(URL)
+            Return If(u.IsEmptyString, Nothing, {New UserMedia(u, UserMedia.Types.Video)})
+        End Function
+    End Class
+End Namespace

SCrawler/API/Imgur/Envir.vb

@@ -0,0 +1,102 @@
+' Copyright (C) 2022  Andy
+' This program is free software: you can redistribute it and/or modify
+' it under the terms of the GNU General Public License as published by
+' the Free Software Foundation, either version 3 of the License, or
+' (at your option) any later version.
+'
+' This program is distributed in the hope that it will be useful,
+' but WITHOUT ANY WARRANTY
+Imports PersonalUtilities.Functions.XML
+Imports PersonalUtilities.Functions.RegularExpressions
+Imports PersonalUtilities.Tools.WebDocuments.JSON
+Imports System.Net
+Imports SCrawler.API.Imgur.Declarations
+Imports SCrawler.API.Base
+Namespace API.Imgur
+    Namespace Declarations
+        Friend Module Imgur_Declarations
+            Friend ReadOnly PostRegex As RParams = RParams.DMS("/([\w\d]+?)(|\.[\w]{0,4})\Z", 1)
+        End Module
+    End Namespace
+    Friend NotInheritable Class Envir
+        Private Sub New()
+        End Sub
+        Friend Shared Function GetGallery(ByVal URL As String, Optional ByVal e As ErrorsDescriber = Nothing) As List(Of String)
+            Try
+                If Not Settings.ImgurClientID.IsEmptyString And Not URL.IsEmptyString Then
+                    Dim __url$ = RegexReplace(URL, PostRegex)
+                    If Not __url.IsEmptyString Then
+                        __url = $"https://api.imgur.com/post/v1/albums/{__url}?client_id={Settings.ImgurClientID.Value}&include=media"
+                        Using w As New WebClient
+                            Dim r$ = w.DownloadString(__url)
+                            If Not r.IsEmptyString Then
+                                Using j As EContainer = JsonDocument.Parse(r).XmlIfNothing
+                                    If j.Contains("media") Then
+                                        Dim UrlsList As New List(Of String)
+                                        Dim tmpUrl$
+                                        For Each m As EContainer In j("media")
+                                            tmpUrl = m.Value("url")
+                                            If Not tmpUrl.IsEmptyString Then UrlsList.ListAddValue(tmpUrl, Base.LNC)
+                                        Next
+                                        Return UrlsList
+                                    End If
+                                End Using
+                            End If
+                        End Using
+                    End If
+                End If
+                Return Nothing
+            Catch ex As Exception
+                Return DownloadingException(ex, $"[API.Imgur.Envir.GetGallery({URL})]", Nothing, e)
+            End Try
+        End Function
+        Friend Shared Function GetImage(ByVal URL As String, Optional ByVal e As ErrorsDescriber = Nothing) As String
+            Try
+                If Not Settings.ImgurClientID.IsEmptyString And Not URL.IsEmptyString Then
+                    Dim __url$ = RegexReplace(URL, PostRegex)
+                    If Not __url.IsEmptyString Then
+                        __url = $"https://api.imgur.com/3/image/{__url}?client_id={Settings.ImgurClientID.Value}&include=media"
+                        Using w As New WebClient
+                            Dim r$ = w.DownloadString(__url)
+                            If Not r.IsEmptyString Then Return JsonDocument.Parse(r).XmlIfNothing.Value({"data"}, "link")
+                        End Using
+                    End If
+                End If
+                Return String.Empty
+            Catch ex As Exception
+                Return DownloadingException(ex, $"[API.Imgur.Envir.GetImage({URL})]", String.Empty, e)
+            End Try
+        End Function
+        Friend Shared Function GetVideoInfo(ByVal URL As String) As IEnumerable(Of UserMedia)
+            Try
+                If Not URL.IsEmptyString AndAlso URL.ToLower.Contains("imgur") AndAlso Not Settings.ImgurClientID.IsEmptyString Then
+                    Dim img$ = GetImage(URL, EDP.ReturnValue)
+                    If Not img.IsEmptyString Then
+                        Return {New UserMedia(img)}
+                    Else
+                        Return GetGallery(URL, EDP.ReturnValue).ListIfNothing.Select(Function(u) New UserMedia(u))
+                    End If
+                End If
+                Return Nothing
+            Catch ex As Exception
+                Return ErrorsDescriber.Execute(EDP.ShowMainMsg + EDP.SendInLog, ex, "Imgur standalone downloader: fetch media error")
+            End Try
+        End Function
+        Private Shared Function DownloadingException(ByVal ex As Exception, ByVal Message As String,
+                                                     ByVal NullArg As Object, ByVal e As ErrorsDescriber) As Object
+            If TypeOf ex Is WebException Then
+                Dim obj As HttpWebResponse = TryCast(DirectCast(ex, WebException).Response, HttpWebResponse)
+                If Not obj Is Nothing Then
+                    If obj.StatusCode = HttpStatusCode.NotFound Then
+                        Return NullArg
+                    ElseIf obj.StatusCode = HttpStatusCode.Unauthorized Then
+                        MyMainLOG = "Imgur credentials expired"
+                        Return NullArg
+                    End If
+                End If
+            End If
+            If Not e.Exists Then e = New ErrorsDescriber(EDP.ReturnValue + EDP.SendInLog)
+            Return ErrorsDescriber.Execute(e, ex, Message, NullArg)
+        End Function
+    End Class
+End Namespace

SCrawler/API/Instagram/AuthNullException.vb

@@ -0,0 +1,36 @@
+' Copyright (C) 2022  Andy
+' This program is free software: you can redistribute it and/or modify
+' it under the terms of the GNU General Public License as published by
+' the Free Software Foundation, either version 3 of the License, or
+' (at your option) any later version.
+'
+' This program is distributed in the hope that it will be useful,
+' but WITHOUT ANY WARRANTY
+Imports Sections = SCrawler.API.Instagram.UserData.Sections
+Namespace API.Instagram
+    Friend Class AuthNullException : Inherits ArgumentNullException
+        Public Overrides ReadOnly Property ParamName As String
+        Public Overrides ReadOnly Property Message As String
+        Friend Sub New(ByVal s As Sections, ByVal IsSavedPosts As Boolean)
+            If IsSavedPosts Then
+                ParamName = "HashSavedPosts"
+            ElseIf s = Sections.Timeline Then
+                ParamName = "Hash"
+            Else
+                ParamName = "IG_APP_ID, IG_WWW_CLAIM"
+            End If
+            Message = $"Instagram auth for [{s}] is not set"
+        End Sub
+        Friend Shared Sub ThrowIfNull(ByVal s As Sections, ByVal IsSavedPosts As Boolean, ByVal Host As SiteSettings)
+            Dim b As Boolean = False
+            If IsSavedPosts Then
+                If Not ACheck(Host.HashSavedPosts.Value) Then b = True
+            ElseIf s = Sections.Timeline Then
+                If Not ACheck(Host.Hash.Value) Then Host.HashUpdateRequired.Value = True : b = True
+            Else
+                If Not Host.StoriesAndTaggedReady Then b = True
+            End If
+            If b Then Throw New AuthNullException(s, IsSavedPosts)
+        End Sub
+    End Class
+End Namespace

SCrawler/API/Instagram/Declarations.vb

@@ -0,0 +1,25 @@
+' Copyright (C) 2022  Andy
+' This program is free software: you can redistribute it and/or modify
+' it under the terms of the GNU General Public License as published by
+' the Free Software Foundation, either version 3 of the License, or
+' (at your option) any later version.
+'
+' This program is distributed in the hope that it will be useful,
+' but WITHOUT ANY WARRANTY
+Imports PersonalUtilities.Functions.RegularExpressions
+Namespace API.Instagram
+    Friend Module Declarations
+        Friend Const InstagramSite As String = "Instagram"
+        Friend ReadOnly FilesPattern As RParams = RParams.DMS(".+?([^/\?]+?\.[\w\d]{3,4})(?=(\?|\Z))", 1, EDP.ReturnValue)
+        Friend ReadOnly Property DateProvider As New JsonDate
+        Friend Class JsonDate : Implements ICustomProvider
+            Friend Function Convert(ByVal Value As Object, ByVal DestinationType As Type, ByVal Provider As IFormatProvider,
+                                    Optional ByVal NothingArg As Object = Nothing, Optional ByVal e As ErrorsDescriber = Nothing) As Object Implements ICustomProvider.Convert
+                Return ADateTime.ParseUnicode(Value)
+            End Function
+            Private Function GetFormat(ByVal FormatType As Type) As Object Implements IFormatProvider.GetFormat
+                Throw New NotImplementedException("GetFormat is not available in this context")
+            End Function
+        End Class
+    End Module
+End Namespace

SCrawler/API/Instagram/EditorExchangeOptions.vb

@@ -0,0 +1,23 @@
+' Copyright (C) 2022  Andy
+' This program is free software: you can redistribute it and/or modify
+' it under the terms of the GNU General Public License as published by
+' the Free Software Foundation, either version 3 of the License, or
+' (at your option) any later version.
+'
+' This program is distributed in the hope that it will be useful,
+' but WITHOUT ANY WARRANTY
+Imports SCrawler.Plugin
+Namespace API.Instagram
+    Friend Class EditorExchangeOptions
+        Friend Property GetStories As Boolean
+        Friend Property GetTagged As Boolean
+        Private ReadOnly Property MySiteSettings As SiteSettings
+        Friend Sub New(ByVal h As ISiteSettings)
+            MySiteSettings = DirectCast(h, SiteSettings)
+            With MySiteSettings
+                GetStories = CBool(.GetStories.Value)
+                GetTagged = CBool(.GetTagged.Value)
+            End With
+        End Sub
+    End Class
+End Namespace

SCrawler/API/Instagram/ExitException.vb

@@ -0,0 +1,15 @@
+' Copyright (C) 2022  Andy
+' This program is free software: you can redistribute it and/or modify
+' it under the terms of the GNU General Public License as published by
+' the Free Software Foundation, either version 3 of the License, or
+' (at your option) any later version.
+'
+' This program is distributed in the hope that it will be useful,
+' but WITHOUT ANY WARRANTY
+Namespace API.Instagram
+    Friend Class ExitException : Inherits Exception
+        Friend Sub New(ByRef CompleteArg As Boolean)
+            CompleteArg = True
+        End Sub
+    End Class
+End Namespace

SCrawler/API/Instagram/OptionsForm.Designer.vb

@@ -0,0 +1,120 @@
+' Copyright (C) 2022  Andy
+' This program is free software: you can redistribute it and/or modify
+' it under the terms of the GNU General Public License as published by
+' the Free Software Foundation, either version 3 of the License, or
+' (at your option) any later version.
+'
+' This program is distributed in the hope that it will be useful,
+' but WITHOUT ANY WARRANTY
+Namespace API.Instagram
+    <Global.Microsoft.VisualBasic.CompilerServices.DesignerGenerated()>
+    Partial Friend Class OptionsForm : Inherits System.Windows.Forms.Form
+        <System.Diagnostics.DebuggerNonUserCode()>
+        Protected Overrides Sub Dispose(ByVal disposing As Boolean)
+            Try
+                If disposing AndAlso components IsNot Nothing Then
+                    components.Dispose()
+                End If
+            Finally
+                MyBase.Dispose(disposing)
+            End Try
+        End Sub
+        Private components As System.ComponentModel.IContainer
+        <System.Diagnostics.DebuggerStepThrough()>
+        Private Sub InitializeComponent()
+            Dim CONTAINER_MAIN As System.Windows.Forms.ToolStripContainer
+            Dim TP_MAIN As System.Windows.Forms.TableLayoutPanel
+            Me.CH_GET_STORIES = New System.Windows.Forms.CheckBox()
+            Me.CH_GET_TAGGED = New System.Windows.Forms.CheckBox()
+            CONTAINER_MAIN = New System.Windows.Forms.ToolStripContainer()
+            TP_MAIN = New System.Windows.Forms.TableLayoutPanel()
+            CONTAINER_MAIN.ContentPanel.SuspendLayout()
+            CONTAINER_MAIN.SuspendLayout()
+            TP_MAIN.SuspendLayout()
+            Me.SuspendLayout()
+            '
+            'CONTAINER_MAIN
+            '
+            '
+            'CONTAINER_MAIN.ContentPanel
+            '
+            CONTAINER_MAIN.ContentPanel.Controls.Add(TP_MAIN)
+            CONTAINER_MAIN.ContentPanel.Size = New System.Drawing.Size(260, 53)
+            CONTAINER_MAIN.Dock = System.Windows.Forms.DockStyle.Fill
+            CONTAINER_MAIN.LeftToolStripPanelVisible = False
+            CONTAINER_MAIN.Location = New System.Drawing.Point(0, 0)
+            CONTAINER_MAIN.Name = "CONTAINER_MAIN"
+            CONTAINER_MAIN.RightToolStripPanelVisible = False
+            CONTAINER_MAIN.Size = New System.Drawing.Size(260, 78)
+            CONTAINER_MAIN.TabIndex = 0
+            CONTAINER_MAIN.TopToolStripPanelVisible = False
+            '
+            'TP_MAIN
+            '
+            TP_MAIN.CellBorderStyle = System.Windows.Forms.TableLayoutPanelCellBorderStyle.[Single]
+            TP_MAIN.ColumnCount = 1
+            TP_MAIN.ColumnStyles.Add(New System.Windows.Forms.ColumnStyle(System.Windows.Forms.SizeType.Percent, 100.0!))
+            TP_MAIN.Controls.Add(Me.CH_GET_STORIES, 0, 0)
+            TP_MAIN.Controls.Add(Me.CH_GET_TAGGED, 0, 1)
+            TP_MAIN.Dock = System.Windows.Forms.DockStyle.Fill
+            TP_MAIN.Location = New System.Drawing.Point(0, 0)
+            TP_MAIN.Name = "TP_MAIN"
+            TP_MAIN.RowCount = 3
+            TP_MAIN.RowStyles.Add(New System.Windows.Forms.RowStyle(System.Windows.Forms.SizeType.Absolute, 25.0!))
+            TP_MAIN.RowStyles.Add(New System.Windows.Forms.RowStyle(System.Windows.Forms.SizeType.Absolute, 25.0!))
+            TP_MAIN.RowStyles.Add(New System.Windows.Forms.RowStyle(System.Windows.Forms.SizeType.Percent, 100.0!))
+            TP_MAIN.Size = New System.Drawing.Size(260, 53)
+            TP_MAIN.TabIndex = 0
+            '
+            'CH_GET_STORIES
+            '
+            Me.CH_GET_STORIES.AutoSize = True
+            Me.CH_GET_STORIES.Dock = System.Windows.Forms.DockStyle.Fill
+            Me.CH_GET_STORIES.Location = New System.Drawing.Point(4, 4)
+            Me.CH_GET_STORIES.Name = "CH_GET_STORIES"
+            Me.CH_GET_STORIES.Size = New System.Drawing.Size(252, 19)
+            Me.CH_GET_STORIES.TabIndex = 0
+            Me.CH_GET_STORIES.Text = "Get stories"
+            Me.CH_GET_STORIES.UseVisualStyleBackColor = True
+            '
+            'CH_GET_TAGGED
+            '
+            Me.CH_GET_TAGGED.AutoSize = True
+            Me.CH_GET_TAGGED.Dock = System.Windows.Forms.DockStyle.Fill
+            Me.CH_GET_TAGGED.Location = New System.Drawing.Point(4, 30)
+            Me.CH_GET_TAGGED.Name = "CH_GET_TAGGED"
+            Me.CH_GET_TAGGED.Size = New System.Drawing.Size(252, 19)
+            Me.CH_GET_TAGGED.TabIndex = 1
+            Me.CH_GET_TAGGED.Text = "Get tagged data"
+            Me.CH_GET_TAGGED.UseVisualStyleBackColor = True
+            '
+            'OptionsForm
+            '
+            Me.AutoScaleDimensions = New System.Drawing.SizeF(6.0!, 13.0!)
+            Me.AutoScaleMode = System.Windows.Forms.AutoScaleMode.Font
+            Me.ClientSize = New System.Drawing.Size(260, 78)
+            Me.Controls.Add(CONTAINER_MAIN)
+            Me.FormBorderStyle = System.Windows.Forms.FormBorderStyle.FixedSingle
+            Me.KeyPreview = True
+            Me.MaximizeBox = False
+            Me.MaximumSize = New System.Drawing.Size(276, 117)
+            Me.MinimizeBox = False
+            Me.MinimumSize = New System.Drawing.Size(276, 117)
+            Me.Name = "OptionsForm"
+            Me.ShowIcon = False
+            Me.ShowInTaskbar = False
+            Me.SizeGripStyle = System.Windows.Forms.SizeGripStyle.Hide
+            Me.Text = "Options"
+            CONTAINER_MAIN.ContentPanel.ResumeLayout(False)
+            CONTAINER_MAIN.ResumeLayout(False)
+            CONTAINER_MAIN.PerformLayout()
+            TP_MAIN.ResumeLayout(False)
+            TP_MAIN.PerformLayout()
+            Me.ResumeLayout(False)
+
+        End Sub
+
+        Private WithEvents CH_GET_STORIES As CheckBox
+        Private WithEvents CH_GET_TAGGED As CheckBox
+    End Class
+End Namespace

SCrawler/API/Instagram/OptionsForm.resx

@@ -117,26 +117,10 @@
   <resheader name="writer">
     <value>System.Resources.ResXResourceWriter, System.Windows.Forms, Version=4.0.0.0, Culture=neutral, PublicKeyToken=b77a5c561934e089</value>
   </resheader>
-  <metadata name="ToolbarTOP.TrayLocation" type="System.Drawing.Point, System.Drawing, Version=4.0.0.0, Culture=neutral, PublicKeyToken=b03f5f7f11d50a3a">
+  <metadata name="CONTAINER_MAIN.GenerateMember" type="System.Boolean, mscorlib, Version=4.0.0.0, Culture=neutral, PublicKeyToken=b77a5c561934e089">
-    <value>17, 17</value>
+    <value>False</value>
   </metadata>
-  <assembly alias="System.Drawing" name="System.Drawing, Version=4.0.0.0, Culture=neutral, PublicKeyToken=b03f5f7f11d50a3a" />
+  <metadata name="TP_MAIN.GenerateMember" type="System.Boolean, mscorlib, Version=4.0.0.0, Culture=neutral, PublicKeyToken=b77a5c561934e089">
-  <data name="MENU_VIEW.Image" type="System.Drawing.Bitmap, System.Drawing" mimetype="application/x-microsoft.net.object.bytearray.base64">
+    <value>False</value>
-    <value>
-        iVBORw0KGgoAAAANSUhEUgAAABAAAAAQCAYAAAAf8/9hAAAAAXNSR0IArs4c6QAAAARnQU1BAACxjwv8
-        YQUAAAAJcEhZcwAADsMAAA7DAcdvqGQAAAIDSURBVDhPpZLrS5NhGMb3j4SWh0oRQVExD4gonkDpg4hG
-        YKxG6WBogkMZKgPNCEVJFBGdGETEvgwyO9DJE5syZw3PIlPEE9pgBCLZ5XvdMB8Ew8gXbl54nuf63dd9
-        0OGSnwCahxbPRNPAPMw9Xpg6ZmF46kZZ0xSKzJPIrhpDWsVnpBhGkKx3nAX8Pv7z1zg8OoY/cITdn4fw
-        bf/C0kYAN3Ma/w3gWfZL5kzTKBxjWyK2DftwI9tyMYCZKXbNHaD91bLYJrDXsYbrWfUKwJrPE9M2M1Oc
-        VzOOpHI7Jr376Hi9ogHqFIANO0/MmmmbmSmm9a8ze+I4MrNWAdjtoJgWcx+PSzg166yZZ8xM8XvXDix9
-        c4jIqFYAjoriBV9AhEPv1mH/sonogha0afbZMMZz+yreTGyhpusHwtNNCsA5U1zS4BLxzJIfg299qO32
-        Ir7UJtZfftyATqeT+8o2D8JSjQrAJblrncYL7ZJ2+bfaFnC/1S1NjL3diRat7qrO7wLRP3HjWsojBeCo
-        mDEo5mNjuweFGvjWg2EBhCbpkW78htSHHwRyNdmgAFzPEee2iFkzayy2OLXzT4gr6UdUnlXrullsxxQ+
-        kx0g8BTA3aZlButjSTyjODq/WcQcW/B/Je4OQhLvKQDnzN1mp0nnkvAhR8VuMzNrpm1mpjgkoVwB/v8D
-        TgDQASA1MVpwzwAAAABJRU5ErkJggg==
-</value>
-  </data>
-  <metadata name="ToolbarBOTTOM.TrayLocation" type="System.Drawing.Point, System.Drawing, Version=4.0.0.0, Culture=neutral, PublicKeyToken=b03f5f7f11d50a3a">
-    <value>133, 17</value>
   </metadata>
 </root>

SCrawler/API/Instagram/OptionsForm.vb

@@ -0,0 +1,44 @@
+' Copyright (C) 2022  Andy
+' This program is free software: you can redistribute it and/or modify
+' it under the terms of the GNU General Public License as published by
+' the Free Software Foundation, either version 3 of the License, or
+' (at your option) any later version.
+'
+' This program is distributed in the hope that it will be useful,
+' but WITHOUT ANY WARRANTY
+Imports PersonalUtilities.Forms
+Imports PersonalUtilities.Forms.Toolbars
+Namespace API.Instagram
+    Friend Class OptionsForm : Implements IOkCancelToolbar
+        Private ReadOnly MyDefs As DefaultFormProps
+        Private ReadOnly Property MyExchangeOptions As EditorExchangeOptions
+        Friend Sub New(ByRef ExchangeOptions As EditorExchangeOptions)
+            InitializeComponent()
+            MyExchangeOptions = ExchangeOptions
+            MyDefs = New DefaultFormProps
+        End Sub
+        Private Sub OptionsForm_Load(sender As Object, e As EventArgs) Handles Me.Load
+            With MyDefs
+                .MyViewInitialize(Me, Settings.Design, True)
+                .AddOkCancelToolbar()
+                .DelegateClosingChecker()
+                .AppendDetectors()
+                With MyExchangeOptions
+                    CH_GET_STORIES.Checked = .GetStories
+                    CH_GET_TAGGED.Checked = .GetTagged
+                End With
+                .EndLoaderOperations()
+            End With
+        End Sub
+        Private Sub ToolbarBttOK() Implements IOkCancelToolbar.ToolbarBttOK
+            With MyExchangeOptions
+                .GetStories = CH_GET_STORIES.Checked
+                .GetTagged = CH_GET_TAGGED.Checked
+            End With
+            MyDefs.CloseForm()
+        End Sub
+        Private Sub ToolbarBttCancel() Implements IOkCancelToolbar.ToolbarBttCancel
+            MyDefs.CloseForm(DialogResult.Cancel)
+        End Sub
+    End Class
+End Namespace

SCrawler/API/Instagram/SiteSettings.vb

@@ -0,0 +1,314 @@
+' Copyright (C) 2022  Andy
+' This program is free software: you can redistribute it and/or modify
+' it under the terms of the GNU General Public License as published by
+' the Free Software Foundation, either version 3 of the License, or
+' (at your option) any later version.
+'
+' This program is distributed in the hope that it will be useful,
+' but WITHOUT ANY WARRANTY
+Imports SCrawler.API.Base
+Imports SCrawler.Plugin
+Imports SCrawler.Plugin.Attributes
+Imports PersonalUtilities.Tools
+Imports PersonalUtilities.Functions.XML
+Imports PersonalUtilities.Functions.XML.Base
+Imports PersonalUtilities.Functions.RegularExpressions
+Imports Download = SCrawler.Plugin.ISiteSettings.Download
+Namespace API.Instagram
+    <Manifest("AndyProgram_Instagram"), UseClassAsIs, SeparatedTasks(1), SavedPosts, SpecialForm(False)>
+    Friend Class SiteSettings : Inherits SiteSettingsBase
+#Region "Interface Declarations"
+        Friend Overrides ReadOnly Property Icon As Icon
+            Get
+                Return My.Resources.InstagramIcon
+            End Get
+        End Property
+        Friend Overrides ReadOnly Property Image As Image
+            Get
+                Return My.Resources.InstagramPic76
+            End Get
+        End Property
+#End Region
+#Region "Providers"
+        Private Class TimersChecker : Implements ICustomProvider
+            Private ReadOnly _LowestValue As Integer
+            Friend Sub New(ByVal LowestValue As Integer)
+                _LowestValue = LowestValue
+            End Sub
+            Private Function Convert(ByVal Value As Object, ByVal DestinationType As Type, ByVal Provider As IFormatProvider,
+                                     Optional ByVal NothingArg As Object = Nothing, Optional ByVal e As ErrorsDescriber = Nothing) As Object Implements ICustomProvider.Convert
+                If ACheck(Of Integer)(Value) AndAlso CInt(Value) >= _LowestValue Then
+                    Return Value
+                Else
+                    Return Nothing
+                End If
+            End Function
+            Private Function GetFormat(ByVal FormatType As Type) As Object Implements IFormatProvider.GetFormat
+                Throw New NotImplementedException()
+            End Function
+        End Class
+#End Region
+#Region "Authorization properties"
+        <PropertyOption(ControlText:="Hash", ControlToolTip:="Instagram session hash", IsAuth:=True), PXML("InstaHash"), ControlNumber(0)>
+        Friend ReadOnly Property Hash As PropertyValue
+        <PropertyOption(ControlText:="Hash 2", ControlToolTip:="Instagram session hash for saved posts", IsAuth:=True), PXML("InstaHashSavedPosts"), ControlNumber(1)>
+        Friend ReadOnly Property HashSavedPosts As PropertyValue
+        <PropertyOption(ControlText:="x-ig-app-id", IsAuth:=True), ControlNumber(2)>
+        Friend Property IG_APP_ID As PropertyValue
+        <PropertyOption(ControlText:="x-ig-www-claim", IsAuth:=True), ControlNumber(3)>
+        Friend Property IG_WWW_CLAIM As PropertyValue
+        <PropertyOption(ControlText:="Saved posts user", IsAuth:=True), PXML("SavedPostsUserName"), ControlNumber(4)>
+        Friend ReadOnly Property SavedPostsUserName As PropertyValue
+        Friend ReadOnly Property StoriesAndTaggedReady As Boolean
+            Get
+                Return ACheck(IG_APP_ID.Value) And ACheck(IG_WWW_CLAIM.Value)
+            End Get
+        End Property
+#End Region
+#Region "Download properties"
+        Friend ReadOnly Property HashUpdateRequired As XMLValue(Of Boolean)
+        <PropertyOption(ControlText:="Request timer", AllowNull:=False), PXML("RequestsWaitTimer"), ControlNumber(5)>
+        Friend ReadOnly Property RequestsWaitTimer As PropertyValue
+        <Provider(NameOf(RequestsWaitTimer), FieldsChecker:=True)>
+        Private ReadOnly Property RequestsWaitTimerProvider As IFormatProvider
+        <PropertyOption(ControlText:="Request timer counter", AllowNull:=False), PXML("RequestsWaitTimerTaskCount"), ControlNumber(6)>
+        Friend ReadOnly Property RequestsWaitTimerTaskCount As PropertyValue
+        <Provider(NameOf(RequestsWaitTimerTaskCount), FieldsChecker:=True)>
+        Private ReadOnly Property RequestsWaitTimerTaskCountProvider As IFormatProvider
+        <PropertyOption(ControlText:="Posts limit timer", AllowNull:=False), PXML("SleepTimerOnPostsLimit"), ControlNumber(7)>
+        Friend ReadOnly Property SleepTimerOnPostsLimit As PropertyValue
+        <Provider(NameOf(SleepTimerOnPostsLimit), FieldsChecker:=True)>
+        Private ReadOnly Property SleepTimerOnPostsLimitProvider As IFormatProvider
+        <PropertyOption(ControlText:="Get stories"), PXML, ControlNumber(8)>
+        Friend ReadOnly Property GetStories As PropertyValue
+        <PropertyOption(ControlText:="Get tagged photos"), PXML, ControlNumber(9)>
+        Friend ReadOnly Property GetTagged As PropertyValue
+#End Region
+#Region "429 bypass"
+        Friend ReadOnly Property DownloadingErrorDate As XMLValue(Of Date)
+        Friend Property LastApplyingValue As Integer? = Nothing
+        Friend ReadOnly Property ReadyForDownload As Boolean
+            Get
+                With DownloadingErrorDate
+                    If .ValueF.Exists Then
+                        Return .ValueF.Value.AddMinutes(If(LastApplyingValue, 10)) < Now
+                    Else
+                        Return True
+                    End If
+                End With
+            End Get
+        End Property
+        Friend ReadOnly Property LastDownloadDate As XMLValue(Of Date)
+        Friend ReadOnly Property LastRequestsCount As XMLValue(Of Integer)
+        Private TooManyRequestsReadyForCatch As Boolean = True
+        Friend Function GetWaitDate() As Date
+            With DownloadingErrorDate
+                If .ValueF.Exists Then
+                    Return .ValueF.Value.AddMinutes(If(LastApplyingValue, 10))
+                Else
+                    Return Now
+                End If
+            End With
+        End Function
+        Friend Sub TooManyRequests(ByVal Catched As Boolean)
+            With DownloadingErrorDate
+                If Catched Then
+                    If Not .ValueF.Exists Then
+                        .Value = Now
+                        If TooManyRequestsReadyForCatch Then
+                            LastApplyingValue = If(LastApplyingValue, 0) + 10
+                            TooManyRequestsReadyForCatch = False
+                            MyMainLOG = $"Instagram downloading error: too many requests. Try again after {If(LastApplyingValue, 10)} minutes..."
+                        End If
+                    End If
+                Else
+                    .ValueF = Nothing
+                    LastApplyingValue = Nothing
+                    TooManyRequestsReadyForCatch = True
+                End If
+            End With
+        End Sub
+#End Region
+        Friend Overrides ReadOnly Property Responser As WEB.Response
+        Friend Sub New(ByRef _XML As XmlFile, ByVal GlobalPath As SFile)
+            MyBase.New(InstagramSite)
+            Responser = New WEB.Response($"{SettingsFolderName}\Responser_{Site}.xml")
+
+            Dim app_id$ = String.Empty
+            Dim www_claim$ = String.Empty
+
+            With Responser
+                If .File.Exists Then
+                    .LoadSettings()
+                    With .Headers
+                        If .ContainsKey(Header_IG_APP_ID) Then app_id = .Item(Header_IG_APP_ID)
+                        If .ContainsKey(Header_IG_WWW_CLAIM) Then www_claim = .Item(Header_IG_WWW_CLAIM)
+                    End With
+                Else
+                    .CookiesDomain = "instagram.com"
+                    .SaveSettings()
+                End If
+            End With
+
+            Dim n() As String = {SettingsCLS.Name_Node_Sites, Site.ToString}
+
+            SavedPostsUserName = New PropertyValue(String.Empty, GetType(String))
+
+            HashUpdateRequired = New XMLValue(Of Boolean)("InstaHashUpdateRequired", True, _XML, n)
+            Hash = New PropertyValue(String.Empty, GetType(String))
+            HashSavedPosts = New PropertyValue(String.Empty, GetType(String))
+            IG_APP_ID = New PropertyValue(app_id, GetType(String), Sub(v) ChangeResponserFields(NameOf(IG_APP_ID), v))
+            IG_WWW_CLAIM = New PropertyValue(www_claim, GetType(String), Sub(v) ChangeResponserFields(NameOf(IG_WWW_CLAIM), v))
+
+            RequestsWaitTimer = New PropertyValue(1000)
+            RequestsWaitTimerProvider = New TimersChecker(100)
+            RequestsWaitTimerTaskCount = New PropertyValue(1)
+            RequestsWaitTimerTaskCountProvider = New TimersChecker(1)
+            SleepTimerOnPostsLimit = New PropertyValue(6000)
+            SleepTimerOnPostsLimitProvider = New TimersChecker(10000)
+
+            GetStories = New PropertyValue(False)
+            GetTagged = New PropertyValue(False)
+
+            DownloadingErrorDate = New XMLValue(Of Date) With {
+                .Provider = New XMLValueConversionProvider(Function(ss, vv) AConvert(Of String)(vv, AModes.Var, Nothing))}
+            DownloadingErrorDate.SetExtended("InstagramDownloadingErrorDate", Now.AddYears(-10), _XML, n)
+            LastDownloadDate = New XMLValue(Of Date)("LastDownloadDate", Now.AddDays(-1), _XML, n)
+            LastRequestsCount = New XMLValue(Of Integer)("LastRequestsCount", 0, _XML, n)
+
+            UrlPatternUser = "https://www.instagram.com/{0}/"
+            UserRegex = RParams.DMS("[htps:/]{7,8}.*?instagram.com/([^/]+)", 1)
+            ImageVideoContains = "instagram.com"
+        End Sub
+        Friend Overrides Function GetInstance(ByVal What As Download) As IPluginContentProvider
+            Select Case What
+                Case Download.Main : Return New UserData
+                Case Download.SavedPosts
+                    Dim u As New UserData
+                    DirectCast(u, UserDataBase).User = New UserInfo With {.Name = CStr(AConvert(Of String)(SavedPostsUserName.Value, String.Empty))}
+                    Return u
+            End Select
+            Return Nothing
+        End Function
+        Private Const Header_IG_APP_ID As String = "x-ig-app-id"
+        Private Const Header_IG_WWW_CLAIM As String = "x-ig-www-claim"
+        Private Sub ChangeResponserFields(ByVal PropName As String, ByVal Value As Object)
+            If Not PropName.IsEmptyString Then
+                Dim f$ = String.Empty
+                Select Case PropName
+                    Case NameOf(IG_APP_ID) : f = Header_IG_APP_ID
+                    Case NameOf(IG_WWW_CLAIM) : f = Header_IG_WWW_CLAIM
+                End Select
+                If Not f.IsEmptyString Then
+                    If Responser.Headers.Count > 0 AndAlso Responser.Headers.ContainsKey(f) Then Responser.Headers.Remove(f)
+                    If Not CStr(Value).IsEmptyString Then Responser.Headers.Add(f, CStr(Value))
+                    Responser.SaveSettings()
+                End If
+            End If
+        End Sub
+        <PropertiesDataChecker({NameOf(Hash), NameOf(HashSavedPosts)})>
+        Private Function CheckHashControls(ByVal p As IEnumerable(Of PropertyData)) As Boolean
+            If p.ListExists(2) Then
+                Dim h$ = String.Empty
+                Dim hsp$ = String.Empty
+                For Each pp As PropertyData In p
+                    Select Case pp.Name
+                        Case NameOf(Hash) : h = AConvert(Of String)(pp.Value, String.Empty)
+                        Case NameOf(HashSavedPosts) : hsp = AConvert(Of String)(pp.Value, String.Empty)
+                    End Select
+                Next
+                If h.IsEmptyString And hsp.IsEmptyString Then
+                    Return True
+                Else
+                    If h = hsp Then
+                        MsgBoxE({"InstaHash for saved posts must be different from InstaHash!", "InstaHash are equal"}, vbCritical)
+                        Return False
+                    Else
+                        Return True
+                    End If
+                End If
+            Else
+                Return False
+            End If
+        End Function
+        Friend Overrides Sub BeginInit()
+        End Sub
+        Friend Overrides Sub EndInit()
+            If (CStr(Hash.Value).IsEmptyString Or HashUpdateRequired) AndAlso Responser.Cookies.ListExists Then GatherInstaHash()
+        End Sub
+        Friend Overrides Function ReadyToDownload(ByVal What As Download) As Boolean
+            Return ActiveJobs < 2 AndAlso ReadyForDownload
+        End Function
+#Region "Downloading"
+        Private ActiveJobs As Integer = 0
+        Private _NextWNM As UserData.WNM = UserData.WNM.Notify
+        Friend Overrides Sub DownloadStarted(ByVal What As Download)
+            If CStr(Hash.Value).IsEmptyString Or HashUpdateRequired Then GatherInstaHash()
+            ActiveJobs += 1
+        End Sub
+        Friend Overrides Sub BeforeStartDownload(ByVal User As Object, ByVal What As Download)
+            With DirectCast(User, UserData)
+                If What = Download.Main Then .WaitNotificationMode = _NextWNM
+                If LastDownloadDate.Value.AddMinutes(60) > Now Then
+                    .RequestsCount = LastRequestsCount
+                Else
+                    LastRequestsCount.Value = 0
+                    .RequestsCount = 0
+                End If
+            End With
+        End Sub
+        Friend Overrides Sub AfterDownload(ByVal User As Object, ByVal What As Download)
+            With DirectCast(User, UserData)
+                _NextWNM = .WaitNotificationMode
+                If _NextWNM = UserData.WNM.SkipTemp Or _NextWNM = UserData.WNM.SkipCurrent Then _NextWNM = UserData.WNM.Notify
+                LastRequestsCount.Value = .RequestsCount
+            End With
+        End Sub
+        Friend Overrides Sub DownloadDone(ByVal What As Download)
+            _NextWNM = UserData.WNM.Notify
+            LastDownloadDate.Value = Now
+            ActiveJobs -= 1
+            If HashUpdateRequired Then MyMainLOG = "Check your Instagram credentials"
+        End Sub
+#End Region
+        <PropertyUpdater(NameOf(Hash))>
+        Friend Function GatherInstaHash() As Boolean
+            Try
+                If Not Responser.Cookies.ListExists Then Throw New Exception("Instagram cookies does not set")
+                Dim rs As New RParams("=""([^""]+?ConsumerLibCommons[^""]+?.js)""", Nothing, 1) With {.MatchTimeOut = 10}
+                Dim r$ = Responser.GetResponse("https://instagram.com",, EDP.ThrowException)
+                If Not r.IsEmptyString Then
+                    Dim hStr$ = RegexReplace(r, rs)
+                    If Not hStr.IsEmptyString Then
+                        Do While Left(hStr, 1) = "/" : hStr = Right(hStr, hStr.Length - 1) : Loop
+                        hStr = $"https://instagram.com/{hStr}"
+                        r = Responser.GetResponse(hStr,, EDP.ThrowException)
+                        If Not r.IsEmptyString Then
+                            rs = New RParams("generatePaginationActionCreators.+?.profilePosts.byUserId.get.+?queryId:.([\d\w\S]+?)""", Nothing, 1) With {.MatchTimeOut = 10}
+                            Dim h$ = RegexReplace(r, rs)
+                            If Not h.IsEmptyString Then
+                                Hash.Value = h
+                                HashUpdateRequired.Value = False
+                                Return True
+                            End If
+                        End If
+                    End If
+                End If
+                Return False
+            Catch ex As Exception
+                HashUpdateRequired.Value = True
+                Hash.Value = String.Empty
+                Return ErrorsDescriber.Execute(EDP.SendInLog + EDP.ReturnValue, ex, "[SiteSettings.GaterInstaHash]", False)
+            End Try
+        End Function
+        Friend Overrides Function GetSpecialDataF(ByVal URL As String) As IEnumerable(Of UserMedia)
+            Return UserData.GetVideoInfo(URL, Responser)
+        End Function
+        Friend Overrides Sub UserOptions(ByRef Options As Object, ByVal OpenForm As Boolean)
+            If Options Is Nothing OrElse Not TypeOf Options Is EditorExchangeOptions Then Options = New EditorExchangeOptions(Me)
+            If OpenForm Then
+                Using f As New OptionsForm(Options) : f.ShowDialog() : End Using
+            End If
+        End Sub
+    End Class
+End Namespace

SCrawler/API/Instagram/UserData.vb

@@ -0,0 +1,587 @@
+' Copyright (C) 2022  Andy
+' This program is free software: you can redistribute it and/or modify
+' it under the terms of the GNU General Public License as published by
+' the Free Software Foundation, either version 3 of the License, or
+' (at your option) any later version.
+'
+' This program is distributed in the hope that it will be useful,
+' but WITHOUT ANY WARRANTY
+Imports PersonalUtilities.Functions.XML
+Imports PersonalUtilities.Functions.Messaging
+Imports PersonalUtilities.Functions.RegularExpressions
+Imports PersonalUtilities.Tools.WEB
+Imports PersonalUtilities.Tools.WebDocuments.JSON
+Imports SCrawler.API.Base
+Imports System.Threading
+Imports System.Net
+Imports UTypes = SCrawler.API.Base.UserMedia.Types
+Namespace API.Instagram
+    Friend Class UserData : Inherits UserDataBase
+        Private Const MaxPostsCount As Integer = 200
+        Private Const Name_LastCursor As String = "LastCursor"
+        Private Const Name_FirstLoadingDone As String = "FirstLoadingDone"
+        Private Const Name_GetStories As String = "GetStories"
+        Private Const Name_GetTagged As String = "GetTaggedData"
+        Private Const Name_TaggedChecked As String = "TaggedChecked"
+        Private ReadOnly Property MySiteSettings As SiteSettings
+            Get
+                Return DirectCast(HOST.Source, SiteSettings)
+            End Get
+        End Property
+        Private ReadOnly _SavedPostsIDs As New List(Of String)
+        Private LastCursor As String = String.Empty
+        Private FirstLoadingDone As Boolean = False
+        Friend Property GetStories As Boolean
+        Friend Property GetTaggedData As Boolean
+        Friend Overrides Function ExchangeOptionsGet() As Object
+            Return New EditorExchangeOptions(HOST.Source) With {.GetStories = GetStories, .GetTagged = GetTaggedData}
+        End Function
+        Friend Overrides Sub ExchangeOptionsSet(ByVal Obj As Object)
+            If Not Obj Is Nothing AndAlso TypeOf Obj Is EditorExchangeOptions Then
+                With DirectCast(Obj, EditorExchangeOptions)
+                    GetStories = .GetStories
+                    GetTaggedData = .GetTagged
+                End With
+            End If
+        End Sub
+        Friend Sub New()
+        End Sub
+        Protected Overrides Sub LoadUserInformation_OptionalFields(ByRef Container As XmlFile, ByVal Loading As Boolean)
+            If Loading Then
+                LastCursor = Container.Value(Name_LastCursor)
+                FirstLoadingDone = Container.Value(Name_FirstLoadingDone).FromXML(Of Boolean)(False)
+                GetStories = Container.Value(Name_GetStories).FromXML(Of Boolean)(CBool(MySiteSettings.GetStories.Value))
+                GetTaggedData = Container.Value(Name_GetTagged).FromXML(Of Boolean)(CBool(MySiteSettings.GetTagged.Value))
+                TaggedChecked = Container.Value(Name_TaggedChecked).FromXML(Of Boolean)(False)
+            Else
+                Container.Add(Name_LastCursor, LastCursor)
+                Container.Add(Name_FirstLoadingDone, FirstLoadingDone.BoolToInteger)
+                Container.Add(Name_GetStories, GetStories.BoolToInteger)
+                Container.Add(Name_GetTagged, GetTaggedData.BoolToInteger)
+                Container.Add(Name_TaggedChecked, TaggedChecked.BoolToInteger)
+            End If
+        End Sub
+#Region "Download data"
+        Protected Overrides Sub DownloadDataF(ByVal Token As CancellationToken)
+            Try
+                _InstaHash = String.Empty
+                HasError = False
+                If Not LastCursor.IsEmptyString Then
+                    DownloadData(LastCursor, Sections.Timeline, Token)
+                    ThrowAny(Token)
+                    If Not HasError Then FirstLoadingDone = True
+                End If
+                If Not HasError Then
+                    DownloadData(String.Empty, Sections.Timeline, Token)
+                    ThrowAny(Token)
+                    If Not HasError Then FirstLoadingDone = True
+                End If
+                If FirstLoadingDone Then LastCursor = String.Empty
+                If IsSavedPosts Then
+                    DownloadPosts(Token)
+                ElseIf MySiteSettings.StoriesAndTaggedReady Then
+                    If GetStories Then DownloadData(String.Empty, Sections.Stories, Token)
+                    If GetTaggedData Then DownloadData(String.Empty, Sections.Tagged, Token)
+                End If
+                If WaitNotificationMode = WNM.SkipTemp Or WaitNotificationMode = WNM.SkipCurrent Then WaitNotificationMode = WNM.Notify
+            Catch eex As ExitException
+            Catch ex As Exception
+                ProcessException(ex, Token, "[API.Instagram.UserData.DownloadDataF", False)
+            End Try
+        End Sub
+        Private _InstaHash As String = String.Empty
+        Friend Enum Sections
+            Timeline
+            Tagged
+            Stories
+        End Enum
+#Region "429 bypass"
+        Friend Property RequestsCount As Integer = 0
+        Friend Enum WNM As Integer
+            Notify = 0
+            SkipCurrent = 1
+            SkipAll = 2
+            SkipTemp = 3
+        End Enum
+        Friend WaitNotificationMode As WNM = WNM.Notify
+        Private Caught429 As Boolean = False
+        Private ProgressTempSet As Boolean = False
+        Private Const InstAborted As String = "InstAborted"
+        Private Function Ready() As Boolean
+            With MySiteSettings
+                If Not .ReadyForDownload Then
+                    If WaitNotificationMode = WNM.Notify Then
+                        Dim m As New MMessage("Instagram [too many requests] error." & vbCr &
+                                              $"The program suggests waiting {If(.LastApplyingValue, 0)} minutes." & vbCr &
+                                              "What do you want to do?", "Waiting for Instagram download...",
+                                              {
+                                               New MsgBoxButton("Wait") With {.ToolTip = "Wait and ask again when the error is found."},
+                                               New MsgBoxButton("Wait (disable current") With {.ToolTip = "Wait and skip future prompts while downloading the current profile."},
+                                               New MsgBoxButton("Abort") With {.ToolTip = "Abort operation"},
+                                               New MsgBoxButton("Wait (disable all)") With {.ToolTip = "Wait and skip future prompts while downloading the current session."}
+                                              },
+                                              vbExclamation) With {.ButtonsPerRow = 2, .DefaultButton = 0, .CancelButton = 2}
+                        Select Case MsgBoxE(m).Index
+                            Case 1 : WaitNotificationMode = WNM.SkipCurrent
+                            Case 2 : Throw New OperationCanceledException("Instagram download operation aborted") With {.HelpLink = InstAborted}
+                            Case 3 : WaitNotificationMode = WNM.SkipAll
+                            Case Else : WaitNotificationMode = WNM.SkipTemp
+                        End Select
+                    End If
+                    If Not ProgressTempSet Then Progress.InformationTemporary = $"Waiting until { .GetWaitDate().ToString(ParsersDataDateProvider)}"
+                    ProgressTempSet = True
+                    Return False
+                Else
+                    Return True
+                End If
+            End With
+        End Function
+        Private Sub ReconfigureAwaiter()
+            If WaitNotificationMode = WNM.SkipTemp Then WaitNotificationMode = WNM.Notify
+            If Caught429 Then Caught429 = False ': RequestsCount = 0
+            ProgressTempSet = False
+        End Sub
+        Private Sub NextRequest(ByVal StartWait As Boolean)
+            With MySiteSettings
+                If StartWait And RequestsCount > 0 And (RequestsCount Mod .RequestsWaitTimerTaskCount.Value) = 0 Then Thread.Sleep(CInt(.RequestsWaitTimer.Value))
+                If RequestsCount >= MaxPostsCount - 5 Then Thread.Sleep(CInt(.SleepTimerOnPostsLimit.Value))
+            End With
+        End Sub
+#End Region
+        Private Const StoriesFolder As String = "Stories"
+        Private Const TaggedFolder As String = "Tagged"
+        Private TaggedChecked As Boolean = False
+        Private Overloads Sub DownloadData(ByVal Cursor As String, ByVal Section As Sections, ByVal Token As CancellationToken)
+            Dim URL$ = String.Empty
+            Dim StoriesList As List(Of String) = Nothing
+            Dim StoriesRequested As Boolean = False
+            Dim _DownloadComplete As Boolean = False
+            LastCursor = Cursor
+            Try
+                Do While Not _DownloadComplete
+                    ThrowAny(Token)
+                    If Not Ready() Then Thread.Sleep(10000) : ThrowAny(Token) : Continue Do
+                    ReconfigureAwaiter()
+
+                    Try
+                        Dim n As EContainer, nn As EContainer, node As EContainer
+                        Dim HasNextPage As Boolean = False
+                        Dim EndCursor$ = String.Empty
+                        Dim PostID$ = String.Empty, PostDate$ = String.Empty, SpecFolder$ = String.Empty
+                        Dim TaggedCount%
+                        Dim ENode() As Object = Nothing
+                        NextRequest(True)
+
+                        'Check environment
+                        If Cursor.IsEmptyString And _InstaHash.IsEmptyString Then _
+                            _InstaHash = CStr(If(IsSavedPosts, MySiteSettings.HashSavedPosts, MySiteSettings.Hash).Value)
+                        AuthNullException.ThrowIfNull(Section, IsSavedPosts, MySiteSettings)
+                        If ID.IsEmptyString Then GetUserId()
+                        If ID.IsEmptyString Then Throw New ArgumentException("User ID is not detected", "ID")
+
+                        'Create query
+                        Select Case Section
+                            Case Sections.Timeline
+                                Dim vars$ = "{""id"":" & ID & ",""first"":50,""after"":""" & Cursor & """}"
+                                vars = SymbolsConverter.ASCII.EncodeSymbolsOnly(vars)
+                                URL = $"https://www.instagram.com/graphql/query/?query_hash={_InstaHash}&variables={vars}"
+                                ENode = {"data", "user", 0}
+                            Case Sections.Tagged
+                                URL = $"https://i.instagram.com/api/v1/usertags/{ID}/feed/?count=50&max_id={Cursor}"
+                                ENode = {"items"}
+                                SpecFolder = TaggedFolder
+                            Case Sections.Stories
+                                If Not StoriesRequested Then
+                                    StoriesList = GetStoriesList()
+                                    MySiteSettings.TooManyRequests(False)
+                                    RequestsCount += 1
+                                    ThrowAny(Token)
+                                End If
+                                If StoriesList.ListExists Then
+                                    GetStoriesData(StoriesList, Token)
+                                    MySiteSettings.TooManyRequests(False)
+                                    RequestsCount += 1
+                                End If
+                                If StoriesList.ListExists Then
+                                    Continue Do
+                                Else
+                                    Throw New ExitException(_DownloadComplete)
+                                End If
+                        End Select
+
+                        'Get response
+                        Dim r$ = Responser.GetResponse(URL,, EDP.ThrowException)
+                        MySiteSettings.TooManyRequests(False)
+                        RequestsCount += 1
+                        ThrowAny(Token)
+
+                        'Data
+                        If Not r.IsEmptyString Then
+                            Using j As EContainer = JsonDocument.Parse(r).XmlIfNothing
+                                n = j.ItemF(ENode).XmlIfNothing
+                                If n.Count > 0 Then
+                                    Select Case Section
+                                        Case Sections.Timeline
+                                            If n.Contains("page_info") Then
+                                                With n("page_info")
+                                                    HasNextPage = .Value("has_next_page").FromXML(Of Boolean)(False)
+                                                    EndCursor = .Value("end_cursor")
+                                                End With
+                                            End If
+                                            n = n("edges").XmlIfNothing
+                                            If n.Count > 0 Then
+                                                For Each nn In n
+                                                    ThrowAny(Token)
+                                                    node = nn(0).XmlIfNothing
+                                                    If IsSavedPosts Then
+                                                        PostID = node.Value("shortcode")
+                                                        If Not PostID.IsEmptyString Then
+                                                            If _TempPostsList.Contains(PostID) Then Throw New ExitException(_DownloadComplete) Else _SavedPostsIDs.Add(PostID)
+                                                        End If
+                                                    Else
+                                                        PostID = node.Value("id")
+                                                        If Not PostID.IsEmptyString And _TempPostsList.Contains(PostID) Then Throw New ExitException(_DownloadComplete)
+                                                        _TempPostsList.Add(PostID)
+                                                        PostDate = node.Value("taken_at_timestamp")
+                                                        ObtainMedia(node, PostID, PostDate, SpecFolder)
+                                                    End If
+                                                Next
+                                            End If
+                                        Case Sections.Tagged
+                                            HasNextPage = j.Value("more_available").FromXML(Of Boolean)(False)
+                                            EndCursor = j.Value("next_max_id")
+                                            For Each nn In n
+                                                PostID = $"Tagged_{nn.Value("id")}"
+                                                If Not PostID.IsEmptyString And _TempPostsList.Contains(PostID) Then Throw New ExitException(_DownloadComplete)
+                                                _TempPostsList.Add(PostID)
+                                                ObtainMedia2(nn, PostID, SpecFolder)
+                                            Next
+                                            If Not TaggedChecked Then
+                                                TaggedCount = j.Value("total_count").FromXML(Of Integer)(0)
+                                                TaggedChecked = True
+                                                If TaggedChecked > 200 Then
+                                                    Dim a% = MsgBoxE({$"The number of tagged posts is {TaggedCount.NumToString(New ANumbers With {
+                                                                                                       .FormatOptions = ANumbers.Options.GroupIntegral})}" & vbCr &
+                                                                      "The tagged data download operation can take a long time.", "Too much tagged data"}, vbExclamation,,,
+                                                                      {"Continue",
+                                                                       New MsgBoxButton("Disable and cancel") With {
+                                                                        .ToolTip = "Disable downloading tagged data and cancel downloading tagged data."},
+                                                                       "Cancel"})
+                                                    If a > 0 Then
+                                                        If a = 1 Then GetTaggedData = False
+                                                        Throw New ExitException(_DownloadComplete)
+                                                    End If
+                                                End If
+                                            End If
+                                    End Select
+                                Else
+                                    If j.Value("status") = "ok" AndAlso j({"data", "user"}).XmlIfNothing.Count = 0 AndAlso _TempMediaList.Count = 0 Then
+                                        MySiteSettings.HashUpdateRequired.Value = True
+                                        UserExists = False
+                                        Throw New ExitException(_DownloadComplete)
+                                    End If
+                                End If
+                            End Using
+                        Else
+                            Throw New ExitException(_DownloadComplete)
+                        End If
+                        _DownloadComplete = True
+                        If HasNextPage And Not EndCursor.IsEmptyString Then DownloadData(EndCursor, Section, Token)
+                    Catch iane As AuthNullException
+                        ErrorsDescriber.Execute(EDP.SendInLog, iane)
+                        Throw New ExitException(_DownloadComplete)
+                    Catch eex As ExitException
+                        Throw eex
+                    Catch oex As OperationCanceledException When Token.IsCancellationRequested
+                        Exit Do
+                    Catch dex As ObjectDisposedException When Disposed
+                        Exit Do
+                    Catch ex As Exception
+                        If DownloadingException(ex, $"data downloading error [{URL}]") = 1 Then Continue Do Else Exit Do
+                    End Try
+                Loop
+            Catch eex2 As ExitException
+                If (Section = Sections.Timeline Or Section = Sections.Tagged) And Not Cursor.IsEmptyString Then Throw eex2
+            Catch oex2 As OperationCanceledException When Token.IsCancellationRequested Or oex2.HelpLink = InstAborted
+                If oex2.HelpLink = InstAborted Then HasError = True
+            Catch DoEx As Exception
+                ProcessException(DoEx, Token, $"data downloading error [{URL}]")
+            End Try
+        End Sub
+        Private Sub DownloadPosts(ByVal Token As CancellationToken)
+            Dim URL$ = String.Empty
+            Dim _DownloadComplete As Boolean = False
+            Dim _Index% = 0
+            Try
+                Do While Not _DownloadComplete
+                    ThrowAny(Token)
+                    If Not Ready() Then Thread.Sleep(10000) : ThrowAny(Token) : Continue Do
+                    ReconfigureAwaiter()
+
+                    Try
+                        Dim r$
+                        Dim j As EContainer, jj As EContainer
+                        Dim _MediaObtained As Boolean
+                        If _SavedPostsIDs.Count > 0 And _Index <= _SavedPostsIDs.Count - 1 Then
+                            Dim e As New ErrorsDescriber(EDP.ThrowException)
+                            For i% = _Index To _SavedPostsIDs.Count - 1
+                                _Index = i
+                                URL = $"https://instagram.com/p/{_SavedPostsIDs(i)}/?__a=1"
+                                ThrowAny(Token)
+                                NextRequest(((i + 1) Mod 5) = 0)
+                                ThrowAny(Token)
+                                r = Responser.GetResponse(URL,, e)
+                                MySiteSettings.TooManyRequests(False)
+                                RequestsCount += 1
+                                If Not r.IsEmptyString Then
+                                    j = JsonDocument.Parse(r)
+                                    If Not j Is Nothing Then
+                                        _MediaObtained = False
+                                        If j.Contains({"graphql", "shortcode_media"}) Then
+                                            With j({"graphql", "shortcode_media"}).XmlIfNothing
+                                                If .Count > 0 Then ObtainMedia(.Self, _SavedPostsIDs(i), String.Empty, String.Empty) : _MediaObtained = True
+                                            End With
+                                        End If
+                                        If Not _MediaObtained AndAlso j.Contains("items") Then
+                                            With j("items")
+                                                If .Count > 0 Then
+                                                    For Each jj In .Self : ObtainMedia2(jj, _SavedPostsIDs(i)) : Next
+                                                End If
+                                            End With
+                                        End If
+                                        j.Dispose()
+                                    End If
+                                End If
+                            Next
+                        End If
+                        _DownloadComplete = True
+                    Catch oex As OperationCanceledException When Token.IsCancellationRequested
+                        Exit Do
+                    Catch dex As ObjectDisposedException When Disposed
+                        Exit Do
+                    Catch ex As Exception
+                        If DownloadingException(ex, $"downloading saved posts error [{URL}]") = 1 Then Continue Do Else Exit Do
+                    End Try
+                Loop
+            Catch oex2 As OperationCanceledException When Token.IsCancellationRequested Or oex2.HelpLink = InstAborted
+                If oex2.HelpLink = InstAborted Then HasError = True
+            Catch DoEx As Exception
+                ProcessException(DoEx, Token, $"downloading saved posts error [{URL}]")
+            End Try
+        End Sub
+#End Region
+#Region "Obtain Media"
+        Private Sub ObtainMedia(ByVal node As EContainer, ByVal PostID As String, ByVal PostDate As String, ByVal SpecFolder As String)
+            Dim CreateMedia As Action(Of EContainer) =
+                Sub(ByVal e As EContainer)
+                    Dim t As UTypes = If(e.Value("is_video").FromXML(Of Boolean)(False), UTypes.Video, UTypes.Picture)
+                    Dim tmpValue$
+                    If t = UTypes.Picture Then
+                        tmpValue = e.Value("display_url")
+                    Else
+                        tmpValue = e.Value("video_url")
+                    End If
+                    If Not tmpValue.IsEmptyString Then _TempMediaList.ListAddValue(MediaFromData(t, tmpValue, PostID, PostDate, SpecFolder), LNC)
+                End Sub
+            If node.Contains({"edge_sidecar_to_children", "edges"}) Then
+                For Each edge As EContainer In node({"edge_sidecar_to_children", "edges"}) : CreateMedia(edge("node").XmlIfNothing) : Next
+            Else
+                CreateMedia(node)
+            End If
+        End Sub
+        Private Sub ObtainMedia2(ByVal n As EContainer, ByVal PostID As String, Optional ByVal SpecialFolder As String = Nothing)
+            Try
+                Dim img As Predicate(Of EContainer) = Function(_img) Not _img.Name.IsEmptyString AndAlso _img.Name.StartsWith("image_versions") AndAlso _img.Count > 0
+                Dim vid As Predicate(Of EContainer) = Function(_vid) Not _vid.Name.IsEmptyString AndAlso _vid.Name.StartsWith("video_versions") AndAlso _vid.Count > 0
+                Dim ss As Func(Of EContainer, Sizes) = Function(_ss) New Sizes(_ss.Value("width"), _ss.Value("url"))
+                If n.Count > 0 Then
+                    Dim l As New List(Of Sizes)
+                    Dim d As EContainer
+                    Dim t%
+                    '8 - gallery
+                    '2 - one video
+                    '1 - one picture
+                    t = n.Value("media_type").FromXML(Of Integer)(-1)
+                    If t >= 0 Then
+                        Select Case t
+                            Case 1
+                                If n.Contains(img) Then
+                                    t = n.Value("media_type").FromXML(Of Integer)(-1)
+                                    If t >= 0 Then
+                                        With n.ItemF({img, "candidates"}).XmlIfNothing
+                                            If .Count > 0 Then
+                                                l.Clear()
+                                                l.ListAddList(.Select(ss), LNC)
+                                                If l.Count > 0 Then
+                                                    l.Sort()
+                                                    _TempMediaList.ListAddValue(MediaFromData(UTypes.Picture, l.First.Data, PostID, Nothing, SpecialFolder), LNC)
+                                                    l.Clear()
+                                                End If
+                                            End If
+                                        End With
+                                    End If
+                                End If
+                            Case 2
+                                If n.Contains(vid) Then
+                                    With n.ItemF({vid}).XmlIfNothing
+                                        If .Count > 0 Then
+                                            l.Clear()
+                                            l.ListAddList(.Select(ss), LNC)
+                                            If l.Count > 0 Then
+                                                l.Sort()
+                                                _TempMediaList.ListAddValue(MediaFromData(UTypes.Video, l.First.Data, PostID, Nothing, SpecialFolder), LNC)
+                                                l.Clear()
+                                            End If
+                                        End If
+                                    End With
+                                End If
+                            Case 8
+                                With n("carousel_media").XmlIfNothing
+                                    If .Count > 0 Then
+                                        For Each d In .Self : ObtainMedia2(d, PostID, SpecialFolder) : Next
+                                    End If
+                                End With
+                        End Select
+                    End If
+                    l.Clear()
+                End If
+            Catch ex As Exception
+                ErrorsDescriber.Execute(EDP.SendInLog, ex, "API.Instagram.ObtainMedia2")
+            End Try
+        End Sub
+#End Region
+        Private Sub GetUserId()
+            Try
+                Dim r$ = Responser.GetResponse($"https://www.instagram.com/{Name}/?__a=1",, EDP.ThrowException)
+                If Not r.IsEmptyString Then
+                    Using j As EContainer = JsonDocument.Parse(r).XmlIfNothing
+                        ID = j({"graphql", "user"}, "id").XmlIfNothingValue
+                    End Using
+                End If
+            Catch ex As Exception
+                If Responser.StatusCode = HttpStatusCode.NotFound Or Responser.StatusCode = HttpStatusCode.BadRequest Then
+                    Throw ex
+                Else
+                    LogError(ex, "get Instagram user id")
+                End If
+            End Try
+        End Sub
+#Region "Pinned stories"
+        Private Sub GetStoriesData(ByRef StoriesList As List(Of String), ByVal Token As CancellationToken)
+            Const ReqUrl$ = "https://i.instagram.com/api/v1/feed/reels_media/?{0}"
+            Dim tmpList As IEnumerable(Of String)
+            Dim qStr$, r$, sFolder$, storyID$
+            Dim i% = -1
+            Dim jj As EContainer, s As EContainer
+            ThrowAny(Token)
+            If StoriesList.ListExists Then
+                tmpList = StoriesList.Take(5)
+                If tmpList.ListExists Then
+                    qStr = String.Format(ReqUrl, tmpList.Select(Function(q) $"reel_ids=highlight:{q}").ListToString(, "&"))
+                    r = Responser.GetResponse(qStr,, EDP.ThrowException)
+                    ThrowAny(Token)
+                    If Not r.IsEmptyString Then
+                        Using j As EContainer = JsonDocument.Parse(r).XmlIfNothing
+                            If j.Contains("reels") Then
+                                For Each jj In j("reels")
+                                    i += 1
+                                    sFolder = jj.Value("title")
+                                    storyID = jj.Value("id").Replace("highlight:", String.Empty)
+                                    If sFolder.IsEmptyString Then sFolder = $"Story_{storyID}"
+                                    If sFolder.IsEmptyString Then sFolder = $"Story_{i}"
+                                    sFolder = $"{StoriesFolder}\{sFolder}"
+                                    If Not storyID.IsEmptyString Then storyID &= ":"
+                                    With jj("items").XmlIfNothing
+                                        If .Count > 0 Then
+                                            For Each s In .Self : ThrowAny(Token) : ObtainMedia2(s, storyID & s.Value("id"), sFolder) : Next
+                                        End If
+                                    End With
+                                Next
+                            End If
+                        End Using
+                    End If
+                    StoriesList.RemoveRange(0, tmpList.Count)
+                End If
+            End If
+        End Sub
+        Private Function GetStoriesList() As List(Of String)
+            Try
+                Dim r$ = Responser.GetResponse($"https://i.instagram.com/api/v1/highlights/{ID}/highlights_tray/",, EDP.ThrowException)
+                If Not r.IsEmptyString Then
+                    Using j As EContainer = JsonDocument.Parse(r).XmlIfNothing()("tray").XmlIfNothing
+                        If j.Count > 0 Then Return j.Select(Function(jj) jj.Value("id").Replace("highlight:", String.Empty)).ListIfNothing
+                    End Using
+                End If
+                Return Nothing
+            Catch ex As Exception
+                DownloadingException(ex, "API.Instagram.GetStoriesList")
+                Return Nothing
+            End Try
+        End Function
+#End Region
+        Protected Overrides Sub ReparseVideo(ByVal Token As CancellationToken)
+        End Sub
+        Protected Overrides Sub DownloadContent(ByVal Token As CancellationToken)
+            DownloadContentDefault(Token)
+        End Sub
+        ''' <summary>
+        ''' <inheritdoc cref="UserDataBase.DownloadingException(Exception, String)"/><br/>
+        ''' 1 - continue
+        ''' </summary>
+        Protected Overrides Function DownloadingException(ByVal ex As Exception, ByVal Message As String, Optional ByVal FromPE As Boolean = False) As Integer
+            If Responser.StatusCode = HttpStatusCode.NotFound Then
+                UserExists = False
+            ElseIf Responser.StatusCode = HttpStatusCode.BadRequest Then
+                HasError = True
+                MyMainLOG = "Instagram credentials have expired"
+                MySiteSettings.HashUpdateRequired.Value = True
+            ElseIf Responser.StatusCode = 429 Then
+                With MySiteSettings
+                    Dim WaiterExists As Boolean = .LastApplyingValue.HasValue
+                    .TooManyRequests(True)
+                    If Not WaiterExists Then .LastApplyingValue = 2
+                End With
+                Caught429 = True
+                MyMainLOG = $"Number of requests before error 429: {RequestsCount}"
+                Return 1
+            Else
+                MySiteSettings.HashUpdateRequired.Value = True
+                If Not FromPE Then LogError(ex, Message) : HasError = True
+                Return 0
+            End If
+            Return 2
+        End Function
+        Private Shared Function MediaFromData(ByVal t As UTypes, ByVal _URL As String, ByVal PostID As String, ByVal PostDate As String,
+                                              Optional ByVal SpecialFolder As String = Nothing) As UserMedia
+            _URL = LinkFormatterSecure(RegexReplace(_URL.Replace("\", String.Empty), LinkPattern))
+            Dim m As New UserMedia(_URL, t) With {.Post = New UserPost With {.ID = PostID}}
+            If Not m.URL.IsEmptyString Then m.File = CStr(RegexReplace(m.URL, FilesPattern))
+            If Not PostDate.IsEmptyString Then m.Post.Date = AConvert(Of Date)(PostDate, DateProvider, Nothing) Else m.Post.Date = Nothing
+            m.SpecialFolder = SpecialFolder
+            Return m
+        End Function
+        Friend Shared Function GetVideoInfo(ByVal URL As String, ByVal r As Response) As IEnumerable(Of UserMedia)
+            Try
+                If Not URL.IsEmptyString AndAlso URL.Contains("instagram.com") Then
+                    Dim PID$ = RegexReplace(URL, RParams.DMS(".*?instagram.com/p/([_\w\d]+)", 1))
+                    If Not PID.IsEmptyString Then
+                        Using t As New UserData
+                            t.Responser = New Response
+                            t.Responser.Copy(r)
+                            t._SavedPostsIDs.Add(PID)
+                            t.DownloadPosts(Nothing)
+                            Return ListAddList(Nothing, t._TempMediaList)
+                        End Using
+                    End If
+                End If
+                Return Nothing
+            Catch ex As Exception
+                Return ErrorsDescriber.Execute(EDP.ShowMainMsg + EDP.SendInLog, ex, "Instagram standalone downloader: fetch media error")
+            End Try
+        End Function
+        Protected Overrides Sub Dispose(ByVal disposing As Boolean)
+            If Not disposedValue And disposing Then _SavedPostsIDs.Clear()
+            MyBase.Dispose(disposing)
+        End Sub
+    End Class
+End Namespace

SCrawler/API/Reddit/Channel.vb

@@ -1,249 +1,33 @@
-Imports PersonalUtilities.Tools
+' Copyright (C) 2022  Andy
+' This program is free software: you can redistribute it and/or modify
+' it under the terms of the GNU General Public License as published by
+' the Free Software Foundation, either version 3 of the License, or
+' (at your option) any later version.
+'
+' This program is distributed in the hope that it will be useful,
+' but WITHOUT ANY WARRANTY
+Imports PersonalUtilities.Tools
 Imports PersonalUtilities.Forms.Toolbars
 Imports PersonalUtilities.Functions.XML
 Imports SCrawler.API.Base
+Imports SCrawler.Plugin.Hosts
 Imports System.Threading
 Namespace API.Reddit
     Friend Class Channel : Implements ICollection(Of UserPost), IEquatable(Of Channel), IComparable(Of Channel),
-            IRangeSwitcherContainer(Of UserPost), ILoaderSaver, IMyEnumerator(Of UserPost), IChannelLimits, IUserData, IDisposable
+            IRangeSwitcherContainer(Of UserPost), ILoaderSaver, IMyEnumerator(Of UserPost), IChannelLimits, IDisposable
 #Region "XML Nodes' Names"
         Private Const Name_Name As String = "Name"
         Private Const Name_ID As String = "ID"
         Private Const Name_Date As String = "Date"
         Private Const Name_PostsNode As String = "Posts"
+        Private Const Name_UsersAdded As String = "UsersAdded"
+        Private Const Name_UsersExistent As String = "UsersExistent"
+        Private Const Name_PostsDownloaded As String = "PostsDownloaded"
 #End Region
         Friend Const DefaultDownloadLimitCount As Integer = 1000
-#Region "IUserData Support"
+        Friend ReadOnly Property Site As String = RedditSite
-        Private Event OnPictureUpdated(User As IUserData) Implements IUserData.OnPictureUpdated
+        Friend Property Name As String
-        Friend Property Instance As IUserData
+        Friend Property ID As String
-        Private Property IUserData_ParseUserMediaOnly As Boolean = False Implements IUserData.ParseUserMediaOnly
-        Private ReadOnly Property IUserData_IsCollection As Boolean Implements IUserData.IsCollection
-            Get
-                Return Instance.IsCollection
-            End Get
-        End Property
-        Private Property IUserData_CollectionName As String Implements IUserData.CollectionName
-            Get
-                Return Instance.CollectionName
-            End Get
-            Set(ByVal NewName As String)
-                Instance.CollectionName = NewName
-            End Set
-        End Property
-        Private ReadOnly Property IUserData_IncludedInCollection As Boolean Implements IUserData.IncludedInCollection
-            Get
-                Return Instance.IncludedInCollection
-            End Get
-        End Property
-        Private ReadOnly Property IUserData_Labels As List(Of String) Implements IUserData.Labels
-            Get
-                Return Instance.Labels
-            End Get
-        End Property
-        Private ReadOnly Property IUserData_IsChannel As Boolean = True Implements IUserData.IsChannel
-        Private Property IUserData_ReadyForDownload As Boolean Implements IUserData.ReadyForDownload
-            Get
-                Return Instance.ReadyForDownload
-            End Get
-            Set(ByVal IsReady As Boolean)
-                Instance.ReadyForDownload = IsReady
-            End Set
-        End Property
-        Private Property IUserData_File As SFile Implements IUserData.File
-            Get
-                Return Instance.File
-            End Get
-            Set(ByVal NewFile As SFile)
-                Instance.File = NewFile
-            End Set
-        End Property
-        Private Property IUserData_FileExists As Boolean Implements IUserData.FileExists
-            Get
-                Return Instance.FileExists
-            End Get
-            Set(ByVal IsExists As Boolean)
-                Instance.FileExists = IsExists
-            End Set
-        End Property
-        Private Property IUserData_DownloadedPictures As Integer Implements IUserData.DownloadedPictures
-            Get
-                Return Instance.DownloadedPictures
-            End Get
-            Set(ByVal c As Integer)
-                Instance.DownloadedPictures = c
-            End Set
-        End Property
-        Private Property IUserData_DownloadedVideos As Integer Implements IUserData.DownloadedVideos
-            Get
-                Return Instance.DownloadedVideos
-            End Get
-            Set(ByVal c As Integer)
-                Instance.DownloadedVideos = c
-            End Set
-        End Property
-        Private ReadOnly Property IUserData_DownloadedTotal(Optional Total As Boolean = True) As Integer Implements IUserData.DownloadedTotal
-            Get
-                Return Instance.DownloadedTotal
-            End Get
-        End Property
-        Private ReadOnly Property IUserData_DownloadedInformation As String Implements IUserData.DownloadedInformation
-            Get
-                Return Instance.DownloadedInformation
-            End Get
-        End Property
-        Private Property IUserData_HasError As Boolean Implements IUserData.HasError
-            Get
-                Return Instance.HasError
-            End Get
-            Set(ByVal e As Boolean)
-                Instance.HasError = e
-            End Set
-        End Property
-        Private ReadOnly Property IUserData_FitToAddParams As Boolean Implements IUserData.FitToAddParams
-            Get
-                Return Instance.FitToAddParams
-            End Get
-        End Property
-        Private ReadOnly Property IUserData_LVIKey As String Implements IUserData.LVIKey
-            Get
-                Return Instance.LVIKey
-            End Get
-        End Property
-        Private ReadOnly Property IUserData_LVIIndex As Integer Implements IUserData.LVIIndex
-            Get
-                Return Instance.LVIIndex
-            End Get
-        End Property
-        Private Property IUserData_DownloadImages As Boolean Implements IUserData.DownloadImages
-            Get
-                Return Instance.DownloadImages
-            End Get
-            Set(ByVal d As Boolean)
-                Instance.DownloadImages = d
-            End Set
-        End Property
-        Private Property IUserData_DownloadVideos As Boolean Implements IUserData.DownloadVideos
-            Get
-                Return Instance.DownloadVideos
-            End Get
-            Set(ByVal d As Boolean)
-                Instance.DownloadVideos = d
-            End Set
-        End Property
-        Private ReadOnly Property IUserData_Self As IUserData Implements IUserData.Self
-            Get
-                Return Instance
-            End Get
-        End Property
-        Private Property IUserData_DownloadTopCount As Integer? Implements IUserData.DownloadTopCount
-            Get
-                Return Instance.DownloadTopCount
-            End Get
-            Set(ByVal c As Integer?)
-                Instance.DownloadTopCount = c
-            End Set
-        End Property
-        Friend Property Site As Sites = Sites.Reddit Implements IContentProvider.Site
-        Private Property IUserData_FriendlyName As String Implements IContentProvider.FriendlyName
-            Get
-                Return Instance.FriendlyName
-            End Get
-            Set(ByVal NewName As String)
-                Instance.FriendlyName = NewName
-            End Set
-        End Property
-        Private Property IUserData_Description As String Implements IContentProvider.Description
-            Get
-                Return Instance.Description
-            End Get
-            Set(ByVal d As String)
-                Instance.Description = d
-            End Set
-        End Property
-        Private Property IUserData_Favorite As Boolean Implements IContentProvider.Favorite
-            Get
-                Return Instance.Favorite
-            End Get
-            Set(ByVal f As Boolean)
-                Instance.Favorite = f
-            End Set
-        End Property
-        Private Property IUserData_Temporary As Boolean Implements IContentProvider.Temporary
-            Get
-                Return Instance.Temporary
-            End Get
-            Set(ByVal t As Boolean)
-                Instance.Temporary = t
-            End Set
-        End Property
-        Private Sub IUserData_SetPicture(ByVal f As SFile) Implements IUserData.SetPicture
-            Instance.SetPicture(f)
-        End Sub
-        Private Sub IUserData_LoadUserInformation() Implements IUserData.LoadUserInformation
-            Instance.LoadUserInformation()
-        End Sub
-        Private Sub IUserData_UpdateUserInformation() Implements IUserData.UpdateUserInformation
-            Instance.UpdateUserInformation()
-        End Sub
-        Private Sub IUserData_OpenFolder() Implements IUserData.OpenFolder
-            Instance.OpenFolder()
-        End Sub
-        Private Sub IUserData_OpenSite() Implements IContentProvider.OpenSite
-            Instance.OpenSite()
-        End Sub
-        Private Sub IUserData_DownloadData(ByVal Token As CancellationToken) Implements IContentProvider.DownloadData
-            DownloadData(Token, False, Nothing)
-        End Sub
-        Private Function IUserData_GetPicture() As Image Implements IUserData.GetPicture
-            Return Instance.GetPicture()
-        End Function
-        Private Function IUserData_GetLVI(ByVal Destination As ListView) As ListViewItem Implements IUserData.GetLVI
-            Return Instance.GetLVI(Destination)
-        End Function
-        Private Function IUserData_GetLVIGroup(ByVal Destination As ListView) As ListViewGroup Implements IUserData.GetLVIGroup
-            Return Instance.GetLVIGroup(Destination)
-        End Function
-        Private Function IUserData_Delete() As Integer Implements IUserData.Delete
-            Return DirectCast(Instance, UserDataBase).DeleteF(Me)
-        End Function
-        Private Function IUserData_MoveFiles(ByVal CollectionName As String) As Boolean Implements IUserData.MoveFiles
-            Return DirectCast(Instance, UserDataBase).MoveFilesF(Me, CollectionName)
-        End Function
-#End Region
-        Private _Name As String = String.Empty
-        Friend Property Name As String Implements IUserData.Name
-            Get
-                If IsRegularChannel Then
-                    Return Instance.Name
-                Else
-                    Return _Name
-                End If
-            End Get
-            Set(ByVal NewName As String)
-                If IsRegularChannel Then
-                    Instance.Name = NewName
-                Else
-                    _Name = NewName
-                End If
-            End Set
-        End Property
-        Private _ID As String = String.Empty
-        Friend Property ID As String Implements IUserData.ID
-            Get
-                If IsRegularChannel Then
-                    Return Instance.ID
-                Else
-                    Return _ID
-                End If
-            End Get
-            Set(ByVal NewID As String)
-                If IsRegularChannel Then
-                    Instance.ID = NewID
-                Else
-                    _ID = NewID
-                End If
-            End Set
-        End Property
         Friend ReadOnly Property CUser As UserInfo
             Get
                 Return New UserInfo(Me)
@@ -289,6 +73,47 @@ Namespace API.Reddit
             End Get
         End Property
         Private ReadOnly Property Range As RangeSwitcher(Of UserPost)
+#Region "Statistics support"
+        Private ReadOnly CountOfAddedUsers As List(Of Integer)
+        Private ReadOnly CountOfLoadedPostsPerSession As List(Of Integer)
+        Friend ReadOnly Property ChannelExistentUserNames As List(Of String)
+        Private _FirstUserAdded As Boolean = False
+        Friend Sub UserAdded(ByVal UserName As String, Optional ByVal IsAdded As Boolean = True)
+            If Not _FirstUserAdded Then CountOfAddedUsers.Add(0) : _FirstUserAdded = True
+            Dim v% = CountOfAddedUsers.Last
+            v += IIf(IsAdded, 1, -1)
+            If v < 0 Then v = 0
+            CountOfAddedUsers(CountOfAddedUsers.Count - 1) = v
+            If Not ChannelExistentUserNames.Contains(UserName) Then ChannelExistentUserNames.Add(UserName)
+        End Sub
+        Friend Sub UpdateUsersStats()
+            If Posts.Count > 0 Or PostsLatest.Count > 0 Then
+                ChannelExistentUserNames.ListAddList((From p As UserPost In PostsAll
+                                                      Where Not p.UserID.IsEmptyString AndAlso
+                                                            Settings.UsersList.Exists(Function(u) u.Site = Site And u.Name = p.UserID)
+                                                      Select p.UserID), LAP.NotContainsOnly)
+                ChannelExistentUserNames.RemoveAll(Function(u) Not Settings.UsersList.Exists(Function(uu) uu.Site = Site And uu.Name = u))
+            End If
+        End Sub
+        Friend Function GetChannelStats(ByVal Extended As Boolean) As String
+            UpdateUsersStats()
+            Dim s$ = String.Empty
+            Dim p As New ANumbers With {.FormatOptions = ANumbers.Options.GroupIntegral}
+            If Extended Then
+                s.StringAppendLine($"Users added from this channel: {CountOfAddedUsers.Sum.NumToString(p)}")
+                s.StringAppendLine($"Users added from this channel (avg): {CountOfAddedUsers.DefaultIfEmpty(0).Average.RoundDown.NumToString(p)}")
+                s.StringAppendLine($"Users added from this channel (session): {CountOfAddedUsers.LastOrDefault.NumToString(p)}")
+                s.StringAppendLine($"Posts downloaded (avg): {CountOfLoadedPostsPerSession.DefaultIfEmpty(0).Average.RoundUp.NumToString(p)}")
+                s.StringAppendLine($"Posts downloaded (session): {CountOfLoadedPostsPerSession.LastOrDefault.NumToString(p)}")
+                s.StringAppendLine($"My users in this channel: {ChannelExistentUserNames.Count.NumToString(p)}")
+            Else
+                s.StringAppend($"Users: {CountOfAddedUsers.Sum.NumToString(p)} (avg: {CountOfAddedUsers.DefaultIfEmpty(0).Average.RoundDown.NumToString(p)}; s: {CountOfAddedUsers.LastOrDefault.NumToString(p)})")
+                s.StringAppend($"Posts: {CountOfLoadedPostsPerSession.DefaultIfEmpty(0).Average.RoundUp.NumToString(p)} (s: {CountOfLoadedPostsPerSession.LastOrDefault.NumToString(p)})", "; ")
+                s.StringAppend($"My users: {ChannelExistentUserNames.Count.NumToString(p)}", "; ")
+            End If
+            Return s
+        End Function
+#End Region
 #Region "Limits Support"
         Private _DownloadLimitCount As Integer? = Nothing
         Friend Property DownloadLimitCount As Integer? Implements IChannelLimits.DownloadLimitCount
@@ -352,29 +177,23 @@ Namespace API.Reddit
         End Sub
         Friend Property AutoGetLimits As Boolean = True Implements IChannelLimits.AutoGetLimits
 #End Region
-        Friend ReadOnly IsRegularChannel As Boolean = False
+        Friend ReadOnly Property HOST As SettingsHost
         Friend Sub New()
             Posts = New List(Of UserPost)
             PostsLatest = New List(Of UserPost)
             Range = New RangeSwitcher(Of UserPost)(Me)
+            CountOfAddedUsers = New List(Of Integer)
+            CountOfLoadedPostsPerSession = New List(Of Integer)
+            ChannelExistentUserNames = New List(Of String)
+            HOST = Settings(RedditSiteKey)
         End Sub
         Friend Sub New(ByVal f As SFile)
             Me.New
             LoadData(f, False)
         End Sub
-        Friend Sub New(ByVal u As UserInfo, Optional ByVal _LoadUserInformation As Boolean = True)
-            Me.New
-            Instance = New UserData(u, _LoadUserInformation) With {.SaveToCache = False, .SkipExistsUsers = False, .ChannelInfo = Me}
-            AutoGetLimits = True
-            DirectCast(Instance, UserData).SetLimit(Me)
-            IsRegularChannel = True
-        End Sub
         Public Shared Widening Operator CType(ByVal f As SFile) As Channel
             Return New Channel(f)
         End Operator
-        Public Shared Widening Operator CType(ByVal c As Channel) As UserDataBase
-            Return DirectCast(c.Instance, UserDataBase)
-        End Operator
         Public Overrides Function ToString() As String
             If Not Name.IsEmptyString Then
                 Return Name
@@ -383,28 +202,29 @@ Namespace API.Reddit
             End If
         End Function
         Friend Sub Delete()
-            If File.Exists Then File.Delete()
+            File.Delete(, SFODelete.DeleteToRecycleBin)
         End Sub
         Friend Sub DownloadData(ByVal Token As CancellationToken, Optional ByVal SkipExists As Boolean = True,
                                 Optional ByVal p As MyProgress = Nothing)
             Try
                 _Downloading = True
-                If Not Instance Is Nothing Then
+                Using d As New UserData With {
-                    Instance.DownloadData(Token)
+                    .Progress = p,
-                Else
+                    .SaveToCache = True,
-                    Using d As New UserData(CUser, False, False) With {
+                    .SkipExistsUsers = SkipExists,
-                        .Progress = p,
+                    .ChannelInfo = Me
-                        .SaveToCache = True,
+                }
-                        .SkipExistsUsers = SkipExists,
+                    d.SetEnvironment(HOST, CUser, False)
-                        .ChannelInfo = Me
+                    d.RemoveUpdateHandlers()
-                    }
+                    d.SetLimit(Me)
-                        d.SetLimit(Me)
+                    d.DownloadData(Token)
-                        d.DownloadData(Token)
+                    Dim b% = Posts.Count
-                        Posts.ListAddList(d.GetNewChannelPosts(), LAP.NotContainsOnly)
+                    Posts.ListAddList(d.GetNewChannelPosts(), LAP.NotContainsOnly)
-                        Posts.Sort()
+                    If Posts.Count - b > 0 Then CountOfLoadedPostsPerSession.Add(Posts.Count - b)
-                        LatestParsedDate = If(Posts.FirstOrDefault(Function(pp) pp.Date.HasValue).Date, LatestParsedDate)
+                    Posts.Sort()
-                    End Using
+                    LatestParsedDate = If(Posts.FirstOrDefault(Function(pp) pp.Date.HasValue).Date, LatestParsedDate)
-                End If
+                    UpdateUsersStats()
+                End Using
             Catch oex As OperationCanceledException When Token.IsCancellationRequested
             Finally
                 _Downloading = False
@@ -445,21 +265,12 @@ Namespace API.Reddit
         Friend Overloads Function Equals(ByVal Other As Channel) As Boolean Implements IEquatable(Of Channel).Equals
             Return ID = Other.ID
         End Function
-        Private Overloads Function Equals(ByVal Other As UserDataBase) As Boolean Implements IEquatable(Of UserDataBase).Equals
-            If Not Instance Is Nothing Then
-                Return Instance.Equals(Other)
-            Else
-                Return False
-            End If
-        End Function
         Public Overloads Overrides Function Equals(ByVal Obj As Object) As Boolean
             If Not Obj Is Nothing Then
                 If TypeOf Obj Is String Then
                     Return ID = CStr(Obj)
                 ElseIf TypeOf Obj Is Channel Then
                     Return Equals(DirectCast(Obj, Channel))
-                ElseIf TypeOf Obj Is UserDataBase Then
-                    Return Equals(DirectCast(Obj, UserDataBase))
                 End If
             End If
             Return False
@@ -473,22 +284,6 @@ Namespace API.Reddit
                 Return ID.CompareTo(Other.ID)
             End If
         End Function
-        Private Overloads Function CompareTo(ByVal Other As UserDataBase) As Integer Implements IComparable(Of UserDataBase).CompareTo
-            If Not Instance Is Nothing Then
-                Return Instance.CompareTo(Other)
-            Else
-                Return 0
-            End If
-        End Function
-        Private Overloads Function CompareTo(ByVal Obj As Object) As Integer Implements IComparable.CompareTo
-            If TypeOf Obj Is Channel Then
-                Return CompareTo(DirectCast(Obj, Channel))
-            ElseIf TypeOf Obj Is UserDataBase And Not Instance Is Nothing Then
-                Return Instance.CompareTo(Obj)
-            Else
-                Return 0
-            End If
-        End Function
 #End Region
 #Region "ILoaderSaver Support"
         Friend Overloads Function LoadData(Optional ByVal f As SFile = Nothing, Optional ByVal e As ErrorsDescriber = Nothing) As Boolean Implements ILoaderSaver.Load
@@ -496,14 +291,17 @@ Namespace API.Reddit
         End Function
         Friend Overloads Function LoadData(ByVal f As SFile, ByVal PartialLoad As Boolean, Optional ByVal e As ErrorsDescriber = Nothing) As Boolean
             If f.Exists Then
-                Using x As New XmlFile(f, ProtectionLevels.All, False) With {.XmlReadOnly = True, .AllowSameNames = True}
+                Using x As New XmlFile(f, Protector.Modes.All, False) With {.XmlReadOnly = True, .AllowSameNames = True}
                     x.LoadData()
-                    x.DefaultsLoading(False)
                     If x.Count > 0 Then
                         Dim XMLDateProvider As New ADateTime(ADateTime.Formats.BaseDateTime)
+                        Dim lc As New ListAddParams(LAP.ClearBeforeAdd)
                         Name = x.Value(Name_Name)
                         ID = x.Value(Name_ID)
                         LatestParsedDate = AConvert(Of Date)(x.Value(Name_Date), XMLDateProvider, Nothing)
+                        CountOfAddedUsers.ListAddList(x.Value(Name_UsersAdded).StringToList(Of Integer)("|"), lc)
+                        CountOfLoadedPostsPerSession.ListAddList(x.Value(Name_PostsDownloaded).StringToList(Of Integer)("|"), lc)
+                        ChannelExistentUserNames.ListAddList(x.Value(Name_UsersExistent).StringToList(Of String)("|"), LNC)
                         If Not PartialLoad Then
                             With x(Name_PostsNode).XmlIfNothing
                                 If .Count > 0 Then .ForEach(Sub(ee) PostsLatest.Add(New UserPost With {
@@ -518,8 +316,8 @@ Namespace API.Reddit
         End Function
         Friend Overloads Function Save(Optional ByVal f As SFile = Nothing, Optional ByVal e As ErrorsDescriber = Nothing) As Boolean Implements ILoaderSaver.Save
             Dim XMLDateProvider As New ADateTime(ADateTime.Formats.BaseDateTime)
+            UpdateUsersStats()
             Using x As New XmlFile With {.AllowSameNames = True, .Name = "Channel"}
-                x.DefaultsLoading(False)
                 x.Add(Name_Name, Name)
                 x.Add(Name_ID, ID)
                 If Posts.Count > 0 Or PostsLatest.Count > 0 Then
@@ -529,6 +327,9 @@ Namespace API.Reddit
                     LatestParsedDate = tmpPostList.FirstOrDefault(Function(pd) pd.Date.HasValue).Date
                     x.Add(Name_Date, AConvert(Of String)(LatestParsedDate, XMLDateProvider, String.Empty))
                     x.Add(Name_PostsNode, String.Empty)
+                    x.Add(Name_UsersAdded, CountOfAddedUsers.ListToString(, "|"))
+                    x.Add(Name_PostsDownloaded, CountOfLoadedPostsPerSession.ListToString(, "|"))
+                    x.Add(Name_UsersExistent, ChannelExistentUserNames.ListToString(, "|"))
                     With x(Name_PostsNode)
                         tmpPostList.Take(200).ToList.ForEach(Sub(p) .Add(New EContainer("Post",
                                                                                   String.Empty,
@@ -548,19 +349,16 @@ Namespace API.Reddit
 #End Region
 #Region "IDisposable Support"
         Private disposedValue As Boolean = False
-        Friend ReadOnly Property Disposed As Boolean Implements IUserData.Disposed
-            Get
-                Return disposedValue
-            End Get
-        End Property
         Protected Overridable Overloads Sub Dispose(ByVal disposing As Boolean)
             If Not disposedValue Then
                 If disposing Then
                     Posts.Clear()
                     PostsLatest.Clear()
+                    CountOfAddedUsers.Clear()
+                    CountOfLoadedPostsPerSession.Clear()
                     Range.Dispose()
-                    If Not Instance Is Nothing Then Instance.Dispose()
+                    ChannelExistentUserNames.Clear()
-                    If CachePath.Exists(SFO.Path, False) Then CachePath.Delete(SFO.Path, False, False, EDP.SendInLog)
+                    CachePath.Delete(SFO.Path, SFODelete.None, EDP.SendInLog)
                 End If
                 disposedValue = True
             End If

SCrawler/API/Reddit/ChannelsCollection.vb

@@ -1,4 +1,12 @@
-Imports PersonalUtilities.Tools
+' Copyright (C) 2022  Andy
+' This program is free software: you can redistribute it and/or modify
+' it under the terms of the GNU General Public License as published by
+' the Free Software Foundation, either version 3 of the License, or
+' (at your option) any later version.
+'
+' This program is distributed in the hope that it will be useful,
+' but WITHOUT ANY WARRANTY
+Imports PersonalUtilities.Tools
 Imports PersonalUtilities.Forms.Toolbars
 Imports SCrawler.API.Base
 Imports System.Threading
@@ -7,15 +15,39 @@ Namespace API.Reddit
         Friend Shared ReadOnly Property ChannelsPath As SFile = $"{SettingsFolderName}\Channels\"
         Friend Shared ReadOnly Property ChannelsPathCache As SFile = $"{Settings.GlobalPath.Value.PathWithSeparator}_CachedData\"
         Private ReadOnly Channels As List(Of Channel)
+        Friend Structure ChannelImage : Implements IEquatable(Of ChannelImage)
+            Friend File As SFile
+            Friend Channel As String
+            Friend Sub New(ByVal ChannelName As String, ByVal f As SFile)
+                Channel = ChannelName
+                File = f
+            End Sub
+            Friend Overloads Function Equals(ByVal Other As ChannelImage) As Boolean Implements IEquatable(Of ChannelImage).Equals
+                Return Channel = Other.Channel And File.File = Other.File.File
+            End Function
+            Public Overloads Overrides Function Equals(ByVal Obj As Object) As Boolean
+                Return Equals(DirectCast(Obj, ChannelImage))
+            End Function
+        End Structure
         Friend ReadOnly Property Downloading As Boolean
             Get
-                If Count > 0 Then
+                Return Count > 0 AndAlso Channels.Exists(Function(c) c.Downloading)
-                    Return Channels.Exists(Function(c) c.Downloading)
-                Else
-                    Return False
-                End If
             End Get
         End Property
+        Friend Function GetUserFiles(ByVal UserName As String) As IEnumerable(Of ChannelImage)
+            Try
+                If Settings.ChannelsAddUserImagesFromAllChannels.Value And Count > 0 Then
+                    Return Channels.SelectMany(Function(c) From p As UserPost In c.Posts Where p.UserID = UserName Select New ChannelImage(c.Name, p.CachedFile))
+                Else
+                    Return Nothing
+                End If
+            Catch ex As Exception
+                Return ErrorsDescriber.Execute(EDP.SendInLog + EDP.ReturnValue, ex)
+            End Try
+        End Function
+        Friend Sub UpdateUsersStats()
+            If Channels.Count > 0 Then Channels.ForEach(Sub(c) c.UpdateUsersStats())
+        End Sub
 #Region "Limits Support"
         Friend Property DownloadLimitCount As Integer? Implements IChannelLimits.DownloadLimitCount
         <Obsolete("This property cannot be used in collections", True)> Private Property DownloadLimitPost As String Implements IChannelLimits.DownloadLimitPost
@@ -66,7 +98,6 @@ Namespace API.Reddit
                     Next
                 End If
                 Throw New ArgumentException($"Channel ID [{ChannelID}] does not found in channels collection", "ChannelID") With {.HelpLink = 1}
-                'Return Nothing
             End Get
         End Property
         Friend Sub DownloadData(ByVal Token As CancellationToken, Optional ByVal SkipExists As Boolean = True,
@@ -103,7 +134,7 @@ Namespace API.Reddit
             Return Count > 0 AndAlso Channels.Contains(_Item)
         End Function
         Friend Function Remove(ByVal _Item As Channel) As Boolean Implements ICollection(Of Channel).Remove
-            If Count > 0 Then
+            If Count > 0 And Not _Item Is Nothing Then
                 Dim i% = Channels.IndexOf(_Item)
                 If i >= 0 Then
                     With Channels(i) : .Delete() : .Dispose() : End With

SCrawler/API/Reddit/Declarations.vb

@@ -1,32 +1,41 @@
-Imports PersonalUtilities.Functions.XML.Base
+' Copyright (C) 2022  Andy
+' This program is free software: you can redistribute it and/or modify
+' it under the terms of the GNU General Public License as published by
+' the Free Software Foundation, either version 3 of the License, or
+' (at your option) any later version.
+'
+' This program is distributed in the hope that it will be useful,
+' but WITHOUT ANY WARRANTY
+Imports PersonalUtilities.Functions.XML.Base
+Imports PersonalUtilities.Functions.RegularExpressions
 Namespace API.Reddit
     Friend Module Declarations
+        Friend Const RedditSite As String = "Reddit"
+        Friend Const RedditSiteKey As String = "AndyProgram_Reddit"
         Friend ReadOnly JsonNodesJson() As NodeParams = {New NodeParams("posts", True, True, True, True, 3)}
         Friend ReadOnly ChannelJsonNodes() As NodeParams = {New NodeParams("data", True, True, True, True, 1),
                                                             New NodeParams("children", True, True, True)}
-        Friend ReadOnly UrlBasePattern As New RegexStructure("(?<=/)([^/]+?\.[\w]{3,4})(?=(\?|\Z))", True, False)
+        Friend ReadOnly UrlBasePattern As RParams = RParams.DM("(?<=/)([^/]+?\.[\w]{3,4})(?=(\?|\Z))", 0)
-        Friend ReadOnly VideoRegEx As New RegexStructure("http.{0,1}://[^" & Chr(34) & "]+?mp4", True, False)
+        Friend ReadOnly VideoRegEx As RParams = RParams.DM("http.{0,1}://[^" & Chr(34) & "]+?mp4", 0)
         Friend ReadOnly DateProvider As New JsonDate
         Friend ReadOnly DateProviderChannel As New JsonDateChannel
-        Private ReadOnly EUR_PROVIDER As New ANumbers(ANumbers.Modes.EUR)
+        Private ReadOnly EUR_PROVIDER As New ANumbers(ANumbers.Cultures.EUR)
         Friend Class JsonDate : Implements ICustomProvider
-            ''' <inheritdoc cref="ADateTime.ParseUnicodeJS(Object, Object, ErrorsDescriber)"/>
             Friend Function Convert(ByVal Value As Object, ByVal DestinationType As Type, ByVal Provider As IFormatProvider,
                                     Optional ByVal NothingArg As Object = Nothing, Optional ByVal e As ErrorsDescriber = Nothing) As Object Implements ICustomProvider.Convert
                 Return ADateTime.ParseUnicodeJS(Value, NothingArg, e)
             End Function
             Private Function GetFormat(ByVal FormatType As Type) As Object Implements IFormatProvider.GetFormat
-                Throw New NotImplementedException("GetFormat does not available in this context")
+                Throw New NotImplementedException("GetFormat is not available in this context")
             End Function
         End Class
         Friend Class JsonDateChannel : Implements ICustomProvider
-            ''' <inheritdoc cref="ADateTime.ParseUnicodeJS(Object, Object, ErrorsDescriber)"/>
             Friend Function Convert(ByVal Value As Object, ByVal DestinationType As Type, ByVal Provider As IFormatProvider,
                                     Optional ByVal NothingArg As Object = Nothing, Optional ByVal e As ErrorsDescriber = Nothing) As Object Implements ICustomProvider.Convert
                 Return ADateTime.ParseUnicode(AConvert(Of Integer)(Value, EUR_PROVIDER, Value), NothingArg, e)
             End Function
             Private Function GetFormat(ByVal FormatType As Type) As Object Implements IFormatProvider.GetFormat
-                Throw New NotImplementedException("GetFormat does not available in this context")
+                Throw New NotImplementedException("GetFormat is not available in this context")
             End Function
         End Class
     End Module

SCrawler/API/Reddit/M3U8.vb

@@ -1,26 +1,33 @@
-Imports System.Net
+' Copyright (C) 2022  Andy
+' This program is free software: you can redistribute it and/or modify
+' it under the terms of the GNU General Public License as published by
+' the Free Software Foundation, either version 3 of the License, or
+' (at your option) any later version.
+'
+' This program is distributed in the hope that it will be useful,
+' but WITHOUT ANY WARRANTY
+Imports System.Net
 Imports SCrawler.API.Reddit.M3U8_Declarations
 Imports PersonalUtilities.Tools.WEB
-Namespace API.Reddit.M3U8_Declarations
+Imports PersonalUtilities.Functions.RegularExpressions
-    Friend Module M3U8_Declarations
-        Friend ReadOnly BaseUrlPattern As New RegexStructure("([htps:/]{7,8}.+?/.+?)(?=/)", True, False,,,,,, EDP.ReturnValue)
-        Friend ReadOnly PlayListRegEx_1 As New RegexStructure("(#EXT-X-STREAM-INF)(.+)(RESOLUTION=)(\d+)(.+?[\r\n]{1,2})(.+?)([\r\n]{1,2})", True, False,,,
-                                                              RegexReturn.List,, New List(Of String),
-                                                              New ErrorsDescriber(False, False, True, New List(Of String)))
-        Friend ReadOnly PlayListRegEx_2 As New RegexStructure("(?<=#EXT-X-BYTERANGE.+?[\r\n]{1,2})(.+)(?=[\r\n]{0,2})", True, False,,, RegexReturn.List,,
-                                                              New List(Of String),
-                                                              New ErrorsDescriber(False, False, True, New List(Of String)))
-        Friend ReadOnly DPED As New ErrorsDescriber(EDP.SendInLog + EDP.ReturnValue)
-    End Module
-End Namespace
 Namespace API.Reddit
+    Namespace M3U8_Declarations
+        Friend Module M3U8_Declarations
+            Friend ReadOnly BaseUrlPattern As RParams = RParams.DM("([htps:/]{7,8}.+?/.+?)(?=/)", 0, EDP.ReturnValue)
+            Friend ReadOnly PlayListRegEx_1 As RParams = RParams.DM("(#EXT-X-STREAM-INF)(.+)(RESOLUTION=)(\d+)(.+?[\r\n]{1,2})(.+?)([\r\n]{1,2})", 0,
+                                                                    RegexReturn.List, EDP.SendInLog, EDP.ReturnValue)
+            Friend ReadOnly PlayListRegEx_2 As RParams = RParams.DM("(?<=#EXT-X-BYTERANGE.+?[\r\n]{1,2})(.+)(?=[\r\n]{0,2})", 0,
+                                                                    RegexReturn.List, EDP.SendInLog, EDP.ReturnValue)
+            Friend ReadOnly DPED As New ErrorsDescriber(EDP.SendInLog + EDP.ReturnValue)
+        End Module
+    End Namespace
     Friend NotInheritable Class M3U8
         Private Sub New()
         End Sub
         Private Structure Resolution : Implements IRegExCreator, IComparable(Of Resolution)
             Friend File As String
             Friend Resolution As Integer
-            Friend Function CreateFromArray(ByVal ParamsArray() As String) As IRegExCreator Implements IRegExCreator.CreateFromArray
+            Friend Function CreateFromArray(ByVal ParamsArray() As String) As Object Implements IRegExCreator.CreateFromArray
                 If ParamsArray.ArrayExists Then
                     File = ParamsArray(0)
                     If ParamsArray.Length > 1 Then Resolution = AConvert(Of Integer)(ParamsArray(1), 0)
@@ -37,7 +44,7 @@ Namespace API.Reddit
                     Using w As New WebClient
                         Dim r$ = w.DownloadString(PlayListURL)
                         If Not r.IsEmptyString Then
-                            Dim l As List(Of Resolution) = RegexFields(Of Resolution)(r, {PlayListRegEx_1}, {6, 4})
+                            Dim l As List(Of Resolution) = FNF.RegexFields(Of Resolution)(r, {PlayListRegEx_1}, {6, 4})
                             If l.ListExists Then
                                 l.Sort()
                                 Dim pls$ = $"{BaseUrl}/{l.First.File}"
@@ -66,7 +73,7 @@ Namespace API.Reddit
                     ConcatFile.Extension = "mp4"
                     CachePath = $"{f.PathWithSeparator}_Cache\{SFile.GetDirectories($"{f.PathWithSeparator}_Cache\",,, EDP.ReturnValue).ListIfNothing.Count + 1}\"
                     If CachePath.Exists(SFO.Path) Then
-                        Dim p As New SFileNumbers(ConcatFile.Name,,, New ANumbers(ANumbers.Modes.USA) With {.GroupSeparator = String.Empty, .FormatMode = ANumbers.Formats.General})
+                        Dim p As New SFileNumbers(ConcatFile.Name,,, New ANumbers With {.Format = ANumbers.Formats.General})
                         ConcatFile = SFile.Indexed_IndexFile(ConcatFile,, p, EDP.ReturnValue)
                         Dim i%
                         Dim eFiles As New List(Of SFile)
@@ -89,7 +96,7 @@ Namespace API.Reddit
             Catch ex As Exception
                 Return ErrorsDescriber.Execute(DPED, ex, "[M3U8.Save]", New SFile)
             Finally
-                If Not CachePath.IsEmptyString AndAlso CachePath.Exists(SFO.Path, False) Then CachePath.Delete(SFO.Path, False, False, DPED)
+                CachePath.Delete(SFO.Path, SFODelete.None, DPED)
             End Try
         End Function
         Friend Shared Function Download(ByVal URL As String, ByVal f As SFile) As SFile

SCrawler/API/Reddit/SiteSettings.vb

@@ -0,0 +1,97 @@
+' Copyright (C) 2022  Andy
+' This program is free software: you can redistribute it and/or modify
+' it under the terms of the GNU General Public License as published by
+' the Free Software Foundation, either version 3 of the License, or
+' (at your option) any later version.
+'
+' This program is distributed in the hope that it will be useful,
+' but WITHOUT ANY WARRANTY
+Imports SCrawler.API.Base
+Imports SCrawler.Plugin
+Imports SCrawler.Plugin.Attributes
+Imports PersonalUtilities.Tools
+Imports PersonalUtilities.Functions.RegularExpressions
+Imports DownDetector = SCrawler.API.Base.DownDetector
+Imports Download = SCrawler.Plugin.ISiteSettings.Download
+Namespace API.Reddit
+    <Manifest(RedditSiteKey), UseClassAsIs, SavedPosts>
+    Friend Class SiteSettings : Inherits SiteSettingsBase
+        Friend Overrides ReadOnly Property Icon As Icon
+            Get
+                Return My.Resources.RedditIcon
+            End Get
+        End Property
+        Friend Overrides ReadOnly Property Image As Image
+            Get
+                Return My.Resources.RedditPic512
+            End Get
+        End Property
+        <PropertyOption(ControlText:="Saved posts user"), PXML("SavedPostsUserName")>
+        Friend ReadOnly Property SavedPostsUserName As PropertyValue
+        Friend Overrides ReadOnly Property Responser As WEB.Response
+        Friend Sub New()
+            MyBase.New(RedditSite)
+            Responser = New WEB.Response($"{SettingsFolderName}\Responser_{Site}.xml")
+
+            With Responser
+                If .File.Exists Then
+                    .LoadSettings()
+                Else
+                    .CookiesDomain = "reddit.com"
+                    .Decoders.Add(SymbolsConverter.Converters.Unicode)
+                    .SaveSettings()
+                End If
+            End With
+            SavedPostsUserName = New PropertyValue(String.Empty, GetType(String))
+            UrlPatternUser = "https://www.reddit.com/user/{0}/"
+            UrlPatternChannel = "https://www.reddit.com/r/{0}/"
+            ImageVideoContains = "redgifs"
+        End Sub
+        Friend Overrides Function GetInstance(ByVal What As Download) As IPluginContentProvider
+            Select Case What
+                Case Download.Main : Return New UserData
+                Case Download.Channel : Return New UserData With {.SaveToCache = False, .SkipExistsUsers = False, .AutoGetLimits = True}
+                Case Download.SavedPosts
+                    Dim u As New UserData With {.IsSavedPosts = True}
+                    DirectCast(u, UserDataBase).User = New UserInfo With {.Name = CStr(AConvert(Of String)(SavedPostsUserName.Value, String.Empty))}
+                    Return u
+            End Select
+            Return Nothing
+        End Function
+        Private ReadOnly RedditRegEx1 As RParams = RParams.DMS("[htps:/]{7,8}.*?reddit.com/user/([^/]+)", 1)
+        Private ReadOnly RedditRegEx2 As RParams = RParams.DMS(".?u/([^/]+)", 1)
+        Private ReadOnly RedditChannelRegEx1 As RParams = RParams.DMS("[htps:/]{7,8}.*?reddit.com/r/([^/]+)", 1)
+        Private ReadOnly RedditChannelRegEx2 As RParams = RParams.DMS(".?r/([^/]+)", 1)
+        Friend Overrides Function IsMyUser(ByVal UserURL As String) As ExchangeOptions
+            Dim s$
+            Dim c% = 0
+            For Each r As RParams In {RedditRegEx1, RedditRegEx2, RedditChannelRegEx1, RedditChannelRegEx2}
+                s = RegexReplace(UserURL, r)
+                If Not s.IsEmptyString Then Return New ExchangeOptions(Site, s, c > 1)
+                c += 1
+            Next
+            Return Nothing
+        End Function
+        Friend Overrides Function Available(ByVal What As Download) As Boolean
+            Try
+                Dim dl As List(Of DownDetector.Data) = DownDetector.GetData("reddit")
+                If dl.ListExists Then
+                    dl = dl.Take(4).ToList
+                    Dim avg% = dl.Average(Function(d) d.Value)
+                    If avg > 100 Then
+                        Return MsgBoxE({"Over the past hour, Reddit has received an average of " &
+                                        avg.NumToString(New ANumbers With {.FormatOptions = ANumbers.Options.GroupIntegral}) & " outage reports:" & vbCr &
+                                        dl.ListToString(, vbCr) & vbCr & vbCr &
+                                        "Do you want to continue parsing Reddit data?", "There are outage reports on Reddit"}, vbYesNo) = vbYes
+                    End If
+                End If
+                Return True
+            Catch ex As Exception
+                Return ErrorsDescriber.Execute(EDP.SendInLog + EDP.ReturnValue, ex, "[API.Reddit.SiteSettings.Available]", True)
+            End Try
+        End Function
+        Friend Overrides Function GetSpecialDataF(ByVal URL As String) As IEnumerable(Of UserMedia)
+            Return UserData.GetVideoInfo(URL, Responser)
+        End Function
+    End Class
+End Namespace

SCrawler/API/Reddit/UserData.vb

@@ -1,6 +1,15 @@
-Imports PersonalUtilities.Functions.XML
+' Copyright (C) 2022  Andy
-Imports PersonalUtilities.Forms.Toolbars
+' This program is free software: you can redistribute it and/or modify
+' it under the terms of the GNU General Public License as published by
+' the Free Software Foundation, either version 3 of the License, or
+' (at your option) any later version.
+'
+' This program is distributed in the hope that it will be useful,
+' but WITHOUT ANY WARRANTY
+Imports PersonalUtilities.Functions.XML
+Imports PersonalUtilities.Functions.RegularExpressions
 Imports PersonalUtilities.Tools.ImageRenderer
+Imports PersonalUtilities.Tools.WEB
 Imports PersonalUtilities.Tools.WebDocuments.JSON
 Imports System.Net
 Imports System.Threading
@@ -9,7 +18,11 @@ Imports UStates = SCrawler.API.Base.UserMedia.States
 Imports UTypes = SCrawler.API.Base.UserMedia.Types
 Namespace API.Reddit
     Friend Class UserData : Inherits UserDataBase : Implements IChannelData
-        Friend Overrides Property Site As Sites = Sites.Reddit
+        Private ReadOnly Property MySiteSettings As SiteSettings
+            Get
+                Return DirectCast(HOST.Source, SiteSettings)
+            End Get
+        End Property
 #Region "Channels Support"
 #Region "IChannelLimits Support"
         Friend Property DownloadLimitCount As Integer? Implements IChannelLimits.DownloadLimitCount
@@ -42,31 +55,25 @@ Namespace API.Reddit
                                                   Select c.Post) Else Return Nothing
         End Function
 #End Region
-        Private _Progress As MyProgress
+#Region "Initializer"
-        Friend Property Progress As MyProgress
+        Friend Sub New()
-            Get
-                If _Progress Is Nothing Then Return MainProgress Else Return _Progress
-            End Get
-            Set(ByVal p As MyProgress)
-                _Progress = p
-            End Set
-        End Property
-#Region "Initializers"
-        ''' <summary>Video downloader initializer</summary>
-        Private Sub New()
-        End Sub
-        ''' <summary>Default initializer</summary>
-        Friend Sub New(ByVal u As UserInfo, Optional ByVal _LoadUserInformation As Boolean = True, Optional ByVal InvokeImageHandler As Boolean = True)
-            MyBase.New(InvokeImageHandler)
             ChannelPostsNames = New List(Of String)
             _ExistsUsersNames = New List(Of String)
-            User = u
+            _CrossPosts = New List(Of String)
-            If _LoadUserInformation Then LoadUserInformation()
+        End Sub
+#End Region
+#Region "Load and Update user info"
+        Protected Overrides Sub LoadUserInformation_OptionalFields(ByRef Container As XmlFile, ByVal Loading As Boolean)
         End Sub
 #End Region
 #Region "Download Overrides"
         Friend Overrides Sub DownloadData(ByVal Token As CancellationToken)
-            If IsChannel AndAlso Not ChannelInfo.IsRegularChannel Then
+            UserDescriptionReset()
+            _CrossPosts.Clear()
+            If Not IsSavedPosts AndAlso (IsChannel AndAlso Not ChannelInfo Is Nothing) Then
+                If Not Responser Is Nothing Then Responser.Dispose()
+                Responser = New Response
+                Responser.Copy(MySiteSettings.Responser)
                 ChannelPostsNames.ListAddList(ChannelInfo.PostsAll.Select(Function(p) p.ID), LNC)
                 If SkipExistsUsers Then _ExistsUsersNames.ListAddList(Settings.UsersList.Select(Function(p) p.Name), LNC)
                 DownloadDataF(Token)
@@ -79,8 +86,10 @@ Namespace API.Reddit
         End Sub
         Protected Overrides Sub DownloadDataF(ByVal Token As CancellationToken)
             _TotalPostsDownloaded = 0
-            If IsChannel Then
+            If IsSavedPosts Then
-                If ChannelInfo.IsRegularChannel Then
+                DownloadDataChannel(String.Empty, Token)
+            ElseIf IsChannel Then
+                If ChannelInfo Is Nothing Then
                     ChannelPostsNames.ListAddList(_TempPostsList, LNC)
                     If ChannelPostsNames.Count > 0 Then
                         DownloadLimitCount = Nothing
@@ -91,7 +100,7 @@ Namespace API.Reddit
                     If DownloadTopCount.HasValue Then DownloadLimitCount = DownloadTopCount
                 End If
                 DownloadDataChannel(String.Empty, Token)
-                If ChannelInfo.IsRegularChannel Then _TempPostsList.ListAddList(_TempMediaList.Select(Function(m) m.Post.ID), LNC)
+                If ChannelInfo Is Nothing Then _TempPostsList.ListAddList(_TempMediaList.Select(Function(m) m.Post.ID), LNC)
             Else
                 DownloadDataUser(String.Empty, Token)
             End If
@@ -99,10 +108,13 @@ Namespace API.Reddit
 #End Region
 #Region "Download Functions (User, Channel)"
         Private _TotalPostsDownloaded As Integer = 0
+        Private ReadOnly _CrossPosts As List(Of String)
         Private Sub DownloadDataUser(ByVal POST As String, ByVal Token As CancellationToken)
+            Const CPRI$ = "crosspostRootId"
+            Const CPPI$ = "crosspostParentId"
             Dim URL$ = String.Empty
             Try
-                Dim PostID$ = String.Empty
+                Dim PostID$ = String.Empty, PostTmp$ = String.Empty
                 Dim PostDate$
                 Dim n As EContainer, nn As EContainer, s As EContainer
                 Dim NewPostDetected As Boolean = False
@@ -111,53 +123,68 @@ Namespace API.Reddit
                 Dim added As Boolean
                 Dim __ItemType$
                 Dim tmpType As UTypes
-                Dim CheckNode As Predicate(Of EContainer) = Function(e) e("author").XmlIfNothingValue("/").ToLower.Equals(Name.ToLower)
+                Dim IsCrossPost As Predicate(Of EContainer) = Function(e) Not (e.Value(CPRI).IsEmptyString And e.Value(CPPI).IsEmptyString)
+                Dim CheckNode As Predicate(Of EContainer) = Function(e) Not ParseUserMediaOnly OrElse e("author").XmlIfNothingValue("/").ToLower.Equals(Name.ToLower)
                 Dim UPicType As Func(Of String, UTypes) = Function(input) IIf(input = "image", UTypes.Picture, UTypes.GIF)
+                Dim _PostID As Func(Of String) = Function() IIf(PostTmp.IsEmptyString, PostID, PostTmp)
 
                 URL = $"https://gateway.reddit.com/desktopapi/v1/user/{Name}/posts?rtj=only&allow_quarantined=true&allow_over18=1&include=identity&after={POST}&dist=25&sort=new&t=all&layout=classic"
                 ThrowAny(Token)
-                Dim r$ = GetSiteResponse(URL)
+                Dim r$ = Responser.GetResponse(URL,, EDP.ThrowException)
                 If Not r.IsEmptyString Then
                     Using w As EContainer = JsonDocument.Parse(r).XmlIfNothing
                         If w.Count > 0 Then
+                            If UserDescriptionNeedToUpdate() Then UserDescriptionUpdate(w.ItemF({"subredditAboutInfo", 0, "publicDescription"}).XmlIfNothingValue)
                             n = w.GetNode(JsonNodesJson)
                             If Not n Is Nothing AndAlso n.Count > 0 Then
                                 For Each nn In n
                                     ThrowAny(Token)
                                     If nn.Count > 0 Then
-                                        PostID = nn.Name
-                                        If PostID.IsEmptyString AndAlso nn.Contains("id") Then PostID = nn("id").Value
-                                        If nn.Contains("created") Then PostDate = nn("created").Value Else PostDate = String.Empty
-                                        If Not _TempPostsList.Contains(PostID) Then
-                                            NewPostDetected = True
-                                            _TempPostsList.Add(PostID)
-                                        Else
-                                            ExistsDetected = True
-                                            Continue For
-                                        End If
-
                                         If CheckNode(nn) Then
+
+                                            'Obtain post ID
+                                            PostTmp = nn.Name
+                                            If PostTmp.IsEmptyString Then PostTmp = nn.Value("id")
+                                            If PostTmp.IsEmptyString Then Continue For
+                                            'Check for CrossPost
+                                            If IsCrossPost(nn) Then
+                                                _CrossPosts.ListAddList({nn.Value(CPRI), nn.Value(CPPI)}, LNC)
+                                                Continue For
+                                            Else
+                                                If Not _CrossPosts.Contains(PostTmp) Then PostID = PostTmp : PostTmp = String.Empty
+                                            End If
+
+                                            'Download decision
+                                            If Not _TempPostsList.Contains(_PostID()) Then
+                                                NewPostDetected = True
+                                                _TempPostsList.Add(_PostID())
+                                            Else
+                                                If Not _CrossPosts.Contains(_PostID()) Then ExistsDetected = True
+                                                Continue For
+                                            End If
+                                            If nn.Contains("created") Then PostDate = nn("created").Value Else PostDate = String.Empty
+
                                             _ItemsBefore = _TempMediaList.Count
                                             added = True
                                             s = nn.ItemF({"source", "url"})
-                                            If s.XmlIfNothingValue("/").Contains("redgifs.com") Then
+                                            If s.XmlIfNothingValue("/").StringContains({"redgifs.com", "gfycat.com"}) Then
-                                                _TempMediaList.ListAddValue(MediaFromData(UTypes.VideoPre, s.Value, PostID, PostDate,, IsChannel), LNC)
+                                                _TempMediaList.ListAddValue(MediaFromData(UTypes.VideoPre, s.Value, _PostID(), PostDate,, IsChannel), LNC)
-                                            ElseIf Not CreateImgurMedia(s.XmlIfNothingValue, PostID, PostDate,, IsChannel) Then
+                                            ElseIf Not CreateImgurMedia(s.XmlIfNothingValue, _PostID(), PostDate,, IsChannel) Then
                                                 s = nn.ItemF({"media"}).XmlIfNothing
                                                 __ItemType = s("type").XmlIfNothingValue
                                                 Select Case __ItemType
-                                                    Case "gallery" : If Not DownloadGallery(s, PostID, PostDate) Then added = False
+                                                    Case "gallery" : If Not DownloadGallery(s, _PostID(), PostDate) Then added = False
                                                     Case "image", "gifvideo"
                                                         If s.Contains("content") Then
                                                             _TempMediaList.ListAddValue(MediaFromData(UPicType(__ItemType), s.Value("content"),
-                                                                                                      PostID, PostDate,, IsChannel), LNC)
+                                                                                                      _PostID(), PostDate,, IsChannel), LNC)
                                                         Else
                                                             added = False
                                                         End If
                                                     Case "video"
                                                         If Settings.UseM3U8 AndAlso s("hlsUrl").XmlIfNothingValue("/").ToLower.Contains("m3u8") Then
                                                             _TempMediaList.ListAddValue(MediaFromData(UTypes.m3u8, s.Value("hlsUrl"),
-                                                                                                      PostID, PostDate,, IsChannel), LNC)
+                                                                                                      _PostID(), PostDate,, IsChannel), LNC)
                                                         Else
                                                             added = False
                                                         End If
@@ -169,7 +196,7 @@ Namespace API.Reddit
                                                 If Not s.IsEmptyString AndAlso TryFile(s.Value) Then
                                                     With s.Value.ToLower
                                                         Select Case True
-                                                            Case .Contains("redgifs") : tmpType = UTypes.VideoPre
+                                                            Case .Contains("redgifs"), .Contains("gfycat") : tmpType = UTypes.VideoPre
                                                             Case .Contains("m3u8") : If Settings.UseM3U8 Then tmpType = UTypes.m3u8
                                                             Case .Contains(".gif") And TryFile(s.Value) : tmpType = UTypes.GIF
                                                             Case TryFile(s.Value) : tmpType = UTypes.Picture
@@ -177,7 +204,7 @@ Namespace API.Reddit
                                                         End Select
                                                     End With
                                                     If Not tmpType = UTypes.Undefined Then
-                                                        _TempMediaList.ListAddValue(MediaFromData(tmpType, s.Value, PostID, PostDate,, IsChannel), LNC)
+                                                        _TempMediaList.ListAddValue(MediaFromData(tmpType, s.Value, _PostID(), PostDate,, IsChannel), LNC)
                                                     End If
                                                 End If
                                             End If
@@ -190,11 +217,8 @@ Namespace API.Reddit
                     If POST.IsEmptyString And ExistsDetected Then Exit Sub
                     If Not PostID.IsEmptyString And NewPostDetected Then DownloadDataUser(PostID, Token)
                 End If
-            Catch oex As OperationCanceledException When Token.IsCancellationRequested
-            Catch dex As ObjectDisposedException When Disposed
             Catch ex As Exception
-                LogError(ex, $"data downloading error [{URL}]")
+                ProcessException(ex, Token, $"data downloading error [{URL}]")
-                HasError = True
             End Try
         End Sub
         Private Sub DownloadDataChannel(ByVal POST As String, ByVal Token As CancellationToken)
@@ -208,9 +232,14 @@ Namespace API.Reddit
                 Dim eCount As Predicate(Of EContainer) = Function(e) e.Count > 0
                 Dim lDate As Date?
 
-                URL = $"https://reddit.com/r/{Name}/new.json?allow_quarantined=true&allow_over18=1&include=identity&after={POST}&dist=25&sort=new&t=all&layout=classic"
+                If IsSavedPosts Then
+                    URL = $"https://www.reddit.com/user/{Name}/saved.json?after={POST}"
+                Else
+                    URL = $"https://reddit.com/r/{Name}/new.json?allow_quarantined=true&allow_over18=1&include=identity&after={POST}&dist=25&sort=new&t=all&layout=classic"
+                End If
+
                 ThrowAny(Token)
-                Dim r$ = GetSiteResponse(URL)
+                Dim r$ = Responser.GetResponse(URL,, EDP.ThrowException)
                 If Not r.IsEmptyString Then
                     Using w As EContainer = JsonDocument.Parse(r).XmlIfNothing
                         If w.Count > 0 Then
@@ -232,13 +261,28 @@ Namespace API.Reddit
                                             End With
                                             If lDate.HasValue AndAlso lDate.Value <= DownloadLimitDate.Value Then Exit Sub
                                         End If
-                                        NewPostDetected = True
+
+                                        If IsSavedPosts Then
+                                            If Not _TempPostsList.Contains(PostID) Then
+                                                NewPostDetected = True
+                                                _TempPostsList.Add(PostID)
+                                            Else
+                                                ExistsDetected = True
+                                                Continue For
+                                            End If
+                                        Else
+                                            NewPostDetected = True
+                                        End If
 
                                         If s.Contains("created") Then PostDate = s("created").Value Else PostDate = String.Empty
                                         _UserID = s.Value("author")
 
                                         If SkipExistsUsers AndAlso _ExistsUsersNames.Count > 0 AndAlso
-                                           Not _UserID.IsEmptyString AndAlso _ExistsUsersNames.Contains(_UserID) Then Continue For
+                                           Not _UserID.IsEmptyString AndAlso _ExistsUsersNames.Contains(_UserID) Then
+                                            If Not IsSavedPosts AndAlso Not ChannelInfo Is Nothing Then _
+                                               ChannelInfo.ChannelExistentUserNames.ListAddValue(_UserID, LNC)
+                                            Continue For
+                                        End If
 
                                         tmpUrl = s.Value("url")
                                         If Not tmpUrl.IsEmptyString AndAlso tmpUrl.Contains("redgifs.com") Then
@@ -252,6 +296,18 @@ Namespace API.Reddit
                                                 _TempMediaList.ListAddValue(MediaFromData(UTypes.VideoPre, tmpUrl, PostID, PostDate, _UserID, IsChannel), LNC)
                                                 _TotalPostsDownloaded += 1
                                             End If
+                                        ElseIf Not s.Value({"media", "reddit_video"}, "fallback_url").IsEmptyString Then
+                                            tmpUrl = s.Value({"media", "reddit_video"}, "fallback_url")
+                                            If SaveToCache Then
+                                                tmpUrl = s.Value("thumbnail")
+                                                If Not tmpUrl.IsEmptyString Then
+                                                    _TempMediaList.ListAddValue(MediaFromData(UTypes.Picture, tmpUrl, PostID, PostDate, _UserID, IsChannel), LNC)
+                                                    _TotalPostsDownloaded += 1
+                                                End If
+                                            Else
+                                                _TempMediaList.ListAddValue(MediaFromData(UTypes.VideoPre + UTypes.m3u8, tmpUrl, PostID, PostDate, _UserID, IsChannel), LNC)
+                                                _TotalPostsDownloaded += 1
+                                            End If
                                         ElseIf CreateImgurMedia(tmpUrl, PostID, PostDate, _UserID, IsChannel) Then
                                             _TotalPostsDownloaded += 1
                                         ElseIf s.Item("media_metadata").XmlIfNothing.Count > 0 Then
@@ -272,11 +328,8 @@ Namespace API.Reddit
                     If POST.IsEmptyString And ExistsDetected Then Exit Sub
                     If Not PostID.IsEmptyString And NewPostDetected Then DownloadDataChannel(PostID, Token)
                 End If
-            Catch oex As OperationCanceledException When Token.IsCancellationRequested
-            Catch dex As ObjectDisposedException When Disposed
             Catch ex As Exception
-                LogError(ex, $"channel data downloading error [{URL}]")
+                ProcessException(ex, Token, $"channel data downloading error [{URL}]")
-                HasError = True
             End Try
         End Sub
 #End Region
@@ -336,23 +389,31 @@ Namespace API.Reddit
                 End If
                 Return added
             Catch ex As Exception
-                LogError(ex, "gallery parsing error")
+                ProcessException(ex, Nothing, "gallery parsing error", False)
-                HasError = True
                 Return False
             End Try
         End Function
         Protected Overrides Sub ReparseVideo(ByVal Token As CancellationToken)
             Try
                 ThrowAny(Token)
-                If _TempMediaList.Count > 0 AndAlso _TempMediaList.Exists(Function(p) p.Type = UTypes.VideoPre) Then
+                Const v2 As UTypes = UTypes.VideoPre + UTypes.m3u8
+                If _TempMediaList.Count > 0 AndAlso _TempMediaList.Exists(Function(p) p.Type = UTypes.VideoPre Or p.Type = v2) Then
                     Dim r$, v$
                     Dim e As New ErrorsDescriber(EDP.ReturnValue)
                     Dim m As UserMedia
                     For i% = _TempMediaList.Count - 1 To 0 Step -1
                         ThrowAny(Token)
-                        If _TempMediaList(i).Type = UTypes.VideoPre Then
+                        If _TempMediaList(i).Type = UTypes.VideoPre Or _TempMediaList(i).Type = v2 Then
                             m = _TempMediaList(i)
-                            r = GetSiteResponse(m.URL, e)
+                            If _TempMediaList(i).Type = UTypes.VideoPre Then
+                                If m.URL.Contains("gfycat.com") Then
+                                    r = Gfycat.Envir.GetVideo(m.URL)
+                                Else
+                                    r = Responser.GetResponse(m.URL,, e)
+                                End If
+                            Else
+                                r = m.URL
+                            End If
                             _TempMediaList(i) = New UserMedia
                             If Not r.IsEmptyString Then
                                 v = RegexReplace(r, VideoRegEx)
@@ -365,19 +426,19 @@ Namespace API.Reddit
                         End If
                     Next
                 End If
-            Catch oex As OperationCanceledException When Token.IsCancellationRequested
-            Catch dex As ObjectDisposedException When Disposed
             Catch ex As Exception
-                LogError(ex, "video reparsing error")
+                ProcessException(ex, Token, "video reparsing error", False)
             End Try
         End Sub
-        Friend Shared Function GetVideoInfo(ByVal URL As String) As UserMedia
+        Friend Shared Function GetVideoInfo(ByVal URL As String, ByVal resp As Response) As IEnumerable(Of UserMedia)
             Try
                 If Not URL.IsEmptyString AndAlso URL.Contains("redgifs") Then
                     Using r As New UserData
                         r._TempMediaList.Add(MediaFromData(UTypes.VideoPre, URL, String.Empty, String.Empty,, False))
+                        r.Responser = New Response
+                        r.Responser.Copy(resp)
                         r.ReparseVideo(Nothing)
-                        If r._TempMediaList.ListExists Then Return r._TempMediaList(0)
+                        If r._TempMediaList.ListExists Then Return {r._TempMediaList(0)}
                     End Using
                 End If
                 Return Nothing
@@ -401,7 +462,7 @@ Namespace API.Reddit
             Try
                 If Not URL.IsEmptyString AndAlso URL.StringContains({".jpg", ".png", ".jpeg"}) Then
                     Dim f As SFile = CStr(RegexReplace(URL, FilesPattern))
-                    Return Not f.IsEmptyString And Not f.File.IsEmptyString
+                    Return Not f.File.IsEmptyString
                 End If
                 Return False
             Catch ex As Exception
@@ -414,6 +475,8 @@ Namespace API.Reddit
 #End Region
         Protected Overrides Sub DownloadContent(ByVal Token As CancellationToken)
             Try
+                Const _RFN$ = "RedditVideo"
+                Const RFN$ = _RFN & "{0}"
                 Dim i%
                 Dim dCount% = 0, dTotal% = 0
                 ThrowAny(Token)
@@ -422,23 +485,38 @@ Namespace API.Reddit
                     If _ContentNew.Count > 0 Then
                         MyFile.Exists(SFO.Path)
                         Dim MyDir$
-                        If IsChannel And SaveToCache Then
+                        If Not IsSavedPosts AndAlso (IsChannel And SaveToCache And Not ChannelInfo Is Nothing) Then
                             MyDir = ChannelInfo.CachePath.PathNoSeparator
                         Else
                             MyDir = MyFile.CutPath.PathNoSeparator
                         End If
+                        Dim StartRFN% = 0
+                        If _ContentNew.Exists(Function(c) c.Type = UTypes.Video And c.URL.Contains("redd.it")) Then
+                            StartRFN = SFile.Indexed_GetMaxIndex($"{MyDir}\{IIf(SeparateVideoFolderF, "Video\", String.Empty)}{_RFN}.mp4",, New SFileNumbers(_RFN, String.Empty), EDP.ReturnValue)
+                        End If
                         Dim HashList As New List(Of String)
                         If _ContentList.Count > 0 Then HashList.ListAddList((From h In _ContentList Where Not h.MD5.IsEmptyString Select h.MD5), LNC)
                         Dim f As SFile
                         Dim v As UserMedia
                         Dim cached As Boolean = IsChannel And SaveToCache
                         Dim vsf As Boolean = SeparateVideoFolderF
-                        Dim ImgFormat As Imaging.ImageFormat
+                        Dim UseMD5 As Boolean = Not IsChannel Or (Not cached And Settings.ChannelsRegularCheckMD5)
                         Dim bDP As New ErrorsDescriber(EDP.None)
+                        Dim ImgurUrls As New List(Of String)
+                        Dim TryBytes As Func(Of String, Imaging.ImageFormat, String) =
+                            Function(ByVal __URL As String, ByVal ImgFormat As Imaging.ImageFormat) As String
+                                Try
+                                    Return ByteArrayToString(GetMD5(SFile.GetBytesFromNet(__URL, bDP), ImgFormat))
+                                Catch hash_ex As Exception
+                                    Return String.Empty
+                                End Try
+                            End Function
                         Dim MD5BS As Func(Of String, UTypes,
                                              SFile, Boolean, String) = Function(ByVal __URL As String, ByVal __MT As UTypes,
                                                                                 ByVal __File As SFile, ByVal __IsBase As Boolean) As String
                                                                            Try
+                                                                               ImgurUrls.Clear()
+                                                                               Dim ImgFormat As Imaging.ImageFormat
                                                                                If __MT = UTypes.GIF Then
                                                                                    ImgFormat = Imaging.ImageFormat.Gif
                                                                                ElseIf __IsBase Then
@@ -446,7 +524,27 @@ Namespace API.Reddit
                                                                                Else
                                                                                    ImgFormat = GetImageFormat(__File)
                                                                                End If
-                                                                               Return ByteArrayToString(GetMD5(SFile.GetBytesFromNet(__URL, bDP), ImgFormat))
+
+                                                                               Dim tmpBytes$ = TryBytes(__URL, ImgFormat)
+                                                                               If tmpBytes.IsEmptyString And Not __MT = UTypes.GIF Then
+                                                                                   ImgFormat = Imaging.ImageFormat.Png
+                                                                                   tmpBytes = TryBytes(__URL, ImgFormat)
+                                                                                   If Not tmpBytes.IsEmptyString Then Return tmpBytes
+                                                                               Else
+                                                                                   Return tmpBytes
+                                                                               End If
+
+                                                                               If tmpBytes.IsEmptyString And Not __MT = UTypes.GIF And __URL.Contains("imgur.com") Then
+                                                                                   For c% = 0 To 1
+                                                                                       If c = 0 Then
+                                                                                           ImgurUrls.ListAddList(Imgur.Envir.GetGallery(__URL))
+                                                                                       Else
+                                                                                           ImgurUrls.ListAddValue(Imgur.Envir.GetImage(__URL))
+                                                                                       End If
+                                                                                       If ImgurUrls.Count > 0 Then Exit For
+                                                                                   Next
+                                                                               End If
+                                                                               Return tmpBytes
                                                                            Catch hash_ex As Exception
                                                                                Return String.Empty
                                                                            End Try
@@ -466,43 +564,63 @@ Namespace API.Reddit
                                 End If
                                 f.Separator = "\"
                                 m = String.Empty
-                                If (v.Type = UTypes.Picture Or v.Type = UTypes.GIF) And Not cached Then
+                                If (v.Type = UTypes.Picture Or v.Type = UTypes.GIF) And UseMD5 Then
                                     m = MD5BS(v.URL, v.Type, f, False)
-                                    If m.IsEmptyString AndAlso Not v.URL_BASE.IsEmptyString AndAlso Not v.URL_BASE = v.URL Then
+                                    If ImgurUrls.Count = 0 AndAlso m.IsEmptyString AndAlso Not v.URL_BASE.IsEmptyString AndAlso Not v.URL_BASE = v.URL Then
                                         m = MD5BS(v.URL_BASE, v.Type, f, True)
                                         If Not m.IsEmptyString Then v.URL = v.URL_BASE
                                     End If
                                 End If
 
                                 If (Not m.IsEmptyString AndAlso Not HashList.Contains(m)) Or Not (v.Type = UTypes.Picture Or
-                                                                                                  v.Type = UTypes.GIF) Or cached Then
+                                                                                                  v.Type = UTypes.GIF) Or Not UseMD5 Or ImgurUrls.Count > 0 Then
-                                    If Not cached Then HashList.Add(m)
+                                    Do
-                                    v.MD5 = m
+                                        If Not cached And Not m.IsEmptyString Then HashList.Add(m)
-                                    f.Path = MyDir
+                                        v.MD5 = m
-                                    Try
+                                        If ImgurUrls.Count > 0 Then
-                                        If (v.Type = UTypes.Video Or v.Type = UTypes.m3u8) And vsf Then f.Path = $"{f.PathWithSeparator}Video"
+                                            If ImgurUrls(0).IsEmptyString Then ImgurUrls.RemoveAt(0) : Continue Do
-                                        If v.Type = UTypes.m3u8 Then
+                                            f = UrlToFile(ImgurUrls(0))
-                                            f = M3U8.Download(v.URL, f)
+                                            If f.Extension.IsEmptyString Then f.Extension = "gif"
-                                        Else
+                                            If f.Name.IsEmptyString Then
-                                            w.DownloadFile(v.URL, f.ToString)
+                                                f.Path = MyDir
-                                        End If
+                                                f.Name = $"ImgurImg_{v.File.Name}"
-                                        If Not v.Type = UTypes.m3u8 Or Not f.IsEmptyString Then
+                                                f = SFile.Indexed_IndexFile(f,,, EDP.ReturnValue)
-                                            Select Case v.Type
-                                                Case UTypes.Picture : DownloadedPictures += 1 : _CountPictures += 1
-                                                Case UTypes.Video, UTypes.m3u8 : DownloadedVideos += 1 : _CountVideo += 1
-                                            End Select
-                                            If Not IsChannel Or Not SaveToCache Then
-                                                v.File = ChangeFileNameByProvider(f, v)
-                                            Else
-                                                v.File = f
                                             End If
-                                            v.Post.CachedFile = f
-                                            v.State = UStates.Downloaded
-                                            dCount += 1
                                         End If
-                                    Catch wex As Exception
+                                        f.Path = MyDir
-                                        If Not IsChannel Then ErrorDownloading(f, v.URL)
+                                        Try
-                                    End Try
+                                            If (v.Type = UTypes.Video Or v.Type = UTypes.m3u8 Or (ImgurUrls.Count > 0 AndAlso f.Extension = "mp4")) And
+                                                vsf Then f.Path = $"{f.PathWithSeparator}Video"
+                                            If v.Type = UTypes.Video AndAlso v.URL.Contains("redd.it") Then
+                                                StartRFN += 1
+                                                f.Name = String.Format(RFN, StartRFN)
+                                            End If
+                                            If v.Type = UTypes.m3u8 Then
+                                                f = M3U8.Download(v.URL, f)
+                                            ElseIf ImgurUrls.Count > 0 Then
+                                                w.DownloadFile(ImgurUrls(0), f.ToString)
+                                            Else
+                                                w.DownloadFile(v.URL, f.ToString)
+                                            End If
+                                            If Not v.Type = UTypes.m3u8 Or Not f.IsEmptyString Then
+                                                Select Case v.Type
+                                                    Case UTypes.Picture : DownloadedPictures(False) += 1
+                                                    Case UTypes.Video, UTypes.m3u8 : DownloadedVideos(False) += 1
+                                                End Select
+                                                If Not IsChannel Or Not SaveToCache Then
+                                                    v.File = ChangeFileNameByProvider(f, v)
+                                                Else
+                                                    v.File = f
+                                                End If
+                                                v.Post.CachedFile = f
+                                                v.State = UStates.Downloaded
+                                                dCount += 1
+                                            End If
+                                        Catch wex As Exception
+                                            If Not IsChannel Then ErrorDownloading(f, v.URL)
+                                        End Try
+                                        If ImgurUrls.Count > 0 Then ImgurUrls.RemoveAt(0)
+                                    Loop While ImgurUrls.Count > 0
                                 Else
                                     v.State = UStates.Skipped
                                 End If
@@ -526,27 +644,23 @@ Namespace API.Reddit
                 HasError = True
             End Try
         End Sub
-        Protected Function GetSiteResponse(ByVal URL As String, Optional ByVal e As ErrorsDescriber = Nothing) As String
+        Protected Overrides Function DownloadingException(ByVal ex As Exception, ByVal Message As String, Optional ByVal FromPE As Boolean = False) As Integer
-            Try
+            If Responser.StatusCode = HttpStatusCode.NotFound Then
-                Return Settings.Site(Sites.Reddit).Responser.GetResponse(URL,, EDP.ThrowException)
+                UserExists = False
-            Catch ex As Exception
+            ElseIf Responser.StatusCode = HttpStatusCode.Forbidden Then
-                HasError = True
+                UserSuspended = True
-                Dim OptText$ = String.Empty
+            ElseIf Responser.StatusCode = HttpStatusCode.BadGateway Or
-                If Not e.Exists Then
+                   Responser.StatusCode = HttpStatusCode.ServiceUnavailable Or
-                    Dim ee As EDP = EDP.SendInLog
+                   Responser.StatusCode = HttpStatusCode.GatewayTimeout Then
-                    If Settings.Site(Sites.Reddit).Responser.StatusCode = HttpStatusCode.NotFound Then
+                MyMainLOG = "Reddit is currently unavailable"
-                        ee += EDP.ThrowException
+            Else
-                        OptText = ": USER NOT FOUND"
+                If Not FromPE Then LogError(ex, Message) : HasError = True
-                    Else
+                Return 0
-                        ee += EDP.ReturnValue
+            End If
-                    End If
+            Return 1
-                    e = New ErrorsDescriber(ee)
-                End If
-                Return ErrorsDescriber.Execute(e, ex, $"[{Site} - {Name}: GetSiteResponse([{URL}])]{OptText}", String.Empty)
-            End Try
         End Function
         Protected Overrides Sub Dispose(ByVal disposing As Boolean)
-            If Not disposedValue And disposing Then ChannelPostsNames.Clear() : _ExistsUsersNames.Clear()
+            If Not disposedValue And disposing Then ChannelPostsNames.Clear() : _ExistsUsersNames.Clear() : _CrossPosts.Clear()
             MyBase.Dispose(disposing)
         End Sub
     End Class

SCrawler/API/Redgifs/Declarations.vb

@@ -0,0 +1,23 @@
+' Copyright (C) 2022  Andy
+' This program is free software: you can redistribute it and/or modify
+' it under the terms of the GNU General Public License as published by
+' the Free Software Foundation, either version 3 of the License, or
+' (at your option) any later version.
+'
+' This program is distributed in the hope that it will be useful,
+' but WITHOUT ANY WARRANTY
+Namespace API.RedGifs
+    Friend Module Declarations
+        Friend Const RedGifsSite As String = "RedGifs"
+        Friend ReadOnly DateProvider As New JsonDate
+        Friend Class JsonDate : Implements ICustomProvider
+            Friend Function Convert(ByVal Value As Object, ByVal DestinationType As Type, ByVal Provider As IFormatProvider,
+                                    Optional ByVal NothingArg As Object = Nothing, Optional ByVal e As ErrorsDescriber = Nothing) As Object Implements ICustomProvider.Convert
+                Return ADateTime.ParseUnicode(Value, NothingArg, e)
+            End Function
+            Private Function GetFormat(ByVal FormatType As Type) As Object Implements IFormatProvider.GetFormat
+                Throw New NotImplementedException("GetFormat is not available in this context")
+            End Function
+        End Class
+    End Module
+End Namespace

SCrawler/API/Redgifs/SiteSettings.vb

@@ -0,0 +1,29 @@
+' Copyright (C) 2022  Andy
+' This program is free software: you can redistribute it and/or modify
+' it under the terms of the GNU General Public License as published by
+' the Free Software Foundation, either version 3 of the License, or
+' (at your option) any later version.
+'
+' This program is distributed in the hope that it will be useful,
+' but WITHOUT ANY WARRANTY
+Imports SCrawler.Plugin
+Imports SCrawler.Plugin.Attributes
+Imports SCrawler.API.Base
+Imports PersonalUtilities.Functions.RegularExpressions
+Namespace API.RedGifs
+    <Manifest("AndyProgram_RedGifs"), UseClassAsIs>
+    Friend Class SiteSettings : Inherits SiteSettingsBase
+        Friend Sub New()
+            MyBase.New(RedGifsSite, "redgifs.com")
+            UrlPatternUser = "https://www.redgifs.com/users/{0}/"
+            UserRegex = RParams.DMS("[htps:/]{7,8}.*?redgifs.com/users/([^/]+)", 1)
+            ImageVideoContains = "redgifs"
+        End Sub
+        Friend Overrides Function GetInstance(ByVal What As ISiteSettings.Download) As IPluginContentProvider
+            Return New UserData
+        End Function
+        Friend Overrides Function GetSpecialDataF(ByVal URL As String) As IEnumerable(Of UserMedia)
+            Return Reddit.UserData.GetVideoInfo(URL, Nothing)
+        End Function
+    End Class
+End Namespace

SCrawler/API/Redgifs/UserData.vb

@@ -0,0 +1,88 @@
+' Copyright (C) 2022  Andy
+' This program is free software: you can redistribute it and/or modify
+' it under the terms of the GNU General Public License as published by
+' the Free Software Foundation, either version 3 of the License, or
+' (at your option) any later version.
+'
+' This program is distributed in the hope that it will be useful,
+' but WITHOUT ANY WARRANTY
+Imports PersonalUtilities.Functions.XML
+Imports PersonalUtilities.Functions.RegularExpressions
+Imports PersonalUtilities.Tools.WebDocuments.JSON
+Imports System.Threading
+Imports System.Net
+Imports SCrawler.API.Base
+Imports UTypes = SCrawler.API.Base.UserMedia.Types
+Namespace API.RedGifs
+    Friend Class UserData : Inherits UserDataBase
+        Friend Sub New()
+        End Sub
+        Protected Overrides Sub LoadUserInformation_OptionalFields(ByRef Container As XmlFile, ByVal Loading As Boolean)
+        End Sub
+        Protected Overrides Sub DownloadDataF(ByVal Token As CancellationToken)
+            DownloadData(1, Token)
+        End Sub
+        Private Overloads Sub DownloadData(ByVal Page As Integer, ByVal Token As CancellationToken)
+            Dim URL$ = String.Empty
+            Try
+                URL = $"https://api.redgifs.com/v2/users/{Name}/search?order=recent&page={Page}"
+                Dim r$ = Responser.GetResponse(URL,, EDP.ThrowException)
+                Dim postDate$, postID$
+                Dim pTotal% = 0
+                Dim u$
+                Dim ut As UTypes
+                If Not r.IsEmptyString Then
+                    Using j As EContainer = JsonDocument.Parse(r).XmlIfNothing
+                        If j.Contains("gifs") Then
+                            pTotal = j.Value("pages").FromXML(Of Integer)(0)
+                            For Each g As EContainer In j("gifs")
+                                postDate = g.Value("createDate")
+                                postID = g.Value("id")
+                                If Not _TempPostsList.Contains(postID) Then _TempPostsList.Add(postID) Else Exit For
+                                With g("urls")
+                                    If .ListExists Then
+                                        u = If(.Item("hd"), .Item("sd")).XmlIfNothingValue
+                                        If Not u.IsEmptyString Then
+                                            ut = UTypes.Undefined
+                                            'Type 1: video
+                                            'Type 2: image
+                                            Select Case g.Value("type").FromXML(Of Integer)(0)
+                                                Case 1 : ut = UTypes.Video
+                                                Case 2 : ut = UTypes.Picture
+                                            End Select
+                                            If Not ut = UTypes.Undefined Then _TempMediaList.ListAddValue(MediaFromData(ut, u, postID, postDate))
+                                        End If
+                                    End If
+                                End With
+                            Next
+                        End If
+                    End Using
+                End If
+                If pTotal > 0 And Page < pTotal Then DownloadData(Page + 1, Token)
+            Catch ex As Exception
+                ProcessException(ex, Token, $"data downloading error [{URL}]")
+            End Try
+        End Sub
+        Protected Overrides Sub ReparseVideo(ByVal Token As CancellationToken)
+        End Sub
+        Protected Overrides Sub DownloadContent(ByVal Token As CancellationToken)
+            DownloadContentDefault(Token)
+        End Sub
+        Private Shared Function MediaFromData(ByVal t As UTypes, ByVal _URL As String, ByVal PostID As String, ByVal PostDate As String) As UserMedia
+            _URL = LinkFormatterSecure(RegexReplace(_URL.Replace("\", String.Empty), LinkPattern))
+            Dim m As New UserMedia(_URL, t) With {.Post = New UserPost With {.ID = PostID}}
+            If Not m.URL.IsEmptyString Then m.File = CStr(RegexReplace(m.URL, FilesPattern)) : m.URL_BASE = m.URL
+            If Not PostDate.IsEmptyString Then m.Post.Date = AConvert(Of Date)(PostDate, DateProvider, Nothing) Else m.Post.Date = Nothing
+            Return m
+        End Function
+        Protected Overrides Function DownloadingException(ByVal ex As Exception, ByVal Message As String, Optional ByVal FromPE As Boolean = False) As Integer
+            If Responser.StatusCode = HttpStatusCode.NotFound Then
+                UserExists = False
+            Else
+                If Not FromPE Then LogError(ex, Message) : HasError = True
+                Return 0
+            End If
+            Return 1
+        End Function
+    End Class
+End Namespace

SCrawler/API/Twitter/Declarations.vb

@@ -1,9 +1,19 @@
-Imports PersonalUtilities.Functions.XML.Base
+' Copyright (C) 2022  Andy
+' This program is free software: you can redistribute it and/or modify
+' it under the terms of the GNU General Public License as published by
+' the Free Software Foundation, either version 3 of the License, or
+' (at your option) any later version.
+'
+' This program is distributed in the hope that it will be useful,
+' but WITHOUT ANY WARRANTY
+Imports PersonalUtilities.Functions.XML.Base
+Imports PersonalUtilities.Functions.RegularExpressions
 Namespace API.Twitter
     Friend Module Declarations
+        Friend Const TwitterSite As String = "Twitter"
         Friend DateProvider As New ADateTime(ADateTime.Formats.BaseDateTime)
         Friend ReadOnly VideoNode As NodeParams() = {New NodeParams("video_info", True, True, True, True, 10)}
-        Friend ReadOnly VideoSizeRegEx As New RegexStructure("\d+x(\d+)",,,, 1,,, String.Empty, EDP.ReturnValue)
+        Friend ReadOnly VideoSizeRegEx As RParams = RParams.DMS("\d+x(\d+)", 1, EDP.ReturnValue)
-        Friend ReadOnly UserIdRegEx As New RegexStructure("user_id.:.(\d+)",,,, 1,,, String.Empty, EDP.ReturnValue)
+        Friend ReadOnly UserIdRegEx As RParams = RParams.DMS("user_id.:.(\d+)", 1, EDP.ReturnValue)
     End Module
 End Namespace

SCrawler/API/Twitter/SiteSettings.vb

@@ -0,0 +1,99 @@
+' Copyright (C) 2022  Andy
+' This program is free software: you can redistribute it and/or modify
+' it under the terms of the GNU General Public License as published by
+' the Free Software Foundation, either version 3 of the License, or
+' (at your option) any later version.
+'
+' This program is distributed in the hope that it will be useful,
+' but WITHOUT ANY WARRANTY
+Imports SCrawler.Plugin
+Imports SCrawler.Plugin.Attributes
+Imports PersonalUtilities.Tools
+Imports PersonalUtilities.Functions.RegularExpressions
+Imports SCrawler.API.Base
+Namespace API.Twitter
+    <Manifest("AndyProgram_Twitter"), UseClassAsIs>
+    Friend Class SiteSettings : Inherits SiteSettingsBase
+        Friend Const Header_Authorization As String = "authorization"
+        Friend Const Header_Token As String = "x-csrf-token"
+        Friend Overrides ReadOnly Property Icon As Icon
+            Get
+                Return My.Resources.TwitterIcon
+            End Get
+        End Property
+        Friend Overrides ReadOnly Property Image As Image
+            Get
+                Return My.Resources.TwitterPic400
+            End Get
+        End Property
+        <PropertyOption(AllowNull:=False, ControlText:="Authorization",
+                        ControlToolTip:="Set authorization from [authorization] response header. This field must start from [Bearer] key word")>
+        Private ReadOnly Property Auth As PropertyValue
+        <PropertyOption(AllowNull:=False, ControlText:="Token", ControlToolTip:="Set token from [x-csrf-token] response header")>
+        Private ReadOnly Property Token As PropertyValue
+        Friend Overrides ReadOnly Property Responser As WEB.Response
+        Friend Sub New()
+            MyBase.New(TwitterSite)
+            Responser = New WEB.Response($"{SettingsFolderName}\Responser_{Site}.xml")
+
+            Dim a$ = String.Empty
+            Dim t$ = String.Empty
+
+            With Responser
+                If .File.Exists Then
+                    .LoadSettings()
+                    With .Headers
+                        If .ContainsKey(Header_Authorization) Then a = .Item(Header_Authorization)
+                        If .ContainsKey(Header_Token) Then t = .Item(Header_Token)
+                    End With
+                Else
+                    .ContentType = "application/json"
+                    .Accept = "*/*"
+                    .CookiesDomain = "twitter.com"
+                    .Decoders.Add(SymbolsConverter.Converters.Unicode)
+                    With .Headers
+                        .Add("sec-ch-ua", " Not;A Brand" & Chr(34) & ";v=" & Chr(34) & "99" & Chr(34) & ", " & Chr(34) &
+                             "Google Chrome" & Chr(34) & ";v=" & Chr(34) & "91" & Chr(34) & ", " & Chr(34) & "Chromium" &
+                             Chr(34) & ";v=" & Chr(34) & "91" & Chr(34))
+                        .Add("sec-ch-ua-mobile", "?0")
+                        .Add("sec-fetch-dest", "empty")
+                        .Add("sec-fetch-mode", "cors")
+                        .Add("sec-fetch-site", "same-origin")
+                        .Add(Header_Token, String.Empty)
+                        .Add("x-twitter-active-user", "yes")
+                        .Add("x-twitter-auth-type", "OAuth2Session")
+                        .Add(Header_Authorization, String.Empty)
+                    End With
+                    .SaveSettings()
+                End If
+            End With
+
+            Auth = New PropertyValue(a, GetType(String), Sub(v) ChangeResponserFields(NameOf(Auth), v))
+            Token = New PropertyValue(t, GetType(String), Sub(v) ChangeResponserFields(NameOf(Token), v))
+
+            UserRegex = RParams.DMS("[htps:/]{7,8}.*?twitter.com/([^/]+)", 1)
+            UrlPatternUser = "https://twitter.com/{0}"
+            ImageVideoContains = "twitter"
+        End Sub
+        Private Sub ChangeResponserFields(ByVal PropName As String, ByVal Value As Object)
+            If Not PropName.IsEmptyString Then
+                Dim f$ = String.Empty
+                Select Case PropName
+                    Case NameOf(Auth) : f = Header_Authorization
+                    Case NameOf(Token) : f = Header_Token
+                End Select
+                If Not f.IsEmptyString Then
+                    If Responser.Headers.Count > 0 AndAlso Responser.Headers.ContainsKey(f) Then Responser.Headers.Remove(f)
+                    If Not CStr(Value).IsEmptyString Then Responser.Headers.Add(f, CStr(Value))
+                    Responser.SaveSettings()
+                End If
+            End If
+        End Sub
+        Friend Overrides Function GetInstance(ByVal What As ISiteSettings.Download) As IPluginContentProvider
+            Return New UserData
+        End Function
+        Friend Overrides Function GetSpecialDataF(ByVal URL As String) As IEnumerable(Of UserMedia)
+            Return UserData.GetVideoInfo(URL, Responser)
+        End Function
+    End Class
+End Namespace

SCrawler/API/Twitter/UserData.vb

@@ -1,53 +1,40 @@
-Imports PersonalUtilities.Tools.WebDocuments.JSON
+' Copyright (C) 2022  Andy
+' This program is free software: you can redistribute it and/or modify
+' it under the terms of the GNU General Public License as published by
+' the Free Software Foundation, either version 3 of the License, or
+' (at your option) any later version.
+'
+' This program is distributed in the hope that it will be useful,
+' but WITHOUT ANY WARRANTY
+Imports PersonalUtilities.Tools.WEB
+Imports PersonalUtilities.Tools.WebDocuments.JSON
 Imports PersonalUtilities.Functions.XML
+Imports PersonalUtilities.Functions.RegularExpressions
 Imports System.Net
 Imports System.Threading
 Imports SCrawler.API.Base
-Imports UStates = SCrawler.API.Base.UserMedia.States
 Namespace API.Twitter
     Friend Class UserData : Inherits UserDataBase
 #Region "Declarations"
-        Friend Overrides Property Site As Sites = Sites.Twitter
+        Private ReadOnly _DataNames As List(Of String)
-        Private Structure Sizes : Implements IComparable(Of Sizes)
-            Friend Value As Integer
-            Friend Name As String
-            Friend ReadOnly HasError As Boolean
-            Friend Sub New(ByVal _Value As String, ByVal _Name As String)
-                Try
-                    Value = _Value
-                    Name = _Name
-                Catch ex As Exception
-                    HasError = True
-                End Try
-            End Sub
-            Friend Function CompareTo(ByVal Other As Sizes) As Integer Implements IComparable(Of Sizes).CompareTo
-                Return Value.CompareTo(Other.Value) * -1
-            End Function
-            Friend Shared Function Reparse(ByRef Current As Sizes, ByVal Other As Sizes, ByVal LargeContained As Boolean) As Sizes
-                If LargeContained And Current.Name.IsEmptyString And Current.Value > Other.Value Then Current.Name = "large"
-                Return Current
-            End Function
-            Friend Shared Function ApplyLarge(ByRef s As Sizes) As Sizes
-                s.Name = "large"
-                Return s
-            End Function
-        End Structure
 #End Region
 #Region "Initializer"
-        Friend Sub New(ByVal u As UserInfo, Optional ByVal _LoadUserInformation As Boolean = True)
+        Friend Sub New()
-            User = u
+            _DataNames = New List(Of String)
-            If _LoadUserInformation Then LoadUserInformation()
         End Sub
 #End Region
+        Protected Overrides Sub LoadUserInformation_OptionalFields(ByRef Container As XmlFile, ByVal Loading As Boolean)
+        End Sub
 #Region "Download functions"
         Protected Overrides Sub DownloadDataF(ByVal Token As CancellationToken)
+            If _ContentList.Count > 0 Then _DataNames.ListAddList(_ContentList.Select(Function(c) c.File.File), LAP.ClearBeforeAdd, LAP.NotContainsOnly)
             DownloadData(String.Empty, Token)
         End Sub
         Private Overloads Sub DownloadData(ByVal POST As String, ByVal Token As CancellationToken)
             Dim URL$ = String.Empty
             Try
                 Dim PostID$ = String.Empty
-                Dim PostDate$
+                Dim PostDate$, dName$
                 Dim m As EContainer, nn As EContainer, s As EContainer
                 Dim NewPostDetected As Boolean = False
                 Dim ExistsDetected As Boolean = False
@@ -59,7 +46,7 @@ Namespace API.Twitter
                 If Not POST.IsEmptyString Then URL &= $"&max_id={POST}"
 
                 ThrowAny(Token)
-                Dim r$ = Settings.Site(Sites.Twitter).Responser.GetResponse(URL,, EDP.ThrowException)
+                Dim r$ = Responser.GetResponse(URL,, EDP.ThrowException)
                 If Not r.IsEmptyString Then
                     Using w As EContainer = JsonDocument.Parse(r)
                         If Not w Is Nothing AndAlso w.Count > 0 Then
@@ -72,6 +59,8 @@ Namespace API.Twitter
                                         If Not ID.IsEmptyString Then UpdateUserInformation()
                                     End If
 
+                                    If UserDescriptionNeedToUpdate() AndAlso nn.Value({"user"}, "screen_name") = Name Then UserDescriptionUpdate(nn.Value({"user"}, "description"))
+
                                     'Date Pattern:
                                     'Sat Jan 01 01:10:15 +0000 2000
                                     If nn.Contains("created_at") Then PostDate = nn("created_at").Value Else PostDate = String.Empty
@@ -92,8 +81,12 @@ Namespace API.Twitter
                                             If Not s Is Nothing AndAlso s.Count > 0 Then
                                                 For Each m In s
                                                     If m.Count > 0 AndAlso m.Contains("media_url") Then
-                                                        _TempMediaList.ListAddValue(MediaFromData(m("media_url").Value,
+                                                        dName = UrlFile(m("media_url").Value)
-                                                                                                  PostID, PostDate, GetPictureOption(m)), LNC)
+                                                        If Not dName.IsEmptyString AndAlso Not _DataNames.Contains(dName) Then
+                                                            _DataNames.Add(dName)
+                                                            _TempMediaList.ListAddValue(MediaFromData(m("media_url").Value,
+                                                                                                      PostID, PostDate, GetPictureOption(m)), LNC)
+                                                        End If
                                                     End If
                                                 Next
                                             End If
@@ -106,25 +99,22 @@ Namespace API.Twitter
                     If POST.IsEmptyString And ExistsDetected Then Exit Sub
                     If Not PostID.IsEmptyString And NewPostDetected Then DownloadData(PostID, Token)
                 End If
-            Catch oex As OperationCanceledException When Token.IsCancellationRequested
-            Catch dex As ObjectDisposedException When Disposed
             Catch ex As Exception
-                LogError(ex, $"data downloading error [{URL}]")
+                ProcessException(ex, Token, $"data downloading error [{URL}]")
-                HasError = True
             End Try
         End Sub
-        Friend Shared Function GetVideoInfo(ByVal URL As String) As UserMedia
+        Friend Shared Function GetVideoInfo(ByVal URL As String, ByVal resp As Response) As IEnumerable(Of UserMedia)
             Try
                 If URL.Contains("twitter") Then
-                    Dim PostID$ = RegexReplace(URL, New RegexStructure("(?<=/)\d+", True, False,,,,, String.Empty))
+                    Dim PostID$ = RegexReplace(URL, RParams.DM("(?<=/)\d+", 0))
                     If Not PostID.IsEmptyString Then
-                        Dim r$ = Settings.Site(Sites.Twitter).Responser.GetResponse($"https://api.twitter.com/1.1/statuses/show.json?id={PostID}",,
+                        Dim r$ = DirectCast(resp.Copy(), Response).
-                                                                                    EDP.ReturnValue)
+                                            GetResponse($"https://api.twitter.com/1.1/statuses/show.json?id={PostID}",, EDP.ReturnValue)
                         If Not r.IsEmptyString Then
                             Using j As EContainer = JsonDocument.Parse(r)
                                 If j.ListExists Then
                                     Dim u$ = GetVideoNodeURL(j)
-                                    If Not u.IsEmptyString Then Return MediaFromData(u, PostID, String.Empty)
+                                    If Not u.IsEmptyString Then Return {MediaFromData(u, PostID, String.Empty)}
                                 End If
                             End Using
                         End If
@@ -147,12 +137,12 @@ Namespace API.Twitter
                     Next
                     If l.Count > 0 Then
                         l.Sort()
-                        If l(0).Name.IsEmptyString And LargeContained Then Return "large" Else Return l(0).Name
+                        If l(0).Data.IsEmptyString And LargeContained Then Return "large" Else Return l(0).Data
                     End If
                 End If
                 Return String.Empty
             Catch ex As Exception
-                LogError(ex, "[GetPictureOption]")
+                LogError(ex, "[API.Twitter.UserData.GetPictureOption]")
                 Return String.Empty
             End Try
         End Function
@@ -161,10 +151,17 @@ Namespace API.Twitter
         Private Function CheckVideoNode(ByVal w As EContainer, ByVal PostID As String, ByVal PostDate As String) As Boolean
             Try
                 Dim URL$ = GetVideoNodeURL(w)
-                If Not URL.IsEmptyString Then _TempMediaList.ListAddValue(MediaFromData(URL, PostID, PostDate), LNC) : Return True
+                If Not URL.IsEmptyString Then
+                    Dim f$ = UrlFile(URL)
+                    If Not f.IsEmptyString AndAlso Not _DataNames.Contains(f) Then
+                        _DataNames.Add(f)
+                        _TempMediaList.ListAddValue(MediaFromData(URL, PostID, PostDate), LNC)
+                    End If
+                    Return True
+                End If
                 Return False
             Catch ex As Exception
-                LogError(ex, "[CheckVideoNode]")
+                LogError(ex, "[API.Twitter.UserData.CheckVideoNode]")
                 Return False
             End Try
         End Function
@@ -185,12 +182,20 @@ Namespace API.Twitter
                     End If
                 Next
                 If l.Count > 0 Then l.RemoveAll(Function(s) s.HasError)
-                If l.Count > 0 Then l.Sort() : Return l(0).Name
+                If l.Count > 0 Then l.Sort() : Return l(0).Data
             End If
             Return String.Empty
         End Function
         Protected Overrides Sub ReparseVideo(ByVal Token As CancellationToken)
         End Sub
+        Private Function UrlFile(ByVal URL As String) As String
+            Try
+                Dim f As SFile = CStr(RegexReplace(LinkFormatterSecure(RegexReplace(URL.Replace("\", String.Empty), LinkPattern)), FilesPattern))
+                If Not f.IsEmptyString Then Return f.File Else Return String.Empty
+            Catch ex As Exception
+                Return String.Empty
+            End Try
+        End Function
 #End Region
         Private Shared Function MediaFromData(ByVal _URL As String, ByVal PostID As String, ByVal PostDate As String,
                                               Optional ByVal _PictureOption As String = "") As UserMedia
@@ -205,62 +210,24 @@ Namespace API.Twitter
         End Function
 #End Region
         Protected Overrides Sub DownloadContent(ByVal Token As CancellationToken)
-            Try
+            DownloadContentDefault(Token)
-                Dim i%
+        End Sub
-                ThrowAny(Token)
+        Protected Overrides Function DownloadingException(ByVal ex As Exception, ByVal Message As String, Optional ByVal FromPE As Boolean = False) As Integer
-                If _ContentNew.Count > 0 Then
+            If Responser.StatusCode = HttpStatusCode.NotFound Then
-                    _ContentNew.RemoveAll(Function(c) c.URL.IsEmptyString)
+                UserExists = False
-                    If _ContentNew.Count > 0 Then
+            ElseIf Responser.StatusCode = HttpStatusCode.Unauthorized Then
-                        MyFile.Exists(SFO.Path)
+                UserSuspended = True
-                        Dim MyDir$ = MyFile.CutPath.Path
+            ElseIf Responser.StatusCode = HttpStatusCode.BadRequest Then
-                        Dim vsf As Boolean = SeparateVideoFolderF
+                MyMainLOG = "Twitter has invalid credentials"
-                        Dim f As SFile
+            Else
-                        Dim v As UserMedia
+                If Not FromPE Then LogError(ex, Message) : HasError = True
-                        Using w As New WebClient
+                Return 0
-                            If vsf Then SFileShares.SFileExists($"{MyDir}\Video\", SFO.Path)
+            End If
-                            MainProgress.TotalCount += _ContentNew.Count
+            Return 1
-                            For i = 0 To _ContentNew.Count - 1
+        End Function
-                                ThrowAny(Token)
+        Protected Overrides Sub Dispose(ByVal disposing As Boolean)
-                                v = _ContentNew(i)
+            If Not disposedValue And disposing Then _DataNames.Clear()
-                                v.State = UStates.Tried
+            MyBase.Dispose(disposing)
-                                If v.File.IsEmptyString Then
-                                    f = v.URL
-                                Else
-                                    f = v.File
-                                End If
-                                f.Separator = "\"
-                                f.Path = MyDir
-
-                                If v.URL_BASE.IsEmptyString Then v.URL_BASE = v.URL
-
-                                If Not v.File.IsEmptyString AndAlso Not v.URL_BASE.IsEmptyString Then
-                                    Try
-                                        If f.Extension = "mp4" And vsf Then f.Path = $"{f.PathWithSeparator}Video"
-                                        w.DownloadFile(v.URL_BASE, f.ToString)
-                                        Select Case f.Extension
-                                            Case "mp4" : v.Type = UserMedia.Types.Video : DownloadedVideos += 1 : _CountVideo += 1
-                                            Case Else : v.Type = UserMedia.Types.Picture : DownloadedPictures += 1 : _CountPictures += 1
-                                        End Select
-                                        v.File = ChangeFileNameByProvider(f, v)
-                                        v.State = UStates.Downloaded
-                                    Catch wex As Exception
-                                        ErrorDownloading(f, v.URL_BASE)
-                                    End Try
-                                Else
-                                    v.State = UStates.Skipped
-                                End If
-                                _ContentNew(i) = v
-                                MainProgress.Perform()
-                            Next
-                        End Using
-                    End If
-                End If
-            Catch oex As OperationCanceledException When Token.IsCancellationRequested
-            Catch dex As ObjectDisposedException When Disposed
-            Catch ex As Exception
-                LogError(ex, "content downloading error")
-                HasError = True
-            End Try
         End Sub
     End Class
 End Namespace

SCrawler/API/UserDataBind.vb

@@ -1,11 +1,21 @@
-Imports PersonalUtilities.Tools
+' Copyright (C) 2022  Andy
+' This program is free software: you can redistribute it and/or modify
+' it under the terms of the GNU General Public License as published by
+' the Free Software Foundation, either version 3 of the License, or
+' (at your option) any later version.
+'
+' This program is distributed in the hope that it will be useful,
+' but WITHOUT ANY WARRANTY
+Imports PersonalUtilities.Tools
+Imports PersonalUtilities.Functions.XML
+Imports PersonalUtilities.Functions.Messaging
 Imports System.Threading
 Imports SCrawler.API.Base
 Namespace API
     Friend Class UserDataBind : Inherits UserDataBase : Implements ICollection(Of IUserData), IMyEnumerator(Of IUserData)
-        Friend Event OnCollectionSelfRemoved()
+        Friend Event OnCollectionSelfRemoved(ByVal Collection As IUserData)
+        Friend Event OnUserRemoved(ByVal User As IUserData)
 #Region "Declarations"
-        Friend Overrides Property Site As Sites = Sites.Undefined
         Friend ReadOnly Property Collections As List(Of IUserData)
         Private _CollectionName As String = String.Empty
         Friend Overrides Property CollectionName As String
@@ -28,6 +38,20 @@ Namespace API
                 CollectionName = NewCollectionName
             End Set
         End Property
+        Friend Overrides Property UserExists As Boolean
+            Get
+                Return Count > 0 AndAlso Collections.Exists(Function(c) c.Exists)
+            End Get
+            Set(ByVal e As Boolean)
+            End Set
+        End Property
+        Friend Overrides Property UserSuspended As Boolean
+            Get
+                Return Count > 0 AndAlso Collections.LongCount(Function(c) c.Suspended) = Count
+            End Get
+            Set(ByVal s As Boolean)
+            End Set
+        End Property
         Friend Overrides Sub ChangeCollectionName(ByVal NewName As String, ByVal UpdateSettings As Boolean)
             _CollectionName = NewName
             If Count > 0 Then Collections.ForEach(Sub(c) c.CollectionName = NewName)
@@ -98,7 +122,7 @@ Namespace API
         Friend Overrides Property DataMerging As Boolean
             Get
                 If Count > 0 Then
-                    Return DirectCast(Collections(0).Self, UserDataBase).DataMerging
+                    Return DirectCast(Collections(0), UserDataBase).DataMerging
                 Else
                     Return False
                 End If
@@ -161,15 +185,15 @@ Namespace API
         End Property
         Friend Overrides Function GetUserInformation() As String
             Dim OutStr$ = String.Empty
-            If Count > 0 Then Collections.ForEach(Sub(c) OutStr.StringAppendLine(DirectCast(c.Self, UserDataBase).GetUserInformation(), $"{vbCrLf}{vbCrLf}"))
+            If Count > 0 Then Collections.ForEach(Sub(c) OutStr.StringAppendLine(DirectCast(c, UserDataBase).GetUserInformation(), $"{vbCrLf}{vbCrLf}"))
             Return OutStr
         End Function
         Friend Overrides Property LastUpdated As Date?
             Get
                 If Count > 0 Then
-                    With If((From c In Collections
+                    With If((From c As IUserData In Collections
-                             Where DirectCast(c.Self, UserDataBase).LastUpdated.HasValue
+                             Where DirectCast(c, UserDataBase).LastUpdated.HasValue
-                             Select DirectCast(c.Self, UserDataBase).LastUpdated.Value).ToList, New List(Of Date))
+                             Select DirectCast(c, UserDataBase).LastUpdated.Value).ToList, New List(Of Date))
                         If .Count > 0 Then Return .Max
                     End With
                 End If
@@ -187,7 +211,7 @@ Namespace API
         Friend ReadOnly Property ContextDown As ToolStripMenuItem()
             Get
                 If Count > 0 Then
-                    Return Collections.Select(Function(c) DirectCast(c.Self, UserDataBase).BTT_CONTEXT_DOWN).ToArray
+                    Return Collections.Select(Function(c) DirectCast(c, UserDataBase).BTT_CONTEXT_DOWN).ToArray
                 Else
                     Return New ToolStripMenuItem() {}
                 End If
@@ -196,7 +220,7 @@ Namespace API
         Friend ReadOnly Property ContextEdit As ToolStripMenuItem()
             Get
                 If Count > 0 Then
-                    Return Collections.Select(Function(c) DirectCast(c.Self, UserDataBase).BTT_CONTEXT_EDIT).ToArray
+                    Return Collections.Select(Function(c) DirectCast(c, UserDataBase).BTT_CONTEXT_EDIT).ToArray
                 Else
                     Return New ToolStripMenuItem() {}
                 End If
@@ -205,7 +229,7 @@ Namespace API
         Friend ReadOnly Property ContextDelete As ToolStripMenuItem()
             Get
                 If Count > 0 Then
-                    Return Collections.Select(Function(c) DirectCast(c.Self, UserDataBase).BTT_CONTEXT_DELETE).ToArray
+                    Return Collections.Select(Function(c) DirectCast(c, UserDataBase).BTT_CONTEXT_DELETE).ToArray
                 Else
                     Return New ToolStripMenuItem() {}
                 End If
@@ -214,7 +238,7 @@ Namespace API
         Friend ReadOnly Property ContextPath As ToolStripMenuItem()
             Get
                 If Count > 0 Then
-                    Return Collections.Select(Function(c) DirectCast(c.Self, UserDataBase).BTT_CONTEXT_OPEN_PATH).ToArray
+                    Return Collections.Select(Function(c) DirectCast(c, UserDataBase).BTT_CONTEXT_OPEN_PATH).ToArray
                 Else
                     Return New ToolStripMenuItem() {}
                 End If
@@ -223,7 +247,7 @@ Namespace API
         Friend ReadOnly Property ContextSite As ToolStripMenuItem()
             Get
                 If Count > 0 Then
-                    Return Collections.Select(Function(c) DirectCast(c.Self, UserDataBase).BTT_CONTEXT_OPEN_SITE).ToArray
+                    Return Collections.Select(Function(c) DirectCast(c, UserDataBase).BTT_CONTEXT_OPEN_SITE).ToArray
                 Else
                     Return New ToolStripMenuItem() {}
                 End If
@@ -247,7 +271,9 @@ Namespace API
             If Count > 0 Then Collections.ForEach(Sub(c) c.UpdateUserInformation())
         End Sub
         Friend Overrides Sub LoadContentInformation()
-            If Count > 0 Then Collections.ForEach(Sub(c) DirectCast(c.Self, UserDataBase).LoadContentInformation())
+            If Count > 0 Then Collections.ForEach(Sub(c) DirectCast(c, UserDataBase).LoadContentInformation())
+        End Sub
+        Protected Overrides Sub LoadUserInformation_OptionalFields(ByRef Container As XmlFile, ByVal Loading As Boolean)
         End Sub
         Friend Overrides Property DownloadTopCount As Integer?
             Get
@@ -270,15 +296,19 @@ Namespace API
         End Sub
         Protected Overrides Sub DownloadContent(ByVal Token As CancellationToken)
         End Sub
-        Private Sub User_OnPictureUpdated(ByVal User As IUserData)
+        Protected Overrides Function DownloadingException(ByVal ex As Exception, ByVal Message As String, Optional ByVal FromPE As Boolean = False) As Integer
-            Raise_OnPictureUpdated()
+            Return 0
+        End Function
+        Private Sub User_OnUserUpdated(ByVal User As IUserData)
+            RaiseEvent_OnUserUpdated()
         End Sub
-        Friend Overrides Sub OpenSite()
+        Friend Overrides Sub OpenSite(Optional ByVal e As ErrorsDescriber = Nothing)
-            If Count > 0 Then Collections(0).OpenSite()
+            If Not e.Exists Then e = New ErrorsDescriber(EDP.SendInLog)
+            If Count > 0 Then Collections.ForEach(Sub(c) c.OpenSite(e))
         End Sub
         Friend Overrides Sub OpenFolder()
             Try
-                If Count > 0 Then Collections(0).File.CutPath(2).Open(SFO.Path, EDP.None)
+                If Count > 0 Then GlobalOpenPath(Collections(0).File.CutPath(2))
             Catch ex As Exception
             End Try
         End Sub
@@ -300,32 +330,56 @@ Namespace API
                     If DataMerging Then DirectCast(.Self, UserDataBase).MergeData()
                     Collections.Add(_Item)
                     With Collections.Last
-                        If Collections.Count - 1 > 0 Then
+                        If Count > 1 Then
+                            If _CollectionName.IsEmptyString Then _CollectionName = .CollectionName
                             .Temporary = Temporary
                             .Favorite = Favorite
+                            .ReadyForDownload = ReadyForDownload
+                            ConsolidateLabels()
                             .UpdateUserInformation()
                         End If
                         ImageHandler(_Item, False)
-                        AddHandler .Self.OnPictureUpdated, AddressOf User_OnPictureUpdated
+                        AddRemoveBttDeleteHandler(.Self, True)
-                        DirectCast(.Self, UserDataBase).CreateButtons(Count - 1)
+                        AddHandler .Self.OnUserUpdated, AddressOf User_OnUserUpdated
                     End With
                 Else
-                    Throw New InvalidOperationException("User data doe not move to the collection folder")
+                    Throw New InvalidOperationException("User data was not moved to the collection folder")
                 End If
             End With
         End Sub
         ''' <summary>FOR SETTINGS START LOADING ONLY</summary>
         Friend Overloads Sub Add(ByVal u As UserInfo, Optional ByVal _LoadData As Boolean = True)
-            Select Case u.Site
+            Collections.Add(GetInstance(u, _LoadData))
-                Case Sites.Reddit : Collections.Add(New Reddit.UserData(u, _LoadData))
+            If Not Collections.Last Is Nothing Then
-                Case Sites.Twitter : Collections.Add(New Twitter.UserData(u, _LoadData))
+                With Collections.Last
-                Case Else : Exit Sub
+                    If _CollectionName.IsEmptyString Then _CollectionName = .CollectionName
-            End Select
+                    AddRemoveBttDeleteHandler(.Self, True)
-            With DirectCast(Collections.Last.Self, UserDataBase)
+                    AddHandler .OnUserUpdated, AddressOf User_OnUserUpdated
-                .CreateButtons(Count - 1)
+                End With
-                AddHandler .BTT_CONTEXT_DELETE.Click, AddressOf BTT_CONTEXT_DELETE_Click
+            Else
-            End With
+                Collections.RemoveAt(Count - 1)
-            AddHandler Collections(Count - 1).OnPictureUpdated, AddressOf User_OnPictureUpdated
+            End If
+        End Sub
+        Private Sub AddRemoveBttDeleteHandler(ByRef User As IUserData, ByVal IsAdd As Boolean)
+            Try
+                With DirectCast(User, UserDataBase)
+                    If IsAdd Then
+                        .CreateButtons(Count - 1)
+                        AddHandler .BTT_CONTEXT_DELETE.Click, AddressOf DeleteRemoveUserFromCollection
+                    Else
+                        RemoveHandler .BTT_CONTEXT_DELETE.Click, AddressOf DeleteRemoveUserFromCollection
+                    End If
+                End With
+            Catch ex As Exception
+            End Try
+        End Sub
+        Private Sub ConsolidateLabels()
+            If Count > 1 Then
+                Dim l As New List(Of String)
+                Dim lp As New ListAddParams(LAP.ClearBeforeAdd)
+                l.ListAddList(Collections.SelectMany(Function(c) c.Labels), LNC)
+                Collections.ForEach(Sub(c) c.Labels.ListAddList(l, lp))
+            End If
         End Sub
         Friend Sub AddRange(ByVal _Items As IEnumerable(Of IUserData))
             If Not _Items Is Nothing AndAlso _Items.Count > 0 Then
@@ -333,7 +387,7 @@ Namespace API
             End If
         End Sub
         Friend Overrides Function MoveFiles(ByVal __CollectionName As String) As Boolean
-            Throw New NotImplementedException("Files moving does not available if collection context")
+            Throw New NotImplementedException("Move files is not available in the collection context")
         End Function
         Friend Overloads Sub MergeData(ByVal Merging As Boolean)
             If Count > 0 Then
@@ -342,7 +396,7 @@ Namespace API
                         MsgBoxE($"Collection [{CollectionName}] data already merged")
                     Else
                         If Collections.Count > 1 Then
-                            Collections.ForEach(Sub(c) DirectCast(c.Self, UserDataBase).MergeData())
+                            Collections.ForEach(Sub(c) DirectCast(c, UserDataBase).MergeData())
                             MsgBoxE($"Collection [{CollectionName}] data merged")
                         Else
                             MsgBoxE($"Collection [{CollectionName}] contains only one user profile" & vbCr &
@@ -375,8 +429,10 @@ Namespace API
                         "Operation canceled", MsgBoxStyle.Critical)
                 Return False
             Else
-                DirectCast(_Item.Self, UserDataBase).MoveFiles(String.Empty)
+                DirectCast(_Item, UserDataBase).MoveFiles(String.Empty)
                 ImageHandler(_Item)
+                AddRemoveBttDeleteHandler(_Item, False)
+                RaiseEvent OnUserRemoved(_Item)
                 Return Collections.Remove(_Item)
             End If
         End Function
@@ -385,21 +441,23 @@ Namespace API
                 Dim f As SFile
                 If MsgBoxE({$"Collection may contain data{vbCr}Do you really want to delete collection and all of it files?", "Collection deleting"},
                            MsgBoxStyle.Exclamation + MsgBoxStyle.YesNo) = MsgBoxResult.Yes Then
-                    f = Collections(0).File.CutPath(2).PathWithSeparator
+                    f = Collections(0).File.CutPath(IIf(DataMerging, 1, 2)).PathWithSeparator
                     Settings.Users.Remove(Me)
                     Collections.ForEach(Sub(c) c.Delete())
                     Downloader.UserRemove(Me)
                     ImageHandler(Me, False)
                     Collections.ListClearDispose
                     Dispose(False)
-                    If f.Exists(SFO.Path, False) Then f.Delete(SFO.Path, True, False, EDP.SendInLog)
+                    f.Delete(SFO.Path, SFODelete.EmptyOnly + Settings.DeleteMode, EDP.SendInLog)
                     Return 2
                 Else
                     If DataMerging Then
                         MsgBoxE($"Collection [{CollectionName}] data are already merged{vbCr}Cannot split merged collection{vbCr}Operation canceled", MsgBoxStyle.Exclamation)
                         Return 0
                     End If
-                    If MsgBoxE({$"Do you want to delete collection only?{vbCr}Users will not be deleted", "Collection deleting"},
+                    If MsgBoxE({"Do you want to delete only the collection and split users' profiles??" & vbCr &
+                                "Users will be removed from the collection and split by sites." & vbCr &
+                                "All user data will remain.", "Collection deleting"},
                                MsgBoxStyle.Question + MsgBoxStyle.YesNo) = MsgBoxResult.Yes Then
                         f = Collections(0).File.CutPath(2)
                         Settings.Users.Remove(Me)
@@ -408,7 +466,7 @@ Namespace API
                                                 ImageHandler(c)
                                             End Sub)
                         Collections.Clear()
-                        f.Delete(SFO.Path,,, EDP.SendInLog)
+                        f.Delete(SFO.Path, SFODelete.Default + Settings.DeleteMode, EDP.SendInLog)
                         Downloader.UserRemove(Me)
                         ImageHandler(Me, False)
                         Dispose(False)
@@ -420,28 +478,45 @@ Namespace API
             End If
             Return 0
         End Function
-        Private Sub BTT_CONTEXT_DELETE_Click(sender As Object, e As EventArgs)
+        Private Sub DeleteRemoveUserFromCollection(sender As Object, e As EventArgs)
             With DirectCast(sender, ToolStripMenuItem)
                 Dim i% = AConvert(Of Integer)(.Tag, -1)
                 If i >= 0 Then
                     Dim n$ = Collections(i).Name
                     Dim s$ = Collections(i).Site.ToString
-                    If MsgBoxE({$"Do you really want to delete user profile [{n}] of site [{s}]?" & vbCr &
+                    Dim RemoveMeIfNull As Action = Sub()
-                                "This profile will be removed from collection and all data will be erased",
+                                                       If Count = 0 Then
-                                "Profile removing"}, MsgBoxStyle.Exclamation,,, {"Process", "Cancel"}) = 0 Then
+                                                           Settings.Users.Remove(Me)
-                        Collections(i).Delete()
+                                                           ImageHandler(Me, False)
-                        Collections(i).Dispose()
+                                                           RaiseEvent OnCollectionSelfRemoved(Me)
-                        Collections.RemoveAt(i)
+                                                           Dispose(False)
-                        MsgBoxE($"User profile [{n}] of site [{s}] has been removed")
+                                                       End If
-                        If Count = 0 Then
+                                                   End Sub
-                            Settings.Users.Remove(Me)
+                    Select Case MsgBoxE({$"Are you sure you want to remove user profile [{n}] of site [{s}] from collection [{Name}]?" & vbCr &
-                            ImageHandler(Me, False)
+                                         "You can remove a user from the collection while keeping data (Remove) or deleting the data (Delete)" & vbCr &
-                            RaiseEvent OnCollectionSelfRemoved()
+                                         "Deleting this profile will remove it from the collection and all its data will be erased." & vbCr &
-                            Dispose(False)
+                                         "Removing this profile will remove it from the collection and all its data will remain." &
-                        End If
+                                         "This user will still appear in the program, but not in the collection.",
-                    Else
+                                         "Deleting a user"}, vbExclamation,,,
-                        MsgBoxE("Operation canceled")
+                                         {
-                    End If
+                                          New MsgBoxButton("Remove") With {
+                                            .ToolTip = "Remove a user from the collection only. All its data will remain. The user will appear in the program."},
+                                          New MsgBoxButton("Delete") With {
+                                            .ToolTip = "Delete a user from the collection and erase their data."},
+                                          "Cancel"
+                                         }).Index
+                        Case 0
+                            Remove(Collections(i))
+                            MsgBoxE($"User [{s} - {n}] has been removed from the collection. Now it should be displayed in the program.")
+                            RemoveMeIfNull.Invoke
+                        Case 1
+                            Collections(i).Delete()
+                            Collections(i).Dispose()
+                            Collections.RemoveAt(i)
+                            MsgBoxE($"User profile [{n}] of site [{s}] has been deleted")
+                            RemoveMeIfNull.Invoke
+                        Case Else : MsgBoxE("Operation canceled")
+                    End Select
                 End If
             End With
         End Sub
@@ -454,26 +529,6 @@ Namespace API
         End Function
 #End Region
 #End Region
-        Friend Overrides Function CompareTo(ByVal Other As UserDataBase) As Integer
-            If TypeOf Other Is UserDataBind Then
-                Dim x% = CompareValue(Me)
-                Dim y% = CompareValue(Other)
-                If x.CompareTo(y) = 0 Then
-                    Return CollectionName.CompareTo(Other.CollectionName)
-                Else
-                    Return x.CompareTo(y)
-                End If
-            Else
-                Return -1
-            End If
-        End Function
-        Friend Overrides Function CompareTo(ByVal Obj As Object) As Integer
-            If TypeOf Obj Is UserDataBind Then
-                Return CompareTo(DirectCast(Obj, UserDataBind))
-            Else
-                Return -1
-            End If
-        End Function
         Friend Overrides Function Equals(ByVal Other As UserDataBase) As Boolean
             If Other.IsCollection Then
                 Return CollectionName = Other.CollectionName

SCrawler/Channels/ChannelViewForm.vb

@@ -1,4 +1,12 @@
-Imports PersonalUtilities.Forms
+' Copyright (C) 2022  Andy
+' This program is free software: you can redistribute it and/or modify
+' it under the terms of the GNU General Public License as published by
+' the Free Software Foundation, either version 3 of the License, or
+' (at your option) any later version.
+'
+' This program is distributed in the hope that it will be useful,
+' but WITHOUT ANY WARRANTY
+Imports PersonalUtilities.Forms
 Imports PersonalUtilities.Forms.Toolbars
 Imports PersonalUtilities.Forms.Controls
 Imports PersonalUtilities.Forms.Controls.Base
@@ -7,24 +15,31 @@ Imports System.ComponentModel
 Imports System.Threading
 Imports SCrawler.API.Base
 Imports SCrawler.API.Reddit
+Imports SCrawler.Plugin.Hosts
 Imports CmbDefaultButtons = PersonalUtilities.Forms.Controls.Base.ActionButton.DefaultButtons
 Imports RButton = PersonalUtilities.Tools.RangeSwitcherButton.Types
 Friend Class ChannelViewForm : Implements IChannelLimits
     Friend Event OnUsersAdded(ByVal StartIndex As Integer)
+    Friend Event OnDownloadDone(ByVal Message As String)
 #Region "Appended user structure"
     Private Structure PendingUser
         Friend ID As String
         Friend File As SFile
-        Friend Sub New(ByVal _ID As String, Optional ByVal _File As SFile = Nothing)
+        Friend Channel As Channel
+        Friend Sub New(ByVal _ID As String, ByRef _Channel As Channel, Optional ByVal _File As SFile = Nothing)
             ID = _ID
+            Channel = _Channel
             If Settings.FromChannelCopyImageToUser Then File = _File
         End Sub
         Public Shared Widening Operator CType(ByVal _ID As String) As PendingUser
-            Return New PendingUser(_ID, False)
+            Return New PendingUser(_ID, Nothing)
         End Operator
         Public Shared Widening Operator CType(ByVal u As PendingUser) As String
             Return u.ToString
         End Operator
+        Friend Sub ChannelUserAdded(Optional ByVal IsAdded As Boolean = True)
+            If Not Channel Is Nothing Then Channel.UserAdded(ID, IsAdded)
+        End Sub
         Public Overrides Function ToString() As String
             Return ID
         End Function
@@ -45,6 +60,7 @@ Friend Class ChannelViewForm : Implements IChannelLimits
     Private WithEvents OPT_LIMITS_COUNT As RadioButton
     Private WithEvents OPT_LIMITS_POST As RadioButton
     Private WithEvents OPT_LIMITS_DATE As RadioButton
+    Private WithEvents BTT_SHOW_STATS As ToolStripButton
 #End Region
     Private ReadOnly CProvider As ANumbers
     Private ReadOnly CProgress As MyProgress
@@ -70,7 +86,7 @@ Friend Class ChannelViewForm : Implements IChannelLimits
     Private Property DownloadLimitCount As Integer? Implements IChannelLimits.DownloadLimitCount
         Get
             If OPT_LIMITS_COUNT.Checked Then
-                Return AConvert(Of Integer)(TXT_LIMIT.Text, Nothing)
+                Return AConvert(Of Integer)(TXT_LIMIT.Text, AModes.Var, Nothing)
             Else
                 Return Nothing
             End If
@@ -92,7 +108,7 @@ Friend Class ChannelViewForm : Implements IChannelLimits
     Private Property DownloadLimitDate As Date? Implements IChannelLimits.DownloadLimitDate
         Get
             If OPT_LIMITS_DATE.Checked Then
-                Return AConvert(Of Date)(TXT_LIMIT.Value, Nothing)
+                Return AConvert(Of Date)(TXT_LIMIT.Value, AModes.Var, Nothing)
             Else
                 Return Nothing
             End If
@@ -106,6 +122,7 @@ Friend Class ChannelViewForm : Implements IChannelLimits
     Private Sub SetLimit(ByVal Source As IChannelLimits) Implements IChannelLimits.SetLimit
     End Sub
 #End Region
+    Private ReadOnly HOST As SettingsHost
     Private ReadOnly PendingUsers As List(Of PendingUser)
     Private ReadOnly LNC As New ListAddParams(LAP.NotContainsOnly)
     Private WithEvents MyRange As RangeSwitcher(Of UserPost)
@@ -126,9 +143,10 @@ Friend Class ChannelViewForm : Implements IChannelLimits
         InitializeComponent()
         MyDefs = New DefaultFormProps
         CProgress = New MyProgress(ToolbarBOTTOM, PR_CN, LBL_STATUS, "Downloading data") With {.PerformMod = 10, .DropCurrentProgressOnTotalChange = False}
-        CProvider = New ANumbers(ANumbers.Modes.USA) With {.GroupSize = 3, .DecimalDigits = 0}
+        CProvider = New ANumbers With {.FormatOptions = ANumbers.Options.GroupIntegral}
         LimitProvider = New ADateTime("dd.MM.yyyy HH:mm")
         PendingUsers = New List(Of PendingUser)
+        HOST = Settings(RedditSiteKey)
 
         CMB_CHANNELS = New ComboBoxExtended With {
             .CaptionMode = ICaptionControl.Modes.CheckBox,
@@ -141,7 +159,8 @@ Friend Class ChannelViewForm : Implements IChannelLimits
         }
         CMB_CHANNELS.Buttons.AddRange({CmbDefaultButtons.Refresh, CmbDefaultButtons.Add, CmbDefaultButtons.Delete,
                                        New ActionButton(CmbDefaultButtons.Up) With {.ToolTipText = "Previous item (F1)"},
-                                       New ActionButton(CmbDefaultButtons.Down) With {.ToolTipText = "Next item (F4)"}})
+                                       New ActionButton(CmbDefaultButtons.Down) With {.ToolTipText = "Next item (F4)"},
+                                       CmbDefaultButtons.Info})
         TXT_LIMIT = New TextBoxExtended With {
             .CaptionText = "Limit",
             .Margin = New Padding(2),
@@ -160,6 +179,9 @@ Friend Class ChannelViewForm : Implements IChannelLimits
         OPT_LIMITS_DATE = New RadioButton With {.Text = "Date", .BackColor = Color.Transparent, .Margin = New Padding(2)}
         CH_HIDE_EXISTS_USERS = New CheckBox With {.Text = "Hide exists users", .BackColor = Color.Transparent, .Margin = New Padding(2),
                                                   .Checked = Settings.ChannelsHideExistsUser}
+        BTT_SHOW_STATS = New ToolStripButton With {.Text = "Info", .Image = PersonalUtilities.My.Resources.InfoPic_32,
+                                                   .DisplayStyle = ToolStripItemDisplayStyle.ImageAndText, .Alignment = ToolStripItemAlignment.Right,
+                                                   .AutoToolTip = True, .ToolTipText = "Show channels statistic"}
 
         TT_MAIN.SetToolTip(CH_HIDE_EXISTS_USERS, "Hide users which already exists in collection")
         TT_MAIN.SetToolTip(OPT_LIMITS_COUNT, "Total posts count limit")
@@ -174,8 +196,9 @@ Friend Class ChannelViewForm : Implements IChannelLimits
                                   TXT_LIMIT.GetControlHost,
                                   LBL_LIMIT_TEXT,
                                   New ToolStripSeparator,
-                                  New ToolStripControlHost(CH_HIDE_EXISTS_USERS)})
+                                  New ToolStripControlHost(CH_HIDE_EXISTS_USERS),
-        MyRange = New RangeSwitcher(Of UserPost) With {.Selector = Function(p) Not Settings.UserExists(Sites.Reddit, p.UserID)}
+                                  BTT_SHOW_STATS})
+        MyRange = New RangeSwitcher(Of UserPost) With {.Selector = SelectorExpression}
         With MyRange
             .Limit = ImagesInRow * ImagesRows
             .InsertButtons(ToolbarTOP, {RButton.Previous, RButton.Next}, 5)
@@ -184,7 +207,6 @@ Friend Class ChannelViewForm : Implements IChannelLimits
             .BindForm(Me)
             .LabelNumbersProvider = CProvider
             .UpdateControls()
-            .Selector = SelectorExpression
         End With
         AddHandler Settings.ChannelsImagesColumns.OnValueChanged, AddressOf ImagesCountChanged
         AddHandler Settings.ChannelsImagesRows.OnValueChanged, AddressOf ImagesCountChanged
@@ -217,6 +239,8 @@ Friend Class ChannelViewForm : Implements IChannelLimits
         OPT_LIMITS_COUNT.Dispose()
         OPT_LIMITS_POST.Dispose()
         LBL_LIMIT_TEXT.Dispose()
+        BTT_SHOW_STATS.Dispose()
+        MyRange.Dispose()
         PendingUsers.Clear()
         MyDefs.Dispose()
     End Sub
@@ -258,9 +282,11 @@ Friend Class ChannelViewForm : Implements IChannelLimits
 #Region "Images refill methods"
     Private Sub AppendPendingUsers()
         If LIST_POSTS.CheckedIndices.Count > 0 Then
+            Dim c As Channel = GetCurrentChannel(False)
+            Dim lp As New ListAddParams(LAP.NotContainsOnly) With {.OnAddAction = Sub(ByVal u As PendingUser) u.ChannelUserAdded()}
             PendingUsers.ListAddList((From p As ListViewItem In LIST_POSTS.Items
                                       Where p.Checked
-                                      Select New PendingUser(p.Text, GetPostBySelected(CStr(p.Tag)).CachedFile)), LNC)
+                                      Select New PendingUser(p.Text, c, GetPostBySelected(CStr(p.Tag)).CachedFile)), lp)
             Dim a As Action = Sub() BTT_ADD_USERS.Text = $"Add ({PendingUsers.Count.ToString(CProvider)})"
             If ToolbarTOP.InvokeRequired Then ToolbarTOP.Invoke(a) Else a.Invoke
         End If
@@ -300,7 +326,7 @@ Friend Class ChannelViewForm : Implements IChannelLimits
     Private Async Sub BTT_DOWNLOAD_Click(sender As Object, e As EventArgs) Handles BTT_DOWNLOAD.Click
         Try
             AppendPendingUsers()
-            If Not TokenSource Is Nothing Then Exit Sub
+            If Not TokenSource Is Nothing OrElse Not HOST.Source.Available(Plugin.ISiteSettings.Download.Channel) Then Exit Sub
             Dim InvokeToken As Action = Sub()
                                             If TokenSource Is Nothing Then
                                                 CProgress.TotalCount = 0
@@ -316,6 +342,7 @@ Friend Class ChannelViewForm : Implements IChannelLimits
                                                 TXT_LIMIT.Enabled = False
                                                 CH_HIDE_EXISTS_USERS.Enabled = False
                                                 CMB_CHANNELS.Enabled(True) = False
+                                                BTT_SHOW_STATS.Enabled = False
                                                 MyRange.EnableButton(RButton.Previous, False)
                                                 MyRange.EnableButton(RButton.Next, False)
                                             End If
@@ -329,6 +356,8 @@ Friend Class ChannelViewForm : Implements IChannelLimits
                     _CollectionDownloading = True
                     Settings.Channels.SetLimit(Me)
                     Await Task.Run(Sub() Settings.Channels.DownloadData(Token, CH_HIDE_EXISTS_USERS.Checked, CProgress))
+                    Settings.Channels.UpdateUsersStats()
+                    RaiseEvent OnDownloadDone("All channels downloaded")
                     Token.ThrowIfCancellationRequested()
                     c = GetCurrentChannel()
                 Else
@@ -337,6 +366,8 @@ Friend Class ChannelViewForm : Implements IChannelLimits
                         InvokeToken.Invoke()
                         c.SetLimit(Me)
                         Await Task.Run(Sub() c.DownloadData(Token, CH_HIDE_EXISTS_USERS.Checked, CProgress))
+                        c.UpdateUsersStats()
+                        RaiseEvent OnDownloadDone($"Channel [{c.Name}] downloaded")
                         Token.ThrowIfCancellationRequested()
                     End If
                 End If
@@ -369,6 +400,7 @@ Friend Class ChannelViewForm : Implements IChannelLimits
                 TXT_LIMIT.Enabled = True
                 CH_HIDE_EXISTS_USERS.Enabled = True
                 CMB_CHANNELS.Enabled(True) = True
+                BTT_SHOW_STATS.Enabled = True
                 CMB_CHANNELS_ActionOnCheckedChange(CMB_CHANNELS.Checked)
                 With MyRange
                     .EnableButton(RButton.Previous, .Count > 0 AndAlso .CurrentIndex > 0)
@@ -406,21 +438,34 @@ Friend Class ChannelViewForm : Implements IChannelLimits
             Dim Added% = 0, Skipped% = 0
             Dim StartIndex% = Settings.Users.Count
             Dim f As SFile
+            Dim umo As Boolean = HOST.GetUserMediaOnly
             Settings.Labels.Add(CannelsLabelName)
             Settings.Labels.Add(LabelsKeeper.NoParsedUser)
             Dim rUsers$() = UserBanned(PendingUsers.Select(Function(u) u.ID).ToArray)
             If rUsers.ListExists Then PendingUsers.RemoveAll(Function(u) rUsers.Contains(u))
             If PendingUsers.Count > 0 Then
-                With PendingUsers.Select(Function(u) New UserInfo(u, Sites.Reddit))
+                Dim c As New ListAddParams(LAP.NotContainsOnly)
+                Dim cn$
+                Dim tmpUser As IUserData
+                With PendingUsers.Select(Function(u) New UserInfo(u, HOST))
                     For i = 0 To .Count - 1
                         If Not Settings.UsersList.Contains(.ElementAt(i)) Then
                             f = PendingUsers(i).File
+                            cn = If(PendingUsers(i).Channel?.Name, String.Empty)
                             Settings.UpdateUsersList(.ElementAt(i))
-                            Settings.Users.Add(New UserData(.ElementAt(i), False) With {.Temporary = True, .CreatedByChannel = True})
+                            tmpUser = HOST.GetInstance(Plugin.ISiteSettings.Download.Main, .ElementAt(i), False)
+                            With DirectCast(tmpUser, UserData)
+                                .Temporary = Settings.ChannelsDefaultTemporary
+                                .CreatedByChannel = True
+                                .ReadyForDownload = Settings.ChannelsDefaultReadyForDownload
+                                .ParseUserMediaOnly = umo
+                            End With
+                            Settings.Users.Add(tmpUser)
                             With Settings.Users.Last
                                 .Labels.Add(CannelsLabelName)
                                 .UpdateUserInformation()
-                                If Settings.FromChannelCopyImageToUser And Not f.IsEmptyString And Not .File.IsEmptyString Then CopyFile(f, .File)
+                                If Settings.FromChannelCopyImageToUser And Not f.IsEmptyString And Not .File.IsEmptyString Then _
+                                   CopyFile(ListAddValue(Nothing, New ChannelsCollection.ChannelImage(cn, f)).ListAddList(Settings.Channels.GetUserFiles(.Name), c), .File)
                             End With
                             Added += 1
                         Else
@@ -433,17 +478,26 @@ Friend Class ChannelViewForm : Implements IChannelLimits
             BTT_ADD_USERS.Text = "Add"
             MsgBoxE($"Added users: {Added.ToString(CProvider)}{vbCr}Skipped users: {Skipped.ToString(CProvider)}{vbCr}Total: {PendingUsers.Count.ToString(CProvider)}")
             RaiseEvent OnUsersAdded(StartIndex)
+            Settings.Channels.UpdateUsersStats()
         Else
             MsgBoxE("No one users selected for add to collection")
         End If
     End Sub
-    Private Sub CopyFile(ByVal Source As SFile, ByVal Destination As SFile)
+    Private Sub CopyFile(ByVal Source As IEnumerable(Of ChannelsCollection.ChannelImage), ByVal Destination As SFile)
         Try
-            If Not Source.IsEmptyString And Not Destination.IsEmptyString Then
+            If Source.ListExists And Not Destination.IsEmptyString Then
                 Destination = Destination.CutPath.PathWithSeparator & "ChannelImage\"
-                Destination.Name = Source.Name
+                Dim f As SFile
-                Destination.Extension = Source.Extension
+                Dim i% = 0
-                If Source.Exists AndAlso Destination.Exists(SFO.Path) Then IO.File.Copy(Source, Destination)
+                If Destination.Exists(SFO.Path) Then
+                    For Each ff As ChannelsCollection.ChannelImage In Source
+                        f = Destination
+                        f.Extension = ff.File.Extension
+                        f.Name = $"{IIf(i = 0, "!", String.Empty)}{ff.Channel}_{ff.File.Name}"
+                        If ff.File.Exists Then IO.File.Copy(ff.File, f)
+                        i += 1
+                    Next
+                End If
             End If
         Catch ex As Exception
         End Try
@@ -512,12 +566,13 @@ Friend Class ChannelViewForm : Implements IChannelLimits
         If Not c Is Nothing Then MyRange.ChangeSource(c, EDP.SendInLog)
     End Sub
     Private Sub CMB_CHANNELS_ActionOnButtonClick(ByVal Sender As ActionButton) Handles CMB_CHANNELS.ActionOnButtonClick
+        Dim c As Channel
         Select Case Sender.DefaultButton
             Case CmbDefaultButtons.Refresh : RefillChannels()
             Case CmbDefaultButtons.Add : AddNewChannel()
             Case CmbDefaultButtons.Delete
                 Try
-                    Dim c As Channel = GetCurrentChannel()
+                    c = GetCurrentChannel()
                     If Not c Is Nothing AndAlso MsgBoxE($"Do you really want to delete channel [{c}]?", MsgBoxStyle.Exclamation + MsgBoxStyle.YesNo) = 0 Then
                         Settings.Channels.Remove(c)
                         RefillChannels()
@@ -527,6 +582,13 @@ Friend Class ChannelViewForm : Implements IChannelLimits
                 End Try
             Case CmbDefaultButtons.Up : ChangeComboIndex(-1)
             Case CmbDefaultButtons.Down : ChangeComboIndex(1)
+            Case CmbDefaultButtons.Info
+                Try
+                    c = GetCurrentChannel()
+                    If Not c Is Nothing Then MsgBoxE({c.GetChannelStats(True), "Channel statistics"})
+                Catch info_ex As Exception
+                    ErrorsDescriber.Execute(EDP.LogMessageValue, info_ex, "Error on trying to show channel info")
+                End Try
         End Select
     End Sub
     Private Sub CMB_CHANNELS_ActionOnCheckedChange(ByVal Mode As Boolean) Handles CMB_CHANNELS.ActionOnCheckedChange
@@ -560,6 +622,7 @@ Friend Class ChannelViewForm : Implements IChannelLimits
     End Sub
     Private Sub ChangeComboIndex(ByVal Appender As Integer)
         Try
+            AppendPendingUsers()
             Dim _ComboUpEnabled As Boolean = False
             Dim _ComboDownEnabled As Boolean = False
             If CMB_CHANNELS.Count > 0 Then
@@ -589,6 +652,12 @@ Friend Class ChannelViewForm : Implements IChannelLimits
             MyRange.Update()
         End If
     End Sub
+    Private Sub BTT_SHOW_STATS_Click(sender As Object, e As EventArgs) Handles BTT_SHOW_STATS.Click
+        Using f As New ChannelsStatsForm
+            f.ShowDialog()
+            If f.DeletedChannels > 0 Then RefillChannels()
+        End Using
+    End Sub
 #End Region
 #Region "CONTEXT"
     Private Sub BTT_C_OPEN_USER_Click(sender As Object, e As EventArgs) Handles BTT_C_OPEN_USER.Click
@@ -614,17 +683,21 @@ Friend Class ChannelViewForm : Implements IChannelLimits
     End Sub
     Private Sub BTT_C_OPEN_FOLDER_Click(sender As Object, e As EventArgs) Handles BTT_C_OPEN_FOLDER.Click
         Dim f As SFile = GetPostBySelected().CachedFile
-        If Not f.IsEmptyString Then f.Open(SFO.Path)
+        If Not f.IsEmptyString Then GlobalOpenPath(f, EDP.LogMessageValue)
     End Sub
     Private Sub BTT_C_REMOVE_FROM_SELECTED_Click(sender As Object, e As EventArgs) Handles BTT_C_REMOVE_FROM_SELECTED.Click
         Try
             Dim u$ = GetPostBySelected().UserID
             If Not u.IsEmptyString Then
                 Dim uRemoved As Boolean = False
-                If PendingUsers.Contains(u) Then PendingUsers.Remove(u) : uRemoved = True
+                Dim i% = PendingUsers.IndexOf(u)
+                If i >= 0 Then
+                    PendingUsers(i).ChannelUserAdded(False)
+                    PendingUsers.RemoveAt(i)
+                    uRemoved = True
+                End If
                 With LIST_POSTS
                     If .Items.Count > 0 Then
-                        Dim i%
                         Dim a As Action = Sub() .Items(i).Checked = False
                         For i = 0 To .Items.Count - 1
                             If .Items(i).Text = u And .Items(i).Checked Then

SCrawler/Channels/ChannelsStatsForm.Designer.vb

@@ -0,0 +1,112 @@
+' Copyright (C) 2022  Andy
+' This program is free software: you can redistribute it and/or modify
+' it under the terms of the GNU General Public License as published by
+' the Free Software Foundation, either version 3 of the License, or
+' (at your option) any later version.
+'
+' This program is distributed in the hope that it will be useful,
+' but WITHOUT ANY WARRANTY
+
+<Global.Microsoft.VisualBasic.CompilerServices.DesignerGenerated()>
+Partial Friend Class ChannelsStatsForm : Inherits System.Windows.Forms.Form
+    <System.Diagnostics.DebuggerNonUserCode()>
+    Protected Overrides Sub Dispose(ByVal disposing As Boolean)
+        Try
+            If disposing AndAlso components IsNot Nothing Then
+                components.Dispose()
+            End If
+        Finally
+            MyBase.Dispose(disposing)
+        End Try
+    End Sub
+    Private components As System.ComponentModel.IContainer
+    <System.Diagnostics.DebuggerStepThrough()>
+    Private Sub InitializeComponent()
+        Dim CONTAINER_MAIN As System.Windows.Forms.ToolStripContainer
+        Dim ActionButton1 As PersonalUtilities.Forms.Controls.Base.ActionButton = New PersonalUtilities.Forms.Controls.Base.ActionButton()
+        Dim resources As System.ComponentModel.ComponentResourceManager = New System.ComponentModel.ComponentResourceManager(GetType(ChannelsStatsForm))
+        Dim ActionButton2 As PersonalUtilities.Forms.Controls.Base.ActionButton = New PersonalUtilities.Forms.Controls.Base.ActionButton()
+        Dim ActionButton3 As PersonalUtilities.Forms.Controls.Base.ActionButton = New PersonalUtilities.Forms.Controls.Base.ActionButton()
+        Dim ListColumn1 As PersonalUtilities.Forms.Controls.Base.ListColumn = New PersonalUtilities.Forms.Controls.Base.ListColumn()
+        Dim ListColumn2 As PersonalUtilities.Forms.Controls.Base.ListColumn = New PersonalUtilities.Forms.Controls.Base.ListColumn()
+        Me.CMB_CHANNELS = New PersonalUtilities.Forms.Controls.ComboBoxExtended()
+        CONTAINER_MAIN = New System.Windows.Forms.ToolStripContainer()
+        CONTAINER_MAIN.ContentPanel.SuspendLayout()
+        CONTAINER_MAIN.SuspendLayout()
+        CType(Me.CMB_CHANNELS, System.ComponentModel.ISupportInitialize).BeginInit()
+        Me.SuspendLayout()
+        '
+        'CONTAINER_MAIN
+        '
+        '
+        'CONTAINER_MAIN.ContentPanel
+        '
+        CONTAINER_MAIN.ContentPanel.Controls.Add(Me.CMB_CHANNELS)
+        CONTAINER_MAIN.ContentPanel.Size = New System.Drawing.Size(384, 261)
+        CONTAINER_MAIN.Dock = System.Windows.Forms.DockStyle.Fill
+        CONTAINER_MAIN.LeftToolStripPanelVisible = False
+        CONTAINER_MAIN.Location = New System.Drawing.Point(0, 0)
+        CONTAINER_MAIN.Name = "CONTAINER_MAIN"
+        CONTAINER_MAIN.RightToolStripPanelVisible = False
+        CONTAINER_MAIN.Size = New System.Drawing.Size(384, 261)
+        CONTAINER_MAIN.TabIndex = 0
+        CONTAINER_MAIN.TopToolStripPanelVisible = False
+        '
+        'CMB_CHANNELS
+        '
+        ActionButton1.BackgroundImage = CType(resources.GetObject("ActionButton1.BackgroundImage"), System.Drawing.Image)
+        ActionButton1.Index = 0
+        ActionButton1.Name = "BTT_COMBOBOX_ARROW"
+        ActionButton1.Visible = False
+        ActionButton2.BackgroundImage = CType(resources.GetObject("ActionButton2.BackgroundImage"), System.Drawing.Image)
+        ActionButton2.Index = 1
+        ActionButton2.Name = "BTT_CLEAR"
+        ActionButton3.BackgroundImage = CType(resources.GetObject("ActionButton3.BackgroundImage"), System.Drawing.Image)
+        ActionButton3.Index = 2
+        ActionButton3.Name = "BTT_DELETE"
+        Me.CMB_CHANNELS.Buttons.Add(ActionButton1)
+        Me.CMB_CHANNELS.Buttons.Add(ActionButton2)
+        Me.CMB_CHANNELS.Buttons.Add(ActionButton3)
+        Me.CMB_CHANNELS.ClearTextByButtonClear = False
+        ListColumn1.DisplayMember = True
+        ListColumn1.Name = "COL_INFO"
+        ListColumn1.Text = "Information"
+        ListColumn1.Width = -2
+        ListColumn2.Name = "COL_VALUE"
+        ListColumn2.Text = "Channel"
+        ListColumn2.ValueMember = True
+        ListColumn2.Visible = False
+        Me.CMB_CHANNELS.Columns.Add(ListColumn1)
+        Me.CMB_CHANNELS.Columns.Add(ListColumn2)
+        Me.CMB_CHANNELS.Dock = System.Windows.Forms.DockStyle.Fill
+        Me.CMB_CHANNELS.ListCheckBoxes = True
+        Me.CMB_CHANNELS.ListDropDownStyle = PersonalUtilities.Forms.Controls.ComboBoxExtended.ListMode.Simple
+        Me.CMB_CHANNELS.ListGridVisible = True
+        Me.CMB_CHANNELS.ListMultiSelect = True
+        Me.CMB_CHANNELS.Location = New System.Drawing.Point(0, 0)
+        Me.CMB_CHANNELS.Name = "CMB_CHANNELS"
+        Me.CMB_CHANNELS.Size = New System.Drawing.Size(386, 262)
+        Me.CMB_CHANNELS.TabIndex = 0
+        '
+        'ChannelsStatsForm
+        '
+        Me.AutoScaleDimensions = New System.Drawing.SizeF(6.0!, 13.0!)
+        Me.AutoScaleMode = System.Windows.Forms.AutoScaleMode.Font
+        Me.ClientSize = New System.Drawing.Size(384, 261)
+        Me.Controls.Add(CONTAINER_MAIN)
+        Me.Icon = CType(resources.GetObject("$this.Icon"), System.Drawing.Icon)
+        Me.KeyPreview = True
+        Me.MinimizeBox = False
+        Me.MinimumSize = New System.Drawing.Size(400, 300)
+        Me.Name = "ChannelsStatsForm"
+        Me.ShowInTaskbar = False
+        Me.Text = "Channels statistics"
+        CONTAINER_MAIN.ContentPanel.ResumeLayout(False)
+        CONTAINER_MAIN.ResumeLayout(False)
+        CONTAINER_MAIN.PerformLayout()
+        CType(Me.CMB_CHANNELS, System.ComponentModel.ISupportInitialize).EndInit()
+        Me.ResumeLayout(False)
+
+    End Sub
+    Private WithEvents CMB_CHANNELS As PersonalUtilities.Forms.Controls.ComboBoxExtended
+End Class

SCrawler/Channels/ChannelsStatsForm.resx

@@ -117,19 +117,98 @@
   <resheader name="writer">
     <value>System.Resources.ResXResourceWriter, System.Windows.Forms, Version=4.0.0.0, Culture=neutral, PublicKeyToken=b77a5c561934e089</value>
   </resheader>
-  <metadata name="TP_MAIN.GenerateMember" type="System.Boolean, mscorlib, Version=4.0.0.0, Culture=neutral, PublicKeyToken=b77a5c561934e089">
+  <metadata name="CONTAINER_MAIN.GenerateMember" type="System.Boolean, mscorlib, Version=4.0.0.0, Culture=neutral, PublicKeyToken=b77a5c561934e089">
     <value>False</value>
   </metadata>
   <assembly alias="System.Drawing" name="System.Drawing, Version=4.0.0.0, Culture=neutral, PublicKeyToken=b03f5f7f11d50a3a" />
   <data name="ActionButton1.BackgroundImage" type="System.Drawing.Bitmap, System.Drawing" mimetype="application/x-microsoft.net.object.bytearray.base64">
     <value>
-        iVBORw0KGgoAAAANSUhEUgAAABAAAAAQCAYAAAAf8/9hAAAABGdBTUEAALGPC/xhBQAAAAlwSFlzAAAO
+        iVBORw0KGgoAAAANSUhEUgAAAgAAAAIACAYAAAD0eNT6AAAABGdBTUEAALGPC/xhBQAAE65JREFUeF7t
-        wwAADsMBx2+oZAAAAR5JREFUOE+VkjFqwzAUhn2D9iShRyi+QhYbGujg3ZATZPKYdC6FQhPwlAMkg3dP
+        3X2sJWddB/DdLi2lQG2hdOHuvfM887J7Cxca4ELTQMDWKigIFpBAEAgi9g+CJpJo9Q8NJhgBiYZIYspL
-        WQwhyWIyJIUW5NqyPb7oCVtIlhVTwYf8nv7/t2zJagel9KmqKsIACYL9RjI8UHz5zshougZr/AEvbxEP
+        GlAKCkhEC4KgQlsLQkqhKi/lrYWWlxaw3dLddrerz/Q89+7dc2fbfTn3npf5fJJv2rS758z85nnOzJz5
-        aZCDBY3VslixaJvX3wzkkDiOwbZtDRGA5vdNAg+TL27qgmt5XkBG/gTdAG7Gt+3PP9oOaEGFCVEC6rp+
+        nZktAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
-        5g9MfM/c5e4OsEZMZkQEtGL5H2DdZ5JRArDwPA+iKII0TfkC9vroC9j5vq8JTWw3WzWgLMtZGIaa0MR8
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
-        vlAD8PYlSaIJTTiOowY0p0Bc19XEJo6HE59FAPuMzyAINKGJ1XLFZxHALtMrnkBXOIQIIIQ8YvF/KrgB
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
-        cMaRN0UdBBkAAAAASUVORK5CYII=
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAMK3O3r79wVUIz65jfGNVxI/VIX69CvGO9M//a9P+e8o3B/8v
+        vKn9s+3fyX8dAJgmaWd+fl3E96Wd/E9XdvZHkfbvXNa+Rn45AGCS3bvjj/E/h3box5OrmxjPyy8PAEyS
+        XXO7zqhCeH/HDnwUOdCE+J6zdux4eH47YIrEGE8uy/Ls9Bnx/LooL0oH9b9Th/I1TVG+rCqKC+q6Xsh/
+        FJgmO8vy6WknfdPQTnsjckMdwlPy2wITLO3wF6si/lGas1ekuXvX0Fzuyg9S3psOCl6qDwimQB3ji9Ok
+        3btmEm907kpnEa/Mbw9Mlq1pB/6cdHZ/ZcfcPZrcXoXyrVVVFfl1gUmSdsS/libqPUMTd5NSvjktwrbB
+        kgDjVi1UT26K+Nnu+XrMuaud60uPWHpIfhtg3JqyfEaanHcPTdZNTRPCPy4uLj40LxIwBudt2fKAtOP/
+        0zQnN+5koIg3tpca81sC49J+LZcm5a3rJulYEq6LSV40YBOFEB6V5uFV6+flRiTsSwf9r81vDYzBCSO4
+        vjfq/KAuiqfm5QM2QRPjuWnubUbz71DCn6W33zpYCmDT1EX5m92Tcuy5q47xFXkxgQ3UduqnOXfn0Bzc
+        xJSvz4sCbIb2pzlp8v1w/WScnKSzkjekRT1hsMTAKC0vL5/Ydud3zb1NT1FelBcL2GiDm3d0TMTJy0ea
+        pjk1LzYwAu3NvtLc+uTQXBtn7tYYCJtja/vQno5JOJFpQrzWb4hhNJoQnpjm1Q3D82wCcnNRFKfnxQQ2
+        Qttk1zH5JjzhFmcIcHzyzb6O5aFem5J0sP/OvKjARmg7b7sm3xRkT3vDorwawJHb1t6Ep2NOTVoOtDch
+        yssMjFr6IPh8x8SbnsT4lrQamgPhCMzPzz+sifHjnXNpMnN5XnRglJaWlk5KE2z/0ISbxnzQQ0bgvlXz
+        1ePSXPnG0NyZ+DRF8Zi8CsCo7Azh0V0TbkrzRc2B0G3wIJ9429CcmZLce4MgYJTyff87JtzU5uayLM/J
+        qwcM7vD5+jQ3DgzNlWnKDXldgFFJZwW/2jHZpj1727uZ5VWE3mofqJXmw4eG5sdUpqqqXXm1gFGoQnhJ
+        12SbgRxoYvzjtIruK04vxRjPSvPgK0PzYmqTPqtemVcNGIU6xgu7JtusJH1ovH9ubu6UvLrQC2ncPyuN
+        /58Mz4fpTvnmvHrAKJQL5dO6J9ssJXxucWFhLq8yzLKtaUf5h2ncb9zz+8eUKsYP53UERmHX/PyOrsk2
+        g7nJDUWYZUuPWHpIE8oPdIz92UiMn86rCoxIOmOYta8KD5uftk2Peb1hZtTzdVOHcF3HmJ+ZVCF+Ia8u
+        MCppcl0+PNlmOG1zYPtYYc2BzIQ0np+ZxvWPh8b5LObqvMrAqEzRo4BHmctijCfnEsBUqkP5u2ksz8Kd
+        PI8g5SfyagOj0jbIpQk2c01DR5Brmh3NfC4DTI324LWO8V0dY3pm48mAsEGm7OEgo0sRb9wZ4+NzGWDi
+        lWUZ0ti9Zt1YnvUU8fdyCYBRmsFbAh9xqhDvqEN4Xi4FTKz8s93vD4/hPiSdpJyXywCMWPtrgKuGJ12P
+        ck/6gPmDXAuYOHVR/lY6UN3XMXb7kDv17MAGqhaqJ6WJ1sdegDUJ726a5oG5JDB2917vL+Kl3eO1N/lQ
+        LgewUdIO8E0dk69vubosy+25JDA2bYNuFeJnOsZovxLjhbkkwEZZXl4+0QfOvfl2Ogg4O5cFNl1dFE9N
+        4/B7Q+Oyj7mh/VzKZQE2UtM0j6iL+LWOidizhN3OPBiHuigvSmPwrvVjsn9pQnh1LguwGQa3Fo3fHp6M
+        Pcw97c1WcllgQy0tLZ2UDr7/qmMc9jJNiF/WkwNjMHhQ0GzfX/yIU8RLfRCxkdq+kzTfrugcf/3MgZ1l
+        +fRcHmCztU8Yq2P8h47J2cdcpTmQjdCE8IQ0vnzjdkjKP8nlAcZoWxXin3dP0n4l1eGb9UL92FwXOG51
+        Ub48ja09w2Otz2nvTJpKs21QIWDs0lnKb6TJqTEphN3NQvncXBY4VtvSju4N3WOs17l6cXHxoblGwKRo
+        r8mlHeAtHZO2b9mfDohem8sCR2XX3K4z0hj65NCYklSTGONpuUzApNlVFFWaqP81NHF7mvD2tnM7lwbu
+        V/vwqTR2vrV+LPU7VSjf4ff+MAU0B65NeWVd12fm0sBhpTnzosHDp7rGUV8T9lVFvDiXCJgSrmEezDea
+        onhMrgsM25rmyuvSODkwNG56nvZyYvi5XCNg2mgOXM3tVVH9ci4L3KtpmlN9W7Y+VYhfiEkuEzCt8n3L
+        fzA8yXuY/b7OZEVZlovt3ew6xknf8965ublTcpmAaac5cG3C2zQ09Vv7bVAaC/+7fmz0Og6QYVZpDlyT
+        GD/dPlgpl4b+2Nru5NIYuGfdmOhxmhB/VBblL+QaATNKc+DBfH1nCI/OdWHGtTewSdv874fGgIT4xfYb
+        wlwmYNZpDlzNbVUIz85lYUblJ2i6BDacGP/u7O3bH5zLBPSF5sDV7K+L+Nu5LMyYtJP7xbSNfzy0zfue
+        A+03gak8WwdVAnpHc+CaxHiJ5sCZsnK9f/+6bd3v3JZ2/r+SawT0mebAg0kfjB93v/Pp136t3X693bWN
+        e56v6nsBhmkOXE24Ph0EnJXrwpSp63qhDuXnu7dtn1P+U1VVP5PLBHAozYGDtD+LchvU6TN4Iqa+lqGs
+        XO8/YVAlgMPQHLiSsC+dNb0ml4UJVxflRWm73b1+O/Y5YXcVwvNziQDun+bANYnxkvO2bHlALg0TJsZ4
+        cl3ESzu3Xa8Trm+KYimXCeDIaQ48mKqIH9McOHl2zc/vaIr42a5t1vN8tCiK03OZAI6J5sCVFPFr7QNk
+        cl0Ys3yp6nvrtlO/s3K9f9ugSgDHSXPgILk58PxcFsYkX+93J8s1qUK8oynKF+YSAYyO5sCVhH3pgOjV
+        uSxsoqZpHpjq//bu7dLjFPHGND+Xc5kARk9z4JrE+JZUEl+1bpLFhYW5VPf/WLcd5N/ruj4zlwlg42gO
+        PCQfdXOVjdeE8MRU6xuGai9uXw2MgebA1YTrFkMoc10YsaYoX5rqfOf6uvc6e9LO/xW5RACbT3Pgam5N
+        B0Q/m8vCCLT3XnCQ2ZXwnWqhenIuE8D4aA5czV3OykZj19yuM1I9PzlUXwnhirIst+cyAYyf5sA1GTQH
+        uu/6MdoZ4+NTHb+1rq59j+v9wKTSHHhIPtI0zam5NByhNH5enGr306Fa9j1720ttuUQAE0tz4Epi/FJM
+        cl24b8ZNd25KdTk31whg8mkOXEm4pX1EbS4LHebn5x+WdnIf765fr3NVCOFRuUwA00Nz4Gr21kX58lwW
+        1qjmq8el+nxjqF4S4yVLS0sn5TIBTB/NgWuiOfAQTVE+J9XltnV16nXCvqqIF+cSAUw3zYGH5INnb9/+
+        4Fyavtra7uRSLe4Zqk3f88MmxvNyjQBmhiavg/liVVVFrkuvLC4uPjSt/4eG6iEhXlOWZchlApg9mgNX
+        c3P6wD8nl6UXqvlqZ1rv/xmqQ+/ThPJv5ufnH5TLBDC7NAeuZm97n/tclplWhfCstL4/GVr/nsf1fqCH
+        NAeu5kB7aSSVZFabA13v786tVVFckGsE0C+aAw8mnSG/f25u7pRcmpnQbt8mlB/oWt8+pwnxWk+PBNAc
+        uJoqxC/MSnNgs7BQ1yFc17WePc97Z+1AD+C4aA5czU3T/qjXdED3zLQePx5ar75nf77ev3VQJQBWaQ5c
+        zZ4qhJfkskyVuigvapvbOtapt2lC/FFTls/IJQKgi+bA1aw0B07FGWOM8eQ6xnd1rEe/E+OX2jGdywTA
+        fdEcuCYx/u2kXzNudjTz6az/c53L3+NUMX7YI6EBjp7mwIO5pt3J5rpMlHKhfFpavu8PLW/fM+s/7QTY
+        eJoDV/PduiiWc1kmwuB6f7x7aDn7ntvrGC/MJQLgeGgOHKQK8Y46hOflsoxN0zQPbEJ8Z9cy9jxf3RnC
+        o3OZABgFzYGrab9efl0qyViaAxcXFubSgchnOpar77k8xnhaLhMAo6Q5cE2K+L7NfoBMHcJT0nvfvG5Z
+        +h3X+wE2iebAg7m6LMvtuS4bKl/v14txSMLuKoQX5BIBsBk0B64kfCfV4om5LCN33pYtD3DA1ZVwfb1Q
+        PzaXCYDNpDlwJWH3RnSe75rbdUZ6/X9b/369z0eLojg9lwmAcdAcuJqV5sCRaEJ4QnrNbw+9R9+zcr1/
+        26BKAIyV5sBDcll7W95cmmPSPocgvc6dQ6/b9+xpivJluUQATBDNgQdz1TE2B6phV4p446TdhAmAIens
+        9ZXpQ1tz4KA58Am5LPfrrB07Hp7+zr90v1Z/UxXxU3Vdn5nLBMAk0xy4krC7WSifm8tyWGVZnl2F+M3u
+        1+hxYrxkeXn5xFwmAKaB5sDV7E9nsRfnsqyTdnIvGtxiuPPv9jV7Ul1ekUsEwLTRHHgwVSjfsbS0dFIu
+        TWtr+6uB9P8ODP/Znue7ZVmek2sEwBTT2Laa8sr2enb7jHoHRl0JV8QYH5nHDQCzwJ0DV/P1tKO7vuO/
+        9zpVKN/qej/AjNIcKB3Z24TyVXmIADCrNAfKmtzUxHhuHhoAzDrNgZJyVQjhUXlIANAjmgN7m/Du471d
+        MgBTzp0D+5Sw777uiQBAz2gO7EPCLSnn500OAAOaA2c615RlGfKmBoBDaQ6cvTQhvmd+fv5BeRMDwGFp
+        DpyJuN4PwDHQHDjVubUqigvypgSAo6M5cPrShHjtYghl3oQAcGw0B05Rivi+ubm5U/KmA4Djozlw4rM/
+        X+/fOthiADA6mgMnME2IP2rK8hl5GwHAxtAcOFH5SozxrLxpAGBjaQ4cf6oYP9w0zal5kwDA5tAcOLYc
+        aC/FpE1wwmBLAMAm0xy46bk91fvCXH4AGCvNgZuRIn6tKYrH5JoDwGTQHLihuTzGeFouNQBMFs2BI4/r
+        /QBMB82Bo0rYXYXwglxWAJh8mgOPN+H6eqF+bC4nAEwVzYHHkiL+c1EUp+caAsB00hx4FInxLalk2waV
+        A4AppznwfrOnLsqX53IBwOzQHHiYFPHGaqF6Ui4TAMwezYGHpirip+q6PjOXBwBmmubANjFesry8fGKu
+        CQD0Q4+bA/dWMf56LgMA9E8PmwO/W5blOXn1AaC/+tMcWF4ZY3xkXm0AYOabA2O8ZGlp6aS8ugDAGrPY
+        HLi3CeWr8voBAIczQ82BN6UDmnPzagEA92f6mwPLz1dVVeTVAQCO1LQ2B1Yh/PX8/PyD8moAAEdrupoD
+        w76qiBfnRQcAjtMUNAeGW1LOz8sLAIzKBDcHXlOWZciLCQCM2gQ2B142Nzd3Sl48AGCjTEhz4H7X+wFg
+        k425OfDWqqh+Pi8KALDJtqWDgDemHfKBoR30hqUJ8dqY5PcHAMalKcrnpJ3z94Z31qNO+/t+1/sBYIKk
+        k/LT6hD+Mu2oR/4rgXTW/+X02r+U3woAmDTtz/GaIv5F2nH/ZHhHfpS5J+Vf01n/S9LLbhu8OgAw0dpb
+        8TYL5XPTmfvb0o78v/MOvWtHvybtzXzKT1Qx/n5d1wv5pQCAaXXvAUFRLLXd+3WMFzZF+cKUl7X/rIri
+        gsWFhbn8RwEAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA6LEtW/4flgYiLD1qeX0A
+        AAAASUVORK5CYII=
 </value>
   </data>
   <data name="ActionButton2.BackgroundImage" type="System.Drawing.Bitmap, System.Drawing" mimetype="application/x-microsoft.net.object.bytearray.base64">
@@ -142,68 +221,31 @@
   </data>
   <data name="ActionButton3.BackgroundImage" type="System.Drawing.Bitmap, System.Drawing" mimetype="application/x-microsoft.net.object.bytearray.base64">
     <value>
-        iVBORw0KGgoAAAANSUhEUgAAABAAAAAQCAYAAAAf8/9hAAAABGdBTUEAALGOfPtRkwAAACBjSFJNAACH
+        iVBORw0KGgoAAAANSUhEUgAAABgAAAAYCAYAAADgdz34AAAABGdBTUEAALGPC/xhBQAAABl0RVh0U29m
-        DwAAjA8AAP1SAACBQAAAfXkAAOmLAAA85QAAGcxzPIV3AAAKOWlDQ1BQaG90b3Nob3AgSUNDIHByb2Zp
+        dHdhcmUAQWRvYmUgSW1hZ2VSZWFkeXHJZTwAAAVoSURBVEhLhZVrTJNXGMdfrtNSQIoadKRz2o0CorU3
-        bGUAAEjHnZZ3VFTXFofPvXd6oc0w0hl6ky4wgPQuIB0EURhmBhjKAMMMTWyIqEBEEREBRZCggAGjoUis
+        WkDIVBRaaGNbwAteh+AARRQlitEYTTRekiX7sH3YPmyZH9wtziybigLRCWTaCW5sCBWhlrb0Ci9zSxbo
-        iGIhKKhgD0gQUGIwiqioZEbWSnx5ee/l5ffHvd/aZ+9z99l7n7UuACRPHy4vBZYCIJkn4Ad6ONNXhUfQ
+        2f+UliGX7SS/tO85z/k9T57zXhhCCPO7Wh3VIhB83JKQ0Nu4bNlHm5YseZ1hmHC69n+Y5HLFcz7/ft/S
-        sf0ABniAAaYAMFnpqb5B7sFAJC83F3q6yAn8i94MAUj8vmXo6U+ng/9P0qxUvgAAyF/E5mxOOkvE+SJO
+        pY+vr1hhwL4oEBJcZ0x793If5uZ+1VNfT/qvXCHP6+p8tzMymqRxcW8hMGKqbDo9MlmWddu2AfbiRTJ6
-        yhSkiu0zIqbGJIoZRomZL0pQxHJijlvkpZ99FtlRzOxkHlvE4pxT2clsMfeIeHuGkCNixEfEBRlcTqaI
+        +TIZKC52fyAUVi2JiYkLJmGaBYIPnx4+TPrOnCH9p08TC4LNx46RWwrF/ZXR0W/PleRZZuY669atZvbS
-        b4tYM0mYzBXxW3FsMoeZDgCKJLYLOKx4EZuImMQPDnQR8XIAcKS4LzjmCxZwsgTiQ7mkpGbzuXHxArou
+        JcJiL9vQQEZPnSKmwkLPjcTE97GPB8KZlvh4C5X31dWRgRMniAVBtvPnyWB9ve+2XP7jmtjYpOlJTOnp
-        S49uam3NoHtyMpM4AoGhP5OVyOSz6S4pyalMXjYAi2f+LBlxbemiIluaWltaGpoZmX5RqP+6+Dcl7u0i
+        G60lJRZaOZWPQs4ePUpGUZh3xw7SnJDQhT0KEM3c5fOv9paVkX4kMAPL8ePEig1D584RG9rVpFS2rY6J
-        vQr43DOI1veH7a/8UuoAYMyKarPrD1vMfgA6tgIgd/8Pm+YhACRFfWu/8cV5aOJ5iRcIUm2MjTMzM424
+        EQaTmKTSjbbiYsvIhQuERTGjKIrFvtHaWjK8fz9plsudexYu/BLxKsBj9ALBGzel0vt9e/b4XiBoENhQ
-        HJaRuKC/6386/A198T0j8Xa/l4fuyollCpMEdHHdWClJKUI+PT2VyeLQDf88xP848K/zWBrIieXwOTxR
+        zRDOxIWWOY4cIS0KRZs4Nja5QyLJtRoM1pGzZ/0tYVExi/ayNTVkBPJ76enuJA7nM4j3gVWAHjgTIYqL
-        RKhoyri8OFG7eWyugJvCo3N5/6mJ/zDsT1qca5Eo9Z8ANcoISN2gAuTnPoCiEAESeVDc9d/75oMPBeKb
+        E96SStvMu3YR64EDxF5dTYYOHSJOJPNA5Kiu9rUrlZ1mrdbCnjzpr5jFGotYtqpqQi6TuVM4nKvwlYHU
-        F6Y6sTj3nwX9+65wifiRzo37HOcSGExnCfkZi2viawnQgAAkARXIAxWgAXSBITADVsAWOAI3sAL4gWAQ
+        gDzU31OMSGl8fPJtsbjVsn27z15RQRzAVVlJ3BB4kcx78CAZQbUjVIxrFtd+OdrbmpHhEXG5VE4rTwHz
-        DtYCFogHyYAPMkEu2AwKQBHYBfaCSlAD6kEjaAEnQAc4DS6Ay+A6uAnugAdgBIyD52AGvAHzEARhITJE
+        wMRdFDw4jEgFj5dyRyRqsxYVEcfu3cQFPPv2ES8qHEbCYRzgsFZLvO+8Q7xKJXGDVoXCK46Ovob95YBW
-        geQhVUgLMoDMIAZkD7lBPlAgFA5FQ3EQDxJCudAWqAgqhSqhWqgR+hY6BV2ArkID0D1oFJqCfoXewwhM
+        Ph/8+xwE/wSTyHi81OZVq9qsGs2Ye8sW4srPJy6JhDgTE4kzOpo4IyKIMyyMOLhcX9Py5R4lj0cPtAKs
-        gqmwMqwNG8MM2An2hoPhNXAcnAbnwPnwTrgCroOPwe3wBfg6fAcegZ/DswhAiAgNUUMMEQbigvghEUgs
+        BBwwKfc7p174J5BEhHY9FIk6bBDaIRuiQkDFfsLDSbdU+pdBKPwe8e+BNDBD7vdNn6BYd+6stK5da7bP
-        wkc2IIVIOVKHtCBdSC9yCxlBppF3KAyKgqKjDFG2KE9UCIqFSkNtQBWjKlFHUe2oHtQt1ChqBvUJTUYr
+        nz9TDujcoEAw1lJY+CyFz9dCHDubnDJjwltRccS5fr3TjurnlIMBYE5NJY8Nhq7SrCwREsz6xL9y4S4v
-        oQ3QNmgv9Cp0HDoTXYAuRzeg29CX0HfQ4+g3GAyGhtHBWGE8MeGYBMw6TDHmAKYVcx4zgBnDzGKxWHms
+        b3Bt2uSyR0XNkDvQe9ouKu8HvaGh5FfQIxL5OgyG30qUStqmGUkm/3jKy0+48vLcs1XuiI8nL/Ly/rYl
-        AdYO64dlYgXYAux+7DHsOewgdhz7FkfEqeLMcO64CBwPl4crxzXhzuIGcRO4ebwUXgtvg/fDs/HZ+BJ8
+        JfmovCcgN4JW+l8iGe8oKuoqzcyckSQob3CpVB47l+sXv9KWxYtJt0r1x9ns7HZjQYHNnJxMfoH0EXgA
-        Pb4LfwM/jp8nSBN0CHaEYEICYTOhgtBCuER4SHhFJBLVidbEACKXuIlYQTxOvEIcJb4jyZD0SS6kSJKQ
+        7oFm0CmTjRsNhs6Na9bQF+Tkq57xlJXVu9Rqz9Bs8kWLSG9BwcsqieQONlXnpaaWdul0z7rR+6C8CTSC
-        tJN0hHSedI/0ikwma5MdyRFkAXknuZF8kfyY/FaCImEk4SXBltgoUSXRLjEo8UISL6kl6SS5VjJHslzy
+        m8Aol4+36/XGT7VaevCRIIRx6/WWoQULZq2cyveLxY0IrAT0IHm1OTmZT3Q6U2da2qT8B/Ad+BZ05OSM
-        pOQNyWkpvJS2lIsUU2qDVJXUKalhqVlpirSptJ90snSxdJP0VelJGayMtoybDFsmX+awzEWZMQpC0aC4
+        GXW6p4hdBiIZZ1FRt5vPn6vyuwiqCsj9Xyq6qXbDBkWnXm/6OS3NN1X+dUgIeZSdPXZPoxlEXC6IY9pL
-        UFiULZR6yiXKOBVD1aF6UROoRdRvqP3UGVkZ2WWyobJZslWyZ2RHaAhNm+ZFS6KV0E7QhmjvlygvcVrC
+        S7faNBqXC9Iplf95YBb5ZF+RpGbdunQcbO/D1avJ9YC8LT19/Iv8/BeqpKRPEDORAGNeY3HxSYtG43Eq
-        WbJjScuSwSVzcopyjnIcuUK5Vrk7cu/l6fJu8onyu+U75B8poBT0FQIUMhUOKlxSmFakKtoqshQLFU8o
+        FL5etfpljUzWhPlZ5VOTlGVliR+hHUbs+0mpHP9GpRqM5XAuY20zmGgRRohYKIx9rNd/3qfTOa7l5uLu
-        3leClfSVApXWKR1W6lOaVVZR9lBOVd6vfFF5WoWm4qiSoFKmclZlSpWiaq/KVS1TPaf6jC5Ld6In0Svo
+        C63BvARw6fp0eRCMyBslJe8+2bx58EFhoVMlFNJvgQ4kgggQEgykvV0ApEAd+J3z8Z8KxmuA3pr0zikA
-        PfQZNSU1TzWhWq1av9q8uo56iHqeeqv6Iw2CBkMjVqNMo1tjRlNV01czV7NZ874WXouhFa+1T6tXa05b
+        b4LJZ2FqYBigFdOPNf0NC679Fxi0OPr+XxiAJgwURph/AJfOQQebMR8TAAAAAElFTkSuQmCC
-        RztMe5t2h/akjpyOl06OTrPOQ12yroNumm6d7m09jB5DL1HvgN5NfVjfQj9ev0r/hgFsYGnANThgMLAU
-        vdR6KW9p3dJhQ5Khk2GGYbPhqBHNyMcoz6jD6IWxpnGE8W7jXuNPJhYmSSb1Jg9MZUxXmOaZdpn+aqZv
-        xjKrMrttTjZ3N99o3mn+cpnBMs6yg8vuWlAsfC22WXRbfLS0suRbtlhOWWlaRVtVWw0zqAx/RjHjijXa
-        2tl6o/Vp63c2ljYCmxM2v9ga2ibaNtlOLtdZzllev3zMTt2OaVdrN2JPt4+2P2Q/4qDmwHSoc3jiqOHI
-        dmxwnHDSc0pwOub0wtnEme/c5jznYuOy3uW8K+Lq4Vro2u8m4xbiVun22F3dPc692X3Gw8Jjncd5T7Sn
-        t+duz2EvZS+WV6PXzAqrFetX9HiTvIO8K72f+Oj78H26fGHfFb57fB+u1FrJW9nhB/y8/Pb4PfLX8U/z
-        /z4AE+AfUBXwNNA0MDewN4gSFBXUFPQm2Dm4JPhBiG6IMKQ7VDI0MrQxdC7MNaw0bGSV8ar1q66HK4Rz
-        wzsjsBGhEQ0Rs6vdVu9dPR5pEVkQObRGZ03WmqtrFdYmrT0TJRnFjDoZjY4Oi26K/sD0Y9YxZ2O8Yqpj
-        ZlgurH2s52xHdhl7imPHKeVMxNrFlsZOxtnF7YmbineIL4+f5rpwK7kvEzwTahLmEv0SjyQuJIUltSbj
-        kqOTT/FkeIm8nhSVlKyUgVSD1ILUkTSbtL1pM3xvfkM6lL4mvVNAFf1M9Ql1hVuFoxn2GVUZbzNDM09m
-        SWfxsvqy9bN3ZE/kuOd8vQ61jrWuO1ctd3Pu6Hqn9bUboA0xG7o3amzM3zi+yWPT0c2EzYmbf8gzySvN
-        e70lbEtXvnL+pvyxrR5bmwskCvgFw9tst9VsR23nbu/fYb5j/45PhezCa0UmReVFH4pZxde+Mv2q4quF
-        nbE7+0ssSw7uwuzi7Rra7bD7aKl0aU7p2B7fPe1l9LLCstd7o/ZeLV9WXrOPsE+4b6TCp6Jzv+b+Xfs/
-        VMZX3qlyrmqtVqreUT13gH1g8KDjwZYa5ZqimveHuIfu1nrUttdp15UfxhzOOPy0PrS+92vG140NCg1F
-        DR+P8I6MHA082tNo1djYpNRU0gw3C5unjkUeu/mN6zedLYYtta201qLj4Ljw+LNvo78dOuF9ovsk42TL
-        d1rfVbdR2grbofbs9pmO+I6RzvDOgVMrTnV32Xa1fW/0/ZHTaqerzsieKTlLOJt/duFczrnZ86nnpy/E
-        XRjrjup+cHHVxds9AT39l7wvXbnsfvlir1PvuSt2V05ftbl66hrjWsd1y+vtfRZ9bT9Y/NDWb9nffsPq
-        RudN65tdA8sHzg46DF645Xrr8m2v29fvrLwzMBQydHc4cnjkLvvu5L2key/vZ9yff7DpIfph4SOpR+WP
-        lR7X/aj3Y+uI5ciZUdfRvidBTx6Mscae/5T+04fx/Kfkp+UTqhONk2aTp6fcp24+W/1s/Hnq8/npgp+l
-        f65+ofviu18cf+mbWTUz/pL/cuHX4lfyr468Xva6e9Z/9vGb5Dfzc4Vv5d8efcd41/s+7P3EfOYH7IeK
-        j3ofuz55f3q4kLyw8Bv3hPP74uYdwgAAAAlwSFlzAAALEwAACxMBAJqcGAAAAahJREFUOE9j+P//P8l4
-        vaOjPYyNIYkPO1lZsa1wdNy42sHh3Hxb22KQGFaF2LC4qjjroUP7n97s6vx/Ny/3/ypn54+LbGwisSpG
-        x+aaouwZren/u5f2/3/18tX/qzNn/l/i4XGSgYFBFasGZKwjzcJ6YVnU152blvw3LHH53zCl/ufatWu+
-        T+1vDALJY9UEwxrijExHZgd+/Xy1Hcg98BNkCMglMM0gjKEJhuX5GVh2TvD+/O5c0///P9b///qo819P
-        lgmKZhBG0QTDMjwMzJs7XT+9OVHz///XFf+/PWj7j00zCKNwQFiah4FtXbPjp8d78////7bo/4/79Tg1
-        gzAKR1mUg3lOocXbe9uz/v9/M/H/1zuVeDWDMJwhJcDBvK4p4tb1DQn//r/u+f/zRh5BzSAMZyyrdVh9
-        c33B9//32159vZr2hxjNIAwm1GUE3e+ur/n9/+Ls/592Nf9fUun3khjNIMzAysTAv6g6+OT/E33/j09N
-        +zWpMuImsZpBmMHIQK9x19T8/03x1ufE+TkqsCnChxmUlFWuyEpJtAHTtT42BfjxfwYAtlm0ShMkSB4A
-        AAAASUVORK5CYII=
-</value>
-  </data>
-  <data name="ActionButton4.BackgroundImage" type="System.Drawing.Bitmap, System.Drawing" mimetype="application/x-microsoft.net.object.bytearray.base64">
-    <value>
-        iVBORw0KGgoAAAANSUhEUgAAABAAAAAQCAYAAAAf8/9hAAAABGdBTUEAALGPC/xhBQAAAAlwSFlzAAAO
-        xAAADsQBlSsOGwAAAIZJREFUOE+1j10KwCAMgz2b755xl/IsvnaL2K20UfbDAmEako+ZROSTafjE12Go
-        tbbB43rK5xSAQq1VYFtmeQBoqZTSreVZvgTknM8yyyjA/qodsDF9gspD2Bj6B+DH+NqzhQQAG+POMnSX
-        AFuc5QFgn6ClHh5iOQVAKNixyucB8NY0vG9JOzzyhrdq5IRgAAAAAElFTkSuQmCC
 </value>
   </data>
   <data name="$this.Icon" type="System.Drawing.Icon, System.Drawing" mimetype="application/x-microsoft.net.object.bytearray.base64">

SCrawler/Channels/ChannelsStatsForm.vb

@@ -0,0 +1,84 @@
+' Copyright (C) 2022  Andy
+' This program is free software: you can redistribute it and/or modify
+' it under the terms of the GNU General Public License as published by
+' the Free Software Foundation, either version 3 of the License, or
+' (at your option) any later version.
+'
+' This program is distributed in the hope that it will be useful,
+' but WITHOUT ANY WARRANTY
+Imports System.ComponentModel
+Imports PersonalUtilities.Forms
+Imports PersonalUtilities.Forms.Controls.Base
+Imports PersonalUtilities.Forms.Toolbars
+Friend Class ChannelsStatsForm : Implements IOkCancelDeleteToolbar
+    Private ReadOnly MyDefs As DefaultFormProps
+    Friend Property DeletedChannels As Integer = 0
+    Friend Sub New()
+        InitializeComponent()
+        MyDefs = New DefaultFormProps
+    End Sub
+    Private Sub ChannelsStatsForm_Load(sender As Object, e As EventArgs) Handles Me.Load
+        Try
+            With MyDefs
+                .MyViewInitialize(Me, Settings.Design)
+                .AddOkCancelToolbar()
+                .DelegateClosingChecker()
+                .MyOkCancel.EnableDelete = False
+                If Settings.Channels.Count > 0 Then
+                    RefillList()
+                Else
+                    MsgBoxE("Channels not found", vbExclamation)
+                End If
+                .AppendDetectors()
+                .EndLoaderOperations()
+            End With
+        Catch ex As Exception
+            MyDefs.InvokeLoaderError(ex)
+        End Try
+    End Sub
+    Private Sub ChannelsStatsForm_Closing(sender As Object, e As CancelEventArgs) Handles Me.Closing
+        MyDefs.Dispose()
+    End Sub
+    Private Sub RefillList()
+        CMB_CHANNELS.Items.Clear()
+        If Settings.Channels.Count > 0 Then
+            CMB_CHANNELS.BeginUpdate()
+            CMB_CHANNELS.Items.AddRange(Settings.Channels.Select(Function(c) New ListItem({$"[{c.ID}]: {c.GetChannelStats(False)}", c.ID})))
+            CMB_CHANNELS.EndUpdate()
+        End If
+    End Sub
+    Private Sub ToolbarBttOK() Implements IOkCancelToolbar.ToolbarBttOK
+        MyDefs.CloseForm()
+    End Sub
+    Private Sub ToolbarBttCancel() Implements IOkCancelToolbar.ToolbarBttCancel
+        MyDefs.CloseForm(DialogResult.Cancel)
+    End Sub
+    Private Sub ToolbarBttDelete() Implements IOkCancelDeleteToolbar.ToolbarBttDelete
+        Try
+            Dim c As List(Of String) = CMB_CHANNELS.Items.CheckedItems.Select(Function(cc) CStr(cc.Value(1))).ListIfNothing
+            If c.ListExists Then
+                If MsgBoxE({$"The following channels will be deleted:{vbCr}{c.ListToString(, vbCr)}", "Deleting channels"}, vbExclamation,,, {"Confirm", "Cancel"}) = 0 Then
+                    For Each CID$ In c : Settings.Channels.Remove(Settings.Channels.Find(CID)) : Next
+                    MyMainLOG = $"Deleted channels:{vbNewLine}{c.ListToString(, vbNewLine)}"
+                    MsgBoxE("Channels deleted")
+                    DeletedChannels += c.Count
+                    c.Clear()
+                    MyDefs.ChangesDetected = False
+                    RefillList()
+                Else
+                    MsgBoxE("Operation canceled")
+                End If
+            Else
+                MsgBoxE("No one channel checked", vbExclamation)
+            End If
+        Catch ex As Exception
+            ErrorsDescriber.Execute(EDP.LogMessageValue, ex, "Deleting channels")
+        End Try
+    End Sub
+    Private Sub CMB_CHANNELS_ActionOnChangeDetected(ByVal c As Boolean) Handles CMB_CHANNELS.ActionOnChangeDetected
+        If Not MyDefs.Initializing Then MyDefs.MyOkCancel.EnableDelete = CMB_CHANNELS.ListCheckedIndexes.Count > 0
+    End Sub
+    Private Sub CMB_CHANNELS_ActionOnButtonClearClick() Handles CMB_CHANNELS.ActionOnButtonClearClick
+        CMB_CHANNELS.ListCheckedIndexes = Nothing
+    End Sub
+End Class

SCrawler/Download/ActiveDownloadingProgress.Designer.vb

@@ -0,0 +1,61 @@
+' Copyright (C) 2022  Andy
+' This program is free software: you can redistribute it and/or modify
+' it under the terms of the GNU General Public License as published by
+' the Free Software Foundation, either version 3 of the License, or
+' (at your option) any later version.
+'
+' This program is distributed in the hope that it will be useful,
+' but WITHOUT ANY WARRANTY
+Namespace DownloadObjects
+    <Global.Microsoft.VisualBasic.CompilerServices.DesignerGenerated()>
+    Partial Friend Class ActiveDownloadingProgress : Inherits System.Windows.Forms.Form
+        <System.Diagnostics.DebuggerNonUserCode()>
+        Protected Overrides Sub Dispose(ByVal disposing As Boolean)
+            Try
+                If disposing AndAlso components IsNot Nothing Then
+                    components.Dispose()
+                End If
+            Finally
+                MyBase.Dispose(disposing)
+            End Try
+        End Sub
+        Private components As System.ComponentModel.IContainer
+        <System.Diagnostics.DebuggerStepThrough()>
+        Private Sub InitializeComponent()
+            Dim resources As System.ComponentModel.ComponentResourceManager = New System.ComponentModel.ComponentResourceManager(GetType(ActiveDownloadingProgress))
+            Me.TP_MAIN = New System.Windows.Forms.TableLayoutPanel()
+            Me.SuspendLayout()
+            '
+            'TP_MAIN
+            '
+            Me.TP_MAIN.CellBorderStyle = System.Windows.Forms.TableLayoutPanelCellBorderStyle.[Single]
+            Me.TP_MAIN.ColumnCount = 1
+            Me.TP_MAIN.ColumnStyles.Add(New System.Windows.Forms.ColumnStyle(System.Windows.Forms.SizeType.Percent, 100.0!))
+            Me.TP_MAIN.ColumnStyles.Add(New System.Windows.Forms.ColumnStyle(System.Windows.Forms.SizeType.Absolute, 20.0!))
+            Me.TP_MAIN.Dock = System.Windows.Forms.DockStyle.Fill
+            Me.TP_MAIN.Location = New System.Drawing.Point(0, 0)
+            Me.TP_MAIN.Name = "TP_MAIN"
+            Me.TP_MAIN.RowCount = 1
+            Me.TP_MAIN.RowStyles.Add(New System.Windows.Forms.RowStyle(System.Windows.Forms.SizeType.Absolute, 62.0!))
+            Me.TP_MAIN.RowStyles.Add(New System.Windows.Forms.RowStyle(System.Windows.Forms.SizeType.Absolute, 62.0!))
+            Me.TP_MAIN.Size = New System.Drawing.Size(434, 61)
+            Me.TP_MAIN.TabIndex = 0
+            '
+            'ActiveDownloadingProgress
+            '
+            Me.AutoScaleDimensions = New System.Drawing.SizeF(6.0!, 13.0!)
+            Me.AutoScaleMode = System.Windows.Forms.AutoScaleMode.Font
+            Me.ClientSize = New System.Drawing.Size(434, 61)
+            Me.Controls.Add(Me.TP_MAIN)
+            Me.Icon = CType(resources.GetObject("$this.Icon"), System.Drawing.Icon)
+            Me.KeyPreview = True
+            Me.MinimumSize = New System.Drawing.Size(450, 100)
+            Me.Name = "ActiveDownloadingProgress"
+            Me.Text = "Active downloading progress"
+            Me.ResumeLayout(False)
+
+        End Sub
+
+        Private WithEvents TP_MAIN As TableLayoutPanel
+    End Class
+End Namespace

SCrawler/Download/ActiveDownloadingProgress.resx

@@ -0,0 +1,624 @@
+<?xml version="1.0" encoding="utf-8"?>
+<root>
+  <!-- 
+    Microsoft ResX Schema 
+    
+    Version 2.0
+    
+    The primary goals of this format is to allow a simple XML format 
+    that is mostly human readable. The generation and parsing of the 
+    various data types are done through the TypeConverter classes 
+    associated with the data types.
+    
+    Example:
+    
+    ... ado.net/XML headers & schema ...
+    <resheader name="resmimetype">text/microsoft-resx</resheader>
+    <resheader name="version">2.0</resheader>
+    <resheader name="reader">System.Resources.ResXResourceReader, System.Windows.Forms, ...</resheader>
+    <resheader name="writer">System.Resources.ResXResourceWriter, System.Windows.Forms, ...</resheader>
+    <data name="Name1"><value>this is my long string</value><comment>this is a comment</comment></data>
+    <data name="Color1" type="System.Drawing.Color, System.Drawing">Blue</data>
+    <data name="Bitmap1" mimetype="application/x-microsoft.net.object.binary.base64">
+        <value>[base64 mime encoded serialized .NET Framework object]</value>
+    </data>
+    <data name="Icon1" type="System.Drawing.Icon, System.Drawing" mimetype="application/x-microsoft.net.object.bytearray.base64">
+        <value>[base64 mime encoded string representing a byte array form of the .NET Framework object]</value>
+        <comment>This is a comment</comment>
+    </data>
+                
+    There are any number of "resheader" rows that contain simple 
+    name/value pairs.
+    
+    Each data row contains a name, and value. The row also contains a 
+    type or mimetype. Type corresponds to a .NET class that support 
+    text/value conversion through the TypeConverter architecture. 
+    Classes that don't support this are serialized and stored with the 
+    mimetype set.
+    
+    The mimetype is used for serialized objects, and tells the 
+    ResXResourceReader how to depersist the object. This is currently not 
+    extensible. For a given mimetype the value must be set accordingly:
+    
+    Note - application/x-microsoft.net.object.binary.base64 is the format 
+    that the ResXResourceWriter will generate, however the reader can 
+    read any of the formats listed below.
+    
+    mimetype: application/x-microsoft.net.object.binary.base64
+    value   : The object must be serialized with 
+            : System.Runtime.Serialization.Formatters.Binary.BinaryFormatter
+            : and then encoded with base64 encoding.
+    
+    mimetype: application/x-microsoft.net.object.soap.base64
+    value   : The object must be serialized with 
+            : System.Runtime.Serialization.Formatters.Soap.SoapFormatter
+            : and then encoded with base64 encoding.
+
+    mimetype: application/x-microsoft.net.object.bytearray.base64
+    value   : The object must be serialized into a byte array 
+            : using a System.ComponentModel.TypeConverter
+            : and then encoded with base64 encoding.
+    -->
+  <xsd:schema id="root" xmlns="" xmlns:xsd="http://www.w3.org/2001/XMLSchema" xmlns:msdata="urn:schemas-microsoft-com:xml-msdata">
+    <xsd:import namespace="http://www.w3.org/XML/1998/namespace" />
+    <xsd:element name="root" msdata:IsDataSet="true">
+      <xsd:complexType>
+        <xsd:choice maxOccurs="unbounded">
+          <xsd:element name="metadata">
+            <xsd:complexType>
+              <xsd:sequence>
+                <xsd:element name="value" type="xsd:string" minOccurs="0" />
+              </xsd:sequence>
+              <xsd:attribute name="name" use="required" type="xsd:string" />
+              <xsd:attribute name="type" type="xsd:string" />
+              <xsd:attribute name="mimetype" type="xsd:string" />
+              <xsd:attribute ref="xml:space" />
+            </xsd:complexType>
+          </xsd:element>
+          <xsd:element name="assembly">
+            <xsd:complexType>
+              <xsd:attribute name="alias" type="xsd:string" />
+              <xsd:attribute name="name" type="xsd:string" />
+            </xsd:complexType>
+          </xsd:element>
+          <xsd:element name="data">
+            <xsd:complexType>
+              <xsd:sequence>
+                <xsd:element name="value" type="xsd:string" minOccurs="0" msdata:Ordinal="1" />
+                <xsd:element name="comment" type="xsd:string" minOccurs="0" msdata:Ordinal="2" />
+              </xsd:sequence>
+              <xsd:attribute name="name" type="xsd:string" use="required" msdata:Ordinal="1" />
+              <xsd:attribute name="type" type="xsd:string" msdata:Ordinal="3" />
+              <xsd:attribute name="mimetype" type="xsd:string" msdata:Ordinal="4" />
+              <xsd:attribute ref="xml:space" />
+            </xsd:complexType>
+          </xsd:element>
+          <xsd:element name="resheader">
+            <xsd:complexType>
+              <xsd:sequence>
+                <xsd:element name="value" type="xsd:string" minOccurs="0" msdata:Ordinal="1" />
+              </xsd:sequence>
+              <xsd:attribute name="name" type="xsd:string" use="required" />
+            </xsd:complexType>
+          </xsd:element>
+        </xsd:choice>
+      </xsd:complexType>
+    </xsd:element>
+  </xsd:schema>
+  <resheader name="resmimetype">
+    <value>text/microsoft-resx</value>
+  </resheader>
+  <resheader name="version">
+    <value>2.0</value>
+  </resheader>
+  <resheader name="reader">
+    <value>System.Resources.ResXResourceReader, System.Windows.Forms, Version=4.0.0.0, Culture=neutral, PublicKeyToken=b77a5c561934e089</value>
+  </resheader>
+  <resheader name="writer">
+    <value>System.Resources.ResXResourceWriter, System.Windows.Forms, Version=4.0.0.0, Culture=neutral, PublicKeyToken=b77a5c561934e089</value>
+  </resheader>
+  <assembly alias="System.Drawing" name="System.Drawing, Version=4.0.0.0, Culture=neutral, PublicKeyToken=b03f5f7f11d50a3a" />
+  <data name="$this.Icon" type="System.Drawing.Icon, System.Drawing" mimetype="application/x-microsoft.net.object.bytearray.base64">
+    <value>
+        AAABAAwAMDAQAAEABABoBgAAxgAAACAgEAABAAQA6AIAAC4HAAAYGBAAAQAEAOgBAAAWCgAAEBAQAAEA
+        BAAoAQAA/gsAADAwAAABAAgAqA4AACYNAAAgIAAAAQAIAKgIAADOGwAAGBgAAAEACADIBgAAdiQAABAQ
+        AAABAAgAaAUAAD4rAAAwMAAAAQAgAKglAACmMAAAICAAAAEAIACoEAAATlYAABgYAAABACAAiAkAAPZm
+        AAAQEAAAAQAgAGgEAAB+cAAAKAAAADAAAABgAAAAAQAEAAAAAACABAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAIAAAIAAAACAgACAAAAAgACAAICAAACAgIAAwMDAAAAA/wAA/wAAAP//AP8AAAD/AP8A//8AAP//
+        /wAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAB4YAAAAAAAAAAAAAAAAAAAAAAAAAAAAAjsjgAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAIbOh4AAAAAAAAAAAAAAAAAAAAAAAAAAAH5mfsgAAAAAAAAAAAAAAAAAAAAAAAAAB+
+        xs54YAAAAAAAAAAAAAAAAAAAAAAAAAfsbmxo5wAAAAAAAAAAAAAAAAAAAAAAAIbObObOeMAAAAAAAAAA
+        AAAAAAAAAAAACG5+zmzsaOgAAAAAAAAAAAAAAAAAAAAABn7ObOZmbneAAAAAAAAAAAAAAAAAAAAAfs5s
+        5+zs7I7AAAAAAAAAAAAAAAAAAAAH7Ofm7G7GbGiOAAAAAAAAAAAAAAAAAAB+fs7Ofs5+zmzngAAAAAAA
+        AAAAAAAAAAhn7Ojs5uzm7OZ4yAAAAAAAAAAAAAAAAAaOfm7Obsfsbs7OjnAAAAAAAAAAAAAAAH7Ojs7n
+        7O7ObOZs54AAAAAAAAAAAAAABn6Ozuduzn5uznzmyOcAAAAAAAAAAAAAfn7I6M7s5+zn7Obs5oyAAAAA
+        AAAAAAAIZ+jujuzo7Obs5uxubOjnAAAAAAAAAAAG586M5+js7n7OfOfs5s54cAAAAAAAAABnzo7o5+zu
+        fs5+5uzmzmzowAAAAAAAAAdujn5+fu7Ozuzs7Ofs5+bI6AAAAAAAAHzn7OjOjI5+5+jufs5uzs5ueOAA
+        AAAAAG6M6O6O7n7Ofs7Ozo7Ofmzs53gAAAAAB+zo7IznyOzuzufufs6Ofo6Ofn4AAAAACEdsZ2Z87o5+
+        js7O7O5cjHx8jIgAAAAAAAAAAAAAfOfs7Ojs6OfgAAAAAAAAAAAAAAAAAAAAbo7O6O7O7OfAAAAAAAAA
+        AAAAAAAAAAAAfsjm7Obo7s6AAAAAAAAAAAAAAAAAAAAAaO5+zo7OyO5wAAAAAAAAAAAAAAAAAAAAzn7O
+        js7n7sjAAAAAAAAAAAAAAAAAAAAAaM6Ozuzuzu5wAAAAAAAAAAAAAAAAAAAAbn7Obn5+jshgAAAAAAAA
+        AAAAAAAAAAAAbOjn7Ozs7O5wAAAAAAAAAAAAAAAAAAAAfnzn5+bn7n7AAAAAAAAAAAAAAAAAAAAAbOjs
+        7OzuzshgAAAAAAAAAAAAAAAAAAAAaOyOfn7I5+5wAAAAAAAAAAAAAAAAAAAAbOfs7Ozm7OfAAAAAAAAA
+        AAAAAAAAAAAAbnzn5+bs5u5wAAAAAAAAAAAAAAAAAAAAfOfsjOx+zn7AAAAAAAAAAAAAAAAAAAAAbnzn
+        5o7OfshgAAAAAAAAAAAAAAAAAAAAx+Z+zs5uzm5gAAAAAAAAAAAAAAAAAAAAbs7H5+fObsjAAAAAAAAA
+        AAAAAAAAAAAAZ2js585s7O5wAAAAAAAAAAAAAAAAAAAAjOyH5+jn53aAAAAAAAAAAAAAAAAAAAAACGZs
+        bHxsfGgAAAAAAAAAAAD///////8AAP///////wAA////////AAD///j///8AAP//8H///wAA///gP///
+        AAD//+Af//8AAP//wB///wAA//+AD///AAD//wAH//8AAP/+AAP//wAA//4AAf//AAD//AAB//8AAP/4
+        AAD//wAA//AAAH//AAD/4AAAP/8AAP/gAAAf/wAA/8AAAB//AAD/gAAAD/8AAP8AAAAH/wAA/gAAAAP/
+        AAD+AAAAAf8AAPwAAAAB/wAA+AAAAAD/AADwAAAAAH8AAPAAAAAAPwAA4AAAAAA/AADgAAAAAD8AAP/8
+        AAH//wAA//wAAf//AAD//AAB//8AAP/8AAH//wAA//wAAf//AAD//AAB//8AAP/8AAH//wAA//wAAf//
+        AAD//AAB//8AAP/8AAH//wAA//wAAf//AAD//AAB//8AAP/8AAH//wAA//wAAf//AAD//AAB//8AAP/8
+        AAH//wAA//wAAf//AAD//AAB//8AAP/8AAH//wAA//4AA///AAAoAAAAIAAAAEAAAAABAAQAAAAAAAAC
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAgAAAgAAAAICAAIAAAACAAIAAgIAAAICAgADAwMAAAAD/AAD/
+        AAAA//8A/wAAAP8A/wD//wAA////AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA5+AAAAAAAAAAAAAAAAAA
+        BoyHAAAAAAAAAAAAAAAAAOfn7AAAAAAAAAAAAAAAAAjIzn6AAAAAAAAAAAAAAAAO5uxo7AAAAAAAAAAA
+        AAAAaM7ObI6AAAAAAAAAAAAADn5ubOboyAAAAAAAAAAAAH7Ozs5sbo4AAAAAAAAAAAjI5+fn7saM4AAA
+        AAAAAAAO7n7Ozsbs6OcAAAAAAAAAaH7O5+bn5s6MgAAAAAAABo7o5+zs7Ozm6OAAAAAAAH7I7Ozufn5u
+        zsfsAAAAAAjOjn6Ofs7s5+bsjnAAAAAG6Ozo7O7n5+zs5ujnAAAAaOyOjo587Ozo6I7IjIAAAGxmxsZ+
+        7o7uzsbG7O4AAAAAAAAM587OyOhgAAAAAAAAAAAABo7n5+7OYAAAAAAAAAAAAAzozuzujsAAAAAAAAAA
+        AAAGjufuzs5wAAAAAAAAAAAADOfOyOfowAAAAAAAAAAAAAaOfm7O7mAAAAAAAAAAAAAM7Ofs5sjAAAAA
+        AAAAAAAABn585+7oYAAAAAAAAAAAAAyM6Oxs58AAAAAAAAAAAAAG5+zm5+5gAAAAAAAAAAAABOx+fs7I
+        wAAAAAAAAAAAAAZ+Z8hs7kAAAAAAAAAAAAAMjOjm52fAAAAAAAAAAAAAAGbExsbOAAAAAAAA///////8
+        f///+D////A////gH///4A///8AH//+AA///AAP//gAB//4AAP/8AAB/+AAAf/AAAD/gAAAf4AAAD8AA
+        AAfAAAAP/4AH//+AB///gAf//4AH//+AB///gAf//4AH//+AB///gAf//4AH//+AB///gAf//4AH///A
+        D/8oAAAAGAAAADAAAAABAAQAAAAAACABAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAgAAAgAAAAICAAIAA
+        AACAAIAAgIAAAICAgADAwMAAAAD/AAD/AAAA//8A/wAAAP8A/wD//wAA////AAAAAAAAAAAAAAAAAAAA
+        AAAABgAAAAAAAAAAAAAAeOAAAAAAAAAAAAAG7IcAAAAAAAAAAAB+fujgAAAAAAAAAAbs7OyHAAAAAAAA
+        AGjufm7oYAAAAAAABo7OzsfOhwAAAAAAaO5+5+7s6GAAAAAG5+zs7Ozn7PYAAABo6Ojo7n6IjojgAAAM
+        bGzs7OyOx+wAAAAAAAfo7o7nAAAAAAAAAAaM7OyGAAAAAAAAAAbufu6MAAAAAAAAAAd+zn6GAAAAAAAA
+        AAzn7OznAAAAAAAAAAaOzuiGAAAAAAAAAAbn587sAAAAAAAAAAZ87m6GAAAAAAAAAAzozs6MAAAAAAAA
+        AAaOh+eGAAAAAAAAAABsbGxgAAAAAAAAAAAAAAAAAAAAAP///wD/7/8A/8f/AP+D/wD/Af8A/gD/APwA
+        fwD4AD8A8AAfAOAADwDAAAcA4AAPAP4A/wD+AP8A/gD/AP4A/wD+AP8A/gD/AP4A/wD+AP8A/gD/AP4A
+        /wD/Af8A////ACgAAAAQAAAAIAAAAAEABAAAAAAAgAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAACAAACA
+        AAAAgIAAgAAAAIAAgACAgAAAgICAAMDAwAAAAP8AAP8AAAD//wD/AAAA/wD/AP//AAD///8AAAAABgAA
+        AAAAAABoYAAAAAAABo6MAAAAAABozshgAAAABo5uboYAAABo7OfOeGAABo5+fn6OhgB2xs7O6MfHgAAA
+        aOfIYAAAAABuzujgAAAAAGjn6MAAAAAAzs5+cAAAAABo5+jAAAAAAG7OyOAAAAAAaI6OcAAAAAAMbGYA
+        AAD+/wAA/H8AAPg/AADwHwAA4A8AAMAHAACAAwAAAAEAAPAfAADwHwAA8B8AAPAfAADwHwAA8B8AAPAf
+        AAD4PwAAKAAAADAAAABgAAAAAQAIAAAAAAAACQAAAAAAAAAAAAAAAQAAAAEAAAAAAACjaB0ApmsgAKlt
+        IwCrcCYArXMqALF1LACzeC4ArHYwALR6MQC4fTQAt385AMh1AADJdwQAy3gAAM17AADOfQEAy3oHAM5/
+        CQDMfA0A0H4BAMt/GQC7gDcAvoI6ALmBPADRgAIA0oIEANSDBADVhQUA1ogGANaMBwDZiQYA3I0GANKE
+        CgDWhwkA0YIMANaMCwDZiggA2o0JANyOCQDbkgsA3pAKAN6UCwDekg0A3ZQNAM+EGgDRhhUA1YkSANiN
+        EgDajhcA2pISANqSHgDalh4A3ZgaAOGUCgDgkg0A4ZUOAOSWDgDhmA4A5ZgPAOicDgDklxAA45cVAOGY
+        EADlmRAA5ZwRAOSdFwDonRIA550YAOmfGwDpoBIA6qEUAO2iFADrpBQA7qUWAO6mGADvqBgA8KUXAPCm
+        GADxqRgA9KsZAPKsGgD0rBoA9a0cAPiuGgD1sBsA+bEbAPixHADOhycAzo0lAMqKKwDRjCIA0Y8lANSP
+        JgDTji0A05ImANiRIwDdnScA1JQpANmVKwDXmCoA25stAMGJNQDAhj0A0I84AM2VPwDTmTYA3JwyANKR
+        OQDSlDgA2Js6AOGeIADknS8A3qAxANyiPwDopCAA7qogAOKiLQDtqykA8asjAPOxJwD6syAA+LMkAPq1
+        JwD2tSoA+rYsAPq4LgDiozEA6qUzAOepNQDpqTEA66wyAOmrNwDtqjUA6qw2AO2vNQDjpjoA6aw4AOir
+        PwDwrDgA67A3AO2xOQDssT8A8rIwAPazMwD2tzEA8bE2APq7NgDytDoA+Lc6APW5PAD5uToA+bw7APi7
+        PQD5vD0A/L49APzAPgCxgEMAv4VAALaFSAC5h0sAvJZmALyacgC5mnYAxYlBAMOLRgDHi0QAyY1GAMaO
+        SgDJj0oAyZBEAMyQSgDPlEkAypFNAM6TTADNlE4A0pVHANebQwDUnUUA0JRNANaaSgDDkVUAzpZWAM2X
+        WwDOmVsAzZpdANGZVgDUmlcA0ppaANOcWwDQnF4A16BHANqiSADapUkA3adLAN2lTQDbo1QA1KFeANql
+        WwDgpkMA4KtOAO6sSwDxrUYA8rdAAPGxRQD1uUAA+r1AAPSySADirl0Ax5ljAMOYZgDFmWUAz51gAM+f
+        ZADBnG4AxJ1uANGeYgDQnmUA0aBjANalYwDVoWQA2KRgAN+sYwDbqWYA3aplAN2sZwDRo2sA1KdrANWl
+        bADZqmoA3q5qAMWhcgDNpHMAzKV1AMmmeQDUqXAA1Kp5ANuwcADhrWAA569jAOCvaQDismgA5LRoAOGy
+        bADitGwA+8BDALGchQCxnokAxa2OAMqwkQDPs5MA1LiXAN3AngDjwJYAAAAAAP///wAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAADc2b4AAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAOy6sLjRAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAA+7oVbN2+ogAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAulgR
+        DLTFuvYAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAC6aCMREQzGvroAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAALisLxsUERET4Nm4AAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAA6awxJhsbGxERLuC+0QAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAD6rGArJiYdGxsREV7gvqIAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAACoYz4+NyYm
+        GxsbERGx3Lr2AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAKhsREM3PjcpJh8bGxQRw9y6AAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAtapFSEhGOzc3KSYfGxsbE+DauAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAADXpYJIT0hIRkY3NzcmJhsbGS7w2dEAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        APqeipBPT01IRkZGPjc3JiYbGxFg8L6iAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAJ5yzZdPT09NSEZG
+        Ozc3NyYmGxsZbvC49gAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAGGnLzpd5T09PTk1GRkZDNzcmJh0bEcHj
+        ugAAAAAAAAAAAAAAAAAAAAAAAAAAAACgnsuX9fV5V1dPT05NRkZGNzc3Jh8fGyPu47cAAAAAAAAAAAAA
+        AAAAAAAAAAAAAKELjs719fV+V09XT05OTkhGRjdDNyYmHxsv8dnRAAAAAAAAAAAAAAAAAAAAAAAA+AmI
+        l/X1l/WTV1dXV09PTk5IRkY3NzcpJh0bYPG+ogAAAAAAAAAAAAAAAAAAAAAACGrLl8719fWXeVdXT1RX
+        Tk5NSEZGRjc3KSYdG27tvvcAAAAAAAAAAAAAAAAAAAAIZo7Ll87OzvX1fldXVFRTT1dOTUhGRjs+NyYm
+        JhvC67YAAAAAAAAAAAAAAAAAAJ0JgZDLy8uczs7Ofld5eVdPVE9PTk1IRkY7NzcpJh8i0Ou4AAAAAAAA
+        AAAAAAAA1whxjI6Qy5PLl/XOl3l5V3l5eVdPV05NTUZGRjs3KSYfMPHj6QAAAAAAAAAAAAAABGOBjIyU
+        k8uXnJf1l3l5eXl5V1dXT1dOTU1GRjw7NzYfHzPxvvwAAAAAAAAAAACfWnFwf4CAgoyLy4yXznlPeVR5
+        V1dXV05XTneLz8/Pz8/Pz8/J79wAAAAAAAAAAADqAQECAgMDAwQEBAaXznx5VHl5V1dXV1dPV5WkpKam
+        pqarp6ezs/0AAAAAAAAAAAAAAAAAAAAAAAAAAASXy5NQVXlUeXlXV1dXTpWkAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAASXy5NPVVVUeXlXV1dXV5dnAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAASQy8t4UFVVeVR5eVdXV5dnAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAOQjst8TFBV
+        VVR5eXlXeZeeAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAKMjJCOUFBQT1V5VHl5eZcWAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAKCjI6MdEhPVU95VXlUeZwKAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAKCgoKOdkh0UE9VVXlUeZwKAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAJ/f4KCgkhITExPT1VVeZwJAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAF/f4GMjHNG
+        SExPVU95VZwJAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAF1cXF/iHVGRkh0UFBQT5wJAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAFlZXF/f4FDQ0ZGSExPVZcGAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAFlZWVxdX9vLENGRnRQT5cJAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAFvY2VlcXFxKT9BRkZMTMsEAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAFjY2RlZXFx
+        NSwsRkZGTJMEAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAFgY2NkZWVxYSksPz9GRssEAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAFgWVlkY2RxcTIoLCxGRowEAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAFZWWRZZGRkcTQdLCw/Q4wDAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAFYWVljWWRjZGQyHSgogYECAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAOcBv7+/wcHB
+        wsjHZXFxdQHnAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAADnAQEBAQEBAQEBAQEBAecAAAAA
+        AAAAAAAAAAAAAAAAAAD///////8AAP///////wAA////////AAD///j///8AAP//8H///wAA///gP///
+        AAD//+Af//8AAP//wB///wAA//+AD///AAD//wAH//8AAP/+AAP//wAA//4AAf//AAD//AAB//8AAP/4
+        AAD//wAA//AAAH//AAD/4AAAP/8AAP/gAAAf/wAA/8AAAB//AAD/gAAAD/8AAP8AAAAH/wAA/gAAAAP/
+        AAD+AAAAAf8AAPwAAAAB/wAA+AAAAAD/AADwAAAAAH8AAPAAAAAAPwAA4AAAAAA/AADgAAAAAD8AAP/8
+        AAH//wAA//wAAf//AAD//AAB//8AAP/8AAH//wAA//wAAf//AAD//AAB//8AAP/8AAH//wAA//wAAf//
+        AAD//AAB//8AAP/8AAH//wAA//wAAf//AAD//AAB//8AAP/8AAH//wAA//wAAf//AAD//AAB//8AAP/8
+        AAH//wAA//wAAf//AAD//AAB//8AAP/8AAH//wAA//4AA///AAAoAAAAIAAAAEAAAAABAAgAAAAAAAAE
+        AAAAAAAAAAAAAAABAAAAAQAAAAAAAKdIAACpSgAArU0AALBSAACxVQAAtFYAALdYAAC5WwAAuVwAALxe
+        AAC/YQAAvGgNALllFwC5Zx8AtWUpAMJkAADFaAAAyGsAAMxuAgDOcQYA0nYJANR5DQDFdREAz34aANd8
+        EADafxMA0IAGANSDBQDThAYA1YUFANiJBwDThg8A2YoIANqNCQDcjQoA25AKAN2QCgDekQ0A35UNAN2A
+        FgDXjxAA2Y4UAN6DGQDWjBsA3ZEQAN6UFgDdmBgA4JMKAOCSDQDhlQ4A5ZcPAOSZDgDghhsA44geAOSW
+        EADjmxEA5ZoQAOScEQDnnxQA6Z0SAOWcGgDpoBIA6aEUAO2iFADtpBYA5qAZAO+oGgDwphcA8acYAPGp
+        GAD0qxkA86waAPSsGgD1rhwA9rAbAPawHAD4sBoA+LEcAMyAIADXhSMA0IUnAN+NKgDRkScA2pYhAN2b
+        IwDcmyUA05MoANWWKQDali8A2ZksANucLQDcnS4A3Z0xAN2TOwDblT8A1po7ANKYPADVmj0A154+AOaO
+        JADjkCoA5ZIuAOqTKgDtkysA7ZQrAOiTLQDulSwA4pIxAOmWMQDrlzUA6J02AOOaOQDgnTwA6pw5APCa
+        NADynj0A36AvAN6hMADdoDgA2aE/AOSgIQDioSYA7KchAO2oJgDgoCkA6agrAPewIAD5tCIA+bQnAPOx
+        KAD5tigA+bcvAOOmMgDjpjQA5KU0AOepNQDnrD8A6Ko4AOyvOADprj8A86A/AO+zOgDysjAA8LE3APe4
+        NgD7ujEA8rY7APCzPQDytj4A9Lg6APW6PQD7vDoA+b0+AMWARADPkEUA3ZlEANmbTQDPnF8A0phUAOqe
+        QgDdoEEA2aJGAN2kRADep0kA3aVOANuiUADdplQA4ahGAO2qRwDooEgA4alKAOOtTQDzoUAA869EAPap
+        TgDsskAA77JGAOewTgDusUoA6rBMAPC1QwD0ukUA9rxGAPm9QQDwskkA8rVNAPe+SAD1uk8A+L5IAPWp
+        UADyqlQA6rRRAO22UgDuuFQA47BbAPCyUQD0vFAA8r5WAPC2XAD4sV0AyZ5nAMSlfwDfr3MA2K19AOWt
+        YgDltmcA67NgAOm5YQDsu2oA77ptAPW+awDwvm0A+bhpAOizcQDiu34A7Lt9APS9cAD7wEIA+8FGAPnA
+        SAD4wk4A+MNZAPnEWgD6w2AA/ctkAMOnhQAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAA////AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAABta58AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAbc2/a8oAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAKpvpabIawAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAADWcqgdHaa/awAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAG2JLR8dIM6tXgAAAAAAAAAAAAAAAAAAAAAAAAAAAABlsT0xIx8dLNJzngAAAAAA
+        AAAAAAAAAAAAAAAAAAAAUq58PDMxIyMdWdVr4gAAAAAAAAAAAAAAAAAAAAAAAJypj0REMzMxJSMdochr
+        AAAAAAAAAAAAAAAAAAAAAADLcN9KRURERDMxJSMjw69lAAAAAAAAAAAAAAAAAAAAAFDhuH9KSkQzRDMx
+        JSMq0o1fAAAAAAAAAAAAAAAAAAAY4Nu4gUdHQ0VEM0QlJSNU2XPJAAAAAAAAAAAAAAAAT8TcuNuSTUpK
+        R0REMzsxJSNd1WsAAAAAAAAAAAAAAJtw3bi425hNTUpKSkRERDMzMSOryGsAAAAAAAAAAADMUd2Vl7i4
+        mIFNTU1KSkRERDMzMSXQr2wAAAAAAAAAABfBsJOXmLi4g01NTU1KSkRERDk5MS3ZdJ0AAAAAAAAMz7S0
+        urrFxbiETYFNTU1KSo+xlbq6tMfTa9gAAAAAAJoGBgYGCQkL35FLTU2BTU1KthkZKys1NmSgAAAAAAAA
+        AAAAAAAAAAnfl0pLTU1NgU29FgAAAAAAAAAAAAAAAAAAAAAAAAAABt2VgkpNgU1NTdwVAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAGxrGPSkpKTU2B2xQAAAAAAAAAAAAAAAAAAAAAAAAAAAbCi5BDREpLTU3cEwAAAAAA
+        AAAAAAAAAAAAAAAAAAAABMGIi3xAR0pLTdwTAAAAAAAAAAAAAAAAAAAAAAAAAAADsoWKjzlEQ0pL3BEA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAOrhYWFOztEREq7EQAAAAAAAAAAAAAAAAAAAAAAAAAAA6tdXIV5OTtE
+        Q7YLAAAAAAAAAAAAAAAAAAAAAAAAAAABpVxcdn0nMztEtgkAAAAAAAAAAAAAAAAAAAAAAAAAAAGhWFpd
+        di8nMzu1CQAAAAAAAAAAAAAAAAAAAAAAAAAAAaVTWFxdViUnJ7EGAAAAAAAAAAAAAAAAAAAAAAAAAAAB
+        YFNYWFhcKSQnsAYAAAAAAAAAAAAAAAAAAAAAAAAAAA/XYWBjoaF3VFZWDQAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAA8BAQEBAQEEBA4AAAAAAAAAAAAAAAD///////x////4P///8D///+Af///gD///wAf//4AD//8A
+        A//+AAH//gAA//wAAH/4AAB/8AAAP+AAAB/gAAAPwAAAB8AAAA//gAf//4AH//+AB///gAf//4AH//+A
+        B///gAf//4AH//+AB///gAf//4AH//+AB///gAf//8AP/ygAAAAYAAAAMAAAAAEACAAAAAAAQAIAAAAA
+        AAAAAAAAAAEAAAABAAAAAAAApWYWAKhpGQCqbBsAqm0dAKxuHgCucCEAsHMjALJ2JgC2eioAuH4uALyC
+        MgC9gzQAvoU1AN+YEwDklw8A5ZkQAOmdEgDooBIA6aEUAO2hFQDtpRYA8KYXAPGqFwDxpxgA8qoZAPSr
+        GgD0rRoA86wcAPauHAD3sBoA97AcAPmwGgD4sRwAwIY3AMGJOQDDizwAxIs8AMWNPgDjnSUA5J4nAN6g
+        MADnoyAA5aAnAOSjKQDgoi8A7awpAPCsIwD6syIA+rcrAOKlMwDqqzIA6Kk3AOSpOgDpqz0A+rozAPq6
+        NADytjsA97s+APe8PAD5uzgA36VCAN+sVADgqUQA5axHAOmuQADkrUoA6bNKAO63TgDws0EA9btDAPS6
+        RQD6vkEA9LxMAPm+SADhrlUA5LJZAPK7UAD7wEMA+8NOAPbBUAD6xFIA+8VUAPDDaQD0xmwA9shtAPjK
+        bgD6zW8A8cmCAPPMhAD0zoYA99CHAPDPmQDw0JkAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAD///8AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAmAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAACZcJgAAAAAAAAAAAAAAAAAAAAAAAAAAJjYnXSYAAAAAAAAAAAAAAAAAAAAA
+        AAAiRREPJ10mAAAAAAAAAAAAAAAAAAAAAAtHFhYQECddJgAAAAAAAAAAAAAAAAAACkobGxYRERAnXSYA
+        AAAAAAAAAAAAAAAJUjAbGxgbFhEQKF0mAAAAAAAAAAAAAAhSTjEgGxsbFhYRECtdJgAAAAAAAAAABjpI
+        SDggICAbGBgWERAnXSYAAAAAAAAFOVBSUk84IDAgGxtUW1paWlwmAAAAAAAABQUGBgg8IDAgMBtWCwsL
+        IiIAAAAAAAAAAAAAAAY6HiAgMCBXCgAAAAAAAAAAAAAAAAAAAAVHGx4wICBXCgAAAAAAAAAAAAAAAAAA
+        AAVJGxseMCBXCQAAAAAAAAAAAAAAAAAAAAVJLxsbHjBXCAAAAAAAAAAAAAAAAAAAAAFELhYcGx5XCAAA
+        AAAAAAAAAAAAAAAAAAFDMxMVGxtXBgAAAAAAAAAAAAAAAAAAAAFANCsWFhxVBgAAAAAAAAAAAAAAAAAA
+        AAE/MisOEBZVBQAAAAAAAAAAAAAAAAAAAAE9KS0OEBNUAwAAAAAAAAAAAAAAAAAAAAE+S0xAND9TAwAA
+        AAAAAAAAAAAAAAAAAAABAQEBAwEBAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA////AP/v
+        /wD/x/8A/4P/AP8B/wD+AP8A/AB/APgAPwDwAB8A4AAPAMAABwDgAA8A/gD/AP4A/wD+AP8A/gD/AP4A
+        /wD+AP8A/gD/AP4A/wD+AP8A/gD/AP8B/wD///8AKAAAABAAAAAgAAAAAQAIAAAAAAAAAQAAAAAAAAAA
+        AAAAAQAAAAEAAAAAAAClZhYAsnYmALN4KQC4fi8A1Y0XANWOGADXkBkA2pUbANuVHADclhwA3poeAOCc
+        HwDgmyAA46EiAOaiIwDmpiMA56cnAOilIwDppiUA66omAO2rJwDuricA46YsAOyrKADurikA7q4sAPCv
+        KQDvsS4A8LAqAO2vMQDkpjgA5q8+AOqwOADwszIA4qtBAOi0TwDyvEoA7LlSAOSyXADnt18Aw5ljAMui
+        bQDqumEA5LhoAOa7cADpv3MA78FlAPDFdgDyyXkA88x6APXNegD20IAA6MeQAOnIkQDpyZcAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAP///wAAAAAAAAAAAwAAAAAAAAAAAAAAAAAAAzcCAAAAAAAAAAAAAAAAAycFNQIAAAAA
+        AAAAAAAAAysLCAY1BAAAAAAAAAAAAy8SDg0IBjUEAAAAAAAAAzMaFBIODQgINQQAAAAAAzQlIhQaEg4f
+        Li01BAAAKQEBAQEbGhQUMAQEBAQqAAAAAAABGxsbFDMEAAAAAAAAAAAAARwbGxszBAAAAAAAAAAAAAEe
+        FBsbMwQAAAAAAAAAAAABIRQcHDMEAAAAAAAAAAAAASARFBQzBAAAAAAAAAAAAAEjFw4WMwQAAAAAAAAA
+        AAABLCgkJjMDAAAAAAAAAAAAAAEBAQEBAAAAAAAA/v8AAPx/AAD4PwAA8B8AAOAPAADABwAAgAMAAAAB
+        AADwHwAA8B8AAPAfAADwHwAA8B8AAPAfAADwHwAA+D8AACgAAAAwAAAAYAAAAAEAIAAAAAAAgCUAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAEAAAADAAAABgAAAAgAAAAGAAAAAwAA
+        AAEAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAQAAAAMAAAAFgAA
+        ABsAAAAWAAAACwAAAAQAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAwAA
+        AAwAAAAfAAAAMwAAADwAAAAyAAAAHQAAAAsAAAACAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAACAAAACSccDyHPllLiypFQ4M2UUesdFQtZAAAANQAAABoAAAAJAAAAAgAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAEAAAAHAAAAF8aOTb/RlU3z0pVH/82UU/K/iUvcAAAAUAAAADAAAAAWAAAABgAA
+        AAEAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAQAAAAUAAAATs4BGjtOXUfXLfxn/0pE5/9ikYP7Rl1T3pXdBvQAA
+        AEoAAAAqAAAAEgAAAAUAAAABAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAABAAAAA+RaDhc0ZdR+M6HJv3Legf/yHUA/9aa
+        Sv/Tn1v51JlU+nxZMZcAAABDAAAAJAAAAA4AAAADAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAACAAAADFg/ITLPlE/1z4wz+NGC
+        DP/NewD/y3gA/8l3BP/apVv/zZdV89OYU/hHMxxzAAAAPAAAAB8AAAALAAAAAgAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAIAAAAJJxwOIMiO
+        SuHNj0Dy1YkR/9ODBf/QfwH/zXsA/8t4AP/MfA3/3apl/8yXV/DLklDuHBQLXQAAADYAAAAaAAAACAAA
+        AAEAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAQAA
+        AAcAAAAXu4VEvMuPRvPajhf/2osK/9aIBv/UgwX/0YAD/819Af/LeQD/z4Qa/92sZ//OmFfyvYhL2QAA
+        AE8AAAAvAAAAFQAAAAYAAAABAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAABAAAABQAAABOodjyMyY5H9tuTH//ekg7/3Y4K/9qLCP/Whwb/1IMF/9GAA//PfQD/y3kA/9OO
+        Lf/bqWX90plW96R2QbsAAABJAAAAKQAAABEAAAAFAAAAAQAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAEAAAAD4hfL1rHjEb42ZUq/eOXFf/jlQ7/35IN/92OCv/aiwn/14gG/9SE
+        Bf/SgQT/z34B/8t6AP/Xm0P/1qNg+dKYU/p6WDCVAAAAQgAAACMAAAAOAAAAAwAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAIAAAALUzkcMsSJQvPRkTL3550Y/+ecEf/lmBD/45UP/+CS
+        Df/djgr/24sJ/9eIB//VhAb/0oED/9B+Af/NfAP/26NU/9CcXPPSllP4RzMccwAAADsAAAAeAAAACgAA
+        AAIAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAgAAAAkUDgYeu4I938eLO/Lpnxv/7qIU/+qg
+        E//onRL/5pkR/+SWDv/gkw3/3o8L/9uMCf/ZiQf/1YUG/9OBBP/QfwP/zn8J/9+sY//Nmlvwy5JQ7RYQ
+        CVoAAAA0AAAAGQAAAAgAAAABAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAABAAAABwAAABaueDe4wYY98+qq
+        Mf/vphb/8KYX/+2iFf/roBP/6J0S/+aZEf/klw//4JQO/96QCv/bjQn/2YoI/9WFBv/TgwT/0H8D/9GG
+        Ff/gr2n/z5pb87qHSdYAAABOAAAALgAAABQAAAAGAAAAAQAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAEAAAAFAAAAEpxr
+        MIe9gjr36Ks///azM//zqRj/8agY//CkF//uoxX/66AU/+mdEv/mmhD/5JcP/+GUDf/ekAr/240K/9mJ
+        B//Whwb/04IE/9B/Af/Ujyb/3q5p/dKZV/ifcj62AAAARwAAACgAAAARAAAABAAAAAEAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAMAAAAOfVUkV7p/N/jcoT389rlB//m4Of/1rBv/86oZ//GoGP/wphf/7qMV/+ugE//pnhL/55oR/+SX
+        EP/hlQ7/3pIL/9yNCf/aiwf/1ocF/9ODBP/RgAP/2Js6/9ioZvjTmFT6dlYukQAAAEEAAAAjAAAADQAA
+        AAMAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAgAAAAtGMBQvtXsz8sySOPb1uUD/+75B//q8Pf/4sB//9Kwa//OrGv/yqRn/8KYX/+6j
+        Ff/roBT/6Z4T/+ecEf/kmBD/4ZUO/9+SC//djgn/2ooI/9aHBv/UgwT/0YAC/9ylT//So2Tzz5VR90Mw
+        GnAAAAA6AAAAHQAAAAoAAAACAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAACAAAACRIMBR2udS/cvYI08/K3QP/7v0H/+79B//u+Qf/4syX/9q0a//Ws
+        G//zqxr/8akZ//GmGP/uoxX/7aEU/+qeE//nnBH/5ZgP/+GVDv/fkg3/3I4K/9qLB//WiAf/1IQF/9KE
+        Cv/hrWD/z55i8MmPTusPCwZXAAAAMwAAABgAAAAIAAAAAQAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAEAAAAHAAAAFqJtKba0eTDz7LE///q+Qf/7v0H/+79B//vA
+        Q//6tiz/+K4a//auG//1rRr/9Ksa//KpGf/wpxj/76MX/+2hFP/pnxP/6JwS/+WYD//hlQ//35IN/92O
+        Cv/aiwn/14gH/9SEBf/ViRP/4rJo/8+cXfS4hEjVAAAATQAAAC0AAAAUAAAABgAAAAEAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAQAAAAUAAAASjl8jgq91LPfjpjr/+Ls///q+
+        Qf/7v0H/+79B//vAQ//7vDb/+bEc//iwHP/2rhz/9a0b//SrGv/yqhn/8agY/++kF//toRT/6p8T/+ic
+        Ev/lmRD/45YO/9+TDf/djwv/2owI/9eJB//UhQT/2JEj/+Gya/zRmVf5mm48sQAAAEYAAAAnAAAAEAAA
+        AAQAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAwAAAA5zTBtTrXIp+NOY
+        NPzytz3/+bw+//q9QP/6vkH/+79B//u/Qf/7vj7/+rMg//mxHP/4sBz/9q4c//WsG//0rBr/86oZ//Go
+        GP/vpBf/7aEV/+qfE//onRH/5ZkQ/+OWD//gkw7/3Y8J/9uMCP/XiQf/1YQG/9uaNv/armz30phU+nJR
+        LI0AAABAAAAAIgAAAAwAAAADAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAACAAAACzom
+        DSyobyXxv4Ut9e2wOv/1ujz/+Ls9//m8QP/6vUD/+r5B//u/Qf/7v0L/+rUn//mxG//5sR3/+LAc//au
+        HP/1rRv/9Kwa//OqGf/xqBj/76QX/+6iFf/roBP/6JwS/+aZEP/klg//4JMN/96OC//bjQn/2YkI/9WF
+        Bv/fpkz/06Zp8s2TUPY/LRhtAAAAOQAAABwAAAAJAAAAAgAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAEGRAFFKRqI9mwdibx56o3//G0Ov/ztjv/9bo8//a7Pv/5vED/+r1A//q+Qf/7wEP/+rgu//mx
+        G//5sh3/+bId//ixHP/2sBz/9a0b//SrGv/yqhn/8agY//CmF//uoxX/6qAT/+mdEf/mmRD/5JYP/+CT
+        Dv/ejwr/3IwK/9mJB//Whwn/4q5d/9GiZ+7Hj0znEg0HSAAAACcAAAAPAAAAAwAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAGoGcgpaluIvLdoDP/6q03/++yOf/xtDr/87Y7//S4PP/2uz3/+bw+//m9
+        QP/6vkL/+rs3//myHP/5sh3/+bId//myHf/5sR3/+LAc//WtHP/0rRv/9KsZ//KpGP/wphf/7qMV/+ug
+        E//onhL/55oR/+SXD//hlA3/3pAL/9yNCf/Zigf/2I0S/+S0aP/ToGPwvolJxAAAACcAAAARAAAABQAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAACiaB9ppmsg9dKVL//nqjX/67A3/+6yOP/wtDr/87Y7//W4
+        PP/4uz3/+b0+//m9QP/5vUD/+rw7//myHv/5sh3/+bId//myHf/5sh3/+LEd//iwHP/2rhv/9awb//Or
+        Gv/xqBn/8KYY/+6jFf/roBP/6p4Q/+icDv/llw3/4ZQK/9+QCf/cjQb/2okF/9mRHf/ismj40ZVQ9MGK
+        SogAAAALAAAAAwAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAACmaR7PyYgn+uSdL//loDD/56Iy/+qk
+        M//rpjT/7qk3//CrOP/xrTn/8a05//CxOP/4vD7/+bxA//izJP/4sRz/+bId//myHf/5sh3/+bId//mx
+        Hf/4sBz/9q4c//WsG//zqxr/8qkY//GrI//xsDr/8bFF//W0Sf/2s0n/9LJI//OwSP/yr0f/8a1G//Cs
+        R//urEv/5ahV6dGVT+AAAAAEAAAAAQAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAACkaR2XpGoe/6Vq
+        H/+mayD/pmwh/6hsIv+pbSP/qW4k/6twJf+scCf/rXIn/65zKf/6vDz/+LxA//a1Kv/2sBr/+bEd//my
+        Hf/5sh3/+bId//myHf/5sR3/+LAc//auHP/1rRv/9Ksa//a3Ov/EiED/xYlB/8aKQ//Hi0T/yY1G/8qO
+        R//Lj0n/zJBK/82RS//Ok0z/0JRN/9GVTpcAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAK1yJ//5uzv/9rs+//a3
+        Mf/1rhr/9rAc//iyHf/5sh3/+bId//myHf/5sh3/+bEd//iwHP/2rhz/9a0b//m5Ov/Chj//AAAAKwAA
+        AA4AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAKtw
+        Jf/4tzr/9Lg9//W3OP/0rRz/9a4b//awHP/4sh3/+bId//myHf/5sh3/+bId//mxHf/4sBz/9q4c//q8
+        O//AhT3/AAAAKwAAAA4AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAKpvJP/0tTn/8rU8//O2Pf/zsSf/86wZ//WuG//2sBz/+LEd//myHf/5sh3/+bId//my
+        Hf/5sh3/+LEc//u9PP+/gzv/AAAAKwAAAA4AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAKluI//yszf/77M6//K1Pf/ysjD/8aoY//SsGv/1rhz/9rAc//ix
+        Hf/5sh3/+bId//myHf/5sh3/+bId//y+Pf+9gTn/AAAAKwAAAA4AAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAKdtIv/wsDb/7bA5//CzO//xszj/8Kkb//Gq
+        Gf/yqxr/9a4b//awHP/4sR3/+bId//myHf/5sh3/+bId//y/Pv+7gDf/AAAAKwAAAA4AAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAKZrIf/tqzT/6qw3/+2w
+        OP/vsjr/7qog/+6nFf/xqhn/86wa//StG//2sBz/+LEd//myHf/5sh3/+bId//zAPv+5fjX/AAAAKwAA
+        AA4AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAKZq
+        IP/pqTL/56k0/+qsN//tsDn/7asp/+2jFP/vqBj/8aoZ//KsGv/1rhv/9rAc//ixHP/5sh3/+bId//zA
+        Pv+4fDT/AAAAKwAAAA4AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAKRqHv/mpC//5KYz/+epNP/pqzf/66wy/+mhFf/rpBT/7qcY//CqGf/zrBr/9K0b//Ww
+        HP/2sRz/+LId//zAPv+2ezL/AAAAKwAAAA4AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAKRoHf/koi//4KIx/+SmMv/nqDb/6aw4/+ikIP/ooBL/7aQV/+6n
+        F//xqRn/8qwa//StG//1rhz/9rAc//zAPv+1eTD/AAAAKwAAAA4AAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAKNoHf/goC3/36Aw/+CiMP/kpDP/56k2/+en
+        Lv/mnRL/6KAT/+ujFf/uphj/8KkY//KrGv/0rRv/9a4c//y+Pf+zeC7/AAAAKwAAAA4AAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAKNoHf/enSz/3J0v/96f
+        L//goTD/5KYy/+anM//knRf/5Z0R/+igE//qoxX/7qYX//CpGP/yqxn/86wb//q9Pf+ydi3/AAAAKwAA
+        AA4AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAKNo
+        Hf/dnCr/25wt/9ydLv/eny//4KIw/+OmM//hniD/4ZgO/+WdEv/ooBP/6qIU/+6mF//wqBj/8qsa//m9
+        O/+wdCv/AAAAKwAAAA4AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAKNoHf/bmCj/2Zgs/9qaLf/bnC7/3p8v/+CiMf/goCn/3pUO/+GZD//lnRL/6KAT/+qi
+        Ff/uphf/8KgY//a5O/+ucyn/AAAAKwAAAA4AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAKNoHf/XlSf/1ZYq/9mYLP/ami3/25wu/92eL//goTH/3Zga/96U
+        C//hmBD/5ZwS/+efE//qohX/7aYX//W4Ov+tcij/AAAAKwAAAA4AAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAKNoHf/WlCb/1JQo/9WVKf/XmCr/2pot/9uc
+        Lv/enzH/3Z0n/9uSC//elQ3/4ZgQ/+ScEf/nnxP/6qIU//K1OP+rcCb/AAAAJwAAAA0AAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAKNoHf/TkiX/0pIo/9OU
+        KP/VlSj/15cq/9qaLf/bnC//3Z4v/9qSEv/ajwn/3ZUO/+CXD//knBH/558S//GyNv+qbyX/AAAAHwAA
+        AAkAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAKNo
+        Hf/SjyT/0I8m/9KSJ//TlCj/1JUp/9eXKv/ZmS3/250w/9qWHv/WjAf/25IL/92UDf/hmBD/5JwR/+2v
+        Nf+pbiP/AAAAEwAAAAUAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAKNoHf/RjCL/zY0l/8+OJv/RkCf/05Mo/9SUKf/Wlyn/2pkt/9qaLP/WjQ//1owI/9qP
+        Cv/dlA7/5aYz/+qsNP+obCL/AAAACAAAAAIAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAKNoHZ6jaB3/1J1G/9SeRf/XoEf/2qJI/9qlSf/bpkn/3adL/+Cr
+        Tv/gpkP/25wr/92eLP/goi//46Uv/6ZqIP+jaR+gAAAAAgAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAACjaB2eo2gd/6NoHf+jaB3/o2gd/6No
+        Hf+jaB3/o2gd/6NoHf+jaB3/o2gd/6NoHf+jaB7/pWke/6RpHp4AAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAD///Af//8AAP//
+        8B///wAA///gD///AAD//8AH//8AAP//gAP//wAA//8AAf//AAD//wAB//8AAP/+AAD//wAA//wAAH//
+        AAD/+AAAP/8AAP/wAAAf/wAA//AAAB//AAD/4AAAD/8AAP/AAAAH/wAA/4AAAAP/AAD/AAAAAf8AAP8A
+        AAAB/wAA/gAAAAD/AAD8AAAAAH8AAPgAAAAAPwAA8AAAAAA/AADwAAAAAB8AAOAAAAAADwAA4AAAAAAP
+        AADgAAAAAA8AAOAAAAAADwAA4AAAAAAPAADgAAAAAD8AAP/8AAB//wAA//wAAH//AAD//AAAf/8AAP/8
+        AAB//wAA//wAAH//AAD//AAAf/8AAP/8AAB//wAA//wAAH//AAD//AAAf/8AAP/8AAB//wAA//wAAH//
+        AAD//AAAf/8AAP/8AAB//wAA//wAAH//AAD//AAAf/8AAP/8AAB//wAA//wAAH//AAD//AAAf/8AAP/8
+        AAD//wAA//4AA///AAAoAAAAIAAAAEAAAAABACAAAAAAAIAQAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAJCKQwWOiQLMQAA
+        ADAAAAAfAAAACgAAAAEAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAACyHwmPemQ
+        KPPulSz/w3YbvwAAADgAAAAcAAAABwAAAAEAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAatq
+        Hh3qkirx5a1i//KqVP/vly7/klgQiAAAADMAAAAXAAAABQAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AABOMA0J5I4l1eidNv/dpU7/26JQ//iyXv/ulCz+SisDXQAAAC0AAAARAAAAAwAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAABNyJIaPqmzb64ahG/9OEBv/QgAb/3aZU//WpUP/okCj4EgoARAAAACcAAAANAAAAAgAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAALOfhxj6JUt+eesP//dkRD/2IkH/9SDBf/Thg//5bZn//OhQP/ZhSHgAAAAPQAA
+        ACEAAAAKAAAAAQAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAACsWgUMeONJPjvskb/5Zwa/+CSDf/djgr/2IkH/9WEBf/WjBv/77pt//Ca
+        NP+6cRiwAAAAOAAAABsAAAAHAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAY5RDBfdhRrt869E/+2oJv/onRL/5ZgQ/+GUDf/djgv/2ooI/9WF
+        Bv/ali//+Lhp/++XLv+IUQyAAAAAMgAAABUAAAAEAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAG1YAVy+2pRfvzsjD/76UX/+yhFP/onRP/5ZkQ/+GU
+        Dv/dkAr/2osI/9aGBv/doEH/+bJd/+2TK/4rGQBQAAAALAAAABAAAAACAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAABMl2D5TjmTb7+sVa//WsHP/yqRj/8KYX/+2i
+        FP/pnhL/5pkR/+KVDv/dkQv/24sI/9iJCv/jsFv/9qlO/+SOJfQAAABAAAAAJgAAAA0AAAACAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAK7bAtd14Qg+/3LZP/6vkH/97Ag//Sr
+        Gf/yqhn/8KYX/+2iFf/qnhP/5psR/+KWDv/fkQv/24wJ/9mOFP/su2r/86A//9WCHdgAAAA8AAAAIAAA
+        AAkAAAABAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAABl1EBKc56Evb6w2D/+8FG//u/
+        Q//5tCf/9q0Z//SsGv/yqRr/8KYX/+6iFf/qnxP/55sR/+KWD//ekQz/24wJ/9uVIf/0vXD/8Jo0/6xo
+        EqMAAAA3AAAAGgAAAAYAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAVIrAA7Hcwjm8LJR//rB
+        S//7v0H/+8BD//u6Mf/4sBr/9q4c//WsG//zqhn/8acY/+6jFf/qnxP/55sR/+OXDv/fkg3/240J/96e
+        Mv/6uGn/7ZUs/2Y+BWoAAAAxAAAAFQAAAAQAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAFv2sHv+Cd
+        PP74wk7/+r1A//q+Qf/7wEL/+7w6//mxHf/5sRz/964c//StGv/0qxr/8agY/+6iFv/rnxP/6JwR/+SW
+        EP/gkg3/3I0J/+KoSv/4sFz/6pIo/DokA1MAAAArAAAAEAAAAAIAAAAAAAAAAAAAAAAAAAAAAAAAA7Zj
+        CYbQhCT7879V//S4O//2uz7/+bxA//q+Qv/7vj//+bQi//mxG//5sh3/968c//WtG//zqhn/8agY/++l
+        Fv/roBP/6JwR/+WXD//gkg3/3pAP/+m5Yf/2qU7/4Ioi7QAAAD8AAAAlAAAADAAAAAIAAAAAAAAAAAAA
+        AACtWQRFxXMO++22Uv/vszr/8rY7//W5PP/4vD3/+r5B//q+Qf/5tij/+bEb//myHf/5sR3/97Ac//Wu
+        G//0qxr/8akZ/++kFv/roRT/6J0Q/+WYDf/gkwr/3pQW//C+bf/ynj3/z38axgAAACkAAAASAAAAAwAA
+        AAAAAAAAvWoGQrpiA/Trs2D/6rBL/e2ySv3xtEz987dN/fW6Tv30vE/9+L1A//m3L//4sRv/+bId//my
+        Hf/5sh3/+LAc//atHP/zqxv/87Iw//G1Q/7ws0f987VL/fGySv3vsEn98LZc/vW+a/7tlCv/4I0mmAAA
+        AAkAAAACAAAAAAAAAACtTgBIsVQCvLNXAP+xVQD/tFcA/7dYAP+5WwD/vF4A/71fAP/5wlLz97g2//aw
+        G//5sR3/+bId//myHf/5sh3/+LAc//auHP/3vEb/13wQ/9p/E//dgBb/3oMZ/+CGG//jiB7/5o4k/+eO
+        ItrnjiVwAAAAAQAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAulwA//jA
+        UfL1uTr/9K8e//awG//5sh3/+bId//myHf/5sh3/+LAd//i+SP/UeQ3/AAAALgAAAA0AAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAC3WgD/87xP8vK2Pv/zsSj/9KwZ//awHP/4sR3/+bId//myHf/5sh3/+cBI/9J2Cf8AAAAuAAAADQAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAALRXAP/xuU3y8LM9//KyMv/xqhj/9K0b//avHP/4sh3/+bId//myHf/6wUj/znEG/wAA
+        AC4AAAANAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAsVQA/+61S/Lsrzn/8LE3/++oGv/xqhj/9K0a//awHP/4sR3/+bId//rB
+        SP/MbgL/AAAALgAAAA0AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAACwUgD/6bBI8ueqNv/srzj/7Kch/+2lFP/wqhn/9K0b//av
+        HP/4shz/+sFI/8hrAP8AAAAuAAAADQAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAK9PAP/mrEXy46Yy/+iqOP/pqCv/6aET/+2m
+        Fv/xqRn/86wa//SuHP/5wEj/xWgA/wAAAC4AAAANAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAArUwA/+KpRPLfoTD/5KU0/+ep
+        Nf/moBn/6aAS/+2lF//wqRj/86wa//e+SP/CZAD/AAAALgAAAA0AAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAACqSwD/4KZC8tyd
+        L//foC//46Y0/+SgIf/kmw//6KEU/+ykFv/wqRj/9bxH/79hAP8AAAAuAAAADQAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAKdJ
+        AP/do0Dy2Zot/9ydLv/fojL/4KAp/9+WD//knBH/6KAT/+2lFv/0ukX/vF8A/wAAAC4AAAANAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAp0gA/9mfPvLWliv/2Zos/9ydL//eoDD/3ZgY/9+VDP/kmxL/558U//C2Q/+5XAD/AAAALgAA
+        AA4AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAACnSAD/2J498tOTKP/Wlin/2Zks/9ydMf/cmyX/25AK/9+WDv/jmxH/7LJA/7dY
+        AP8AAAAsAAAADAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAKdIAP/Wmjr90ZEn/9OTKP/Vlin/2Zkt/9ucLf/XjxD/2Y8J/9+V
+        Dv/prj//tFUA/wAAAB4AAAAHAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAp0gA1tWcRK/SmDz/1Zo9/9eePv/ZoT//3aRE/92g
+        OP/alyH/3Zsj/+KhJv+zVgHoAAAACwAAAAIAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAACnSABLp0gA1qdIAP+nSAD/p0gA/6dI
+        AP+nSQD/qUkA/6pLAP+sTgD/sFIA4KJGAE0AAAABAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAP/4D///8Af//+AH///gA///wAH//4AA//8AAP/+AAB//gAAP/wAAB/4AAAP8AAAD+AA
+        AAfgAAADwAAAAcAAAAGAAAABgAAAA/+AAf//gAH//4AB//+AAf//gAH//4AB//+AAf//gAH//4AB//+A
+        Af//gAH//4AB//+AAf//gAP/KAAAABgAAAAwAAAAAQAgAAAAAABgCQAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAADGjj9nxo4//8aOP2cAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAMSMPGfFjD7/8M+Z/8aO
+        P//Gjj9nAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAwok5Z8OKO//pqz3/450m//DQmf/Gjj//xo4/ZwAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAC+hTZnwIY3//Cz
+        Qf/onBH/5JcP/+OdJf/w0Jn/xY4+/8aOP2cAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAALuBMme8gzP/9LpF/++mFv/soRT/6JwS/+WYEP/jnyb/8dCZ/8WN
+        Pv/Gjj9nAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAuH0tZ7l/
+        L//5vkj/9Kwa//KpGf/wphf/7aEV/+meEv/lmRD/5J4n//DQmv/FjT3/xY0/ZwAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAC0eClntnoq//vFU//6syL/964a//WsG//yqhr/8acY/+2i
+        Ff/qnhP/5ZkQ/+SfJ//x0Jr/xY09/8WOPmcAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAALF0
+        JGeydib/+8ZU//vAQ//6tyv/+bAa//evHP/1rRv/86sZ//GnGP/tohb/6p8T/+aaEP/loCf/8dGZ/8SM
+        Pf/FjT5nAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAArXAgZ69xIv/3uz7/+r1A//q/Q//6ujP/+bEb//my
+        Hf/3sBz/9a0b//OqGv/xpxj/7qMV/+qfE//nmhD/5Z8n//HQmv/Dizz/xY09ZwAAAAAAAAAAAAAAAAAA
+        AAAAAAAAq24e//K2O//2wVD/+sRS//vFVf/7w07/+ro0//myHf/5sh3/+LAc//WuHP/0qxr/9shs//fQ
+        h//0zob/88yE//HJgv/x0Zj/xIs8/wAAAAAAAAAAAAAAAAAAAAAAAAAAqWscdaptHf+sbx7/rnAg/69y
+        Iv+wcyP/+bs4//mxHP/5sh3/+bId//mxHf/2rhz/+Mpu/7yCMv+9gzT/voU1/8CGN//AiDj/wok6dQAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAACucCH/97w8//ewGv/5sh3/+bId//my
+        Hf/5sRz/+cxv/7l/L/8AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAACsbh7/9btD//WtGf/3sRz/+bId//myHf/5sh3/+81v/7h8Lf8AAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAACqbB3/9LxM//Os
+        HP/1rRr/97Ed//myHf/5sh3/+85v/7Z6Kv8AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAACpahr/8rtQ//CsI//xqhf/9K4b//exHf/5sh3/+85v/7N3
+        J/8AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AACoaRn/7rdO/+2sKf/uphX/8qsa//StG//3sBz/+85v/7F1Jf8AAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAACmZxf/6bNK/+qrMv/qohX/7qYW//Kr
+        Gv/0rRv/+c1v/69yIv8AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAClZhb/5axH/+ipN//noyD/6aAR/+2lF//xqhn/98pu/61wIP8AAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAClZhb/4KlE/+Kl
+        M//koyn/5JsQ/+igFP/tpRb/9sht/6ttHv8AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAClZhb/36VC/96gMP/goi//35gT/+SbEP/ooBP/9MZs/6ps
+        G/8AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAClZhb/36xU/+GuVf/ksln/5K1K/+SpOv/prkD/8MNp/6hqGv8AAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAClZhZ1pWYW/6VmFv+lZhb/pWYW/6Vm
+        Fv+lZhb/pmcX/6doGHUAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAP///wD/x/8A/4P/AP8B/wD+AP8A/AB/APgAPwDwAB8A4AAPAMAA
+        BwDAAAcAwAAHAP4A/wD+AP8A/gD/AP4A/wD+AP8A/gD/AP4A/wD+AP8A/gD/AP4A/wD+AP8A////ACgA
+        AAAQAAAAIAAAAAEAIAAAAAAAQAQAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AACxcSJds3gp/76DM18AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AACycSJds3gp/+nJl/+ydib/voMzXwAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AACxcSJds3gp/+SyXP/VjRf/6MeQ/7J2Jv++gzNfAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AACxciJds3gp/+q6Yf/emh7/2pUb/9WOGP/ox5H/uH4v/76DNF0AAAAAAAAAAAAAAAAAAAAAAAAAAAAA
+        AACycyNfs3gp/+/BZf/opSP/46Ei/+CbIP/blRz/1Y8Z/+jHkf+4fi//voM0XQAAAAAAAAAAAAAAAAAA
+        AACxciJes3gp//TNe//uriz/66om/+mmJf/moiP/4Jwf/9yWHP/XkBn/6ceR/7h+L/++gzRdAAAAAAAA
+        AACwcSJes3gp//bQgP/yvEr/8LMy/+6uJ//sqyj/6acm/+aiI//kpjj/6b9z/+a7cP/pyJH/uH4v/76D
+        NF0AAAAApWYWqqVmFv+lZhb/pWYW/6VmFv/wryj/764p/+yrKP/qpyX/8MV2/7h+L/+4fi//uH4v/7h+
+        L/+xdCWqAAAAAAAAAAAAAAAAAAAAAAAAAAClZhb/8LAr//CwKf/vryr/7asn//LJef+4fi//AAAAAAAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAApWYW/++xLv/wryn/8LAq//CvKv/0zHr/uH4v/wAA
+        AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAKVmFv/trzH/7q4n//CwKv/wsCr/9s17/7h+
+        L/8AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAClZhb/6rA4/+urJv/urin/768q//bO
+        e/+4fi//AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAApWYW/+avPv/npyf/66om/+6u
+        KP/2z3r/uH4v/wAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAKVmFv/iq0H/46Ys/+am
+        I//rqyf/9M16/7h+L/8AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAClZhb/5Lho/+e3
+        X//otE//7LlS//PMev+4fi//AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAu4Eyd6Vm
+        Fv+lZhb/pWYW/6VmFv+lZhb/wIc5dwAAAAAAAAAAAAAAAAAAAAAAAAAA/H8AAPg/AADwHwAA4A8AAMAH
+        AACAAwAAAAEAAAABAADwHwAA8B8AAPAfAADwHwAA8B8AAPAfAADwHwAA8B8AAA==
+</value>
+  </data>
+</root>

SCrawler/Download/ActiveDownloadingProgress.vb

@@ -0,0 +1,72 @@
+' Copyright (C) 2022  Andy
+' This program is free software: you can redistribute it and/or modify
+' it under the terms of the GNU General Public License as published by
+' the Free Software Foundation, either version 3 of the License, or
+' (at your option) any later version.
+'
+' This program is distributed in the hope that it will be useful,
+' but WITHOUT ANY WARRANTY
+Imports System.ComponentModel
+Imports PersonalUtilities.Forms
+Namespace DownloadObjects
+    Friend Class ActiveDownloadingProgress
+        Private Const MinWidth As Integer = 450
+        Private MyView As FormsView
+        Friend Property Opened As Boolean = False
+        Private ReadOnly JobsList As List(Of DownloadProgress)
+        Friend Sub New()
+            InitializeComponent()
+            JobsList = New List(Of DownloadProgress)
+            AddHandler Downloader.OnReconfigured, AddressOf Downloader_OnReconfigured
+            Downloader_OnReconfigured()
+        End Sub
+        Private Sub ActiveDownloadingProgress_Load(sender As Object, e As EventArgs) Handles Me.Load
+            MyView = New FormsView(Me)
+            MyView.ImportFromXML(Settings.Design)
+            MyView.SetMeSize()
+            Opened = True
+        End Sub
+        Private Sub ActiveDownloadingProgress_Closing(sender As Object, e As CancelEventArgs) Handles Me.Closing
+            MyView.ExportToXML(Settings.Design)
+            e.Cancel = True
+            Hide()
+        End Sub
+        Private Sub Downloader_OnReconfigured()
+            Const RowHeight% = 30
+            With TP_MAIN
+                If .Controls.Count > 0 Then
+                    For Each c As Control In .Controls
+                        If Not c Is Nothing Then c.Dispose()
+                    Next
+                    .Controls.Clear()
+                End If
+                .RowStyles.Clear()
+                .RowCount = 0
+            End With
+            JobsList.ListClearDispose
+            With Downloader
+                If .Pool.Count > 0 Then
+                    For Each j As TDownloader.Job In .Pool
+                        With TP_MAIN
+                            .RowStyles.Add(New RowStyle(SizeType.Absolute, RowHeight))
+                            .RowCount += 1
+                            JobsList.Add(New DownloadProgress(j))
+                            AddHandler JobsList.Last.OnTotalCountChange, AddressOf Jobs_OnTotalCountChange
+                            .Controls.Add(JobsList.Last.Get, 0, .RowStyles.Count - 1)
+                        End With
+                    Next
+                    TP_MAIN.RowStyles.Add(New RowStyle(SizeType.Percent, 100))
+                    TP_MAIN.RowCount += 1
+                End If
+                Dim s As Size = Size
+                s.Height = TP_MAIN.RowStyles.Count * RowHeight + PaddingE.GetOf({TP_MAIN}).Vertical(TP_MAIN.RowStyles.Count) - TP_MAIN.RowStyles.Count * 2
+                MinimumSize = New Size(MinWidth, s.Height)
+                Size = s
+            End With
+            TP_MAIN.Refresh()
+        End Sub
+        Private Sub Jobs_OnTotalCountChange()
+            If JobsList.Count > 0 Then MainProgress.TotalCount = JobsList.Sum(Function(j) CLng(j.Job.Progress.TotalCount))
+        End Sub
+    End Class
+End Namespace