geonu/SCrawler
1
0
Fork 0
mirror of https://github.com/AAndyProgram/SCrawler.git synced 2026-03-14 15:52:18 +00:00
Code Issues Packages Projects Releases Wiki Activity

2023.4.28.0

Browse Source 
Plugins
IPluginContentProvider: added DownloadSingleObject function; added tokens to GetMedia and Download functions; removed GetSpecialData function
Add IDownloadableMedia interface
Removed 'Channel' option from all functions and enums
ISiteSettings: added GetSingleMediaInstance function
ExchangeOptions: removed 'IsChannel'
UserMediaTypes: added Audio and AudioPre enums
IUserMedia, PluginUserMedia: changed ContentType and DownloadState from integers to their enums

SCrawler
Add YouTube standalone downloader
Add gallery-dl & yt-dlp support
Remove 'UserInfo' requirement from 'ProfilesSaved'
Update 'SiteSettingsBase' to use domains and Netscape cookies
UserDataBase: remove channels; remove old 'Merge' const; standardize SavedPosts file naming; move 'ValidateMD5' function from Twitter to UserDataBase to use it in other UserData classes; add 'DownloadSingleObject' environment for single posts; add validating file extension for m3u8 during download; add reindex of video file during download

Rewritten DomainsContainer
Create a universal settings form and PSettingsArttribute
Gfycat, Imgur: turn these classes into IUserData to download a single object

All plugins: update 'GetInstance' function for saved posts; update domains where implemented; remove 'OptionForm' where it exists; update options where they exist; update unix date providers; reconfigure channels where they exist

LPSG: fix attachments; update converters and regex
Add sites: ThisVid, Mastodon, Pinterest, YouTube, YouTube music
Reddit: standardize container parsing for all data types; new channel environment; fix 'ReparseMissing' function; redirect data downloading to the base download function, saved crossposts support
Twitter: fixed gif path bug; fixed downloading saved posts
PornHub: hide unnecessary errors; photo galleries bug
RedGifs: add 'UserAgent' option

Added icons to download progress

Rename some objects
Completely redesigned standalone downloader form and rewritten its environment
WebClient2: update to use tokens

Labels: update label form (save labels to file only when OK button is clicked); change removing labels.txt from recycle bin to permanent; disable storing label 'NoParsedUser'

UserCreatorForm: remove the 'Channel' checkbox and related functions; ability to extract the user's URL from the buffer and apply parameters if found
Remove temporary 'EncryptCookies' module

MainFrame: added simplified way to create new users (Ctrl+Insert to create a new user with default parameters from clipboard URL); removed SCrawler command line argument "-v" (remove the ability to run SCrawler as video downloader)
PropertyValueHost: update for option forms compatibility
SettingsHost: removed 'GetSpecialData' fork; added 'GetSingleMediaInstance' fork
UserDataHost: update functions with tokens; update events; add 'DownloadSingleObject' function
Settings: add the ability to get environment from 4 destinations; add the ability to set the program environment manually; add CMDEncoding; add cache; remove the old function 'RemoveUnusedPlugins'; add 'STDownloader' properties; add YT compatibility; add new notification options; add deleting user settings file when 'SettingsCLS.Dispose()' if where are no users in SCrawler
UserFinder: remove old 'Merge' const; remove channel option
UserInfo: remove channel option
This commit is contained in:
Andy
2023-04-28 10:13:46 +03:00
parent db9e2cfb88
commit b2a9b22478
270 changed files with 18120 additions and 3332 deletions
Download Patch File Download Diff File Expand all files Collapse all files

29
SCrawler.sln
View File

@@ -12,13 +12,16 @@ Project("{2150E333-8FDC-42A3-9474-1A3956D46DE8}") = "Solution Items", "Solution
.gitignore = .gitignore
Changelog.md = Changelog.md
README.md = README.md
ToDo.txt = ToDo.txt
EndProjectSection
EndProject
Project("{F184B08F-C81C-45F6-A57F-5ABD9991F28F}") = "SCrawler.PluginProvider", "SCrawler.PluginProvider\SCrawler.PluginProvider.vbproj", "{D4650F6B-5A54-44B6-999B-6C675B7116B1}"
EndProject
Project("{F184B08F-C81C-45F6-A57F-5ABD9991F28F}") = "PersonalUtilities.Notifications", "..\..\MyUtilities\PersonalUtilities.Notifications\PersonalUtilities.Notifications.vbproj", "{FC532253-1AB3-4DEF-A28A-DFDD9A481EB2}"
EndProject
Project("{F184B08F-C81C-45F6-A57F-5ABD9991F28F}") = "SCrawler.YouTube", "SCrawler.YouTube\SCrawler.YouTube.vbproj", "{7C764707-7FD1-469C-A365-94605C193607}"
EndProject
Project("{F184B08F-C81C-45F6-A57F-5ABD9991F28F}") = "SCrawler.YouTubeDownloader", "SCrawler.YouTubeDownloader\SCrawler.YouTubeDownloader.vbproj", "{3F2F2C29-4ADB-48B5-A66E-EE0F51D0DCEF}"
EndProject
Global
GlobalSection(SolutionConfigurationPlatforms) = preSolution
Debug|Any CPU = Debug|Any CPU
@@ -77,6 +80,30 @@ Global
{FC532253-1AB3-4DEF-A28A-DFDD9A481EB2}.Release|x64.Build.0 = Release|x64
{FC532253-1AB3-4DEF-A28A-DFDD9A481EB2}.Release|x86.ActiveCfg = Release|x86
{FC532253-1AB3-4DEF-A28A-DFDD9A481EB2}.Release|x86.Build.0 = Release|x86
{7C764707-7FD1-469C-A365-94605C193607}.Debug|Any CPU.ActiveCfg = Debug|Any CPU
{7C764707-7FD1-469C-A365-94605C193607}.Debug|Any CPU.Build.0 = Debug|Any CPU
{7C764707-7FD1-469C-A365-94605C193607}.Debug|x64.ActiveCfg = Debug|x64
{7C764707-7FD1-469C-A365-94605C193607}.Debug|x64.Build.0 = Debug|x64
{7C764707-7FD1-469C-A365-94605C193607}.Debug|x86.ActiveCfg = Debug|x86
{7C764707-7FD1-469C-A365-94605C193607}.Debug|x86.Build.0 = Debug|x86
{7C764707-7FD1-469C-A365-94605C193607}.Release|Any CPU.ActiveCfg = Release|Any CPU
{7C764707-7FD1-469C-A365-94605C193607}.Release|Any CPU.Build.0 = Release|Any CPU
{7C764707-7FD1-469C-A365-94605C193607}.Release|x64.ActiveCfg = Release|x64
{7C764707-7FD1-469C-A365-94605C193607}.Release|x64.Build.0 = Release|x64
{7C764707-7FD1-469C-A365-94605C193607}.Release|x86.ActiveCfg = Release|x86
{7C764707-7FD1-469C-A365-94605C193607}.Release|x86.Build.0 = Release|x86
{3F2F2C29-4ADB-48B5-A66E-EE0F51D0DCEF}.Debug|Any CPU.ActiveCfg = Debug|Any CPU
{3F2F2C29-4ADB-48B5-A66E-EE0F51D0DCEF}.Debug|Any CPU.Build.0 = Debug|Any CPU
{3F2F2C29-4ADB-48B5-A66E-EE0F51D0DCEF}.Debug|x64.ActiveCfg = Debug|x64
{3F2F2C29-4ADB-48B5-A66E-EE0F51D0DCEF}.Debug|x64.Build.0 = Debug|x64
{3F2F2C29-4ADB-48B5-A66E-EE0F51D0DCEF}.Debug|x86.ActiveCfg = Debug|x86
{3F2F2C29-4ADB-48B5-A66E-EE0F51D0DCEF}.Debug|x86.Build.0 = Debug|x86
{3F2F2C29-4ADB-48B5-A66E-EE0F51D0DCEF}.Release|Any CPU.ActiveCfg = Release|Any CPU
{3F2F2C29-4ADB-48B5-A66E-EE0F51D0DCEF}.Release|Any CPU.Build.0 = Release|Any CPU
{3F2F2C29-4ADB-48B5-A66E-EE0F51D0DCEF}.Release|x64.ActiveCfg = Release|x64
{3F2F2C29-4ADB-48B5-A66E-EE0F51D0DCEF}.Release|x64.Build.0 = Release|x64
{3F2F2C29-4ADB-48B5-A66E-EE0F51D0DCEF}.Release|x86.ActiveCfg = Release|x86
{3F2F2C29-4ADB-48B5-A66E-EE0F51D0DCEF}.Release|x86.Build.0 = Release|x86
EndGlobalSection
GlobalSection(SolutionProperties) = preSolution
HideSolutionNode = FALSE