b2a9b22478
Plugins IPluginContentProvider: added DownloadSingleObject function; added tokens to GetMedia and Download functions; removed GetSpecialData function Add IDownloadableMedia interface Removed 'Channel' option from all functions and enums ISiteSettings: added GetSingleMediaInstance function ExchangeOptions: removed 'IsChannel' UserMediaTypes: added Audio and AudioPre enums IUserMedia, PluginUserMedia: changed ContentType and DownloadState from integers to their enums SCrawler Add YouTube standalone downloader Add gallery-dl & yt-dlp support Remove 'UserInfo' requirement from 'ProfilesSaved' Update 'SiteSettingsBase' to use domains and Netscape cookies UserDataBase: remove channels; remove old 'Merge' const; standardize SavedPosts file naming; move 'ValidateMD5' function from Twitter to UserDataBase to use it in other UserData classes; add 'DownloadSingleObject' environment for single posts; add validating file extension for m3u8 during download; add reindex of video file during download Rewritten DomainsContainer Create a universal settings form and PSettingsArttribute Gfycat, Imgur: turn these classes into IUserData to download a single object All plugins: update 'GetInstance' function for saved posts; update domains where implemented; remove 'OptionForm' where it exists; update options where they exist; update unix date providers; reconfigure channels where they exist LPSG: fix attachments; update converters and regex Add sites: ThisVid, Mastodon, Pinterest, YouTube, YouTube music Reddit: standardize container parsing for all data types; new channel environment; fix 'ReparseMissing' function; redirect data downloading to the base download function, saved crossposts support Twitter: fixed gif path bug; fixed downloading saved posts PornHub: hide unnecessary errors; photo galleries bug RedGifs: add 'UserAgent' option Added icons to download progress Rename some objects Completely redesigned standalone downloader form and rewritten its environment WebClient2: update to use tokens Labels: update label form (save labels to file only when OK button is clicked); change removing labels.txt from recycle bin to permanent; disable storing label 'NoParsedUser' UserCreatorForm: remove the 'Channel' checkbox and related functions; ability to extract the user's URL from the buffer and apply parameters if found Remove temporary 'EncryptCookies' module MainFrame: added simplified way to create new users (Ctrl+Insert to create a new user with default parameters from clipboard URL); removed SCrawler command line argument "-v" (remove the ability to run SCrawler as video downloader) PropertyValueHost: update for option forms compatibility SettingsHost: removed 'GetSpecialData' fork; added 'GetSingleMediaInstance' fork UserDataHost: update functions with tokens; update events; add 'DownloadSingleObject' function Settings: add the ability to get environment from 4 destinations; add the ability to set the program environment manually; add CMDEncoding; add cache; remove the old function 'RemoveUnusedPlugins'; add 'STDownloader' properties; add YT compatibility; add new notification options; add deleting user settings file when 'SettingsCLS.Dispose()' if where are no users in SCrawler UserFinder: remove old 'Merge' const; remove channel option UserInfo: remove channel option
4.9 KiB
Frequently asked questions
Please read the GUIDE Before asking a question!
Also read here for basic information.
Most of your questions are already answered. All settings, functions, buttons and everything else described in the guide.
Any other questions I will keep in this file.
Q: HOW TO SETUP COOKIES
A: https://github.com/AAndyProgram/SCrawler/wiki/Settings#how-to-set-up-cookies
Q: Does this program have GUI or CLI.
A: This is a GUI program.
Q: Will CLI be added in the future?
A: NO.
Q: I want to add "...." site. How to request.
I'm currently not accepting requests to develop new sites.
Q: Site download failed.
A: Check your credentials and SITES REQUIREMENTS. If all settings are set, but nothing works, go to create a new issue. Don't forget to attach the LOG.
ATTENTION! Issues without URLs will be closed without a response!
Q: I have set credentials but still nothing is downloading
A: Click the Start downloading button
Q: Where can I find the release?
A: https://github.com/AAndyProgram/SCrawler/releases/latest
Q: How to run the program?
A: Double-click SCrawler.exe
Q: Where to find binaries?
A: https://github.com/AAndyProgram/SCrawler/releases/latest
Q: Does the program remember the last download and check for new posts, downloading only new posts? Or does the program download the entire profile every time?
A: The program stored posts IDs in users' folders. For the first time, the program downloads the entire profile. All subsequent times the program will check for new posts and download only new posts!
Q: How to redownload all data
A: Double-click on the user you want to redownload. In the opened window open folder setting. Delete the files ending with _Data.xml and _Posts.txt. Restart SCrawler. Download this user again.
Q: How to remove the label
A: There is no functionality to remove an individual label. You can open the Labels.txt file in the program settings folder and delete any label you want. You also can delete this file (Labels.txt). In this case, when the program starts, the list of labels list will be updated with only existing labels (from the user data files).
Q: How to remove a user from the blacklist
A: Just add that user back to the program. In the dialog box that opens, click on the Add and remove from blacklist button.
Q: Why don't you answer how it works
A: Because I don't want to. I don't want to waste my time explaining things that are already covered in the GUIDE! If you didn't bother to read the guide, why would I waste my time?! ALL FUNCTIONALITY IS DESCRIBED IN THE GUIDE. Before publishing a new release, I update the guide. If you don't respect my work, I don't waste my time.
Q: You lost me. Your program is too complicated.
A: I'm fine with that. If the program is difficult for you or you can't configure it, I can only suggest you find another (easier) program. I really don't mind! The program is free. I am develop SCrawler for myself and publish on GitHub because people found my program useful. If someone can't use it or doesn't like it, I'm fine.
Q: I can't configure something
A: I can only suggest you find another (easier) program.
Q: Can you add a step-by-step guide or video on how to use the program?
A: NO! NEVER! The guide fully covers all the functionality of SCrawler! If you don't respect my work, I don't waste my time. If you want, you can create a video tutorial and send it to me. Then I add it. All options and what each option does described on the wiki. The wiki also contains a description of all settings and how-to configure them. For complex settings, there is a steep-by-steep guide. Read the main information and GUIDE and you won't have any problems. I have developed a program with an intuitive interface. There is a Settings button, download buttons, a context menu that drops down when a user is clicked, and other controls. Anyone can use it.