mirror of
https://github.com/AAndyProgram/SCrawler.git
synced 2026-03-14 15:52:18 +00:00
Site settings have been expanded, some functions and dependencies have been changed. Removed unused elements in UserDataBase, added additional xml fields, added error executor. Created a basic download function. Added Instagram saved posts and 429 bypass. Added channel statistics. Added site redgifs. Updated sites algorithms. Other improvements. Updated downloader algorithm.
3.0 KiB
3.0 KiB
Contributor's Guide
I welcome requests! Follow these steps to contribute:
- Find an issue that needs assistance.
- Let me know you are working on it by posting a comment on the issue.
- If you find an error in the code, please provide a link to the file and the line number.
- If you have a suggestion to change the code, you can post a block of code to replace. I don't currently have time to learn pull requests, so it might work this way.
How to build from source
- Delete the "PersonalUtilities" project from the solution.
- Add the latest version of the "PersonalUtilities.dll" library (from the latest release).
- Import PersonalUtilities.Functions for the whole project.
Always use the correct "PersonalUtilities.dll" library. You must download this library from the release of the code you downloaded.
How to request a new site
- Check issues (open and closed) and discussions to find your issue. Perhaps I have already answered your request.
- If you don't find anything, create a new issue with your request. I usually reply as soon as possible (within the next few hours).
- If I'm interested in a site you want to add, it may be added in future releases.
- If the site has an API that does not require authorization, it may be added in the coming releases.
- You can make it faster by posting a link to the API. I don't use OAuth authentication in my application, so if it's not too hard to make a new parsing algorithm without OAuth authorization, I can start developing it in the coming days. Otherwise, I need time to figure out how to do it.
- If the site does not have an API that does not require authorization, this may take some time.
- If you will be posting request urls without OAuth authentication, I might consider adding your site if I have time.
- If I'm not interested in the site you want to add, you can pay to have it added by making a donation of approximately $10. But before that, you still need to create an issue. If I'm not interested, you can offer me a deal to develop it for money. I'll check the site you want to add, check the availability of the API and tell you how much time I need to develop it and the price. If you agree, I will do it.
- If I'm interested in a site you want to add, it may be added in future releases.
Sites I will never develop
Sites requested by users
- TikTok
- API for receiving data without authorization was not found. Therefore, I don't have time to start developing this site parsing algorithm. If anyone knows of requests that may collect data without OAuth authentication, please let me know.
Contact me
Element messenger: @andyprogram:matrix.org https://matrix.to/#/@andyprogram:matrix.org