mirror of
https://github.com/AAndyProgram/SCrawler.git
synced 2026-03-15 16:22:17 +00:00
2.0.0.2
25
Settings.md
25
Settings.md
@@ -16,6 +16,9 @@
|
||||
- ```Date``` - append date to file name
|
||||
- ```Time``` - append time to file name
|
||||
- Date positions ```Start/End``` - date and/or time will be appended to the end or beginning of the file name
|
||||
- ```Exit confirm``` - ask for confirmation before closing the program
|
||||
- ```Close to tray``` - close program to system tray
|
||||
- ```Show notifications``` - show notifications when download is complete
|
||||
|
||||
- Defaults
|
||||
- ```Separate video folder``` - this means that video files will be placed in a separate folder in the user's folder to store video files separately from images.
|
||||
@@ -34,6 +37,12 @@
|
||||
- ```Get user media only``` - the default for creating new users
|
||||
- Instagram
|
||||
- ```Temporary```, ```Download images/videos``` - personal site settings by default for creating new users. Means the same as the parameters of the same name on the ```Defaults``` tab. If the checkbox is in an intermediate state, then the same name setting of the ```Defaults``` tab will be used instead. Otherwise, this setting will be applied.
|
||||
- ```Request timer``` - this is the time value (in milliseconds) the program will wait before processing the next ```Request time counter``` request (**it is highly recommended not to change this default value**)
|
||||
- ```Request time counter``` - how many requests will be sent to Instagram before the program waits ```Request timer``` milliseconds (**it is highly recommended not to change this default value**)
|
||||
- ```Post limit timer``` - this is the time value (in milliseconds) the program will wait before processing the next request after 195 requests (**it is highly recommended not to change this default value**)
|
||||
- ```Saved posts user``` - your personal Instagram username to download your saved posts (this feature requires cookies and **InstaHash 2**)
|
||||
- RedGifs
|
||||
- ```Temporary```, ```Download images/videos``` - personal site settings by default for creating new users. Means the same as the parameters of the same name on the ```Defaults``` tab. If the checkbox is in an intermediate state, then the same name setting of the ```Defaults``` tab will be used instead. Otherwise, this setting will be applied.
|
||||
|
||||
## Reddit settings
|
||||
|
||||
@@ -64,12 +73,24 @@ The Reddit parser can parse data without cookies, but you can add it if you like
|
||||
- ```Path``` - where Instagram users' data will be placed.
|
||||
- ```Cookies``` add cookies from your browser (click the pencil button to open the cookies editor).
|
||||
- ```Hash``` - in this field you need to put the hash of the Instagram session. Just add cookies and click on the curved arrows.
|
||||
- ```Hash 2``` - in this field you need to put the [hash of the Instagram session for saved posts](#how-to-find-instagram-hash-2).
|
||||
|
||||
### How to find Instagram Hash 2
|
||||
|
||||
1. Open browser developer tools
|
||||
2. Go to ```Network```
|
||||
3. If this tab contain any data, clear it.
|
||||
4. Open your saved Instagram posts.
|
||||
5. Click ```Ctrl``` + ```F``` and find the text ```query_hash=```. The value (of letters and numbers) after the equal sign is the required hash.
|
||||
6. Copy this and paste it into the ```Hash 2``` field on the Instagram settings form.
|
||||
|
||||
### Instagram limits
|
||||
|
||||
Instagram API is requests limited. For one request, the program receive only 12 posts. Be careful with ```Ready for download``` option. I recommended parsing one new profile every 5-10 minutes. I'm still thinking about how to make Instagram parsing algorithm smoother.
|
||||
Instagram API is requests limited. For one request, the program receive only 50 posts. Before catching error 429, the program can process 200 requests. I reduced this to 195 requests and set a timer to wait for the next request after.
|
||||
|
||||
I think you can get new posts for several profiles that have already parsed using the ```Download all``` operation without the "Too many requests" error. But if the program catches an error (429), the timeout information will be added to the log.
|
||||
~~Be careful with ```Ready for download``` option. I recommended parsing one new profile every 5-10 minutes. I'm still thinking about how to make Instagram parsing algorithm smoother.~~
|
||||
|
||||
~~I think you can get new posts for several profiles that have already parsed using the ```Download all``` operation without the "Too many requests" error. But if the program catches an error (429), the timeout information will be added to the log.~~
|
||||
|
||||
## How to set up cookies
|
||||
|
||||
|
||||
Reference in New Issue
Block a user