Cyber Detective💙💛
Cyber Detective💙💛

@cyb_detective

7 Tweets 65 reads Aug 17, 2022
Yagooglesearch
(Yet Another Google Seatch #python library)
"Simulates real human Google search behavior to prevent rate limiting by Google and if HTTP 429 blocked by Google, logic to back off and continue trying" (c)
github.com
Quick manual 🧵⬇️
1. (check that you have Python and PyPi installed)
2. Install Yagooglesearch:
pip install yagooglesearch
🧵⬇️
3. Create file main․py and copy code from README․md into it (view pic)
4. Replace the query with the one you want (query='')
5. Run in command line:
python main․py >results.txt
⬇️🧵
6. Open the results.txt file to see the results of the script.
(Unfortunately, the script generates not quite standard JSON, so to process this data automatically, you need to bring it to a standard form. This may help jsonformatter.curiousconcept.com)
⬇️🧵
The script has built-in automatic setting of waiting time for the next request to bypass Gooogle blocking. But it is better to use proxy servers to perform a larger list of queries. In the documentation there is a ready example code for this:
pypi.org
🧵⬇️
And finally, a list of sources of fresh proxies to test this tool.
⬆️🧵
@threader compile
@threadreaderapp unroll
@threadrip unroll
@PingThread unroll
@threadreaders unroll
@TurnipSocial save
@readwiseio save thread
@tresselapp save thread
@rattibha unroll
@getnaked_bot unroll

Loading suggestions...