HomeLinuxScraper - Proxy and User-Agent Scraper

Scraper – Proxy and User-Agent Scraper

Scraper – All web browsers and software obtain user agent information to identify the device and the IP address. This user agent information will be changed when the phone or router is restarted

In this article i’m going to teach you how to scrap our all used user-agent information with the scraper tool

How to install scraper tool?

1. First of all we need to download the “Scraper” Tool so execute the below command in your terminal

				
					git clone https://github.com/ebankoff/scraper.git
				
			
Scraper – Proxy and User-Agent Scraper

2. Now change the directory to “scraper” tool so execute the below command in your terminal

change the directory

3. Now check the following packages in your pip list, if not please install

  1. lxml

  2. beautifulsoup4

  3. bs4

  4. progressbar

  5. colorama

				
					sudo pip install lxml
sudo pip install beautifulsoup4
sudo pip install bs4
sudo pip install progressbar
sudo pip install colorama
				
			

3. Now give permission to read write and execute of scraper.py python file so run the following command in your terminal

				
					chmod +x scraper.py
				
			
give permission

4. After complete the above steps run the following command to execute the python script

				
					python3 scraper.py
				
			
Scraper – Proxy and User-Agent Scraper

Scrap user-agent

Now type the 4 in your command prompt to know the previous user agent information. see the below image

				
					sudo python3 scraper.py
				
			
Scraper – Proxy and User-Agent Scraper

That’s it you are done. Now you can see all your previous user agent information with these tool, I hope this article help you lot if yes please share your friends and if you have any doubts please free to ask in the command section

RELATED ARTICLES

Leave A Reply

Please enter your comment!
Please enter your name here

Most Popular