Once it has been done, then we must install some python libraries required such as time and requests like the code below: pip install time Installing the required librariesįirst, we must install a selenium library on our terminal such as the code below: pip install selenium

You can download it from here (for Chrome user) or here (for Firefox user). One of the tools that we must prepare to run the selenium program is webdriver (for Chrome) or geckodriver (for Firefox). You will have knowledge about selenium python theory (auto login, auto click, auto scroll page down, auto download). The browser, in this case, is Google Chrome, so the options that will be mentioned in this article are available on Google Chrome.We need a code editor and python that have been installed on your PC/Laptop.Familiar with a python programming language, especially the theory of OOP.You must finish reading this article first, and then doing the practice technically.So, our scraper doesn’t act rapidly which is can reduce the risk from banned by Instagram’s team. Yes, we can set the timer for our automatic scraper. It very helpful since Instagram’s team has banned automatically scraper bot for its website.

Secondly, selenium can scrape the website using a timer that we can set as required. And surprisingly, selenium can handle it such as log in to our Instagram account automatically. For example, we need to log in to our Instagram account to scraping Instagram’s website. It can handle automation in a complex way. Selenium is a powerful tool for scraping. You can search about Scrapy, Beautifulsoup, and many other tools that can be used to scraping in many other places, but now I want to explain how we choose Selenium for scraping this time here. However, each of them has the special ability for their action to scrape a website.

As we know that many tools can be used to scraping data from a website, and the three most popular from them are Scrapy, Beautifulsoup, and Selenium.

Selenium webdriver download for mac