web_scraping

Technologies Used:

python: 3.10.2
vscode

Note (For chrome users): For selenium to access the browser, it would require the chrome webdriver installed-

Download and install Chrome Browser from https://www.google.com/chrome/.

ChromeDriver executable file is available at https://sites.google.com/a/chromium.org/chromedriver/downloads.

to install the selenium use the below command

pip install selenium

Web Scraping:
Use selenium to scrape the Tender Data From this webiste: url: https://opentender.eu/all/search/tender
Screenshot:

this website contains the 5 millions plus pages So, I used condition to scrape only the limited pages. you can increase or decrease the page number as per your choice. you just need to modify the max_page variable in code file

I Scraped the tendors data from this website using Selenium and save it in CSV format using pandas

--- Copyright © 2021 Taiyō.ai Inc.