Taopiaopiao cinema crawler

Usage

Environment

• python 3.6.13
• beautifulsoup4 (4.12.3)
• certifi (2020.6.20)
• pip (9.0.1)
• selenium (3.141.0)
• setuptools (36.4.0)
• soupsieve (2.3.2.post1)
• urllib3 (1.26.20)
• wheel (0.37.1)
• wincertstore (0.2)

Webdriver

• msedgedriver 131.0.2903.99
• browser edge

Steps

1. run

python taopiaopiao_crawler.py

2. login in and enter city selector page

   

3. press enter in terminal to continue

4. iterate city list, get cinema info

5. save data to file