Selenium Library

selenium Library is an automated testing tool , It can drive the browser to simulate human operation , Such as mouse click 、 Keyboard input, etc .
adopt selenium The library can easily obtain the source code of web pages , It can also automatically download network content in batches .
Public information of Shanghai Stock Exchange 、 Sina Finance's real-time stock market data and other web pages are dynamically rendered , And by
Conventional crawler methods get unreported information , In the face of this non rendered web page , In data mining, we need to use
selenium library , By simulating the operation of people in the browser , Get the rendered web page source code quickly .

One 、 Simulation browser chromeDriver Download and install of

1. Install Google Chrome and check the version number

install chromedriver Before , You have to install Google browser first , Then check the version of Google browser installed .
Click three points in the upper right corner of the browser , Then click Help , Click on about google chrome command , In relation to Chrome Dialog box
You can see the version number of the currently installed Google browser .

2.chromedriver download

chromedriver Version needs to be associated with Chrome Versions, , The author chrome Version is 103.0.0506, Just find
chromedriver Just the same version . The specific operation is as follows ：
chromedriver Official download address ：https://npm.taobao.org/mirrors/chromedriver/
or
http://chromedriver.storage.googleapis.com/index.html

The following figure shows the completion of installation ！

Two 、selenium The installation of the library

pip install selenium

The following figure shows the completion of installation ！