Final part of web crawler: send directional messages to 100000 Netease cloud users

The goal of this article ：

In the last article, we got the comment users ID And home page address . This article can conduct some data analysis and market operation based on these data . I learned the method of this article theoretically , You can send advertising messages on any web page , This article has the possibility of being used by bad people , Therefore, charges are set , And this set of crawler tutorials , If you find online classes in Netease cloud class , Tuition fees 1200 yuan . The windfall profits of online classes are still huge .

---

The ultimate goal is achieved ：

1、 Through popular singers , Grab songs ID.
2、 Through songs ID, Grab comment users ID.
3、 By commenting on users ID, Send a directed push message .
The last two articles have completed the steps 1、 step 2, This article completes the steps 3.
Conclusion ：requests and selenium The difference between ：requests No page method to get songs ID, It's quite fast , But you can only get some public web pages without login , If user login and authentication are required ,requests Will not be able to .
selenium Its advantage is that it completely imitates the operation of opening a web page , It's like you hired an assistant to do things for you , Very intuitive , It will not be forbidden to visit . And for interfaces that require user login （ Such as microblog ）, use selenium It can easily skip the troublesome part of verification .
In the first part, we use MYSQL Store and crawl the user's home page information , This article will support error redoing , Each time a record is processed, a processing flag bit will be marked Y, Similar to our production system .

---

step 1： Query the user lD And home page tables

We need to check u