A gadget can write crawlers faster

Hello , I am a somenzz, I think you wrote about reptiles , That's it. requests library , It works so well , There should be no one who doesn't know requests.

Usually we use Google Chrome developer tools （F12） Find network requests , Then send the network request to url、headers、cookie、user-agent、 Requested parameters, etc , recorded , then , use requests Simulate a request from a browser .

These simple mindless copying operations , It makes me feel really tired to write about reptiles , Is there a tool , You can convert this request directly into Python Code ？

There are ！

That's it curlconverter^[1]

It's easy to use ：

Take Google browser for example ：

1、 stay 「 Developer tools 」 Open in 「Network」 tab

2、 Right click （ Or press and hold Ctrl Key click ） request

3、 Click on "Copy" → "Copy as cURL"

4、 Paste it onto the above curl The command box

Select the language you want to convert （ The default is Python）, You can copy the code , Very convenient ：

Last words

I hate to meet you so late , It can save you a lot of time writing crawlers , Please remember that the URL is ：https://curlconverter.com/, If it helps , Please click to see the diffusion , If there are good tools , You can also leave a message to share .

Reference material

[1]

curlconverter: https://curlconverter.com/