Cookie simulation login "recommended collection"

Hello everyone, meet again, I'm your friend Quanstack Jun.

I am using requests.get(url,headers,cookies) in python here.

Where headers and cookies are both in dictionary form.The role of headers is to simulate a browser and tell the server that I am not a crawler.The role of cookies is to impersonate a user and tell the server that I am not a robot and that I am a user of so-and-so.

Take Zhihu as an example, headers can use templates:

headers = { 'Host': 'www.zhihu.com', 'User-Agent': 'Mozilla/5.0 (Windows NT 6.1; WOW64; rv:43.0) Gecko/20100101 Firefox/43.0', 'Accept': 'text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8', 'Accept-Language': 'zh-CN,zh;q=0.8,en-US;q=0.5,en;q=0.3', 'Accept-Encoding': 'gzip, deflate', 'Referer': 'http://www.baidu.com', 'Connection': 'keep-alive', 'Cache-Control': 'max-age=0',

}

Then there are cookies. For cookies, I log in in the browser first, then look for the cookie, and copy the content into txt. Then the crawler directly reads the txt and converts it into a dictionary.The specific process is as follows (take google browser as an example):

1. Log in to Zhihu: http://www.zhihu.com

2. Open browser settings->advanced->privacy settings and security->content settings->cookies->view all cookies and website data

3. Search zhihu and get the following picture

Open zhihu.com, as shown below

These four are the keys of the cookie. There is a value in the down arrow, and a dictionary can be created based on this.(Note: Some values ​​contain double quotes, so you can't lose them)

When visiting, html=requests.get("https://www.zhihu,com",headers=headers,cookies=cookies)

content=html.text

Publisher: Full-stack programmer, please indicate the source: https://javaforall.cn/128957.htmlOriginal link: https://javaforall.cn