当前位置:网站首页>爬虫练习题(二)
爬虫练习题(二)
2022-07-05 19:05:00 【InfoQ】
"""
目标网站:https://www.1ppt.com/moban/
爬取要求:
1、 翻页爬取这个网页上面的源代码
2、 并且保存到本地,注意编码
"""
'''
1.分析网站:
https://www.1ppt.com/moban/ 第一页
https://www.1ppt.com/moban/ppt_moban_2.html 第二页
https://www.1ppt.com/moban/ppt_moban_3.html 第三页
'''
import urllib.request
start = int(input("输入起始页")) # 转int
end = int(input("输入结束页"))
headers = {
'User-Agent': 'Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/98.0.4758.102 Safari/537.36'
}
for n in range(start, end + 1):
url = 'https://www.1ppt.com/moban/ppt_moban_{}.html'.format(n)
print(url)
req = urllib.request.Request(url, headers=headers) # 实例化请求对象
response = urllib.request.urlopen(req) # 发送请求的方法
with open(f'第{n}页.html', 'a', encoding='gb2312') as f:
f.write(response.read().decode('gb2312'))
边栏推荐
- How to realize the Online timer and offline timer in the game
- PHP利用ueditor实现上传图片添加水印
- Ten years at sea: old and new relay, dark horse rising
- 【历史上的今天】7 月 5 日:Google 之母出生;同一天诞生的两位图灵奖先驱
- C# 语言的高级应用
- Common interview questions in Android, 2022 golden nine silver ten Android factory interview questions hit
- 基于FPGA的超声波测距
- Optimization of middle alignment of loading style of device player in easycvr electronic map
- How to quickly advance automated testing? Listen to the personal feelings of the three bat test engineers
- JS解力扣每日一题(十二)——556. 下一个更大元素 III(2022-7-3)
猜你喜欢
华为让出的高端市场,小米12S靠徕卡能抢到吗?
Fuzor 2020軟件安裝包下載及安裝教程
Go语言 | 02 for循环及常用函数的使用
Why can't Bi software do correlation analysis? Take you to analyze
2022 the latest big company Android interview real problem analysis, Android development will be able to technology
Low code practice of xtransfer, a cross-border payment platform: how to integrate with other medium-sized platforms is the core
Reflection and imagination on the notation like tool
[performance test] jmeter+grafana+influxdb deployment practice
Word finds red text word finds color font word finds highlighted formatted text
100million single men and women supported an IPO with a valuation of 13billion
随机推荐
Debezium系列之:解析默认值字符集
How to quickly advance automated testing? Listen to the personal feelings of the three bat test engineers
Postman核心功能解析 —— 参数化和测试报告
Shell编程基础(第8篇:分支语句-case in)
Taishan Office Technology Lecture: from the layout height of the line, talk about the height overflow and height shrinkage of the drawing height (launched in the whole network)
Notion 类生产力工具如何选择?Notion 、FlowUs 、Wolai 对比评测
cf:B. Almost Ternary Matrix【对称 + 找规律 + 构造 + 我是构造垃圾】
Analysis of postman core functions - parameterization and test report
C# 语言的高级应用
【FAQ】华为帐号服务报错 907135701的常见原因总结和解决方法
Debezium系列之:修改源码支持drop foreign key if exists fk
HAC cluster modifying administrator user password
Oracle故障处理:Ora-10873:file * needs to be either taken out of backup or media recovered
Cf:b. almost Terry matrix [symmetry + finding rules + structure + I am structural garbage]
PG basics -- Logical Structure Management (user and permission management)
PG基础篇--逻辑结构管理(用户及权限管理)
android中常见的面试题,2022金九银十Android大厂面试题来袭
cf:B. Almost Ternary Matrix【對稱 + 找規律 + 構造 + 我是構造垃圾】
Technology sharing | common interface protocol analysis
How to realize the Online timer and offline timer in the game