当前位置:网站首页>How do programmers without objects spend the Chinese Valentine's Day
How do programmers without objects spend the Chinese Valentine's Day
2022-08-05 01:52:00 【Z_Xshan】
Run the code and enter the connection to crawl the video 直接上代码
# encoding: utf-8
'''
爬取b站视频
'''
import requests
import json
import re
import os
class BilibiliVideoSpider(object):
def __init__(self, url, output_root=''):
self.url = url
if not os.path.isdir(output_root):
output_root = os.path.abspath(os.path.dirname(__file__))
self.output_root = output_root
self.headers = {
'Accept': '*/*',
'Accept-Language': 'en-US,en;q=0.5',
'User-Agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10_12_6) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/63.0.3239.84 Safari/537.36'
} # 定义请求头
def _match(self, text, pattern):
match = re.search(pattern, text)
if match is None:
print('this pattern was not matched !')
return json.loads(match.group(1))
def getHtml(self):
try:
response = requests.get(url=self.url, headers=self.headers) # 发请求,拿数据 (获取响应对象)
print(f'status_code: {response.status_code}')
if response.status_code == 200:
return response
except RequestException:
print('html reques error !')
def parseHtml(self, response):
playinfo = self._match(response.text, '__playinfo__=(.*?)</script><script>') # 视频详情json
initial_state = self._match(response.text, r'__INITIAL_STATE__=(.*?);\(function\(\)') # 视频内容json
video_url = playinfo['data']['dash']['video'][0]['baseUrl'] # 视频分多种格式,直接取分辨率最高的视频 1080p
audio_url = playinfo['data']['dash']['audio'][0]['baseUrl'] # get audio address
video_name = initial_state['videoData']['title'] # Take the video name
return video_url, audio_url, video_name
def video_audio_merge(self, video_src, audio_src, video_dst):
'''使用ffmpeg单个视频音频合并'''
import subprocess
command = 'ffmpeg -i %s_video.mp4 -i %s_audio.mp4 -c copy %s.mp4 -y -loglevel quiet' % (
video_src, audio_src, video_dst)
subprocess.Popen(command, shell=True)
def downloadVideo(self, video_url, audio_url, video_name):
self.headers.update({"Referer": self.url})
print('开始下载视频: ')
video_content = requests.get(video_url, headers=self.headers)
audio_content = requests.get(audio_url, headers=self.headers)
print('%s视频大小:' % video_name, video_content.headers['content-length'])
print('%s音频大小:' % video_name, audio_content.headers['content-length'])
# 下载视频
received_video = 0
video = f'{self.output_root}/video.mp4'
with open(video, 'ab') as output:
while int(video_content.headers['content-length']) > received_video:
self.headers['Range'] = 'bytes=' + str(received_video) + '-'
response = requests.get(video_url, headers=self.headers)
output.write(response.content)
received_video += len(response.content)
# 下载音频开始
audio_content = requests.get(audio_url, headers=self.headers)
received_audio = 0
audio = f'{self.output_root}/audio.mp4'
with open(audio, 'ab') as output:
while int(audio_content.headers['content-length']) > received_audio:
self.headers['Range'] = 'bytes=' + str(received_audio) + '-'
response = requests.get(audio_url, headers=self.headers)
output.write(response.content)
received_audio += len(response.content)
print('视频下载完成')
video_dst = f'{self.output_root}/download.mp4'
self.video_audio_merge(video, audio, video_dst)
print(f'下载的视频: {video_dst}')
os.remove(video)
os.remove(audio)
def video_audio_merge(self, video_src, audio_src, video_dst):
'''使用ffmpeg单个视频音频合并'''
cmd = f'ffmpeg -y -i {audio_src} -i {video_src} -vcodec copy -acodec aac -strict -2 -q:v 1 {video_dst}'
print('execute cmd:', cmd)
os.system(cmd)
# subprocess.Popen(command, shell=True)
def run(self):
response = self.getHtml()
video_url, audio_url, video_name = self.parseHtml(response)
self.downloadVideo(video_url, audio_url, video_name)
def demo():
# url = 'https://www.bilibili.com/video/BV1Q5411p7bz?from=search&seid=14643382716113842219'
url=input('请输入视频地址:')
b = BilibiliVideoSpider(url)
b.run()
if __name__ == '__main__':
demo()
Then save it to a file in the current path
边栏推荐
- PHP Skills Assessment
- torch.autograd.grad finds the second derivative
- 1349. 参加考试的最大学生数 状态压缩
- 释放技术创新引擎,英特尔携手生态合作伙伴推动智慧零售蓬勃发展
- Knowledge Points for Network Planning Designers' Morning Questions in November 2021 (Part 2)
- 蓝牙Mesh系统开发四 ble mesh网关节点管理
- Are testing jobs so hard to find?I am 32 this year and I have been unemployed for 2 months. What should an older test engineer do next to support his family?
- (十七)51单片机——AD/DA转换
- Chapter 09 Use of Performance Analysis Tools [2. Index and Tuning] [MySQL Advanced]
- 软件测试技术之最有效的七大性能测试技术
猜你喜欢
ORA-01105 ORA-03175
Are testing jobs so hard to find?I am 32 this year and I have been unemployed for 2 months. What should an older test engineer do next to support his family?
第十一章 开关级建模
IJCAI2022 | DictBert:采用对比学习的字典描述知识增强的预训练语言模型
基于OpenVINO工具套件简单实现YOLOv7预训练模型的部署
pytorch的使用:卷积神经网络模块
高数_复习_第1章:函数、极限、连续
习题:选择结构(一)
Xunrui cms website cannot be displayed normally after relocation and server change
新来个技术总监,把DDD落地的那叫一个高级,服气
随机推荐
基于OpenVINO工具套件简单实现YOLOv7预训练模型的部署
张驰咨询:揭晓六西格玛管理(6 Sigma)长盛不衰的秘密
### Error querying database. Cause: com.mysql.jdbc.exceptions.jdbc4.MySQLNonTransientConnectionExcep
The use of pytorch: temperature prediction using neural networks
记录谷歌gn编译时碰到的一个错误“I could not find a “.gn“ file ...”
Interview summary: Why do interviewers in large factories always ask about the underlying principles of Framework?
高数_复习_第1章:函数、极限、连续
Creative code confession
MySQL学习
迁移学习——Joint Geometrical and Statistical Alignment for Visual Domain Adaptation
ORA-01105 ORA-03175
VOC格式数据集转COCO格式数据集
KingbaseES V8 GIS数据迁移方案(2. Kingbase GIS能力介绍)
LiveVideoStackCon 2022 Shanghai Station opens tomorrow!
AI+小核酸药物|Eleven完成2200万美元种子轮融资
Are testing jobs so hard to find?I am 32 this year and I have been unemployed for 2 months. What should an older test engineer do next to support his family?
居民用水问题
Why is this problem reported when installing oracle11
PCIe Core Configuration
DDOS攻击真的是无解吗?不!