2022 latest Tiktok live broadcast monitoring (II) streaming media download in live broadcast room

Next time, when we judged that the live room had started broadcasting, we could grab packets and analyze the returned live room data , This time we are going to study live streaming media .

“ Streaming media ” Literally , It seems to be a new form of media , It's not , It is just a new way of media transmission . This technology can transmit compressed media packets on the Internet even after they are sent in segments like pipelining on the Internet , This data is transmitted to the viewer's computer and can be played immediately . In a word, it can be achieved ： Broadcast while transmitting , No need to wait

Just now we said that streaming media is just a way of video streaming , To realize this transmission mode , You need help “ Streaming technology ”. Streaming media technology is not a single technology , It is an organic combination of network technology and audio and video technology . Include ：

（1） Production of flow Encoder

（2） Flow of transmission Streaming devices , Flow pulling equipment

（3） Cache of streams Streaming media server

（4） Stream play decoder

In fact, the main core idea is to find the stream file in the detailed interface data of the live broadcast room , There are two kinds of audio stream files , One is m3u8 File format , One is flv Format , Both of these files can be parsed and downloaded

flv File format ：

m3u8 File format ：

After finding the stream file, you can download it locally in real time with the help of some third-party tools , such as ffmpeg Procedure, etc . Here you can also choose the size of the stream when you download , Such as standard definition , hd , Super clear , Blu ray, etc

This series only shares the general idea , Of course, those who need this plan are welcome D, At present, it is stable and unrestrained , Ten million levels of daily data is not a problem , The whole set of live broadcast content has a complete plan

                    if videoencode:
                        _output = subprocess.check_output([
                            ffmpeg_path, "-y",
                            "-v","verbose", 
                            "-timeout","10000000", # 10s
                            "-loglevel","error",
                            "-hide_banner",
                            "-user_agent",headers["User-Agent"],
                            "-analyzeduration","2147483647",
                            "-probesize","2147483647",
                            "-i",real_url,
                            '-bufsize','5000k',
                            "-map","0",
                            "-sn","-dn",
                            # "-f","mpegts",
                            # "-bsf:v","h264_mp4toannexb",
                            # "-c","copy",
                            "-c:v","libx264",   # Later you can use crf To control the size 
                            #"-c:v","copy", # Direct use copy The volume is very large .
                            '-max_muxing_queue_size','64',
                            "{path}".format(path=file),
                        ], stderr = subprocess.STDOUT)
                    else:
                        _output = subprocess.check_output([
                            ffmpeg_path, "-y",
                            "-v","verbose", 
                            "-timeout","10000000", # 10s
                            "-loglevel","error",
                            "-hide_banner",
                            "-user_agent",headers["User-Agent"],
                            "-analyzeduration","2147483647",
                            "-probesize","2147483647",
                            "-i",real_url,
                            '-bufsize','5000k',
                            "-map","0",
                            "-sn","-dn",
                            # "-f","mpegts",
                            # "-bsf:v","h264_mp4toannexb",
                            # "-c","copy",
                            #"-c:v","libx264", # Later you can use crf To control the size 
                            "-c:v","copy",   # Direct use copy The volume is very large .
                            '-max_muxing_queue_size','64',
                            "{path}".format(path=file),
                        ], stderr = subprocess.STDOUT)   

The difficulty in streaming media is to find its URL, The link address , If you find it , Then all the problems will be solved .

1. from HTML Source code to find
   stay IE Menu for “ see ” Midpoint “ Source file ” Button , Open source file with Notepad , Click Notepad “ edit ” Menu “ lookup ”, Then enter the suffix of the streaming media file SWF、WMV、RM、ASF、AVI, When you find them , You will see the download link address ！ The most typical is the flash Empire Flash, Just find SWF The suffix of , You can know its flash Download the address .

2. Save file lookup
   Choose an online audio-visual song MP3, Right click the target save as , There will be one “.m3u” The file of is saved , And then use “ Notepad ” Open the file , Find in Notepad “http:////.m3u” perhaps “http:////.mp3”, If it's the previous one , Then we will put m3u Change it to mp3, Then copy the link to FlashGet in , You can download it. . If it is the latter , Copy directly to FlashGet You can download it in .

3. RAM or ASX Search for
   Sometimes find the address and download , Open it with playback software but can't watch , Check that the file size is only a few hundred KB, How can a movie be so small ？ original RAM or ASX Is a substitute for RM or ASF The text of , Open in Notepad ASX or RAM file , You can find the address of the movie ！

4. Player properties
   If you use RealOne Player The player plays the movie , Select... In the menu bar of the player “ file → Clip properties → View clip information ”, In the pop-up “ Clip properties ” Select... In the dialog box “ file ” Options , Here you can see the address of the currently playing video file .