4G brings audio and video outbreak of APP, various audio and video services-oriented company flourishing, audio and video technologies are booming both in breadth and depth, ushered in a qualitative leap. The 5G high bandwidth, low latency, but also bring endless possibilities for the audio and video technology.
NetEase cloud letter multimedia, senior technical architect Wu Tong was invited to participate in the 2019 QCon Global Software Development Conference Shanghai station, delivered a speech entitled " ultra-high definition 4K video and low-latency live fusion of architecture design RTC wonderful sharing".
Share this article organize content from Wu Tong, because too many dry goods herein, this record speech will be divided into three themes articles published. They are as follows:
- 4K ultra high-definition video and low-latency live RTC integration architecture design ①: 5G and future network structure
- 4K ultra high-definition video and low-latency live fusion of architecture design RTC ②: Live with low latency RTC program
- 4K ultra high-definition video and low-latency live fusion of architecture design RTC ③: Live with RTC Fusion Architecture Design
The following is the first share, Netease cloud letter multimedia, senior technical architect Wu Tong from 5G background, characteristics talking about, and we explore the edge computing, IPv6 and other hot topics, while sharing the selected direction of ultra-high-definition encoder.
5G and future network structure
2019 is the first year of 5G booming. In June, the Ministry for operators awarded licenses 5G; September, national pride Huawei released the first true 5G phone Mate 30, for the first time and 5G baseband processor in one set; at the same time, we have seen the government Trump all sorts of things difficult for Huawei 5G. All these developments indicate that, 5G era really want to come.
So, 5G which has brought changes to audio and video technology? Let's look at three features of 5G.
- Ultra mobile broadband, high flow. This feature we are most likely to feel the change, uplink and downlink bandwidth larger. Looking back at the past few years, we> 5G along the way from 2.5G-> 3G-> 4G-, video clarity is also clear from the low -> SD -> HD -> Ultra HD, to 1080p, 2k, 4k. As bandwidth becomes larger and larger, it will increasingly demanding video clarity. In the ultra-high-definition encoding section below, will be subject to further share this with you.
- Ultra low latency, high reliability . 5G, while providing the basis for ultra-low latency for everyone, but you want to truly live and on RTC low-latency, we have a lot of work to do, and this is the focus of our next two articles.
- Mass connection. Future connections are massive, before we use the PC computer access, then, we use the phone, and now has a growing number of smart devices can connect to the Internet, such as intelligent speakers, intelligent television. It is foreseeable that more and more iOT equipment will have audio and video capabilities, this is an opportunity and challenge, we need to be ready access to vast amounts of equipment in the audio and video server architecture in this part of the next two articles It will be involved in.
After talking three characteristics, we also share the basic content of roughly delineated. The floor of the three characteristics of 5G networks in specific scenarios and also achieved another core competencies 5G is closely related to that edge computing. Next, let's talk about another hot topic of 5G: 5G and edge computing.
5G and edge computing
MEC is not a new concept, it is an early edge mobile computing Mobile Edge Computing abbreviation, and later the European Telecommunications Standards Institute (ETSI) has expanded into Multi-Access Edge Computing, is a multi-access edge computing. In fact, essentially no difference between the two, are Internet Cloud computing power will sink to the edge of the mobile network, but the latter is further extended position of the edge is located.
After sinking What good is it?
- Because the closer to the user, so the user experience propagation delay less ;
- Network congestion control is significant ;
- Because the ability to sink, so operators can open more information and network congestion control features to developers .
In order to optimize the user experience in audio and video scene, Netease cloud computing edge of the letter is also actively exploring. This year, Netease cloud operators to carry out the letter and the MEC edge computing power cooperation, practical experience optimization in a video call at the scene of the 5G network.
5G three characteristics mentioned above massive connection, then I would like to share with you related, but you may ignore a small topic. That is: 5G and IPv6.
5G and IPv6
IPv6 we wanted to come will not be unfamiliar, we have already learned the relevant background knowledge in undergraduate courses in computer networks, also knew the limitations of IPv4.
Let's look at some data:
- Global IPv4 as early as February 2011 been distributed, we are now mainly rely on operator NAT assigns private network addresses;
IPv6 global penetration exceeded 30%, China deployed a rate of about 5%, the data may not be accurate, but my personal experience, I really do not feel the popularity of IPv6.
The Future of Things and mass 5G equipment era is certainly the world of IPv6. In the 5G background, IPv4 + NAT limitations become more apparent, and now the Ministry of Industry and other relevant government agencies, have began to emphasize the importance of IPv6, NetEase also respond to national call, requiring major departments within the group must speed up the implementation. As the cloud letter group YORK, audio and video capabilities of the underlying IM provider, naturally belong to the first embodiment of the IPv6 column. NetEase cloud letter has completed the most current IM, audio and video related to the server and client programs IPv6 compatible work , in fact, from this part of the technology difficulty is not great; Second, we must do a good room IPv6 routers and switches deployed renovation work . I hope you pay attention to the transformation of IPv6-related, 5G before the arrival of the era of comprehensive, can quickly smooth transition to the next IPv6.
Next, we chat with ultra-high definition encoding.
Ultra HD encoding
We look at a set of data displayed in the White Paper on the future network prediction Cisco released, the proportion of online video traffic in 2022 will be as high as 82%, with 4K video traffic will account for 62% of all video traffic, and 4K video code rate will reach 18Mbps.
For clarity we need higher and higher, so how to choose the right coding in the project is particularly important. In recent years, our most popular video encoding is H.264, VP8, but their compression rate has been unable to meet the ultra-high resolution. Then under ultra-high resolution, what else can we choose? Now popular encoding: HEVC (H.265), VP9, AV1, as well as next-generation video coding standard VVC.
Select the encoder, we examine the most important of its two aspects: encoding quality and speed . Several encoder data provided herein, by reference. The data disclosed by the Moscow State University in April 2019. Quality: AV1> VP9 / x265> x264 ; speed: x264> VP9 / x265> AV1 ; VP9 wherein X265 and quality and speed are very close.
In accordance with the above data, we can get a super high-definition encoder selection recommendations:
- In the Web side, that is, there are scenarios WebRTC participation, preference VP9;
- For iOS and Android flagship model, priority use of H.265 hardware encoding;
- You can use the H.265 hardware acceleration on the server, NVIDIA, Intel, and Linux, and many other FPGA chip and hardware companies offer solutions;
- AV1 video compression of high quality and have AV1 open nature, so it is a very promising encoder, we present it to maintain focus, and for VVC, in 2020 after its standardization, we will keep an eye .
These are the Wu Tong "4K Ultra HD video and low-latency live RTC Fusion Architecture Design" series share the first article, so stay tuned for more dry content.
