The relationship between people and equipment is reconstructed, and a new interaction model begins to take shape

The name of the Internet of Everything has been called for many years, but its value has been underestimated. The Internet of Things is not just the interaction between things, but the interaction mode between people and things also needs to be upgraded and changed.

There are many scenes of character interaction, and fitness is one of them. In the running scene, not only do we need someone as a coach by our side, but Huawei also provides us with new options and interaction modes. Under the linkage of multiple devices such as smart watches, smart treadmills, and mobile phones, users can be in the device matrix. Get the same experience as a professional personal fitness trainer.

Wang Chenglu, President of Huawei’s Consumer Business AI and Intelligence Full Scenario Business Department, introduced that the “personal trainer” created by the device matrix can formulate the most appropriate exercise plan according to the user’s physical state, and will remind the user in real time whether the exercise method is correct during the exercise process. , will it cause damage to a certain part of the body, how to relax after the exercise, the appropriate relaxation plan according to the results of the exercise state, etc.

The basis of artificial intelligence development is data, and the environment built by many devices is even more reliable than professional coaches for the accuracy of data acquisition. The user’s body fat rate, heart rate interval, diet and sleep status before exercise, breathing and heart rate during exercise, pace, slope and running posture during running, these data can be automatically obtained by the device at will. Of course, if the data is not circulated, it will be meaningless. The more devices users use, the more “sensors” surrounding the user, and the user’s behavioral data will continue to be generated. HyperTerminal” can more accurately capture the user’s intent.

In this process, no additional operations are required for more devices. Services can be obtained with just one finger, and services can be found with a single touch. The relationship between people and devices begins to change, and devices will be able to actively understand users and recommend corresponding services. services, and new interaction models have begun to take shape.

Dr. Wang Chenglu said, “I believe that with the blessing of the Hongmeng system, we will have many opportunities to build a variety of scene-based hyperterminals.” This means that this new interactive mode is expected to be pushed to more far direction.

Let data flow and truly realize the Internet of Everything

If the acquisition of data by multiple devices is to give the device a ticket to enter the IoT era, then the real participation in the competition and entering the Internet of Everything means that data flow and interoperability are required. A large number of devices around us have the ability to obtain data, which can be regarded as sensors one by one, and can obtain information such as geographic location, spatial information, physiological indicators, behavioral activities, etc., but a single device and a single dimension cannot accurately capture consumers Intentions, let alone form a smart interconnection.

Therefore, the synchronization of multi-device sensor signals, the labeling of multi-modal data, and multi-modal self-adaptation have become problems that must be solved.

The first challenge of multi-device collaboration is complex device heterogeneity. To make good use of the sensor signals, the first step is to ensure the timing alignment of the signals reported by all sensors. Due to the different sizes of devices, different sensors, and different characteristics of the reported signals, it is very challenging to align the timing between the signals.

The soft bus technology of Hongmeng Ecology The soft bus has the ability to approach the hard bus infinitely. Its working principle includes a connecting tool-soft clock. When the working device forms a hyperterminal, the soft clock can capture the clock signal from the crystal oscillator of the strongest device. Once the clock signal is captured, the clock of all subsequent business processing will be based on the soft clock. The current accuracy of the soft clock can already achieve an error of less than 1 millisecond. Wang Chenglu said that the goal of the Beta version of HarmonyOS 3.0 is to achieve 500 microseconds, which can fully meet the needs of sensor signal synchronization.

Data labeling has always been a big challenge in the direction of AI sample data, and Huawei has proposed an innovative mutual-aid labeling method for multi-modal data labeling. Annotated modal data is automatically annotated. When there are more sensing devices and more labeled devices, there will be more and more associated modalities, and the efficiency of automatic labeling will also be greatly improved.

Compared with the traditional large-scale semantic training, the small sample real-time training model has very few sample data of the sensing signal, and the sensor is not stable enough. Once the fluctuation occurs, it will have a greater impact on the model. Therefore, the existing traditional AI model cannot be used for training on the device side. Huawei specially developed a small sample real-time training model on the device side for this purpose to solve the impact problem caused by the fluctuation and instability of the small sample data.

The final normalization of the three technologies, the core algorithm of the model is the unsupervised learning algorithm sparse coding. After finding a complete basic vector machine, the vector signal can use the linear combination of the basic vector machine to represent the input signal. The advantage of this algorithm is that it can avoid the model fluctuation problem caused by unstable data and sample space.

Understand the needs of users, the entrance is unified

In HarmonyOS, the same principle applies. When the federated data of the sensor captures the consumer’s intent in real time and accurately, the next step is to find the corresponding service according to the intent, and hand over the matching actions to the machine. It is not easy to achieve this step. It is never necessary to continuously enhance the implicit vectorization intention, find dozens of candidate sets from a large number of services and applications, and add explicit structured intentions to further filter and analyze the candidate sets. Logic assembly to enhance accurate feedback of consumer intent.

In the past year, “Xiaoyi Suggestion” has served countless users, and the unsung hero behind this is the above technology. Like the design concept of HarmonyOS, Xiaoyi also adopts a complete decoupled architecture design to support flexible deployment. This means that all ecological devices, all HarmonyOS and OpenHarmony gadgets, can install Xiaoyi, allowing users to have a unified entrance.

Wang Chenglu pointed out that the current usage rate of “Xiaoyi Suggestions” has been very high, and Xiaoyi can deeply understand the user’s intention, and put the services that may be needed into Xiaoyi suggestions according to the user’s time, place, and scene. As a result, the frequency of active searches by users becomes lower and lower. The lower the frequency, the smarter the “Xiaoyi Suggestion”. Based on this, it is expected to become a unified portal for human-computer interaction for the Internet of Everything in the future. Through Xiaoyi, various hardware differences can be shielded. Wang Chenglu also called Xiaoyi “a milestone and starting point for the Internet of Everything in the future”.

When Xiaoyi is deployed like this, with the interconnection and integration of Hongmeng ecology, in any scene, no matter what device the user uses to reach it at any moment, Xiaoyi can perceive it. Xiaoyi will also feed back information to you according to the way you reach it at the moment, saving you the process of constantly matching between different devices, searching for services for logical assembly. Wang Chenglu also hopes that Huawei hopes to accelerate the arrival of the era of the true Internet of Everything and the Internet of Everything.

Simple development like getting a service

Developers are the core driving force behind the implementation of all these technologies. The HarmonyOS Connect software service package 3.0 provides developers with massive development assistance, newly added devices with screens that support vertical applications, and upgraded basic service packages, enhanced service packages, and services including Xiaoyi, Service Center, The application service package including Changlian and other applications can be directly invoked by developers to quickly develop devices with smart AI capabilities. It is expected that by 2022, it will be fully adapted to devices with screens that support rich applications.

Wang Chenglu said that in the future, he will continue to enhance capabilities and tools, leaving more time and convenience for developers to do business innovation. “Leave the complexity to us, and leave the simplicity to the developers.”

For hardware developers, Huawei provides a one-stop device integrated development environment that supports remote development, on-demand customization, one-click compilation and programming, one-click integration service packages, and device emulators, lowering the access threshold and device emulator for developers. The development cycle has improved development efficiency. The development cycle of non-screen devices has been reduced from 2 months to 2 weeks, and the device with a screen is expected to be reduced to less than 2 months in 2023.

download link:

https://device.harmonyos.com/cn/develop/ide

For application developers, Huawei has launched a one-stop device integrated development environment, which provides more than 50 atomic services and card templates, supports multi-terminal bidirectional preview, low-code development, distributed simulation, and distributed debugging. According to reports, the current atomization service development efficiency has been reduced from 1 month to 15 days. The goal for next year is one week. It is estimated that by 2023, it will only take 5 days to complete the development.

From the launch of HarmonyOS 2.0 on September 10, 2020, to the official release of the HarmonyOS 2 mobile version on June 2, 2021, HarmonyOS has become synonymous with domestic operating systems, and the Hongmeng ecosystem has continued to accelerate. In such an ecosystem, the power of the Internet of Everything and AI has begun to change the interaction mode between people and devices, and between people and services.

Ecology means being in the same dust as the light. The mission that Hongmeng Ecology has shouldered since its birth wants to continue to reach its peak. Although this process is lonely, it cannot be lonely all the time. The construction of the Hongmeng Ecology is inseparable from the help of developers and ecological partners. Dr. Wang Chenglu also expressed that he welcomes more partners and developers to join the Hongmeng Ecology, and continue to contribute to the new era of the Internet of Everything.

The Links:   2DI200A-050   S5C-225HV