一句话:提出可在边缘计算环境商品机器上部署的低成本人体行为识别系统 Edge4Real,实现实时、易用的人体动作识别。
人体行为识别(包括身体动作和面部表情)在人本软件工程中很重要,但基于视频分析的方法数据与计算密集,通常需要昂贵的高性能机器,限制了研究与应用。本文提出 Edge4Real,一个可在商品化边缘计算环境中部署的低成本人体行为识别系统。它采用分布式架构,将动作捕捉、人体行为识别、数据解码与提取以及识别结果应用等组件部署在分离的终端设备和边缘节点上。通过一个能实时捕捉用户动作并驱动 3D 化身运动的虚拟现实应用,作者验证了系统的有效性,并展示了其对人本软件工程研究与应用的价值。
Recognition of human behaviours including body motions and facial expressions plays a significant role in human-centric software engineering. However, due to the data and computation intensive nature of human behaviour recognition through video analytics, expensive powerful machines are often required, which could hinder the research and application in human-centric software engineering. To address such an issue, this paper proposes a cost-effective human behaviour recognition system named Edge4Real which can be easily deployed in an edge computing environment with commodity machines. Compared with existing centralised solutions, Edge4Real has three major advantages including cost-effectiveness, easy-to-use, and real-time. Specifically, Edge4Real adopts a distributed architecture where components such as motion capturing, human behaviour recognition, data decoding and extraction, and the application of the recognition result, can be deployed on separated end devices and edge nodes in an edge computing environment. Using a virtual reality application which can capture a user's motion and translate into the motion of a 3D avatar in real time, we successfully validate the effectiveness of the system and demonstrate its promising value to the research and application of human-centric software engineering. The demo video can be found at https://youtu.be/tnEshD8j-kA.
DOI 原文 ·
@inproceedings{paperbot5874,
title = {Edge4Real},
author = {Di Shao and Xiao Liu and Ben Cheng and Yi Wang and Thuong Hoang},
booktitle = {ASE},
year = {2020},
doi = {10.1145/3324884.3415297}
}