The Huawei ICT Competition 2023-2024 China Grand Final and Award Ceremony was successfully held in Xiamen, Fujian Province on 30-31 March. QG Studio, a student team of GDUT-Huawei Kunpeng & Rising Developer Creative Club (hereinafter referred to as the Creative Club), competed with 50 teams from 31 colleges and universities across China, including Tsinghua University, Tongji University, Shanghai Jiaotong University, and Sichuan University, and won second prize for its project "Mindspore-based Smart Assistive Glasses for the Hearing Impaired", achieving a new breakthrough.
This project is designed and developed by the QG Studio of "Xiaoping Science and Technology Innovation Team", which is a benchmark team of the School of Computer Science and is stationed in the direction of "Digital Intelligent City" in the Creative Society. The project is an intelligent system combining hardware and software, which can not only realise the recognition of human voice and environmental sound for the hearing-impaired, but also enable the visually-impaired to better perceive the world around them, effectively improve their quality of life and encourage them to better integrate into the society, which is of good social benefits. The project designs integrated wearable smart glasses, adopting technologies such as Huawei MindSpore full-scene deep learning framework and ModelArts, an AI development platform, combined with a multi-channel audio processing module, to train and deploy an intelligent audio analysis model in the cloud. And at the same time, based on the VisualGLM-6B home-made multimodal large model, it could fine-tune the deployment of voice assistants to address the complexity and diversity of the scenarios. In addition, the project innovatively combines the augmented reality technology AR to bring more convenient experience for users.
