Acupoint stimulation is one of the methods for maintaining the body's health. It includes many acupoints with healing effects that not only target specific diseases but also regulate overall body functions.
However, acupoints are distributed throughout the body, and their exact locations often require the assistance of professional books or experts to determine. In order to assist users in easily locating and understanding the acupoints on the hands and head, enabling them to relieve symptoms and prevent diseases at any time, our team has developed an interactive AR acupoint health care system.
This system uses the Jetson Nano J1010 development board and incorporates Mediapipe technology and acupoint mapping algorithms to display acupoints on the screen.Through a custom deep neural network (DNN) hand recognition model, it achieves augmented reality (AR) acupoint interaction. Users can use gestures to view the corresponding acupoint locations on the body, as well as brief descriptions of the acupoints.
Additionally, we have developed a mobile app that interacts with the system via Bluetooth technology. Users can select the symptoms they want to understand, and the system will display the acupoints that can alleviate those symptoms.
Our team has also developed AI consultation using the open-source conversational AI Rasa,
utilizing natural language understanding (NLU) to determine the user's intent based on their inputs in the mobile app.When the intent is related to medical content, it is passed to the BERT model for consultation information analysis, determining possible diseases or symptoms, and providing corresponding acupoint recommendations to relieve the symptoms.This helps users make preliminary judgments about their own conditions.
All AI consultation information is transmitted to the server, where doctors can view user information through a website. By utilizing visualized data, doctors can quickly understand the user's condition and further save medical resources.This acupoint-based system provides a safe, convenient, and efficient health care solution for people, especially those who lack experience and medical knowledge.The innovation of this project lies in the combination of the mobile app, AI, and AR technologies, realizing an acupoint-based health care solution.
Traditional methods of health care may require books or expert assistance to determine the locations of acupoints. Through the combination of our interactive AR acupoint health care system and the mobile app, we enable users to intuitively understand the positions and functions of acupoints on the hands in their bodies. This innovative combination of technologies makes acupoint health care more convenient and efficient, providing users with a new way of self-care.