Multi-task AI Model for Swimmer Tracking and Action Recognition


Project Overview
Design And Implementation Of A Lightweight Multi-task Deep Neural Network For Swimmer Action Recognition And Re-identification.
Problem
The conventional supervised learning of deep neural network is not well applicable with the increasing needs of today’s complex decision making especially in smart surveillance systems because the real-world problem often involves multiple complexes of factors and criteria. Existing swimmer monitoring systems relied on wearable devices such as smartwatches and separate machine learning models for action recognition and swimmer re-identification, increasing system complexity and deployment limitations.
Approach
Multi-task learning (MTL) with multi-output capabilities has emerged as a solution. The MTL is a subfield of AI in which multiple tasks are simultaneously learned by a shared model. This method as being inspired by human learning makes the model beings more accurate than single-task learning. Proposed and developed a lightweight multi-task deep neural network integrating swimmer action recognition and swimmer re-identification into a single unified framework using surveillance video streams
Key Results & Impact
- ✓Delivered a real-time smart swimming surveillance system capable of swimmer detection, tracking, action recognition, and re-identification with reduced computational complexity and improved deployment practicality.
- ✓Promising Performance on large-scale dataset for each task (action recognition and re- identification), and multi- task dataset.
Technologies Used
Additional Information
Related Projects

Intelligent Sootblower
Optimization of Sootblower Operation Using Machine Learning for Reducing Sootblower Steam Consumption

Product Matching - Shopee National Data Science Competition 2020
Built a Siamese Neural Network for Shopee product matching and achieved Rank 6/139 in the 2020 national data science competition.

Sensor-Based Human Action Recognition
A wearable AI action recognition system using smartphone and smartwatch sensors for real-time activity detection, sponsored by MOST Taiwan.