The present invention relates to a system and method for monitoring hand hygiene compliance. The system is configured to monitor the hand hygiene compliance during hand washing procedure by classifying hand motion as performed by a user using machine learning models. Compliance scores are generated to determine whether each hand motion comply with pre-defined classes of hand motion. A real-time feedback and recommendation are provided to the user to allow the user to improve the hand washing procedure. The system comprises a recording device, a processing module, a server, and an output module.