Skip to content

Hands UP is an innovative application that bridges the communication gap between signers and non-signers. Using advanced AI technology, the application detects and translates sign language in real-time through, converting signs into both text and spoken language. Additionally, the app allows users to learn how to sign accurately.

Notifications You must be signed in to change notification settings

COS301-SE-2025/Hands-Up

Repository files navigation

Hands UP by TMKDT
A Capstone Project for EPI-USE Africa
Launch Hands UP

Quick Navigation

Contents

Project Description

Hands UP is an innovative application that bridges the communication gap between signers and non-signers. Using advanced AI technology, the application detects and translates American Sign Language in real-time through the device's camera, converting signs into both text and spoken language without significant delays. Beyond translation, it also serves as an interactive learning platform with structured lessons and immediate feedback on signing accuracy.

Thus, the system focuses on three core functionalities:

  1. Real-time sign language translation
  2. Interactive sign language learning curriculum
  3. Progress tracking for users

Project Documentation and Development Resources

Resource View PDF Description
Software Requirements Specification Software Requirements Specification Outlines the system's functional and non-functional requirements
Coding Standards Coding Standards Coding rules and quality guidelines
Testing Policy Testing Policy Guide to testing tools, system tests and reports
Deployment Deployment Describes the deployment process and diagrams interactions
Project Management - Scrum board for tracking tasks and progress
User Manual User Manual Guide for using the system
Technical Installation Manual Technical Installation Manual Steps to install dependencies and set up the system
Service Contracts Service Contracts Defined inputs, outputs and behaviors of services
Contributions - Outlines each member's individual responsibilities
References - Citations of resources used in the project
Previous Versions of Project Documentation

Technologies

Artificial Intelligence & Machine Learning

Frontend

Backend

Testing

Uptime Kuma Google Lighthouse

Project Management


Meet The Team

Karabo Serothoane

Group Leader, AI Engineer


I’m a detail-oriented developer with expertise in API design and system integration, as well as experience in Azure development. I have specialized in building RESTful APIs using OpenAPI specifications and have hands-on experience with Node.js and Docker, enabling seamless, adaptable deployments across diverse environments. Throughout this project, I have also gained experience with Python and its machine learning libraries, such as scikit-learn and TensorFlow.

Over the past few years, I’ve developed valuable skills in group dynamics and leadership, further strengthened by my participation in the GirlCode Hackathon and vacation work with BBD. These opportunities helped me refine my collaborative skills, apply my technical knowledge in real-world scenarios, and contribute meaningfully in team-driven environments.

Thendo Mbedzi

UI/UX Engineer


I am a BSc Computer Science student with a strong foundation in frontend development, database design, and programming. My academic projects have allowed me to develop hands-on experience in UI/UX design, web development, and database systems, including designing a movie website and NoSQL database interface.

I am skilled in collaborative development, using Git for version control and Visual Paradigm for system design and modeling. My teamwork approach balances task delegation with active collaboration, ensuring clear communication and progress tracking.

Tambi Chirima

Software Architect, AI Engineer


I work well in a professional team environment bringing over three years of part time experience across diverse roles. My most notable positions include working as a manager for a food vendor (currently), an administrative secretary for a small software development firm and as an IT tutor for matric students. My passion lies with backend development, network operations and cloud engineering.

Driya Govender

Business Analyst, Game Design Engineer


Exploring how technology can create smart and efficient solutions is something I am passionate about. I am especially drawn to data science and the ways data-driven insights can shape impactful systems.

While most of my experience lies in front-end development, I have also gained experience in backend development through previous projects involving RESTful APIs, managing relational databases and implementing authentication systems. Throughout this project, I have developed skills in game development and working with 3D models by editing, optimizing, and integrating them to enhance the app.

In addition to my technical skills, I am highly organized, manage my time effectively, and thrive in dynamic environments due to my adaptability and critical analysis skills.

Mutarisi Chibaya

DevOps Engineer


I combine strong technical skills in full-stack development with passion for building innovative solutions to real-world problems. My experience spans system design, database architecture and application development with a proven ability to adapt quickly to new technologies and frameworks. My academic projects have honed my ability to deliver solutions under constraints, making me a valuable contributor to projects requiring both technical rigor and creative thinking.

About

Hands UP is an innovative application that bridges the communication gap between signers and non-signers. Using advanced AI technology, the application detects and translates sign language in real-time through, converting signs into both text and spoken language. Additionally, the app allows users to learn how to sign accurately.

Topics

Resources

Stars

Watchers

Forks

Packages

No packages published

Contributors 5