Skip to content

Siddharth-732/Mudra-Classifier-ML

 
 

Repository files navigation

🎭 SANKET - Indian Classical Dance Mudra Detection

✨ Features

  • 🤖 AI-Powered Mudra Detection - Identify 50+ classical dance hand gestures
  • 💬 Intelligent Chatbot - Learn about mudras with Sanket, your AI dance expert
  • 🎨 Beautiful UI - Modern, responsive design with Indian cultural aesthetics
  • 📚 Educational Content - Comprehensive mudra database with meanings and usage

### 2️⃣ Backend Setup (Python + FastAPI)
```bash
# Navigate to backend
cd backend

# Install Python dependencies
pip install -r requirements.txt

# Start both servers (FastAPI + Node.js Chatbot)
python start_server.py

3️⃣ Frontend Setup (React + TypeScript)

# In a new terminal, go to project root
cd sih3

# Install frontend dependencies
npm install

# Start development server
npm run dev

4️⃣ Access the Application

🎯 How to Use

  1. Upload Image - Select a photo containing a mudra gesture
  2. Choose Dance Form - Select from 8 classical dance styles
  3. Analyze - Click "Analyze Mudra" for instant recognition
  4. Learn More - Chat with Sanket for detailed explanations
  5. Explore - Discover the rich cultural heritage of Indian dance

🏗️ Project Structure

sih3/
├── 📁 src/                    # React Frontend
│   ├── Components/           # React components
│   │   └── Chatbot.tsx      # AI Chatbot component
│   ├── App.tsx              # Main application
│   └── index.css            # Styling
├── 📁 backend/               # Python Backend
│   ├── app.py               # FastAPI mudra detection
│   ├── index.js             # Node.js chatbot server
│   ├── start_server.py      # Unified server startup
│   └── requirements.txt     # Python dependencies
├── 📁 ml/                    # Machine Learning Models
│   └── *.pt                 # Trained YOLOv8 models
├── 📁 public/                # Static assets
└── package.json             # Frontend dependencies

🔧 Technology Stack

Frontend

  • React 18 - Modern UI framework
  • TypeScript - Type-safe development
  • Vite - Fast build tool
  • Tailwind CSS - Utility-first styling
  • Lucide React - Beautiful icons
  • Axios - HTTP client

Backend

  • FastAPI - High-performance Python API
  • Node.js + Express - Chatbot server
  • OpenCV - Computer vision
  • PyTorch - Deep learning
  • YOLOv8 - Object detection
  • Google Gemini AI - Chatbot intelligence

🎭 Supported Dance Forms

  • Bharatanatyam - Tamil classical dance
  • Kathak - North Indian classical dance
  • Odissi - Odisha classical dance
  • Kuchipudi - Andhra Pradesh classical dance
  • Manipuri - Manipur classical dance
  • Mohiniyattam - Kerala classical dance
  • Kathakali - Kerala classical dance-drama
  • Sattriya - Assam classical dance

📊 API Endpoints

Mudra Detection API (Port 8000)

  • GET / - Welcome message
  • GET /health - Health check
  • GET /mudras - List all mudras
  • POST /predict - Upload image for analysis

Chatbot API (Port 5000)

  • POST /api/chat - Send message to Sanket

About

No description, website, or topics provided.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

 
 
 

Contributors

Languages

  • Jupyter Notebook 82.1%
  • TypeScript 11.6%
  • Python 3.9%
  • CSS 1.3%
  • JavaScript 0.9%
  • HTML 0.1%
  • Dockerfile 0.1%