🎡 Play Melody

December 15, 2025 Β· View on GitHub

Play Melody is a camera-based music app that lets you perform melodies with your fingers using real-time hand tracking.



πŸ“‹ Features

  • Real-time hand tracking with Vision framework
  • Pinch-to-note mapping for intuitive music play
  • Works offline – no internet required

πŸš€ Getting Started

Flow: Welcome β†’ Guide β†’ Practice β†’ Play

  1. Welcome & Guide

    • Read the brief intro and instructions.

      Screenshot 2025-08-13 at 11 10 25β€―PM Screenshot 2025-08-13 at 11 10 28β€―PM
  2. Practice

    • Learn hand gestures for each note (e.g., pinch patterns).
    • Follow on-screen cues until you can reliably trigger the right notes.
  3. Play

    • Choose a song and perform.

      Screenshot 2025-08-13 at 11 10 35β€―PM image 5

About Hand Tracking

image

❓ FAQ

Q1. Does the app record or upload video?
A. No. Camera frames are processed on-device and never stored or uploaded.

Q2. Why doesn’t hand tracking work?
A. Use good lighting, keep hands in view, maintain a steady 30–60 cm distance, and avoid strong backlight.

Q3. I denied Camera permission by mistake.
A. Go to Settings β†’ Play Melody β†’ Camera and enable it, then restart the app.

Q4. Does it support both orientations?
A. Yes. If alignment is flipped after rotation, return to the home screen and re-enter practice.


πŸ›  Troubleshooting

  • No camera prompt: Force-quit and reopen, or enable in Settings.
  • Lag or stutter: Close other apps, keep battery >20%, ensure good lighting.
  • Small icons/text: Adjust in Settings β†’ Accessibility β†’ Display & Text Size.

⚠ Known Issues

  • Very dim lighting may reduce detection accuracy.

πŸ“§ Contact


πŸ† Awards

  • Apple Swift Student Challenge 2024 Distinguished Winner