π΅ Play Melody
December 15, 2025 Β· View on GitHub
Play Melody is a camera-based music app that lets you perform melodies with your fingers using real-time hand tracking.
π Quick Links
- Contact: leeshin1130@gmail.com
- App Score: View Here
- Initial Demo Video: View Here
- Notion: View Here
- Privacy Policy: View Here
- Report a Bug / Request a Feature: GitHub Issues
- Supported Platforms: Mac (macOS 15+)
π Features
- Real-time hand tracking with Vision framework
- Pinch-to-note mapping for intuitive music play
- Works offline β no internet required
π Getting Started
Flow: Welcome β Guide β Practice β Play
-
Welcome & Guide
-
Read the brief intro and instructions.
-
-
Practice
- Learn hand gestures for each note (e.g., pinch patterns).
- Follow on-screen cues until you can reliably trigger the right notes.
-
Play
-
Choose a song and perform.
-
About Hand Tracking
β FAQ
Q1. Does the app record or upload video?
A. No. Camera frames are processed on-device and never stored or uploaded.
Q2. Why doesnβt hand tracking work?
A. Use good lighting, keep hands in view, maintain a steady 30β60 cm distance, and avoid strong backlight.
Q3. I denied Camera permission by mistake.
A. Go to Settings β Play Melody β Camera and enable it, then restart the app.
Q4. Does it support both orientations?
A. Yes. If alignment is flipped after rotation, return to the home screen and re-enter practice.
π Troubleshooting
- No camera prompt: Force-quit and reopen, or enable in Settings.
- Lag or stutter: Close other apps, keep battery >20%, ensure good lighting.
- Small icons/text: Adjust in Settings β Accessibility β Display & Text Size.
β Known Issues
- Very dim lighting may reduce detection accuracy.
π§ Contact
- Email: leeshin1130@gmail.com
π Awards
- Apple Swift Student Challenge 2024 Distinguished Winner