234 points by webdevwizard 6 months ago flag hide 22 comments
johnsmith 6 months ago next
Really cool demo! I've been playing around with TensorFlow.js lately and this is really impressive.
original_poster 6 months ago next
Thanks @johnsmith! I'm glad you enjoyed it. I've been working on this project for a while now and it's great to see others interested in it.
anotheruser 6 months ago prev next
I've been trying to get gesture recognition working in my own project. How did you handle the webcam access?
original_poster 6 months ago next
I used the MediaDevices API to access the webcam and retrieve the video stream. From there, I used TensorFlow.js to process the frames and extract features.
yetanother 6 months ago prev next
This is really cool, I'm wondering how the performance is? Are you seeing a lot of lag?
original_poster 6 months ago next
It performs pretty well! I've tested it on a few different computers and the lag is minimal. Of course, this can vary depending on the performance of the device.
gsundeep 6 months ago prev next
Nice work, I remember the early days of gesture recognition and this is quite an improvement
user9876 6 months ago prev next
How accurate is the gesture recognition? What kind of gestures can it detect?
original_poster 6 months ago next
I've tested the accuracy using a few different datasets, and it's around 90-95% depending on the complexity of the gestures. Currently, it can detect common gestures like swipe, pinch, and tap.
thatsawsome 6 months ago prev next
Wow, this is amazing! I can't wait to try it out for myself.
original_poster 6 months ago next
Thanks! I'm glad you're interested. You can check out the code on GitHub and try it out for yourself.
genxguru 6 months ago prev next
I remember when this kind of thing could only be done on local machines with specialized hardware. Now it's all done in the browser!
original_poster 6 months ago next
Yep, that's the power of web technologies and machine learning frameworks like TensorFlow.js. It's incredible what we can do now with just a webcam and a browser.
mayankgoyal 6 months ago prev next
This is very cool! Are there any plans to add more complex gestures?
original_poster 6 months ago next
Yes, I'm planning to add support for more complex gestures like sign language in a future update
spdgmn 6 months ago prev next
Very nice, I'm looking forward to trying it out for my own projects.
pgarcc 6 months ago prev next
This is amazing, I really like the idea of real-time gesture recognition in the browser. However, I am curious about the latency. Can you tell me more about how you optimized it?
original_poster 6 months ago next
Sure, I optimized the latency by using the Web Workers API to offload the computation to a separate thread. This way, the main browser thread won't be blocked and the latency is minimized. I also use the Intersection Observer API to only process frames that are in the current viewport, reducing the amount of unnecessary computation.
davidjohnson 6 months ago prev next
This is incredible, I can't wait to see where this technology goes.
original_poster 6 months ago next
Thanks, I'm excited to see what people will build with it too. Let me know if you have any further questions or need any help getting started.
futuretechie 6 months ago prev next
This is amazing! It reminds of the HoloLens demos I've seen. I'm wondering if this could be adapted to a similar use-case?
original_poster 6 months ago next
Yes, I think this could definitely be adapted for a HoloLens or similar AR/VR device. The idea would be to use a similar webcam-based gesture recognition system to track the user's hand movements and translate them into commands for the AR/VR system.