234 points by webdevwizard 1 year ago flag hide 22 comments
johnsmith 1 year ago next
Really cool demo! I've been playing around with TensorFlow.js lately and this is really impressive.
original_poster 1 year ago next
Thanks @johnsmith! I'm glad you enjoyed it. I've been working on this project for a while now and it's great to see others interested in it.
anotheruser 1 year ago prev next
I've been trying to get gesture recognition working in my own project. How did you handle the webcam access?
original_poster 1 year ago next
I used the MediaDevices API to access the webcam and retrieve the video stream. From there, I used TensorFlow.js to process the frames and extract features.
yetanother 1 year ago prev next
This is really cool, I'm wondering how the performance is? Are you seeing a lot of lag?
original_poster 1 year ago next
It performs pretty well! I've tested it on a few different computers and the lag is minimal. Of course, this can vary depending on the performance of the device.
gsundeep 1 year ago prev next
Nice work, I remember the early days of gesture recognition and this is quite an improvement
user9876 1 year ago prev next
How accurate is the gesture recognition? What kind of gestures can it detect?
original_poster 1 year ago next
I've tested the accuracy using a few different datasets, and it's around 90-95% depending on the complexity of the gestures. Currently, it can detect common gestures like swipe, pinch, and tap.
thatsawsome 1 year ago prev next
Wow, this is amazing! I can't wait to try it out for myself.
original_poster 1 year ago next
Thanks! I'm glad you're interested. You can check out the code on GitHub and try it out for yourself.
genxguru 1 year ago prev next
I remember when this kind of thing could only be done on local machines with specialized hardware. Now it's all done in the browser!
original_poster 1 year ago next
Yep, that's the power of web technologies and machine learning frameworks like TensorFlow.js. It's incredible what we can do now with just a webcam and a browser.
mayankgoyal 1 year ago prev next
This is very cool! Are there any plans to add more complex gestures?
original_poster 1 year ago next
Yes, I'm planning to add support for more complex gestures like sign language in a future update
spdgmn 1 year ago prev next
Very nice, I'm looking forward to trying it out for my own projects.
pgarcc 1 year ago prev next
This is amazing, I really like the idea of real-time gesture recognition in the browser. However, I am curious about the latency. Can you tell me more about how you optimized it?
original_poster 1 year ago next
Sure, I optimized the latency by using the Web Workers API to offload the computation to a separate thread. This way, the main browser thread won't be blocked and the latency is minimized. I also use the Intersection Observer API to only process frames that are in the current viewport, reducing the amount of unnecessary computation.
davidjohnson 1 year ago prev next
This is incredible, I can't wait to see where this technology goes.
original_poster 1 year ago next
Thanks, I'm excited to see what people will build with it too. Let me know if you have any further questions or need any help getting started.
futuretechie 1 year ago prev next
This is amazing! It reminds of the HoloLens demos I've seen. I'm wondering if this could be adapted to a similar use-case?
original_poster 1 year ago next
Yes, I think this could definitely be adapted for a HoloLens or similar AR/VR device. The idea would be to use a similar webcam-based gesture recognition system to track the user's hand movements and translate them into commands for the AR/VR system.