760 points by ai_robotics 5 months ago flag hide 31 comments
edwardp 5 months ago next
This is really impressive, I'm curious to know what kind of latency you're experiencing between the gesture and the robot movement
johnsmith 5 months ago next
I'm getting a latency of around 100ms but that can be adjusted based on the user's preference
johnsmith 5 months ago prev next
This is impressive! I've been following the development of gesture-controlled robots for a while now and this one looks very promising.
janedoe 5 months ago next
Could you possibly add a video showing how you've implemented the gesture control?
johnsmith 5 months ago next
Sure thing, I'll post a video soon.
randomuser 5 months ago prev next
This looks really cool. Could you also share more about the TensorFlow model you used? I'm interested in implementing something similar for a research project.
johnsmith 5 months ago next
Certainly, I used a CNN-LSTM model for gesture recognition. I'd be happy to discuss further and help with your research project.
joesmith 5 months ago next
Can you share more about how the CNN-LSTM model works? I've been experimenting with NNs for robotics, but haven't used this type of model yet.
johnsmith 5 months ago next
Sure, the CNN part of the model extracts features from the gesture data, and the LSTM part of the model learns the temporal dependencies.
randomuser2 5 months ago next
That's interesting, I have been looking for a way to add temporal dependencies into my model, have you published your code somewhere?
johnsmith 5 months ago next
Not yet, but I plan to soon.
samantha56 5 months ago prev next
This is amazing! I've been looking to incorporate gesture control into my robotics projects. What kind of camera do you use for gesture tracking?
johnsmith 5 months ago next
I'm using a simple RGB camera, but it's possible to use a depth camera or even a mobile phone camera with the right tracking algorithms.
ethanxs 5 months ago prev next
Has anyone else tried to implement gesture controlled robots before? I'm curious to know if there have been any previous attempts and how this compares.
roboticsenthusiast 5 months ago next
There have been other attempts, but they usually require specialized equipment like leap motion or specific gestures.
johnsmith 5 months ago next
True, but I aimed to make the gesture tracking as general as possible so it can learn new gestures easily and work in a variety of applications.
annjones 5 months ago prev next
This is so cool! I'm a teacher and I'm always looking for new ways to engage my students in robotics. I think this would be such a fun project for my class.
putnik 5 months ago prev next
Very nicely done! I'm curious about the hardware setup, what type of robot are you controlling and what is the communication protocol between the robot and the gesture controller?
johnsmith 5 months ago next
I'm controlling a UR5 robotic arm via TCP/IP. I'll post more details about the hardware in a future update.
teja 5 months ago prev next
this is good work. I would be interested in contributing to this project. Do you accept pull requests?
johnsmith 5 months ago next
Absolutely, I welcome any and all contributions. Let's collaborate!
yasmin 5 months ago prev next
I've always been fascinated by the potential of gesture controlled robots, glad to see advancement in this area. Keep it up!
beta 5 months ago prev next
Are you planning on implementing any kind of security measures to prevent unauthorized control of the robot?
johnsmith 5 months ago next
That's a great point, I will definitely take that into consideration as I continue to develop the project. I appreciate the feedback.
roboexpert 5 months ago prev next
Awesome job on the project, I'm looking forward to more updates and improvements.
emiliaclarke 5 months ago prev next
As a big fan of technology, I'm really impressed by your work, keep it going!
markzuckerberg 5 months ago prev next
This is amazing, would love to see this kind of technology being used to help people with disabilities in their daily lives.
elonmusk 5 months ago next
Agreed, definitely has a lot of potential use cases. Looking forward to seeing where this goes.
billgates 5 months ago prev next
This is certainly an exciting area of research, can't wait to see what you come up with next.
stevejobs 5 months ago prev next
Innovation distinguishes between a leader and a follower, your work definitely shows innovation and creativity. Keep up the great work.
jobsresurrected 5 months ago next
Thanks for your kind words, Steve. I will continue to push the boundaries of what's possible with robotics and AI.