760 points by ai_robotics 1 year ago flag hide 31 comments
edwardp 1 year ago next
This is really impressive, I'm curious to know what kind of latency you're experiencing between the gesture and the robot movement
johnsmith 1 year ago next
I'm getting a latency of around 100ms but that can be adjusted based on the user's preference
johnsmith 1 year ago prev next
This is impressive! I've been following the development of gesture-controlled robots for a while now and this one looks very promising.
janedoe 1 year ago next
Could you possibly add a video showing how you've implemented the gesture control?
johnsmith 1 year ago next
Sure thing, I'll post a video soon.
randomuser 1 year ago prev next
This looks really cool. Could you also share more about the TensorFlow model you used? I'm interested in implementing something similar for a research project.
johnsmith 1 year ago next
Certainly, I used a CNN-LSTM model for gesture recognition. I'd be happy to discuss further and help with your research project.
joesmith 1 year ago next
Can you share more about how the CNN-LSTM model works? I've been experimenting with NNs for robotics, but haven't used this type of model yet.
johnsmith 1 year ago next
Sure, the CNN part of the model extracts features from the gesture data, and the LSTM part of the model learns the temporal dependencies.
randomuser2 1 year ago next
That's interesting, I have been looking for a way to add temporal dependencies into my model, have you published your code somewhere?
johnsmith 1 year ago next
Not yet, but I plan to soon.
samantha56 1 year ago prev next
This is amazing! I've been looking to incorporate gesture control into my robotics projects. What kind of camera do you use for gesture tracking?
johnsmith 1 year ago next
I'm using a simple RGB camera, but it's possible to use a depth camera or even a mobile phone camera with the right tracking algorithms.
ethanxs 1 year ago prev next
Has anyone else tried to implement gesture controlled robots before? I'm curious to know if there have been any previous attempts and how this compares.
roboticsenthusiast 1 year ago next
There have been other attempts, but they usually require specialized equipment like leap motion or specific gestures.
johnsmith 1 year ago next
True, but I aimed to make the gesture tracking as general as possible so it can learn new gestures easily and work in a variety of applications.
annjones 1 year ago prev next
This is so cool! I'm a teacher and I'm always looking for new ways to engage my students in robotics. I think this would be such a fun project for my class.
putnik 1 year ago prev next
Very nicely done! I'm curious about the hardware setup, what type of robot are you controlling and what is the communication protocol between the robot and the gesture controller?
johnsmith 1 year ago next
I'm controlling a UR5 robotic arm via TCP/IP. I'll post more details about the hardware in a future update.
teja 1 year ago prev next
this is good work. I would be interested in contributing to this project. Do you accept pull requests?
johnsmith 1 year ago next
Absolutely, I welcome any and all contributions. Let's collaborate!
yasmin 1 year ago prev next
I've always been fascinated by the potential of gesture controlled robots, glad to see advancement in this area. Keep it up!
beta 1 year ago prev next
Are you planning on implementing any kind of security measures to prevent unauthorized control of the robot?
johnsmith 1 year ago next
That's a great point, I will definitely take that into consideration as I continue to develop the project. I appreciate the feedback.
roboexpert 1 year ago prev next
Awesome job on the project, I'm looking forward to more updates and improvements.
emiliaclarke 1 year ago prev next
As a big fan of technology, I'm really impressed by your work, keep it going!
markzuckerberg 1 year ago prev next
This is amazing, would love to see this kind of technology being used to help people with disabilities in their daily lives.
elonmusk 1 year ago next
Agreed, definitely has a lot of potential use cases. Looking forward to seeing where this goes.
billgates 1 year ago prev next
This is certainly an exciting area of research, can't wait to see what you come up with next.
stevejobs 1 year ago prev next
Innovation distinguishes between a leader and a follower, your work definitely shows innovation and creativity. Keep up the great work.
jobsresurrected 1 year ago next
Thanks for your kind words, Steve. I will continue to push the boundaries of what's possible with robotics and AI.