NVIDIA trains humanoid robots with Apple Vision Pro
In this neural network training method, the machine copies the operator's movements in real time, and it is Apple Vision Pro that digitizes the movements.
The developers transfer the acquired data to the NVIDIA Isaac Sim application, where they simulate movements in a virtual environment. Then, in the MimicGen NIM microservice, they generate synthetic motion data based on recorded teleoperations with Apple Vision Pro. The resulting synthetic sets are used to extend the AI database of the humanoid robot.
Training an AI humanoid robot requires a colossal amount of data and impressive finances. The Apple headset itself is necessary for NVIDIA because it solves two big problems at once: first, the helmet can generate a lot of data using teleoperation, and second, it does it relatively cheaply.
Robotics
19
4
0
Comments
Recommended
Pavel Ryzhikh
79 subscribers
9 months ago
Subscribe
Figure robot developers revealed the next generation of humanoids
Now they look even more cyberpunk and move much smoother.
They also promise that you can communicate with them almost like with humans - the custom AI model was created together with OpenAI, the developers of ChatGPT.
Figure 02 is being trained at one of BMW's factories in the USA, where it helps to transfer parts
Robotics
20
0
0
Artem Vershinsky
157 subscribers
9 months ago
Subscribe
Foundation Robotics Labs, a humanoid robotics startup, is seeking the last $1 million in funds
Sankaet Pathak, Arjun Sethi from Synapse, and Mike LeBlanc from Cobalt Robotics founded Foundation Robotics Labs in April. They aim to innovate at factories, warehouses and homes with humanoid robots. The company plans to secure the last million dollars of an 11 million dollar seed round by claiming that GM will invest and place orders. However, GM disputes these claims.