Skip to content

Aakash Madabhushi

Robot Learning

I train manipulation policies on a physical arm and build the evaluation apparatus that says honestly whether they work.

Graduate Research Assistant in the SJSU Department of Applied Data Science since March 2026, training and evaluating SO-101 pick-and-place policies on real hardware. The work covers the whole loop: teleoperated data collection, quality gates over the recorded episodes, PyTorch and CUDA training runs, and a physical evaluation harness that scores rollouts one at a time and survives being interrupted.

Training the policy is the easy half. The harder half is the measurement: a harness that returns the arm to start on its own, guards against stale caches, logs every failure mode separately, and reports 92% instead of rounding it up. That work now extends into Isaac Sim and MuJoCo for SO-ARM101 and Franka Emika Panda arms, so control approaches can be checked before they reach hardware.

92%
pick-and-place success, 50 physical rollouts at the trained cube position
2.49 cm
average placement error on successful trials
49,633
demonstration frames published as an open dataset, across 50 episodes

3 projects in this area

Every link goes to code or data you can inspect yourself.

  • The SO-101 arm on the lab desk beside the marked cube it picks up and the clear container it places the cube into.

    Scored 92% pick-and-place success and 2.49 cm mean placement error over 50 physical rollouts, by training an Action Chunking Transformer on 50 teleoperated demonstrations and scoring it against a protocol locked before evaluation.

    Robot LearningML Engineering

    Graduate Research Assistant, SJSU Applied Data Science · Mar 2026 to present

  • The physical robot arm on the lab desk beside the monitor running the simulator it is matched against.

    Takes physical robot time out of the iteration loop, by locating the real cube and bowl with ArUco markers from a calibrated overhead camera and mirroring their coordinates into Isaac Sim, so policies train against the real table's layout.

    Robot LearningSoftware Engineering

    Personal project, built on NVIDIA's Sim-to-Real SO-101 workshop · Aug 2026 to present

  • Reduced robotics environment setup to one command on macOS and Linux, by packaging ROS 2 Jazzy, Gazebo Harmonic, RViz and TurtleBot3 into a version-pinned Docker Compose stack with a browser desktop that removes X11 failures.

    Robot LearningSoftware Engineering

    Personal project · Mar 2026

Select a project for the full detail and links.

Robot LearningML Engineering

Teaching a Robot Arm to Pick and Place

Scored 92% pick-and-place success and 2.49 cm mean placement error over 50 physical rollouts, by training an Action Chunking Transformer on 50 teleoperated demonstrations and scoring it against a protocol locked before evaluation.

Graduate Research Assistant, SJSU Applied Data Science · Mar 2026 to present

The SO-101 arm on the lab desk beside the marked cube it picks up and the clear container it places the cube into.

Results

92%
pick-and-place success, 50 rollouts at the trained cube position
2.49 cm
average placement error on successful trials
50
teleoperated episodes published as an open dataset, 49,633 frames

Built with

  • Python
  • PyTorch
  • CUDA
  • LeRobot
  • ACT
  • SmolVLA
  • Weights & Biases
  • Hugging Face Hub
Robot LearningSoftware Engineering

Real2Sim2Real: Mirroring a Real Workspace into Simulation

Takes physical robot time out of the iteration loop, by locating the real cube and bowl with ArUco markers from a calibrated overhead camera and mirroring their coordinates into Isaac Sim, so policies train against the real table's layout.

Personal project, built on NVIDIA's Sim-to-Real SO-101 workshop · Aug 2026 to present

The physical robot arm on the lab desk beside the monitor running the simulator it is matched against.

Built with

  • Python
  • NVIDIA Isaac Sim
  • ROS 2
  • OpenCV
  • ArUco
  • LeRobot
  • Docker
Robot LearningSoftware Engineering

ROS 2 + Gazebo, Containerized

Reduced robotics environment setup to one command on macOS and Linux, by packaging ROS 2 Jazzy, Gazebo Harmonic, RViz and TurtleBot3 into a version-pinned Docker Compose stack with a browser desktop that removes X11 failures.

Personal project · Mar 2026

Built with

  • Docker
  • Docker Compose
  • ROS 2 Jazzy
  • Gazebo Harmonic
  • TurtleBot3
  • VNC

Hiring for robot learning?

I'm available from December 2026 and open to relocating. Email me and I'll reply within a day.

Hiring for something else?