10110 01101
01011 10010
11001 01110
Sunny Deshpande
Robotics Engineer

Sunny Nitin
Deshpande

Building intelligent robotic systems at the intersection of perception, controls, and learning. MEng student in Autonomy & Robotics at UIUC.

sunnydeshpande9900@gmail.com
Selected Projects

A curated collection spanning perception, controls, learning, and systems.

VLA Humanoid🧠
UIUC · Robot Learning

VLA Model for Language-Guided Humanoid Loco-Manipulation

CLIP-based VLA with Teacher–Student distillation via DAgger. EfficientNet/BERT student deployed to edge hardware. 62.1% success on unseen tasks.

CLIPVLABehavior CloningDAggerEfficientNetBERT
Oct 2025 – Dec 2025
AutoShield🚗
UIUC · AV Safe Autonomy

AutoShield — Pedestrian-Intent Prediction with Safety-Filtered Autonomous Driving

ROS2-based predictive control on GEM e4 with LiDAR-RGB-D fusion, Kalman-filtered TTC, YOLOv11 + DBSCAN tracking. 91% success rate across real-world trials.

ROS2YOLOv11LiDARRGB-DKalman FilterStanleyPIDSensor Fusion
Oct 2025 – Dec 2025
Hierarchical MARL🤖
UIUC · Humanoid Robotics

Hierarchical Multi-Agent RL for Humanoid Interaction

Hierarchical PPO for Unitree G1 humanoids: high-level navigation decoupled from 29-DOF locomotion. Curriculum learning in Isaac Lab with domain randomization.

PPOIsaac LabMulti-Agent RLUnitree G1Curriculum LearningDomain Rand.
Oct 2025 – Dec 2025
6D Pose Estimation📐
UIUC · Computer Vision

Open-World Zero-Shot 6D Pose Estimation

Open-vocabulary 6D pose tracking extending FoundationPose with Moondream2 VLM + SAM-3 segmentation. 88.31% ADD-S on 44 YCB-Video datasets.

FoundationPoseVLMSAM-3TripoSRPyTorchZero-Shot
Oct 2025 – Dec 2025
C.A.R.E. Robot👓
CalHacks 12.0

C.A.R.E. — Companion Autonomous Robotic Entity

Gemini VLM task planner + ROS2 Nav2 on Booster K1 Humanoid synced with Snap AR Spectacles via WebSocket at sub-100ms latency.

ROS2Gemini VLMNav2OpenCVWebSocketAR
Oct 2025 - Oct 2025
Glass Cleaning Robot🧹
SUTD Capstone · Changi Airport

Curved Glass Cleaning Robot

Led 7-person team. ROS2 on Jetson Orin Nano, dual-Arduino FSM, cascade lift to 2m, custom admittance controller, live airport deployment.

ROS2Jetson OrinAdmittance ControlFSMArduinoSolidWorks
Aug 2024 – May 2025
Lightning Risk Prediction⛈️
SUTD · Deep Learning

Category 1 Lightning Risk Prediction using CNN-RNN

CNN-RNN model predicting Cat 1 Lightning Risk from weather station features: rainfall, wind speed, temperature, humidity, wind direction.

CNN-RNNTime SeriesPyTorchWeather
Jan 2025 - Apr 2025
DIAPP Controller🏎️
SUTD Thesis · SHARP

DIAPP — Dynamics-Intent Aware Pure Pursuit Controller

Non-linear tire slip + friction circle vehicle model with modified Pure Pursuit for high-lateral-acceleration cornering. Significant CTE reduction.

Pure PursuitVehicle DynamicsTire Slip ModelPythonMATLAB
Sep 2024 – Apr 2025
Lane Tracking Race Car🏁
SUTD Coursework

Lane-Tracking 4WD Race Car

Vision pipeline on Jetson with adaptive thresholding + radial-scan. Real-time polynomial lateral controller at 45+ FPS.

JetsonOpenCVLane DetectionReal-Time45+ FPS
Jan 2025 – Apr 2025
Maze SLAM🗺️
SUTD Coursework

Maze Frontier Exploration SLAM + Object Tracking

Frontier-based exploration with GMapping SLAM, A* global planner, YOLOv11 detection, and simultaneous object tracking.

GMappingA*FrontierYOLOv11ROS
Sep 2024 – Dec 2024
Autonomous Underwater Vehicle🐟
SOAR · Software Lead

SUTD Autonomous Underwater Vehicle

Cascaded PID for 6-DOF underwater stability, state-space control with IMU + depth fusion, real-time CV target acquisition. SAUVC Finalist.

PIDState-SpaceIMU FusionComputer VisionOpenCV
Sep 2022 – Apr 2024
Sentiment Analysis🎬
SUTD · NLP

Sentiment Analysis — BiLSTM-DistilBERT

Contextual transformer embeddings + sequential modeling. ~96% accuracy outperforming classical NLP baselines.

DistilBERTBiLSTMNLPPyTorch
Jan 2024 – Apr 2024
HMM Sequence Labelling📊
SUTD · ML

Automated Sequence Labelling using HMM

Hidden Markov Models with first- and second-order Viterbi decoding for entity recognition and sentiment tagging.

HMMViterbiNERPython
Jan 2024 – Apr 2024
Visual Odometry in Rain🌧️
MARVL Lab · Published

Deep-Learning VO for Autonomous Driving in Rain

DROID-SLAM benchmarked in adverse weather on Oxford RobotCar & 4Seasons. Heuristic variant with map priors. IEEE CASE 2023.

DROID-SLAMVisual OdometryPyTorchStereo VisionBenchmarking
May 2023 – Aug 2023
Pipe Leak Detector🔌
SUTD · EM

Variable-Length Fluid Pipe Leak Detector

Low-cost electromagnetic leak detector with Bluetooth connectivity using EM conduction principles for non-invasive detection.

EM DesignBluetoothAntennaFabrication
May 2023 – Aug 2023
TROLL-E Trolley🛒
SUTD · EDI

TROLL-E: Smart Foldable Electric Grocery Trolley

Custom PCB with motor control, dynamic air-cooling, slope-based actuation, and anti-roll basket mechanism.

PCB DesignMotor ControlKiCADSolidWorks
Jan 2023 – Apr 2023
Quad-Rotor Helicopter🚁
Personal Build

Teleoperable Quad-Rotor Helicopter

Low-cost quadcopter with off-the-shelf components. Integrated propulsion, power distribution, and flight electronics for stable teleoperation.

ElectronicsFlight ControlPID Tuning
Jan 2023 - Jan 2023
Bio-Inspired Underwater Robot🐠
BRD Lab

Bio-Inspired Underwater Robot Control

CPG-based motion controller for soft batoid robot with sinusoidal propulsion and strain gauge obstacle detection.

CPGSoft RoboticsSignal ProcessingDSP
Jan 2022 – Apr 2022
Nature-Inspired Aerial Craft🚁
AIR Lab

Nature-Inspired Aerial Robotic Craft

Angsana seed-inspired autorotating craft with single-flap motor trajectory control and aerodynamic calibration.

AerodynamicsFabricationCADMATLAB
Sep 2021 – Dec 2021
Epilepsy EEG Diagnosis🧬
NP Research · Published

Epilepsy Diagnosis via AI + EEG Signals

CNN-LSTM for EEG-based epilepsy detection at 87% accuracy. Contributing to FCGS journal publication.

CNN-LSTMEEGDeep LearningTensorFlow
Mar 2018 – Aug 2019
8-Bar Lifting Robot🏗️
Asia-Pacific Vex Robotics 2014

8-Bar Cube Frame Lifting Robot

8-bar lifting mechanism with novel intake for cube frame collection. Won Best Design Award at Asia-Pacific Robotics Championship.

Mechanism DesignCompetitionFabrication
Jan 2014 - Aug 2014
Work Experience

Hands-on internships across the robotics stack — from research institutes to startups and MNCs.

May 2024 – Sep 2024

Hyundai Motor Group Innovation Centre

Robotics Fleet Software Engineer Intern · Robotics Center
  • Optimized ROS2/REST/MQTT fleet communication pipeline, improving real-time reliability and latency.
  • Increased junction navigation speed by 40% via redesigned trajectory-following and motion-planning controller.
  • Designed bidirectional temporal traffic path planner improving routing, congestion handling, and mission success by 10%.
ROS2MQTTREST APIMotion PlanningPath PlanningTrajectory FollowingPythonMobile Robot
Sep 2023 – Dec 2023

Venti Technologies

AV Simulation Engineer Intern · Planning and Control Team
  • Built simulation pipelines in Virtual Test Drive (VTD) to validate planning, control, and prediction algorithms with accurate vehicle dynamics.
  • Developed scenario scripts and agent behaviors to stress-test MPC controllers, expanding scenario coverage.
  • Developed and performed parameter extraction and computation agents for controller design.
VTDMPCVehicle DynamicsSimulationPythonScenario TestingAV
May 2019 – Aug 2019

A*STAR (I2R)

Robotics & AI Research Intern · Perception Team
  • Designed CNN-based indoor navigation and obstacle-avoidance model using RGB-D and pose input, deployed on Pioneer P3-DX with 95% success rate.
  • Project served as foundation for future collaborative commercial research on end-to-end neural network-based navigation.
CNNRGB-DROSTensorFlowObstacle AvoidanceNavigationPythonMobile Robot
Technical Skills

Full-stack robotics — from perception and planning to learning and deployment.

Autonomy and Robot Learning

Robot Learning 13

Deep LearningReinforcement LearningPPOH-MARLVision-Language-Action (VLA)Behavior CloningDAggerImitation LearningCurriculum LearningDomain RandomizationSim-to-Real TransferNLPTransformers

Perception & SLAM 12

Computer VisionSLAMVisual Odometry6D Pose EstimationObject DetectionSAM-3YOLOv11Semantic SegmentationInstance SegmentationLiDARStereo VisionRGB-D

Autonomy & Controls 12

Motion PlanningPath PlanningTrajectory OptimizationMPCPIDState SpacePure PursuitStanley ControllerAdmittance ControlSensor FusionKalman FilterFinite State Machine

Spoken Languages: English (Fluent) · Hindi (Fluent) · Marathi (Fluent)

Academic Background

A focused academic path through engineering, robotics, and CS.

Aug 2025 – Sep 2026

University of Illinois Urbana-Champaign

MEng in Autonomy and Robotics · GPA 3.75/4.00
Reinforcement Learning, Advanced Computer Vision, Autonomous Vehicle Safe Autonomy, Humanoid Robotics
Sep 2021 – May 2025

Singapore University of Technology and Design

BEng (Engineering Product Development), Robotics Focus · Minor in CS
SUTD Honours and Research Programme (SHARP) · Global Distinguished Scholarship
May 2016 – May 2019

Ngee Ann Polytechnic

Diploma in Engineering Science
Specialization in Automation and Mechatronics Systems · NP Engineering Merit Awardee
Jan 2012 – Dec 2016

School of Science and Technology, Singapore

GCE O'Levels
Pure Physics and Chemistry · Fundamentals of Electronics (Applied Subject)
Publications

Peer-reviewed contributions to robotics and biomedical AI.

19th IEEE International Conference on Automation Science and Engineering (CASE 2023)

Evaluating Visual Odometry Methods for Autonomous Driving in Rain

Benchmarked classical and learning-based VO/SLAM across Oxford RobotCar, 4Seasons, and internal Singapore rain datasets. Proposed DROID-SLAM heuristic variant with map priors for rain robustness.

Download Paper
Future Generation Computer Systems (FGCS), Elsevier, 2019

Characterization of Focal EEG Signals: A Review

Large-scale review of nonlinear signal representations for EEG-based diagnosis. Benchmarked 50+ features across 7,500 signals with statistical validation. CNN-LSTM models achieving 87% accuracy on Bern–Barcelona datasets. DOI: 10.1016/j.future.2018.08.044

Download Paper
Role-Specific Resumes

Tailored resumes highlighting relevant experience for each role.

Awards & Competitions
1st

Deep Dive Singapore

Winning Business Pitch · 2025
Final

SAUVC

Autonomous Underwater Vehicle · 2024
3rd

Build On Singapore Hackathon

Category B · 2019
Merit

NP Engineering Merit Award

Academic Excellence · 2017
Best

NJRC Best Programming + Mech Design

National Junior Robotics · 2016–17
Best

Asia-Pacific Robotics Design + 3rd

Championship · 2014
1st

FIRST Tech Challenge

Winning Alliance · 2013
3rd

Vex Robotics Best Programming

Singapore · 2013