Modified Create 3 robot with camera and sensor
← Back to Work GitHub →
Robotics · 2024

Object-Based Recognition Navigation

Autonomous robot that navigates a maze by identifying objects in real time and making turn decisions based on what it sees.

Teachable Machine Keras ROS2 Picamera Ultrasonic Sensor Object Recognition

This project challenged the robot to navigate a maze containing seven objects, making real-time navigation decisions based on what it identified. A Picamera captured live images fed into a Teachable Machine model trained to classify the specific objects placed in the maze. The camera also provided visual feedback during navigation, allowing us to monitor what the robot was recognizing as it moved.

An infrared sensor measured distance to objects, triggering the decision logic when the robot came within threshold range. Upon identifying an object, the robot stopped and executed a 90-degree rotation — clockwise or counterclockwise depending on the classification. The direction mapping for each object was confirmed ten minutes before the presentation, so the code was designed to be quickly reconfigured on the spot.

The system combined sensor fusion — vision for object identity, distance sensing for proximity — with ROS2 action commands for motion control, creating a modular and adaptable navigation pipeline.

Hardware

  • iRobot Create 3
  • Raspberry Pi
  • Picamera
  • Infrared Sensor

Vision & ML

  • Teachable Machine
  • Keras Model
  • Real-Time Classification
  • Sensor Fusion

Software

  • ROS2
  • Python
  • Action Commands
  • Modular Logic

Robot navigating the maze — identifying objects and executing turn decisions in real time.

Previous Project ← ROBOTIC CAFÉ
Next Project REMOTE NAVIGATION →