Co-design Hardware/Software of Real time Vision System on FPGA for Obstacle Detection

Ali Alhamwi 1
1 LAAS-RAP - Équipe Robotique, Action et Perception
LAAS - Laboratoire d'analyse et d'architecture des systèmes [Toulouse]
Abstract : Obstacle detection, localization and occupancy map reconstruction are essential abilities for a mobile robot to navigate in an environment. Solutions based on passive monocular vision such as Simultaneous Localization And Mapping (SLAM) or Optical Flow (OF) require intensive computation. Systems based on these methods often rely on over-sized computation resources to meet real-time constraints. Inverse Perspective Mapping allows for obstacles detection at a low computational cost under the hypothesis of a flat ground observed during motion. It is thus possible to build an occupancy grid map by integrating obstacle detection over the course of the sensor. In this work we propose hardware/software system for obstacle detection, localization and 2D occupancy map reconstruction in real-time. The proposed system uses a FPGA-based design for vision and proprioceptive sensors for localization. Fusing this information allows for the construction of a simple environment model of the sensor surrounding. The resulting architecture is a low-cost, low-latency, high-throughput and low-power system.
Document type :
Robotics [cs.RO]. Université de Toulouse III, 2016. English
Liste complète des métadonnées
Contributor : Arlette Evrard <>
Submitted on : Monday, March 6, 2017 - 1:52:25 PM
Last modification on : Thursday, January 11, 2018 - 6:26:29 AM
Document(s) archivé(s) le : Wednesday, June 7, 2017 - 2:02:28 PM


  • HAL Id : tel-01483746, version 1


Ali Alhamwi. Co-design Hardware/Software of Real time Vision System on FPGA for Obstacle Detection. Robotics [cs.RO]. Université de Toulouse III, 2016. English. 〈tel-01483746〉



Record views


Files downloads