Skip to Main content Skip to Navigation
Journal articles

HW/SW co-design of a visual SLAM application

Abstract : Vision-based advanced driver assistance systems (ADAS), appeared in the 2000s, are increasingly integrated on-board mass-produced vehicles, as off-the-shelf low-cost cameras are now available. But ADAS implement most of the time-specific and basic functionalities such as lane departure or control of the distance to other vehicles. Integrating accurate localization and mapping functionalities meeting the constraints of ADAS (high-throughput, low-consumption, and small-design footprint) would pave the way towards obstacle detection, identification and tracking on-board vehicles at potential high speed. While the SLAM problem has been widely addressed by the robotics community, very few embedded operational implementations can be found, and they do not meet the ADAS-related constraints. In this paper, we implement the first 3D monocular EKF-SLAM chain on a heterogeneous architecture, on a single System on Chip (SoC), meeting these constraints. In order to do so, we picked up a standard co-design method (Shaout et al. Specification and modeling of hw/sw co-design for heterogeneous embedded systems, 2009) and adapted it to the implementation of potentially any of such complex processing chains. The refined method encompasses a hardware-in-the-loop approach allowing to progressively integrate hardware accelerators on the basis of a systematic rule. We also have designed original hardware accelerators for all the image processing functions involved, and for some algebraic operations involved in the filtering process.
Complete list of metadata

Cited literature [52 references]  Display  Hide  Download
Contributor : Michel Devy <>
Submitted on : Wednesday, March 6, 2019 - 10:11:23 AM
Last modification on : Thursday, June 10, 2021 - 3:06:57 AM
Long-term archiving on: : Friday, June 7, 2019 - 6:09:58 PM


Files produced by the author(s)



Jonathan Piat, Philippe Fillatreau, Daniel Tortei, François Brenot, Michel Devy. HW/SW co-design of a visual SLAM application. Journal of Real-Time Image Processing, Springer Verlag, 2018, ⟨10.1007/s11554-018-0836-2⟩. ⟨hal-02049364⟩



Record views


Files downloads