Seeking attention : using full context transformers for better disparity estimation

Abstract

<div lang="en" class="abs"><p class="abs_header">Abstract</p><p>Until recently, convolutional neural networks have dominated various machine vision fields-including stereo disparity estimation-with little to no competition. Vision transformers have shaken up this domination with the introduction of multiple models achieving state of art results in fields such as semantic segmentation and object detection. In this paper, we explore the viability of stereo transformers, which are attention-based models inspired from NLP applications, by designing a transformer-based stereo disparity estimation as well as an end-to-end transformer architectures for both feature extraction and feature matching. Our solution is not limited by a pre-set maximum disparity and manages to achieve state of the art on SceneFlow dataset.</p></div>