Lightweight Instruction Set for Flexible Dilated Convolutions and Mixed-Precision Operands

Simon Friedrich, Shambhavi Balamuthu Sampath, Robert Wittig, Manoj Rohit Vemparala, Nael Fasfous, Emil Matus, Walter Stechele, Gerhard Fettweis

Publikation: Beitrag in Buch/Bericht/KonferenzbandKonferenzbeitragBegutachtung

5 Zitate (Scopus)

Abstract

Modern deep neural networks specialized for object detection and semantic segmentation require specific operations to increase or preserve the resolution of their feature maps. Hence, more generic convolution layers called transposed and dilated convolutions are employed, adding a large number of zeros between the elements of the input features or weights. Usually, standard neural network hardware accelerators process these convolutions in a straightforward manner, without paying attention to the added zeros, resulting in an increased computation time. To cope with this problem, recent works propose to skip the redundant elements with additional hardware or solve the problem efficiently only for a limited range of dilation rates. We present a general approach for accelerating transposed and dilated convolutions that does not introduce any hardware overhead while supporting all dilation rates. To achieve this, we introduce a novel precision-scalable lightweight instruction set and memory scheme that can be applied to the different convolution variants. This results in a speed-up of 5 times in DeepLabV3+ outperforming the recently proposed design methods. The support of precision-scalable execution of all workloads further increases the speedup in computation time shown for the PointPillars, DeepLabV3+, and ENet networks. Compared to the state-of-the-art commercial EdgeTPU, the instruction footprint of ResNet-50 of our designed accelerator is reduced by 60 percent.

OriginalspracheEnglisch
TitelProceedings of the 24th International Symposium on Quality Electronic Design, ISQED 2023
Herausgeber (Verlag)IEEE Computer Society
ISBN (elektronisch)9798350334753
DOIs
PublikationsstatusVeröffentlicht - 2023
Veranstaltung24th International Symposium on Quality Electronic Design, ISQED 2023 - San Francisco, USA/Vereinigte Staaten
Dauer: 5 Apr. 20237 Apr. 2023

Publikationsreihe

NameProceedings - International Symposium on Quality Electronic Design, ISQED
Band2023-April
ISSN (Print)1948-3287
ISSN (elektronisch)1948-3295

Konferenz

Konferenz24th International Symposium on Quality Electronic Design, ISQED 2023
Land/GebietUSA/Vereinigte Staaten
OrtSan Francisco
Zeitraum5/04/237/04/23

Fingerprint

Untersuchen Sie die Forschungsthemen von „Lightweight Instruction Set for Flexible Dilated Convolutions and Mixed-Precision Operands“. Zusammen bilden sie einen einzigartigen Fingerprint.

Dieses zitieren