BestOf: an online implementation selector for the training and inference of deep neural networks
![Thumbnail](/xmlui/bitstream/handle/10234/198110/barrachina_2022_bestOf.pdf.jpg?sequence=4&isAllowed=y)
View/ Open
Impact
![Google Scholar](/xmlui/themes/Mirage2/images/uji/logo_google.png)
![Microsoft Academico](/xmlui/themes/Mirage2/images/uji/logo_microsoft.png)
Metadata
Show full item recordcomunitat-uji-handle:10234/9
comunitat-uji-handle2:10234/7036
comunitat-uji-handle3:10234/8620
comunitat-uji-handle4:
INVESTIGACIONMetadata
Title
BestOf: an online implementation selector for the training and inference of deep neural networksDate
2022-05-20Publisher
SpringerISSN
0920-8542; 1573-0484Bibliographic citation
Barrachina, S., Castelló, A., Dolz, M.F. et al. BestOf: an online implementation selector for the training and inference of deep neural networks. J Supercomput (2022). https://doi.org/10.1007/s11227-022-04577-2Type
info:eu-repo/semantics/articleVersion
info:eu-repo/semantics/publishedVersionSubject
Abstract
Tuning and optimising the operations executed in deep learning frameworks is a fundamental task in accelerating the processing of deep neural networks (DNNs). However, this optimisation usually requires extensive ... [+]
Tuning and optimising the operations executed in deep learning frameworks is a fundamental task in accelerating the processing of deep neural networks (DNNs). However, this optimisation usually requires extensive manual efforts in order to obtain the best performance for each combination of tensor input size, layer type, and hardware platform. In this work, we present BestOf, a novel online auto-tuner that optimises the training and inference phases of DNNs. BestOf automatically selects at run time, and among the provided alternatives, the best performing implementation in each layer according to gathered profiling data. The evaluation of BestOf is performed on multi-core architectures for different DNNs using PyDTNN, a lightweight library for distributed training and inference. The experimental results reveal that the BestOf auto-tuner delivers the same or higher performance than that achieved using a static selection approach. [-]
Funder Name
Generalitat Valenciana | Ministerio de Ciencia e Innovación
Project code
PID2020-113656RB-C21/C22 | CDEIGENT/2018/014 | FJC2019-039222-I
Rights
© The Author(s) 2022
info:eu-repo/semantics/openAccess
info:eu-repo/semantics/openAccess
This item appears in the folowing collection(s)
- ICC_Articles [424]