DeepTLF: robust deep neural networks for heterogeneous tabular data

Vadim Borisov, Klaus Broelemann, Enkelejda Kasneci, Gjergji Kasneci

Publikation: Beitrag in FachzeitschriftArtikelBegutachtung

10 Zitate (Scopus)

Abstract

Although deep neural networks (DNNs) constitute the state of the art in many tasks based on visual, audio, or text data, their performance on heterogeneous, tabular data is typically inferior to that of decision tree ensembles. To bridge the gap between the difficulty of DNNs to handle tabular data and leverage the flexibility of deep learning under input heterogeneity, we propose DeepTLF, a framework for deep tabular learning. The core idea of our method is to transform the heterogeneous input data into homogeneous data to boost the performance of DNNs considerably. For the transformation step, we develop a novel knowledge distillations approach, TreeDrivenEncoder, which exploits the structure of decision trees trained on the available heterogeneous data to map the original input vectors onto homogeneous vectors that a DNN can use to improve the predictive performance. Within the proposed framework, we also address the issue of the multimodal learning, since it is challenging to apply decision tree ensemble methods when other data modalities are present. Through extensive and challenging experiments on various real-world datasets, we demonstrate that the DeepTLF pipeline leads to higher predictive performance. On average, our framework shows 19.6% performance improvement in comparison to DNNs. The DeepTLF code is publicly available.

OriginalspracheEnglisch
Seiten (von - bis)85-100
Seitenumfang16
FachzeitschriftInternational Journal of Data Science and Analytics
Jahrgang16
Ausgabenummer1
DOIs
PublikationsstatusVeröffentlicht - Juni 2023
Extern publiziertJa

Fingerprint

Untersuchen Sie die Forschungsthemen von „DeepTLF: robust deep neural networks for heterogeneous tabular data“. Zusammen bilden sie einen einzigartigen Fingerprint.

Dieses zitieren