ATTENTION/WARNING - NE PAS DÉPOSER ICI/DO NOT SUBMIT HERE

Ceci est la version de TEST de DIAL.mem. Veuillez ne pas soumettre votre mémoire sur ce site mais bien à l'URL suivante: 'https://thesis.dial.uclouvain.be'.
This is the TEST version of DIAL.mem. Please use the following URL to submit your master thesis: 'https://thesis.dial.uclouvain.be'.
 

Information theory and machine learning : information Bottleneck theory applied to classification trees and random forests

De Vroey, Martin
(2023)

Files

DeVroey_79061400_2023.pdf
  • Open access
  • Adobe PDF
  • 1.35 MB
Download

Details

Supervisors
Delvenne, Jean-Charles
Faculty
Ecole polytechnique de Louvain
Degree label
Master [120] : ingénieur civil en mathématiques appliquées, à finalité spécialisée
Abstract
The Information Bottleneck (IB) method has been proposed as a theoretical framework to explain the effectiveness of deep learning. It has since become a widely-studied concept in the field of deep learning. However, research on the application of IB theory to other machine learning algorithms is almost nonexistent. In this work we explore the application of IB theory to decision trees and random forests for classification tasks. After establishing the theoretical background, we show evidence against some of the conclusions of earlier work on IB theory in the case of classification tasks. Further, we present a novel analysis of random forests trough the IB method. Finally we apply the IB method to a nondeterministic classification task.

Citations

  • APA

De Vroey, M. (2023). Information theory and machine learning : information Bottleneck theory applied to classification trees and random forests. https://dial-mem.test.bib.ucl.ac.be/handle/2078.2/31498