ogrisel, MotherNet: A Foundational Hypernetwork for Tabular Classification
by Andreas Müller, Carlo Curino, Raghu Ramakrishnan
https://arxiv.org/abs/2312.08598Crazy paper that introduces a meta trained transformer that can perform In-context Learning of the weights of small MLPs from numerical tabular training sets passed to the 'prompt' of the big transformer.
A kind of TabPFN but with very fast inference.
Add comment