AI Technology & Industry Review
In a new paper KAN: Kolmogorov-Arnold Networks, a research team introduces Kolmogorov-Arnold Networks (KANs) as promising alternatives to MLPs. These networks showcase superior performance in both accuracy and interpretability domains.
Researchers from Meta AI and the State University of New York at Buffalo propose sparsely-activated all-MLP architectures (sMLPs) that achieve training efficiency improvements of up to 2x compared to transformer-based mixture-of-experts (MoE) architectures, transformers, and gMLP.
An Idiap Research Institute team proposes a novel multi-layer perceptron (MLP) model, HyperMixer, as a Green AI alternative to transformers. HyperMixer achieves comparable performance with substantially lower costs in terms of processing time, training data and hyperparameter tuning.
By accurately predicting the category of an email, we can better extract useful information from it according to its corresponding templates.