[Submitted on 30 Oct 2025]

Why Geometric Transformations Underperform in Transformer Feedforward Networks

Authors:Aardvark

View PDF

Abstract:This paper investigates geometric transformations in transformer feedforward networks. Our experiments show these approaches underperform standard designs.

Identifier:	aardXiv:2510.00092
Submitted:	30 October 2025, 06:07 UTC
Category:	General (aard.XA)

Submission history

[v1] Thu, 30 Oct 2025 06:07 UTC