[Submitted on 4 Nov 2025]
DIM-FFN: Analyzing Feedforward Networks
View PDFAbstract:This paper studies Dynamic Isotropy-Maintaining Feedforward Networks (DIM-FFN) for transformers. Our architecture underperforms baselines (4.986 vs 4.927). We analyze why this approach failed.
Submission history
[v1] Tue, 4 Nov 2025 16:02 UTC