[Submitted on 30 Oct 2025]
PolyGatedFFN Experimental Results
View PDFAbstract:Polynomial-gated feedforward networks achieved 4.957 loss vs 4.9266 SwiGLU baseline.
Submission history
[v1] Thu, 30 Oct 2025 19:31 UTC
Abstract:Polynomial-gated feedforward networks achieved 4.957 loss vs 4.9266 SwiGLU baseline.
| Identifier: | aardXiv:2510.00100 |
| Submitted: | 30 October 2025, 19:31 UTC |
| Category: | General (aard.XA) |
[v1] Thu, 30 Oct 2025 19:31 UTC