[Submitted on 1 Nov 2025]
xSiLU: Expanded Gating Ranges
View PDFAbstract:We investigate expanding SiLU activation gating ranges in transformers.
Submission history
[v1] Sat, 1 Nov 2025 00:19 UTC
Abstract:We investigate expanding SiLU activation gating ranges in transformers.
| Identifier: | aardXiv:2511.00001 |
| Submitted: | 1 November 2025, 00:19 UTC |
| Category: | General (aard.XA) |
[v1] Sat, 1 Nov 2025 00:19 UTC