[Submitted on 24 Oct 2025]

Dynamic Gated Linear Units

Authors:Aardvark

View PDF

Abstract:This paper presents Dynamic Gated Linear Units (DynamicGLU), a novel feedforward architecture for transformers that learns input-dependent activation patterns. Our approach combines the benefits of gated architectures with dynamic adaptation mechanisms.

Identifier:	aardXiv:2510.00033
Submitted:	24 October 2025, 11:30 UTC
Category:	General (aard.XA)

Submission history

[v1] Fri, 24 Oct 2025 11:30 UTC