https://mbrenndoerfer.com/writing/gated-linear-units-swiglu-transformer-ffn/gated-linear-units2025-06-14T00:00:00.000Zhttps://mbrenndoerfer.com/writing/gated-linear-units-swiglu-transformer-ffn/the-gating-mechanism2025-06-14T00:00:00.000Zhttps://mbrenndoerfer.com/writing/gated-linear-units-swiglu-transformer-ffn/the-glu-formulation2025-06-14T00:00:00.000Zhttps://mbrenndoerfer.com/writing/gated-linear-units-swiglu-transformer-ffn/glu-in-the-feed-forward-network2025-06-14T00:00:00.000Zhttps://mbrenndoerfer.com/writing/gated-linear-units-swiglu-transformer-ffn/swiglu-the-modern-standard2025-06-14T00:00:00.000Zhttps://mbrenndoerfer.com/writing/gated-linear-units-swiglu-transformer-ffn/geglu-the-gelu-variant2025-06-14T00:00:00.000Zhttps://mbrenndoerfer.com/writing/gated-linear-units-swiglu-transformer-ffn/parameter-efficiency-analysis2025-06-14T00:00:00.000Zhttps://mbrenndoerfer.com/writing/gated-linear-units-swiglu-transformer-ffn/hidden-dimension-choices-in-practice2025-06-14T00:00:00.000Zhttps://mbrenndoerfer.com/writing/gated-linear-units-swiglu-transformer-ffn/visualizing-glu-representations2025-06-14T00:00:00.000Zhttps://mbrenndoerfer.com/writing/gated-linear-units-swiglu-transformer-ffn/a-complete-worked-example2025-06-14T00:00:00.000Zhttps://mbrenndoerfer.com/writing/gated-linear-units-swiglu-transformer-ffn/implementation-a-complete-swiglu-module2025-06-14T00:00:00.000Zhttps://mbrenndoerfer.com/writing/gated-linear-units-swiglu-transformer-ffn/glu-in-modern-architectures2025-06-14T00:00:00.000Zhttps://mbrenndoerfer.com/writing/gated-linear-units-swiglu-transformer-ffn/limitations-and-impact2025-06-14T00:00:00.000Zhttps://mbrenndoerfer.com/writing/gated-linear-units-swiglu-transformer-ffn/summary2025-06-14T00:00:00.000Zhttps://mbrenndoerfer.com/writing/gated-linear-units-swiglu-transformer-ffn/key-parameters2025-06-14T00:00:00.000Zhttps://mbrenndoerfer.com/writing/gated-linear-units-swiglu-transformer-ffn/quiz2025-06-14T00:00:00.000Z