g-lago8/RNN-JAX
Recurrent neural networks (RNNs) in JAX and Equinox
What's novel
Recurrent neural networks (RNNs) in JAX and Equinox
Code Analysis
17 files read · 4 roundsA JAX/Equinox library implementing 10+ RNN cell types (Elman, LSTM, GRU, Unitary, Antisymmetric, Lipschitz, Clockwork, Oscillator, IndRNN), state space models (S5, LRU), reservoir computing (ESN), and bidirectional/deep RNN layers, all built on jax.lax.scan and associative_scan for efficient sequenc
Strengths
Genuine algorithmic implementations of non-trivial architectures (Clockwork periodic masking, Unitary RNN with Householder reflectors, S5 with NPLR decomposition, Lipschitz RNN with RK2 discretization) rather than thin wrappers, combined with a clean cell→encoder→layer hierarchy and comprehensive test coverage of every cell type.
Weaknesses
Several copy-paste bugs in core logic (GRU uses wrong weight matrix, coRNN heterogeneous eps initialized with gamma bounds, DeepBidirectionalRNN duplicate assert), plus code hygiene issues like sys.path hacks, global JAX config side effects, and placeholder docstrings that undermine the otherwise solid architecture.
Score Breakdown
Signal breakdown
Innovation
Craft
Traction
Scope
Evidence
Commits
101
Contributors
1
Files
53
Active weeks
12
Repository
Language
Python
Stars
1
Forks
0
License
MIT