wesleyscholl/drex
🦀 The transformer is a brilliant hack scaled past its limits. DREX is what comes next — tiered memory 🧠, sparse execution ⚡, and a learned controller that knows what to remember 💾✨
What's novel
🦀 The transformer is a brilliant hack scaled past its limits. DREX is what comes next — tiered memory 🧠, sparse execution ⚡, and a learned controller that knows what to remember 💾✨
Code Analysis
1 files read · 5 roundsA claimed transformer architecture with four-tier memory hierarchy that appears to be mostly documentation and experiment tracking without accessible implementation code
Strengths
Ambitious architectural design with clear theoretical contributions (episodic/semantic split associative memory, length-adaptive EMA). The project structure shows thoughtful organization separating Python model logic from Rust systems layer.
Weaknesses
Cannot verify actual implementation quality due to inaccessible source files. Claims of 247+ experiments and advanced algorithms cannot be substantiated without reading the code. Heavy reliance on documentation over accessible implementation.
Score Breakdown
Signal breakdown
Innovation
Craft
Traction
Scope
Evidence
Commits
47
Contributors
1
Files
1366
Active weeks
2
Repository
Language
Python
Stars
1
Forks
0
License
MIT