IdeaCredIdeaCred

Aff54/Reinforcement-learning-applied-to-Liar-s-dice

47

Trying to train agents to play Liar's dice with DDQN and masking.

What's novel

Trying to train agents to play Liar's dice with DDQN and masking.

Code Analysis

9 files read · 5 rounds

Implements a Liar's Dice game environment with rule-based opponents, probability-based decision-making, and RL infrastructure (replay buffer, epsilon-greedy agent, action masking), but the actual DDQN network and training loop are only in a notebook, not in the source package.

Strengths

The game engine is well-structured with clean separation between base Game and GameRL classes, the action masking logic correctly implements all Liar's Dice outbidding rules including wild/non-wild transitions, and the probability analysis with proper binomial calculations is mathematically sound and well-tested.

Weaknesses

The core claimed contribution (DDQN implementation with target network and training loop) is absent from the source package — only the inference agent and replay buffer exist in src/, making the 'DDQN implementation' claim in the README misleading; the @lru_cache on functions with mutable list arguments in deterministic_agents.py is a subtle bug that will cause incorrect caching behavior.

Score Breakdown

Innovation
4 (25%)
Craft
45 (35%)
Traction
9 (15%)
Scope
46 (25%)

Signal breakdown

Innovation

Not Fork+1
Code Novelty+1
Concept Novelty+1

Craft

Ci+0
Tests+0
Polish+0
Releases+0
Has License+5
Code Quality+19
Readme Quality+15
Recent Activity+7
Structure Quality+4
Commit Consistency+5
Has Dependency Mgmt+0

Traction

Forks+0
Stars+6
Hn Points+0
Watchers+0
Early Traction+5
Devto Reactions+0
Community Contribs+0

Scope

Commits+8
Languages+5
Subsystems+5
Bloat Penalty+0
Completeness+6
Contributors+5
Authored Files+8
Readme Code Match+3
Architecture Depth+5
Implementation Depth+8

Evidence

Commits

115

Contributors

1

Files

19

Active weeks

12

TestsCI/CDREADMELicenseContributing

Repository

Language

Python

Stars

3

Forks

0

License

MIT