IdeaCredIdeaCred

Fabbernat/Thesis

59

My Bachelor's Thesis: Reviewing the Consistency of Semantical Capabilities of Large Language Models. For documentation see [https://github.com/Fabbernat/Thesis-paper]

What's novel

My Bachelor's Thesis: Reviewing the Consistency of Semantical Capabilities of Large Language Models. For documentation see [https://github.com/Fabbernat/Thesis-paper]

Code Analysis

0 files read · 5 rounds

A Python framework intended to evaluate Large Language Models on the Word-in-Context (WiC) benchmark using a three-stage pipeline (prompt preparation, inference, result processing), but the core implementation logic is inaccessible for review.

Strengths

The project has a well-defined structure with clear separation between data loading, model inference, and result processing modules. The README accurately describes the intended workflow and supported models.

Weaknesses

Unable to verify code quality due to inaccessible source files; no tests found in the accessible file tree; reliance on external Hugging Face libraries without visible custom logic suggests a wrapper-heavy implementation rather than novel algorithms.

Score Breakdown

Innovation
4 (25%)
Craft
47 (35%)
Traction
11 (15%)
Scope
68 (25%)

Signal breakdown

Innovation

Not Fork+1
Code Novelty+1
Concept Novelty+1

Craft

Ci-3
Tests+3
Polish+0
Releases-1
Has License+0
Code Quality+11
Readme Quality+15
Recent Activity+7
Structure Quality+5
Commit Consistency+5
Has Dependency Mgmt+5

Traction

Forks+0
Stars+6
Hn Points+0
Watchers+3
Early Traction+0
Devto Reactions+0
Community Contribs+2

Scope

Commits+8
Languages+3
Subsystems+10
Bloat Penalty+0
Completeness+6
Contributors+7
Authored Files+15
Readme Code Match+3
Architecture Depth+7
Implementation Depth+8

Evidence

Commits

476

Contributors

3

Files

210

Active weeks

43

TestsCI/CDREADMELicenseContributing

Repository

Language

Python

Stars

1

Forks

0

License