IdeaCredIdeaCred

JunZheCheng-ctrl/Transformer-IDS

23

Transformer-based Intrusion Detection System with Cross-Dataset Evaluation

What's novel

Transformer-based Intrusion Detection System with Cross-Dataset Evaluation

Code Analysis

15 files read · 4 rounds

A collection of ad-hoc PyTorch training scripts for binary intrusion detection using a TabTransformer-style model, with cross-dataset evaluation via naive feature truncation, but the repository is structurally broken with compiled bytecode files, misnamed files, and a PNG saved as a .py file.

Strengths

The TabTransformer model implementation (FeatureGate + per-feature token embedding + TransformerEncoder + temperature scaling) is a reasonable architecture for tabular data, and the experiment scripts do cover multiple evaluation scenarios (within-dataset, transfer, imbalance, depth ablation).

Weaknesses

The repository is fundamentally non-functional: the core model class is in the wrong file, multiple .py files are actually compiled bytecode or PNG images, imports reference non-existent module paths, file names are misleading (imbalance experiment called 'cross_dataset', feature importance called 'loss_balanced'), and there are zero tests. The README describes a clean directory structure and 'AUC-oriented optimization' that don't match the actual code.

Score Breakdown

Innovation
5 (25%)
Craft
16 (35%)
Traction
4 (15%)
Scope
21 (25%)

Signal breakdown

Innovation

Not Fork+1
Code Novelty+0
Concept Novelty+2

Craft

Ci+0
Tests+0
Polish+0
Releases+0
Has License+0
Code Quality+5
Readme Quality+15
Recent Activity+7
Structure Quality+2
Commit Consistency+0
Has Dependency Mgmt+0

Traction

Forks+0
Stars+6
Hn Points+0
Watchers+0
Early Traction+0
Devto Reactions+0
Community Contribs+0

Scope

Commits+7
Languages+3
Subsystems+5
Bloat Penalty+0
Completeness+5
Contributors+5
Authored Files+12
Readme Code Match+3
Architecture Depth+0
Implementation Depth+8

Evidence

Commits

20

Contributors

1

Files

39

Active weeks

2

TestsCI/CDREADMELicenseContributing

Repository

Language

Python

Stars

1

Forks

0

License