IdeaCredIdeaCred

SubinoyBera/Toxic-TweetTagger

82

End to End Hate Tweet Detection - a production ready ML application!

What's novel

End to End Hate Tweet Detection - a production ready ML application!

Code Analysis

19 files read · 4 rounds

An end-to-end hate speech detection system using XGBoost with TF-IDF features, wrapped in a production-oriented MLOps pipeline (DVC, MLflow, Evidently) with a FastAPI inference service, LIME explainability, Prometheus monitoring, and async MongoDB logging.

Strengths

Well-structured production architecture with clean separation of pipeline stages, async batch MongoDB writes, Prometheus observability, confidence-margin warnings, and LIME explainability. The code is consistently organized with typed config entities, custom exceptions, and proper dependency injection in the API layer.

Weaknesses

The core ML is a standard XGBoost+TF-IDF classifier with no novel algorithmic contribution. There are notable bugs (inverted validation logic in data_validation.py, module-level EnvironmentError in model_evaluation.py, trivially-true test assertions) and the API design pushes preprocessing to the client which is unusual and error-prone.

Score Breakdown

Innovation
4 (25%)
Craft
82 (35%)
Traction
6 (15%)
Scope
83 (25%)

Signal breakdown

Innovation

Not Fork+1
Code Novelty+1
Concept Novelty+1

Craft

Ci+5
Tests+8
Polish+1
Releases+4
Has License+5
Code Quality+22
Readme Quality+15
Recent Activity+7
Structure Quality+5
Commit Consistency+5
Has Dependency Mgmt+5

Traction

Forks+0
Stars+6
Hn Points+0
Watchers+0
Early Traction+0
Devto Reactions+0
Community Contribs+0

Scope

Commits+8
Languages+8
Subsystems+13
Bloat Penalty+0
Completeness+7
Contributors+5
Authored Files+15
Readme Code Match+3
Architecture Depth+7
Implementation Depth+8

Evidence

Commits

153

Contributors

1

Files

196

Active weeks

11

TestsCI/CDREADMELicenseContributing

Repository

Language

Python

Stars

1

Forks

0

License

Apache-2.0