opendatahub-io/models-as-a-service
Model as a Service
What's novel
Model as a Service
Code Analysis
15 files read · 4 roundsA Kubernetes-native Models-as-a-Service platform for OpenShift that provides multi-tenant LLM model access with subscription-based authorization, API key management, rate limiting via Kuadrant, and automatic provisioning of networking resources (Gateway API, Istio) for both internal KServe models an
Strengths
Exceptionally thorough security engineering with explicit CWE mitigations, fail-closed defaults, and defense-in-depth throughout; the reconciliation logic handles complex multi-tenant scenarios with race condition detection, careful cutover between controllers, and idempotent resource management at production scale.
Weaknesses
The codebase is large and some controller files exceed 50-80kb, making individual files harder to navigate; the tight coupling to OpenShift-specific APIs (Kuadrant, Authorino, KServe) limits portability to vanilla Kubernetes despite some fallback logic.
Score Breakdown
Signal breakdown
Innovation
Craft
Traction
Scope
Evidence
Commits
375
Contributors
29
Files
329
Active weeks
32
Repository
Language
Go
Stars
19
Forks
43
License
Apache-2.0