Kloia Assessment Framework • 4.0
Nine Disciplines, Scored One at a Time
KAF is the framework our consultants run in every engagement,
scoring your engineering organisation across nine disciplines to give you
a maturity level, the gaps behind it, and a roadmap to close them.
Each pillar carries 10 weighted categories
scoring to 100 points.
9
Pillars
90
Categories
578
Criteria
L1- L5
Maturity Levels
Nine Disciplines, Scored One at a Time
Build AI Into Your Delivery
01 · Criteria are checked
Each category holds four to nine yes/no criteria, reviewed against evidence rather than opinion.
02 · A scoring band is assigned
Four bands per category describe practice as it actually is, from absent to fully implemented. The band sets the points.
03 · Points roll up to the pillar
Ten weighted categories total 100 points, which maps to one of five maturity levels. Weights differ by pillar, so scores are comparable across teams and over time.
APM & Distributed Tracing
12 pts- Is an APM solution deployed?
- Is distributed tracing capability active?
- Are all services traceable?
- Can transaction flows be visualized end-to-end?
- Are performance bottlenecks easily identified?
How We Run an Assessment
Our engagement follows AWS Migration Acceleration Program phases, extended with modernization sprints.
01 • Scope
Pick
The Pillars
We agree which disciplines are in scope and which teams and systems each one covers.
02 • Workshop
Walk
The Criteria
Half a day per pillar with the engineers who own the systems, going through criteria one by one.
03 • Score
Band
With Evidence
Every category gets a band and a note on what backs it. Nothing is scored without a reference.
04 • Gaps
Order
What Is Missing
Unmet criteria are ranked by the points they carry and the effort they take.
05 • Roadmap
Plan And
Re-Assess
A sequenced plan for the next two to four quarters, re-scored after delivery to measure movement.
What You Get
Maturity Scorecard
A score out of 100 and a level L1–L5 for every pillar in scope, on one page.
Category Breakdown
All 90 categories with the band assigned, the evidence, and the points lost.
Prioritised Gap List
Unmet criteria ranked by score impact against implementation effort.
Roadmap And Baseline
A sequenced improvement plan, plus the frozen baseline to re-assess against.
Try a Short Version Yourself
DevOps
Pipeline, delivery and release practice.
Go to QA Assessment Page →
AI Maturity
Readiness, data and governance for AI work.
Go to AI Assessment Page →
Start With One Pillar And a Workshop
Tell us which discipline is under pressure. We will run the assessment for it and come back with the score, the gaps and the plan.
FAQ
Who is KAF built for?
Engineering leaders, mainly VPs of Engineering, CTOs and Heads of Platform, who need a defensible answer to how mature their organisation is, not a gut-feel opinion.
How long does an assessment take?
A single pillar workshop typically runs one to two weeks from kickoff to scored report. A full nine-pillar engagement usually takes four to six weeks, depending on team availability.
Do we have to assess all nine pillars at once?
No. Most engagements start with one or two pillars under the most pressure, such as Observability or Security, and expand from there once the format proves useful.
What's the difference between the self-assessment and a full engagement?
The self-assessment gives your team a quick, internal directional score. A full engagement is run by our consultants, includes interviews with the teams who own the systems, and produces a validated score plus a prioritised roadmap.
Who from our side needs to be involved?
Typically the engineering leader sponsoring the assessment, plus the tech leads or team owners closest to the pillar in question. Most sessions run 60 to 90 minutes per team.
How is the score calculated?
Each pillar has a fixed set of weighted criteria, reviewed against evidence from the teams who run the systems, not self-reported opinion. Weights are published in the framework spec so the score is reproducible and auditable.
What do we walk away with?
A maturity level per pillar, the specific gaps behind that score, and a roadmap ordered by what will move the number fastest, so the output is something you can act on the same week.