AI Indexes
HR AI Index
Index › Products › Codility · September 2026 Edition
3 categories · Ranked

Codility

186Judge labels
10First choices
46Negative labels
12 of 12Models named it
3Categories
September 2026 Edition. Every number here is derived from the raw labels under vendor table vv2026-09.3, every buyer segment counted.
Best standing
19% in Technical hiring assessm for enterprise buyers
Rank 7 of 52 in the mid-market standingcriticized challenger
1 of 12 models made it the first choice on the direct prompt; 32% of its 44 labels there were negative.
What the models named instead of Codility →
By buyer segmentStrongest at enterprise.
In technical hiring assessm · each standing computed within its segment · bars are 0 to 100 · the accent bar is the product's own best reading

Standing by category

Every category where a model named Codility for a mid-market B2B company. Share is first choices across the direct, paraphrase, budget and scale prompts; rank is within every product named in that category.
CategoryFunctionShareRankNegative rateLabelsQuadrant
Technical hiring assessmentsTalent acquisition5%7 of 5232%44criticized challenger
Candidate assessmentTalent acquisition0%13 of 10012%17accepted challenger
Skills intelligencePerformance and talent management0%34 of 1610%4under 10 labels · led by TalentGuard at 19%

Movement

This is the first edition on this tier, so no move can be computed for Codility yet. From the next edition this section shows, per buyer segment and per category, whether its share moved by more than the measured noise floor.

By model

How each model treated Codility across every prompt where it was named for a mid-market B2B company. Twelve models, six prompts per category.
ShowHide
ModelFirst choiceAlternativeMentionNegativeLabels
Claude Haiku 4.500303
GPT-5.4 mini03126
Gemini 3.5 Flash00437
Perplexity Sonar00303
Grok 4.1 Fast03238
Mistral Small10203
DeepSeek V4 Flash04116
Llama 4 Maverick00404
Qwen 3.7 Flash12104
Kimi K222329
GLM 4.7 FlashX01146
MiniMax M2.522116

By framing

Which of the six questions produced the naming. By model says how often; this says asked what. The first-choice count on the right carries the marks of the models that produced it.
FramingLabels by classFirst choices
Direct29 labels4
Paraphrase26 labels1
Comparative59 labels7not counted in share
Budget-constrained20 labels3
Scale-constrained24 labels2
Negative28 labels1not counted in share
First choiceAlternativeMentionNegative186 labels in all, every segment counted; 10 of the 18 first choices count toward share, since the comparative and negative framings do not. The bar is one segment per label class, to scale within the framing.

What the models said for it

Verbatim evidence the judge attached to positive labels.

“Codility (structured, automated grading) or HackerEarth (large question bank, strong analytics).” MiniMax M2.5 · Candidate assessment · comparative prompt · first choice
“Tools like TestDome, Codility (for coders) ... are generally well-regarded when used correctly” Qwen 3.7 Flash · Candidate assessment · negative prompt · first choice
“Codility offers the best balance of capability, reputation, and price” Kimi K2 · Technical hiring assessm · direct prompt · first choice
“Often ranked as the best overall, especially for enterprise use.” Mistral Small · Technical hiring assessm · comparative prompt · first choice

And against it

Verbatim evidence attached to negative labels. A warning on a product with few labels is a warning; on a product with many, it is one voice among them.

“it is often described as "quite pricey" ... Codility has had issues with "test integrity," where questions and answers are not sufficiently hidden from recruiters” GLM 4.7 FlashX · Technical hiring assessm · negative prompt · hard negative
“Opaque scoring: Candidates and reviewers criticize edge-case scoring and lack of transparency” MiniMax M2.5 · Technical hiring assessm · negative prompt · hard negative
“Why we recommend avoiding HackerRank or Codility (for now)” Gemini 3.5 Flash · Technical hiring assessm · paraphrase prompt · hard negative
“like HackerRank or Codility when using generic public questions) are easily solved by modern generative AI models” Gemini 3.5 Flash · Candidate assessment · negative prompt · soft negative

Named alongside

The products named in the same answers as Codility, over the 186 answers that named it. Took the first choice instead counts the answers where the other product was the first choice and Codility was named but was not.
ShowHide
ProductSame answerTook the first choice insteadHead to head
Criteria Corp43 of 1863Not among the top eight
Mercer | Mettl35 of 1862Not among the top eight
iMocha32 of 1863Not among the top eight
HireVue29 of 1863Not among the top eight
Vervoe24 of 1862Not among the top eight
A head-to-head page exists where both products are among a category's top eight. The other rows are the same fact without a page behind them, so they link to the product instead.

What carried it into the answer

The sites and pages cited by the answers that named Codility. A fact about retrieval, not a lever on the model.

Citations exist only for the models that return a source list, four of the twelve in this edition, so these counts come from 157 of the 186 answers that named Codility and are not a share of its labels.

Domains cited

hackerrank.com80
codility.comYour site76
codesignal.com59
testlify.com57
codesubmit.io53
testgorilla.com50
testtrick.com49
selectsoftwarereviews.com48
g2.com46
goodfit.so38

480 of the 556 domain citations in answers naming Codility came from somebody else's page.

Pages cited

Pages are listed as the models cited them.

Names read as Codility

What the judge wrote, as written, with how often. The vendor table decides that these count as Codility; a claim can dispute any of them.
Codility Starter 1

Follow Codility

An email the morning each edition publishes: where this product moved, where it held, and by how much against the noise floor. One address, confirmed by a click; a stop link in every email.

Already following? Everything you follow, with a stop for each.

Is this your product?

Claim this page

Claiming is free and changes nothing in the data. A claimed page shows a verified contact who is told when each edition publishes and when Codility's standing changes by more than the noise floor; the right to propose corrections to the vendor table, meaning names the judge wrote that should or should not read as Codility, applied by version and listed in the change log; and a one-line description supplied by the vendor and marked as such.

With a new claim: the vendor brief

A new claim receives the current edition's vendor brief for Codility by email, built from the raw record of the edition. It shows:

  • where Codility is named, by buyer and by framing, and which cells hold its first choices;
  • the claims the models make when they name it, ranked, with the strongest and the weakest quoted;
  • its vocabulary against the segment leader's, and the pages the models cited;
  • who was chosen in the answers that did not name Codility, and every reason the record gives;
  • a battlecard for each top rival: the head-to-head split, why they win, and the reservation quoted against them;
  • one page of published figures cleared to show a buyer.

It does not get any change to labels, shares or verdicts, any preview, or any say over which quotes appear. A verification link goes to your work email; an address at codility.com is approved on the spot, any other address is reviewed by hand.

Your name and company appear on the claimed page, or the company alone if you ask below. A title and a LinkedIn address appear there too if you give them, and are left off if you do not. Your email address is never published.

Subscribe to the pack