š¤ Open to Collab
HICHAM ABADOUR
ApyHTML19
P(doom) Rejects the premise
AI & ML interests
Currently, I'm a Software Engineer Student at ENSAO passionate about LLM / Reasearch Articles /System design /AI Infrastructure / Computer vision .
Recent Activity
liked a model about 2 hours ago
Cloudflare/clef reacted to SeaWolf-AI's post with š„ about 2 hours ago
š Darwin-27B-ZTC-v2 just took #1 on the System One Mosaic Benchmark (S1MB).
S1MB compares 102 models across 137 specialized benchmarks, in three task types: Noul (assess a condition), Choice (select an option), Score (rate on a scale). Ranking is by overall Borda score.
š Top of the board
š„ Darwin ZTC v2 (FINAL-Bench) 89.58
š„ OpenJev-27B 87.50
š„ AutoJev-27B 87.07
4ļøā£ Eikos 27B 85.43
5ļøā£ Jev 1.13 85.05
š Ranks 2 to 5 are all the JEV family (TypeSafe AI's System One model, from ex-OpenAI researchers). S1MB exists to compare these System One judges, so leading it is the headline.
āļø Why a zero-token judge wins here
š¹ It does not generate. It reads the input and typed questions and returns a calibrated distribution in a single forward pass.
š¹ Zero generated tokens, no decoding loop, so latency and cost stay low.
š¹ Holds up out of distribution too: General Noul 96.00, General Choice 99.34.
It is also #1 on the typed-decisions leaderboard (0.743, zero-shot). Same message from both: a deterministic, calibrated judge at one forward pass per call.
š Model: https://huggingface.co/FINAL-Bench/Darwin-27B-ZTC-v2
š Leaderboard: https://huggingface.co/spaces/hotchpotch/S1MB-leaderboard
Standings move as new models are added. Numbers reflect the board at the time of writing. š
liked a model 8 days ago
Contrastive-LM/CLM-v0.1-8B