โšก QJev-1.5B: Qwen2.5-1.5B JEV Decision Model

High-Speed System 1 Real-Time Decision Engine (~31 ms Forward Pass)

Hugging Face GitHub JevBench License


๐Ÿ“ฆ QJev Model Family (Choose Your Format):


๐Ÿ’ก Overview: System 1 Decision Paradigm

Traditional LLMs make decisions through slow, non-deterministic token-by-token generation (e.g. generating "Option A" over 300โ€“600 ms).

QJev-1.5B introduces a System 1 Decision Architecture:

  1. Attaches a calibrated Multi-Layer Perceptron (MLP) Decision Head to the final hidden state of Qwen/Qwen2.5-1.5B-Instruct.
  2. Jointly trains attention projection layers (q_proj, k_proj, v_proj, o_proj) via QLoRA and the decision head across all 655,806 distillation samples from SargeDev/jev-distill-corpus-v3.
  3. Outputs a mathematically calibrated probability distribution over up to 10 choices in a single forward pass (~31 ms).

โš–๏ธ JEV Ecosystem Comparison

Model Parameters Target Hardware Decision Latency Choice Flexibility JevBench Score OOD Accuracy Memory Required
SargeDev/jev-gate-student-b 0.49B Edge / CPU ~23 ms Binary Only (2 choices) ~50.2% ~64.5% ~1.5 GB
QJev-1.5B (Ours) 1.54B Any 8GB Laptop / GPU 31.49 ms (~32 dec/s) Arbitrary Choices ($\le 10$) 71.50% 80.07% ~3.4 GB
autotrust/JEV-9B 9.0B 24GB Server GPU ~45 โ€“ 90 ms Arbitrary Choices ($\le 16$) ~72.0% ~83.5% ~18.5 GB
autotrust/JEV-27B 27.0B Datacenter (A100) ~150 โ€“ 350 ms Arbitrary Choices ($\le 16$) ~76.5% ~86.2% ~55.0 GB
TypeSafe Jev 1.13 (Teacher) ~30B+ Cloud API ~200 ms+ Arbitrary Choices ~72.1% ~88.0% Closed API

๐Ÿ† Official JevBench Metamorphic Benchmark Results

Evaluated against the official JevBench test harness (jevbench-mini, 240 real-world decision cases, 50 scored metamorphic relations):

JevBench Metamorphic Dimension Phase 1 (Frozen Base Baseline) Phase 2 (Our Fine-Tuned Model) Delta / Gain Practical Meaning
BAT.isolation 100.0% 100.0% 0.0% Predictions are completely independent of batching
REP.invariance 79.2% 87.5% +8.3% Immune to choice shuffling and prompt reordering
REP.type 64.6% 85.4% +20.8% Strict adherence to output probability typing
LOG.monotonicity 63.9% 76.4% +12.5% Supportive evidence strictly increases probability
CHO.conditioning 34.7% 70.8% +36.1% Removing irrelevant choices preserves odds ratios
REP.binding 63.9% 73.6% +9.7% Strict semantic criteria binding
REP.equivariance 36.1% 70.8% +34.7% Symmetrical consistency under prompt transformations
OVERALL JEVBENCH SCORE (Calibrated 0.10) 60.2% [57โ€“63] 71.5% [69โ€“74] +11.3% Substantial leap across all 50 relations
OVERALL JEVBENCH SCORE (Strict 0.05) 48.8% [47โ€“51] 58.6% [56โ€“61] +9.8% Strict zero-variance compliance

๐Ÿš€ Quickstart: Super Friendly 3-Line Decision

from qjev import QJev

# 1. Load in 1 line:
model = QJev.from_pretrained("devankit7873/QJev-1.5B")

# 2. Decide in 31 ms!
result = model.decide(
    context="Production database primary replica CPU spiked to 100% and connection pool is exhausted.",
    choices=[
        "Trigger immediate automated failover to standby replica",
        "Restart the primary database daemon immediately",
        "Double connection pool limits without scaling compute",
        "Silence alerts and monitor for next 15 minutes"
    ]
)

print(f"๐Ÿ‘‰ Recommended: {result['best_choice']} ({result['confidence']}%)")
for choice, prob in result['probabilities'].items():
    print(f"  [{prob:>5.2f}%]  {choice}")

๐Ÿ’ป Hardware & Training Infrastructure

Trained from scratch locally on consumer silicon:

  • Host System: HP OMEN Gaming Laptop (Windows 11 Pro 64-bit)
  • GPU: NVIDIA GeForce RTX 5060 Laptop GPU (8GB VRAM)
  • CUDA / Driver: CUDA 12.8 / Driver 621.24 (CUDA UMD 13.5)
  • Framework: PyTorch 2.12.0.dev20260408+cu128, transformers 5.22.0, peft 0.21.2
  • VRAM Footprint: Strictly pegged at 5.90 GB / 8.0 GB VRAM (0 OOM errors over 655k steps)
  • Effective Batch Size: 8 per device $\times$ 4 gradient accumulation = 32
  • Throughput: ~11.5โ€“12.0 samples/sec (total ~18.5 GPU compute hours)

๐Ÿ“š Citation

@misc{nayak2026qjev15b,
  author = {Ankit Nayak},
  title = {QJev-1.5B: High-Speed System 1 JEV Decision Model based on Qwen2.5},
  year = {2026},
  publisher = {GitHub and Hugging Face},
  howpublished = {\url{https://github.com/AnkitNayak-dev/QJev-1.5B}}
}

๐Ÿ“„ License

Released under the Apache 2.0 License. Base weights governed by Alibaba Cloud Qwen License. Distillation corpus by SargeDev (jev-distill-corpus-v3).

Downloads last month
2
Safetensors
Model size
2B params
Tensor type
BF16
ยท
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Model tree for devankit7873/QJev-1.5B

Finetuned
(2,157)
this model
Adapters
1 model
Quantizations
1 model

Dataset used to train devankit7873/QJev-1.5B