Huggingface.js documentation
Interface: MlxQuantizationConfig
Interface: MlxQuantizationConfig
Hierarchy
-
↳
MlxQuantizationConfig
Indexable
▪ [key: string]: unknown
Properties
bits
• Optional bits: number
Inherited from
Defined in
packages/hub/src/lib/parse-safetensors-metadata.ts:821
config _ groups
• Optional config_groups: Record<string, { format?: string ; targets?: string[] ; weights?: { num_bits?: number } }>
Inherited from
QuantizationConfig.config_groups
Defined in
packages/hub/src/lib/parse-safetensors-metadata.ts:826
expert _ dtype
• Optional expert_dtype: string
Routed expert precision when it differs from the main quantizer (e.g. FP4 experts with FP8 attention).
Inherited from
QuantizationConfig.expert_dtype
Defined in
packages/hub/src/lib/parse-safetensors-metadata.ts:811
format
• Optional format: string
Inherited from
Defined in
packages/hub/src/lib/parse-safetensors-metadata.ts:825
group _ size
• Optional group_size: number
Inherited from
Defined in
packages/hub/src/lib/parse-safetensors-metadata.ts:819
ignore
• Optional ignore: string[]
compressed-tensors names its exclusion list ignore rather than modules_to_not_convert,
using the same re:-prefixed target syntax as config_groups[].targets.
Inherited from
Defined in
packages/hub/src/lib/parse-safetensors-metadata.ts:831
load _ in _ 4bit
• Optional load_in_4bit: boolean
Inherited from
QuantizationConfig.load_in_4bit
Defined in
packages/hub/src/lib/parse-safetensors-metadata.ts:822
load _ in _ 8bit
• Optional load_in_8bit: boolean
Inherited from
QuantizationConfig.load_in_8bit
Defined in
packages/hub/src/lib/parse-safetensors-metadata.ts:823
mode
• Optional mode: string
MLX quantization mode (e.g. affine); MLX configs do not declare quant_method.
Inherited from
Defined in
packages/hub/src/lib/parse-safetensors-metadata.ts:818
modules _ to _ not _ convert
• Optional modules_to_not_convert: string[]
Inherited from
QuantizationConfig.modules_to_not_convert
Defined in
packages/hub/src/lib/parse-safetensors-metadata.ts:820
quant _ method
• Optional quant_method: string
Inherited from
QuantizationConfig.quant_method
Defined in
packages/hub/src/lib/parse-safetensors-metadata.ts:809
store _ dtype
• Optional store_dtype: string
Same role as expert_dtype under another name: MiMo-V2.6 is quant_method: "fp8" for its
dense layers but stores the routed experts as store_dtype: "mxfp4", packed two per U8.
Inherited from
QuantizationConfig.store_dtype
Defined in
packages/hub/src/lib/parse-safetensors-metadata.ts:816
Update on GitHub