Inference Optimization

community

AI & ML interests

None defined yet.

Recent Activity

kylesayrs updated a model 1 day ago

inference-optimization/Qwen3-1.6B-A0.9B-FP8-REAP-15-uniform

kylesayrs published a model 1 day ago

inference-optimization/Qwen3-1.6B-A0.9B-FP8-REAP-15-uniform

kylesayrs updated a model 1 day ago

inference-optimization/Qwen3-1.6B-A0.9B-FP8-REAP-15-nonuniform

View all activity

inference-optimization 's models 482

inference-optimization/Qwen3-8B-speculator.dflash.swa.dpace.fullvocab.muon.1536anc.codemultilang.v3-v7-ckpt18

2B • Updated Aug 17 • 22

inference-optimization/Qwen3-8B-speculator.dflash.swa.dpace.fullvocab.muon.1536anc.codemultilang.v3-v7-ckpt19

2B • Updated Aug 17 • 22

inference-optimization/Qwen3-8B-speculator.dflash.swa.dpace.fullvocab.muon.2048anc.combdatav3-q235b-instr-v9-ckpt19

2B • Updated Aug 16 • 597

inference-optimization/Qwen3-8B-speculator.dflash.swa.dpace.fullvocab.muon.2048anc.combdatav3-q235b-instr-v9-ckpt18

2B • Updated Aug 16 • 26

inference-optimization/Qwen3-8B-speculator.dflash.swa.dpace.fullvocab.muon.2048anc.combdatav3-q235b-instr-v9-ckpt17

2B • Updated Aug 16 • 25

inference-optimization/Qwen3-8B-speculator.dflash.swa.dpace.fullvocab.muon.2048anc.combdatav3-q235b-instr-v9-ckpt16

2B • Updated Aug 16 • 584

inference-optimization/Qwen3-8B-speculator.dflash.swa.dpace.fullvocab.muon.2048anc.combdatav3-q235b-instr-v9-ckpt15

2B • Updated Aug 15 • 24

inference-optimization/Qwen3-8B-speculator.dflash.swa.dpace.fullvocab.muon.2048anc.combdatav3-q235b-instr-v9-ckpt14

2B • Updated Aug 15 • 25

inference-optimization/Qwen3-8B-speculator.dflash.swa.dpace.fullvocab.muon.2048anc.combdatav3-q235b-instr-v9-ckpt13

2B • Updated Aug 15 • 25

inference-optimization/Qwen3-8B-speculator.dflash.swa.dpace.fullvocab.muon.2048anc.combdatav3-q235b-instr-v9-ckpt12

2B • Updated Aug 15 • 368

inference-optimization/Qwen3-8B-speculator.dflash.swa.dpace.fullvocab.muon.2048anc.combdatav3-q235b-instr-v9-ckpt11

2B • Updated Aug 14 • 23

inference-optimization/DeepSeek-R1-Distill-Llama-8B-NVFP4

Text Generation • 5B • Updated Aug 14 • 42

inference-optimization/Qwen3-8B-speculator.dflash.swa.dpace.fullvocab.muon.2048anc.combdatav3-q235b-instr-v9-ckpt10

2B • Updated Aug 14 • 24

inference-optimization/Qwen3-8B-speculator.dflash.swa.dpace.fullvocab.muon.2048anc.combdatav3-q235b-instr-v8-ckpt9

2B • Updated Aug 13 • 24

inference-optimization/Qwen3-8B-speculator.dflash.swa.dpace.fullvocab.muon.2048anc.combdatav3-q235b-instr-v8-ckpt8

2B • Updated Aug 13 • 25

inference-optimization/Qwen3-8B-speculator.dflash.swa.dpace.fullvocab.muon.2048anc.combdatav3-q235b-instr-v8-ckpt7

2B • Updated Aug 13 • 24

inference-optimization/Qwen3-8B-speculator.dflash.swa.dpace.fullvocab.muon.2048anc.combdatav3-q235b-instr-v8-ckpt6

2B • Updated Aug 13 • 23

inference-optimization/Qwen3-8B-speculator.dflash.swa.dpace.fullvocab.muon.2048anc.combdatav3-q235b-instr-v8-ckpt5

2B • Updated Aug 12 • 25

inference-optimization/Qwen3.8-1.0B-A0.6B-NVFP4-FP8

1.0B • Updated Aug 12 • 15 • 1

inference-optimization/Qwen3-8B-speculator.dflash.swa.dpace.fullvocab.muon.2048anc.combdatav3-q235b-instr-v8-ckpt4

2B • Updated Aug 12 • 22

inference-optimization/Qwen3.8-1.0B-A0.6B

Text Generation • 1.0B • Updated Aug 12 • 3.85k • 6

inference-optimization/Qwen3-VL-Reranker-0.1B-tiny

98.7M • Updated Aug 12 • 891

inference-optimization/granite-vision-4.1-0.2B-tiny

0.2B • Updated Aug 12 • 873

inference-optimization/gemma-4-unified-0.8B-tiny

0.8B • Updated Aug 12 • 889

inference-optimization/Qwen3-8B-speculator.dflash.swa.dpace.fullvocab.muon.2048anc.combdatav3-q235b-instr-v8-ckpt3

2B • Updated Aug 12 • 25

inference-optimization/Qwen3-8B-speculator.dflash.swa.dpace.fullvocab.muon.2048anc.combdatav3-q235b-instr-v8-ckpt2

2B • Updated Aug 12 • 25

inference-optimization/Qwen3-8B-speculator.dflash.swa.dpace.fullvocab.muon.2048anc.combdatav3-q235b-instr-v8-ckpt1

2B • Updated Aug 12 • 23

inference-optimization/Qwen3-8B-speculator.dflash.swa.dpace.fullvocab.muon.2048anc.combdatav3-q235b-instr-v8-ckpt0

2B • Updated Aug 11 • 25

inference-optimization/tinysmokeqwen3-fp8-kv-only

2.64M • Updated Aug 11 • 8

inference-optimization/Qwen3-8B-speculator.dflash.swa.dpace.fullvocab.muon.1536anc.codemultilang.v2-v5-ckpt0

2B • Updated Aug 10 • 25