16 Commits
Author SHA1 Message Date
hanzo-dev b6f7ab315e feat(v4): pipeline tools — corpus prep, GGUF embed/head extractor, chunked dump driver 2026-07-02 21:22:16 -07:00
hanzo-dev 0c4edccb40 feat(v4): DeepSeek-V4-Flash DSpark training pipeline against a quantized serving target
convert_engine_dump.py: hanzo-engine hidden-state dumps -> TARGET_CACHE_VERSION=2 (reuses DeepSpec's own writers; bit-exact round-trip). dspark_v4flash_quant.py: V4-Flash draft config (hidden 4096, vocab 129280, 43 target layers, layer_ids [1,11,21,31,41], block 7, markov vanilla 256, confidence head, mask_token 129279). v4_pipeline/: synthetic dump generator + training smoke (single-GPU, reduced dims). PROVEN on GB10: 300 real samples dumped at 111.5 tok/s prefill -> converted -> 50 steps on real quantized-V4 hiddens, loss 3.03->2.6 decreasing; full config 5L/64a/12288 passes solo.
2026-07-02 21:20:04 -07:00
Hannibal046andGitHub afdfa7c938 Merge pull request #16 from DaoyuanLi2816/fix-scheduler-state-dict-optimizer-key
Fix scheduler state_dict to drop the optimizer key by equality
2026-06-30 14:42:21 +08:00
Hannibal046andGitHub af59e17a37 Merge pull request #18 from DaoyuanLi2816/remove-unused-extract-context-feature-import
Remove unused extract_context_feature import from DSpark modeling
2026-06-30 14:35:19 +08:00
Hannibal046andGitHub a3999d8b9f Merge pull request #19 from DaoyuanLi2816/fix-launch-eval-message-grammar
Fix grammar in the _launch_eval placeholder message
2026-06-30 12:47:26 +08:00
Hannibal046andGitHub c5cc09845b Merge pull request #17 from DaoyuanLi2816/align-block-naming-to-block7
Align DSpark/DFlash exp_name with block_size=7 (block7)
2026-06-30 12:47:01 +08:00
Daoyuan Li 3b835574be Fix grammar in the _launch_eval placeholder message
"launch to your auto eval script" -> "launch your auto eval script".
2026-06-29 21:25:38 -07:00
Daoyuan Li d87334ec83 Remove unused extract_context_feature import from DSpark modeling
The qwen3 and gemma4 DSpark modeling modules both import
extract_context_feature from ..common but never use it; it is referenced
only in deepspec/eval/dspark/evaluator.py. Drop the unused import (F401).
2026-06-29 21:25:10 -07:00
Daoyuan Li c938b5424c Align DSpark/DFlash exp_name with block_size=7 (block7)
The DSpark and DFlash configs set `block_size=7` but name their experiments
`*_block8_*`. The Eagle3 configs already follow the parameter value in their
names (`*_ttt7_*` with `ttt_length=7`), and the released checkpoints in the
README are published as `*_block7_*`.

Rename the experiments to `*_block7_*` so the default checkpoint directory
matches both `block_size=7` and the published checkpoint names, and update
the eval.sh / README examples that reference that path.
2026-06-29 21:23:50 -07:00
Daoyuan Li a71367a787 Fix scheduler state_dict to drop the optimizer key by equality
TwoStageScheduler.state_dict() used `key not in "optimizer"`, which tests
whether each key is a substring of the string "optimizer" rather than
comparing it against "optimizer". It only drops the intended "optimizer"
key today because no other scheduler attribute name happens to be a
substring of "optimizer".

Use `key != "optimizer"`, matching torch's LRScheduler.state_dict idiom and
the SpecForge optimizer code this class is adapted from.
2026-06-29 21:23:02 -07:00
Hannibal046andGitHub 6443750b5c Merge pull request #12 from inisis/main
fix: add prettytable in requirements.txt
2026-06-29 15:55:49 +08:00
Hannibal046andGitHub ae6712019f Update requirements.txt 2026-06-29 15:55:34 +08:00
inisis d7ed43c187 fix: add prettytable in requirements.txt 2026-06-29 15:39:46 +08:00
Xin Cheng dd854392fa minor 2026-06-28 20:53:08 +08:00
Xin Cheng f9879b5c1f release ckpt 2026-06-28 20:43:16 +08:00
Xin Cheng 0a03e19e1c first init 2026-06-27 12:56:53 +08:00