zenlm/zen-nano
1
0
Fork 0
mirror of https://github.com/zenlm/zen-nano.git synced 2026-07-27 03:09:47 +00:00
Code Issues Packages Projects Releases Wiki Activity

docs: update abliteration section to reference hanzoai/remove-refusals

Browse Source
This commit is contained in:
Hanzo Dev
2026-02-27 16:01:13 -08:00
parent 937c8497f7
commit a0f77d538f
1 changed files with 3 additions and 3 deletions
Download Patch File Download Diff File Expand all files Collapse all files
README.md
+3 -3
View File
@@ -164,11 +164,11 @@ Part of the **[Zen AI](https://github.com/zenlm)** ecosystem.
Zen Nano 0.6B weights are derived from an abliterated base model. Abliteration removes
refusal behavior by identifying and nullifying the "refusal direction" in the model's
residual stream, as described in
[Maxime Labonne's methodology](https://huggingface.co/blog/mlabonne/abliteration).
residual stream.
**Method**: Directional ablation on the residual stream across all layers
**Source**: Zen MoDE (Mixture of Distilled Experts) architecture base
**Implementation**: [hanzoai/remove-refusals](https://github.com/hanzoai/remove-refusals) — Hanzo's production abliteration toolkit
**Technique**: [Refusal in LLMs is mediated by a single direction](https://www.lesswrong.com/posts/jGuXSZgv6qfdhMCuJ/refusal-in-llms-is-mediated-by-a-single-direction) — Arditi et al.
**Effect**: Removes refusal behaviors while preserving all other capabilities
**Identity layer**: Zen identity added via system prompt — full LoRA fine-tuning planned