zenlm/zen-pro
1
0
Fork 0
mirror of https://github.com/zenlm/zen-pro.git synced 2026-07-27 03:09:50 +00:00
Code Issues Packages Projects Releases Wiki Activity

docs: update abliteration section to reference hanzoai/remove-refusals

Browse Source
This commit is contained in:
Hanzo Dev
2026-02-27 16:01:19 -08:00
parent a6468516f7
commit 814884414c
1 changed files with 3 additions and 3 deletions
Download Patch File Download Diff File Expand all files Collapse all files
README.md
+3 -3
View File
@@ -178,11 +178,11 @@ Part of the [Zen model family](https://zenlm.org) by [Hanzo AI](https://hanzo.ai
Zen Pro 8B weights are derived from an abliterated base model. Abliteration removes
refusal behavior by identifying and nullifying the "refusal direction" in the model's
residual stream, as described in
[Maxime Labonne's methodology](https://huggingface.co/blog/mlabonne/abliteration).
residual stream.
**Method**: Directional ablation on the residual stream across all layers
**Source**: Zen MoDE (Mixture of Distilled Experts) architecture base
**Implementation**: [hanzoai/remove-refusals](https://github.com/hanzoai/remove-refusals) — Hanzo's production abliteration toolkit
**Technique**: [Refusal in LLMs is mediated by a single direction](https://www.lesswrong.com/posts/jGuXSZgv6qfdhMCuJ/refusal-in-llms-is-mediated-by-a-single-direction) — Arditi et al.
**Effect**: Removes refusal behaviors while preserving all other capabilities
**Identity layer**: Zen identity added via system prompt — full LoRA fine-tuning planned