Ternary-Bonsai-2-27B-Uncensored-Heretic-GGUF

A decensored version of Prism ML's Ternary-Bonsai-2-27B, with a Heretic LoRA baked into the ternary weights.

The LoRA was baked into the official PQ2_0 model by adjusting ternary codes while preserving the original block scales. The update affected 34 matrices; the remaining 817 tensors were unchanged. This is an approximate merge, not an exact floating-point LoRA merge.

Abliteration parameters

Parameter	Value
start_layer_index	27
end_layer_index	44
preserve_good_behavior_weight	1.0
steer_bad_behavior_weight	0.03
overcorrect_relative_weight	2.3
neighbor_count	1
ridge_regularization	0.00015
transport_rank	4
entropy_regularization	0.1
transport	gaussian
lora_rank	128
row_normalization	none
target_components	attn.o_proj, mlp.down_proj
covariance_regularization	0.01
max_weight_change	1.0

Performance

Metric	This model	Original model (prism-ml/Ternary-Bonsai-2-27B-gguf)
Refusals	0/100	95/100
KL divergence	0.0135	0 (by definition)

Usage

Use the Prism ML fork of llama.cpp. Both formats require its ternary kernels and Hadamard activation transforms.

With the Prism llama-server executable available:

llama-server -m Ternary-Bonsai-2-27B-Uncensored-Heretic-PTQ1_0.gguf -ngl 99 -c 32768 --jinja --reasoning on --reasoning-effort medium --temp 1.0 --top-p 0.95 --top-k 20 --host 127.0.0.1 --port 8080

Open http://127.0.0.1:8080. Substitute the PQ2_0 filename to use that packing.

Local validation

Check	PQ2_0	PTQ1_0
English perplexity — WikiText-2 test	10.1460	10.1435
Japanese perplexity — harmless_alpaca_ja test	16.7833	16.7744
Short functional checks passed	16/16	16/16

Perplexity was measured with a 512-token context over 4,080 English and 3,570 Japanese scored tokens. Functional checks covered arithmetic, JSON, translation, and reading comprehension. Slight numerical differences between packings can arise from their runtime kernels.

These are small local tests, not a comprehensive benchmark. Long-context performance, and vision behavior have not been evaluated for this release.

⚠️ Important Notice

This model has undergone substantial reduction of its safety alignment. As a result, it is more likely than standard models to generate harmful, inaccurate, biased, offensive, or otherwise inappropriate content.

Intended Use

For research and experimentation only, including safety research, alignment studies, and red-teaming. Please avoid deploying it in public or end-user-facing services.

User Responsibility

All outputs should be treated as untrusted and independently verified before use. Users are solely responsible for:

• Evaluating the accuracy and suitability of generated content
• Implementing appropriate safeguards and human oversight
• Complying with applicable laws, regulations, licenses, and ethical standards

Use of this model is entirely at your own risk.

Disclaimer

OS-Software provides this model without warranties of any kind and assumes no liability for any direct or indirect damages, losses, misuse, or legal consequences arising from its use.

Acknowledgements

Thanks to the base model developers, p-e-w for Heretic, and the wider open-source community.

This is a derivative work released under the base model’s applicable license. All rights to the base model remain with their respective owners.