DeathGodlike/Starlit-Shadow-12B_EXL3

Original model: Starlit-Shadow-12B by Vortex5

---

Available ExLlamaV3 (release v0.0.18) quantizations

Type	Size	CLI
H8-4.0BPW	7.49 GB	Copy-paste the line / Download the batch file
H8-6.0BPW	10.22 GB	Copy-paste the line / Download the batch file
H8-8.0BPW	12.95 GB	Copy-paste the line / Download the batch file

Requirements: A python installation with huggingface-hub module to use CLI.

Licensing

License detected: unknown

The license for the provided quantized models is derived from the original model. For additional information see the original model's page above, or, if unavialable, the files and the page backups below.

---

Backups

Original files

Original page (click to expand)

Starlit-Shadow-12B

Overview

Starry-Shadow-12B was created through a multi-stage merge involving Red-Synthesis-12B, KansenSakura-Erosion-RP-12B, NoctyxCosma-12B, and Crimson-Twilight-12B,

Multi-stage merge configuration

name: First
models:
  - model: Vortex5/Red-Synthesis-12B
merge_method: sm2f
base_model: Retreatcost/KansenSakura-Erosion-RP-12b
dtype: bfloat16
tokenizer:
  source: Retreatcost/KansenSakura-Erosion-RP-12b
---
name: Second
models:
  - model: Vortex5/NoctyxCosma-12B
merge_method: sm2f
base_model: Vortex5/Crimson-Twilight-12B
dtype: bfloat16
tokenizer:
  source: Vortex5/Crimson-Twilight-12B
---
models:
  - model: First
  - model: Second
merge_method: karcher
dtype: bfloat16
parameters:
  tol: 1e-9
  max_iter: 1000
tokenizer:
  source: Vortex5/Crimson-Twilight-12B
      

Intended Use

🎭 Roleplay

📜 Storytelling

🌌 Creative Writing