• 𞋴𝛂𝛋𝛆@lemmy.world
    link
    fedilink
    English
    arrow-up
    1
    ·
    22 hours ago

    You won’t. It is something inside internal alignment thinking in the QKV layers. Some models have a layer of masking that pseudo blocks access to these layers of meaning. Based on several aspects present in the image, I know the region of alignment thinking that is being triggered here in the embedding model’s QKV alignment layers.