Got Ollama set up with an 8GB AMD graphics card at my disposal. Any recommendations for the most unhinged model I can run on this? i.e. I can ask it how to annoy my neighbors and it won’t go on a rant about morals or its supposed purpose as an LLM?

  • d00ery@lemmy.world
    link
    fedilink
    arrow-up
    5
    arrow-down
    1
    ·
    edit-2
    3 months ago

    4chan tech /g usually has an AI models post with the latest uncensored model, then look it up on hugging face.

    I think deep seek have an uncensored model but I’m not sure how small it is. Report back if you find something good!

    • JustAnotherKay@lemmy.world
      link
      fedilink
      arrow-up
      3
      ·
      3 months ago

      I think deep seek have an uncensored model

      They do, but the smaller ones and the distilled ones still struggle with some censorship. Methinks it has to do with more parameters = more ability to decide what is and isn’t disinformation, however I doubt they’re gonna self host the 18b model on 8b brand to get around that