this post was submitted on 30 Jan 2025
77 points (84.1% liked)
Technology
61227 readers
4224 users here now
This is a most excellent place for technology news and articles.
Our Rules
- Follow the lemmy.world rules.
- Only tech related content.
- Be excellent to each other!
- Mod approved content bots can post up to 10 articles per day.
- Threads asking for personal tech support may be deleted.
- Politics threads may be removed.
- No memes allowed as posts, OK to post as comments.
- Only approved bots from the list below, to ask if your bot can be added please contact us.
- Check for duplicates before posting, duplicates may be removed
- Accounts 7 days and younger will have their posts automatically removed.
Approved Bots
founded 2 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
I made a comment to a beehaw post about something similar, I should make it a post so the .world can see it.
I've been running the 14B distilled model, based on Ali Baba's Qwen2 model, but distilled by R1 and given it's chain of thought ability. You can run it locally with Ollama and download it from their site.
That version has a couple of odd quirks, like the first interaction in a new session seems much more prone triggering a generic brush-off response. But subsequent responses I've noticed very few guardrails.
I got it to write a very harsh essay on Tiananmen Square, tell me how to make gunpowder (very generally, the 14B model doesn't appear to have as much data available in some fields, like chemistry), offer very balanced views on Isreal and Palestine, and a few other spicy responses.
At one point though I did get a very odd and suspicious message out of it regarding the "Realis" group within China and how the government always treats them very fairly. It misread "Isrealis" and apparently got defensive about something else entirely.