this post was submitted on 17 Aug 2024
746 points (96.0% liked)

Technology

59111 readers
6169 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each another!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed

Approved Bots


founded 1 year ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
[–] [email protected] 2 points 2 months ago* (last edited 2 months ago) (1 children)

I use a locally run open source LLM.

How? GPT4All + Llama or something else? I just started dipping my toe in locally run open source LLM.

not fine tuning a LLM to match tone and style counts as either misuse or hobbyist use

You’ve hit the nail on the head with this one. I think the other commenters are right, that a lot of people will misuse the tool, but nonetheless it is an issue with the users, not the tool itself.

[–] [email protected] 2 points 2 months ago

My main workstation runs Linux and I use Llama.cpp. I used it with mistral’s latest largest model but I have used others in the past.

I appreciate your thoughts here. Lemmy I think, in general, has an indistinguishing anti LLM bias.