Aitrepreneur: NEW ExLLAMA Breakthrough! 8K TOKENS! LESS VRAM & SPEED BOOST!

www.youtube.com

Aitrepreneur: NEW ExLLAMA Breakthrough! 8K TOKENS! LESS VRAM & SPEED BOOST!

www.youtube.com

2dollarsim@lemmy.worldM to Oobabooga Text Generation@lemmy.worldEnglish · 2 years ago

NEW ExLLAMA Breakthrough! 8K TOKENS! LESS VRAM & SPEED BOOST!

www.youtube.com

ExLLAMA is a real breakthrough in the LLM community! This innovative update for the text-generation LLM webui not only can increase the TOKENS capacity of a ...

Tested it myself, huge improvement!

You must log in or register to comment.

Chat

Oobabooga Text Generation@lemmy.world

oobabooga@lemmy.world

Create a post

You are not logged in. However you can subscribe from another Fediverse account, for example Lemmy or Mastodon. To do this, paste the following into the search field of your instance: !oobabooga@lemmy.world

Community for Oobabooga / Pygmalion / TavernAI / AI text generation

Let’s rebuild our knowledge base here!

Ooba community is still dark on reddit, so we’re starting from scratch. https://www.reddit.com/r/Oobabooga/

Subscribe, engage, post, comment!

Helpful links:

https://github.com/oobabooga/text-generation-webui

https://zoltanai.github.io/character-editor/

https://www.chub.ai/characters

Remember to mark NSFW posts.

Other AI communities to check out:

!fosai@lemmy.world

Visibility: Public

This community can be federated to other instances and be posted/commented in by their users.

1 user / day
1 user / week
1 user / month
1 user / 6 months
4 local subscribers
189 subscribers
17 Posts
11 Comments
Modlog

mods:
2dollarsim@lemmy.world