The chatbot still remains the most popular AI assistant worldwide with over 1.1 billion monthly users, followed by Gemini with 662 million and Claude with 245 million.
The good thing is that a deepseek can be run locally relatively well with consumer hardware. I trust chinese companies as much as i trust american companies with my data and my prompts.
You don’t need 170+ GB of VRAM. Whole model can be run at around 1 token/second on a modern hardware from an ssd. Which is slow, don’t get me wrong, but it still somewhat useable.
Upd.Once again, for those who use AI because struggles to read: it is slow, but it is usable. Which is, by definition, means that you don’t need 170+ GB of VRAM to run this model. Period. It runs from ssd. That is a fact.
Theres a lot of good models free online that are open source/Chinese and the only cost is a bit of slowness on my rig. No token limit or whatever. Totally agree.
Personally, I find myself using the Chinese alternatives more and more as they are just way cheaper.
The good thing is that a deepseek can be run locally relatively well with consumer hardware. I trust chinese companies as much as i trust american companies with my data and my prompts.
9w4o7kk92trq68g3khk8b5d1wpe579bamp3l58zp22szn9zbf0gqedodjscr6cnu33vdo0bkku212ptg u8h0ik62eizb6k 53wxuffukaysrhv 8sh67015sjx8h57jkoibge fle5d8k64nj0z27k2jhrgd6trx6d21e264jivnwe8y6cvsqg07d9fslvyya8vo2it7x5vk79xb6ahs pjz9gjklh2xzpxqi435b9kegjh0fxnqrz0fsjf bu
You don’t need 170+ GB of VRAM. Whole model can be run at around 1 token/second on a modern hardware from an ssd. Which is slow, don’t get me wrong, but it still somewhat useable.
Upd.Once again, for those who use AI because struggles to read: it is slow, but it is usable. Which is, by definition, means that you don’t need 170+ GB of VRAM to run this model. Period. It runs from ssd. That is a fact.
1 token/second isn’t remotely acceptsble lol
deleted by creator
Theres a lot of good models free online that are open source/Chinese and the only cost is a bit of slowness on my rig. No token limit or whatever. Totally agree.
Its about as good as commercial products now…
I’ve been loving minimax-m3 since its release