deleted by creator

deleted by creator

deleted by creator

I think I found my jam! AnythingLLM self-hostable

Are there any AI apps that will index markdown documents with a vector DB, then allow you to run natural language queries using some kind of RAG approach with a local LLM?

Closest I’ve found is LlamaIndex, but this is still more of a ‘foundation’ than a turn-key solution and right now I’m too time-poor to do the assembly required…

I realise I’m describing close-to-frontier tech, but is there anything more turn-key (Dockerised) out there yet?

My use-case is pretty ‘vanilla’ in this space: Having a knowledge base and wanting quick answers to questions like “How should screen X behave if I am not a registered user?”.

Thanks for any suggestions!

$14 USD/mo… Ironically

I’ve been an enthusiastic adopter of Generative AI in my coding work; and know that Claude 3.7 is the greatest coding model out there right now (at least for my niche).

That said, at some point you have to choose principles over convenience; so I’ve cancelled all my US Tech service accounts - now exclusively using ‘Le Chat Pro’ (+ sometimes local LLM’s).

Honestly, it’s not quite as good, but it’s not half bad either, and it is very very fast thanks to some nifty hardware acceleration that the others lack.

I still get my work done, and sleep better at night.

The more subscriptions Mistral get, the more they’re able to compete with the US offerings.

Anyone can do this.