The Open Source Computing Thread

[Based_Christian_Dude]

Artificial Intelligence (AI)

STOP using enemy's AI like ChatGPT, Google Gemini, Microsoft CoPilot, Apple Intelligence, etc. By using their proprietary AI, you are training them to get stronger and exposing yourselves for the enemy to exploit you. You must use open source alternatives to be safe out there and to ensure the safety of your children.

GPT4All: GPT4All runs large language models (LLMs) privately on everyday desktops & laptops.

GPT4All

Run AI Privately: the privacy-first, no internet required LLM platform

nomic.ai

GitHub - nomic-ai/gpt4all: GPT4All: Run Local LLMs on Any Device. Open-source and available for commercial use.

GPT4All: Run Local LLMs on Any Device. Open-source and available for commercial use. - nomic-ai/gpt4all

github.com

Ollama: Get up and running with large language models.

Ollama

Get up and running with large language models.

ollama.com

GitHub - ollama/ollama: Get up and running with Llama 3.3, DeepSeek-R1, Phi-4, Gemma 2, and other large language models.

Get up and running with Llama 3.3, DeepSeek-R1, Phi-4, Gemma 2, and other large language models. - ollama/ollama

github.com

KoboldCpp: KoboldCpp is an easy-to-use AI text-generation software for GGML and GGUF models.

GitHub - LostRuins/koboldcpp: Run GGUF models easily with a KoboldAI UI. One File. Zero Install.

Run GGUF models easily with a KoboldAI UI. One File. Zero Install. - LostRuins/koboldcpp

github.com

Oobabooga Text generation web UI: A Gradio web UI for Large Language Models.

GitHub - oobabooga/text-generation-webui: A Gradio web UI for Large Language Models with support for multiple inference backends.

A Gradio web UI for Large Language Models with support for multiple inference backends. - oobabooga/text-generation-webui

github.com

More AI Client Tools

Alpaca: Alpaca is an Ollama client where you can manage and chat with multiple models, Alpaca provides an easy and beginner friendly way of interacting with local AI, everything is open source and powered by Ollama.

Alpaca

jeffser.com

GitHub - Jeffser/Alpaca: 🦙 Local and online AI hub

🦙 Local and online AI hub. Contribute to Jeffser/Alpaca development by creating an account on GitHub.

github.com

Jan AI: Jan is a ChatGPT-alternative that runs 100% offline on your device. Our goal is to make it easy for a layperson to download and run LLMs and use AI with full control and privacy.

https://jan.ai/

GitHub - janhq/jan: Jan is an open source alternative to ChatGPT that runs 100% offline on your computer

Jan is an open source alternative to ChatGPT that runs 100% offline on your computer - janhq/jan

github.com

 

[Jeff3025]

Looks cool, what do you think about the Qwen models? https://ollama.com/library/qwen2.5

I think you have a great point here. Just like with search engines, these companies are hoovering up all your data.

 

[Based_Christian_Dude]

Looks cool, what do you think about the Qwen models? https://ollama.com/library/qwen2.5

I think you have a great point here. Just like with search engines, these companies are hoovering up all your data.

Don't know anything about Qwen, but since it's made by Alibaba, it's most likely at least a decent AI with neutered opinions about the CCP.

 

[Jeff3025]

Better than Deepseek in many cases:
In examples: https://www.tomsguide.com/ai/i-tested-deepseek-vs-qwen-2-5-with-7-prompts-heres-the-winner

and in metrics: https://dev.to/mehmetakar/qwen-25-max-vs-deepseek-v3-r1-benchmark-49be

 

[Based_Christian_Dude]

Better than Deepseek in many cases:
In examples: https://www.tomsguide.com/ai/i-tested-deepseek-vs-qwen-2-5-with-7-prompts-heres-the-winner

and in metrics: https://dev.to/mehmetakar/qwen-25-max-vs-deepseek-v3-r1-benchmark-49be

Interesting...wouldn't be surprised if China is purposely creating multiple brilliant open source AI models to antagonize the USA's economic dominance. The only thing the US really exports is copyrighted intellectual property (e.g. software, multimedia, subscription services).