How to run Large Language Models (LLMs) locally.

1

Ollama

Ollama is a lightweight tool designed to download open-source large language models (LLMs) directly on your computer. It also exposes an API to create, modify and/or provide a REST API for running and managing models too.

#AI #Developer Tools #LLM 128 social mentions

2

LM Studio

LM Studio is an open-source, free desktop application.

#AI #AI Tools #Developer Tools 11 social mentions

3

Hugging Face

You will need to go to HuggingFace to select the model GGUF (GPT-Generated Unified Format) link. In this case, we'll use unsloth/DeepSeek-R1-GGUF link (https://huggingface.co/unsloth/DeepSeek-R1-Distill-Llama-8B-GGUF).

#AI #Social & Communications #Chatbots 295 social mentions