Ollama and Local LLMs for Swiss SMEs: AI Without Cloud, Without Cost

Ollama is an open-source tool that allows language models (LLMs) to run directly on your computer or server — without a cloud API, without a monthly subscription and without your data ever leaving your infrastructure. In 2026, this approach has become accessible to Swiss SMEs thanks to affordable GPU hardware and the emergence of highly capable compact models.

It is the definitive answer to the strictest Swiss FADP requirements: zero data transfer, zero vendor dependency, zero marginal cost in use.

For general context, see the pillar guide on AI automation for Swiss SMEs.

1. What Ollama Enables in Practice

Ollama simplifies the installation and use of open-source LLMs to a single command. Once installed, you can:

Launch a local chat from the command line: ollama run mistral.
Expose an OpenAI-compatible REST API on localhost:11434 — integrable into n8n, LangChain, your Python scripts.
Manage multiple models simultaneously and switch between them in seconds.
Run the model in the background as a system service.

2. The Best Models for a Swiss SME in 2026

Mistral 7B (3.8 GB)

Excellent for: writing in French, summaries, Q&A on documents. Very good FR/DE multilingual. Runs on a recent laptop with 8 GB RAM.

LLaMA 3.1 8B (4.7 GB)

Excellent for: code, analysis, structured reasoning. Better in English than in French. Ideal for workflow automation.

Qwen 2.5 7B (4.7 GB)

Excellent multilingual including Chinese — useful for Swiss SMEs with Asian business relationships.

LLaMA 3.1 70B (40 GB, GPU required)

Performance close to GPT-4 on a server with a dedicated GPU (RTX 4090 or A100). For tasks requiring the highest level of reasoning.

Mistral Large 2 (quantised, 23 GB)

The best French-language model available locally. Comparable to Claude Sonnet for professional writing in French.

3. Required Infrastructure for an SME

Minimum Configuration (Office or Remote Work)

MacBook Pro M3/M4 (16 or 32 GB unified memory): excellent for Mistral 7B and LLaMA 8B.
PC with 16 GB RAM, no dedicated GPU: runs but slow (10 to 30 tokens/s).

Recommended SME Configuration (Dedicated Server)

Mini-PC with RTX 3080/4070 (10–12 GB VRAM): perfect for 7B–13B models at high speed.
Server with RTX 4090 GPU: runs 30–70B models.
On-premise hosting or dedicated Infomaniak VPS with GPU: full data sovereignty.

4. Integration into SME Workflows

Ollama exposes an OpenAI-compatible API. To integrate it into n8n:

HTTP Request node to http://localhost:11434/api/generate.
Or n8n's OpenAI node, changing the base URL to http://localhost:11434/v1.

Result: your automation workflows (customer follow-ups, content generation, document analysis) run entirely locally, with no API costs and no data transfer.

See self-hosted n8n for Swiss SMEs and Make vs. n8n vs. Zapier.

5. High-Value Local Use Cases for Swiss SMEs

Local Contract Analysis

A law firm or fiduciary processes its client contracts with local Mistral Large. No client data leaves the office. Performance equivalent to a cloud LLM for this use case. Marginal cost = 0.

Multilingual Content Generation Without an API

A French-speaking Swiss SME generates its blog articles in FR/DE/IT with local Mistral 7B. No Mammouth or OpenAI subscription required.

Internal Chatbot on a Knowledge Base

Ollama + LangChain + your internal PDF documentation = HR chatbot, quality chatbot, product chatbot — 100% internal, zero data leakage.

6. Limitations of Ollama for an SME

No performance guarantee on lightweight models: Mistral 7B makes factual errors that Claude 4 avoids. For critical decisions, maintain human validation.
Power consumption: a 24/7 GPU server consumes 200 to 500 W. Factor this into the TCO calculation.
Manual model updates: no automatic updates like with a cloud API.
Limited multimodal capability: vision and audio are less accessible locally than in the cloud.

7. Cost Comparison: Local Ollama vs. Cloud API

For 1 million tokens processed per month:

Mistral API (cloud): approximately CHF 3 to CHF 10 depending on the model.
Ollama local (amortised server): electricity cost ≈ CHF 0.20 to CHF 1.

For SMEs generating high volumes (large file analysis, daily content generation), hardware amortisation is reached in 6 to 18 months.

Ollama and Local LLMs for Swiss SMEs: AI Without Cloud, Without Cost (2026)