local-ai · GitHub Topics

#大语言模型#Simple, scalable AI model deployment on GPU clusters

ascend CUDA deepseek distributed-inference genai inference llama llamacpp 大语言模型 maas metal openai qwen rocm vllm mindie llm-inference llm-serving local-ai heterogeneous-cluster

Python 3.7 k

4 天前

beclab / Olares

Olares: An Open-Source Personal Cloud to Reclaim Your Data

Kubernetes 自托管 home-automation homelab edge-ai homeserver local-ai ai-agents model-serving mcp home-cloud home-server

Go 2.45 k

1 天前

Mobile-Artificial-Intelligence / maid

#安卓#Maid is a cross-platform Flutter app for interfacing with GGUF / llama.cpp models locally, and with Ollama and OpenAI models remotely.

Android 聊天机器人 ChatGPT Facebook Flutter gguf large-language-models llama llama-cpp llama2 llamacpp mistral openai local-ai ollama mobile-ai android-ai free-chatgpt

Dart 2.15 k

2 个月前

Blaizzy / mlx-vlm

#大语言模型#MLX-VLM is a package for inference and fine-tuning of Vision Language Models (VLMs) on your Mac using MLX.

llava 大语言模型 MLX vision-transformer apple-silicon idefics local-ai paligemma vision-framework vision-language-model florence2 molmo pixtral

Python 1.63 k

11 天前

fmaclen / hollama

#大语言模型#A minimal LLM chat app that runs entirely in your browser

人工智能聊天机器人 local-ai ollama 大语言模型

TypeScript 978

2 个月前

withneural / neuralagent

#大语言模型#The AI Agent That Lives On Your Desktop And Uses It Like You Do!

人工智能 personal-assistant ai-agent ai-sdk 自动化 autonomous-agents desktop-automation 大语言模型 local-ai productivity pyautogui

Python 820

14 天前

NativeMindBrowser / NativeMindExtension

#大语言模型#NativeMind: Your fully private, open-source, on-device AI assistant

人工智能 Chrome 插件大语言模型 on-device-ai ollama local-ai

TypeScript 648

3 天前

Michael-A-Kuykendall / shimmy

#计算机科学#⚡ Python-free Rust inference server — OpenAI-API compatible. GGUF + SafeTensors, hot model swap, auto-discovery, single binary. FREE now, FREE forever.

llama llamacpp llm-inference ollama-api command-line-tool gguf inference-server local-ai lora 机器学习 API developer-tools huggingface huggingface-transformers Rust rust-crate transformers

Rust 563

2 天前

Mozilla-Ocho / Memory-Cache

MemoryCache is an experimental development project to turn a local desktop environment into an on-device AI agent

人工智能 Firefox 插件 local-ai

JavaScript 562

1 年前

rikkichy / ollama-telegram

🦙 Ollama Telegram bot, with advanced configuration

local-ai ollama telegram-bots

Python 388

14 天前

dcSpark / shinkai-local-ai-agents

Shinkai is a two click install App that allows you to create Local AI agents in 5 minutes or less using a simple UI. Supports: MCPs, Remote and Local AI, Crypto and Payments.

local-ai ai-agents

TypeScript 360

2 天前

dcSpark / shinkai-local-ai-agents

Shinkai is a two click install App that allows you to create Local AI agents in 5 minutes or less using a simple UI. Supports: MCPs, Remote and Local AI, Crypto and Payments.

local-ai ai-agents

TypeScript 360

2 天前

Haervwe / open-webui-tools

#大语言模型#Open‑WebUI Tools is a modular toolkit designed to extend and enrich your Open WebUI instance, turning it into a powerful AI workstation. With a suite of over 15 specialized tools, function pipelines, ...

ai-agents comfyui 大语言模型 llm-tools local-ai ollama open-webui arxiv image-generation multi-agent music-generation

Python 346

14 天前

NeuralNodeOne814 / LocalineAI

LocalineAI brings powerful AI capabilities directly to your Windows terminal while keeping your data completely private and secure. No cloud dependencies, no data sharing - just pure AI power at your ...

ai-assistant 人工智能 cli-tool code-generation generative-ai image-generation local-ai local-llm open-source-ai text-generation

290

4 个月前

CyberLinkGamma314 / LocalineAI

ai-assistant 人工智能 cli-tool code-generation generative-ai image-generation local-ai local-llm open-source-ai text-generation

289

4 个月前

BinarySyncBeta995 / LocalineAI

ai-assistant 人工智能 cli-tool code-generation generative-ai image-generation local-ai local-llm open-source-ai text-generation

287

4 个月前

NanoNetGamma531 / LocalineAI

ai-assistant 人工智能 cli-tool code-generation generative-ai image-generation local-ai local-llm open-source-ai text-generation

268

4 个月前

lee-b / kobold_assistant

#安卓#Like ChatGPT's voice conversations with an AI, but entirely offline/private/trade-secret-friendly, using local AI models such as LLama 2 and Whisper

ai-assistant Android Desktop Linux llama 大语言模型移动 speech-to-text text-to-speech voice-assistant voice-recognition local-ai koboldai

Python 161

1 年前