gguf

Local AI API Platform

#安卓#Maid is a cross-platform Flutter app for interfacing with GGUF / llama.cpp models locally, and with Ollama and OpenAI models remotely.

#大语言模型#Effortlessly run LLM backends, APIs, frontends, and services with one command.

LLM Agent Framework in ComfyUI includes MCP sever, Omost,GPT-sovits, ChatTTS,GOT-OCR2.0, and FLUX prompt nodes,access to Feishu,discord,and adapts to all llms with similar openai / aisuite interfaces,...

#大语言模型#动手学Ollama，CPU玩转大模型部署，在线阅读地址：https://datawhalechina.github.io/handy-ollama/

#大语言模型#Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema on the model output on the generation level

#大语言模型#Go manage your Ollama models

Interface for OuteTTS models.

#数据仓库#An open source DevOps tool from the CNCF for packaging and versioning AI/ML models, datasets, code, and configuration into an OCI Artifact.

#计算机科学#⚡ Python-free Rust inference server — OpenAI-API compatible. GGUF + SafeTensors, hot model swap, auto-discovery, single binary. FREE now, FREE forever.

#大语言模型#Practical Llama 3 inference in Java

#IOS#LLM.swift is a simple and readable library that allows you to interact with large language models locally with ease for macOS, iOS, watchOS, tvOS, and visionOS.

#搜索#Go library for embedded vector search and semantic embeddings using llama.cpp

#大语言模型#Run AI ✨ assistant locally! with simple API for Node.js 🚀

#大语言模型#GGUF implementation in C as a library and a tools CLI program

Webscout is the all-in-one search and AI toolkit you need. Discover insights with Yep.com, DuckDuckGo, and Phind; access cutting-edge AI models; transcribe YouTube videos; generate temporary emails an...

LM inference server implementation based on *.cpp.

#大语言模型#The Easiest Rust Interface for Local LLMs and an Interface for Deterministic Signals from Probabilistic LLM Vibes

#大语言模型#llama.cpp (GGUF LLMs) and llava.cpp (GGUF VLMs) for ROS 2

Review/Check GGUF files and estimate the memory usage and maximum tokens per second.