cpu-inference

#自然语言处理#Running Llama 2 and other Open-Source LLMs on CPU Inference Locally for Document Q&A

Runs LLaMA with Extremely HIGH speed

#大语言模型#LLM inference in Fortran

#计算机科学#The bare metal in my basement

eLLM Infers Qwen3-480B on a CPU in Real Time

#大语言模型#Portable LLM - A rust library for LLM inference

Wrapper for simplified use of Llama2 GGUF quantized models.

#大语言模型#Simple large language model playground app

#大语言模型#V-lang api wrapper for llm-inference chatllm.cpp

VB.NET api wrapper for llm-inference chatllm.cpp

#大语言模型#C# api wrapper for llm-inference chatllm.cpp

🧠 A comprehensive toolkit for benchmarking, optimizing, and deploying local Large Language Models. Includes performance testing tools, optimized configurations for CPU/GPU/hybrid setups, and detailed...

#安卓#PlantAi is a ResNet-based CNN model trained on the PlantVillage dataset to classify plant leaf images as healthy or diseased. This repository includes PyTorch training code, tools to convert the model...

#大语言模型#Nim api-wrapper for llm-inference chatllm.cpp

#大语言模型## gemma-2-2b-it.csThis project implements int8 CPU inference in pure C#. It ports a Rust repository using Gemini 2.5 Pro Preview, and you can easily build and run it with the provided batch files. 🐙�...

Privacy-focused RAG chatbot for network documentation. Chat with your PDFs locally using Ollama, Chroma & LangChain. CPU-only, fully offline.

Simple bot that transcribes Telegram voice messages. Powered by go-telegram-bot-api & whisper.cpp Go bindings.

#大语言模型#rust api wrapper for llm-inference chatllm.cpp

#大语言模型#D-lang api wrapper for llm-inference chatllm.cpp

#大语言模型#gemma-2-2b-it int8 cpu inference in one file of pure C#