mixtral · GitHub Topics

#大语言模型#Private chat with local GPT with document, images, video, etc. 100% private, Apache 2.0. Supports oLLaMa, Mixtral, llama.cpp, and more. Demo: https://gpt.h2o.ai/ https://gpt-docs.h2o.ai/

ChatGPT 大语言模型人工智能 embeddings generative gpt gpt4all pdf private privategpt vectorstore llama2 mixtral

Python 11.88 k

2 个月前

bigscience-workshop / petals

#自然语言处理#🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading

bloom 深度学习 distributed-systems language-models large-language-models 机器学习 neural-networks PyTorch volunteer-computing pipeline-parallelism guanaco llama 聊天机器人 gpt transformer 自然语言处理 pretrained-models falcon mixtral

Python 9.73 k

1 年前

yangjianxin1 / Firefly

#大语言模型#Firefly: 大模型训练工具，支持训练Qwen2.5、Qwen2、Yi1.5、Phi-3、Llama3、Gemma、MiniCPM、Yi、Deepseek、Orion、Xverse、Mixtral-8x7B、Zephyr、Mistral、Baichuan2、Llma2、Llama、Qwen、Baichuan、ChatGLM2、InternLM、Ziya2、Vicuna、Bloom等大模型

gpt alpaca 大语言模型 baichuan llama lora qlora peft llama2 internlm chatglm qwen mistral mixtral Zephyr RTOS minicpm gemma llama3 qwen2

Python 6.51 k

9 个月前

InternLM / xtuner

#大语言模型#An efficient, flexible and full-featured toolkit for fine-tuning LLM (InternLM2, Llama3, Phi3, Qwen, Mistral, ...)

baichuan chatglm2 internlm large-language-models llama2 大语言模型 llm-training peft qwen 聊天机器人 conversational-ai agent chatglm3 llava mixtral llama3 phi3

Python 4.67 k

20 天前

aandrew-me / tgpt

#大语言模型#AI Chatbots in terminal without needing API keys

ChatGPT 人工智能聊天机器人命令行界面 Go Linux macOS 终端 Windows llama mixtral gpt4

Go 2.73 k

12 天前

darrenburns / elia

#大语言模型#A snappy, keyboard-centric terminal user interface for interacting with large language models. Chat with ChatGPT, Claude, Llama 3, Phi 3, Mistral, Gemma and more.

Python 人工智能 ChatGPT gpt 终端 tui claude large-language-models llama llama3 大语言模型 mistral mixtral ollama gemma ollama-client ollama-interface

Python 2.24 k

10 个月前

kevinhermawan / Ollamac

#大语言模型#Mac app for Ollama

人工智能大语言模型 ollama mistral macOS llama3 mixtral

Swift 1.87 k

5 个月前

AI-Hypercomputer / maxtext

#大语言模型#A simple, performant and scalable Jax LLM!

large-language-models 大语言模型 gpt deepseek fine-tuning gemma2 gemma3 jax llama2 llama3 llama4 mistral mixtral sft

Python 1.85 k

2 天前

tenstorrent / tt-metal

#大语言模型#:metal: TT-NN operator library, and TT-Metalium low level kernel programming model.

机器学习 llama 大语言模型 low-level-programming metal mistral mixtral resnet stable-diffusion tenstorrent accelerator

C++ 1.02 k

1 天前

jianzhnie / LLamaTuner

#大语言模型#Easy and Efficient Finetuning LLMs. (Supported LLama, LLama2, LLama3, Qwen, Baichuan, GLM , Falcon) 大模型高效量化训练+部署.

llama ChatGPT dpo llama3 mixtral ppo qlora qwen rlhf

Python 608

6 个月前

ymcui / Chinese-Mixtral

#自然语言处理#中文Mixtral混合专家大模型（Chinese Mixtral MoE LLMs）

large-language-models 大语言模型 mixtral mixture-of-experts moe 自然语言处理

Python 603

1 年前

ModelTC / LightCompress

#大语言模型#[EMNLP 2024 Industry Track] This is the official PyTorch implementation of "LLMC: Benchmarking Large Language Model Quantization with a Versatile Compression Toolkit".

部署大语言模型 pruning quantization 工具 benchmark evaluation large-language-models internlm2 smoothquant post-training-quantization mixtral vllm deepseek-r1 deepseek-v3

Python 525

3 天前

helixml / helix

#大语言模型#♾️ Helix is a private GenAI stack for building AI agents with declarative pipelines, knowledge (RAG), API bindings, and first-class testing.

Go llama 大语言模型 mistral openai 自托管 mixtral sdxl stable-diffusion API finetuning function-calling llm-agent llm-serving OpenAPI Specification rag swagger helm Kubernetes

Go 508

19 分钟前

sozercan / aikit

#大语言模型#🏗️ Fine-tune, build, and deploy open-source LLMs easily!

buildkit large-language-models 大语言模型 Docker inference Kubernetes Nvidia 人工智能 llama ChatGPT localllama mistral mixtral gpt openai fine-tuning finetuning gemma open-llm

Go 465

3 天前

moritztng / fltr

#大语言模型#Like grep but for natural language questions. Based on Mistral 7B or Mixtral 8x7B.

大语言模型 Rust llama llama-2 localllama mistral mixtral mixtral-8x7b 命令行界面 grep 操作系统

Rust 382

1 年前

unifyai / unify

#大语言模型#Notion for AI Observability 📊

大语言模型 llm-inference claude gpt-4 llama2 mixtral gpt openai 人工智能 Python

Python 308

6 天前

WangRongsheng / Aurora

#大语言模型#The official codes for "Aurora: Activating chinese chat capability for Mixtral-8x7B sparse Mixture-of-Experts through Instruction-Tuning"

mixtral-8x7b-instruct mixtral mixtral-8x7b instruction-tuning lora qlora fine-tuning large-language-models 大语言模型 gpt language-model 中文

Python 263

1 年前

Picovoice / picollm

#自然语言处理#On-device LLM Inference Powered by X-Bit Quantization

大语言模型 compression efficient-inference gemma generative-ai language-model language-models llama llama2 llama3 mistral mixtral model-compression 自然语言处理 quantization 自托管 llm-inference

Python 259

9 天前

expectedparrot / edsl

#大语言模型#Design, conduct and analyze results of AI-powered surveys and experiments. Simulate social science and market research with large numbers of AI agents and LLMs.

anthropic data-labeling domain-specific-language experiments llama2 大语言模型 llm-agent llm-framework llm-inference mixtral Open Source openai Python surveys synthetic-data

Python 258

2 天前

inferflow / inferflow

Inferflow is an efficient and highly configurable inference engine for large language models (LLMs).

llama2 llamacpp llm-inference model-quantization multi-gpu-inference mixture-of-experts moe gemma falcon minicpm mistral bloom deepseek internlm baichuan2 mixtral qwen

C++ 245

1 年前