llama3-1 · GitHub Topics

#大语言模型#SGLang is a fast serving framework for large language models and vision language models.

CUDA inference llama llava 大语言模型 llm-serving moe PyTorch transformer vlm llama3 llama3-1 deepseek deepseek-llm deepseek-v3 deepseek-r1 deepseek-r1-zero qwen3 llama4

Python 15.14 k

10 小时前

bentoml / OpenLLM

#大语言模型#Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.

大语言模型 llmops model-inference fine-tuning llm-serving llama vicuna bentoml llama2 llm-inference llm-ops mistral mlops llama3-1

Python 11.35 k

6 天前

EmbeddedLLM / JamAIBase

#大语言模型#The collaborative spreadsheet for AI. Chain cells into powerful pipelines, experiment with prompts and models, and evaluate LLM responses in real-time. Work together seamlessly to build and iterate on...

agents 人工智能 ai-agents-framework baas 聊天机器人 lancedb 大语言模型 llm-ops Python Serverless backend-as-a-service ChatGPT orchestration rag retrieval-augmented-generation workflow Svelte Spreadsheet llama3-1

Python 1.02 k

17 天前

adalkiran / llama-nuts-and-bolts

#计算机科学#A holistic way of understanding how Llama and its components run in practice, with code and detailed documentation.

深度学习 educational-project Go large-language-models llama 机器学习 transformers unicode utf-8 llama3-1

Go 307

10 个月前

datastax / astra-assistants-api

Drop in replacement for the OpenAI Assistants API

cohere gemini gpt-4 groq openai-assistants vector assistants-api openai-assistants-api assistants claude llama3-1 ollama

Python 199

2 个月前

austin-starks / Promptimizer

#大语言模型#An Automated AI-Powered Prompt Optimization Framework

人工智能 genetic-algorithm 大语言模型机器学习 MongoDB ollama Open Source optimization prompt-engineering prompt-management anthropic llama3 llama3-1 llamacpp openai

TypeScript 192

1 年前

aimagelab / LLaVA-MORE

LLaVA-MORE: A Comparative Study of LLMs and Visual Backbones for Enhanced Visual Instruction Tuning

llama3 llama3-1 llava 大语言模型 vision-and-language deepseek-r1

Python 139

2 个月前

Debapriya-source / nyaya-gpt

#大语言模型#AI agent with RAG+ReAct on Indian Constitution & BNS

人工智能 groq llama3-1 大语言模型 rag Streamlit

Python 65

8 个月前

husaynirfan1 / simple-rag

#大语言模型#Simple RAG system.

milvus vector vector-database deepseek-r1 llama3-1 大语言模型 Python qwen2-5 nltk

Python 59

2 个月前

RMNCLDYO / perplexity-ai-toolkit

A versatile CLI and Python wrapper for Perplexity's suite of large language models including their flagship 'Sonar' models (built on top of Meta's latest and most advanced open-source model 'Llama-3.1...

perplexity perplexity-ai 聊天机器人 llama llama-3 llama3-1

Python 58

10 个月前

kyopark2014 / llama3.2-rag-bot

Multimodal RAG based on Llama 3.2

bedrock 聊天机器人 langchain llama3 llama3-1

Python 28

7 个月前

MaxiDonkey / DelphiGroqCloud

The GroqCloud API wrapper for Delphi provides access to models from Meta, OpenAI, MistralAI and Google on Groq’s LPUs, offering chat, text generation, image analysis, audio transcription, JSON output,...

API delphi gpt llama llama3-1 lpu vision groq groq-ai groq-api

Pascal 19

1 个月前

bigsk1 / ai-screen-analyzer

AI Screen Analyzer allows users to capture screenshots, analyze them using various AI providers and models, and engage in conversations about the images.

anthropic-claude ollama openai claude homelab image-recognition llama mistral 自托管 gpt4o llama3-1 ai-chatbot-framework

JavaScript 12

2 个月前

MoAshour93 / ConstructionAI

This repository contains projects developed to showcase how to apply Generative AI and open-source LLMs in the construction industry

人工智能聊天机器人 construction genai llama3-1 机器学习 open-webui

Jupyter Notebook 10

8 个月前

elizabethsiegle / bike_walk_route_map_generator

Generate an optimal path on a map a la Traveling Salesman Problem to hit different landmarks in an input city using Cloudflare Workers AI (using LlaMA-3.1), LangChain (for prompt templates and comma s...

人工智能 Cloudflare folium langchain llama3-1 mapbox Python Streamlit workers-ai

Python 7

8 个月前

harshit433 / ResurrectAI

#计算机科学#ResurrectAI is an AI-driven chat application designed to bring the wisdom and knowledge of great historical personalities to life. Leveraging advanced language models and fine-tuning techniques, Resur...

Firebase Flask Flutter html-css-javascript llama3-1 ollama Python unsloth 人工智能聊天机器人 conversational-ai language-model 机器学习

Dart 7

8 个月前

dcarpintero / ai-engineering

AI Engineering: Annotated NBs to dive into Self-Attention, In-Context Learning, RAG, Knowledge-Graphs, Fine-Tuning, Model Optimization, and many more.