structured-generation

Structured Outputs

#大语言模型#The AI framework that adds the engineering to prompt engineering (Python/TS/Ruby/Java/C#/Rust/Go compatible)

#Awesome#Resource list for generating JSON using LLMs via function calling, tools, CFG. Libraries, Models, Notebooks, etc.

Fast, Flexible and Portable Structured Generation

Faster structured generation

#大语言模型#AI辅助长篇小说创作，卡片式创作，支持基于 JSON Schema的结构化 AI 生成与上下文引用，可扩展性强。

Experimental Code for StructuredRAG: JSON Response Formatting with Large Language Models

#自然语言处理#Query language for blending SQL and LLMs across structured + unstructured data, with type constraints.

#自然语言处理#Plug-and-play document processing pipelines with zero-shot models.

TensorRT-LLM server with Structured Outputs (JSON) built with Rust

Building Agents with LLM structured generation (BAML), MCP Tools, and 12-Factor Agents principles

Extract structured data from local or remote LLM models

Extract structured data from local or remote LLM models

#大语言模型#The developper starter pack for document processing

Structured Generation Evals

#自然语言处理#Use `outlines` generators with Haystack.

#自然语言处理#A guide to structured generation using constrained decoding

#大语言模型#Python for logic. English for intelligence.

#大语言模型#Speculative grammar backtracking algorithm for LLM decoding conforming to some lark context-free grammar (CFG)

Presentación en la conferencia IADevs 2024: Potenciando la Generación Aumentada usando Recuperación con Grafos de Conocimiento