Structured Text Generation
#大语言模型#The AI framework that adds the engineering to prompt engineering (Python/TS/Ruby/Java/C#/Rust/Go compatible)
#Awesome#Resource list for generating JSON using LLMs via function calling, tools, CFG. Libraries, Models, Notebooks, etc.
Fast, Flexible and Portable Structured Generation
Faster structured generation
Experimental Code for StructuredRAG: JSON Response Formatting with Large Language Models
#自然语言处理#Query language for blending SQL and LLMs across structured + unstructured data, with constrained decoding.
#自然语言处理#Plug-and-play NLP pipelines without training.
TensorRT-LLM server with Structured Outputs (JSON) built with Rust
Extract structured data from local or remote LLM models
Extract structured data from local or remote LLM models
#大语言模型#The developper starter pack for document processing
Structured Generation Evals
#自然语言处理#Use `outlines` generators with Haystack.
#自然语言处理#A guide to structured generation using constrained decoding
Building Agents with LLM structured generation (BAML), MCP Tools, and 12-Factor Agents principles
#大语言模型#Speculative grammar backtracking algorithm for LLM decoding conforming to some lark context-free grammar (CFG)
Presentación en la conferencia IADevs 2024: Potenciando la Generación Aumentada usando Recuperación con Grafos de Conocimiento
Word alignment of multilingual sentences using structured generation
Presentation at PyData Global: Building Knowledge Graph-Based Agents with Structured Text Generation and Open-Weights Models