Query language for blending SQL and local language models across structured + unstructured data, with type constraints.

Reproduction Package for the paper "Type-Constrained Code Generation with Language Models" [PLDI 2025]

Constrained Decoding of Diffusion LLMs with Context-Free Grammars.

📐 Just-in-time logic enforcement for network data generation with LLMs

For our ICRA 2025 paper 🏆 "SELP: Generating Safe and Efficient Task Plans for Robot Agents with Large Language Models" by Yi Wu, Zikang Xiong, Yiran Hu, Shreyash Iyengar, Nan Jiang, Aniket Bera, Lin Tan, and Suresh Jagannathan. (🏆 Best Paper Award Finalist!)

Code for paper "Extract, Denoise and Enforce: Evaluating and Improving Concept Preservation for Text-to-Text Generation" EMNLP 2021 and "Constrained Abstractive Summarization: Preserving Factual Consistency with Constrained Generation" arXiv 2020

A guide to structured generation using constrained decoding

Speculative grammar backtracking algorithm for LLM decoding conforming to some lark context-free grammar (CFG)

Constraint-driven code generation that transforms AI from probabilistic guessing into controlled search through valid program spaces.

[Pytorch] Efficient tokenization library for recommendations and generative retrieval using pre-trained language models. Inspired by "Vectorizing the Trie: Efficient Constrained Decoding for LLM-based Generative Retrieval on Accelerators"

PEG grammars as LLM output constraints. TypeScript-native parser generator with parametric rules.

VibeDrift - Run any LLM on your own hardware. Bypass the VRAM wall with CPU/RAM inference, MOE expert offloading, and 4-bit quantization. No Cloud, no Subscription.

🧠 Visualize token-by-token sampling with chat templates, nucleus filtering, constrained decoding, and attribution heatmaps in one local app ⚡

The official zero-trust, high-throughput kinetic execution engine for the coreason-manifest ontology.

TexLM: Synthesizing Reliable Latex Matrix from Natural Language Input

ServiceNow → GBNF grammar + iii worker generator | Open-source deterministic AI connector

Context-Free Grammar-guided Generation of FHIR Resources Using Large Language Models

Self-organizing knowledge graph

MAZE is an adaptive constraint-based code generation system that combines Large Language Models (LLMs) with formal constraint enforcement to produce more accurate and contextually appropriate code.

Function calling tool that translates natural language prompts into structured function calls