Pinned Loading

1. tensorrt-insight tensorrt-insight Public

   Deep insight tensorrt, including but not limited to qat, ptq, plugin, triton_inference, cuda

   C++ 23 1

2. xinfer xinfer Public

   AI infer engine

   C++ 10

3. llm-deploy llm-deploy Public

   AI Infra LLM infer/ tensorrt-llm/ vllm

   Python 24 1

4. auto_qat auto_qat Public

   auto qat for nv tensorrt

   Jupyter Notebook

5. NVIDIA/TensorRT-Edge-LLM NVIDIA/TensorRT-Edge-LLM Public

   High-performance, light-weight C++ LLM and VLM Inference Software for Physical AI

   Python 404 67