NVIDIA TensorRT RTX 示例:用 C++ 构建本地 AI 应用
Build Local AI Apps with C++ and NVIDIA TensorRT RTX Samples
NVIDIA 发布 Do Inference Now (DIN) Deploy,一个开源 C++ 示例集合,将 ONNX Runtime 与 NVIDIA TensorRT RTX 执行提供程序结合,帮助开发者把模型 checkpoint 转到本地原生应用。该示例面向需要可移植模型格式、可靠运行时和跨目标系统加速的本地 AI 场景。
Adding AI models to local applications requires a portable model format, a reliable runtime, and acceleration that works across target systems. Do Inference Now...
Adding AI models to local applications requires a portable model format, a reliable runtime, and acceleration that works across target systems. Do Inference Now (DIN) Deploy is an open-source collection of practical C++ samples that bridges that gap. It combines ONNX Runtime with the NVIDIA TensorRT RTX execution provider to help developers move from a model checkpoint to a native…
来源:NVIDIA Developer Blog · developer.nvidia.com