NVIDIA DeepStream SDK
NVIDIA DeepStream çå¤å¹³å°æ¯æï¼ä¸ºå¼åè
æä¾äºä¸ç§æ´å¿«éãæ´ä¾¿æ·çæ¹å¼ï¼å¨ä¸åç¯å¢ä¸æå»ºåé¨ç½²é¢åçæå¼ AI æºè½ä½ä¸åºç¨ç宿¶è§é¢æµå¤çæµæ°´çº¿ãä½ çè³å¯ä»¥åªéè½»ç¹ä¸ä¸æé®ï¼å°±å°è¿äºåºç¨é¨ç½²å¨æ¬å°æºæ¿ãè¾¹ç¼è®¾å¤ä»¥åäºç«¯ã
ä»ä¹æ¯ NVIDIA DeepStreamï¼
NVIDIA DeepStream SDK æ¯ä¸æ¬¾åºäº GStreamer çç»¼åæ§å®æ¶æµåæå·¥å
·å
ï¼ç¨äºåºäº AI çå¤ä¼ æå¨å¤ç以åè§é¢ãé³é¢åå¾åçè§£ãå®é常éåå¼åè
ã软件åä½ä¼ä¼´ãååå
¬å¸å OEMï¼ä¸ºæºæ
§åå¸ãé¶å®ãå¶é çåè¡åä¸æå»ºè§è§ AI æºè½ä½ãåºç¨åæå¡ã
ä½ ç°å¨å¯ä»¥å¨å åéå
å建并é¨ç½²æµå¤çæµæ°´çº¿ï¼å°çæå¼ AI ä¸å¤æå头è·è¸ªç夿å¤çä»»å¡éæå°ä¸èµ·ã为äºè¿ä¸æ¥å éå¼åï¼DeepStream ä¹éæå¨ NVIDIA Metropolis Blueprint for Video Search and Summarization (VSS) ä¸ãè¿ä¸ªç¨äºæå»ºè§è§ AI æºè½ä½çç¤ºä¾æ¶æï¼å¯ä»¥ä»æµ·éå·¥ä¸è§é¢ä¼ æå¨æ°æ®ä¸å®æ¶æåæä»·å¼çæ´å¯ã

ä¼å¿

ä»äºç«¯å°è¾¹ç¼å¿«éé¨ç½² AI
DeepStream SDK æä¾å®æ´çè§é¢æµå¤çãæåã夿åå¤´è¿½è¸ªå·¥ä½æµï¼ä¸ 100% ç± NVIDIA GPU å éãå®é常éåå¶é ãç©æµãé¶å®çè¡ä¸çåç§ç¨ä¾ã

å°å¼åæ¶é´ç¼©çå°å åé
DeepStream ç¼ç æºè½ä½æ ¹æ®èªç¶è¯è¨æç¤ºçæå®æ´çè§é¢åææµç¨ï¼å°æµç¨å建æ¶é´ä»æ°å¨ç¼©çå°æ°å°æ¶ã

宿¶æ´å¯
ä»å¾åãè§é¢åæ¿å é·è¾¾çä¼ æå¨æ°æ®ä¸å®æ¶æå丰å¯çå æ°æ®ã

åå© NVIDIA GPU å®ç°æä½çæ»ä½æ¥æææ¬
éè¿å¨ NVIDIA 硬件ä¸ä½¿ç¨ DeepStream é¨ç½² AI 模åï¼æé«æµå¯åº¦ãæ´å¤§éåº¦å°æé«æ§è½å¹¶æ´å¤§é度å°éä½ TCOã

å¤ç§ç¼ç¨é项
ä½¿ç¨ C/C++ å Python å建åè½å¼ºå¤§çè§è§ AI åºç¨ã
ç¬ç¹åè½
åå©ç¼ç æºè½ä½å GPU å éæä»¶å éè§è§ AI å¼å
DeepStream å¼å§ä¸ºåºäº AI çè§é¢ãé³é¢åå¾ååæå¼åæ ç¼ç宿¶æµå¼ä¼ è¾å·¥ä½æµãå®é带 40 å¤ä¸ªç¡¬ä»¶å éæä»¶ä»¥å 30 å¤ä¸ªç¤ºä¾åºç¨ç¨åºåæ©å±ç¨åºï¼å¯ä¼åé¢å¤ç/ åå¤çãæ¨çã夿å头è·è¸ªãæ¶æ¯ä»£ççã
DeepStream ç¼ç ä»£çæ ¹æ®èªç¶è¯è¨æç¤ºèªå¨çæå®æ´ã符å FlowAPI ç DeepStream 工使µï¼ä»èå°è§è§ AI å¼åæ¶é´ä»æ°å¨ç¼©çå°æ°å°æ¶ãDeepStream ç¼ç æºè½ä½å¯ä»¥ä½¿ç¨æ¨çæå»ºå¨å©ç¨å¤§éæ¨¡æ¿æ¥ç¡®ä¿ä»£ç è´¨éã
DeepStream Service Maker éè¿æ½è±¡å GStreamer çå¤ææ§æ¥è½»æ¾æå»ºé¢å对象ç C++ åºç¨ç¨åºï¼ä»èç®åå¼åæµç¨ãä½¿ç¨ Service Makerï¼åªéå è¡ä»£ç å³å¯æå»ºå®æ´ç DeepStream 工使µ
DeepStream åºç± NVIDIA® CV-CUDA®ãNvImageCodec å PyNvVideoCodec æä¾æ¯æï¼å¯æä¾ä½çº§å« GPU å éæä½ï¼ä»¥ä¼åè§è§ AI æµç¨çååé¶æ®µã
å¨å¤ç§æå头ä¹é´å¯ç¨å¤æå头è·è¸ª
å¤è§å¾ 3D 追踪 (MV3DT) æ¯ DeepStream NvTracker çæ©å±ï¼å¯å®ç°è·¨æå头ç½ç»çåå¸å¼å®æ¶ 3D 追踪ãå®ä¸ 2D å 3D æ£æµå¨æ ç¼é
åï¼æ¯æå¹¿æ³çç¨ä¾ãDeepStream ä¼èªå¨ä¸ºæ°å¯¹è±¡åé
å¯ä¸ IDï¼éè¿é®æ¡å忢æ¥ä¿ç身份ã
为å®ç°ç²¾ç¡®ç夿å头追踪ï¼DeepStream å
嫿°çæ ¡åå·¥å
·ï¼å¯åæ¶å°å¤ä¸ªæå头ä¸é¨ç½²å¹³é¢å¾å¯¹é½ãè¿å¯åå°äººå·¥å·¥ä½éï¼å¹¶ç¡®ä¿ç»æä¸è´ä¸åç¡®ã
æå»ºç«¯å°ç«¯ AI è§£å³æ¹æ¡
åå© NVIDIA Metropolis æå»ºç«¯å°ç«¯è§è§ AI åºç¨ï¼å å¿«æ´ä½å¼åå·¥ä½ï¼å¹¶è§£éæ´åºè²ç宿¶æ§è½ãä»ç产级è§è§ AI 模åå¼å§ï¼ä½¿ç¨ NVIDIA TAO å·¥å
·å¥ä»¶è°æ´åä¼åè¿äºæ¨¡åï¼ç¶åä½¿ç¨ DeepStream è¿è¡é¨ç½²ãä½¿ç¨ Metropolis VSS Blueprint æå»ºå¯ä»¥åæ¶å¤çæ°åä¸ªå®æ¶è§é¢çè§è§ AI æºè½ä½ï¼ä»¥æ¨å¨æ´å¯ååèªå¨åã
è·å¾ä»¤äººæå¹ççµæ´»æ§ (ä»å¿«éåå设计å°å®æ´ççäº§çº§è§£å³æ¹æ¡) ï¼å¹¶éæ©æ¨çè·¯å¾ãä¸ NVIDIA åçéæÂ Triton⢠æ¨çæå¡å¨æ¨å¯ä»¥å¨ PyTorch å TensorFlow çåçæ¡æ¶ä¸é¨ç½²æ¨¡å以è¿è¡æ¨çã对äºé«åå鿍çï¼è¯·ä½¿ç¨ NVIDIA TensorRT å®ç°æä½³æ§è½ã
享åä»è¾¹ç¼å°äºç«¯çæ ç¼å¼å
åå© DeepStream çç°æå®¹å¨ï¼æ¨åªé䏿¬¡æå»ºï¼å³å¯å¨äºç«¯ãæè½½ NVIDIA GPU çå·¥ä½ç«æ NVIDIA Jetson⢠设å¤ä¸çä»»æä½ç½®è¿è¡é¨ç½²ãåå© DeepStream Container Builder å NGC 容å¨ï¼æ¨å¯ä»¥è½»æ¾åå»ºç± Kubernetes å Helm 管çç坿©å±ã髿§è½ AI åºç¨ã
åå© DeepStream REST-APIï¼æ¨è¿å¯ä»¥å¨è¿è¡æ¶ç®¡çå¤ä¸ªåæ°ï¼ä»èç®å SaaS è§£å³æ¹æ¡çå建ãå婿 åç REST-API æ¥å£ï¼æ¨å¯ä»¥æå»ºç¨äºæ§å¶åé
ç½®ç Web 鍿·ï¼æå°å
¶éæå°ç°æåºç¨ä¸ã
为ç产å好åå¤
DeepStream ä½ä¸º NVIDIA AI Enterprise çä¸é¨åæä¾ï¼NVIDIA AI Enterprise æ¯ä¸ä¸ªç«¯å°ç«¯ãå®å
¨ãäºåçç AI 软件平å°ï¼ç»è¿ä¼åï¼å¯å éä¼ä¸è¿å
¥ AI åæ²¿ã
NVIDIA AI Enterprise å¯æä¾ NVIDIA AI 弿ºè½¯ä»¶çéªè¯åéæãå¯ç¼©çç产æ¶é´ç AI è§£å³æ¹æ¡å·¥ä½æµãå¯å¨ä»»æä½ç½®é¨ç½² AI ç认è¯ï¼ä»¥åå¯éä½å¼æºè½¯ä»¶æ½å¨é£é©çä¼ä¸çº§æ¯æãå®å
¨æ§å API ç¨³å®æ§ã

æ¢ç´¢æå»º DeepStream 工使µçæ¹æ³
ç¼ç æºè½ä½
使ç¨èªç¶è¯è¨æç¤ºï¼ä½¿ç¨ Cloude Code æ Cursor çæå®æ´ç DeepStream 工使µï¼å¹¶å°ç¼ç æ¶é´ä» 8 å¨ç¼©çå° 8 å°æ¶ã
Python
ä½¿ç¨ Gst Python ( GStreamer æ¡æ¶ç Python ç»å®) æå»º DeepStream 工使µãæ¨å¯å¨ GitHub ä¸è·åç»å®å Python 示ä¾åºç¨çæºä»£ç ã
C/C++
ä½¿ç¨ C/C++ å建åºç¨ãç´æ¥ä¸ GStreamer å DeepStream æä»¶äº¤äºï¼ä»¥å使ç¨åèåºç¨å模æ¿ã
æé«åç¡®æ§å宿¶æ§è½
DeepStream å¯ä¸ºåç§ç©ä½æ£æµãå¾åå¤çåå®ä¾åå² AI 模åæä¾åºè²çååéãä¸è¡¨æ¾ç¤ºäºä»æ°æ®æåãè§£ç ãå¾åå¤çå°æ¨çç端å°ç«¯åºç¨ç¨åºæ§è½ãå®éè¦å¤ä¸ª 1080p/ 30fps çæµä½ä¸ºè¾å ¥ã请注æï¼å¨ Jetson 设å¤ç DLA ä¸è¿è¡å¯ä»¥éæ¾ GPU æ¥å¤çå ¶ä»ä»»å¡ãå¯¹äºæ§è½æä½³å®è·µï¼è§çæ¤è§é¢æç¨ã
| Foundation Model | Tracker | Precision | Jetson Thor | DGX Spark | L40S | RTX PRO 4500 | B200 | RTX PRO⢠WS | RTX PRO SE |
|---|---|---|---|---|---|---|---|---|---|
| MaskGroundingDINO V2 | No Tracker | FP16 | 23 | 21 | 102 | 63 | 216 | 102 | 101 |
| C-RADIO-Base | No Tracker | FP16 | 1258 | 969 | 2989 | 2050 | 8204 | 4131 | 3754 |
| C-RADIO-Large | No Tracker | FP16 | 547 | 337 | 1097 | 647 | 3831 | 1497 | 1303 |
| NV-DinoV2-Large | No Tracker | FP16 | 431 | 239 | 873 | 533 | 3568 | 1292 | 1173 |
| RT-DETR | No Tracker | FP16 | 195 | 160 | 649 | 345 | 1280 | 659 | 978 |
| RT-DETR | NvDCF | FP16 | 171 | 153 | 615 | 316 | 1249 | 640 | 955 |
| RT-DETR | MV3DT | FP16 | 90 | 100 | 237 | 257 | 900 | 645 | 537 |
| TrafficCamNet Transformer Lite | NvDCF | FP16 | 144 | 139 | 665 | 369 | 1088 | 650 | 918 |
| Peoplenet2.6.3 | MV3DT | FP16 | 363 | 350 | 724 | 595 | 2016 | 1225 | 763 |
| Peoplenet Transformer | MV3DT | FP16 | 24 | 13 | 137 | 78 | 230 | 208 | 175 |
| Grounding-DINO | No Tracker | FP16 | 23 | 21 | 101 | 63 | 218 | 103 | 102 |
| SegFormer + C-RADIO-Base | No Tracker | FP16 | 253 | 201 | 1008 | 435 | 1488 | 1236 | 1061 |
| Mask2Former + SWIN | No Tracker | FP16 | 26 | 29 | 76 | 70 | 144 | 75 | 99 |
å¦é详ç»äºè§£ä½¿ç¨ DeepStream çæ§è½ï¼è¯·æ¥çææ¡£ã
é
è¯»å®¢æ·æ¡ä¾

æååå¸å®å
¨ä¸åºè¡æç
ç½å©å¸ä½¿ç¨ NVIDIA DeepStream å VSS Blueprint æå»º AI æºè½ä½ï¼å¹¶ä»¥ 4 åçé度æä¾å®æ¶è§è§£ï¼è¿å¯è½æ¯å¹´ä¸ºéå¤è
èç约 970 ä¸ç¾å
çæ¶é´åçæææ¬ã

æåé éä¸å¿çè¿è¥
KoiReader ä½¿ç¨ NVIDIA å¼åè å·¥å · (å æ¬ DeepStream SDK) å¼åäº AI èµè½çæºå¨è§è§è§£å³æ¹æ¡ï¼å¸®å©ç¾äºå ¬å¸å¨å¨æååç¯å¢ä¸å®ç°ç²¾åº¦åæçã

ä¼åçå ç½å°æºåºçè¿è¥
Industry.AI ä½¿ç¨ NVIDIA Metropolis å æ (å æ¬ DeepStream) æ¥æé«æºåºçå®å ¨æ§åæçãåå©è§è§ AIï¼å®è½å¤è¿½è¸ªè¢«éå¼çè¡æãæ è®°é¿ä¹å®¢éåï¼å¹¶æéå®å ¨å¢éæ½å¨çé®é¢ã
ä¸è¬å¸¸è§é®é¢è§£ç
DeepStream æ¯ä¸æ¬¾éæº SDKã请注æï¼ææåèåºç¨çæºä»£ç åå¤ä¸ªæä»¶åå¯ç¨ãDeepStream æ¨çæå»ºå¨å°å¼æºå¹¶å¯éè¿Â GitHub è·åã
DeepStream SDK å¯ç¨äºæå»º AI èµè½ç端å°ç«¯åºç¨ï¼ä»¥åæè§é¢åä¼ æå¨æ°æ®ãä¸äºçé¨ç¨ä¾å æ¬é¶å®åæãå车管çãç©æµç®¡çãå 妿£æµãæºå¨äººåä½è²åæã
请åé å¹³å°åæä½ç³»ç»å ¼å®¹æ§è¡¨ã
æ¯çï¼ç°å¨éè¿éæ Triton æ¨çæå¡å¨â¢ï¼è¿ä¸åå¾ä»¥å®ç°ãæ¤å¤ï¼ä» DeepStream 6.1.1 å¼å§ï¼åºç¨å¯ä»¥ä½¿ç¨ gPRC ä¸ Triton æ¨çæå¡å¨çç¬ç«/è¿ç¨å®ä¾è¿è¡éä¿¡ã
DeepStream æ¯æå¤ç§å¼ç®±å³ç¨çç鍿¨¡åãä¾å¦ï¼DeepStream æ¯æææ NVIDIA TAO 模åï¼å¹¶é带è¿è¡ YOLO 模åç示ä¾ã
æ¯ï¼DeepStream 8.0 ææ´é«çæ¬æ¯æ NVIDIA Blackwell æ¶æã
DeepStream ä¸åç´æ¥æ¯æèªå¨è¯é³è¯å« (ASR) åææ¬è½¬è¯é³ (TTS) çé³é¢å¤çåè½ãéè¦è¯é³è¯å«æè¯é³åæç客æ·åºä½¿ç¨ NVIDIA Riva è¯é³ AI SDKï¼è¯¥ SDK æä¾é对 NVIDIA GPU ä¼åçç产级 ASR å TTS æå¡ã
ä½¿ç¨ DeepStream SDK æå»ºé«æ§è½è§è§ AI åºç¨åæå¡ã

