Hauv kev lag luam thev naus laus zis, koj tuaj yeem tsis tshua muaj kev sib tham yam tsis muaj ib tus neeg hais txog kev xav, kev txawj ntse (AI), thiab kev kawm tshuab (ML). Txawm li cas los xij, nws tseem ceeb heev uas yuav tsum nco ntsoov tias thaum tag nrho cov ntsiab lus no sib cuam tshuam, lawv kuj txawv heev.
Hauv tsab xov xwm no, peb yuav piav qhia txog qhov sib txawv ntawm qhov tseem ceeb thiab hais txog qhov tseem ceeb ntawm kev siv tensor processing-raws li edge AI technology, tshwj xeeb tshaj yog nyob rau hauv ntug thiab embedded systems. Piv nrog rau cov kev daws teeb meem raws li cov duab ua haujlwm (GPUs), tensor processing units (TPUs) muab cov txiaj ntsig zoo dua thiab tus nqi - ua haujlwm tau zoo. Peb kuj tseem yuav muab qee qhov piv txwv siv piv txwv qhia qhov uas koj tuaj yeem ntsib cov kev daws teeb meem AI yav tom ntej.
Cov ntsiab lus ntawm ML thiab Inference
ML hais txog cov txheej txheem ntawm kev cob qhia cov qauv siv cov ntaub ntawv sawv cev los pab cov tshuab kom kawm paub ua haujlwm li cas. Cov txheej txheem no tuaj yeem suav nrog kev siv ntau heev, tsim kev lag luam trillions ntawm cov ntaub ntawv qhia tshiab. Qhov xwm txheej ntawm cov txheej txheem kev cob qhia, ua ke nrog cov ntaub ntawv qhia ntau heev uas xav tau kom ua tiav qhov raug siab, ua rau qhov kev thov rau siab heev -kev ua tau zoo ntab - taw tes ua. Kev cob qhia ML yog qhov zoo tshaj plaws ua raws li cov ntaub ntawv chaw tsim kho, qhov twg cov peev txheej siab thiab cov nqi ua haujlwm tuaj yeem raug txiav txim siab los ntawm kev txiav lawv hla ntau tus neeg siv khoom.
Inference suav nrog kev siv cov qauv kev cob qhia los tsim kom muaj peev xwm sib tw rau cov ntaub ntawv tshiab cuam tshuam rau cov ntaub ntawv sawv cev uas tus qauv tau kawm. Inference aims kom xa cov lus teb sai nyob rau hauv milliseconds. Piv txwv ntawm kev xav suav nrog kev paub txog kev hais lus, tiag -lub sijhawm txhais lus, tshuab pom kev, thiab kev txiav txim siab zoo tshaj plaws ntawm kev tshaj tawm. Txawm hais tias qhov kev xav tau tsuas yog ib feem ntawm lub zog ua haujlwm uas xav tau rau kev cob qhia, nws tseem nyob deb tshaj li qhov chaw ua haujlwm hauv nruab nrab (CPU) -raws li cov tshuab tuaj yeem xa tuaj, tshwj xeeb tshaj yog rau kev siv computer tsis pom kev. Qhov no yog vim li cas thiaj li muaj ntau lub tuam txhab tig mus rau tensor-raws li kev daws teeb meem nrawm-txawm yog IP ntawm SoCs lossis hauv - cov txheej txheem nrawm- kom ua tiav cov sub- lub sijhawm teb thib ob uas xav tau ntawm ntug. Qhov tseeb yog tias siv ib feeb lossis ob peb feeb ua cov duab hauv lub zeem muag tsis muaj txiaj ntsig zoo. Cov tshuab pom kev lag luam tab tom nrhiav millisecond- theem ua kom nrawm.
Separating Training thiab Inference
Kev xa cov khoom siv tib yam siv rau kev cob qhia los tswj cov kev ua haujlwm inference tuaj yeem ua rau ntau tshaj - muab cov tshuab inference nrog cov accelerators thiab CPU hardware. GPU cov kev daws teeb meem tsim los rau ML nyob rau hauv kaum xyoo dhau los tsis tas yuav yog qhov kev xaiv zoo tshaj plaws rau kev xa tawm loj ntawm ML inference technologies. Daim duab hauv qab no zoo kawg nkaus qhia txog kev sib piv ntawm TPU accelerators thiab GPU accelerators. Nws qhia meej meej tias TPU cov khoom siv nrawm xa cov kev siv hluav taws xob qis dua, txo cov nqi, thiab kev ua haujlwm siab dua piv rau GPU-raws li AGX cov kev daws teeb meem, thaum tseem muab cov qib kev ua tau zoo rau cov ntawv siv inference.

Lwm qhov kev txiav txim siab tseem ceeb thaum mus txog ML kev cob qhia thiab kev daws teeb meem yog qhov software ib puag ncig. Niaj hnub no, ntau lub tsev qiv ntawv nrov tau siv, xws li CUDA rau NVIDIA GPUs, ML lub luag haujlwm zoo li TensorFlow thiab PyTorch, ua kom zoo hla - qauv tsev qiv ntawv zoo li Keras, thiab ntau dua. Cov cuab yeej siv no yog qhov tseem ceeb rau kev tsim thiab cob qhia ML qauv, tab sis cov ntawv thov kev xav xav tau ib qho sib txawv, me me ntawm cov cuab yeej software.
Inference toolkits tsom rau cov qauv khiav ntawm lub hom phiaj platforms. Lawv txhawb nqa cov qauv kev cob qhia rau cov platforms, uas tuaj yeem koom nrog qee qhov kev hloov pauv tus neeg teb xov tooj, quantization, thiab kev pabcuam kev koom ua tswv cuab. Txawm li cas los xij, qhov no sawv cev rau cov txheej txheem ua haujlwm ncaj nraim piv rau cov uas xav tau rau kev tsim qauv thiab kev cob qhia.
Cov cuab yeej inference tau txais txiaj ntsig los ntawm kev pib nrog tus qauv sawv cev ntawm tus qauv. Open Neural Network Exchange (ONNX) yog hom qauv rau sawv cev ML qauv. Raws li lub npe cuam tshuam, nws yog tus qauv qhib tswj raws li Linux Foundation project. Cov thev naus laus zis zoo li ONNX tso cai rau kev txiav txim siab ntawm kev cob qhia thiab kev tsim cov txheej txheem, tso cai rau cov neeg tsim khoom muaj kev ywj pheej xaiv cov platforms sib txawv rau txhua qhov.
Piv txwv Visual Applications
Raws li ML thiab inference processor technologies txuas ntxiv mus thiab evolve, daim ntaub ntawv yog proliferating. Hauv qab no tsuas yog ob peb qhov chaw koj tuaj yeem ntsib cov thev naus laus zis no yav tom ntej.
Edge servers hauv kev lag luam xws li cov chaw tsim khoom, tsev kho mob, khw muag khoom, thiab cov tuam txhab nyiaj txiag. Piv txwv li, nyob rau hauv kev lag luam chaw, AI tuaj yeem pab nrog kev tswj cov khoom muag, kuaj xyuas qhov tsis raug, thiab txawm tias kev saib xyuas ua ntej muaj teeb meem tshwm sim. Hauv khw muag khoom, nws ua kom muaj cov yam ntxwv zoo li kev kwv yees, siv lub zeem muag hauv computer txhawm rau txheeb xyuas thiab txheeb xyuas tib neeg lub cev. Cov ntaub ntawv los ntawm qhov kev tshuaj ntsuam no pab cib- thiab- cov neeg muag khoom mortar zoo dua nkag siab txog tib neeg tus cwj pwm thiab kev taug kev hauv ko taw hauv lawv lub khw, ua rau lawv ua kom zoo tshaj plaws hauv khw muag khoom kom muaj kev muag khoom siab tshaj plaws thiab cov neeg siv khoom txaus siab.
High-precision/high-kev ua haujlwm zoo rau cov ntawv thov suav nrog cov neeg hlau, kev lag luam automation/kev tshuaj xyuas, kev kuaj pom kev kho mob, kev kuaj pom kev tshawb fawb, kev soj ntsuam thiab lub koob yees duab paub txog cov khoom, thiab photonics. Piv txwv li, cov txheej txheem kev kawm tshuab tau pom tias muaj peev xwm kuaj mob qog noj ntshav los ntawm kev ua cov X-rays. Cov txheej txheem no suav nrog kev tsim tus qauv ML tsim los ua cov duab X-ray duab, feem ntau yog siv cov txheej txheem kev cob qhia semantic segmentation algorithms los txheeb xyuas qhov mob qog noj ntshav. Thaum lub sij hawm kawm, cov duab mob qog noj ntshav uas txheeb xyuas los ntawm cov kws tshawb fawb hluav taws xob tau siv los qhia lub network yam tsis yog mob qog noj ntshav, mob qog noj ntshav dab tsi, thiab hom mob qog noj ntshav sib txawv li cas. Qhov ntau tus qauv ML raug cob qhia, qhov zoo dua nws yuav ua rau kom muaj txiaj ntsig zoo thiab txo qis kev kuaj mob. Qhov no txhais tau hais tias kev kawm tshuab tsis yog tsuas yog siv tus qauv tsim qauv ntse xwb tab sis sib npaug ntawm cov nyiaj ntau (ntau txhiab mus rau lab) ntawm cov ntaub ntawv ua tib zoo kho cov piv txwv uas mob qog noj ntshav tau txheeb xyuas tau zoo.
Smart Shopping Carts- Ntau lub tuam txhab tab tom tsim thiab siv cov khoom lag luam ntse uas lees paub cov khoom tsis yog los ntawm lawv cov UPC barcodes, tab sis los ntawm qhov muag pom ntawm lub ntim nws tus kheej. Qhov tshwj xeeb no tso cai rau cov neeg yuav khoom yooj yim tso cov khoom rau hauv lub laub lossis mus rau hauv lub kaw lus tsis tas yuav nrhiav UPC code thiab luam theej duab nrog UPC laser scanner. Cov thev naus laus zis no ua rau cov txheej txheem yuav khoom muaj tseeb, nrawm dua, thiab yooj yim dua.
Ua Kev Txiav Txim Siab
Cov tuam txhab yuav tsum ntsuas tag nrho cov kev daws teeb meem niaj hnub no thiab xaiv qhov zoo tshaj plaws raws li lawv qhov kev siv tshwj xeeb. Lawv kuj tsis tuaj yeem xav tias txhua qhov kev daws teeb meem AI tau ua tiav zoo tshaj plaws ntawm GPU cov khoom siv, raws li TPU- cov kev daws teeb meem muaj kev ua haujlwm ntau dua thiab siv silicon qis, yog li txo qis kev siv hluav taws xob thiab nqi.




