Overview

AI Inference Overview

Xilinx provides a comprehensive Hardware and Software solution to enable AI Inference. The diagram below shows the high level components.
?

Frameworks
Models
Custom
Model Zoo
Custom
Implementation Software
Data Center
Edge
Hardware
Data Center
Edge
Hardware Overlay (DSA)
Board
Custom
Custom
Silicon

ai-overview1

?

  • Xilinx adaptable hardware can accelerate most AI/ML models when deployed in inference applications
  • The model is optimized by Xilinx’s tools which work with industry standard frameworks
  • Once optimized, the model works with Xilinx runtime and driver software, with optimized portions running in Xilinx hardware
  • Migration is designed to be straightforward and requires no hardware expertise or FPGA programming experience

?

?

  • Xilinx’s AI Optimization tools provide Deep Neural Network (DNN) pruning and quantization and other optimization capabilities to reduce the size of the model with minimal impact on accuracy.
  • Typically models are quantized to 16-bit or 8-bit for inference implementation, although custom precision can be used depending on exact application.
ai-ml-tab1-2
Applications
Frameworks

Supported AI Frameworks

The Xilinx AI Platform supports a number of industry-standard frameworks, highlighted in the table below.

Framework Description Data Center AI Platform Support Edge AI Platform Support
TensorFlow is an open-source framework developed by Google. ? ?
CAFFE is an open-source framework developed at UC Berkeley. ? ?
MXNet is an open-source framework developed by Apache. ? ?
Darknet is an open-source framework developed by Joseph Redmon. ? ?
Keras is an open source high-level API capable of running on top of several other frameworks. ? ?
Onnx is an open-source graph model and standardized operator definition. It works in conjunction with several frameworks. It was created by Facebook and Microsoft. Coming Soon ?
Models

Models

The Xilinx AI Platform supports many AI/ML Models supported as shown below. We are continually working to bring the latest models into our platform.

Application Task Algorithm Data Center AI Platform Support Edge AI Platform Support
General Image classification Googlenetv1, Resnet50, Resnet101, Resnet152 Inception v1, BN-inception, VGG16, SqueezeNet, Mobilenet , MobilenetV2 ??(Subset) ??(Subset)
Object Detection MobilnetV2-SSD, SSD, YOLO v2, YOLO v3, Tiny YOLO v2, Tiny YOLO v3 ??(Subset) ?
Segmentation ENet, ESPNet ? ?
?Face Face detection SSD, Densebox ? ?
Landmark Localization Coordinates Regression ? ?
Face recognition ResNet + Triplet / A-softmax Loss ? ?
Face attributes recognition Classification and regression ? ?


Pedestrian
Pedestrian Detection SSD ? ?
Pose Estimation Coordinates Regression ? ?




Video Analytics
Object detection SSD, RefineDet ? ?
Pedestrian Attributes Recognition GoogleNet Coming Soon ?
Car Attributes Recognition GoogleNet Coming Soon ?
Car Logo Recognition Modified Densebox + GoogleNet Coming Soon ?
License Plate Detection Modified DenseBox Coming Soon ?
License Plate Recognition GoogleNet + Multi-task Learning Coming soon ?



ADAS/AD
Object Detection SSD, YOLOv2, YOLOv3 ? ?
Lane Detection VPGNet ? ?
Semantic Segmentation FPN ? ?
Data Center

Data Center AI Platform

The Data Center AI Platform Supports industry-standard frameworks

You can bring your own trained model or start with one from our model zoo

Xilinx ML suite provides comprehensive optimization for optimal FPGA implementation, together with a runtime and hardware DSA

Target a Xilinx Alveo accelerator card, your own custom card, or FPGA-as-a-Service such as Amazon AWS
?

datacenter-tab1
Edge

AI Edge Platform

The Xilinx Edge AI Platform provides comprehensive tools and models which utilize unique deep compression and hardware-accelerated Deep Learning technology.

The platform provides efficient, convenient and economical inference deployments for embedded-CPU-based FPGAs.

The Xilinx AI team consists of renowned researchers and experienced professionals known for their pioneering work in? the field of deep learning.
?

edge-ai-platform
手机购彩网 临海市 湖北省 钟祥市 大同市 兰溪市 湘潭市 松滋市 铁力市 彭州市 厦门市 宜春市 邹城市 彭州市 山东省 金昌市 平度市 海南省 双滦区 忻州市 葫芦岛市 十堰市 平度市 潞城市 临沂市 阜新市 普兰店市 汉川市 兴城市 都匀市 枣庄市 安达市 烟台市 高邮市 梅河口市 江油市 白银市 丰城市 孝义市 石首市 池州市 葫芦岛市 福建省 金华市 梅河口市 胶州市 上虞市 大石桥市 江阴市 吉首市 大庆市 铁力市 深州市 山西省 厦门市 项城市 永州市 原平市 明光市 耒阳市