Products

Developers

Resources

Company

Products

Developers

Resources

Company

Products

Developers

Resources

Company

MLA100 PCIe Card

MLA100 PCIe Card

MLA100 PCIe Card

The MLA100 PCIe Card brings ARIES AI inference to standard servers and PCs. It’s a single-slot card with a 25W TDP that runs vision, language and multimodal models without replacing your entire system infrastructure.

AI performance (Dense, INT8)

80 TOPS

80 TOPS

Power (TDP)

Power (TDP)

25W

25W

Form factor

Form factor

Single slot

Single slot

Memory

Memory

16GB LPDDR4X

16GB LPDDR4X

Scaling inference on GPUs means scaling power, cooling and rack space

GPUs are the right tool for training and prototyping. Running inference around the clock is different. A workstation-class GPU draws 230–450W and takes two or three slots, and the cooling bill grows with every card. For a server that only needs to run models, most of that is overhead.

Scaling inference on GPUs means scaling power, cooling and rack space

GPUs are the right tool for training and prototyping. Running inference around the clock is different. A workstation-class GPU draws 230–450W and takes two or three slots, and the cooling bill grows with every card. For a server that only needs to run models, most of that is overhead.

Scaling inference on GPUs means scaling power, cooling and rack space

GPUs are the right tool for training and prototyping. Running inference around the clock is different. A workstation-class GPU draws 230–450W and takes two or three slots, and the cooling bill grows with every card. For a server that only needs to run models, most of that is overhead.

Single-slot PCIe card for 80 TOPS of dense INT8 performance

Single-slot PCIe card for 80 TOPS of dense INT8 performance

Single-slot PCIe card for 80 TOPS of dense INT8 performance

The MLA100 PCIe Card fits a standard PCIe slot and runs AI inference for the host system. Models built and validated on a GPU compile to MLA100 through SDK qb, so your application keeps running on the host CPU while the card takes the inference load.

The MLA100 PCIe Card fits a standard PCIe slot and runs AI inference for the host system. Models built and validated on a GPU compile to MLA100 through SDK qb, so your application keeps running on the host CPU while the card takes the inference load.

AI performance

80 TOPS (Dense, INT8)

NPU clock

1.25 GHz

NPU cores

8

Memory

LPDDR4X, 16 GB / 32 GB

Memory bandwidth

66.7 GB/s

Flash memory

32 MB

Host interface

PCI Express Gen4, 8-lane

UART

1 Port

LED indicators

2 (Power, Heartbeat)

Supported OS

Linux, Windows

Frameworks

PyTorch, TensorFlow, TFLite, ONNX, Keras

Power (TDP)

25 W

Input voltage

DC +12V

Cooling system

Heatsink, Fan cooling

Dimensions

167 (L) × 71 (W) × 16 (H) mm

Weight

225 g

Benchmarks

Benchmarks

Benchmarks

MODEL

TASK

ARIES

MobileNetV2

MobileNetV2

Classification

Classification

11,551 FPS

11,551 FPS

YOLO11s

YOLO11s

Object detection

Object detection

784 FPS

784 FPS

YOLO26m

YOLO26m

Object detection

Object detection

343 FPS

343 FPS

EXAONE-4.0-1.2B

EXAONE-4.0-1.2B

Language model

Language model

31.62 tokens/s per user

31.62 tokens/s per user

25×

25×

25×

FPS per watt vs. a 360W desktop GPU (YOLO11n-seg)

9.6×

9.6×

9.6×

FPS per dollar vs. a 230W workstation GPU (YOLO11n-seg)

+138%

+138%

+138%

FPS vs. a 230W workstation GPU (YOLO11n), at a fraction of the power

Measured on the MLA100 PCIe Card, batch 8. Based on internal benchmark testing.

Lower cost to run and cool.

Lower cost to run and cool.

Lower cost to run and cool.

ANNUAL POWER, 24/7

ANNUAL POWER, 24/7

MLA100 PCIE CARD

MLA100 PCIE CARD

230W-CLASS GPU

230W-CLASS GPU

450W-CLASS GPU

450W-CLASS GPU

TDP

TDP

25W

25W

230W

230W

450W

450W

Energy per year

Energy per year

219 kWh

219 kWh

2,015 kWh

2,015 kWh

3,942 kWh

3,942 kWh

Electricity cost per year

Electricity cost per year

USD 17.52

USD 17.52

USD 161.20

USD 161.20

USD 315.36

USD 315.36

Processor operations only. At USD 0.08/kWh, the average US industrial electricity rate (May 2024).

About 9× less power

About 9× less power

About 9× less than a 230W-class GPU and 18× less than a 450W-class GPU at TDP.

No added cooling

No added cooling

The card’s own fan is enough, with no liquid cooling or added air handling at the facility.

Eight cards, one server.

Eight cards, one server.

Eight cards, one server.

An 8-slot AI server holds 8 MLA100 cards. The same number of dual- or triple-slot GPUs would need two or more servers.

MLA100 PCIE CARD

TYPICAL DUAL-SLOT GPU

Slots used

Slots used

1

1

2–3

2–3

Board area

Board area

168 × 65 mm

168 × 65 mm

About 2.5× larger

About 2.5× larger

MLA100 PCIe Card

1 slot

Dual-slot GPU

2 slots

Triple-slot GPU

3 slots

Keep your model’s accuracy when you move it off the GPU.

Keep your model’s accuracy when you move it off the GPU.

Keep your model’s accuracy when you move it off the GPU.

The qb Compiler applies mixed precision layer by layer and keeps over 99% of original FP32 accuracy, with no retraining.

MODEL

MODEL

ORIGINAL (FP32)

ORIGINAL (FP32)

GPU INT8 TOOLCHAIN

GPU INT8 TOOLCHAIN

MLA100 (MIXED PRECISION)

MLA100 (MIXED PRECISION)

YOLOv8n

YOLOv8n

37.34

37.34

31.43 (84.2%)

31.43 (84.2%)

36.97 (99.0%)

36.97 (99.0%)

YOLOv8s

YOLOv8s

44.96

44.96

40.87 (90.9%)

40.87 (90.9%)

44.53 (99.0%)

44.53 (99.0%)

YOLOv8m

YOLOv8m

50.23

50.23

46.38 (92.3%)

46.38 (92.3%)

49.81 (99.2%)

49.81 (99.2%)

YOLOv8l

YOLOv8l

52.76

52.76

48.34 (91.6%)

48.34 (91.6%)

52.55 (99.6%)

52.55 (99.6%)

mAP on COCO, measured on the MLA100 PCIe Card. Percentages show accuracy retained versus FP32. GPU INT8 results use a standard GPU INT8 inference toolchain.

Tested well beyond office conditions.

Tested well beyond office conditions.

Tested well beyond office conditions.

Industrial-grade components

Industrial-grade components

Memory and key parts are industrial grade, rated for -40 to 85℃ operation.

Chamber tested

Chamber tested

Passed a 504-hour operating life test and a 700-cycle thermal test (-40 to 90℃), and met Korean National Police Agency environmental standards.

Certified

Certified

ISO 9001

KC

FCC

CE

RoHS

VCCI

BSMI

PSE

Reliability and Certifications for Industrial Deployment

Reliability and Certifications for Industrial Deployment

Tested for harsh environments (MLA100 PCIe Card): a 504-hour operating life test and a 700-cycle thermal test (-40 to 90℃), and it passed Korean National Police Agency environmental standards.

Certifications

ISO 9001

KC

FCC

CE

RoHS

VCCI

BSMI

PSE

From GPU model to MLA100 in three steps.

From GPU model to MLA100 in three steps.

From GPU model to MLA100 in three steps.

Over 490 validated model architectures, from CNNs to LLMs and VLMs. Pre-compiled models are available in the Mobilint Model Zoo and on Hugging Face.

STEP 01

Compile

Compile

qb Compiler converts PyTorch, TensorFlow or ONNX models into an MLA100 executable, keeping over 99% of original accuracy.

STEP 02

Run

Run

qb Runtime provides Python and C++ APIs for loading models and running inference.

STEP 03

Deploy

Deploy

qb Driver supports Linux and Windows hosts.

Already running in production.

Already running in production.

Already running in production.

Traffic cameras over a night-time city intersection

City traffic analysis

City traffic analysis

Intersection video analyzers handle vehicle detection, license plate OCR and vehicle re-identification on-site for municipal traffic centers.

AI contact center desks with audio waveforms on screen

AI contact center

AI contact center

MLA100 cards replaced GPU servers for speech AI, handling STT at 240 calls per second and TTS at 45 calls per second.

Wafer and battery cell vision inspection machine

Manufacturing inspection

Manufacturing inspection

Secondary battery lines and wafer inspection equipment use MLA100 to detect micro-defects and classify defect patterns.