NPU IP

Bring compute and memory closer. Focus on necessary computation.

Semunite’s PIM-like NPU places compute units and memory close together to minimize data movement. We have enhanced the NPU IP with Zero-skipping to skip unnecessary computations involving zero values.

Zero-skipping added · Not yet taped out

PIM-like NPU concept combining PIM energy efficiency with NPU reconfigurability
PIM-like NPU concept combining PIM energy efficiency with NPU reconfigurability

NPU IP configured around the workload

PIM-like NPU IP is Semunite’s core technology. Compute and memory are placed close together, with compute, data movement and memory configured around the model.

Reconfigurable NPU
PE arrays and multiple cores are configured around the workload and compute precision.
Data control
Control data movement and execution within the NPU. CPU and peripheral integration are configured in the chip or system using the IP.
Memory I/F
Configure memory for model inputs, weights and outputs. External memory connections are designed around chip and system requirements.
Domain Accelerators
Compression, speculative decoding and nonlinear function acceleration are planned for SLM and Vision.

A complementary architecture combining the low-power characteristics of PIM (Processing-in-Memory) with the high reconfigurability of an NPU. Rather than relying solely on automated EDA placement and routing, we use manual physical design to place compute units and memory close together. Minimizing data movement reduces energy consumption, computation time and chip area through PPA optimization.

Explore SeM-V1 architecture and specifications

NPU IP enhanced with Zero-skipping

We have added a function to the NPU IP that skips unnecessary computations involving zero values.

Zero-skipping added · Not yet taped out

Planned integration into a VUI AI Chip

The updated IP is planned for integration into a future VUI AI Chip tape-out.

VUI AI Chip integration · Future tape-out

SUAI test chip for the existing PIM-like NPU

SUAI

PIM-like NPU test chip

SUAI was taped out in January 2026, and physical chips were received in June 2026.

Peak · INT8
3.3 TOPS @ 200 MHz
Peak · INT4
13.1 TOPS @ 200 MHz
NPU cores
32 NPU cores · 4 clusters × 8 cores
Process
Samsung 28nm

Peak performance for all 32 cores at 200 MHz. INT8 computation uses four serial passes through the INT4 array.

Explore SUAI architecture and per-core PPA
An NPU-only test chip with 4 clusters × 8 cores on a 2×4 mesh NoC.
An NPU-only test chip with 4 clusters × 8 cores on a 2×4 mesh NoC.Open full-size diagram (new tab)

SUAI per-core PPA

Peak / core · INT8
0.10 TOPS
Power / core
16.1 mW
Efficiency / core · INT8
6.4 TOPS/W
Area / core
0.110 mm²

Per-core peak values for the PIM-like array block, excluding I/O SRAM. Synopsys PrimeTime PX on a P&R netlist with gate-level simulation activity, 200 MHz, SS 0.9 V / −40 °C, 100% MAC utilization, no SPEF parasitics.

From model mapping to execution

An example AI SDK flow for applying the NPU IP in SeM-V1. It analyzes TFLite INT8 models and connects NPU and RISC-V execution.

  1. Trained model

    Prepare a TFLite INT8 model

  2. Analysis & mapping

    Analyze layers and quantization, split NPU/RISC-V work and schedule four cores

  3. C Runtime & Libraries

    NPU/DMA drivers, audio pre-processing and host protocol

  4. Build

    Build ELF with RISC-V GCC

  5. Flash image

    Place ELF and weights in QSPI Flash

Explore the runtime stack
Host application / Host library
The host application and host library exchange command and result packets over UART/I2C.
Audio pre-processing / Inference scheduler
512-point FFT and Q15 log-mel pre-processing connect to scheduling across four NPU cores and RISC-V.
Bare-metal Runtime / Boot ROM
Boot ROM loads ELF from QSPI Flash into a bare-metal runtime with NPU/DMA drivers and flash weight streaming.
Explore the platform

The next directions for NPU IP

We are preparing NPU IP extensions for SLM and Vision.

SLM

In preparation

Memory architecture and compute optimization for running small language models on device.

The direction includes flash weight streaming, HyperRAM KV cache, weight compression and speculative decoding.

View targets and candidate models
Target model size
0.5B-class
Target throughput
20+ tokens/s
Memory direction
Flash + HyperRAM
Candidate models
Qwen2.5-0.5B, Qwen3-0.6B

Vision

In preparation

Multi-core compute and memory/data-path extensions for compact vision models.

The direction includes CNN/ViT dataflow, shared L2 and tiling, HyperRAM and a camera interface.

View targets and candidate models
Target compute performance
0.5–2 TOPS (INT8)
Target throughput
30+ fps
Memory direction
Flash + HyperRAM
Candidate models
NanoDet, YOLOv8n, ShuffleNetV2, BlazeFace, MobileViT

These are future development targets to be refined around the model, quantization, memory and operating conditions. Current NPU validation figures appear separately in the SUAI section.

Discuss NPU IP for your product.

Tell us about your model and product requirements.

Contact us