Skip to content

About

Resource governance and system tuning toolkit for AI NAS platforms — PSI-based pressure monitoring, cgroup-based app limiting, diagnostics, and OpenVINO benchmarking.

Topics

Resources

Code of conduct

Contributing

Security policy

Stars

13 stars

Watchers

1 watching

Forks

Intel XPU SmarTune

Demo

SmarTune dashboard demo

A short walkthrough of the dashboard: live monitoring, resource control, and diagnostics.

📖 User guide

Overview

Intel XPU SmarTune is a collection of platform tools and services designed to optimize and enhance the system operational efficiency of AI NAS. It brings live monitoring, resource control, benchmarking, diagnostics, and history together in a single browser dashboard.

An AI NAS often runs AI inference alongside media transcoding, backups, and file sharing on the same hardware. When these workloads compete for CPU, memory, or disk I/O, a heavy background job can slow down the apps users actually care about. SmarTune measures that pressure, throttles the lower-priority apps while it lasts, and gives the resources back as it eases — without modifying or restarting the apps.

SmarTune overview

Key Features

Monitor

  • Live CPU, memory, disk, network, Intel GPU, and NPU usage in one dashboard
  • A Pressure Overview panel with system, disk I/O, and network pressure, each rated low / medium / high / critical and naming the busy disks or NICs.
  • Per-app and per-process resource use, plus long-term history trends and a hardware/software inventory

Control

  • Under pressure, automatically limits CPU, memory, disk, and network for low-priority apps, and restores them step by step when it eases
  • Priority classes keep critical apps running; new launches wait in a queue until resources free up
  • Manual control when you want it: cap an app's CPU, memory, disk I/O, or network manually, restore limits immediately, and choose when auto-limiting takes over again.

Benchmark

  • Download AI models and benchmark them on this machine (OpenVINO / GenAI)
  • Compare runs side by side and see how load affects results

Diagnostics

  • A timeline of what happened and what SmarTune did about it
  • Alerts and plain-language advice, custom rules, and exportable reports

For how it works under the hood, see the Balancer guide and Pressure algorithm.

Quick Start (run from source)

1. Start the backend (from the repository root). On first run the script creates a .smartune-venv virtual environment and installs requirements.txt automatically:

bash start_smartune.sh        # balancer + monitor (port 9001)
# bash start_smartune.sh -m   # monitor only

2. Start the frontend in a second terminal:

cd dashboard
bash start_dashboard.sh       # dev server on port 39527

3. Open the dashboard in a browser, using the host machine's IP address:

http://<host-ip>:39527/

Next: the User guide → Getting started, or the Install guide for the systemd service, the Debian package, and building native dependencies.

Install

See the Install guide — run from source (optionally as a systemd service) or install the Debian package, plus verified platforms and ports.

Documentation

Full index: docs/

Contributing & Security

License

Each component of the Edge Infrastructure external is licensed under Apache 2.0.

About

Resource governance and system tuning toolkit for AI NAS platforms — PSI-based pressure monitoring, cgroup-based app limiting, diagnostics, and OpenVINO benchmarking.

Topics

Resources

Code of conduct

Contributing

Security policy

Stars

13 stars

Watchers

1 watching

Forks

Releases

Packages

Used by

Contributors

Languages