GPU not used in my evaluator?

Hui_Liu · March 15, 2026, 11:25pm

I am trying to following the getting_started - step 3.

when I check `nvidia-smi`, there is no running process attached:
```

(base) ...:~/aic_results/bag_trial_1_20260314_045333_203$ nvidia-smi
Sat Mar 14 05:04:28 2026       
+-----------------------------------------------------------------------------------------+
| NVIDIA-SMI 595.45.04              Driver Version: 595.45.04      CUDA Version: 13.2     |
+-----------------------------------------+------------------------+----------------------+
| GPU  Name                 Persistence-M | Bus-Id          Disp.A | Volatile Uncorr. ECC |
| Fan  Temp   Perf          Pwr:Usage/Cap |           Memory-Usage | GPU-Util  Compute M. |
|                                         |                        |               MIG M. |
|=========================================+========================+======================|
|   0  NVIDIA L4                      On  |   00000000:00:03.0 Off |                    0 |
| N/A   40C    P8             12W /   72W |       1MiB /  23034MiB |      0%      Default |
|                                         |                        |                  N/A |
+-----------------------------------------+------------------------+----------------------+

+-----------------------------------------------------------------------------------------+
| Processes:                                                                              |
|  GPU   GI   CI              PID   Type   Process name                        GPU Memory |
|        ID   ID                                                               Usage      |
|=========================================================================================|
|  No running processes found                                                             |
+-----------------------------------------------------------------------------------------+

my os:

PRETTY_NAME="Debian GNU/Linux 13 (trixie)"
NAME="Debian GNU/Linux"
VERSION_ID="13"
VERSION="13 (trixie)"
VERSION_CODENAME=trixie
DEBIAN_VERSION_FULL=13.3
ID=debian
HOME_URL="https://www.debian.org/"
SUPPORT_URL="https://www.debian.org/support"
BUG_REPORT_URL="https://bugs.debian.org/"

I rechecked, I did used nvidia when creating evaluator

(base) ...:~$ distrobox create -r --nvidia -i ghcr.io/intrinsic-dev/aic/aic_eval:latest aic_eval
...

(base) ...:~$ distrobox enter -r aic_eval
Starting container...                   	 [ OK ]
...
Setting up host's nvidia integration... 	 [ OK ]

github.com/intrinsic-dev/aic

docs/getting_started.md

main

# Getting Started

Welcome to the AI for Industry Challenge! Follow this guide to familiarize yourself with the toolkit structure, prepare  your environment, and confirm your setup by running a quickstart example before developing your solution.

> [!NOTE]
> **ROS 2 Distribution:** Official evaluation of all submissions will be conducted using **ROS 2 Kilted Kaiju**. If you choose to develop or test your policy using a different ROS 2 distribution (e.g., Humble or Jazzy), it is entirely your responsibility to ensure compatibility and support. Please note that **inter-distro communication is not guaranteed and not officially supported**. For those new to ROS 2, we strongly encourage completing the [official ROS 2 tutorials](https://docs.ros.org/en/kilted/Tutorials.html).

## Architecture Overview

The challenge uses a two-component architecture:

1. **Evaluation Component** (provided) - Runs the simulation, robot, sensors, and scoring system
2. **Participant Model** (you implement) - Your ROS 2 node that processes sensor data and commands the robot

**Source code for both components is available in this toolkit.** Since the Evaluation Component will not change during the competition, we publish a Docker image (`aic_eval`) for convenience that you can reuse—this is the **recommended workflow**. Advanced users who prefer to build from source can follow the [Building from Source](./build_eval.md) guide.

For a detailed explanation of the architecture, packages, and interfaces, see the [Toolkit Architecture](../README.md#toolkit-architecture) section in the README.

---

This file has been truncated. show original

Yadunund · March 16, 2026, 6:55pm

Is this troubleshooting section helpful? aic/docs/troubleshooting.md at main · intrinsic-dev/aic · GitHub

Hui_Liu · March 17, 2026, 2:33am

Thanks for the information! In my case, I only have one GPU (Nvidia L4), but still it didn’t use it. after some debugging, the following command seems working for me ( not sure if it is hacky though..)

 export __GLX_VENDOR_LIBRARY_NAME=nvidia                                         
/entrypoint.sh ground_truth:=false start_aic_engine:=true

after running the export, now I can see gazebo process attached in `nvidia-smi`. but the image (on the bottom left of RViz) seems flashing a lot

Topic		Replies	Views
Can not start the evaluation container (Pixi Install Succeeds) AI for Industry Challenge	0	57	March 10, 2026
Cannot 'Start the Evaluation Container' AI for Industry Challenge	2	95	March 10, 2026
ROS rendering issue for the Simulation Environment on Getting Started, step 2 AI for Industry Challenge	2	40	March 29, 2026
Nvidia-egl-desktop-ros2: Docker Container of Ubuntu Desktop for ROS2 development ROS General ros2 , docker , gpu	1	993	May 25, 2022
Development setup for multiple ROS distros? ROS General	14	7443	June 29, 2019

GPU not used in my evaluator?

Related topics