# Agnocast & Callback Isolated Executor: True Zero-Copy IPC and Middleware-Transparent Scheduling for ROS 2

**URL:** <https://discourse.openrobotics.org/t/agnocast-callback-isolated-executor-true-zero-copy-ipc-and-middleware-transparent-scheduling-for-ros-2/52678>\
**Category:** Projects\
**Tags:** ros2\
**Created:** [February 24, 2026, 5:05pm UTC](https://discourse.openrobotics.org/t/agnocast-callback-isolated-executor-true-zero-copy-ipc-and-middleware-transparent-scheduling-for-ros-2/52678 "2026-02-24T17:05:38Z")\
**Posts on this page:** 9\
**Page:** 1

<div class="post-metadata">

**Author:** ![AtsushiYano](https://sea2.discourse-cdn.com/flex022/user_avatar/discourse.openrobotics.org/atsushiyano/32/32368_2.png) [@AtsushiYano](https://discourse.openrobotics.org/u/AtsushiYano)\
**Post date:** [February 24, 2026, 5:05pm UTC](https://discourse.openrobotics.org/t/agnocast-callback-isolated-executor-true-zero-copy-ipc-and-middleware-transparent-scheduling-for-ros-2/52678/1 "2026-02-24T17:05:39Z")

</div>

We are excited to introduce **[Agnocast](https://github.com/tier4/agnocast)** and the **[Callback Isolated Executor](https://github.com/tier4/callback_isolated_executor)** — two technologies that dramatically improve the performance of ROS 2 systems through **true zero-copy IPC** and **middleware-transparent scheduling**. Both are now being **fully adopted across** **[Autoware](https://github.com/autowarefoundation/autoware)**, the open-source autonomous driving platform powering a wide range of commercial deployments, including robotaxis, autonomous buses, and cargo vehicles worldwide. For details, please refer to:

- [Introduce True Zero-Copy Publish/Subscribe IPC to Autoware!! 🎉 (New Middleware Coexisting with ROS 2) · autowarefoundation · Discussion #5835](https://github.com/orgs/autowarefoundation/discussions/5835)
- [Proposal: Add agnocast::Node support to common/autoware\_agnocast\_wrapper · autowarefoundation · Discussion #6804](https://github.com/orgs/autowarefoundation/discussions/6804)
- [Proposal: Adopt CallbackIsolatedExecutor in Autoware · autowarefoundation · Discussion #6813](https://github.com/orgs/autowarefoundation/discussions/6813)

## Agnocast: True Zero-Copy IPC for All Message Types

**Agnocast** is **an rclcpp-compatible true zero-copy IPC middleware for ROS 2 that supports all ROS message types** , including message structs already generated by `rosidl`. Existing solutions only support static-sized messages, falling back to serialization and copying for unsized message like `PointCloud2` . Agnocast removes this limitation with no serialization overhead. The API is rclcpp-compatible, so migrating a topic typically requires changing only a few lines per node.

 ![Agnocast Software Stack](https://us1.discourse-cdn.com/flex022/uploads/ros/original/3X/c/6/c65e946cf35948d745eff92f1d51ac1461f5d406.png)

 ![All needed changes to apply Agnocast in ROS 2](https://us1.discourse-cdn.com/flex022/uploads/ros/original/3X/a/a/aaacef4f00c7823302209cb9c72a0ebe790b426c.png)

 ![Agnocast Memory Mapping](https://us1.discourse-cdn.com/flex022/uploads/ros/original/3X/6/4/6464dc38ee476878848258ad900cd621a00535d4.png)

## Callback Isolated Executor: Middleware-Transparent Scheduling

**Callback Isolated Executor (CIE)** is a **drop-in replacement for the standard ROS 2 executor that establishes a persistent one-to-one mapping between each callback and a dedicated OS thread**. Standard executors multiplex callbacks onto shared threads above the OS scheduler, creating a nested scheduling problem that prevents applying OS-level guarantees to individual callbacks. CIE removes this middleware layer, enabling per-callback OS scheduling control for both performance and safety.

 ![image](https://us1.discourse-cdn.com/flex022/uploads/ros/original/3X/4/9/49f5a35eec29aba9da2bcaed2466df17140d3d38.png)

## Cooperation between Agnocast & CIE

Agnocast and CIE can be used independently, but we recommend coordinating both to maximize performance. Due to its proprietary messaging mechanism, Agnocast requires a dedicated executor, and this functionality is included in the CIE shipped with [Agnocast](https://github.com/tier4/agnocast). Of course, we also offer [standalone CIE packages](https://github.com/tier4/callback_isolated_executor).

## Proven in Autonomous Vehicle Deployments

We demonstrate the impact of applying Agnocast and CIE to a large-scale ROS 2 autonomous driving system below.

**Agnocast**  
The figure below plots communication latency from message publication to subscriber callback invocation across different message sizes for Agnocast and the compared IPC mechanisms. **Agnocast maintains consistent communication latency regardless of message size** , even for unsized message types like `PointCloud2`.

 ![image](https://us1.discourse-cdn.com/flex022/uploads/ros/original/3X/7/b/7b6ab7025e482aca47e4b258730599270cefa6ed.png)

**CIE**  
The figure below shows how much the response times of five critical paths were improved by optimizing them with CIE, compared with running under Linux’s default scheduler CFS without any special tuning (gray line). These results were obtained from measurements taken while the robotaxi was operating on public roads, with the horizontal axis representing elapsed time in seconds. As a result, **the worst-case response time (measured) improved by about 5x**, demonstrating a significant enhancement in real-time performance.

 ![image](https://us1.discourse-cdn.com/flex022/uploads/ros/original/3X/7/b/7bb4ac38a2a0750d2e186009064993e1ee90f6b5.jpeg)

## Get Started

All packages have already been deployed to the official ROS 2 Build Farm and are awaiting distribution. Until then, the current distribution model is as follows:

The following components are available through our [PPA](https://launchpad.net/~t4-system-software/+archive/ubuntu/agnocast/+packages?field.name_filter=2.2.0&field.status_filter=&field.series_filter=).

```bash
sudo apt install agnocast-heaphook-v2.2.0 agnocast-kmod-v2.2.0

```

The core [Agnocast](https://github.com/tier4/agnocast) library (including CIE) currently requires a source build.

For detailed setup instructions and sample applications, please refer to the [README](https://github.com/tier4/agnocast) in the repository.

## Learn More

**Agnocast**

- [Repository](https://github.com/tier4/agnocast)
- [Paper (IEEE ISORC 2025)](https://arxiv.org/abs/2506.16882)
- [ROSCon 2025 Presentation Video](https://vimeo.com/1136159023)

**Callback Isolated Executor**

- [Repository](https://github.com/tier4/callback_isolated_executor)
- [Paper (IEEE RTAS 2025)](https://arxiv.org/pdf/2505.06546)
- [ROSConJP 2025 Article](https://tier4.jp/en/media/detail/?sys_id=5lXOcwfBQRQguDWuFsuZoo)

---

<div class="post-metadata">

**Author:** ![charlielito](https://sea2.discourse-cdn.com/flex022/user_avatar/discourse.openrobotics.org/charlielito/32/14353_2.png) [@charlielito](https://discourse.openrobotics.org/u/charlielito)\
**Post date:** [February 25, 2026, 4:59pm UTC](https://discourse.openrobotics.org/t/agnocast-callback-isolated-executor-true-zero-copy-ipc-and-middleware-transparent-scheduling-for-ros-2/52678/2 "2026-02-25T16:59:55Z")

</div>

Thanks for sharing! This looks very promising!  
I have mainly one question about CPU load comparison between middlewares. Given the same conditions, how is the CPU consumption of the nodes affected (or improved) with Agnocast compared to other implementations? One could expect that it improves since zero copy implies fewer operations, but since CIE has one real thread per callback, that could increase the CPU usage (?) Do you have any numbers on that?

---

<div class="post-metadata">

**Author:** ![gbiggs](https://sea2.discourse-cdn.com/flex022/user_avatar/discourse.openrobotics.org/gbiggs/32/30361_2.png) [@gbiggs](https://discourse.openrobotics.org/u/gbiggs)\
**Post date:** [February 26, 2026, 1:02am UTC](https://discourse.openrobotics.org/t/agnocast-callback-isolated-executor-true-zero-copy-ipc-and-middleware-transparent-scheduling-for-ros-2/52678/3 "2026-02-26T01:02:03Z")

</div>

@AtsushiYano Can you please explain a few things for me?

1. Agnocast is a separate communications system, not going through the RMW layer. This makes it incompatible with all the existing ROS tooling, including tools such as rosbag2 and rviz, and also means it won’t benefit from improvements to the RMW layer - such as the upcoming memory architecture agnostic improvements that will allow ROS messages to be views onto GPU buffers. Why did you ignore the RMW layer?
2. You state that CIE “removes this middleware layer”. Does this mean that it is removing the ROS executor infrastructure and effectively allowing nodes to execute directly in OS processes, rather than through the executor abstraction?
3. Your [LinkedIn post](https://www.linkedin.com/posts/sykwer_agnocast-callback-isolated-executor-true-activity-7432294577472163840-TzCu/) says that “It has been officially decided that these middleware will be adopted across the entire Autoware project, replacing the existing ROS 2 stack.” Does this mean that Autoware is no longer using ROS?

---

<div class="post-metadata">

**Author:** ![AtsushiYano](https://sea2.discourse-cdn.com/flex022/user_avatar/discourse.openrobotics.org/atsushiyano/32/32368_2.png) [@AtsushiYano](https://discourse.openrobotics.org/u/AtsushiYano)\
**Post date:** [February 26, 2026, 3:31am UTC](https://discourse.openrobotics.org/t/agnocast-callback-isolated-executor-true-zero-copy-ipc-and-middleware-transparent-scheduling-for-ros-2/52678/4 "2026-02-26T03:31:57Z")

</div>

@gbiggs  
Thank you for your thoughtful questions and for taking the time to engage with our work!

ROS 2 enables the easy construction of robotics systems across a very wide range of environments. We position Agnocast as a library for users who want to further push performance tuning to its limits in specific environments. In other words, users who encounter performance bottlenecks in systems built on the existing ROS 2 stack now have the option to migrate part or all of their middleware stack to Agnocast. Since the user interface is designed to closely mirror rclcpp, migration requires minimal effort. At this stage, Agnocast only supports C++ clients on Linux, though we may expand platform support in the future.

> 1. Agnocast is a separate communications system, not going through the RMW layer. This makes it incompatible with all the existing ROS tooling, including tools such as rosbag2 and rviz, and also means it won’t benefit from improvements to the RMW layer - such as the upcoming memory architecture agnostic improvements that will allow ROS messages to be views onto GPU buffers. Why did you ignore the RMW layer?

For details on why Agnocast is not integrated as an RMW implementation, please refer to [this](https://www.linkedin.com/posts/sykwer_roscon2025-roscon2025-roscon-activity-7399768138084712448-LEsO?utm_source=share&utm_medium=member_desktop&rcm=ACoAABpU-3wBwR_Fphm1b2Ska6Fo0gGlXf1A50s). Compatibility with the existing ROS 2 ecosystem is ensured through the [Bridge feature](https://github.com/autowarefoundation/agnocast/blob/main/docs/agnocast_ros2_bridge.md). This feature mediates between Agnocast’s communication world and the RMW-based communication world, enabling seamless interoperation between them. From the user’s perspective, the experience remains the same as working with a standard ROS 2 system — users can transparently interact with ROS 2 applications that do not use Agnocast, including tools such as rviz and rosbag, without any additional effort.

> 1. You state that CIE “removes this middleware layer”. Does this mean that it is removing the ROS executor infrastructure and effectively allowing nodes to execute directly in OS processes, rather than through the executor abstraction?

This statement does not imply the removal of the ROS executor infrastructure. Rather, it refers to eliminating scheduling behavior from the middleware layer in order to resolve issues related to nested scheduling. Specifically, CIE achieves semantic equivalence between OS-level scheduling and executor-level scheduling by constraining the executor to manage only a single callback. For the most accessible explanation of the nested scheduling problem and how CIE addresses it, please refer to our [paper](https://arxiv.org/pdf/2505.06546).

> 1. Your [LinkedIn post](https://www.linkedin.com/posts/sykwer_agnocast-callback-isolated-executor-true-activity-7432294577472163840-TzCu/) says that “It has been officially decided that these middleware will be adopted across the entire Autoware project, replacing the existing ROS 2 stack.” Does this mean that Autoware is no longer using ROS?

To be precise, the announcement means that Autoware will provide users with the **option** to fully adopt Agnocast, rather than forcing an immediate migration. As described in the [autoware\_agnocast\_wrapper](https://github.com/autowarefoundation/autoware_universe/tree/main/common/autoware_agnocast_wrapper) README, building Autoware with the default build options continues to produce a system based on the conventional ROS 2 stack. By enabling the Agnocast build option, users can build Autoware with Agnocast as its communication foundation. TIER IV, the primary contributor to Autoware, has decided to build its autonomous driving systems with the Agnocast-enabled option going forward. It is also important to note that even with the Agnocast-enabled build, Autoware continues to depend on the existing RMW communication stack for inter-host communication and for interacting with tools such as rviz and rosbag that rely on RMW-based communication.

---

<div class="post-metadata">

**Author:** ![koichi98](https://sea2.discourse-cdn.com/flex022/user_avatar/discourse.openrobotics.org/koichi98/32/32496_2.png) [@koichi98](https://discourse.openrobotics.org/u/koichi98)\
**Post date:** [February 26, 2026, 5:33am UTC](https://discourse.openrobotics.org/t/agnocast-callback-isolated-executor-true-zero-copy-ipc-and-middleware-transparent-scheduling-for-ros-2/52678/5 "2026-02-26T05:33:48Z")

</div>

@charlielito

Thanks for the great question!

**RMW/DDS layer’s CPU overhead**  
In typical ROS 2 applications, the RMW layer (in our environment, CycloneDDS) consumes a non-trivial amount of CPU. Most significantly, communication goes through serialization/deserialization and multiple data copies via socket buffers even for intra-host scenarios. Additionally, the DDS implementation spawns multiple background threads that are periodically active for protocol maintenance — heartbeat transmission, receive polling, garbage collection, thread liveness monitoring, etc. These are necessary functions for DDS as a distributed middleware over unreliable networks, but they add constant CPU overhead, especially when aggregated across multiple DDS participants in a system.  
(Note: we use “DDS” below to refer to the RMW implementation for brevity, though this applies to the RMW layer in general.)

**How Agnocast addresses this**  
Agnocast replaces topic communication with true zero-copy via shared memory, eliminating the serialization/deserialization and copy overhead — the dominant source of CPU consumption, especially for large messages like point clouds. This works with your existing rclcpp::Node and should already provide a significant CPU reduction. For further optimization, switching to agnocast::Node bypasses the RMW layer entirely — no DDS participant is created and none of the DDS background threads are spawned — eliminating the remaining runtime overhead as well.

**Reference measurement: Autoware’s shape\_estimation node**  
We did some rough profiling using Intel VTune on [Autoware’s shape\_estimation node](https://github.com/autowarefoundation/autoware_universe/tree/main/perception/autoware_shape_estimation) (with agnocast::Node) and observed around 80% CPU time reduction — the RMW/DDS runtime functions that had dominated the baseline profile were no longer present. This node performs relatively lightweight geometric fitting compared to the size of its input point cloud data, so the DDS overhead was particularly prominent in this case. The improvement will vary by node depending on the ratio of communication overhead to application logic, but we would expect a meaningful reduction in general. We are planning to run more systematic measurements soon and will share the results once available.

**On CIE’s thread-per-callback model**  
Regarding your concern about CIE potentially increasing CPU usage — the impact is minimal. CIE’s callback threads are purely reactive: they block on epoll\_wait and only wake up when an event is delivered to their file descriptor, consuming no CPU while sleeping. This is fundamentally different from DDS background threads, which wake up periodically for protocol maintenance regardless of application activity. Simply having more threads does not translate to higher CPU usage as long as they are not actively running.

---

<div class="post-metadata">

**Author:** ![Timple](https://sea2.discourse-cdn.com/flex022/user_avatar/discourse.openrobotics.org/timple/32/4891_2.png) [@Timple](https://discourse.openrobotics.org/u/Timple)\
**Post date:** [February 26, 2026, 9:12am UTC](https://discourse.openrobotics.org/t/agnocast-callback-isolated-executor-true-zero-copy-ipc-and-middleware-transparent-scheduling-for-ros-2/52678/6 "2026-02-26T09:12:16Z")

</div>

Nice performance gains!

Are you implying that autoware uses zero packages from the existing ROS ecosystem? (Except external like rosbag & rviz). Because they won’t have Agnocast implementations I guess.

We are happily using some autoware packages (mainly lidar drivers and lidar filtering). Can we still use these in the future or do we need to resort to using (partly) Agnocast?  
Right now they work with any middleware of our choosing.

---

<div class="post-metadata">

**Author:** ![JM\_ROS](https://sea2.discourse-cdn.com/flex022/user_avatar/discourse.openrobotics.org/jm_ros/32/12964_2.png) [@JM\_ROS](https://discourse.openrobotics.org/u/JM_ROS)\
**Post date:** [February 26, 2026, 2:04pm UTC](https://discourse.openrobotics.org/t/agnocast-callback-isolated-executor-true-zero-copy-ipc-and-middleware-transparent-scheduling-for-ros-2/52678/7 "2026-02-26T14:04:55Z")

</div>

I am wondering, the path chosen was to implement agnocast as a API that is visible to the end user.

Why did you not implement an rmw backend using agnocast ?

I had a brief look at the CIE implementation and notices that it still uses the internal waitset approach. As far as I can see you are still maintaining a global waitset for all callback groups, or am I missing something an you are only building the waitset per thread from the callback group ?

I guess as you are on humble the events callback infrastructure is not in place yet and you can’t use it. Note that especially for high frequency applications the events approach shows a big reduction in CPU usage and improves latency across the board. Did you do any measurements were you compared the events executor to the CIE using a newer ros version ?

P.S.: I find the definition of ROS2 mainline in [callback\_isolated\_executor/docs/comparison\_with\_other\_executors.md at main · autowarefoundation/callback\_isolated\_executor · GitHub](https://github.com/autowarefoundation/callback_isolated_executor/blob/main/docs/comparison_with_other_executors.md) rather sketchy…

---

<div class="post-metadata">

**Author:** ![AtsushiYano](https://sea2.discourse-cdn.com/flex022/user_avatar/discourse.openrobotics.org/atsushiyano/32/32368_2.png) [@AtsushiYano](https://discourse.openrobotics.org/u/AtsushiYano)\
**Post date:** [March 11, 2026, 10:19pm UTC](https://discourse.openrobotics.org/t/agnocast-callback-isolated-executor-true-zero-copy-ipc-and-middleware-transparent-scheduling-for-ros-2/52678/8 "2026-03-11T22:19:55Z")

</div>

Sorry for late reply.Thank you for your question!

> Are you implying that autoware uses zero packages from the existing ROS ecosystem? (Except external like rosbag & rviz). Because they won’t have Agnocast implementations I guess.

No, Autoware does partially use packages from the existing ROS ecosystem. For those packages, Agnocast is not used — they continue to communicate via standard ROS 2 middleware as before. Agnocast is currently applied only to Autoware’s own internal packages.

> We are happily using some autoware packages (mainly lidar drivers and lidar filtering). Can we still use these in the future or do we need to resort to using (partly) Agnocast?

Yes, you can absolutely continue using Autoware packages as you do today. As mentioned in [this reply](https://discourse.openrobotics.org/t/agnocast-callback-isolated-executor-true-zero-copy-ipc-and-middleware-transparent-scheduling-for-ros-2/52678/4), this announcement is not about forcing an immediate migration to Agnocast — it is about providing an additional option. Users can choose whether or not to enable Agnocast through a build option, so your existing setup with your preferred middleware will continue to work as before.

---

<div class="post-metadata">

**Author:** ![AtsushiYano](https://sea2.discourse-cdn.com/flex022/user_avatar/discourse.openrobotics.org/atsushiyano/32/32368_2.png) [@AtsushiYano](https://discourse.openrobotics.org/u/AtsushiYano)\
**Post date:** [March 11, 2026, 10:21pm UTC](https://discourse.openrobotics.org/t/agnocast-callback-isolated-executor-true-zero-copy-ipc-and-middleware-transparent-scheduling-for-ros-2/52678/9 "2026-03-11T22:21:27Z")

</div>

Sorry for the delayed reply. Thank you for your interest in our work!

> Why did you not implement an rmw backend using agnocast ?

For details on why Agnocast is not integrated as an RMW implementation, please refer to [this](https://www.linkedin.com/posts/sykwer_roscon2025-roscon2025-roscon-activity-7399768138084712448-LEsO?utm_source=share&utm_medium=member_desktop&rcm=ACoAABpU-3wBwR_Fphm1b2Ska6Fo0gGlXf1A50s).

> I had a brief look at the CIE implementation and notices that it still uses the internal waitset approach. As far as I can see you are still maintaining a global waitset for all callback groups, or am I missing something an you are only building the waitset per thread from the callback group ?

[CIE builds unique waitset (SingleThreadedExecutor) for each callback group](https://github.com/autowarefoundation/callback_isolated_executor/blob/5cf19e5ecbbdae4f2348f6325a30fb6b57c119cf/callback_isolated_executor/src/callback_isolated_executor.cpp#L79-L80).

> I guess as you are on humble the events callback infrastructure is not in place yet and you can’t use it. Note that especially for high frequency applications the events approach shows a big reduction in CPU usage and improves latency across the board. Did you do any measurements were you compared the events executor to the CIE using a newer ros version ?

Thank you very much for the valuable information. It should be noted that the EventsExecutor does not solve the nested scheduling problem, so it addresses a different issue than what the CIE is designed to solve. Therefore, we have not yet conducted a comparison between EventsExecutor and CIE. That said, we are considering integrating EventsExecutor’s advantages into CIE, and we will share the results as work progresses.

> P.S.: I find the definition of ROS2 mainline in callback\_isolated\_executor/docs/comparison\_with\_other\_executors.md at main · autowarefoundation/callback\_isolated\_executor · GitHub rather sketchy…

I have revised the description. Thank you for pointing that out.
