Want to stream your iPhone’s sensors to ROS 2? (Yes, you can even get point clouds!)
I made an app to do exactly this, available for download on the App Store!
SensorStream is an iPhone app + ROS2 node combo that streams live sensor data directly into your ROS2 environment over your local network or over USB.
It can stream the following sensors:
Rear/Front Camera - 1080p @ 30FPS
Depth Map - 320x180 @ 30FPS- ⠿⠿ Point Cloud - 57k points (rear) @ 30FPS , 200k+ points (front) @ 10FPS (over USB) with RGB colour values.
IMU - Accelerometer, Gyro, Orientation up to 100Hz
GPS - Outdoor location tracking max @ 1 Hz
Currently tested / working with ROS 2 Humble and an iPhone 15 Pro.
Nobody has used transmission over USB for this specific use, making everything a lot quicker than alternatives.
Try it out and give some feedback! It’s a work in progress, let me know if there’s anything you want to see added or improved.
Check it out at the site: SensorStream site
Or read my blog (for the motivation behind the project): PaaS (Phone as a Sensor)
See the video below for a demonstration of the app and its features: