A Robot's Eyes Are Now Part of Its Brain

RealSense is shipping a depth camera with the AI processor baked in. It's no longer just an eye; it's a self-contained perception engine that could change robot economics.

The eyes have always been the expensive part of the robot. Not the optics, but the processing. For years, a depth camera was a dumb sensor, streaming floods of data back to a powerful, power-hungry host computer that did all the heavy lifting. The sensor is fine. The new RealSense D585 Pro is the story. It doesn’t just see the world in 3D; it processes what it sees directly on the camera. This isn't just an iterative upgrade. It’s a change in the fundamental architecture of how robots perceive their environment.

Under the hood, the D585 Pro isn't built like a typical camera. It's powered by a proprietary Gen 5 system-on-chip (SoC) that integrates a depth engine, signal processors, and a quad-core ARM CPU. In plain English, the camera is a small, self-contained computer. It uses dual IR projectors to paint the scene with invisible light, creating a high-fidelity depth map that works from under 15 centimeters out to 10 meters, even in bright sunlight that washes out older sensors. Crucially, it runs AI models for tasks like person detection right on that chip, sending a clean, useful signal—"there is a person here"—instead of a raw firehose of pixel data. This offloads the robot's main controller, saving power, cost, and complexity.

RealSense, which spun out from Intel's shadow, is making a direct play for the central nervous system of the next decade of robotics. By bundling processing into the sensor, they threaten the business of anyone selling that extra compute module—think NVIDIA Jetsons or other edge AI boxes in less-demanding roles. The economics are simple: a single, software-updatable device is cheaper to integrate and maintain than a collection of discrete components. Competitors like Stereolabs and Orbbec now have to contend with a platform, not just a sensor. It's telling that RealSense CEO Nadav Orbach called the device, as reported in The Robot Report, “the actualization of the Visual Cortex of Physical AI.” They're not selling a component; they're selling a piece of the robot's brain.

The D585 Pro is slated to ship in early 2027, aimed first at the low-hanging fruit of warehouse logistics and industrial inspection. The immediate future sees smarter, cheaper AMRs navigating factory floors. But the roadmap, with planned software updates for visual odometry and occupancy grids, points directly at more complex machines. The dual RGB stream was explicitly designed for humanoid robots, a clear signal of where RealSense is placing its long-term bets. When the sensor itself is a software-defined platform, an update pushed over the network can grant a fleet of machines a completely new skill. The camera can now learn. The real question is no longer what the robot can see, but who decides what it's allowed to understand.