Fast and Safe Robot Motions with Robot Vision

We are excited to announce the release of the new Jacobi Vision Library. Until now, our robots have relied on pre-uploaded CAD models in Jacobi Studio to plan their motions around obstacles. With the Jacobi Vision Library, this process becomes more dynamic, efficient, and responsive.

From Static Models to Dynamic Vision

In the past, the Jacobi motion tools depended on CAD models to define the environment within which a robot operates. While effective, this approach has limitations, especially in environments where the physical layout is subject to change or is difficult to model accurately. The Jacobi Vision Library addresses these challenges head-on by enabling robots to use real-time vision input to plan their movements.

Imagine a scenario where a robot needs to pick boxes from a roller cage or products from a bin. Previously, any change in the environment—such as the location of the cage—required manual updates to the collision model in Jacobi Studio. With the vision library, the robot can now 'see' these changes and adapt its motions accordingly. This not only enhances the robot's efficiency but also increases safety, reducing the risk of collisions in dynamic environments.

Key Features of the Jacobi Vision Library

  • Seamless Camera Integration.
    The Jacobi Vision Library includes built-in drivers for popular cameras like Intel RealSense, Photoneo and Mech-Mind.

  • Live Visualization in Jacobi Studio.
    Developers can visualize live images, point clouds, and depth maps directly in Studio. With a real-time view of what the robot 'sees,' it’s easier to fine-tune motion plans and adjust for any environmental changes.

  • Simulated Camera for Development.
    The simulated camera allows testing and refining vision-based solutions without needing physical hardware directly in Studio.

  • Image Manipulation Tools.
    The library also includes basic tools for image and depth map manipulation, tailored specifically for robotic applications.

  • Integration with the motion library.
    The vision library can be integrated easily with the motion library, thanks to its use of the DepthMap obstacle type. This ensures that your robots can plan safe and efficient paths around obstacles detected through vision input.

Unlocking New Industries with Vision-Enabled Robotics

The release of the Jacobi Vision Library marks a significant milestone in the evolution of our robotic platform. By shifting from static CAD models to dynamic vision input, we empower robots to operate with greater autonomy and adaptability in real-world environments.

This new capability not only simplifies the motion planning process but also opens up new possibilities for robotics applications across various industries, from manufacturing and logistics to healthcare, construction, agriculture, and beyond.

Getting Started

We invite developers to explore the Jacobi Vision Library. Whether you're working with physical robots or developing in simulation, this library will enhance your projects and push the boundaries of what's possible.To get started, simply activate your Jacobi trial license and install the latest version of our libraries. Detailed documentation and tutorials are available on our website to guide you through the setup and implementation process. With the Jacobi Vision Library, we are excited to see how our community will innovate and develop intelligent and capable robotic systems.

If you’re interested in exploring the future of robotic programming, visit us at www.jacobirobotics.com, or follow us on LinkedIn and X to learn more about our tools and solutions. If you have any questions or feedback, reach out to contact@jacobirobotics.com.

Blog overview