Object-Centric Representations Improve Robotic Imitation Learning

Object-centric slot representations (SPOT) achieve 55% success in robotic imitation learning, outperforming dense DINO features (32%). More structure, not more

martes, 28 de julio de 2026 • 3 min read • Q2BSTUDIO Team

SPOT supera a DINO en tareas de agarre robótico

Robotic manipulation is one of the most challenging fields in applied artificial intelligence. For a robot to grasp an object, it must understand the scene in real time, distinguishing relevant from irrelevant features. Traditional vision models, such as those based on global features or dense grids, tend to mix background information with object information, reducing accuracy. However, an emerging approach based on object-centric representations —called 'slots'— is proving much more effective. These slots group visual information around each individual object, enabling cleaner learning and superior generalization.

Recent research in robotic imitation confirms these advantages. For example, in the PickCube task of the ManiSkill3 benchmark, a frozen encoder based on SPOT (combining DINO ViT-B/16 with Slot Attention) achieved a success rate above 55%, while a dense approach with global features barely reached 32%. This represents an improvement of more than 22 percentage points, without needing to fine-tune the encoder or modify the control policy. Interestingly, simply increasing the number of tokens does not help: a dense grid with 16 times more tokens yielded results similar to the global vector. The key lies in structure, not quantity.

When an explicit 2D spatial reference and native-resolution rendering were added, the full system reached 68.7% accuracy, very close to the theoretical upper bound of 71.7% obtained with a privileged 3D oracle. Additionally, an automated kinematic failure taxonomy allowed distinguishing between spatial precision errors (Near-Miss) and object tracking errors (No-Grasp). The spatial reference reduced the former but not the latter, indicating that the main bottleneck is occlusion, especially in more complex tasks like StackCube.

These findings have direct implications for industrial robotic systems. Companies seeking to automate picking, assembly, or inspection processes need robust and efficient solutions. Instead of relying on dense networks that require large volumes of data and extensive tuning, object-centric representations enable building custom applications that learn from fewer examples and generalize better. Q2BSTUDIO, as a software and technology development company, integrates these architectures into its AI solutions for robotics, offering systems that adapt to changing environments with high precision.

Implementing these models is not limited to the vision layer. For a robot to operate safely and scalably, a robust cloud infrastructure is required. Cloud services from AWS or Azure allow deploying trained models on edge devices or in the cloud, processing data in real time and dynamically updating the slots. Q2BSTUDIO offers cloud consulting and development, ensuring that object-centric representations integrate seamlessly into existing systems. Cybersecurity also plays a crucial role: protecting models and training data against adversarial attacks is essential in connected industrial environments. Therefore, Q2BSTUDIO includes pentesting and security practices in all its implementations.

Another key dimension is business intelligence. Slot-based models generate interpretable information: each slot can be associated with an object and its trajectory. This data can feed Power BI dashboards that monitor robot performance, detecting failure patterns and optimizing production processes. The mentioned failure taxonomy —Near-Miss and No-Grasp— becomes a useful metric for continuous improvement. Companies can visualize in real time which type of error predominates and adjust their strategy accordingly.

Furthermore, AI agents based on object-centric representations are ideal for imitation tasks. By learning from human demonstrations, these agents capture not only the trajectory but also the operator's visual attention. This enables transferring complex skills more naturally, reducing programming time. Q2BSTUDIO develops custom AI agents that combine slots, attention, and reactive control, offering turnkey solutions for manufacturing, logistics, and collaborative robotics.

In conclusion, object-centric representations represent a significant advance over traditional dense vision methods. Their ability to segment the scene into discrete elements improves accuracy, efficiency, and interpretability. For companies looking to make the leap to intelligent automation, adopting this paradigm provides a competitive advantage. Q2BSTUDIO, with its experience in custom software development, AI, cloud, cybersecurity, and BI, is prepared to accompany its clients in this transformation, offering robust and tailored solutions for every need.

A BREAK?

Play for a moment before you go

OUR SERVICES

How we can help you

Do you have a project in mind?

Tell us your vision and we'll turn it into a software solution. Whatever the scope, we make your idea real.