The HSR at storing groceries. This video is accelerated to 600% speed. This results with a real-time factor of approximately 0.22 to an effective speed of 132%.

Welcome to the SUTURO@Home project! This project is organized through the CRC 1320 Everyday Activity Science and Engineering (EASE 🔗). EASE is an interdisciplinary research center at the University of Bremen that investigates everyday activity science & engineering. Its core purpose is to advance the understanding of how human-scale manipulation tasks can be mastered by robotic agents. Within EASE, general software frameworks for robotic agents are created and further developped. These frameworks (CRAM, KNOWROB, GISKARD, and ROBOSHERLOCK) can also be applied to the RoboCup@Home context. There is further a substantial overlap in robot capabilities required to pass the RoboCup@Home challenges with what capabilities robots within EASE provide. SUTURO students will benefit from expertise acquired by EASE researchers through multiple years of experience in working with autonomous robots performing everyday activities, and will be geared up for potentially being future EASE researcher. We further expect to make the EASE software infrastructure more robust and flexible through the application in the RoboCup@Home domain.

We are participating in this years RoboCup@Home Virtual 2021 🔗.
RoboCup@Home wants to provide a stage for service robots and the problems these robots can tackle, like interacting with humans and helping them in their everyday-life. In the cup, the participants have to perform different tests. The first test we try to accomplish is "Storing Groceries". In this setup, the robot has to recognize objects which are provided on a table and then has to sort them in a shelf. The shelf itself will already have some objects inside of it and the robot must categories them so he can correctly place the objects from the table in it. Furthermore, one door of the shelf will be closed, so the robot has to either open it on its own or ask for help. To accomplish the test, the robot has to be able to :

Navigate between the table and shelf,
Recognize the objects,
Find categories for the objects/sort the objects,
Grasp the objects,
Put the objects in the shelf,
Open the door or ask for help

Christos Dhimitris
chdhimit[at]uni-bremen.de
Group: Knowledge
Course of studies: Business Informatics B.Sc.

Evan Kapitzke
evan[at]uni-bremen.de
Group: Perception
Course of studies: Informatics B.Sc.

Philipp Klein
phklein[at]uni-bremen.de
Group: Planning
Course of studies: Informatics B.Sc.

Torge Olliges
tolliges[at]uni-bremen.de
Group: Planning
Course of studies: Informatics B.Sc.

Leonidas Panagio de Oliveira Neto
leo_pan[at]uni-bremen.de
Group: Perception
Course of studies: Informatics B.Sc.

Clement Phung
clement1[at]uni-bremen.de
Group: Navigation/Manipulation
Course of studies: Informatics M.Sc.

Jan Schmipf
schimpf[at]uni-bremen.de
Group: Planning
Course of studies: Informatics B.Sc.

Paul Schnipper
schnippa[at]uni-bremen.de
Group: Knowledge (NLP)
Course of studies: Informatics B.Sc.

Karen Scholz
scholkar[at]uni-bremen.de
Group: Knowledge
Course of studies: Informatics M.Sc.

Marc Stelter
stelter2[at]uni-bremen.de
Group: Navigation/Manipulation
Course of studies: Informatics B.Sc.

Knowledge:
To fulfill complex tasks a robot needs knowledge and memory of its environment. While the robot acts in its world, it recognizes objects and manipulaties them through pick-and-place tasks. With the use of KnowRob, a belief state provides episodic memory of the robot's experience, recording the robot's memory of each cognitive activity. Via ontologies objects can be classified and put into context, which enables logical reasoning over the environment and intelligent decision making.

Navigation:
In order to perform the task, the robot needs to be able to autonomously and safely navigate within the world. This includes the generation of a representation of its surroundings as a 2D map, so that a path can be calculated to navigate the robot from point A to point B. Collision avoidance of objects which are not accounted for within the map, e.g. movable objects like chairs or people who cross the path of the robot, have to be accounted for and reacted to accordingly as well. The combination of all these aspects allows for a safe navigation of the robot within the environment.

Manipulation:
Manipulation is the control of movements of joints and links of the robot. This allows the robot to make correct movements and accomplish orders coming from the upper layer. Depending on the values received the robot can for example enter objects or deposit them. Giskardpy is an important library in the cacul of movements. The implementation of the manipulation is done thanks to the python language, ROS, and the iai_kinematic_sim and iai_hsr_sim libraries in addition to Giskardpy. Sry, Gif is unavailable

Simulation of the HSR while opening a human sized door. This gif is accelerated to 200% speed. This results with a real-time factor of approximately 0.46 to an effective speed of 92%.

Planning:
Planning connects perception, knowledge, manipulation and navigation by creating plans for the robot activities. Here, we develop generic strategies for the robot so that he can decide, which action should be executed in which situation and in which order. One task of planning is the failure handling and providing of recovery strategies. To write the plans, we use the programming language lisp.

Perception:
The perception module has the task to process the visual data received by the robot's camera sensors. The cameras send point clouds forming the different objects in the robot's view port. By using frameworks such as RoboSherlock and OpenCV, the perception can calculate the geometric features of the scene. Based on this, it figures out, which point clouds could be objects of interest. It recognizes the shapes, colors and other features of objects and publishes this information to the other modules. {{ :robocupfiles:objects_perception01.png?nolink&200 |}}