Behaviour Learning: Combining Sensing and Action
- Project Title:
- Behaviour Learning: Combining Sensing and Action
- B-LEARN II
- Work Area:
- Machine Learning
- Universität Karlsruhe
Institute for Real-time Computer Systems & Robotics
D - 76128 KARLSRUHE
- Coordinator Country:
- Katholieke Universiteit Leuven B
Universität Dortmund D
Universidad Politecnica de Catalunya E
Università di Genova I
Università di Torino I
Universidad Nova de Lisboa p
- Contact Point:
- Prof. R. Dillmann
- +49/721 608 3547
- +49/721 606 740
- robotics, machine learning, hybrid learning systems, signal-to-symbol transformation
- Start Date:
- 1 September 92
- 36 months
- Robust subsymbolic and symbolic learning strategies are being studied and developed that should prove useful in enhancing robot performance, reliability and flexibility as well as in supporting the acquisition of robot skills. These techniques are applied to real assembly, machining and navigation tasks, using a framework of enhanced robot control architectures supporting the integration of machine learning algorithms. The work builds on the results of the Working Group on Vision (3352).
The main objective of B-LEARN II is to enhance robot programming and robot autonomy by introducing learning capabilities in order to close the loop between sensing and action. General aspects of interfacing robotics and machine learning are investigated for three applications: compliant actions in assembly, monitoring in assembly and machining, and the navigation of mobile systems. Based on these studies, the general requirements for the application of machine learning in robotics are defined. Appropriate enhancements are made to robot system architectures, leading to robot systems with learning capabilities.
APPROACH AND METHODS
The difficulty of closing the loop between sensing and action by programming appropriate control strategies is one of the major cost factors in robot applications. Moreover, it limits the applicability of robots to non-structured domains. Following the hierarchical structure of the target systems (robots, mobile platforms, and machining devices), symbolic and subsymbolic learning strategies and their combination (hybrid learning systems) are studied. Additionally, robot system architectures are studied, given the requirements of machine learning methods. Certain enhancements due to the aspect of interfacing are added to both components.
On the lowest level, the main problem is that of feature selection and feature extraction. Subsymbolic methods are envisaged in order to automatically refine this process.
On the second level, a conceptual structure representing the robot's internal model of the world must be created. Here symbolic learning techniques are used. The highest level deals with the problem-solving activity in order to reach the main goal of the robot, which might be reaching a given destination, assembling a component, or enhancing the current skills (experimentation). On this level, learning heuristics in problem solving is the typical learning task.
With respect to the aspect of knowledge exchange between the control level and the problem solving/planning level, methods to use low-level robot skills most efficiently in planning and to use high-level knowledge to enhance control skills, eg by experimentation, are developed.
The result of this project will be a set of case studies, demonstrating how machine learning can be applied to robotics, and giving a detailed description of requirements for certain applications.
PROGRESS AND RESULTS
During the first phase, the work has focused on the definition of a common scenario and a sound experimental methodology. Moreover, the requirements for interfacing machine learning and robotics have been investigated on the base of given case studies.
The main results so far are:
- A general architecture supporting the application of machine learning to robotics.
- Architectures supporting the application of machine learning to robotics which are derived from the general one but take the special requirements of the case studies into account.
- A classification of the learning tasks which are to be solved within the several case studies, and an experimental methodology which should lead to this solution.
- Exchange of knowledge between machine learning researches and robotics researchers, leading to a better understanding of the common problems, which is crucial for the success of the project.
- Development of experimental setups.
- First experiments with several learning techniques on the base of real-world sensory data, recorded from the above mentioned test beds.
The cross-fertilisation of the two fields of machine learning and robotics has a deep impact on both sciences. The requirements of machine learning have already lead to an evolution of the robot architectures that are used in B-LEARN II. The control and programming techniques nowadays used for robots can also be expected to change significantly.
Machine learning has until now been applied only very little to real-world problems. It is now facing real robotics task, and the existing methodologies are already and will have to be compared in the light of the concrete tasks and the concrete results that can be achieved. Results and hints from B-LEARN II should be able to influence future research in machine learning. In order to emphasise the benefits arising from the project's synergetic nature and to encourage further cooperation, a workshop will be organised after the first year.
The final results will be demonstrated and explained to the industry at a workshop to be organised at the end of the project.
- Botta M, Giordana A, Neri F and Voinea C An approach to bridge the gap between numerical and symbolic features, In: Proc. of the ECML-93 Workshop on Learning Robots, Vienna, Austria (1993)
- Kreuziger J and Hauser M The new system architecture for applying symbolic learning techniques to robot manipulation, In: Proc. of the IEEE/RSJ Int. Conference on Intelligent Robots and Systems (IROS '93), Yokohama, Japan (1993)
- Morik K and Rieger A Learning action-oriented perceptual features for robot navigation, In: Proc. of the ECML-93 Workshop on Learning Robots, Vienna, Austria (1993)
INFORMATION DISSEMINATION ACTIVITIES
April 8, 1993: Workshop on Learning Robots (in the frame of ECML'93, Vienna, Austria). After the latest results will be presented to the CEC in Autumn 1993, they will be made available to the public by means of a workshop by the end of this year. Moreover, it is expected that many results will also be presented at international conferences in 1993 and 1994.
Sven Müßig, last update 07-nov-1995. Your feedback is welcome.