ReHRI’17 – International Workshop on reproducible HRI experiments: scientific endeavors, benchmarking and standardization
International workshop held in conjunction with the 12th Annual Conference on Human-Robot Interaction (HRI2017).
The current metrics, scenario settings, corpora and databases applied in HRI experiments are tailored to individual cases and, thus, are not suitable to compare and benchmark results across laboratories and systems. The robotics scientific community should agree on processes, procedures and metrics in order to establish a standardized benchmarking platform that is widely applicable across all areas of robotics. This workshop will bring together research scientists, representatives of robotics companies and members of standardization working groups. We expect that a fruitful discussion in the definition of experimental scenarios and protocols in HRI will assist to highlight the latest advances in the field and lead to the development of agreed and shared evaluation platforms for objective benchmarking of the wide and ever-growing range of robot applications.
The primary audience of the proposed workshop is intended to be robot researchers/developers and practitioners from academia and industry working in all areas of HRI including: industrial, personal care, social, medical and entertainment robotics. However, the workshop has a clear focus on how research and standardization should work together effectively in the field of HRI benchmarking, such that useful and thoughtful working groups for standards are created and a roadmap for the coming years is generated.
Topics of interest include, but are not limited to:
A non-exhaustive list of topics to be included in the workshop is as follows:
- Benchmarking HRI in robotic applications
- Performance indicators for HRI
- Standardization activities for HRI experiments
- User studies in Human – robot collaboration
- Human – robot interfaces and evaluation of user-experience
- Innovative design of commercial HRI solutions
- Safety, physical contacts, technical aspects, limitations and regulations influencing HRI design
- Evaluation of HRI group dynamics
- HRI metrics for teams
- Ethics in HRI experiments
- Corpora for HRI
- Creation of ISO working group on HRI
- Repositories of data-sets for benchmarking
- Industrial, medical, social and personal care robots
- Robotics competitions and their standardized experimental settings
- Presentation of an editorial proposal, a book on the workshop topics
Authors of papers select one of following presentation types :
– lightning talk (5 minutes)
– poster presentation
– oral presentation(15-20 minutes)
(note : we will also include a few selected papers or invited speakers)
Submissions will be reviewed and accepted based on relevance to the workshop topics, technical quality, novelty, and presentation type.
The maximum file size is 2 MB. Submissions should be in PDF format through Easy Chair:
Submission deadline (extended):
January 31, 2017 February 07, 2017
Acceptance notification: February 14, 2017
Workshop event: March 6, 2017
The introduction will aim at harmonizing the setting, pointing out the main points of discussion and agreeing on how the workshop activities will be conducted. The initial part of the workshop will also include presentations from multiple experts in the main relevant fields of interest. Once a common ground has been established, it will be easier to convey participants with diverse experiences and backgrounds towards the discussion topic.
Early stage researchers will be encouraged to contribute to the midday workshop session through the presentation of poster work and very short lightning talks. Contrary to formal presentations, posters do not require a long-term research experience, which allows early stage researchers to submit their contributions. The workshop would be an ideal time for young researches to promote their work and share their ideas with experienced researchers in one-to-one discussions in the informal environment of the workshop.
The workshop will continue with two split sessions. Initially parallel brainstorming discussions about benchmarking of HRI experiments will take place. Afterwards, the participants will focus on a brainstorming session about establishing holistic HRI scenarios. These sessions will provide the opportunity for smaller group discussions and greater involvement from the participants. The results of the split sessions will be the contribution to the final discussion (wrap up session), which aims at establishing common ground on benchmarking and evaluation of reproducible HRI experiments and at providing input to standardisation, benchmarking and robotics competition working groups.
|09:00 – 09:15||Welcome – Opening|
|09:15 – 10:00||Oral presentations 1|
|10:00 – 10:20||Coffee Break|
|10:20 – 11:20||Oral presentations 2|
|11:20 – 12:00||Lightning talks|
|12:00 – 12:30||Poster Session|
|12:30 – 13:30||Lunch Break|
|13:30 – 15:00||Split brainstorming sessions on benchmarking HRI experiments|
|15:00 – 15:20||Coffee Break|
|15:20 – 17:00||Brainstorming session on holistic HRI scenarios|
|17:00 – 17:30||Wrap-up and minutes|