Comparing the Performance of Indoor Localization Systems through the EvAAL Framework
Scholar | Other documents of the author: Potortì, Francesco; Park, Sangjoon; Jimenez Ruiz, Antonio Ramon; Barsocchi, Paolo; Girolami, Michele; Crivello, Antonino; Lee, So-Yeon; Lim, Jae Hyun; Torres-Sospedra, Joaquín; Seco, Fernando; Montoliu Colás, Raul; Mendoza-Silva, Germán; María del Carmen, Pérez Rubio; Cristina, Losada Gutiérrez; Espinosa, Felipe; Macias-Guarasa, Javier
MetadataShow full item record
TitleComparing the Performance of Indoor Localization Systems through the EvAAL Framework
In recent years, indoor localization systems have been the object of significant research activity and of growing interest for their great expected social impact and their impressive business potential. Application ... [+]
In recent years, indoor localization systems have been the object of significant research activity and of growing interest for their great expected social impact and their impressive business potential. Application areas include tracking and navigation, activity monitoring, personalized advertising, Active and Assisted Living (AAL), traceability, Internet of Things (IoT) networks, and Home-land Security. In spite of the numerous research advances and the great industrial interest, no canned solutions have yet been defined. The diversity and heterogeneity of applications, scenarios, sensor and user requirements, make it difficult to create uniform solutions. From that diverse reality, a main problem is derived that consists in the lack of a consensus both in terms of the metrics and the procedures used to measure the performance of the different indoor localization and navigation proposals. This paper introduces the general lines of the EvAAL benchmarking framework, which is aimed at a fair comparison of indoor positioning systems through a challenging competition under complex, realistic conditions. To evaluate the framework capabilities, we show how it was used in the 2016 Indoor Positioning and Indoor Navigation (IPIN) Competition. The 2016 IPIN competition considered three different scenario dimensions, with a variety of use cases: (1) pedestrian versus robotic navigation, (2) smartphones versus custom hardware usage and (3) real-time positioning versus off-line post-processing. A total of four competition tracks were evaluated under the same EvAAL benchmark framework in order to validate its potential to become a standard for evaluating indoor localization solutions. The experience gained during the competition and feedback from track organizers and competitors showed that the EvAAL framework is flexible enough to successfully fit the very different tracks and appears adequate to compare indoor positioning systems. [-]
Investigation projectThis work was supported by the ICT R&D program of MSIP/IITP, South Korea (2017-0-00543, Development of Precise Positioning Technology for the Enhancement of Pedestrian’s Position/Spatial Cognition and Sports Competition Analysis). Parts of this work were funded by the Spanish Government through the projects TIN2013-47630-C2-1-R, TIN2015-70202-P, TIN2016-75982-C2-1-R, TEC2015-64835-C3-2-R, DPI2013-47347-C2-1-R and TARSIUS TIN2015-71564-C4-2-R, the network REPNIN TEC2015-71426-REDT, and the José Castillejo mobility programme CAS16/00072.
Bibliographic citationPotortì, F.; Park, S.; Jiménez Ruiz, A.R.; Barsocchi, P.; Girolami, M.; Crivello, A.; Lee, S.Y.; Lim, J.H.; Torres-Sospedra, J.; Seco, F.; Montoliu, R.; Mendoza-Silva, G.M.; Pérez Rubio, M.D.C.; Losada-Gutiérrez, C.; Espinosa, F.; Macias-Guarasa, J. Comparing the Performance of Indoor Localization Systems through the EvAAL Framework. Sensors 2017, 17, 2327.
The following license files are associated with this item:
Except where otherwise noted, this item's license is described as © 2017 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/).