Institute of Electrical and Electronics Engineers (IEEE)

IEEE Sensors Journal

, volume 22 , issue 6 , pages 5011-5054

Off-Line Evaluation of Indoor Positioning Systems in Different Scenarios: The Experiences From IPIN 2020 Competition

Francesco Potortì ¹

Joaquín Torres-Sospedra ²

Darwin Quezada-Gaibor ³

Antonio Jimenez ⁴

F. Seco ⁴

Antoni Pérez-Navarro ⁵

Miguel Ortiz ⁶

Ni Zhu ⁶

Valerie Renaudin ⁶

R. Ichikari ⁷

Ryo Shimomura ⁷

Nozomu Ohta ⁷

Satsuki Nagae ⁸

Takeshi Kurata ⁷

Dongyan Wei ⁹

Xinchun Ji ⁹

Wenchao Zhang ⁹

Sebastian Kram ¹⁰

Maximilian Stahlke ¹⁰

Christopher Mutschler ¹⁰

Antonino Crivello ¹

Paolo Barsocchi ¹

Michele Girolami ¹

FILIPPO PALUMBO ¹

Ruizhi Chen ¹¹

Yuan Wu ¹¹

Wei Li ¹¹

Yue Yu ¹¹

Shihao Xu ¹¹

L. Huang ¹¹

Tao Liu ¹²

Jian Kuang ¹²

You Li ¹²

Takuto Yoshida ¹³

Yoshiteru Nagata ¹³

Yuto Fukushima ¹³

Nobuya Fukatani ¹³

Nozomi Hayashida ¹³

Yusuke Asai ¹³

Kenta Urano ¹³

Wenfei Ge ¹²

Nien-Ting Lee ¹⁴

Shih-Hau Fang ¹⁴

You Cheng Jie ¹⁴

Shawn Rong Young ¹⁴

Ying‐Ren Chien ¹⁵

Chih Chieh Yu ¹⁵

Chengqi Ma ¹⁶

Bang Wu ¹⁷

Wei Zhang ¹⁸

Yankun Wang ¹⁸

Yonglei Fan ¹⁷

Stefan Poslad ¹⁷

David R. Selviah ¹⁶

Weixi Wang ¹⁸

Hong Yuan ⁹

Yoshitomo Yonamoto ¹⁹

Masahiro Yamaguchi ²⁰

Tomoya Kaichi ¹⁹

Baoding Zhou ²¹

Xu Liu ²¹

Zhining Gu ²²

CHENGJING YANG ²¹

Zhiqian Wu ²¹

Doudou Xie ²¹

Can Huang ²¹

Lingxiang Zheng ²³

Ao Peng ²³

Ge Jin ²³

Wang Qu ²⁴

Haiyong Luo ²⁵

Hao Xiong ²⁶

Linfeng Bao ²⁵

Pushuo Zhang ²⁶

Fang Zhao ²⁶

Chia An Yu ¹⁴

Chun Hao Hung ¹⁴

Leonid Antsfeld ²⁷

Boris Chidlovskii ²⁷

Haitao Jiang ²⁸

Ming Xia ²⁸

Dayu Yan ²⁸

Yuhang Li ²⁸

Yitong Dong ²⁸

Ivo Silva ²⁹

Cristiano Pendao ²⁹

Filipe Meneses ²⁹

Maria João Nicolau ²⁹

Antonio Costa ²⁹

Adriano Moreira ²⁹

Cedric De Cock ³⁰

David Plets ³⁰

Miroslav Opiela ³¹

Jakub Dzama ³¹

Liqiang Zhang ³²

Li Hu ³²

Boxuan Chen ³²

Yu Liu ³²

Seanglidet Yean ³³

Bo Zhi Lim ³³

Wei Jie Teo ³³

Bu Sung Lee ³³

Hong Lye Oh ³³

Hide authors affiliations Show authors affiliations: 33 affiliations

Information Science and Technologies Institute, National Research Council, Pisa, Italy |

UBIK Geospatial Solutions S.L., Castellón, Spain |

Institute of New Imaging Technologies, Unviersitat Jaume I, Castellón, Spain |

⁴

Centre for Automation and Robotics (CSIC-UPM), Arganda del Rey, Spain |

⁵

Faculty of Computer Sciences, Multimedia and Telecommunication, Universitat Oberta de Catalunya, Barcelona, Spain |

⁶

AME-GEOLOC, Université Gustave Eiffel, IFSTTAR, Bouguenais, France |

⁷

National Institute of Advanced Industrial Science and technology (AIST), Tsukuba, Japan |

⁸

Department of Intelligent Interaction Technologies, University of Tsukuba, Tsukuba, Japan |

⁹

Aerospace Information Research Institute, Chinese Academy of Sciences, Beijing, China |

¹⁰

Fraunhofer Institute for Integrated Circuits IIS, Nürnberg, Germany |

¹¹

State Key Laboratory of Information Engineering in Surveying, Mapping and Remote Sensing (LIESMARS), Wuhan university, Wuhan, China |

¹²

GNSS Research Center, Wuhan University, Wuhan, China |

¹³

Department of Information and Communication Engineering, Graduate School of Engineering, Nagoya University, Nagoya, Japan |

¹⁴

Department of Electrical Engineering, Yuan Ze University, Taoyuan, Taiwan |

¹⁵

Department of Electrical Engineering, National Ilan University, Yilan, Taiwan |

¹⁶

Electronic and Electrical Engineering Department, University College London, London, U.K. |

¹⁷

Electronic Engineering and Computer Science Department, Queen Mary University of London, London, U.K. |

¹⁸

Department of Research Institute for Smart Cities, Shenzhen University, Shenzhen, China |

¹⁹

Faculty of Science and Technology, Keio University, Yokohama, Japan |

²⁰

Nippon Electric Company Ltd., (NEC), Kawasaki, Japan |

²¹

College of Civil and Transportation Engineering, Shenzhen University, Shenzhen, China |

²²

School of Architecture and Urban Planning, Shenzhen University, Shenzhen, China |

²³

Department of Informatics and Communication Engineering, Xiamen University, Xiamen, China |

²⁴

School of artificial intelligence, Beijing University of Posts and Telecommunications, Beijing, China |

²⁵

Beijing Key Laboratory of Mobile Computing and Pervasive Device, Institute of Computing Technology, Chinese Academy of Sciences, Beijing, China |

²⁶

School of Computer Science (National Pilot Software Engineering School), Beijing University of Posts and Telecommunications, Beijing, China |

²⁷

Naver Labs Europe, Meylan, France |

²⁸

School of electronic and information engineering, Beihang University, Beijing, China |

²⁹

ALGORITMI Research Center, University of Minho, Guimarães, Portugal |

³⁰

Department of Information Technology, IMEC-WAVES Group, Ghent University, Ghent, Belgium

Ghent University

Interuniversity Microelectronics Centre

³¹

Faculty of Science, Institute of Computer Science, Pavol Jozef Šafárik University in Košice, Košice, Slovakia |

³²

School of Microelectronics, Tianjin University, Tianjin, China |

³³

School of Computer Science and Engineering, Nanyang Technological University, Singapore |

Publication type: Journal Article

Publication date: 2022-03-15

Institute of Electrical and Electronics Engineers (IEEE)

IEEE Sensors Journal

scimago Q1

wos Q1

SJR: 1.039

CiteScore: 8.2

Impact factor: 4.5

ISSN: 1530437X, 15581748, 23799153

DOI: 10.1109/jsen.2021.3083149

Copy DOI

Electrical and Electronic Engineering

Instrumentation

Abstract

Every year, for ten years now, the IPIN competition has aimed at evaluating real-world indoor localisation systems by testing them in a realistic environment, with realistic movement, using the EvAAL framework. The competition provided a unique overview of the state-of-the-art of systems, technologies, and methods for indoor positioning and navigation purposes. Through fair comparison of the performance achieved by each system, the competition was able to identify the most promising approaches and to pinpoint the most critical working conditions. In 2020, the competition included 5 diverse off-site off-site Tracks, each resembling real use cases and challenges for indoor positioning. The results in terms of participation and accuracy of the proposed systems have been encouraging. The best performing competitors obtained a third quartile of error of 1 m for the Smartphone Track and 0.5 m for the Foot-mounted IMU Track. While not running on physical systems, but only as algorithms, these results represent impressive achievements.

Found

1 citation

Panov Aleksandr

PhD in Physics and Mathematics, associate professor

123 publications, 834 citations, 26 reviews

h-index: 14

Moscow Institute of Physics and Technology

Research interests

Cognitive modeling

Planning

Reinforcement learning

Top-30

Journals

	2 4 6 8 10 12 14
IEEE Sensors Journal	IEEE Sensors Journal, 14, 24.14% IEEE Sensors Journal 14 publications, 24.14%
IEEE Access	IEEE Access, 7, 12.07% IEEE Access 7 publications, 12.07%
Sensors	Sensors, 6, 10.34% Sensors 6 publications, 10.34%
Expert Systems with Applications	Expert Systems with Applications, 3, 5.17% Expert Systems with Applications 3 publications, 5.17%
IEEE Journal of Indoor and Seamless Positioning and Navigation	IEEE Journal of Indoor and Seamless Positioning and Navigation, 3, 5.17% IEEE Journal of Indoor and Seamless Positioning and Navigation 3 publications, 5.17%
SoftwareX	SoftwareX, 2, 3.45% SoftwareX 2 publications, 3.45%
Internet of Things	Internet of Things, 2, 3.45% Internet of Things 2 publications, 3.45%
Applied Sciences (Switzerland)	Applied Sciences (Switzerland), 1, 1.72% Applied Sciences (Switzerland) 1 publication, 1.72%
Remote Sensing	Remote Sensing, 1, 1.72% Remote Sensing 1 publication, 1.72%
Journal of the Brazilian Society of Mechanical Sciences and Engineering	Journal of the Brazilian Society of Mechanical Sciences and Engineering, 1, 1.72% Journal of the Brazilian Society of Mechanical Sciences and Engineering 1 publication, 1.72%
Satellite Navigation	Satellite Navigation, 1, 1.72% Satellite Navigation 1 publication, 1.72%
ACM Transactions on Internet Technology	ACM Transactions on Internet Technology, 1, 1.72% ACM Transactions on Internet Technology 1 publication, 1.72%
Measurement Science and Technology	Measurement Science and Technology, 1, 1.72% Measurement Science and Technology 1 publication, 1.72%
IFIP Advances in Information and Communication Technology	IFIP Advances in Information and Communication Technology, 1, 1.72% IFIP Advances in Information and Communication Technology 1 publication, 1.72%
Lecture Notes in Electrical Engineering	Lecture Notes in Electrical Engineering, 1, 1.72% Lecture Notes in Electrical Engineering 1 publication, 1.72%
Computer Networks	Computer Networks, 1, 1.72% Computer Networks 1 publication, 1.72%
IEEE Pervasive Computing	IEEE Pervasive Computing, 1, 1.72% IEEE Pervasive Computing 1 publication, 1.72%
IEEE Transactions on Wireless Communications	IEEE Transactions on Wireless Communications, 1, 1.72% IEEE Transactions on Wireless Communications 1 publication, 1.72%
Ad Hoc Networks	Ad Hoc Networks, 1, 1.72% Ad Hoc Networks 1 publication, 1.72%
Journal of King Saud University - Computer and Information Sciences	Journal of King Saud University - Computer and Information Sciences, 1, 1.72% Journal of King Saud University - Computer and Information Sciences 1 publication, 1.72%
	2 4 6 8 10 12 14

Publishers

	5 10 15 20 25 30 35
Institute of Electrical and Electronics Engineers (IEEE)	Institute of Electrical and Electronics Engineers (IEEE), 34, 58.62% Institute of Electrical and Electronics Engineers (IEEE) 34 publications, 58.62%
Elsevier	Elsevier, 9, 15.52% Elsevier 9 publications, 15.52%
MDPI	MDPI, 8, 13.79% MDPI 8 publications, 13.79%
Springer Nature	Springer Nature, 5, 8.62% Springer Nature 5 publications, 8.62%
Association for Computing Machinery (ACM)	Association for Computing Machinery (ACM), 1, 1.72% Association for Computing Machinery (ACM) 1 publication, 1.72%
IOP Publishing	IOP Publishing, 1, 1.72% IOP Publishing 1 publication, 1.72%
	5 10 15 20 25 30 35

We do not take into account publications without a DOI.
Statistics recalculated weekly.

Are you a researcher?

Create a profile to get free access to personal recommendations for colleagues and new articles.

Metrics

Cite this

GOST |

Cite this

GOST Copy

Potortì F. et al. Off-Line Evaluation of Indoor Positioning Systems in Different Scenarios: The Experiences From IPIN 2020 Competition // IEEE Sensors Journal. 2022. Vol. 22. No. 6. pp. 5011-5054.

GOST all authors (up to 50) Copy

Potortì F. et al. Off-Line Evaluation of Indoor Positioning Systems in Different Scenarios: The Experiences From IPIN 2020 Competition // IEEE Sensors Journal. 2022. Vol. 22. No. 6. pp. 5011-5054.

RIS |

Cite this

RIS

BibTex |

Cite this

BibTex (up to 50 authors) Copy

@article{2022_Potortì,

author = {Francesco Potortì and Joaquín Torres-Sospedra and Darwin Quezada-Gaibor and Antonio Jimenez and F. Seco and Antoni Pérez-Navarro and Miguel Ortiz and Ni Zhu and Valerie Renaudin and R. Ichikari and Ryo Shimomura and Nozomu Ohta and Satsuki Nagae and Takeshi Kurata and Dongyan Wei and Xinchun Ji and Wenchao Zhang and Sebastian Kram and Maximilian Stahlke and Christopher Mutschler and Antonino Crivello and Paolo Barsocchi and Michele Girolami and FILIPPO PALUMBO and Ruizhi Chen and Yuan Wu and Wei Li and Yue Yu and Shihao Xu and L. Huang and Tao Liu and Jian Kuang and You Li and Takuto Yoshida and Yoshiteru Nagata and Yuto Fukushima and Nobuya Fukatani and Nozomi Hayashida and Yusuke Asai and Kenta Urano and Wenfei Ge and Nien-Ting Lee and Shih-Hau Fang and You Cheng Jie and Shawn Rong Young and Ying‐Ren Chien and Chih Chieh Yu and Chengqi Ma and Bang Wu and Wei Zhang and others},

title = {Off-Line Evaluation of Indoor Positioning Systems in Different Scenarios: The Experiences From IPIN 2020 Competition},

journal = {IEEE Sensors Journal},

year = {2022},

volume = {22},

publisher = {Institute of Electrical and Electronics Engineers (IEEE)},

month = {mar},

url = {https://doi.org/10.1109/jsen.2021.3083149},

number = {6},

pages = {5011--5054},

doi = {10.1109/jsen.2021.3083149}

}

MLA

Cite this

MLA Copy

Potortì, Francesco, et al. “Off-Line Evaluation of Indoor Positioning Systems in Different Scenarios: The Experiences From IPIN 2020 Competition.” IEEE Sensors Journal, vol. 22, no. 6, Mar. 2022, pp. 5011-5054. https://doi.org/10.1109/jsen.2021.3083149.

Publisher

Institute of Electrical and Electronics Engineers (IEEE)

Journal

IEEE Sensors Journal

scimago Q1

wos Q1

SJR

1.039

CiteScore

8.2

Impact factor

4.5

ISSN

1530437X (Print)

15581748 (Electronic)

23799153 (Electronic)

Profiles