Egocentric video summarisation via purpose-orientedframe scoring and selection
![Thumbnail](/xmlui/bitstream/handle/10234/196287/traver_2021_egocentric.pdf.jpg?sequence=4&isAllowed=y)
Visualitza/
Metadades
Mostra el registre complet de l'elementcomunitat-uji-handle:10234/9
comunitat-uji-handle2:10234/43662
comunitat-uji-handle3:10234/43643
comunitat-uji-handle4:
INVESTIGACIONMetadades
Títol
Egocentric video summarisation via purpose-orientedframe scoring and selectionData de publicació
2021-11-02Editor
Elsevier; PergamonISSN
0957-4174Cita bibliogràfica
TRAVER, V. Javier; DAMEN, Dima. Egocentric video summarisation via purpose-oriented frame scoring and selection. Expert Systems with Applications, 2022, vol. 189, p. 116079.Tipus de document
info:eu-repo/semantics/articleVersió
info:eu-repo/semantics/publishedVersionParaules clau / Matèries
Resum
Existing video summarisation techniques are quite generic in nature, since they generally overlook the important aspect of what actual purpose the summary will be serving. In sharp contrast with this mainstream work, ... [+]
Existing video summarisation techniques are quite generic in nature, since they generally overlook the important aspect of what actual purpose the summary will be serving. In sharp contrast with this mainstream work, it can be acknowledged that there are many possible purposes the same videos can be summarised for. Accordingly, we consider a novel perspective: summaries with a purpose. This work is an attempt to both, call the attention on this neglected aspect of video summarisation research, and to illustrate it and explore it with two concrete purposes, focusing on first-person-view videos. The proposed purpose-oriented summarisation techniques are framed under the common (frame-level) scoring and selection paradigm, and have been tested on two egocentric datasets, BEOID and EGTEA-Gaze+. The necessary purpose-specific evaluation metrics are also introduced.
The proposed approach is compared with two purpose-agnostic summarisation baselines. On the one hand, a partially agnostic method uses the scores obtained by the proposed approach, but follows a standard generic frame selection technique. On the other hand, the fully agnostic method do not use any purpose-based information, and relies on generic concepts such as diversity and representativeness. The results of the experimental work show that the proposed approaches compare favourably with respect to both baselines. More specifically, the purpose-specific approach generally produces summaries with the best compromise between summary lengths and favourable purpose-specific metrics. Interestingly, it is also observed that results of the partially-agnostic baseline tend to be better than those of the fully-agnostic one. These observations provide strong evidence on the advantage and relevance of purpose-specific summarisation techniques and evaluation metrics, and encourage further work on this important subject. [-]
Publicat a
Expert Systems With Applications 189 (2022) 116079Entitat finançadora
Universitat Jaume I | Ministerios de Ciencia e Innovación y de Universidades
Codi del projecte o subvenció
UJI-B2018-44 | PRX18/00283 | RED2018-102511-T
Drets d'accés
© 2021 The Authors. Published by Elsevier Ltd.
info:eu-repo/semantics/openAccess
info:eu-repo/semantics/openAccess
Apareix a les col.leccions
- INIT_Articles [752]