Egocentric video summarisation via purpose-orientedframe scoring and selection
![Thumbnail](/xmlui/bitstream/handle/10234/196287/traver_2021_egocentric.pdf.jpg?sequence=4&isAllowed=y)
Ver/ Abrir
Metadatos
Mostrar el registro completo del ítemcomunitat-uji-handle:10234/9
comunitat-uji-handle2:10234/43662
comunitat-uji-handle3:10234/43643
comunitat-uji-handle4:
INVESTIGACIONMetadatos
Título
Egocentric video summarisation via purpose-orientedframe scoring and selectionFecha de publicación
2021-11-02Editor
Elsevier; PergamonISSN
0957-4174Cita bibliográfica
TRAVER, V. Javier; DAMEN, Dima. Egocentric video summarisation via purpose-oriented frame scoring and selection. Expert Systems with Applications, 2022, vol. 189, p. 116079.Tipo de documento
info:eu-repo/semantics/articleVersión
info:eu-repo/semantics/publishedVersionPalabras clave / Materias
Resumen
Existing video summarisation techniques are quite generic in nature, since they generally overlook the important aspect of what actual purpose the summary will be serving. In sharp contrast with this mainstream work, ... [+]
Existing video summarisation techniques are quite generic in nature, since they generally overlook the important aspect of what actual purpose the summary will be serving. In sharp contrast with this mainstream work, it can be acknowledged that there are many possible purposes the same videos can be summarised for. Accordingly, we consider a novel perspective: summaries with a purpose. This work is an attempt to both, call the attention on this neglected aspect of video summarisation research, and to illustrate it and explore it with two concrete purposes, focusing on first-person-view videos. The proposed purpose-oriented summarisation techniques are framed under the common (frame-level) scoring and selection paradigm, and have been tested on two egocentric datasets, BEOID and EGTEA-Gaze+. The necessary purpose-specific evaluation metrics are also introduced.
The proposed approach is compared with two purpose-agnostic summarisation baselines. On the one hand, a partially agnostic method uses the scores obtained by the proposed approach, but follows a standard generic frame selection technique. On the other hand, the fully agnostic method do not use any purpose-based information, and relies on generic concepts such as diversity and representativeness. The results of the experimental work show that the proposed approaches compare favourably with respect to both baselines. More specifically, the purpose-specific approach generally produces summaries with the best compromise between summary lengths and favourable purpose-specific metrics. Interestingly, it is also observed that results of the partially-agnostic baseline tend to be better than those of the fully-agnostic one. These observations provide strong evidence on the advantage and relevance of purpose-specific summarisation techniques and evaluation metrics, and encourage further work on this important subject. [-]
Publicado en
Expert Systems With Applications 189 (2022) 116079Entidad financiadora
Universitat Jaume I | Ministerios de Ciencia e Innovación y de Universidades
Código del proyecto o subvención
UJI-B2018-44 | PRX18/00283 | RED2018-102511-T
Derechos de acceso
© 2021 The Authors. Published by Elsevier Ltd.
info:eu-repo/semantics/openAccess
info:eu-repo/semantics/openAccess
Aparece en las colecciones
- INIT_Articles [751]