JUCS - Journal of Universal Computer Science 23(5): 505-527, doi: 10.3217/jucs-023-05-0505
A Comparative Study of Objective Video Quality Assessment Metrics
expand article infoCarlos A.B. Mello‡, Marília M. Saraiva‡, Diego P.A. Menor‡, Ricardo Nishihara§
‡ Universidade Federal de Pernambuco, Recife, Brazil§ Motorola Company, São Paulo, Brazil

Corresponding author: Carlos Mello ( fcabm@cin.ufpe.br )

© Carlos Mello, Marília Saraiva, Diego Menor, Ricardo Nishihara.
This article is freely available under the J.UCS Open Content License.
Citation: Mello CA.B, Saraiva MM, Menor DP.A, Nishihara R (2017) A Comparative Study of Objective Video Quality Assessment Metrics. JUCS - Journal of Universal Computer Science 23(5): 505-527. https://doi.org/10.3217/jucs-023-05-0505
Open Access
Abstract
This paper presents a comparison of several video quality metrics, analysing their performance against different types of distortions. Usually, comparisons are made considering a full dataset with few different degradations. We are presenting here a comparison using three very different datasets (VQEG Phase I, LIVE VQA and ReTRIeVED) and a fourth dataset which was generated in a mobile phone network simulator. This was done to check if the video quality metrics can correctly measure the degradations created by variations in the network, very close to real scenarios. The analysis was done with 13 full reference metrics (including Opticom's PEVQ commercial tool) and two no-reference metrics. We have concluded that NTIA's VQM achieved the best results, in most of the cases. It is an open source algorithm that outperformed most of the other techniques, including the licensed PEVQ.
Keywords
video quality assessment, video distortions, PEVQ, SSIM, VQM