JUCS - Journal of Universal Computer Science 23(5): 505-527, doi: 10.3217/jucs-023-05-0505
A Comparative Study of Objective Video Quality Assessment Metrics
expand article infoCarlos A.B. Mello, Marília M. Saraiva, Diego P.A. Menor, Ricardo Nishihara§
‡ Universidade Federal de Pernambuco, Recife, Brazil§ Motorola Company, São Paulo, Brazil
Open Access
This paper presents a comparison of several video quality metrics, analysing their performance against different types of distortions. Usually, comparisons are made considering a full dataset with few different degradations. We are presenting here a comparison using three very different datasets (VQEG Phase I, LIVE VQA and ReTRIeVED) and a fourth dataset which was generated in a mobile phone network simulator. This was done to check if the video quality metrics can correctly measure the degradations created by variations in the network, very close to real scenarios. The analysis was done with 13 full reference metrics (including Opticom's PEVQ commercial tool) and two no-reference metrics. We have concluded that NTIA's VQM achieved the best results, in most of the cases. It is an open source algorithm that outperformed most of the other techniques, including the licensed PEVQ.
video quality assessment, video distortions, PEVQ, SSIM, VQM