Along with the fast development of the world of visual media, arises the need for developing tools for compression of the raw data. However, in some cases the compressed data is subject to unwanted artifacts. As a way of controlling the compression process, we wish to use an objective quality assessment metric that will give us information on the quality of the compressed data. This kind of metric can be applied to a large amount of data and give us results in real time. In this work, we test the performance of the DSS video quality assessment (VQA) algorithm in an encoding and decoding environment of video streams (Transcoder). We compare this algorithm to two other methods in order to check its suitability to this environment, and make adjustments to it if necessary.