[x265] [PATCH] quant[BUG]: correct scaling list type
Steve Borho
steve at borho.org
Wed Mar 18 17:09:11 CET 2015
On 03/18, deepthi at multicorewareinc.com wrote:
> # HG changeset patch
> # User Deepthi Nandakumar <deepthi at multicorewareinc.com>
> # Date 1426664785 -19800
> # Wed Mar 18 13:16:25 2015 +0530
> # Node ID 3a913041edebc6198c78800b63337d3c5afe8f1e
> # Parent 14aec6dc4d3b6c7b295fe1ead34c0f9f89a08cc4
> quant[BUG]: correct scaling list type
how did this not cause serious hash mismatches before?
> diff -r 14aec6dc4d3b -r 3a913041edeb source/common/quant.cpp
> --- a/source/common/quant.cpp Wed Mar 18 12:41:16 2015 +0530
> +++ b/source/common/quant.cpp Wed Mar 18 13:16:25 2015 +0530
> @@ -422,7 +422,7 @@
> {
> int deltaU[32 * 32];
>
> - int scalingListType = ttype + (isLuma ? 3 : 0);
> + int scalingListType = (cu.isIntra(absPartIdx) ? 0 : 3) + ttype;
> int rem = m_qpParam[ttype].rem;
> int per = m_qpParam[ttype].per;
> const int32_t* quantCoeff = m_scalingList->m_quantCoef[log2TrSize - 2][scalingListType][rem];
> _______________________________________________
> x265-devel mailing list
> x265-devel at videolan.org
> https://mailman.videolan.org/listinfo/x265-devel
--
Steve Borho
More information about the x265-devel
mailing list