[x265] ASM crash in r6706

[Steve Borho]

On Tue, Apr 15, 2014 at 11:25 AM, Robert Bacs
<robert.bacs at rapidsolution.ro> wrote:
> I followed these steps to build x264:
>
> http://forum.videohelp.com/threads/357754-%5BHEVC%5D-x265-EXE-mingw-builds
>
> I'm using the following command line to test the CLI:
>
> x265.exe --input in.y4m --output out.hevc
>
> and below is the resulting call-stack:
>
> #0  0x0051995e in x265_quant_sse4 ()
> #1  0x00603ba7 in x265::TComTrQuant::getTUEntropyCodingParameters (cu=
>     0x5c32d98, result=..., absPartIdx=96491840, log2TrSize=16,
>     ttype=x265::TEXT_CHROMA)
>     at E:/temp/x265_clean/source/Lib/TLibCommon/TComTrQuant.h:171
> #2  0x005b5da8 in x265::TComTrQuant::transformNxN (this=0x54ea800,
>     cu=0x5c32d98, residual=0x5c8faa0, stride=32, coeff=0x5c05940, trSize=16,
>     ttype=x265::TEXT_CHROMA, absPartIdx=0, lastPos=0x2def748,
>     useTransformSkip=false, curUseRDOQ=true)
>     at e:/temp/x265_clean/source/Lib/TLibCommon/TComTrQuant.cpp:349
> #3  0x0059c289 in x265::TEncSearch::xIntraCodingChromaBlk (this=0x54ea518,
>     cu=0x5c32d98, trDepth=1, absPartIdx=0, absPartIdxStep=64, fencYuv=
>     0x5c93d38, predYuv=0x5c82a58, resiYuv=0x5c8da00, outDist=@0x2defab4: 0,
>     chromaId=1, bReusePred=false)
>     at e:/temp/x265_clean/source/Lib/TLibEncoder/TEncSearch.cpp:579
> #4  0x0059f6a2 in x265::TEncSearch::xRecurIntraChromaCodingQT (
>     this=0x54ea518, cu=0x5c32d98, trDepth=1, absPartIdx=0,
> fencYuv=0x5c93d38,
>     predYuv=0x5c82a58, resiYuv=0x5c8da00, outDist=@0x2defab4: 0)
>     at e:/temp/x265_clean/source/Lib/TLibEncoder/TEncSearch.cpp:1304
> #5  0x0059f7a6 in x265::TEncSearch::xRecurIntraChromaCodingQT (
>     this=0x54ea518, cu=0x5c32d98, trDepth=0, absPartIdx=0,
> fencYuv=0x5c93d38,
>     predYuv=0x5c82a58, resiYuv=0x5c8da00, outDist=@0x2defab4: 0)
>     at e:/temp/x265_clean/source/Lib/TLibEncoder/TEncSearch.cpp:1323
> #6  0x005a2222 in x265::TEncSearch::estIntraPredChromaQT (this=0x54ea518,

Is your source video publicly available?

-- 
Steve Borho