[x264-devel] Segmentation Fault compiled with icc and encoding with deblocking filter

[Gabriel Bouvigne]

trueice a écrit :

> $ ffmpeg -y -i input.flv -an -vcodec libx264 -flags +loop -g 250 
> -keyint_min 25 -b 512000 -bt 512000 output.mp4
> ... ...
> [libx264 @ 0x6f96c390]using cpu capabilities: MMX2 SSE2Fast SSSE3 Cache64
> Press [q] to stop encoding
> Segmentation fault (core dumped)
> 
> Debugging with gdb, it seems the program fails at 
> x264_deblock_v_luma_intra_sse2().

Might be the same stack alignment issue as with MSVC. Does removing this 
section from frame.c cures your issue?

Section to remove/comment:

         if( cpu&X264_CPU_SSE2 )
         {
             pf->deblock_v_luma = x264_deblock_v_luma_sse2;
             pf->deblock_h_luma = x264_deblock_h_luma_sse2;
             pf->deblock_v_luma_intra = x264_deblock_v_luma_intra_sse2;
             pf->deblock_h_luma_intra = x264_deblock_h_luma_intra_sse2;
         }


--
Gabriel