[vlc-devel] Picture size differs from encoder init fmt

[Rafaël Carré]

Hello,

On 01/15/14 03:21, Francois Cartegnie wrote:
> Hi,
> 
> I've found some heap overflow case with at least one encoder.
> This is due to requested format different the resulting picture format
> passed to encoder, and then overflows the allocated buffer when copying.
> 
> fmt_in is 640x336 which becomes 640x352 in pictures.

Can you give all the struct members to avoid any ambiguity?

(gdb) print *fmt_in
(gdb) print *p_pic

would be perfect.


> I'm unsure if there's a bug (I don't see any alignment) and how to
> handle it (truncate pic or realloc).
> 
> Francois