[x265] unsigned promotion prevents encoding frames with negative strides

[Derek Buitenhuis]

On 1/17/2018 4:31 PM, chen wrote:
> Thank you report this bug.
> I think the root cause is not sizeof(), the negative stride is invalid in encoder/decoder core.
> To avoid these invalid input parameters, the x264 insert a middle-layer that convert color space and images, but x265 doesn't it.
> 
> Of course, crash is worst way to report invalid input parameters, we will fix it soon.

Hi,

Negative strides are quite standard in the image processing world, and I think
x265 would be better off properly supporting them (as it does in its API currently)
than rejecting them

- Derek