[x264-devel] does overflow in abs2() ?

chen chenm003 at 163.com
Thu Dec 18 22:55:40 CET 2014


In the SATD, x264 call abs2() to accelerate 2 pixels parallelism.
I test the function abs2(), it seem can't output right result.
of course, it is less possible mistake.

eg:
abs(0) & abs(-1) ---> abs2(0x0000FFFF) ---> 0x00010001
 
Am I right?
 
Thanks,
Min
 
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mailman.videolan.org/pipermail/x264-devel/attachments/20141219/afd22f5a/attachment.html>


More information about the x264-devel mailing list