[x264-devel] Resend: I tried to add 12 bit depth support into x264 (probably wrongly)
Henrik Gramner
henrik at gramner.com
Sat Mar 21 16:39:43 CET 2020
On Sat, Mar 21, 2020 at 12:48 AM Andrew Randrianasulu
<randrianasulu at gmail.com> wrote:
> I think 12 bit part was simple, but I have no idea how to test it!
It's actually not that simple. There's a bunch of intermediate buffers
that will have insufficient precision when going from 10-bit to 12-bit
which will cause integer overflows.
The tricky part is to figure out exactly which ones those are and
template them with suitable data types to handle it. That affects SIMD
as well.
More information about the x264-devel
mailing list