[vlc-devel] [PATCH] [RFC] decoder: add more decoder device types

[Thomas Guillem]

On Mon, Jun 24, 2019, at 07:32, Steve Lhomme wrote:
> These are types needed to move the decoder pools that exist in various display
> modules closer to the decoder.
> 
> That means we need to make the decision early on which flavor of OpenGL 
> will be
> used before the OpenGL display module is created. Depending on the 
> platform
> used it could be VAAPI, VDPAU, DXVA2, OpenGL PBO (persistent and 
> non-persistent).
> 
> And to do that we need to create the "decoder device" using the es_format_t
> that will be decoded (so we can pick a hardware decoder or a software one),
> which contains the codec, profile and dimensions. When any of these change we
> will need to create a new decoder device (or check the one we have is
> compatible).
> ---
>  include/vlc_codec.h | 9 +++++++++
>  1 file changed, 9 insertions(+)
> 
> diff --git a/include/vlc_codec.h b/include/vlc_codec.h
> index 71f3e8439f..ec5d7e32af 100644
> --- a/include/vlc_codec.h
> +++ b/include/vlc_codec.h
> @@ -491,6 +491,9 @@ enum vlc_decoder_device_type
>      VLC_DECODER_DEVICE_DXVA2,
>      VLC_DECODER_DEVICE_D3D11VA,
>      VLC_DECODER_DEVICE_AWINDOW,
> +    VLC_DECODER_DEVICE_VULKAN,
> +    VLC_DECODER_DEVICE_PBO,

For software rendering, VK and GL can be merged. Both will need memory allocated with vlc_memfd(). That way, we could pass the fd to the VK/GL API.

Decoders don't need to know about PBO. Indeed, PBO buffers (in non persistent) are just used as buffer to upload a picture without locking the whole GL context with glTexSubImage2D().

And for persistent mode, I think we can drop it. Yes, from VLC point of view, there is one less memcpy, but I guess it is still done in the GL/Driver side since persistent buffers are mapped on the CPU.  Mapping buffers in GPU is worst by the way, since it is very slow to access them (for reference frames for example).

> +    VLC_DECODER_DEVICE_MMAL,

Better to take care about MMAL later, when push model is merged and functional for most used HWs.

>  };
>  
>  /**
> @@ -514,6 +517,12 @@ typedef struct vlc_decoder_device
>       * The type of pointer will depend of the type:
>       * VAAPI: VADisplay
>       * VDPAU: vdp_t *
> +     * DXVA2: IDirect3DDevice9*
> +     * D3D11VA: ID3D11DeviceContext*
> +     * AWindow: android AWindowHandler*
> +     * Vulkan: vlc_vk_t*
> +     * OpenGL PBO: vlc_gl_t*
> +     * MMAL: MMAL_PORT_T*
>       */
>      void *opaque;
>  } vlc_decoder_device;
> -- 
> 2.17.1
> 
> _______________________________________________
> vlc-devel mailing list
> To unsubscribe or modify your subscription options:
> https://mailman.videolan.org/listinfo/vlc-devel