[vlc-devel] OpenHMD branch?

[Lomax]

Hi Alexandre, 

Many thanks for this, very helpful! I did manage to build Adrien Maglo's
HMD-instancing branch before I saw your message, but your branch seems a
little more up to date; in particular it includes the Vulkan
video_output module. I am able to run an example 360 stereo video (after
injecting the required meta data tags[1]) using the OpenGL output and it
looks stunning on the Rift, but performance is absolutely terrible - at
full resolution VLC is unable to progress beyond the first frame and
head movements are extremely jerky. Using a greatly scaled down video
(1280x720) it does play, but at something like 0.2fps, and head
movements are still far too jerky. 

I was curious to try the new "Vulkan" renderer so checked out your
branch and managed to get this to build with Vulkan support (after yet
more dependency wrangling) but when selecting this as video output the
3D transformations are no longer applied; I just get the two panoramic
views one above the other, as I would when playing a video without the
spatialmedia meta data. Switching back to OpenGL makes it work again,
but at slideshow speeds. Clearly, I have underestimated the GPU grunt
required to handle this and will need to get a much more powerful
machine! Any pointers as to how high I should set the bar? I'm a bit
rusty on the GPU charts... 

Best regards, 

Lomax 

1: https://github.com/google/spatial-media/tree/master/spatialmedia 

On 2019-05-16 11:26, Alexandre Janniaux wrote:

> Hi, 
> 
> Thank you for your interest in this, don't hesitate to give some feedback about what you expect. 
> 
> The tag used for the demo at CES2019 is there[1]: 
> 
> [1]: https://github.com/alexandre-janniaux/vlc/tree/demo-ces2019-vlc-vr 
> 
> It's taylored for demo so it's using the lua interface and it keeps the HMD at the same state between videos, and offers control over http to switch the item in the playlist. It doesn't offer direct display on the headset though (which needs a vulkan renderer) so you need to configure the screen as soon as the headset is started. I might be able to find the startup script used for the demo, I'll post them here if I recover this. I would advise to start the demo on an existing playlist file so you don't have to create the whole playlist each time or if an issue arise. 
> 
> I'm currently in the process of merging this so I have more recent and cleaner work on this, but it's destructured into multiple branch. I can try to provide you a more up-to-date partial version using these branches if you want. I hope to have sent here at least the full HMD+360 support before the end of next week, if you're ready to wait until then otherwise. 
> 
> There are additional resources that you would need if you want to try the VR Theater demo, I'll check how we can distribute them. 
> 
> Greats,
> -- 
> Alexandre Janniaux, 
> VideoLabs
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mailman.videolan.org/pipermail/vlc-devel/attachments/20190517/d34e951b/attachment.html>