CNCharger
Posts: 24
Joined: Thu Feb 22, 2018 8:00 pm

Pi 4 VR Headset

Tue Nov 24, 2020 7:36 am

With how FB is handling Oculus and that there are no other good low price options, I think the best option is to build my own. What do I need to build my own VR headset?

Here is what I would like it to do if possible:

-4K @ 60Hz or 1080p @ 120Hz
-Can connect to PC or be stand alone device
-Can hand track
-Uses cameras and motion to track location and direction without sensors
-Can connect to custom hand controls or custom/pre existing bluetooth controller in stand alone mode. Can connect wirelessely or by usb-c.

I asked about this on the Arduino Site and they recommended Raspberry Pi 4.

User avatar
Gavinmc42
Posts: 6438
Joined: Wed Aug 28, 2013 3:31 am

Re: Pi 4 VR Headset

Tue Nov 24, 2020 8:35 am

Don't think it has been done yet.
Stereo?

OpenXR on PI4?
Godot 3.2 runs on Pi4, not sure about this 3.1 OpenXR version
https://monado.freedesktop.org/openxr-resources.html

Try the hello_xr demo on the Pi4 with Vulkan?
I'm dancing on Rainbows.
Raspberries are not Apples or Oranges

CNCharger
Posts: 24
Joined: Thu Feb 22, 2018 8:00 pm

Re: Pi 4 VR Headset

Tue Nov 24, 2020 6:48 pm

Gavinmc42 wrote:
Tue Nov 24, 2020 8:35 am
Don't think it has been done yet.
Stereo?

OpenXR on PI4?
Godot 3.2 runs on Pi4, not sure about this 3.1 OpenXR version
https://monado.freedesktop.org/openxr-resources.html

Try the hello_xr demo on the Pi4 with Vulkan?
I will take a look at that. What's this vulkan thing? Is it that driver that AMD really likes for Radeon? Also, whats up with the Pi 400? Doesn't look like its the same form factor as the pi 4.

User avatar
Imperf3kt
Posts: 4665
Joined: Tue Jun 20, 2017 12:16 am
Location: Australia
Contact: Twitter

Re: Pi 4 VR Headset

Tue Nov 24, 2020 8:47 pm

It might be possible, but its an extremely ambitious project involving many complex technologies.

I'd be interested to see if this manages to go anywhere.
55:55:44:44:4C
52:4C:52:42:41

Rose tinted glasses are difficult to see through.

User avatar
Gavinmc42
Posts: 6438
Joined: Wed Aug 28, 2013 3:31 am

Re: Pi 4 VR Headset

Wed Nov 25, 2020 1:45 am

Vulkan is supposed to be a bit faster than OpenGL, important for Pi4's to get reasonable fps.

I don't think it can be done easily yet.

A CM4 with two DSI/MIPI displays?
Starting to see dual screen kits on Alibaba etc.
The Linux open source display driver for DSI is in progress?

Prototype with two small HDMI screens
https://www.waveshare.com/product/raspb ... -lcd-h.htm

Or do split screen on one higher res display?
https://www.waveshare.com/product/raspb ... amoled.htm

Plenty of IMU sensor PCBs around i2c/SPI.

Software, software software.
Is there a VR version of Vulkan Quake?

Need to find some time to try OpenXR.
Around here they use Unity on big $$$$ hardware.
I'm dancing on Rainbows.
Raspberries are not Apples or Oranges

User avatar
Imperf3kt
Posts: 4665
Joined: Tue Jun 20, 2017 12:16 am
Location: Australia
Contact: Twitter

Re: Pi 4 VR Headset

Wed Nov 25, 2020 3:49 am

The hardware and processing power is only one aspect. By the way, you'd want 1080*960 for a 5.5" screen or it'll be too tall vertically as you need a 32:9 aspect ratio, not 16:9

Note my VR experience/ knowledge is limited to the PSVR, as locomotive VR experiences severely affect my health.

The feasibility would depend on OPs ability to interface multiple motion sensors, direction sensors, facial tracking via stereo cameras, distance sensing, device orientation, device height, required peripherals for controlling hand gestures, the software to combine all these things together and then additionally the hardware, which may require possibly a battery, screen (or two), speakers (or headphones) multiple cameras, and various other technologies.


Its certainly not an amateur project.
55:55:44:44:4C
52:4C:52:42:41

Rose tinted glasses are difficult to see through.

kwadroke
Posts: 35
Joined: Tue Jan 29, 2013 4:20 am

Re: Pi 4 VR Headset

Wed Nov 25, 2020 5:30 am

What about using Android with Google Cardboard on the Pi?
I've been thinking about trying this myself.

alnaseh
Posts: 83
Joined: Thu Jun 23, 2016 5:12 am

Re: Pi 4 VR Headset

Wed Nov 25, 2020 7:08 am

Did you look for arducam, they have one board for stereo
There is also stereoPi

User avatar
7F20
Posts: 89
Joined: Tue Jul 24, 2012 2:45 am
Location: New York

Re: Pi 4 VR Headset

Wed Dec 02, 2020 12:30 am

As already noted, there are many technologies inside of a VR headset that are all of great importance to the experience.

What you might not realize is that VR has been around for a very long time, and it's only been quite recently that devices have been developed which can be worn for extended periods of time. Almost all VR headsets prior to the last 3-5 years would make most people terribly sick after some amount of time.

The issues have to do with, but are not limited to:

1) The manipulation of the persistence of vision through the careful timing of video frames, the calculated insertion of blank frames, and the shape of the lens inside the headset (and the shape of the actual display). Additionally, software is tuned to compress video information in curved areas of the FOV in order to save on pixel overhead and speed things up.
2) The audio has to match the visual. This is subtle, but very important. If the spatial audio solution used doesn't accurately reproduce sound in the environment, it can have a terrible effect.

I don't want to stop you from making something fun, but it's very difficult to actually pull all of those things together, and it had to be done just right.

User avatar
Gavinmc42
Posts: 6438
Joined: Wed Aug 28, 2013 3:31 am

Re: Pi 4 VR Headset

Wed Dec 02, 2020 1:30 am

The latest versions of Warzone2100 have HRTF audio support.
Not noticeable on speakers but headphones or earphones it does give some 3D sound effects.
Worked fine with Bluetooth earphones too.
So Pi's can do HRTF.

I was selling MC68040's for VR gear in the 1990's, not that much has changed.
Resolution is higher but it still makes me sick :D
AR is more interesting to me.

Finally got UPBGE working on a Pi4, 32 and 64bit.
Not sure if it does VR/stereo but it is now something to play with.
Don't have a decent small HDMI screen but Android phones can do RealVNC.
That might be worth trying.
Use the sensors in the phone to feedback head orientation?

Just some tricky software to do.
The hardware is available.
I'm dancing on Rainbows.
Raspberries are not Apples or Oranges

cleverca22
Posts: 5044
Joined: Sat Aug 18, 2012 2:33 pm

Re: Pi 4 VR Headset

Wed Dec 02, 2020 11:29 am

something i forgot about until recently:
https://www.youtube.com/watch?v=b6TABljtaGA
https://www.youtube.com/watch?v=aKgLqIW65oc

this would be an rpi3 running an HTC vive!

id expect an rpi4 to do a much better job, given the higher performance of the arm cores

a CM4 would give better integration into some module you could just clip onto your hip or maybe the back of the headset

User avatar
Gavinmc42
Posts: 6438
Joined: Wed Aug 28, 2013 3:31 am

Re: Pi 4 VR Headset

Wed Dec 02, 2020 12:08 pm

Not sticking 6.7 volts in my Pi's ;)
Should work ok in a Pi4, it is much faster.

Wonder if a Pi4 can wifi it to a Pi zero in a headset?
Sort of like Steam Link does from a PC?
But VNC might be easier place to start.
Will VKcube VNC?
I'm dancing on Rainbows.
Raspberries are not Apples or Oranges

cleverca22
Posts: 5044
Joined: Sat Aug 18, 2012 2:33 pm

Re: Pi 4 VR Headset

Wed Dec 02, 2020 12:24 pm

Gavinmc42 wrote:
Wed Dec 02, 2020 12:08 pm
Not sticking 6.7 volts in my Pi's ;)
Should work ok in a Pi4, it is much faster.

Wonder if a Pi4 can wifi it to a Pi zero in a headset?
Sort of like Steam Link does from a PC?
But VNC might be easier place to start.
Will VKcube VNC?
was just chatting with cnlohr (from those youtube vids) on discord, and it seems one complication, is that the video timings and pixel clock coming out of the hdmi port must be exactly what the headset needs

that might be a problem for a pi0 on the headset?

but given that he got a pi3 to drive a vive, and a pi0 has essentially the identical hdmi hw, its likely possible there too

but any time your doing vr over wifi, you will have a large latency in the video stream
the quest hides that, by treating the video stream as a 3d video, and then rotating your view on the receiving side, to compensate for how much your head moved between rendering and receiving

User avatar
Gavinmc42
Posts: 6438
Joined: Wed Aug 28, 2013 3:31 am

Re: Pi 4 VR Headset

Wed Dec 02, 2020 12:40 pm

but any time your doing vr over wifi, you will have a large latency in the video stream
I forgot about that large latency, puke.

An excuse to get a Drone headset?
Already have some 5GHz transmitters and receivers :D

So many way to skin this cat.
But VNC to Android seems like a place to start, same latency?
Got the hardware already, collected the headsets when they go on special ;)
I'm dancing on Rainbows.
Raspberries are not Apples or Oranges

User avatar
Disaster Incarnate
Posts: 49
Joined: Wed Nov 11, 2020 4:42 am
Location: Planet Earth (Usually)

Re: Pi 4 VR Headset

Sun Dec 06, 2020 9:12 am

Image

User avatar
Gavinmc42
Posts: 6438
Joined: Wed Aug 28, 2013 3:31 am

Re: Pi 4 VR Headset

Mon Dec 07, 2020 1:25 am

Haha, seen the stereo version?
Two monitors with a divider your nose touches.
I'm dancing on Rainbows.
Raspberries are not Apples or Oranges

Return to “Gaming”