Kinect v2 Manual Setup
- 1 Introduction
- 2 Setup
- 2.1 Video Tutorial
- 2.2 Requirements
- 2.3 Downloads
- 2.4 Software Setup
- 2.5 Launch OBS Virtualcam
- 2.6 Calibrate LIV
- 2.7 Running LIV
- 2.8 Streaming & Recording
- 2.9 Additional Notes
This guide is a general overview for doing "greenscreen-less" LIV Mixed Reality, using the PC-connected XBox Kinect One (aka KinectV2) sensor.
Read below for the overall setup for getting this working! If you get stuck, message us in Discord.
The wonderful Twins in VR have created a sweet YouTube video tutorial for getting set up. It also covers hardware quirks and some other gotchas. Please check it out - Watch on YouTube!
- A working VR setup
- A KinectV2 (XBox one, black & rectangular) sensor
- The "USB / PC Interface" for KinectV2 (either official or third party)
- An alternative is to modify the KinectV2 sensor with a 12 Volt power supply. This should only be performed by qualified electronics technicians, as it requires disassembly, soldering, etc.
- The software linked below
|Tool & Link||Function||Notes|
|KinectV2GreenScreen||Captures from KinectV2, creates a virtual green screen||The atrujano10 fork w/new features, see #Software_Versions|
|OBS (Open Broadcaster Software)||Captures / records / streams video||Required (for VirtualCam) even if not recording or streaming|
|OBS Virtualcam||Presents KinectV2 Virtual Greenscreen as a video device to LIV||Requires OBS to function (to capture the Kinect window)|
Install all of the software linked above. (The KinectV2 Virtual Green Screen will just need to be extracted into a folder).
Setting up OBS & OBS Scenes
- Launch Open Broadcasting Software/Studio
- Create a new "Scene Collection" in OBS and call it "LIV Kinect".
- Create a scene KinectGreenscreen
- Add a game capture source
- Target the KinectV2GreenScreen app.
- (If you are using the older Virtual Green Screen software by David Goodman/Sox, you will also need to adjust the settings here to crop the window and flip it horizontally. If you are using the latest fork by Atrujano (linked above), you won't need to flip the window)
Launch OBS Virtualcam
- Go to Tools, then Virtualcam, then hit start.
When calibrating using this setup, you may wish to switch to the KinectGreenScreen application, and hit "C" for calibrate; this will disable the green screen efffect. (Be sure to hit C again to re-enable the greenscreen).
After doing that, follow the normal instructions to get calibrated!
When running, make sure you're also running KinectV2GreenScreen. Select the GreenscreenFlipped scene, and you should be good to go!
From here, LIV usage is pretty normal. Check back on the main page for more info.
Streaming & Recording
The one last difference is that because you're already running OBS, you'll need to run another instance to stream/record with.
Create a new scene collection so your setup isn't getting in the way, and then follow the normal steps!
The version of KinectV2GreenScreen linked above is an updated fork of the older version by GiantSox. Previous versions of this guide used the older version. If you are using the older version, you will want to use various "flipped" settings, and may wish to use multiple scenes; see the older guide for help. The newer version removes the need for flipping & cropping, allows for Resize and a Calibration mode, among other things.
You may notice that you don't appear in your greenscreen window, especially when switching from Calibrate to regular. Walking around in the Kinect's field of view may help this.
You may wish to ensure that all of your capturing and outputing is done at 30FPS, nmot 60FPS! (The Kinect camera only supports 30fps anyway). Getting a 60fps capture of the game is nice, but your system may not handle it. Make sure this is set in OBS as well as in LIV.
Additionally, you may wish to resize your Kinect greenscreen - hitting the R key in the application will allow you to resize it. On an i7-8700k w/GTX 1080, one 3-sensor Oculus Rift user reports the smoothest experience when capturing at 1280x720, 30fps.
Another user reports that higher resolutions and framerates work great, as long as you turn down SteamVR Supersampling, and game quality (e.g. Beat Saber's graphics / effects quality).