Kinect v2 Manual Setup

From LIV Wiki
Jump to: navigation, search

Introduction

This guide is a general overview for doing "greenscreen-less" LIV Mixed Reality, using the PC-connected XBox Kinect One (aka KinectV2) sensor.

Setup

Read below for the overall setup for getting this working! If you get stuck, message us in Discord.

Video Tutorial

The wonderful Twins in VR have created a sweet YouTube video tutorial for getting set up. It also covers hardware quirks and some other gotchas. Please check it out - Watch on YouTube!

Requirements

  • A working VR setup
  • A KinectV2 (XBox one, black & rectangular) sensor
  • The "USB / PC Interface" for KinectV2 (either official or third party)
    • An alternative is to modify the KinectV2 sensor with a 12 Volt power supply. This should only be performed by qualified electronics technicians, as it requires disassembly, soldering, etc.
  • The software linked below

Downloads

Tool & Link Function Notes
KinectV2GreenScreen Captures from KinectV2, creates a virtual green screen The atrujano10 fork w/new features, see #Software_Versions
OBS (Open Broadcaster Software) Captures / records / streams video Required (for VirtualCam) even if not recording or streaming
OBS Virtualcam Presents KinectV2 Virtual Greenscreen as a video device to LIV Requires OBS to function (to capture the Kinect window)

Software Setup

Installation

Install all of the software linked above. (The KinectV2 Virtual Green Screen will just need to be extracted into a folder).

Setting up OBS & OBS Scenes

  • Launch Open Broadcasting Software/Studio
  • Create a new "Scene Collection" in OBS and call it "LIV Kinect".
  • Create a scene KinectGreenscreen
    • Add a game capture source
    • Target the KinectV2GreenScreen app.
      • (If you are using the older Virtual Green Screen software, you will also need to adjust the settings here to crop the window and flip it horizontally)

Launch OBS Virtualcam

  • Go to Tools, then Virtualcam, then hit start.

Calibrate LIV

When calibrating using this setup, you may wish to switch to the KinectGreenScreen application, and hit "C" for calibrate; this will disable the green screen efffect. (Be sure to hit C again to re-enable the greenscreen).

After doing that, follow the normal instructions to get calibrated!


Running LIV

When running, make sure you're also running KinectV2GreenScreen. Select the GreenscreenFlipped scene, and you should be good to go!

From here, LIV usage is pretty normal. Check back on the main page for more info.


Streaming & Recording

The one last difference is that because you're already running OBS, you'll need to run another instance to stream/record with.

Create a new scene collection so your setup isn't getting in the way, and then follow the normal steps!

Additional Notes

Software Versions

The version of KinectV2GreenScreen linked above is an updated fork of the older version by GiantSox. Previous versions of this guide used the older version. If you are using the older version, you will want to use various "flipped" settings, and may wish to use multiple scenes; see the older guide for help. The newer version removes the need for flipping & cropping, allows for Resize and a Calibration mode, among other things.

Greenscreen Quirks

You may notice that you don't appear in your greenscreen window, especially when switching from Calibrate to regular. Walking around in the Kinect's field of view may help this.

Performance Thoughts

You may wish to ensure that all of your capturing and outputing is done at 30FPS, nmot 60FPS! (The Kinect camera only supports 30fps anyway). Getting a 60fps capture of the game is nice, but your system may not handle it. Make sure this is set in OBS as well as in LIV.

Additionally, you may wish to resize your Kinect greenscreen - hitting the R key in the application will allow you to resize it. On an i7-8700k w/GTX 1080, one 3-sensor Oculus Rift user reports the smoothest experience when capturing at 1280x720, 30fps.

Another user reports that higher resolutions and framerates work great, as long as you turn down SteamVR Supersampling, and game quality (e.g. Beat Saber's graphics / effects quality).