Brekel Kinect

Kinect is a name given by Microsoft to a family of depth camera based motion sensors.  While we have the first generation Kinect 360 in the CalArts Computer Animation Lab located in F105, we generally prefer to work with the second generation Kinect (known variously as the Kinect v2 or the Kinect for Xbox One).  While the Kinect can be used with a range of software, the Brekel suite of applications are the most popular due to their versatility.  It should be noted that Brekel also makes well designed software for other devices.

.

Jasper Brekelman has created several applications for the Microsoft Kinect v2 (Kinect for Xbox One).  Brekel Pro Body v2 is a very easy to use 180º field of view full body markerless motion capture application that runs well on Windows 10.

.

Features:

  • Can happily co-exist with the other Brekel applications
  • Works in realtime, no offline processing required
  • No calibration required, just stand in front of the sensor and record
  • Supports FBX formats v6, v7, Ascii and Binary, including additional data like 2D face tracking, hand states, lean, clipping
  • Supports BVH format in Generic / Autodesk HumanIK, 3DMax Biped, Poser / Daz flavors
  • Supports TXT and CSV formats
  • Record pointcloud data in sync for use in Pro PointCloud 2
  • Record audio in sync from Kinect’s microphone or any other audio source
  • Automatically align with floor (or not)
  • Adjust smoothing/filtering and get realtime feedback
  • Uses the enhanced v2 depth fidelity to better solve for rotations, with custom controls
  • Detects 3 finger poses (open/closed/lasso) with control over which poses to driver on the skeleton
  • Visualizes Color, InfraRed, Depth, 3D PointCloud, skeleton and hand states live in the 3D viewport
  • Preview option to review data after recording
  • Ability to export a mathematical T-pose
  • Ability to resample output data from 30fps to custom frame rates
  • Ability to sync recording between multiple Brekel app on the same machine or different machines on the same network
  • Optionally live stream and record directly to Autodesk MotionBuilder using included plugins for 2009-2018 32 and 64 bit versions
  • Optionally live stream directly to the Unity3D game engine using included example C# script/scene
  • Optionally live stream directly to Unreal Engine 4 using included example scene
  • Optionally live stream joint data over OSC (Open Sound Control) to other apps (including Synapse and OSCeleton emulation mode for apps like Kinectar)

 

System requirements:

  • Windows 8 / 8.1 / 10 (USB stack of Windows 7 or below can’t handle bandwidth requirements of v2 sensor and is NOT supported)
  • USB 3.0 port, Intel and Renesas chipsets only! (others brands may or may not work)
  • DirectX 11 capable GPU (Intel HD4000, AMD Radeon HD6470M / HD6570, NVIDIA Geforce 610M or above)
  • 4 GB or more RAM
  • Dual Core 3.1Ghz i7/i5 CPU (slower should work but may drop frames)
  • 1280×1024 screen (recommended: 1920×1080 or higher)

Brekel Pro Face v2 is Brekelman’s 180º field of view markerless facial motion capture application for the Kinect v2.
.

Features:

  • Multi-person face tracking (1-6 people simultaneously)
  • Track head position/rotation
  • Track 20 different face shapes (including left/right asymmetry)
  • Can run simultaneously with Pro Body 2 sharing data from the same sensor
  • Works in realtime, no offline processing required
  • No calibration required, just stand in front of the sensor and record
  • Supports FBX formats v6, v7, Ascii and Binary (other file formats coming)
  • Export as mesh with blendshapes/morphs that can be used to drive your own characters
  • Record pointcloud data in sync for use in Pro PointCloud 2
  • Record audio in sync from Kinect’s microphone or any other audio source
  • Adjust smoothing/filtering
  • Adjustable symmetry constraint
  • Adjustable scale/offset per animation uni
  • Build face mesh resembling actor
  • Visualizes Color, InfraRed, Depth, 3D PointCloud and Face Mesh
  • Ability to resample output data from 30fps to custom frame rates
  • Ability to sync recording between multiple Brekel app on the same machine or different machines on the same network
  • Optionally stream and record directly to Autodesk MotionBuilder using included plugins for 2009-2018 32 and 64 bit versions
  • Optionally stream directly to the Unity3D game engine using included example C# script/scene
  • Optionally stream shape and point data over OSC (Open Sound Control) to other apps

 

System requirements:

  • Windows 8 / 8.1 / 10 (USB stack of Windows 7 or below can’t handle bandwidth requirements of v2 sensor and is NOT supported)
  • USB 3.0 port, Intel and Renesas chipsets only! (others brands may or may not work)
  • DirectX 11 capable GPU (Intel HD4000, AMD Radeon HD6470M / HD6570, NVIDIA Geforce 610M or above)
  • 4 GB or more RAM
  • Dual Core 3.1Ghz i7/i5 CPU or equivalent (slower should work but may drop frames)
  • 1280×1024 screen (recommended: 1920×1080 or higher)

 

Brekel Pro Pointcloud v2 records 3D pointcloud data using a Kinect (or other) sensor, and can export it to popular mesh-cache and particle-cache formats for use most 3D packages.
.

Features:

  • Support for Kinect for Windows v2 and Kinect for XBox One sensors
  • Support for Orbbec Astra and Astra Pro sensors
  • Support for Intel RealSense 300 & 400 series sensors
  • Can happily co-exist with the other Brekel applications
  • Record pointclouds and/or meshes at full 30 fps to a custom file format
  • Record color or infrared video, ready to be UV-mapped as a texture
  • Record audio in sync from Kinect’s microphone or any other audio source
  • Convert as a post process to the desired output format(s)
  • Supported texture formats: JPG, PNG, TGA, TIFF
  • Supported particle cache formats: Realflow BIN, BGEO (Houdini pre-v12), PDB, PDC, Krakatoa PRT, PTC
  • Supported mesh cache formats: Realflow BIN, Alembic, OBJ, PLY
  • Ability to sync recording between multiple Brekel app on the same machine or different machines on the same network
  • Automatically align with floor (or not)
  • Compress data during recording to control file size vs quality
  • Detect human bodies and clip data, for greenscreen-like effects
  • Crop & transform pointclouds during record and/or export
  • Batch processor for easily working with multiple files
  • Comes with Unity integration (script/shaders) for file playback, compatible with Unity 2017/2018/2019, Windows, Android, iOS, macOS, VR headsets (HTC ViveOculus Rift/GoWindowsMR), HoloLensMagic Leap.

 

System requirements:

  • Windows 8 / 8.1 / 10 (USB stack of Windows 7 or below can’t handle bandwidth requirements of v2 sensor and is NOT supported)
  • USB 3.0 port, Intel and Renesas chipsets only! (others brands may or may not work)
  • DirectX 11 capable GPU (Intel HD4000, AMD Radeon HD6470M / HD6570, NVIDIA Geforce 610M or above)
  • 4 GB or more RAM
  • Dual Core 3.1Ghz i7/i5 CPU (slower should work but may drop frames)
  • 1280×1024 screen (recommended: 1920×1080 or higher)