RealSense CHOP

From TouchDesigner Documentation
Jump to: navigation, search


The RealSense CHOP outputs position and rotation data from Intel's RealSense camera. This CHOP is only supported on Windows by the older RealSense camera models F200, R200, and SR300, and requires installation of the Intel RealSense Windows API as described on this page RealSense.

See also RealSense for hardware information and installation instruction, and the RealSense TOP.


Parameters - Setup Page

Active active - When On recieves data from teh RealSense sensor.

Model model - - Select the model of device to use, F200 or SR300.

  • F200 f200 -
  • SR300 sr300 -

Sensor sensor - Select the device to use.

Hands World Position handsworldpos - Output positions of the tracked hand joints in world space. Values given in meters relative to the camera.

Hands Color Position handscolorpos - Output positions of the tracked hand joints in normalized color image space.

Hands Rotation handsrotation - - Output the rotation values for the hand joints.

  • Off off -
  • Absolute absolute -
  • Relative relative -

Face Landmarks World Position facelandmarksworld - Output positions of tracked facial landmarks in world space. Values given in meters relative to the camera.

Face Landmarks Color Position facelandmarkscolor - Output positions of the tracked facial landmarks in normalized image space.

Face World Position faceworldpos - Output the world position of the face.

Face Rotation facerotation - Output the rotation of the face.

Face Bounds facebounds - Output the bounds of the face.

Face Expressions faceexpressions - Output channels for any tracked expressions.

Hand Cursors handcursors - Output channels for tracking the hands. Use the menu below to select the coordinate system for these values.

Cursor Coordinates cursorcoords - - Select what coordinates to use for the Hand Cursors position channels.

  • World world - Report the positions in world space.
  • Image image -
  • Adaptive adaptive -

Parameters - Gestures Page

Description of the gestures can be found in the RealSense SDK documentation.

Separate Hands separatehands - When On, each gesture below will have a separate channel for both right and left hands. When Off, one channel is available for each gesture.

Click click - Open hand facing the camera, moves the index finger quickly toward the palm center.

Fist fist - All fingers folded into a fist. The fist can be in different orientations as long as the palm is in the general direction of the camera.

Full Pinch fullpinch - All fingers extended and touching the thumb. The pinched fingers can be anywhere between pointing directly to the screen or in profile.

Spread Fingers spreadfingers - Hand open, facing the camera.

Swipe swipe - The down/up/left/right swipes as described in the SDK documentation.

Tap tap - A hand in a natural relaxed pose is moved forward as if pressing a button.

Thumb Up/Down thumbs - Thumbs up and thumbs down gestures.

Two Finger Pinch twofingerpinch - Hand open with thumb and index finger touching each other.

V Sign vsign - Hand closed with index finger and middle finger pointing up.

Wave wave - An open hand facing the screen. The wave can include any number of repetitions.

Separate Cursors separatecursors - When On, each cursor gesture below will have a separate channel for both right and left hands. When Off, one channel is available for each cursor gesture. NOTE: Only enabled when Hand Cursors = On.

Cursor Click cursorclick - Enable channel(s) for the cursor click gesture.

Cursor Clockwise cursorcwise - Enable channel(s) for moving the cursor in a clockwise gesture.

Cursor Counter Clockwise cursorccwise - Enable channel(s) for moving the cursor in a counter clockwise gesture.

Cursor Closing cursorclosing - Enable channel(s) for the cursor closing gesture.

Cursor Opening cursoropening - Enable channel(s) for the cursor opening gesture.

Parameters - Smoothing Page

Smoothing smoothing - Enable smoothing the channel data.

Smoothing Type smoothtype - - The type of smoothing to apple.

  • Stabilizer stabilizer - For stabilizing a point in space that represents a stationary object. Ignores small changes under a given threshold and represents close points as the same point. Motion smoothing is also applied when the new point exceeds the stabilization radius.
  • Weighted weighted - Replaces the current point with a weighted average of the last N points, according to the chosen weights.
  • Quadratic quadratic - (Time-based smoothing) Uses a quadratic equation to interpolate between the previous point and the current one. This produces both stabilization and smoothing of the motion, depending how far the new point is from the current one.
  • Spring spring - (Time-based smoothing) Uses a linear equation to interpolate between the previous point and the current one (results in a stabilization effect).

Smoothing Strength smoothstrength - Controls the amount of smoothing to apply.

Stabilize Radius smoothrad - Radius of effect for smoothing.

Number of Weights weights - The number of weighted samples to use for weighted smoothing.

Parameters - Common Page

Time Slice timeslice - Turning this on forces the channels to be "Time Sliced". A Time Slice is the time between the last cook frame and the current cook frame.

Scope scope - To determine which channels get affected, some CHOPs use a Scope string on the Common page.

Sample Rate Match srselect - - Handle cases where multiple input CHOPs' sample rates are different. When Resampling occurs, the curves are interpolated according to the Interpolation Method Option, or "Linear" if the Interpolate Options are not available.

  • Resample At First Input's Rate first - Use rate of first input to resample others.
  • Resample At Maximum Rate max - Resample to the highest sample rate.
  • Resample At Minimum Rate min - Resample to the lowest sample rate.
  • Error If Rates Differ err - Doesn't accept conflicting sample rates.

Export Method exportmethod - - This will determine how to connect the CHOP channel to the parameter. Refer to the Export article for more information.

  • DAT Table by Index datindex - Uses the docked DAT table and references the channel via the index of the channel in the CHOP.
  • DAT Table by Name datname - Uses the docked DAT table and references the channel via the name of the channel in the CHOP.
  • Channel Name is Path:Parameter autoname - The channel is the full destination of where to export to, such has geo1/transform1:tx.

Export Root autoexportroot - This path points to the root node where all of the paths that exporting by Channel Name is Path:Parameter are relative to.

Export Table exporttable - The DAT used to hold the export information when using the DAT Table Export Methods (See above).

TouchDesigner Build:

Ableton Link • Analyze • Angle • Attribute • Audio Band EQ • Audio Device In • Audio Device Out • Audio Dynamics • Audio File In • Audio File Out • Audio Filter • Audio Movie • Audio NDI • Audio Oscillator • Audio Para EQ • Audio Play • Audio Render • Audio Spectrum • Audio Stream In • Experimental:Audio Stream In • Audio Stream Out • Beat • Bind • BlackTrax • Blend • Blob Track • Bullet Solver • Clip Blender • Clip • Clock • Composite • Constant • Copy • Count • CPlusPlus • Cross • Cycle • DAT to • Delay • Delete • DMX In • Experimental:DMX In • DMX Out • Envelope • EtherDream • Event • Expression • Extend • Fan • Feedback • File In • File Out • Filter • Experimental:Filter • Experimental:FreeD • Function • Gesture • Handle • Helios DAC • Hog • Hokuyo • Hold • Import Select • In • Info • Interpolate • Introduction To CHOPs id • Inverse Curve • Inverse Kin • Join • Joystick • Keyboard In • Keyframe • Kinect Azure • Experimental:Kinect Azure • Kinect • Lag • Laser • Leap Motion • Leuze ROD4 • LFO • Limit • Logic • Lookup • LTC In • LTC Out • Math • Experimental:Math • Merge • MIDI In • MIDI In Map • MIDI Out • Mouse In • Mouse Out • NatNet In • Noise • Null • Object • Oculus Audio • Oculus Rift • OpenVR • Experimental:OpenVR • OSC In • OSC Out • Out • Override • Panel • Pangolin • Parameter • Pattern • Perform • Experimental:Phaser • Pipe In • Pipe Out • PosiStageNet • Pulse • RealSense • Experimental:RealSense • Record • Rename • Render Pick • Reorder • Replace • Resample • S Curve • Scan • Script • Select • Sequencer • Serial • Shared Mem In • Shared Mem Out • Shift • Shuffle • Slope • SOP to • Sort • Speed • Splice • Spring • Stretch • Stype • Switch • Sync In • Sync Out • Tablet • Time Slice • Timeline • Timer • TOP to • Experimental:TOP to • Touch In • Touch Out • Trail • Transform • Transform XYZ • Trigger • Trim • Warp • Wave • Experimental:WrnchAI • ZED

An Operator Family which operate on Channels (a series of numbers) which are used for animation, audio, mathematics, simulation, logic, UI construction, and many other applications.

A Time Slice is the time from the last cook frame to the current cook frame. In CHOPs it is the set of short channels that only contain the CHOP channels' samples between the last and the current cook frame.

A parameter in most CHOPs that restricts which channels of that CHOP will be affected. Normally all channels of a CHOP are affected by the operator.

samples-per-second of a CHOP. Each CHOP in your network has a sample rate, whether it is used or not. The overall timeline has a "frame rate", which is the number of animation frames per second, generally your monitor display frequency.

Exporting is the connection of CHOP channels to parameters of operators. The output of each exporting CHOP is one or more channels, active only while the CHOP Viewer is on. The current value of a channel can be exported to a parameter of any operator, overriding that parameter's value. See Parameter.

An Operator Family that manipulates text strings: multi-line text or tables. Multi-line text is often a command Script, but can be any multi-line text. Tables are rows and columns of cells, each containing a text string.

The location of an operator within the TouchDesigner environment, for example, /geo1/torus1, a node called torus1 in a component called geo1. The path / is called Root. To refer instead to a filesystem folder, directory, disk file or http: address, see Folder.

Parameters in TouchDesigner are an operator's settings (numbers, menus, flags, strings, paths) which the user can alter. Parameters for any operator can be opened by right-clicking on the operator and selecting "Parameters..." A currently selected operator's parameters can be viewed in a Network Editor by pressing the keyboard shortcut 'p'.

TouchDesigner is a hierarchy of components. "root" is the top-most network in the hierarchy. The Path is simply /. A typical path is /project1/moviein1.