View source for Experimental:WrnchAI CHOP

{{Summary
	|opFamily=CHOP
	|opType=wrnchaiCHOP
	|opLabel=wrnchAI
	|opClass=wrnchaiCHOP_Class
	|opFilter=False
	|opLicense=Pro
	|short=Uses the wrnchAI engine to track human motion in any video stream.
	|long=Using the [[wrnchAI]] engine to track human motion in any video stream, this CHOP will output channels for Body, Face and Hand positions. Multiple people can be tracked at the same time with low-latency, and the system compatible with all cameras and video feeds. TouchDesigner used the wrnchAI Edge SDK and all computation is done locally in realtime utilizing Nvidia GPUs and the NVIDIA CUDA® Deep Neural Network library ([https://developer.nvidia.com/cudnn cuDNN]). This can offer skeletal tracking of multiple people at 60fps or higher (90-120fps etc).
 '''Requires a separate license from wrnchAI''' to run in TouchDesigner. Requires '''Nvidia GPU on Windows OS''' and TouchDesigner Pro. 
 Make sure to install TouchDesigner from the Full Installer, the Lite Installer does not include wrnchAI libraries.

===== Quickstart Guide =====
Once you have a wrnchAI license (purchased or trial), you will have access to your '''wrnchAI licenses''' page and the '''wrnchAI Edge Releases''' page.

# Go to your [https://devportal.wrnch.ai/licenses wrnchAI licenses page]. Click on the 'key' icon and copy the '''Edge License Key''' into the CHOP's 'wrnchAI License' parameter.
# Go to [https://devportal.wrnch.ai/wrnchai_edge/releases wrnchAI Edge Releases page] and download the '''wrnchAI Engine for Win10'''. The file will be something like <code>wrnchAI-Engine-1.17.0-GPU-Win10.zip</code>
# Once downloaded, extract the .zip file and locate the '''wrnchAI trained models folder''' for use in the CHOP's 'Model Folder' parameter. It should be located here: <code>wrnchAI-engine-GPU-1.17.0-Windows-amd64/bin/wrModels</code>
The wrnchAI CHOP will take a few moments to initialize and then will be ready for tracking. Initializing is only required when a new Model Folder is introduced, it will not need to re-initialize each time the project is started.

	}}
{{ParameterPage
	|opFamily=CHOP
	|pageName=Setup
	|pageSummary=
	|items={{Parameter
	|opFamily=CHOP
	|opType=wrnchaiCHOP
	|parLabel=wrnchAI License
	|parName=license
	|parType=Str
	|parReadOnly=
	|parOrder=0
	|parSummary=Add the Edge License Key from your wrnchAI account here. Requires a separate license from [https://wrnch.ai/ wrnchAI].
	|parItems=
	}}
{{Parameter
	|opFamily=CHOP
	|opType=wrnchaiCHOP
	|parLabel=Model Folder
	|parName=modelfolder
	|parType=Folder
	|parReadOnly=
	|parOrder=1
	|parSummary=Specify the path the the folder that contains the trained models. See Quickstart Guide above for details.
	|parItems=
	}}
{{Parameter
	|opFamily=CHOP
	|opType=wrnchaiCHOP
	|parLabel=GPU Device
	|parName=gpu
	|parType=Menu
	|parReadOnly=
	|parOrder=1
	|parSummary=A menu of available GPU(s) to run wrnchAI on. Selecting 'Default' uses the same GPU TouchDesigner is currently running on.
	|parItems={{ParameterItem
	|opFamily=CHOP
	|parName=gpu
	|itemLabel=Default
	|itemName=default
	|itemSummary=Uses the same GPU that TouchDesigner is currently assigned to.
	}}
	}}
{{Parameter
	|opFamily=CHOP
	|opType=wrnchaiCHOP
	|parLabel=TOP
	|parName=top
	|parType=TOP
	|parReadOnly=
	|parOrder=3
	|parSummary=Specify the TOP to process for tracking.
	|parItems=
	}}
{{Parameter
	|opFamily=CHOP
	|opType=wrnchaiCHOP
	|parLabel=Body 3D
	|parName=body3d
	|parType=Toggle
	|parReadOnly=
	|parOrder=4
	|parSummary=Enable the channels (tx, ty, tz) for body tracking points in 3D space.
	|parItems=
	}}
{{Parameter
	|opFamily=CHOP
	|opType=wrnchaiCHOP
	|parLabel=Body 2D
	|parName=body2d
	|parType=Toggle
	|parReadOnly=
	|parOrder=5
	|parSummary=Enable the channels (u, v) for body tracking points in 2D.
	|parItems=
	}}
{{Parameter
	|opFamily=CHOP
	|opType=wrnchaiCHOP
	|parLabel=Body 3D IK
	|parName=body3dik
	|parType=Toggle
	|parReadOnly=
	|parOrder=6
	|parSummary=Enable the IK channels (tx, ty, tz, rx, ry, rz and associated roll channels) for body tracking points in 3D space.
	|parItems=
	}}
{{Parameter
	|opFamily=CHOP
	|opType=wrnchaiCHOP
	|parLabel=Face Bounds
	|parName=facebounds
	|parType=Toggle
	|parReadOnly=
	|parOrder=7
	|parSummary=Enable the position and bounds channels (u, v, width, height) for faces.
	|parItems=
	}}
{{Parameter
	|opFamily=CHOP
	|opType=wrnchaiCHOP
	|parLabel=Face
	|parName=face
	|parType=Toggle
	|parReadOnly=
	|parOrder=8
	|parSummary=Enable the position channels (u, v) for all face tracking points.
	|parItems=
	}}
{{Parameter
	|opFamily=CHOP
	|opType=wrnchaiCHOP
	|parLabel=Hands Bounds
	|parName=handsbounds
	|parType=Toggle
	|parReadOnly=
	|parOrder=9
	|parSummary=Enable the position and bounds channels (u, v, width, height) for hands.
	|parItems=
	}}
{{Parameter
	|opFamily=CHOP
	|opType=wrnchaiCHOP
	|parLabel=Hands
	|parName=hands
	|parType=Toggle
	|parReadOnly=
	|parOrder=10
	|parSummary=Enable the position channels (u, v) for all hand tracking points.
	|parItems=
	}}
{{Parameter
	|opFamily=CHOP
	|opType=wrnchaiCHOP
	|parLabel=Max Players
	|parName=maxplayers
	|parType=Int
	|parReadOnly=
	|parOrder=11
	|parSummary=Sets the maximum number of people that can be tracked. For each person/player a new set of channels is created prefixed p1, p2, p3, ... etc.

'''NOTE''': The parameter slider goes to 10 but higher numbers of players can be tracked by setting a higher Max Player value.
	|parItems=
	}}
{{Parameter
	|opFamily=CHOP
	|opType=wrnchaiCHOP
	|parLabel=Aspect Correct UVs
	|parName=aspectcorrectuv
	|parType=Toggle
	|parReadOnly=
	|parOrder=12
	|parSummary=Adjusts the values of u and v channels to take the TOP's aspect ratio into account. When using non-square input TOP, turn this on to line up u and v position with the image.
	|parItems=
	}}
	}}
{{:CHOP Generator Common Page}}
{{SeeAlso
	|opFamily=
	|items=
	}}
{{History
	}}
{{NavBox
	|Category=CHOPs
	}}
{{#invoke:Category|list|CHOPs}}