Major rewrite of the TouchDesigner skill: - Replace custom API handler with twozero MCP (36 native tools) - Add audio-reactive GLSL proven recipe (spectrum chain, pitfalls) - Add recording checklist (FPS>0, non-black, audio cueing) - Expand pitfalls: 38 entries from real sessions (was 20) - Update network-patterns with MCP-native build scripts - Rewrite mcp-tools reference for twozero v2.774+ - Update troubleshooting for MCP-based workflow - Remove obsolete custom_api_handler.py - Generalize Environment section for all users - Remove session-specific Paired Skills section - Bump version to 2.0.0
23 KiB
TouchDesigner MCP — Pitfalls & Lessons Learned
Hard-won knowledge from real TD sessions. Read this before building anything.
Parameter Names
1. NEVER hardcode parameter names — always discover
Parameter names change between TD versions. What works in one build may not work in another. ALWAYS use td_get_par_info to discover actual names from TD.
The agent's LLM training data contains WRONG parameter names. Do not trust them.
Known historical differences (may vary further — always verify):
| What docs/training say | Actual in some versions | Notes |
|---|---|---|
dat |
pixeldat |
GLSL TOP pixel shader DAT |
colora |
alpha |
Constant TOP alpha |
sizex / sizey |
size |
Blur TOP (single value) |
fontr/g/b/a |
fontcolorr/g/b/a |
Text TOP font color (r/g/b) |
fontcolora |
fontalpha |
Text TOP font alpha (NOT fontcolora) |
bgcolora |
bgalpha |
Text TOP bg alpha |
value1name |
vec0name |
GLSL TOP uniform name |
2. twozero td_execute_python response format
When calling td_execute_python via twozero MCP, successful responses return (ok) followed by FPS/error summary (e.g. [fps 60.0/60] [0 err/0 warn]), NOT the raw Python result dict. If you're parsing responses programmatically, check for the (ok) prefix — don't pattern-match on Python variable names from the script. Use td_get_operator_info or separate inspection calls to read back values.
3. When using td_set_operator_pars, param names must match exactly
Use td_get_par_info to discover them. The MCP tool validates parameter names and returns clear errors explaining what went wrong, unlike raw Python which crashes the whole script with tdAttributeError and stops execution. Always discover before setting.
3. Use safe_par() pattern for cross-version compatibility
def safe_par(node, name, value):
p = getattr(node.par, name, None)
if p is not None:
p.val = value
return True
return False
4. td.tdAttributeError crashes the whole script — use defensive access
If you do node.par.nonexistent = value, TD raises tdAttributeError and stops the entire script. Prevention is better than catching:
- Use
op()instead ofopex()—op()returns None on failure,opex()raises - Use
hasattr(node.par, 'name')before accessing any parameter - Use
getattr(node.par, 'name', None)with a default - Use the
safe_par()pattern from pitfall #3
# WRONG — crashes if param doesn't exist:
node.par.nonexistent = value
# CORRECT — defensive access:
if hasattr(node.par, 'nonexistent'):
node.par.nonexistent = value
5. outputresolution is a string menu, not an integer
menuNames: ['useinput','eighth','quarter','half','2x','4x','8x','fit','limit','custom','parpanel']
Always use the string form. Setting outputresolution = 9 may silently fail.
node.par.outputresolution = 'custom' # correct
node.par.resolutionw = 1280; node.par.resolutionh = 720
Discover valid values: list(node.par.outputresolution.menuNames)
GLSL Shaders
6. uTDCurrentTime does NOT exist in GLSL TOP
There is NO built-in time uniform for GLSL TOPs. GLSL MAT has uTDGeneral.seconds but that's NOT available in GLSL TOP context.
PRIMARY — GLSL TOP Vectors/Values page:
gl.par.value0name = 'uTime'
gl.par.value0.expr = "absTime.seconds"
# In GLSL: uniform float uTime;
FALLBACK — Constant TOP texture (for complex time data):
CRITICAL: set format to rgba32float — default 8-bit clamps to 0-1:
t = root.create(constantTOP, 'time_driver')
t.par.format = 'rgba32float'
t.par.outputresolution = 'custom'
t.par.resolutionw = 1; t.par.resolutionh = 1
t.par.colorr.expr = "absTime.seconds % 1000.0"
t.outputConnectors[0].connect(glsl.inputConnectors[0])
7. GLSL compile errors are silent in the API
The GLSL TOP shows a yellow warning triangle in the UI but node.errors() may return empty string. Check node.warnings() too, and create an Info DAT pointed at the GLSL TOP to read the actual compiler output.
8. TD GLSL uses vUV.st not gl_FragCoord — and REQUIRES TDOutputSwizzle() on macOS
Standard GLSL patterns don't work. TD provides:
vUV.st— UV coordinates (0-1)uTDOutputInfo.res.zw— resolutionsTD2DInputs[0]— input textureslayout(location = 0) out vec4 fragColor— output
CRITICAL on macOS: Always wrap output with TDOutputSwizzle():
fragColor = TDOutputSwizzle(color);
TD uses GLSL 4.60 (Vulkan backend). GLSL 3.30 and earlier removed.
9. Large GLSL shaders — write to temp file
GLSL code with special characters can corrupt JSON payloads. Write the shader to a temp file and load it in TD:
# Agent side: write shader to /tmp/shader.glsl via write_file
# TD side:
sd = root.create(textDAT, 'shader_code')
with open('/tmp/shader.glsl', 'r') as f:
sd.text = f.read()
Node Management
10. Destroying nodes while iterating root.children causes tdError
The iterator is invalidated when a child is destroyed. Always snapshot first:
kids = list(root.children) # snapshot
for child in kids:
if child.valid: # check — earlier destroys may cascade
child.destroy()
10b. Split cleanup and creation into SEPARATE td_execute_python calls
Creating nodes with the same names you just destroyed in the SAME script causes "Invalid OP object" errors — even with list() snapshot. TD's internal references can go stale within one execution context.
WRONG (single call):
# td_execute_python:
for c in list(root.children):
if c.valid and c.name.startswith('promo_'):
c.destroy()
# ... then create promo_audio, promo_shader etc. in same script → CRASHES
CORRECT (two separate calls):
# Call 1: td_execute_python — clean only
for c in list(root.children):
if c.valid and c.name.startswith('promo_'):
c.destroy()
# Call 2: td_execute_python — build (separate MCP call)
audio = root.create(audiofileinCHOP, 'promo_audio')
# ... rest of build
11. Feedback TOP: use top parameter, NOT direct input wire
The feedbackTOP's top parameter references which TOP to delay. Do NOT also wire that TOP directly into the feedback's input — this creates a real cook dependency loop.
Correct setup:
fb = root.create(feedbackTOP, 'fb_delay')
fb.par.top = comp.path # reference only — no wire to fb input
fb.outputConnectors[0].connect(xf) # fb output -> transform -> fade -> comp
The "Cook dependency loop detected" warning on the transform/fade chain is expected.
12. GLSL TOP auto-creates companion nodes
Creating a glslTOP also creates name_pixel (Text DAT), name_info (Info DAT), and name_compute (Text DAT). These are visible in the network. Don't be alarmed by "extra" nodes.
13. The default project root is /project1
New TD files start with /project1 as the main container. System nodes live at /, /ui, /sys, /local, /perform. Don't create user nodes outside /project1.
14. Non-Commercial license caps resolution at 1280x1280
Setting resolutionw=1920 silently clamps to 1280. Always check effective resolution after creation:
n.cook(force=True)
actual = str(n.width) + 'x' + str(n.height)
Recording & Codecs
15. MovieFileOut TOP: H.264/H.265/AV1 requires Commercial license
In Non-Commercial TD, these codecs produce an error. Recommended alternatives:
prores— Apple ProRes, best on macOS, HW accelerated, NOT license-restricted. ~55MB/s at 1280x720 but lossless quality. Use this as default on macOS.cineform— GoPro Cineform, supports alphahap— GPU-accelerated playback, large filesnotchlc— GPU-accelerated, good qualitymjpa— Motion JPEG, legacy fallback (lossy, use only if ProRes unavailable)
For image sequences: rec.par.type = 'imagesequence', rec.par.imagefiletype = 'png'
16. MovieFileOut .record() method may not exist
Use the toggle parameter instead:
rec.par.record = True # start recording
rec.par.record = False # stop recording
When setting file path and starting recording in the same script, use delayFrames:
rec.par.file = '/tmp/new_output.mov'
run("op('/project1/recorder').par.record = True", delayFrames=2)
17. TOP.save() captures same frame when called rapidly
Use MovieFileOut for real-time recording. Set project.realTime = False for frame-accurate output.
18. AudioFileIn CHOP: cue and recording sequence matters
The recording sequence must be done in exact order, or the recording will be empty, audio will start mid-file, or the file won't be written.
Proven recording sequence:
# Step 1: Stop any existing recording
rec.par.record = False
# Step 2: Reset audio to beginning
audio.par.play = False
audio.par.cue = True
audio.par.cuepoint = 0 # may need cuepointunit=0 too
# Verify: audio.par.cue.eval() should be True
# Step 3: Set output file path
rec.par.file = '/tmp/output.mov'
# Step 4: Release cue + start playing + start recording (with frame delay)
audio.par.cue = False
audio.par.play = True
audio.par.playmode = 2 # Sequential — plays once through
run("op('/project1/recorder').par.record = True", delayFrames=3)
Why each step matters:
rec.par.record = Falsefirst — if a previous recording is active, settingpar.filemay fail silentlyaudio.par.cue = True+cuepoint = 0— guarantees audio starts from the beginning, otherwise the spectrum may be silent for the first few secondsdelayFrames=3on the record start — settingpar.fileandpar.record = Truein the same script can race; the file path needs a frame to register before recording startsplaymode = 2(Sequential) — plays the file once. Useplaymode = 0(Locked to Timeline) if you want TD's timeline to control position
TD Python API Patterns
19. COMP extension setup: ext0object format is CRITICAL
ext0object expects a CONSTANT string (NOT expression mode):
comp.par.ext0object = "op('./myExtensionDat').module.MyClassName(me)"
NEVER set as just the DAT name. NEVER use ParMode.EXPRESSION. ALWAYS ensure the DAT has par.language='python'.
20. td.Panel is NOT subscriptable — use attribute access
comp.panel.select # correct (attribute access, returns float)
comp.panel['select'] # WRONG — 'td.Panel' object is not subscriptable
21. ALWAYS use relative paths in script callbacks
In scriptTOP/CHOP/SOP/DAT callbacks, use paths relative to scriptOp or me:
root = scriptOp.parent().parent()
dat = root.op('pixel_data')
NEVER hardcode absolute paths like op('/project1/myComp/child') — they break when containers are renamed or copied.
22. keyboardinCHOP channel names have 'k' prefix
Channel names are kup, kdown, kleft, kright, ka, kb, etc. — NOT up, down, a, b. Always verify with:
channels = [c.name for c in op('/project1/keyboard1').chans()]
23. expressCHOP cook-only properties — false positive errors
me.inputVal, me.chanIndex, me.sampleIndex work ONLY in cook-context. Calling par.expr0expr.eval() from outside always raises an error — this is NOT a real operator error. Ignore these in error scans.
24. td.Vertex attributes — use index access not named attributes
In TD 2025.32, td.Vertex objects do NOT have .x, .y, .z attributes:
# WRONG — crashes:
vertex.x, vertex.y, vertex.z
# CORRECT — index-based:
vertex.point.P[0], vertex.point.P[1], vertex.point.P[2]
# Or for SOP point positions:
pt = sop.points()[i]
pos = pt.P # use P[0], P[1], P[2]
Audio
25. Audio Spectrum CHOP output is weak — boost it
Raw output is very small (0.001-0.05). Use built-in boost: spectrum.par.highfrequencyboost = 3.0
If still weak, add Math CHOP in Range mode: fromrangehi=0.05, torangehi=1.0
26. AudioSpectrum CHOP: timeslice and sample count are the #1 gotcha
AudioSpectrum at 44100Hz with timeslice=False outputs the ENTIRE audio file as samples (~24000+). CHOP-to-TOP then exceeds texture resolution max and warns/fails.
Fix: Keep timeslice = True (default) for real-time per-frame FFT. Set fftsize to control bin count (it's a STRING enum: '256' not 256).
If the CHOP-to-TOP still gets too many samples, set layout = 'rowscropped' on the choptoTOP.
spectrum.par.fftsize = '256' # STRING, not int — enum values
spectrum.par.timeslice = True # MUST be True for real-time audio reactivity
spectex.par.layout = 'rowscropped' # handles oversized CHOP inputs
resampleCHOP has NO numsamples param. It uses rate, start, end, method. Don't guess — always td_get_par_info('resampleCHOP') first.
27. CHOP To TOP has NO input connectors — use par.chop reference
spec_tex = root.create(choptoTOP, 'spectrum_tex')
spec_tex.par.chop = resample # correct: parameter reference
# NOT: resample.outputConnectors[0].connect(spec_tex.inputConnectors[0]) # WRONG
Workflow
28. Always verify after building — errors are silent
Node errors and broken connections produce no output. Always check:
for c in list(root.children):
e = c.errors()
w = c.warnings()
if e: print(c.name, 'ERR:', e)
if w: print(c.name, 'WARN:', w)
29. Window COMP param for display target is winop
win = root.create(windowCOMP, 'display')
win.par.winop = '/project1/logo_out'
win.par.winw = 1280; win.par.winh = 720
win.par.winopen.pulse()
30. sample() returns frozen pixels in rapid calls
out.sample(x, y) returns pixels from a single cook snapshot. Compare samples with 2+ second delays, or use screencapture on the display window.
31. Audio-reactive GLSL: dual-layer sync pipeline
For audio-synced visuals, use BOTH layers for maximum effect:
Layer 1 (TD-side, real-time): AudioFileIn → AudioSpectrum(timeslice=True, fftsize='256') → Math(gain=5) → choptoTOP(par.chop=math, layout='rowscropped') → GLSL input. The shader samples sTD2DInputs[1] at different x positions for bass/mid/hi. Record the TD output with MovieFileOut.
Layer 2 (Python-side, post-hoc): scipy FFT on the SAME audio file → per-frame features (rms, bass, mid, hi, beat detection) → drive ASCII brightness, chromatic aberration, beat flashes during the render pass.
Both layers locked to the same audio file = visuals genuinely sync to the beat at two independent stages.
Key gotcha: AudioFileIn must be cued (par.cue=True → par.cuepulse.pulse()) then uncued (par.cue=False, par.play=True) before recording starts. Otherwise the spectrum is silent for the first few seconds.
32. twozero MCP: benchmark and prefer native tools
Benchmarked April 2026: twozero MCP with 36 native tools. The old curl/REST method (port 9981) had zero native tools.
Always prefer native MCP tools over td_execute_python:
td_create_operatoroverroot.create()scripts (handles viewport positioning)td_set_operator_parsovernode.par.X = Yscripts (validates param names)td_get_par_infoover temp-node discovery dance (instant, no cleanup)td_get_errorsover manualc.errors()loopstd_get_focusfor context awareness (no equivalent in old method)
Only fall back to td_execute_python for multi-step logic (wiring chains, conditional builds, loops).
33. twozero td_execute_python response wrapping
twozero wraps td_execute_python responses with status info: (ok)\n\n[fps 60.0/60] [0 err/0 warn]. Your Python result variable value may not appear verbatim in the response text. If you need to check results programmatically, use print() statements in the script — they appear in the response. Don't rely on string-matching the result dict.
34. Audio-reactive chain: DO NOT use Lag CHOP or Filter CHOP for spectrum smoothing
The Derivative docs and tutorials suggest using Lag CHOP (lag1=0.2, lag2=0.5) to smooth raw FFT output before passing to a shader. This does NOT work with AudioSpectrum → CHOP to TOP → GLSL.
What happens: Lag CHOP operates in timeslice mode. A 256-sample spectrum input gets expanded to 1600-2400 samples. The Lag averaging drives all values to near-zero (~1e-06). The CHOP to TOP produces a 2400x2 texture instead of 256x2. The shader receives effectively zero audio data.
The correct chain is: Spectrum(outlength=256) → Math(gain=10) → CHOPtoTOP → GLSL. No CHOP smoothing at all. If you need smoothing, do it in the GLSL shader via temporal lerp with a feedback texture.
Verified values with audio playing:
- Without Lag CHOP: bass bins = 5.0-5.4, mid bins = 1.0-1.7 (strong, usable)
- With Lag CHOP: ALL bins = 0.000001-0.00004 (dead, zero audio reactivity)
35. AudioSpectrum Output Length: set manually to avoid CHOP to TOP overflow
AudioSpectrum in Visualization mode with FFT 8192 outputs 22,050 samples by default (1 per Hz, 0–22050). CHOP to TOP cannot handle this — you get "Number of samples exceeded texture resolution max".
Fix: spectrum.par.outputmenu = 'setmanually' and spectrum.par.outlength = 256. This gives 256 frequency bins — plenty for visual FFT.
DO NOT set timeslice = False as a workaround — that processes the entire audio file at once and produces even more samples.
36. GLSL spectrum texture from CHOP to TOP is 256x2 not 256x1
AudioSpectrum outputs 2 channels (stereo: chan1, chan2). CHOP to TOP with dataformat='r' creates a 256x2 texture — one row per channel. Sample the first channel at y=0.25 (center of first row), NOT y=0.5 (boundary between rows):
float bass = texture(sTD2DInputs[1], vec2(0.05, 0.25)).r; // correct
float bass = texture(sTD2DInputs[1], vec2(0.05, 0.5)).r; // WRONG — samples between rows
37. FPS=0 doesn't mean ops aren't cooking — check play state
TD can show fps:0 in td_get_perf while ops still cook and TOP.save() still produces valid screenshots. The two most common causes:
a) Project is paused (playbar stopped). TD's playbar can be toggled with spacebar. The root at / has no .playbar attribute (it's on the perform COMP). The easiest fix is sending a spacebar keypress via td_input_execute, though this tool can sometimes error. As a workaround, TOP.save() always works regardless of play state — use it to verify rendering is actually happening before spending time debugging FPS.
b) Audio device CHOP blocking the main thread. An audiooutCHOP with an active audio device can consume 300-400ms/s (2000%+ of frame budget), stalling the cook loop at FPS=0. Fix: keep the CHOP active but set volume=0 to prevent the audio driver from blocking. Disabling it entirely (active=False) may also work but can prevent downstream audio processing CHOPs from cooking.
Diagnostic sequence when FPS=0:
td_get_perf— check if any op has extreme CPU/sTOP.save()on the output — if it produces a valid image, the pipeline works, just not at real-time rate- Check for blocking CHOPs (audioout, audiodevin, etc.)
- Toggle play state (spacebar, or check if absTime.seconds is advancing)
38. Recording while FPS=0 produces empty or near-empty files
This is the #1 cause of "I recorded for 30 seconds but got a 2-frame video." If TD's cook loop is stalled (FPS=0 or very low), MovieFileOut has nothing to record. Unlike TOP.save() which captures the last cooked frame regardless, MovieFileOut only writes frames that actually cook.
Always verify FPS before starting a recording:
# Check via td_get_perf first
# If FPS < 30, do NOT start recording — fix the performance issue first
# If FPS=0, the playbar is likely paused — see pitfall #37
Common causes of recording empty video:
- Playbar paused (FPS=0) — see pitfall #37
- Audio device CHOP blocking the main thread — see pitfall #37b
- Recording started before audio was cued — audio is silent, GLSL outputs black, MovieFileOut records black frames that look empty
par.fileset in the same script aspar.record = True— see pitfall #18
39. GLSL shader produces black output — test before committing to a long render
New GLSL shaders can fail silently (see pitfall #7). Before recording a long take, always:
- Write a minimal test shader first that just outputs a solid color or pass-through:
void main() {
vec2 uv = vUV.st;
fragColor = TDOutputSwizzle(vec4(uv, 0.0, 1.0));
}
-
Verify the test renders correctly via
td_get_screenshoton the GLSL TOP's output. -
Swap in the real shader and screenshot again immediately. If black, the shader has a compile error or logic issue.
-
Only then start recording. A 90-second ProRes recording is ~5GB. Recording black frames wastes disk and time.
Common causes of black GLSL output:
- Missing
TDOutputSwizzle()on macOS (pitfall #8) - Time uniform not connected — shader uses default 0.0, fractal stays at origin
- Spectrum texture not connected — audio values all 0.0, driving everything to black
- Integer division where float division was expected (
1/2 = 0not0.5) absTime.seconds % 1000.0rolled over past 1000 and the modulo produces unexpected values
40. td_write_dat uses text parameter, NOT content
The MCP tool td_write_dat expects a text parameter for full replacement. Passing content returns an error: "Provide either 'text' for full replace, or 'old_text'+'new_text' for patching".
If td_write_dat fails, fall back to td_execute_python:
op("/project1/shader_code").text = shader_string
41. td_execute_python does NOT return stdout or print() output
Despite what earlier versions of pitfall #33 stated, print() and debug() output from td_execute_python scripts does NOT appear in the MCP response. The response is always just (ok) + FPS/error summary. To read values back, use dedicated inspection tools (td_get_operator_info, td_read_dat, td_read_chop) instead of trying to print from within a script.
42. td_get_operator_info JSON is appended with [fps X.X/X] — breaks json.loads()
The response text from td_get_operator_info has [fps 60.0/60] appended after the JSON object. This causes json.loads() to fail with "Extra data" errors. Strip it before parsing:
clean = response_text.rsplit('[fps', 1)[0]
data = json.loads(clean)
43. td_get_screenshot is asynchronous — returns {"status": "pending"}
Screenshots don't complete instantly. The tool returns {"status": "pending", "requestId": "..."} and the actual file appears later. Wait a few seconds before checking for the file. There is no callback or completion notification — poll the filesystem.
44. Recording duration is manual — no auto-stop at audio end
MovieFileOut records until par.record = False is set. If audio ends before you stop recording, the file keeps growing with repeated frames. Always stop recording promptly after the audio duration. For precision: set a timer on the agent side matching the audio length, then send par.record = False. Trim excess with ffmpeg as a safety net:
ffmpeg -i raw.mov -t 25 -c copy trimmed.mov