Audio
Two tools for analyzing audio tracks and syncing scene transitions to beat points.
analyze_beats
Analyze an audio track for beats, tempo, and energy curve. Detects rhythmic structure that can be used to drive scene transitions and animation timing.
- Name
audio- Type
- string
- Description
Path to the audio file to analyze.
Returns: Beat timestamps, tempo (BPM), energy curve over time, and detected sections (intro, build, drop, outro).
Try asking your AI:
"Analyze the beats in my background music track"
"What's the tempo and energy curve of this audio?"
sync_sequence_to_beats
Snap scene transitions to beat points. Aligns the sequence manifest timing so that cuts, transitions, and key animation moments land on musical beats.
- Name
manifest- Type
- object
- Description
Sequence manifest to sync.
- Name
beats- Type
- object
- Description
Beat analysis from
analyze_beats.
- Name
snap_mode- Type
- string
- Description
Snap behavior:
nearest(snap to closest beat),downbeat(snap to strong beats only), ormeasure(snap to measure boundaries).
Returns: Updated manifest with beat-aligned timing, a sync quality score, and notes on any scenes that required significant time adjustment.
Try asking your AI:
"Sync my sequence transitions to the downbeats of this track"
"Align scene cuts to the nearest beats in the audio analysis"