Audio

Two tools for analyzing audio tracks and syncing scene transitions to beat points.

analyze_beats

Analyze a WAV audio file to detect beats, tempo (BPM), and energy curve. Returns beat timestamps and energy data that can be passed to plan_sequence for beat-synced editing. Supports 16-bit and 24-bit PCM WAV files.

Name
audio_path
Type
string
Description
Required. Absolute path to a WAV audio file.
Name
options
Type
object
Description
Detection options: windowSize (default 1024), hopSize (default 512), threshold (default 1.3), minBeatInterval (default 0.2s).

Returns: Beat timestamps with strength and type, tempo (BPM), energy curve over time, and total duration.

Try asking your AI:

"Analyze beats in /Users/me/audio/track.wav"

"Detect beats with a higher threshold on this track"

sync_sequence_to_beats

Align a sequence manifest's scene transitions to beat points from analyze_beats. Adjusts scene durations (±15% max by default) so transitions land on beats. Use after plan_sequence + analyze_beats to make audio a first-class motion driver.

Name
manifest
Type
object
Description
Required. Sequence manifest with a scenes array and duration_s per scene.
Name
beats
Type
object
Description
Required. Beat analysis data from analyze_beats.
Name
options
Type
object
Description
Sync options. sync_mode (tight or loose, default tight) sets tolerance; max_adjust_pct (default 0.15) caps duration changes; include_hit_markers / include_audio_cues toggle optional outputs; archetype_slug enables audio-cue planning; hit_sensitivity (0-1, default 0.5) tunes hit marker detection.

Returns: Adjusted manifest with beat-aligned timing, a sync report with score, hit markers, and optional audio cue suggestions.

Try asking your AI:

"Sync my sequence to these beats with tight sync_mode"

"Sync this manifest to beats and include audio cues for the product-launch archetype"

Audio

analyze_beats

sync_sequence_to_beats

Contents