Check out this repo to create api that returns waveform data of audio

Show & Tell
1

Any plans to maybe add something like this to shotstack so we can time clips in sync with waveform of music?

2

Nice find. We may look into adding support for waveforms in a future ingestion product.

How does it return the waveform? If its a timestamp and a ratio you could write a pretty simple script that either:

  1. Creates an HTML asset with a variable height that appears at the right time.
  2. Create a series of images that can be shown in quick succession using image asset.
  3. Create a waveform video in ffmpeg with transparent background and overlay on video.
3

Beat detection is another one. If we can detect the beat of an audio track then the cuts can be automatically aligned to the beat. I’m sure there are libraries out their for this.