WAV - Bytes per video frame

Question

I hope this question will be interpreted more as the nature of maths than the coding examples provided within:

Using the ffmpeg-fluent library for Node.js I'm able to extract PCM (WAV) audio. I've enabled the .native() capability to the chain of commands for ffmpeg which, for both video and audio, transcodes the input data at the same rate as the FPS of the video feed, 20.

I want to find out the amount of bytes that is contained within a "frame" of audio, correlating it to a frame of video data.

My script delivers me a chunk size of 4096 bytes.

Trying to calculate this ahead of time has been problematic for me since I thought the formula was:

48.000 / 20 * samplesize

By the logic that samples per second / frames per second * size of a sample would give me the size in bytes at each frame however the math does not add up.

Attached below you'll find the WAV header of the audio stream extracted using a hex dump:

  Offset  00 01 02 03 04 05 06 07 08 09 0A 0B 0C 0D 0E 0F
00000000  52 49 46 46 FF FF FF FF 57 41 56 45 66 6D 74 20  RIFFÿÿÿÿWAVEfmt 
00000010  10 00 00 00 01 00 02 00 80 BB 00 00 00 EE 02 00  ........»...î..
00000020  04 00 10 00 4C 49 53 54 1A 00 00 00 49 4E 46 4F  ....LIST....INFO
00000030  49 53 46 54 0E 00 00 00 4C 61 76 66 35 38 2E 32  ISFT....Lavf58.2
00000040  39 2E 31 30 30 00 64 61 74 61 FF FF FF FF        9.100.dataÿÿÿÿ  

When parsing this with node.js I confirm that my block align is 4 bytes and sample rate is 48000, using offsets from the WAV header documentation found at: http://soundfile.sapp.org/doc/WaveFormat/

console.log(chunk.slice(24, 28).readUInt32LE()); // Sample rate.
console.log(chunk.slice(32, 34).readUInt16LE()); // Block Align.
console.log(chunk.slice(34, 36).readUInt16LE()); // Bits per sample.

48000
4
16

Note: In case I screwed something up with the commands in ffmpeg-fluent by combining native processing with a new FPS, the original FPS of the input signal is 25fps.

Answer 1

Firstly, the RIFF file example you are showing is corrupt, which is probably why your math isn't working out. A correct RIFF file has the following chunk format:

4-bytes: {TAG {RIFF}}
4-bytes: {PAYLOAD-Length} (Little-endian representation} - size of entire file minus 8 bytes
4-bytes: {TAG {WAVE}}
n-bytes: PAYLOAD {Entire file}

The "PAYLOAD" portion of the above contains a number of chunks of the following format:

{
   4-bytes: {TAG}
   4-bytes: {PAYLOAD-LENGTH} (Little-endian representation}
   n-bytes: PAYLOAD for {TAG}
}

The "FMT " chunk will tell you about the format of the data held in the payload of the "DATA" chunk.

The "FMT " and "DATA" chunks are mandatory, although a valid RIFF file can contain other chunks.

You will need to parse the "FMT " to work out the size of each sample and also to work out how many samples are required to fill a frame of video.

The "FMT " chunk contains the following information:

4-bytes   Subchunk1ID      Contains the letters "fmt " (0x666d7420 big-endian form).
4-bytes   Subchunk1Size    16 for PCM.  This is the size of the rest of the Subchunk which follows this number.
2-bytes   AudioFormat      PCM = 1 (i.e. Linear quantization) Values other than 1 indicate some form of compression.
2-bytes   NumChannels      Mono = 1, Stereo = 2, etc.
4-bytes   SampleRate       8000, 44100, etc.
4-bytes   ByteRate         == SampleRate * NumChannels * BitsPerSample/8
2-bytes   BlockAlign       == NumChannels * BitsPerSample/8 The number of bytes for one sample including all channels. I wonder what happens when this number isn't an integer?
2-bytes   BitsPerSample    8 bits = 8, 16 bits = 16, etc.

Parsing out the "FMT " chunk should reveal the ByteRate and BlockAlign values (little-endian) which should give you what you need in one easy hit.

{ByteRate}/{Frames Per Second} 

should give you the number of bytes per frame.

This should be equal to

{BlockAlign}*{SampleRate}/{Frames Per Second} .

Just be aware that all these values are little-endian representation.

In your example, the {ByteRate} value is 00 EE 02 00 which is 0x0002EE00, which is 192000 Decimal. 192000/25 gives you a BytesPerFrame rate of 7680.