Audio statistics

[Samoed]

Ref #3498

I’ve started integrating audio statistics. For now, I’ve come up with this format. Do you have any suggestions?

class AudioStatistics(TypedDict):
    """Class for descriptive statistics for audio.

    Attributes:
        total_audio_seconds_length: Total length of all audio clips in total frames
        min_audio_seconds_length: Minimum length of audio clip in seconds
        average_audio_seconds_length: Average length of audio clip in seconds
        max_audio_seconds_length: Maximum length of audio clip in seconds
        unique_audios: Number of unique audio clips
        average_sampling_rate: Average sampling rate
        sampling_rates: Dict of unique sampling rates and their frequencies
    """

    total_audio_seconds_length: float

    min_audio_seconds_length: float
    average_audio_seconds_length: float
    max_audio_seconds_length: float

    unique_audios: int

    average_sampling_rate: float
    sampling_rates: dict[int, int]

[isaac-chung]

When I see length, I think in seconds. I like the frames approach too, and I'd like it spelled out explicitly (num_frames or whatever). I'd like to see:

• the max/min/total number of seconds
• the unique set of sampling rates (specify unit)

Would love to hear other feedback as well while I read into it a bit more.

[Samoed]

Added seconds and sampling rates

[isaac-chung]

Sorry for adding more. Revisited some papers and maybe we should use the standard measure of audio dataset size.

[isaac-chung]

Just wanted to align with HF notation + plus some questions.

[isaac-chung]

Could this just be a unique set of sampling rates? OK either way.

Suggested change

	sampling_rates: dict[int, int]
	sampling_rates: list[int]

[isaac-chung]

What do you think?

[Samoed]

I think it's better to keep dict to show full distribution of different sample rates. If this became a problem, we can easily change to list of ints

[KennethEnevoldsen]

Minor things - generally think this looks good (of course Isaac's comments still apply, but nothing more to add)

[Samoed]

@isaac-chung Can you review this PR?

[isaac-chung]

Judging from the size, does this incorporate changes from #3875 too?

[Samoed]

Yes, I used these changes here too

[isaac-chung]

Lovely!