Skip to content

Rm legacy essentia analysis #2099

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Draft
ffont wants to merge 3 commits into
base: master
Choose a base branch
from
Draft

Rm legacy essentia analysis #2099

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
3 commits
Select commit Hold shift + click to select a range
cec2beb
Use new essentia anlyzer for consolidated descriptors
ffont May 4, 2026
71f06ea
Merge branch 'master' into rm-legacy-essentia-analysis
ffont May 4, 2026
463f9b0
Remove analysis_files API field
ffont May 4, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 0 additions & 2 deletions _docs/api/generate_analysis_documentation/descriptors.csv
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -7,8 +7,6 @@ boominess,ac_boominess,-,numeric,,,,0-100,"Boominess of the audio signal. A boom
bpm,ac_tempo,-,integer,,rhythm.bpm,,,BPM value estimated by beat tracking algorithm.,https://en.wikipedia.org/wiki/Tempo
bpm_confidence,ac_tempo_confidence,-,numeric,,,,0-1,Confidence score on how reliable the tempo (BPM) estimation is.,
brightness,ac_brightness,-,numeric,,,,0-100,Brightness of the audio signal. A bright sound is one that is clear/vibrant and/or contains significant high-pitched elements.,
chord_count,tonal.chords_count,-,integer,advanced,,set to 0 if not meaningful,,Number of chords in the audio signal based on the number of detected chords by the chord_progression descriptor.,http://essentia.upf.edu/documentation/reference/streaming_ChordsDescriptors.html
chord_progression,tonal.chords_progression,VL,array[string],advanced,tonal.chords_strength,set to 0 if not meaningful,,"Chords estimated from the harmonic pitch class profiles (HPCPs) across the audio signal. Using the pitch classes [""A"", ""A#"", ""B"", ""C"", ""C#"", ""D"", ""D#"", ""E"", ""F"", ""F#"", ""G"", ""G#""], it finds the best-matching major or minor triad and outputs a time-varying chord sequence as a sequence of labels (e.g. A#, Bm). Note, chords are major if no minor symbol.",http://essentia.upf.edu/documentation/reference/streaming_ChordsDetection.html
decay_strength,sfx.strongdecay,-,numeric,advanced,,,,Rate at which the audio signal's energy decays (i.e. how quickly it decreases) after the initial attack. It is computed from a non-linear combination of the signal's energy and its temporal centroid (the balance point of the signal's absolute amplitude).,https://essentia.upf.edu/reference/streaming_StrongDecay.html
depth,ac_depth,-,numeric,,,,0-100,Depth of the audio signal. A deep sound is one that conveys the sense of having been made far down below the surface of its source.,
dissonance,lowlevel.dissonance,mean,numeric,,,,,Sensory dissonance of the audio signal given its spectral peaks.,http://essentia.upf.edu/documentation/reference/streaming_Dissonance.html
Expand Down
35 changes: 0 additions & 35 deletions _docs/api/source/analysis_docs.rst
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -651,41 +651,6 @@ beat_loudness
:height: 300px


chord_count
-------------------------

::

curl https://freesound.org/api/sounds/<sound_id>/analysis/chord_count

**Description:** Number of chords in the audio signal based on the number of detected chords by the chord_progression descriptor.

**Type:** integer

**More information:** http://essentia.upf.edu/documentation/reference/streaming_ChordsDescriptors.html

**Distribution in Freesound**

.. image:: _static/descriptors/chord_count.png
:height: 300px


chord_progression
-------------------------

::

curl https://freesound.org/api/sounds/<sound_id>/analysis/chord_progression

**Description:** Chords estimated from the harmonic pitch class profiles (HPCPs) across the audio signal. Using the pitch classes ["A", "A#", "B", "C", "C#", "D", "D#", "E", "F", "F#", "G", "G#"], it finds the best-matching major or minor triad and outputs a time-varying chord sequence as a sequence of labels (e.g. A#, Bm). Note, chords are major if no minor symbol.

**Mode:** VL

**Type:** array[string]

**More information:** http://essentia.upf.edu/documentation/reference/streaming_ChordsDetection.html


decay_strength
-------------------------

Expand Down
5 changes: 0 additions & 5 deletions _docs/api/source/resources.rst
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -325,7 +325,6 @@ comments URI yes* The URI of a paginated l
num_comments integer yes The number of times the sound was commented.
comment URI no The URI to comment the sound.
similar_sounds URI no URI pointing to the :ref:`similar-sounds` resource (to get a list of similar sounds).
analysis_files URIs no List of URIs for retrieving files with analysis information for each frame of the sound (see :ref:`analysis-docs`).
========================= ================ ========= ====================================================================================

Additionally, content-based audio descriptors extracted from the sound signal can be used as fields.
Expand All @@ -347,8 +346,6 @@ boominess_ numeric yes Boominess of the audio sig
bpm_ integer yes BPM value estimated by beat tracking algorithm.
bpm_confidence_ numeric yes Confidence score on how reliable the tempo (BPM) estimation is.
brightness_ numeric yes Brightness of the audio signal. A bright sound is one that is clear/vibrant and/or contains significant high-pitched elements.
chord_count_ integer yes Number of chords in the audio signal based on the number of detected chords by the chord_progression descriptor.
chord_progression_ array[string] no Chords estimated from the harmonic pitch class profiles (HPCPs) across the audio signal. Using the pitch classes ["A", "A#", "B", "C", "C#", "D", "D#", "E", "F", "F#", "G", "G#"], it finds the best-matching major or minor triad and outputs a time-varying chord sequence as a sequence of labels (e.g. A#, Bm). Note, chords are major if no minor symbol.
decay_strength_ numeric yes Rate at which the audio signal's energy decays (i.e. how quickly it decreases) after the initial attack. It is computed from a non-linear combination of the signal's energy and its temporal centroid (the balance point of the signal's absolute amplitude).
depth_ numeric yes Depth of the audio signal. A deep sound is one that conveys the sense of having been made far down below the surface of its source.
dissonance_ numeric yes Sensory dissonance of the audio signal given its spectral peaks.
Expand Down Expand Up @@ -408,8 +405,6 @@ zero_crossing_rate_ numeric yes Zero-crossing rate of the
.. _bpm: https://freesound.org/docs/api/analysis_docs.html#bpm
.. _bpm_confidence: https://freesound.org/docs/api/analysis_docs.html#bpm-confidence
.. _brightness: https://freesound.org/docs/api/analysis_docs.html#brightness
.. _chord_count: https://freesound.org/docs/api/analysis_docs.html#chord-count
.. _chord_progression: https://freesound.org/docs/api/analysis_docs.html#chord-progression
.. _decay_strength: https://freesound.org/docs/api/analysis_docs.html#decay-strength
.. _depth: https://freesound.org/docs/api/analysis_docs.html#depth
.. _dissonance: https://freesound.org/docs/api/analysis_docs.html#dissonance
Expand Down
15 changes: 1 addition & 14 deletions apiv2/serializers.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -42,7 +42,7 @@
+ "geotag,is_geotagged,created,license,type,channels,filesize,bitrate,"
+ "bitdepth,duration,samplerate,username,pack,pack_name,download,bookmark,previews,images,"
+ "num_downloads,avg_rating,num_ratings,rate,comments,num_comments,comment,similar_sounds,"
+ "analysis_files,is_explicit,is_remix,was_remixed,md5,ai_preference"
+ "is_explicit,is_remix,was_remixed,md5,ai_preference"
)
DEFAULT_FIELDS_IN_PACK_DETAIL = None # Separated by commas (None = all)

Expand Down Expand Up @@ -168,7 +168,6 @@ class Meta:
"num_comments",
"comment",
"similar_sounds",
"analysis_files",
"is_explicit",
"score",
"is_remix",
Expand Down Expand Up @@ -317,18 +316,6 @@ def get_images(self, obj):
),
}

analysis_files = serializers.SerializerMethodField()

def get_analysis_files(self, obj):
return {
"essentia_frames": prepend_base(
obj.locations("analysis.frames.url"), request_is_secure=self.context["request"].is_secure()
),
"essentia_stats": prepend_base(
obj.locations("analysis.statistics.url"), request_is_secure=self.context["request"].is_secure()
),
}

similar_sounds = serializers.SerializerMethodField()

def get_similar_sounds(self, obj):
Expand Down
Loading
Loading