ESEssentiaStudio
Credits & licence

About Essentia Studio

A pure frontend music annotation and learning workstation built on Essentia.js WebAssembly and TensorFlow.js. Mark up a track on an audio timeline — chords, melody, tempo, sections and notes — with the engine's detections offered as suggestions. Every computation runs in your browser, in a pool of Web Workers — audio is never recorded or uploaded, and the site works offline once installed.

Pipeline

KeyExtractor
Key and scale from HPCP frames
RhythmExtractor2013
Multi-feature and Degara beat tracking
HPCP · TonalExtractor
Chroma, frame-wise chords and chord descriptors
ChordsDetection
Beat-synced major/minor triad estimation
Template matcher
Extended chord vocabulary over the HPCP (7ths, sus, dim/aug)
MFCC · MelBands · Bark
Timbre, cepstral and spectral descriptors
TensorFlow.js models
Mood, danceability and MusicBrainz autotagging (on demand)

Built with

  • Essentia.js
    WebAssembly audio analysis · AGPL-3.0 · MTG / UPF
  • TensorFlow.js
    In-browser neural network inference · Apache-2.0
  • Tonal
    Music theory utilities · MIT
  • chords-db
    Guitar chord shapes · MIT
  • Next.js
    React framework · MIT

Licence

Essentia.js and the Essentia C++ library are licensed under the GNU Affero General Public License v3 (AGPL-3.0) by the Music Technology Group, Universitat Pompeu Fabra. This application is an independent interface built on top of it; please review the upstream licence before reuse.