TMEGalaxyAudioEffect/relfx-ismir2026

RelFx ISMIR 2026

RelFx encodes the audio-effects transformation between two audio clips. Given a reference clip and a processed clip, it produces a normalized 2048-dimensional embedding that describes how their effects differ, even when the clips contain different musical content.

This model accompanies the ISMIR 2026 paper "Beyond Dry References: Learning Relative Audio Effects Representations via Contrastive Distance Learning." The research source code is available at TMEGalaxyAudioEffect/relfx-ismir2026-release.

This release contains the MoisesDB-only variant reported in the paper's data-scale comparison. It is not the full-data checkpoint.

The checkpoint is publicly downloadable. Use, sharing, and adaptation remain subject to the terms in LICENSE.

Artifact identity

• File: model.safetensors
• Artifact format: relfx-safetensors-v1
• Training data: MoisesDB only
• Training epoch: 179
• Size: 405,071,120 bytes
• SHA-256: 211717c01fd7c56c97cd93e1be226905e9a84f6147597bfa5b3f90fea67af078
• Architecture: RelFx V6, diff_gate, cross-attention stages [3, 5]
• Embedding dimension: 2048

The release artifact contains 99 model tensors and JSON-encoded metadata in the Safetensors header. Optimizer and training-resume state are intentionally excluded.

Download

Install the Hugging Face CLI:

pip install -U huggingface_hub

Download the checkpoint directly; no account or authentication is required:

hf download TMEGalaxyAudioEffect/relfx-ismir2026 \
  model.safetensors \
  --local-dir weights/relfx-ismir2026

Use with the RelFx source release

git clone https://github.com/TMEGalaxyAudioEffect/relfx-ismir2026-release.git
cd relfx-ismir2026-release

python -m venv .venv
source .venv/bin/activate

pip install torch==2.7.1 torchaudio==2.7.1 \
  --index-url https://download.pytorch.org/whl/cu118
pip install -e .

export RELFX_CHECKPOINT_PATH=/absolute/path/to/model.safetensors
python scripts/verify_checkpoint.py "$RELFX_CHECKPOINT_PATH"

bash scripts/run_demo.sh \
  /path/to/reference.wav \
  /path/to/processed.wav \
  outputs/demo/embedding.npy

The two input files do not need to contain the same musical performance. RelFx resamples them to 44.1 kHz, converts them to stereo, and uses the first ten seconds.

Intended use

The model is intended for non-commercial research involving:

• audio-effects representation and retrieval;
• comparison of relative processing styles;
• analysis of effect transformations; and
• differentiable inference-time parameter matching.

Out-of-scope use

• Commercial products or services.
• Claims that the model recovers unique physical processor parameters.
• Source-wise effect disentanglement from a mixed recording.
• Processing audio without the necessary rights or consent.
• Redistribution or adaptation that does not comply with CC BY-NC-SA 4.0.

Training data

This released variant was trained on 2,585 stems from 240 MoisesDB songs (156.4 hours). It does not use the licensed internal collection described in the paper.

Training audio and dataset metadata are not distributed.

Training and evaluation effects

The training chain contains EQ, distortion, multiband compression, gain, stereo imaging, limiting, delay, and reverberation. It has 72 continuous parameters plus activation switches.

The paper's inference-time parameter-matching evaluation uses a separate seven-effect, 47-parameter chain without reverb.

Stored validation metrics

The epoch-179 checkpoint records:

Metric	Value
Validation loss	1.6971
R@1	0.5969
R@5	0.8656
R@10	0.9375
Mean rank	3.2750
Median rank	1.0

These are the validation metrics stored in the training checkpoint. Full parameter-matching results should be reported with the exact evaluation protocol and immutable model revision.

Limitations

• RelFx estimates one global transformation between two clips.
• It does not disentangle independent source-wise effects inside a mixture.
• Evaluation uses a controlled differentiable DSP chain and does not cover every commercial plug-in or real-world preset.
• Relative embeddings are not unique or physically exact processor settings.

License

The checkpoint is released under Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International (CC BY-NC-SA 4.0). Attribution, non-commercial use, and ShareAlike conditions apply; see LICENSE for the complete terms. Public availability does not replace these license obligations.

Citation

@inproceedings{liu2026beyond,
  title     = {Beyond Dry References: Learning Relative Audio Effects
               Representations via Contrastive Distance Learning},
  author    = {Liu, Xinlu and Lin, Huibin and Wei, Weixing and Yan, Zhenhai},
  booktitle = {Proceedings of the 27th International Society for Music
               Information Retrieval Conference (ISMIR)},
  year      = {2026}
}