Classical algorithms of sound source localization with beamforming, TDOA and high-resolution spectral estimation.

A description of "RealMAN: A Real-Recorded and Annotated Microphone Array Dataset for Dynamic Speech Enhancement and Localization" [NIPS 2024]

The Official PyTorch Implementation of FN-SSL & IPDnet for Sound Source Localization

Combine sound source separation with SRP-PHAT to achieve multi-source localization.

A python implementation of “SRP-DNN: Learning Direct-Path Phase Difference for Multiple Moving Sound Source Localization” [ICASSP 2022]

A python implementation of “Learning Deep Direct-Path Relative Transfer Function for Binaural Sound Source Localization” [TASLP 2021]

Official codebase for "Unveiling the Power of Audio-Visual Early Fusion Transformers with Dense Interactions through Masked Modeling".

MATLAB Simulation Framework For Basic Sound Source Localization Using the GCC PHAT Algorithm

Test of the ability of a Convolutional Neural Network (CNN) trained to localize the Direction Of Arrival (DOA), to generalize in different environments.

A MATLAB implementation of “Multiple Sound Source Counting and Localization Based on TF-Wise Spatial Spectrum Clustering” [TASLP 2019]

[ICCV2023] Chaotic World: A Large and Challenging Benchmark for Human Behavior Understanding in Chaotic Events

Official Codebase of "A Unified Audio-Visual Learning Framework for Localization, Separation, and Recognition" (ICML 2023)

Localization of a sound source using a microphone array and beamforming technics

This scripts estimate Sound Source Position based on Cross-power Spectrum Phase (CSP) or Multiple Signal Classification (MUSIC).

PyTorch implementation of "Leveraging Category Information for Single-Frame Visual Sound Source Separation"

3D Sound Source Localization using Masked Autoencoders

Code for the paper: Visually Guided Sound Source Separation using Cascaded Opponent Filter Network

Projects webpage

Eliminating Quantization Errors in Classification-Based Sound Source Localization

Program that takes multiple wav files and processes them so that they can be recognized.