Follow-up from #23.
Description
The stimulus feature extraction module (pyeeg/features/) currently supports classical acoustic features (envelope, filterbank, gammatone). Issue #23 originally called for deep-learning-based acoustic embeddings via wav2vec2 and HuBERT.
Tasks
Context
- The
AcousticFeatureExtractor (envelope/filterbank/gammatone) is already implemented and tested
- The pipeline architecture (
FeatureSpec, FeaturePipeline, StimulusEncoder) supports adding new extractor types
- Models can be downloaded from ModelScope (https://modelscope.ai) if HuggingFace Hub is unavailable
Priority: Medium
Follow-up from #23.
Description
The stimulus feature extraction module (
pyeeg/features/) currently supports classical acoustic features (envelope, filterbank, gammatone). Issue #23 originally called for deep-learning-based acoustic embeddings via wav2vec2 and HuBERT.Tasks
DeepAcousticFeatureExtractorclass topyeeg/features/acoustic.pyfacebook/wav2vec2-base-960hor similar)facebook/hubert-base-ls960or similar)FeaturePipelineviaextractor_type='acoustic_deep'(or extend existing"acoustic"type)StimulusEncoder.add_deep_acoustic_features()convenience methodContext
AcousticFeatureExtractor(envelope/filterbank/gammatone) is already implemented and testedFeatureSpec,FeaturePipeline,StimulusEncoder) supports adding new extractor typesPriority: Medium