U ,:%eg@sddlZddlZddlmZddlmZmZmZddlZddl m Z ddl m Z ddl mZmZdZdZd Zd d d d ddgZGddde ZeeedddZdS)N)Path)OptionalTupleUnion)Dataset)download_url_to_file) _extract_tar_load_waveformz6https://speech.fit.vutbr.cz/files/quesst14Database.tgzi@Z@4f869e06bc066bbe9c5dde31dbd3909a0870d70291110ebbb38878dcbc2fc5e4ZalbanianZbasqueczech nnenglishromanianslovakc@sxeZdZdZdeeefeeeeddddZ e e ee efdd d Z e e e je efdd d Ze d ddZdS)QUESST14a*QUESST14* :cite:`Mir2015QUESST2014EQ` dataset. Args: root (str or Path): Root directory where the dataset's top level directory is found subset (str): Subset of the dataset to use. Options: [``"docs"``, ``"dev"``, ``"eval"``]. language (str or None, optional): Language to get dataset for. Options: [``None``, ``albanian``, ``basque``, ``czech``, ``nnenglish``, ``romanian``, ``slovak``]. If ``None``, dataset consists of all languages. (default: ``"nnenglish"``) download (bool, optional): Whether to download the dataset if it is not found at root path. (default: ``False``) r FN)rootsubsetlanguagedownloadreturncCs|dkrtd|dk r2|tkr2tdttt|}tjt}tj||}| ddd}tj|||_ tj |j stj |s|st dtt|tdt|||d krt|j |d |_n4|d krt|j |d |_n|d krt|j |d|_dS)N)docsdevevalz/`subset` must be one of ['docs', 'dev', 'eval']z"`language` must be None or one of .rz9Dataset not found. Please use `download=True` to download)Z hash_prefixrzlanguage_key_utterances.lstrzlanguage_key_dev.lstrzlanguage_key_eval.lst) ValueError _LANGUAGESstrosfspathpathbasenameURLjoinrsplit_pathisdirisfile RuntimeErrorr _CHECKSUMrfilter_audio_pathsdata)selfrrrrrarchiver,[/var/www/html/Darija-Ai-API/env/lib/python3.8/site-packages/torchaudio/datasets/quesst14.py__init__&s*     zQUESST14.__init__)nrcCs,|j|}tj||j}|t|djfS)aGet metadata for the n-th sample from the dataset. Returns filepath instead of waveform, but otherwise returns the same fields as :py:func:`__getitem__`. Args: n (int): The index of the sample to be loaded Returns: Tuple of the following items; str: Path to audio int: Sample rate str: File name )r)rrrelpathr# SAMPLE_RATE with_suffixname)r*r/ audio_pathr1r,r,r- get_metadataJs zQUESST14.get_metadatacCs2||}t|j|d|d}|f|ddS)a:Load the n-th sample from the dataset. Args: n (int): The index of the sample to be loaded Returns: Tuple of the following items; Tensor: Waveform int: Sample rate str: File name rN)r6r r#)r*r/metadataZwaveformr,r,r- __getitem___s zQUESST14.__getitem__)rcCs t|jS)N)lenr))r*r,r,r-__len__sszQUESST14.__len__)r F)__name__ __module__ __qualname____doc__rrrrboolr.intrr6torchZTensorr9r;r,r,r,r-rs  $r)rrlst_namec Cstg}t|}t|d|N}|D]B}|\}}|dk rH||krHq"tdd|}|||q"W5QRX|S)z+Extract audio paths for the given language.ZscoringNz^.*?\/r0)ropenstripsplitresubappend)rrrCZ audio_pathsfliner5langr,r,r-r(wsr()rrGpathlibrtypingrrrrBZtorch.utils.datarZtorchaudio._internalrZtorchaudio.datasets.utilsrr r r2r'rrrr(r,r,r,r-s,    _