U ,:%eх@sddlmZddlmZddlmZmZmZmZm Z m Z m Z ddl Z ddl Z ddlmZe jjdk rxe jjjZe jjjZdgZeGdddZeGd d d eZeGd d d eZd dZeGdddZeGdddeZeGdddeZddZddddddZdddddddZ Gd d!d!e j!Z"eGd"d#d#e"Z#d$d%Z$d&Z%d'Z&d(Z'd)Z(d*Z)d+Z*d,Z+e$e%e&e'e)e*d-Z,e$e%e&e(e)e*e+d.Z-e d/ed0Z.e ded0Z/e jj0Gd1ddZdS)2) annotations) dataclass)BinaryIODictIteratorOptionalTupleTypeVarUnionNtree_map StreamReaderc@sReZdZUdZded<ded<ded<ded<ded <ded <ded <d ed <dS) SourceStreamaThe metadata of a source stream, returned by :meth:`~torchaudio.io.StreamReader.get_src_stream_info`. This class is used when representing streams of media type other than `audio` or `video`. When source stream is `audio` or `video` type, :class:`SourceAudioStream` and :class:`SourceVideoStream`, which reports additional media-specific attributes, are used respectively. str media_typecodeccodec_long_name Optional[str]format Optional[int]bit_rate num_framesbits_per_sampleDict[str, str]metadataN__name__ __module__ __qualname____doc____annotations__r!r![/var/www/html/Darija-Ai-API/env/lib/python3.8/site-packages/torchaudio/io/_stream_reader.pyrs   rc@s"eZdZUdZded<ded<dS)SourceAudioStreamaThe metadata of an audio source stream, returned by :meth:`~torchaudio.io.StreamReader.get_src_stream_info`. This class is used when representing audio stream. In addition to the attributes reported by :class:`SourceStream`, the following attributes are reported. float sample_rateint num_channelsNrr!r!r!r"r#Ms r#c@s*eZdZUdZded<ded<ded<dS)SourceVideoStreamaThe metadata of a video source stream, returned by :meth:`~torchaudio.io.StreamReader.get_src_stream_info`. This class is used when representing video stream. In addition to the attributes reported by :class:`SourceStream`, the following attributes are reported. r&widthheightr$ frame_rateNrr!r!r!r"r(]s r(c Cs|j}|dkr>t|j|j|j|j|j|j|j|j|j |j d S|dkrzt |j|j|j|j|j|j|j|j|j |j |jd St|j|j|jdddd|jdS)Naudio) rrrrrrrrr%r'video) rrrrrrrrr)r*r+)rrrrrrrr)rr#Z codec_namerrrrrrr%r'r(r)r*r+rirr!r!r" _parse_siosL  r0c@s2eZdZUdZded<ded<ded<ded<dS) OutputStreamzOutput stream configured on :class:`StreamReader`, returned by :meth:`~torchaudio.io.StreamReader.get_out_stream_info`. r& source_indexrfilter_descriptionrrNrr!r!r!r"r1s r1c@s"eZdZUdZded<ded<dS)OutputAudioStreama*Information about an audio output stream configured with :meth:`~torchaudio.io.StreamReader.add_audio_stream` or :meth:`~torchaudio.io.StreamReader.add_basic_audio_stream`. In addition to the attributes reported by :class:`OutputStream`, the following attributes are reported. r$r%r&r'Nrr!r!r!r"r4s r4c@s*eZdZUdZded<ded<ded<dS)OutputVideoStreama)Information about a video output stream configured with :meth:`~torchaudio.io.StreamReader.add_video_stream` or :meth:`~torchaudio.io.StreamReader.add_basic_video_stream`. In addition to the attributes reported by :class:`OutputStream`, the following attributes are reported. r&r)r*r$r+Nrr!r!r!r"r5s r5c Csv|j}|dkr.t|j|j|j|j|j|jdS|dkrZt|j|j|j|j|j|j |j dSt d|jd|ddS)Nr,)r2r3rrr%r'r-)r2r3rrr)r*r+zUnexpected media_type: ()) rr4r2r3rr%r'r5r)r*r+ ValueErrorr.r!r!r" _parse_ois* r9rr)r%fmtr'cCsg}|dk r|d||dk s,|dk rxg}|dk rH|d||dk rb|d|d|dd||rd|SdS)Nz aresample=z sample_fmts=zchannel_layouts=czaformat=:,appendjoin)r%r:r'descspartsr!r!r"_get_afilter_descsrCOptional[float])r+r)r*r:cCsg}|dk r|d|g}|dk r8|d||dk rP|d||rj|dd||dk r|d||rd|SdS)Nzfps=zwidth=zheight=zscale=r<zformat=pix_fmts=r=r>)r+r)r*r:rAscalesr!r!r"_get_vfilter_descsrFcs6eZdZejjZefddZe dddZ Z S)ChunkTensorBasecst||SN)super__new__)cls_elem_ __class__r!r"rJszChunkTensorBase.__new__r!Ncs"fdd}|t||t||S)Ncst|r|jS|SrH) isinstancerL)trKr!r"unwrapsz2ChunkTensorBase.__torch_dispatch__..unwrapr )rKfuncrMargskwargsrSr!rRr"__torch_dispatch__s z"ChunkTensorBase.__torch_dispatch__)r!N) rrrtorchZ_CZ_disabled_torch_function_implZ__torch_function__ staticmethodrJ classmethodrW __classcell__r!r!rNr"rGs rGc@s"eZdZUdZded<ded<dS) ChunkTensoraDecoded media frames with metadata. The instance of this class represents the decoded video/audio frames with metadata, and the instance itself behave like :py:class:`~torch.Tensor`. Client codes can pass instance of this class as-if it's :py:class:`~torch.Tensor` class, or call the methods defined on :py:class:`~torch.Tensor` class. Example: >>> # Define input streams >>> reader = StreamReader(...) >>> reader.add_audio_stream(frames_per_chunk=4000, sample_rate=8000) >>> reader.add_video_stream(frames_per_chunk=7, frame_rate=28) >>> # Decode the streams and fetch frames >>> reader.fill_buffer() >>> audio_chunk, video_chunk = reader.pop_chunks() >>> # Access metadata >>> (audio_chunk.pts, video_chunks.pts) (0.0, 0.0) >>> >>> # The second time the PTS is different >>> reader.fill_buffer() >>> audio_chunk, video_chunk = reader.pop_chunks() >>> (audio_chunk.pts, video_chunks.pts) (0.5, 0.25) >>> # Call PyTorch ops on chunk >>> audio_chunk.shape torch.Size([4000, 2] >>> power = torch.pow(video_chunk, 2) >>> >>> # the result is a plain torch.Tensor class >>> type(power) >>> >>> # Metadata is not available on the result >>> power.pts AttributeError: 'Tensor' object has no attribute 'pts' z torch.TensorrLr$ptsNrr!r!r!r"r\s +r\c sfdd}|S)Ncs|jjf|_|SrH)rr)objrVr!r" decoratorUsz_format_doc..decoratorr!)rVr`r!r_r" _format_docTs raaKNumber of frames returned as one chunk. If the source stream is exhausted before enough frames are buffered, then the chunk is returned as-is. Providing ``-1`` disables chunking and :py:func:`pop_chunks` method will concatenate all the buffered frames and return it.adInternal buffer size. When the number of chunks buffered exceeds this number, old frames are dropped. For example, if ``frames_per_chunk`` is 5 and ``buffer_chunk_size`` is 3, then frames older than ``15`` are dropped. Providing ``-1`` disables this behavior. Default: ``3``.zcThe source audio stream index. If omitted, :py:attr:`default_audio_stream` is used.zcThe source video stream index. If omitted, :py:attr:`default_video_stream` is used.aThe name of the decoder to be used. When provided, use the specified decoder instead of the default one. To list the available decoders, please use :py:func:`~torchaudio.utils.ffmpeg_utils.get_audio_decoders` for audio, and :py:func:`~torchaudio.utils.ffmpeg_utils.get_video_decoders` for video. Default: ``None``.aOptions passed to decoder. Mapping from str to str. (Default: ``None``) To list decoder options for a decoder, you can use ``ffmpeg -h decoder=`` command. | In addition to decoder-specific options, you can also pass options related to multithreading. They are effective only if the decoder support them. If neither of them are provided, StreamReader defaults to single thread. ``"threads"``: The number of threads (in str). Providing the value ``"0"`` will let FFmpeg decides based on its heuristics. ``"thread_type"``: Which multithreading method to use. The valid values are ``"frame"`` or ``"slice"``. Note that each decoder supports different set of methods. If not provided, a default value is used. - ``"frame"``: Decode more than one frame at once. Each thread handles one frame. This will increase decoding delay by one frame per thread - ``"slice"``: Decode more than one part of a single frame at once. | aEnable hardware acceleration. When video is decoded on CUDA hardware, for example `decoder="h264_cuvid"`, passing CUDA device indicator to `hw_accel` (i.e. `hw_accel="cuda:0"`) will make StreamReader place the resulting frames directly on the specified CUDA device as CUDA tensor. If `None`, the frame will be moved to CPU memory. Default: ``None``.)frames_per_chunkbuffer_chunk_size stream_indexdecoderdecoder_option)rbrcrdrerfhw_accelZ InputStream)boundc@seZdZdZdMdddddd d Zed d Zed dZeddZeddZ ddddZ dddddZ dddddZ dNdd d!d"d#Z edOdddd%ddd&ddd'dddd'd'd(d)d*ZedPdddd+ddddd,ddd'dddd'd'd'dd- d.d/ZedQddddd0ddd'dddd1d2d3ZedRdddddd4ddd'ddddd5d6d7Zdd8d9d:ZdSdd?Zd@dAZdBddCdDZdEddFdGZdTd bytes`. Additionally, if the file-like object has `seek` method, it uses the method when parsing media metadata. This improves the reliability of codec detection. The signagure of `seek` method must be `seek(offset: int, whence: int) -> int`. Please refer to the following for the expected signature and behavior of `read` and `seek` method. - https://docs.python.org/3/library/io.html#io.BufferedIOBase.read - https://docs.python.org/3/library/io.html#io.IOBase.seek format (str or None, optional): Override the input format, or specify the source sound device. Default: ``None`` (no override nor device input). This argument serves two different usecases. 1) Override the source format. This is useful when the input data do not contain a header. 2) Specify the input source device. This allows to load media stream from hardware devices, such as microphone, camera and screen, or a virtual device. .. note:: This option roughly corresponds to ``-f`` option of ``ffmpeg`` command. Please refer to the ffmpeg documentations for the possible values. https://ffmpeg.org/ffmpeg-formats.html#Demuxers Please use :py:func:`~torchaudio.utils.ffmpeg_utils.get_demuxers` to list the demultiplexers available in the current environment. For device access, the available values vary based on hardware (AV device) and software configuration (ffmpeg build). https://ffmpeg.org/ffmpeg-devices.html#Input-Devices Please use :py:func:`~torchaudio.utils.ffmpeg_utils.get_input_devices` to list the input devices available in the current environment. option (dict of str to str, optional): Custom option passed when initializing format context (opening source). You can use this argument to change the input source before it is passed to decoder. Default: ``None``. buffer_size (int): The internal buffer size in byte. Used only when `src` is file-like object. Default: `4096`. NzUnion[str, BinaryIO]rzOptional[Dict[str, str]]r&)srcroption buffer_sizecCszt|trt||||_n$t|dr6t|||||_ntd|j}|dkrTdn||_|j }|dkrpdn||_ dS)Nreadz2`src` must be either a string or file-like object.r) rPr _StreamReader_behasattr_StreamReaderFileObjr8Zfind_best_audio_stream_default_audio_streamZfind_best_video_stream_default_video_stream)selfrjrrkrlr/r!r!r"__init__s    zStreamReader.__init__cCs |jS)zRNumber of streams found in the provided media source. :type: int )ronum_src_streamsrtr!r!r"rvszStreamReader.num_src_streamscCs |jS)zPNumber of output streams configured by client code. :type: int )ronum_out_streamsrwr!r!r"rxszStreamReader.num_out_streamscCs|jS)znThe index of default audio stream. ``None`` if there is no audio stream :type: Optional[int] )rrrwr!r!r"default_audio_stream$sz!StreamReader.default_audio_streamcCs|jS)znThe index of default video stream. ``None`` if there is no video stream :type: Optional[int] )rsrwr!r!r"default_video_stream,sz!StreamReader.default_video_streamr)returncCs |jS)zQGet the metadata of the source media. Returns: dict )ro get_metadatarwr!r!r"r|4szStreamReader.get_metadataInputStreamTypes)r/r{cCst|j|S)a0Get the metadata of source stream Args: i (int): Stream index. Returns: InputStreamTypes: Information about the source stream. If the source stream is audio type, then :class:`~torchaudio.io._stream_reader.SourceAudioStream` is returned. If it is video type, then :class:`~torchaudio.io._stream_reader.SourceVideoStream` is returned. Otherwise :class:`~torchaudio.io._stream_reader.SourceStream` class is returned. )r0roget_src_stream_infortr/r!r!r"r~<sz StreamReader.get_src_stream_infoOutputStreamTypescCs|j|}t|S)aGet the metadata of output stream Args: i (int): Stream index. Returns: OutputStreamTypes Information about the output stream. If the output stream is audio type, then :class:`~torchaudio.io._stream_reader.OutputAudioStream` is returned. If it is video type, then :class:`~torchaudio.io._stream_reader.OutputVideoStream` is returned. )roget_out_stream_infor9)rtr/infor!r!r"rLs z StreamReader.get_out_stream_infopreciser$r) timestampmodecCsFdddd}||kr0tdt|d||j|||dS)aSeek the stream to the given timestamp [second] Args: timestamp (float): Target time in second. mode (str): Controls how seek is done. Valid choices are; * "key": Seek into the nearest key frame before the given timestamp. * "any": Seek into any frame (including non-key frames) before the given timestamp. * "precise": First seek into the nearest key frame before the given timestamp, then decode frames until it reaches the closes frame to the given timestamp. Note: All the modes invalidate and reset the internal state of decoder. When using "any" mode and if it ends up seeking into non-key frame, the image decoded may be invalid due to lack of key frame. Using "precise" will workaround this issue by decoding frames from previous key frame, but will be slower. r)keyanyrz!The value of mode must be one of z . Found: N)r8listkeysroseek)rtrrmodesr!r!r"r\szStreamReader.seekZfltp)rdrerfrr%r'r)rbrcrdrerfrr%r'c Cs"|j|||||t|||ddS)a Add output audio stream Args: frames_per_chunk (int): {frames_per_chunk} buffer_chunk_size (int, optional): {buffer_chunk_size} stream_index (int or None, optional): {stream_index} decoder (str or None, optional): {decoder} decoder_option (dict or None, optional): {decoder_option} format (str, optional): Output sample format (precision). If ``None``, the output chunk has dtype corresponding to the precision of the source audio. Otherwise, the sample is converted and the output dtype is changed as following. - ``"u8p"``: The output is ``torch.uint8`` type. - ``"s16p"``: The output is ``torch.int16`` type. - ``"s32p"``: The output is ``torch.int32`` type. - ``"s64p"``: The output is ``torch.int64`` type. - ``"fltp"``: The output is ``torch.float32`` type. - ``"dblp"``: The output is ``torch.float64`` type. Default: ``"fltp"``. sample_rate (int or None, optional): If provided, resample the audio. num_channels (int, or None, optional): If provided, change the number of channels. rdrerf filter_descN)add_audio_streamrC) rtrbrcrdrerfrr%r'r!r!r"add_basic_audio_streamys/ z#StreamReader.add_basic_audio_streamZrgb24)rdrerfrr+r)r*rg) rbrcrdrerfrr+r)r*rgc Cs&|j|||||t||| || ddS)a'Add output video stream Args: frames_per_chunk (int): {frames_per_chunk} buffer_chunk_size (int, optional): {buffer_chunk_size} stream_index (int or None, optional): {stream_index} decoder (str or None, optional): {decoder} decoder_option (dict or None, optional): {decoder_option} format (str, optional): Change the format of image channels. Valid values are, - ``"rgb24"``: 8 bits * 3 channels (R, G, B) - ``"bgr24"``: 8 bits * 3 channels (B, G, R) - ``"yuv420p"``: 8 bits * 3 channels (Y, U, V) - ``"gray"``: 8 bits * 1 channels Default: ``"rgb24"``. frame_rate (int or None, optional): If provided, change the frame rate. width (int or None, optional): If provided, change the image width. Unit: Pixel. height (int or None, optional): If provided, change the image height. Unit: Pixel. hw_accel (str or None, optional): {hw_accel} rdrerfrrgN)add_video_streamrF) rtrbrcrdrerfrr+r)r*rgr!r!r"add_basic_video_streams- z#StreamReader.add_basic_video_streamr)rbrcrdrerfrcCs@|dkr|jn|}|dkr"td|j||||||p8idS)adAdd output audio stream Args: frames_per_chunk (int): {frames_per_chunk} buffer_chunk_size (int, optional): {buffer_chunk_size} stream_index (int or None, optional): {stream_index} decoder (str or None, optional): {decoder} decoder_option (dict or None, optional): {decoder_option} filter_desc (str or None, optional): Filter description. The list of available filters can be found at https://ffmpeg.org/ffmpeg-filters.html Note that complex filters are not supported. NzThere is no audio stream.)ry RuntimeErrorror)rtrbrcrdrerfrr/r!r!r"rszStreamReader.add_audio_streamr)rbrcrdrerfrrgc CsB|dkr|jn|}|dkr"td|j||||||p8i|dS)aAdd output video stream Args: frames_per_chunk (int): {frames_per_chunk} buffer_chunk_size (int, optional): {buffer_chunk_size} stream_index (int or None, optional): {stream_index} decoder (str or None, optional): {decoder} decoder_option (dict or None, optional): {decoder_option} hw_accel (str or None, optional): {hw_accel} filter_desc (str or None, optional): Filter description. The list of available filters can be found at https://ffmpeg.org/ffmpeg-filters.html Note that complex filters are not supported. NzThere is no video stream.)rzrror) rtrbrcrdrerfrrgr/r!r!r"rs zStreamReader.add_video_stream)r/cCs|j|dS)zoRemove an output stream. Args: i (int): Index of the output stream to be removed. N)ro remove_streamrr!r!r"r?szStreamReader.remove_stream$@rD)timeoutbackoffr{cCs|j||S)aRead the source media and process one packet. If a packet is read successfully, then the data in the packet will be decoded and passed to corresponding output stream processors. If the packet belongs to a source stream that is not connected to an output stream, then the data are discarded. When the source reaches EOF, then it triggers all the output stream processors to enter drain mode. All the output stream processors flush the pending frames. Args: timeout (float or None, optional): Timeout in milli seconds. This argument changes the retry behavior when it failed to process a packet due to the underlying media resource being temporarily unavailable. When using a media device such as a microphone, there are cases where the underlying buffer is not ready. Calling this function in such case would cause the system to report `EAGAIN (resource temporarily unavailable)`. * ``>=0``: Keep retrying until the given time passes. * ``0<``: Keep retrying forever. * ``None`` : No retrying and raise an exception immediately. Default: ``None``. Note: The retry behavior is applicable only when the reason is the unavailable resource. It is not invoked if the reason of failure is other. backoff (float, optional): Time to wait before retrying in milli seconds. This option is effective only when `timeout` is effective. (not ``None``) When `timeout` is effective, this `backoff` controls how long the function should wait before retrying. Default: ``10.0``. Returns: int: ``0`` A packet was processed properly. The caller can keep calling this function to buffer more frames. ``1`` The streamer reached EOF. All the output stream processors flushed the pending frames. The caller should stop calling this method. )roprocess_packetrtrrr!r!r"rGs9zStreamReader.process_packetcCs|jdS)z%Process packets until it reaches EOF.N)roprocess_all_packetsrwr!r!r"rsz StreamReader.process_all_packetsboolcCs |jS)zFReturns true if all the output streams have at least one chunk filled.)rois_buffer_readyrwr!r!r"rszStreamReader.is_buffer_readyzTuple[Optional[ChunkTensor]]cCs@g}|jD],}|dkr&|dq|t|j|jq|S)zPop one chunk from all the output stream buffers. Returns: Tuple[Optional[ChunkTensor]]: Buffer contents. If a buffer does not contain any frame, then `None` is returned instead. N)ro pop_chunksr?r\framesr])rtretchunkr!r!r"rs  zStreamReader.pop_chunkscCs|j||S)aKeep processing packets until all buffers have at least one chunk Arguments: timeout (float or None, optional): See :py:func:`~StreamReader.process_packet`. (Default: ``None``) backoff (float, optional): See :py:func:`~StreamReader.process_packet`. (Default: ``10.0``) Returns: int: ``0`` Packets are processed properly and buffers are ready to be popped once. ``1`` The streamer reached EOF. All the output stream processors flushed the pending frames. The caller should stop calling this method. )ro fill_bufferrr!r!r"rszStreamReader.fill_bufferz+Iterator[Tuple[Optional[ChunkTensor], ...]]ccsV|jdkrtd|||r q,|Vq|}tdd|DrJdS|Vq,dS)aReturn an iterator that generates output tensors Arguments: timeout (float or None, optional): See :py:func:`~StreamReader.process_packet`. (Default: ``None``) backoff (float, optional): See :py:func:`~StreamReader.process_packet`. (Default: ``10.0``) Returns: Iterator[Tuple[Optional[ChunkTensor], ...]]: Iterator that yields a tuple of chunks that correspond to the output streams defined by client code. If an output stream is exhausted, then the chunk Tensor is substituted with ``None``. The iterator stops if all the output streams are exhausted. rzNo output stream is configured.css|]}|dkVqdSrHr!).0r;r!r!r" sz&StreamReader.stream..N)rxrrrall)rtrrchunksr!r!r"streams   zStreamReader.stream)NNri)r)r)r)r)r)Nr)Nr)Nr)rrrrrupropertyrvrxryrzr|r~rr_format_audio_argsr_format_video_argsrrrrrrrrrrr!r!r!r"r sH    "7&6) ,;)1 __future__r dataclassesrtypingrrrrrr r rXZ torchaudioZtorch.utils._pytreer _extensionZ _FFMPEG_EXTr rnZStreamReaderFileObjrq__all__rr#r(r0r1r4r5r9rCrFZTensorrGr\raZ_frames_per_chunkZ_buffer_chunk_sizeZ_audio_stream_indexZ_video_stream_index_decoderZ_decoder_optionZ _hw_accelrrr}rZfail_if_no_ffmpegr!r!r!r"sp  $    8)5