U ARdg9 @sUddlZddlZddlmZmZmZmZmZddlm Z m Z ddl m Z ddl Zddl mZmZddlmZddlmZddlmZdd lmZdd lmZerdd lmZdd lmZdd l m!Z!ee"e#ej$ej%ej&ddfZ'e e(d<GdddZ)e*dZ+e e(d<e"ee"dddZ,e"eeefe'e"ddddZ-d*e"ee'e"e.ddddZ/dee#e.fddd Z0de.e#d!d"d#Z1e'ee.e'd!d$d%Z2d+e"ee'e"e.ee.dd'd(d)Z3dS),N) TYPE_CHECKINGOptionalTupleUnioncast)Final TypeAlias)url)runtime type_util)StreamlitAPIException)Audio)Video)caching)gather_metrics)Any)typing)DeltaGeneratornpt.NDArray[Any] MediaDatac @sfeZdZeddddeeeeedddd Zed deeedd d dZ e ddddZ dS) MediaMixinaudio audio/wavrN) sample_rater)dataformat start_timerreturncCsft}|j}t|d}|r0|dkr0td|sF|dk rFtdt|||||||j d|S)aDisplay an audio player. Parameters ---------- data : str, bytes, BytesIO, numpy.ndarray, or file opened with io.open(). Raw audio data, filename, or a URL pointing to the file to load. Raw data formats must include all necessary file headers to match the file format specified via ``format``. If ``data`` is a numpy array, it must either be a 1D array of the waveform or a 2D array of shape ``(num_channels, num_samples)`` with waveforms for all channels. See the default channel order at http://msdn.microsoft.com/en-us/library/windows/hardware/dn653308(v=vs.85).aspx format : str The mime type for the audio file. Defaults to 'audio/wav'. See https://tools.ietf.org/html/rfc4281 for more info. start_time: int The time from which this element should start playing. sample_rate: int or None The sample rate of the audio data in samples per second. Only required if ``data`` is a numpy array. Example ------- >>> import streamlit as st >>> import numpy as np >>> >>> audio_file = open('myaudio.ogg', 'rb') >>> audio_bytes = audio_file.read() >>> >>> st.audio(audio_bytes, format='audio/ogg') >>> >>> sample_rate = 44100 # 44100 samples per second >>> seconds = 2 # Note duration of 2 seconds >>> frequency_la = 440 # Our played note will be 440 Hz >>> # Generate array with seconds*sample_rate steps, ranging between 0 and seconds >>> t = np.linspace(0, seconds, seconds * sample_rate, False) >>> # Generate a 440 Hz sine wave >>> note_la = np.sin(frequency_la * t * 2 * np.pi) >>> >>> st.audio(note_la, sample_rate=sample_rate) .. output:: https://doc-audio.streamlitapp.com/ height: 865px numpy.ndarrayNz=`sample_rate` must be specified when `data` is a numpy array.zGWarning: `sample_rate` will be ignored since data is not a numpy array.r) AudioProtodg_get_delta_path_strr is_typer stwarningmarshall_audio_enqueue)selfrrrrZ audio_proto coordinatesZis_data_numpy_arrayr)>> import streamlit as st >>> >>> video_file = open('myvideo.mp4', 'rb') >>> video_bytes = video_file.read() >>> >>> st.video(video_bytes) .. output:: https://doc-video.streamlitapp.com/ height: 700px .. note:: Some videos may not display if they are encoded using MP4V (which is an export option in OpenCV), as this codec is not widely supported by browsers. Converting your video to H.264 will allow the video to be displayed in Streamlit. See this `StackOverflow post `_ or this `Streamlit forum post `_ for more information. r+) VideoProtor r!marshall_videor&)r'rrrZ video_protor(r)r)r*r+us, zMediaMixin.video)rcCs td|S)zGet our DeltaGenerator.r)r)r'r)r)r*r sz MediaMixin.dg)rr)r,r) __name__ __module__ __qualname__rrstrintrrr+propertyr r)r)r)r*r*s.I0rzuhttp(?:s?):\/\/(?:www\.)?youtu(?:be\.com|\.be)\/(?P(watch\?v=)|embed\/)?(?P[\w\-\_]*)(&(amp;)?[\w\?=]*)? YOUTUBE_RE)r rcCs"t|}|rdjf|SdS)aReturn whether URL is any kind of YouTube embed or watch link. If so, reshape URL into an embed link suitable for use in an iframe. If not a YouTube URL, return None. Parameters ---------- url : str Example ------- >>> print(_reshape_youtube_url('https://youtu.be/_T8LGqJtuGc')) .. output:: https://www.youtube.com/embed/_T8LGqJtuGc z$https://www.youtube.com/embed/{code}N)r5matchr groupdict)r r6r)r)r*_reshape_youtube_urls r8)r(protormimetypercCs|dkr dSt|ttfr |}nt|tjr@|d|}nbt|tjsXt|tjr||d| }|dkrvdS|}n&t |dr| }nt dt|trtj|||}t|||nd}||_dS)aFill audio or video proto based on contents of data. Given a string, check if it's a url; if so, send it out without modification. Otherwise assume strings are filenames and let any OS errors raise. Load data either from file or through bytes-processing methods into a MediaFile object. Pack proto with generated Tornado-based URL. (When running in "raw" mode, we won't actually load data into the MediaFileManager, and we'll return an empty URL.) NrrzInvalid binary data format: %s) isinstancer2bytesioBytesIOseekgetvalue RawIOBaseBufferedReaderreadr r"tobytes RuntimeErrortyper existsZ get_instanceZmedia_file_mgraddrZsave_media_datar )r(r9rr:Zdata_or_filename read_dataZfile_urlr)r)r*_marshall_av_medias2       rKr,)r(r9rr:rrcCsZ||_tjj|_t|trHt|rHt|}|r@||_tjj |_qV||_nt ||||dS)aMarshalls a video proto, using url processors as needed. Parameters ---------- coordinates : str proto : the proto to fill. Must have a string field called "data". data : str, bytes, BytesIO, numpy.ndarray, or file opened with io.open(). Raw video data or a string with a URL pointing to the video to load. Includes support for YouTube URLs. If passing the raw data, this must include headers and any other bytes required in the actual file. mimetype : str The mime type for the video file. Defaults to 'video/mp4'. See https://tools.ietf.org/html/rfc4281 for more info. start_time : int The time from which this element should start playing. (default: 0) N) rr-TypeZNATIVErGr<r2r r8ZYOUTUBE_IFRAMErK)r(r9rr:rZ youtube_urlr)r)r*r.s  r.)rrcCsddl}|j|td}t|jdkr*d}n,t|jdkrN|jd}|j}ntd|jdkrt| |j  |fS| | |}||d}| |j }| |fS)aValidates and normalizes numpy array data. We validate numpy array shape (should be 1d or 2d) We normalize input data to int16 [-32768, 32767] range. Parameters ---------- data : numpy array numpy array to be validated and normalized Returns ------- Tuple of (bytes, int) (bytes, nchan) where - bytes : bytes of normalized numpy array converted to int16 - nchan : number of channels for audio signal. 1 for mono, or 2 for stereo. rN)Zdtypez1Numpy array audio input must be a 1D or 2D array.i)numpyarrayfloatlenshapeTZravelr sizeZastypeZint16rEmaxabs)rnpnchanZ max_abs_valueZnp_arrayZ scaled_datar)r)r*_validate_and_normalize0s     rZ)rrrc Csddl}t|\}}tp}|j|ddV}|||||d|dd| || W5QRW5QRSQRXW5QRXdS)z Transform a numpy array to a PCM bytestring We use code from IPython display module to convert numpy array to wave bytes https://github.com/ipython/ipython/blob/1015c392f3d50cf4ff3e9f29beede8c1abfdcb2a/IPython/lib/display.py#L146 rNwb)moderNNONE) waverZr>r?openZ setnchannelsZ setframerateZ setsampwidthZ setcomptypeZ writeframesrA)rrr^ZscaledrYfpZwaveobjr)r)r* _make_wavas      racCs(t|dr$|dk r$ttd||}|S)z:Convert data to wav bytes if the data type is numpy array.rNr)r r"rar)rrr)r)r*_maybe_convert_to_wav_bytesvsrbr)r(r9rr:rrrcCs<||_t|tr t|r ||_nt||}t||||dS)a3Marshalls an audio proto, using data and url processors as needed. Parameters ---------- coordinates : str proto : The proto to fill. Must have a string field called "url". data : str, bytes, BytesIO, numpy.ndarray, or file opened with io.open() Raw audio data or a string with a URL pointing to the file to load. If passing the raw data, this must include headers and any other bytes required in the actual file. mimetype : str The mime type for the audio file. Defaults to "audio/wav". See https://tools.ietf.org/html/rfc4281 for more info. start_time : int The time from which this element should start playing. (default: 0) sample_rate: int or None Optional param to provide sample_rate in case of numpy array N)rr<r2r rbrK)r(r9rr:rrr)r)r*r%s  r%)r,r)rrN)4r>rerrrrrrZtyping_extensionsrrZ validatorsr Z streamlitr#r r Zstreamlit.errorsr Zstreamlit.proto.Audio_pb2r rZstreamlit.proto.Video_pb2rr-Zstreamlit.runtimerZstreamlit.runtime.metrics_utilrrrOZnptZstreamlit.delta_generatorrr2r=r?rBrCr__annotations__rcompiler5r8rKr3r.rZrarbr%r)r)r)r*sv             : +1