U 9%e*@sUdZddlZddlZddlZddlZddlmZddlmZddl m Z ddl m Z m Z mZmZmZmZmZmZmZmZmZmZmZmZddlmZdd lmZdd lmZm Z m!Z!m"Z"m#Z#m$Z$d d l%m&Z&e rdd l'm(Z(m)Z)ddl*m+Z+e,Z-ee,e fZ.ee/efZ0ee0e.e-fZ1ddhZ2e3e4Z5eGdddZ6Gdddee7Z8ddZ9ddZ:ddZ;daee,ee,fdd d!Z?ee ee d"d#d$Z@ee1ee0d%d&d'ZAeedeedd%d(d'ZAeee1eee0ddfd%d)d'ZAe1e,d%d*d+ZBe,d,d-d.d/ZCe/ed%d0d1ZDe/ed%d2d3ZEe/d,d%d4d5ZFee/eGeee,ee&fd6d7d8ZHee/eGeee,ee&fd6d9d:ZId;dd?ZJeKZLeee,e=d@<ee,ddAdBdCZMee,eGdAdDdEZNdS)FzEContains utilities used by both the sync and async inference clients.N)contextmanager) dataclass)Path) TYPE_CHECKINGAny AsyncIterableBinaryIOContextManagerDict GeneratorIterableListLiteralOptionalSetUnionoverload) HTTPError)ENDPOINT)build_hf_headers get_sessionhf_raise_for_statusis_aiohttp_availableis_numpy_availableis_pillow_available)TextGenerationStreamResponse)ClientResponse ClientSessionImagez text-to-imagezimage-to-imagec@s2eZdZUdZeed<eed<eed<eed<dS) ModelStatusa= This Dataclass represents the the model status in the Hugging Face Inference API. Args: loaded (`bool`): If the model is currently loaded. state (`str`): The current state of the model. This can be 'Loaded', 'Loadable', 'TooBig' compute_type (`str`): The type of compute resource the model is using or will use, such as 'gpu' or 'cpu'. framework (`str`): The name of the framework that the model was built with, such as 'transformers' or 'text-generation-inference'. ZloadedstateZ compute_typeZ frameworkN)__name__ __module__ __qualname____doc__bool__annotations__strr+r+`/var/www/html/Darija-Ai-API/env/lib/python3.8/site-packages/huggingface_hub/inference/_common.pyr"Is r"c@seZdZdZdS)InferenceTimeoutErrorzBError raised when a model is unavailable or the request times out.N)r$r%r&r'r+r+r+r,r-`sr-cCststdddl}|S)NzMPlease install aiohttp to use `AsyncInferenceClient` (`pip install aiohttp`).r)r ImportErroraiohttp)r/r+r+r,_import_aiohttpgsr0cCststdddl}|S)z.Make sure `numpy` is installed on the machine.zGPlease install numpy to use deal with embeddings (`pip install numpy`).rN)rr.numpy)r1r+r+r, _import_numpypsr2cCststdddlm}|S)z,Make sure `PIL` is installed on the machine.zPlease install Pillow to use deal with images (`pip install Pillow`). If you don't want the image to be post-processed, use `client.post(...)` and get the raw response from the server.rr )rr.PILr!r r+r+r,_import_pil_imageys  r4_RECOMMENDED_MODELS)taskreturnc CsFt|}|dkr$td|dtd|d|d|d|S)NzTask zn has no recommended task. Please specify a model explicitly. Visit https://huggingface.co/tasks for more info.zUsing recommended model z for task z7. Note that it is encouraged to explicitly set `model='zI'` as the recommended models list might get updated without prior notice.)_fetch_recommended_modelsget ValueErrorloggerinfo)r6modelr+r+r,_get_recommended_models  r>)r7cCsBtdkr>tjtdtd}t|dd|DatS)Nz /api/tasks)headerscSsi|]\}}|t|dqS)Z widgetModels)_first_or_none).0r6detailsr+r+r, sz-_fetch_recommended_models..)r5rr9rrrjsonitems)responser+r+r,r8s r8)rEr7cCs*z|dp dWStk r$YdSXdS)Nr) IndexError)rEr+r+r,r@sr@)contentr7cCsdSNr+rHr+r+r,_open_as_binarysrKcCsdSrIr+rJr+r+r,rKsc cst|trb|ds|drBtd|t|jVdSt|}| sbt d|dt|trtd|| d }|VW5QRXn|VdS) zOpen `content` as a binary file, either from a URL, a local path, or raw bytes. Do nothing if `content` is None, TODO: handle a PIL.Image as input TODO: handle base64 as input zhttps://zhttp://zDownloading content from NzFile not found at z. If `data` is a string, it must either be a URL or a path to a local file. To pass raw content, please encode it as bytes first.zOpening content from rb) isinstancer* startswithr;debugrr9rHrexistsFileNotFoundErroropen)rHfr+r+r,rKs    c CsDt|2}t|tr|n|}t|W5QRSQRXdS)z[Encode a raw file (image, audio) into base64. Can be byes, an opened file, a path or a URL.N)rKrMbytesreadbase64 b64encodedecode)rHdataZ data_as_bytesr+r+r, _b64_encodes rZr!) encoded_imager7cCst}|tt|S)z/Parse a base64-encoded string into a PIL Image.)r4rRioBytesIOrV b64decode)r[r!r+r+r, _b64_to_imagesr_cCst|S)acParse bytes from a Response object into a Python list. Expects the response body to be JSON-encoded data. NOTE: This is exactly the same implementation as `_bytes_to_dict` and will not complain if the returned data is a dictionary. The only advantage of having both is to help the user (and mypy) understand what kind of data to expect. rDloadsrXrJr+r+r,_bytes_to_listsrbcCst|S)acParse bytes from a Response object into a Python dictionary. Expects the response body to be JSON-encoded data. NOTE: This is exactly the same implementation as `_bytes_to_list` and will not complain if the returned data is a list. The only advantage of having both is to help the user (and mypy) understand what kind of data to expect. r`rJr+r+r,_bytes_to_dictsrccCst}|t|S)zParse bytes from a Response object into a PIL Image. Expects the response body to be raw bytes. To deal with b64 encoded images, use `_b64_to_image` instead. )r4rRr\r])rHr!r+r+r,_bytes_to_imagesrd)bytes_output_as_linesrBr7ccs^|D]T}|dkrq|d}|drt|dd}tf|}|sR|jjn|VqdSN zutf-8zdata:z/n rXrNrDralstriprstriprtokentextrerB byte_payloadpayloadZ json_payloadoutputr+r+r, _stream_text_generation_responses   rqcCsh|2z\3dHW}|dkrq|d}|drt|dd}tf|}|sZ|jjn|Vq6dSrfrhrmr+r+r,&_async_stream_text_generation_responses   rrrr)clientrFr7cCs.|j2z3dHW}|Vq6|IdHdSrI)rHclose)rsrFrnr+r+r,_async_yield_from/s ru_NON_TGI_SERVERS)r=r7cCst|dSrI)rvaddr=r+r+r,_set_as_non_tgiFsrycCs|tkSrI)rvrxr+r+r,_is_tgi_serverJsrz)Or'rVr\rDlogging contextlibr dataclassesrpathlibrtypingrrrrr r r r r rrrrrrequestsr constantsrutilsrrrrrrZ_text_generationrr/rrr3r!r*ZUrlTZPathTrTZBinaryTZContentTZTASKS_EXPECTING_IMAGES getLoggerr$r;r" TimeoutErrorr-r0r2r4r5r)r>r8r@rKrZr_rbrcrdr(rqrrrusetrvryrzr+r+r+r,sl   @            $