U W¨+d»zã@s¬ddlZddlZddlZddlZddlZddlZddlZddlZddlm Z ddl m Z m Z ddl mZddlmZddlmZddlmZddlmZGd d „d eƒZdS) éN)Úmd5)ÚconfigÚ UserAgent)ÚAWSAuthConnection)ÚInvalidUriError)ÚResumableTransferDisposition)ÚResumableUploadException)ÚKeyFilec@s¸eZdZdZejeejej fZ dZ d*dd„Z dd„Z dd „Zd d „Zd d „Zdd„Zdd„Zd+dd„Zdd„Zdd„Zd,dd„Zdd„Zdd„Zdd „Zd!d"„Zd-d%d&„Zd.d(d)„ZdS)/ÚResumableUploadHandleri )réÿÿÿÿNcCs.||_||_d|_d|_|r$| ¡d|_dS)a  Constructor. Instantiate once for each uploaded file. :type tracker_file_name: string :param tracker_file_name: optional file name to save tracker URI. If supplied and the current process fails the upload, it can be retried in a new process. If called with an existing file containing a valid tracker URI, we'll resume the upload from this URI; else we'll start a new resumable upload (and write the URI to this tracker file). :type num_retries: int :param num_retries: the number of times we'll re-try a resumable upload making no progress. (Count resets every time we get progress, so upload can span many more than this number of retries.) rN)Útracker_file_nameÚ num_retriesÚserver_has_bytesÚ tracker_uriÚ_load_tracker_uri_from_fileÚupload_start_point)Úselfr r ©rúD/tmp/pip-unpacked-wheel-dlxw5sjy/boto/gs/resumable_upload_handler.pyÚ__init__@szResumableUploadHandler.__init__c Cs¸d}z z&t|jdƒ}| ¡ ¡}| |¡Wnttk rn}z$|jtjkr^t d|j|j fƒW5d}~XYn4t k r }zt d||jfƒW5d}~XYnXW5|r²| ¡XdS)NÚrzHCouldn't read URI tracker file (%s): %s. Restarting upload from scratch.zXInvalid tracker URI (%s) found in URI tracker file (%s). Restarting upload from scratch.) ÚcloseÚopenr ÚreadlineÚstripÚ_set_tracker_uriÚIOErrorÚerrnoÚENOENTÚprintÚstrerrorr)rÚfÚuriÚerrrr[s     þþz2ResumableUploadHandler._load_tracker_uri_from_filec CsŠ|js dSd}ztd|jtjƒ‚d}| d¡}|r‚t d|¡}|rˆt|  d¡ƒ}t|  d ¡ƒ}d }n|j S|s¤td t |  ¡ƒtjƒ‚|j dkr¾td ||fƒ||fS) a+ Queries server to find out what bytes it currently has. Returns (server_start, server_end), where the values are inclusive. For example, (0, 2) would mean that the server has bytes 0, 1, *and* 2. Raises ResumableUploadException if problem querying server. éÈréi4z1Got non-308 response (%s) from server state queryFÚrangezbytes=(\d+)-(\d+)éTz6Couldn't parse upload server state query response (%s)zServer has: Range: %d - %d.)rNÚstatusrrÚ START_OVERÚ getheaderÚreÚsearchÚlongÚgroupÚSERVER_HAS_NOTHINGÚstrÚ getheadersÚdebugr) rrKrLÚrespZgot_valid_responserAÚmÚ server_startÚ server_endrrrÚ_query_server_posÎs:    ÿþ   ÿþ z(ResumableUploadHandler._query_server_posc Csô|jj}|jdkrtdƒd|_i}|D](}| ¡dkrDtdtjƒ‚||||<q(d||j j <|  d|jj |j |¡}|  ¡}|jdkrštd |jtjƒ‚n&|jd krÀ|jd krÀtd |jtjƒ‚| d ¡}|sÞtd|tjƒ‚| |¡| ¡dS)zn Starts a new resumable upload. Raises ResumableUploadException if any errors occur. rPzStarting new resumable upload.rzcontent-lengthz5Attempt to specify Content-Length header (disallowed)ÚstartÚPOST)éôé÷zEGot status %d from attempt to start resumable upload. Will wait/retryrOéÉz>Got status %d from attempt to start resumable upload. AbortingZLocationzINo resumable tracker URI found in resumable initiation POST response (%s)N)ÚbucketÚ connectionr]rrr0rrr*ZproviderZresumable_upload_headerrJÚnameÚreadrSÚWAIT_BEFORE_RETRYrUrr+) rÚkeyrHrKZ post_headersÚkr^ÚbodyrrrrÚ_start_new_resumable_uploadsX   þ ÿ ÿýÿý ÿý z2ResumableUploadHandler._start_new_resumable_uploadc Cs| |j¡} |rL|dkr,||j|d} n|dkr:d} nd} d} |||ƒ|sVi} n| ¡} |r˜||krx| d|¡} n| d||df|¡} | | d<t||ƒ| d<tj|d |jd | |jd }|  d |j ¡| D]}|  || |¡qÔ|  ¡|  d¡| rt| | ¡|jD]}|j| | ¡q|t| ƒ7}|rf| d7} | | ksX| dkrf|||ƒd} | |j¡} qü|  |j¡|r|||ƒ||kr®td ||ftjƒ‚| ¡}|  |j¡|jd krê| d¡| d¡| d¡fS|jdkrþtj}ntj}td|j|jf|ƒ‚d S)zþ Makes one attempt to upload file bytes, using an existing resumable upload connection. Returns (etag, generation, metageneration) from server upon success. Raises ResumableUploadException if any problems occur. rRrr r@z%d-%drPrCrErFNrGzxsz3ResumableUploadHandler.send_file..ZBotor éc3s |]}|ˆj| ¡fVqdSr<)ryrsrœr6rrrŸƒsÿrPzResumable upload complete.zCaught exception (%s)T)&rÚ isinstancer ZgetkeyÚsizerˆr%ÚSEEK_ENDÚtellrhrir]rÚdictryr rÚgetintr”rr•rZ generationZmetagenerationÚdigestZ local_hashesr?r‘rÚRETRYABLE_EXCEPTIONSÚ__repr__rrÚEPIPErrr“rš)rrmr~rHr€rržZCTrLr]r™rqr…r#r)ržrrÚ send_file;sd%     ÿ   þ  ÿÿ     ÿz ResumableUploadHandler.send_file)NN)r@r@)N)Tr)Nr›N)Ú__name__Ú __module__Ú __qualname__rrÚhttplibÚ HTTPExceptionrrŒrÚgaierrorr¨rZrrr+rr7r;r?rBrNrbrpr‡rr‘r“ršr«rrrrr 6s0 ÿ  4 :^^ÿ r )rr¯r%r–rVrŒr—r.ÚhashlibrZbotorrZboto.connectionrZboto.exceptionrrrZboto.s3.keyfiler Úobjectr rrrrÚs