U $Pff@sddlmZddlZddlZddlZddlmZddlmZddl m Z m Z m Z m Z mZmZmZmZmZmZmZmZddlmZdd lmZdd lmZdd lmZdd lmZGd ddeZ Gddde Z!Gddde Z"Gddde Z#dS))unicode_literalsN) InfoExtractor)compat_urlparse) clean_htmlExtractorErrorget_element_by_class int_or_noneOnDemandPagedList orderedSet str_or_none str_to_int unescapeHTMLunified_timestamp url_or_noneurlencode_postdata) DailymotionIE)OdnoklassnikiIE) PladformIE)VimeoIE) YoutubeIEc@s*eZdZdZddZddZd ddZd S) VKBaseIEvkcCs|\}}|dkrdS|ddd\}}||}||d|dd||d|jdddt|d}t d |rt d d d dS) Nzhttps://vk.comzDownloading login pagecp1251)emailpassZremixlhkzhttps://login.vk.com/?act=loginz Logging in)notedataZ onLoginFailedz3Unable to login, incorrect username and/or passwordTexpected) Z_get_login_infoZ_download_webpage_handleZ_hidden_inputsupdateencodeZ_apply_first_set_cookie_header_download_webpagerresearchr)selfusernamepasswordZ login_pageZ url_handleZ login_formr);/tmp/pip-unpacked-wheel-7zdooeg3/youtube_dl/extractor/vk.py_login"s2    zVKBaseIE._logincCs |dS)N)r+)r&r)r)r*_real_initialize>szVKBaseIE._real_initializeTcCsjd|d<|jd||t||ddidd\}}|dkrB|n$|d krftt|d dd d d |S)Nralzhttps://vk.com/%s.phpzX-Requested-WithZXMLHttpRequest)rfatalheaderspayload38rTr)Z_download_jsonrZraise_login_requiredrr)r&pathvideo_idrr.coder0r)r)r*_download_payloadAs zVKBaseIE._download_payloadN)T)__name__ __module__ __qualname__Z_NETRC_MACHINEr+r,r7r)r)r)r*rsrc@seZdZdZdZdZdddddd d d d d ddddddddddddddddddd dd d d d dddddd dd!d"d#d$ed%d&d'd(d)dd*d+d,d-d.d/d0d1d2d3d4d5d6dd7d8d9ed:d&d'd;dd?d@dAedBd&dCdDdEddFdGdHdIdJdKedL ddMdNddOdPdQdRdSdTdUdVdWidXdYdZd[dd\d]d^d_d`dadVdWidbdcddddedfdgdhdidjdkdVdWidXdldWdmdndWdmdodWdmdpdWdmdqdWdmdrdWdmdsdWdmgZedtduZ dvdwZ dxS)yVKIErZVKa(?x) https?:// (?: (?: (?:(?:m|new)\.)?vk\.com/video_| (?:www\.)?daxab.com/ ) ext\.php\?(?P.*?\boid=(?P-?\d+).*?\bid=(?P\d+).*)| (?: (?:(?:m|new)\.)?vk\.com/(?:.+?\?.*?z=)?video| (?:www\.)?daxab.com/embed/ ) (?P-?\d+_\d+)(?:.*\blist=(?P[\da-f]+))? ) z>http://vk.com/videos-77521?z=video-77521_162222515%2Fclub77521Z 7babad3b85ea2e91948005b1b8b0cb84z-77521_162222515mp4u%ProtivoGunz - Хуёвая песняz&re:(?:Noize MC|Alexander Ilyashenko).*z-77521i7OZ20120212)idexttitleuploader uploader_idduration timestamp upload_date)urlmd5 info_dictz&http://vk.com/video205387401_165548505Z205387401_165548505zNo namez Tom CruiseZ 205387401 i!QZ20130720)rFrHzEmbedded videozJhttps://vk.com/video_ext.php?oid=-77521&id=162222515&hash=87b046504ccd8bfa)r>r?rAr@rCrErDrB)rrFrGrHz%http://vk.com/video-8871596_164049491Z a590bcaf3d543576c9bd162812387666z#Only available for registered usersz-8871596_164049491uТриллерыu<► Бойцовский клуб / Fight Club 1999 [HD 720]i Z20121218)r>r?rAr@rCrE view_countZRemoved)rFrGrrHskipzKhttp://vk.com/hd_kino_mania?z=video-43215063_168067957%2F15c66b9b533119788dz-43215063_168067957z Bro Mazter i{Z20140328Z 223413403in5S)r>r?rAr@rCrErBrDRequires vk account credentials)rFrHrKz[http://m.vk.com/video-43215063_169084319?list=125c627d1aa1cebb83&from=wall-43215063_2566540Z 0c45586baa71b7cb1d0784ee3f4e00a6z ivi.ru embedz-43215063_169084319uКнига ИлаяisZ20140626)r>r?r@rCrErJz>https://vk.com/video30481095_171201961?list=8764ae2d21f14088d4Z 091287af5402239a1051c37ec7b92913Z30481095_171201961uТюменцевВВ_09.07.2015z Anton IvanovmZ20150709)r>r?r@rArCrErJ)rFrGrHrKz'https://vk.com/video276849682_170681728Z V3K4mi0SYkcz`DSWD Awards 'Children's Joy Foundation, Inc.' Certificate of Registration and License to Operatez$md5:bf9c26cfa4acdfb146362682edd3827aZ20130116zChildren's Joy Foundation Inc.Zthecjf) r>r?r@ descriptionrCrErArBrJz'https://vk.com/video-37468416_456239855Zk3lz2cmXyRuJQSjGHUvz$md5:d52606645c20b0ddbb21655adaa4f56fz$md5:424b8e88cc873217f520e582ba28bb36z AniLibria.TvZ20160914Zx1p5vl5iW)r>r?r@rPrArErBrD skip_downloadT)rFrHparamsz'http://vk.com/video-110305615_171782105Z e13fcda136f99764872e739d13fac1d1z-110305615_171782105u+S-Dance, репетиции к The way showuTHE WAY SHOW | 17 апреляz -110305615iQdVZ20160207)r>r?r@rArBrDrE)rFrGrHrRzEhttps://vk.com/videos-387766?z=video-387766_456242764%2Fpl_-387766_-2z-387766_456242764u@ИгроМир 2016 День 1 — Игромания УтромuИгроманияiwZ20160929z-387766iW)r>r?r@rArCrErBrDz%https://vk.com/video-140332_456239111rFZ only_matchingzBhttp://vk.com/feed?z=video-43215063_166094326%2Fbb50cacd3177146d7az'https://vk.com/video205387401_164765225z'https://vk.com/video-76116461_171554880z*http://new.vk.com/video205387401_165548505z'https://vk.com/video-10639516_456240611z'https://vk.com/video-51812607_171445436cCsddtd|DS)NcSsg|]}t|dqSrF)rgroup).0mobjr)r)r* 2sz-VKIE._extract_sibnet_urls..ze]+\bsrc=(["\'])(?P(?:https?:)?//video\.sibnet\.ru/shell\.php\?.*?\bvideoid=\d+.*?)\1)r$finditer)webpager)r)r*_extract_sibnet_urls/s zVKIE._extract_sibnet_urlsc#CsBt|j|}|d}i}|r|d|d}|d}|r@||d<|d||}|d}|d} | d pji}| d pxi} nd |d |d f}|d|d|}|jddg|ddd} | rt| ddt d|rtdddd} | | ddddddddd } | D](\}}t ||rt||ddq| | d!|d"|} t |}|rn||t St||}|dk r||tSt|}|r||tSt d#|}|dk r||dd$d%}||St|}|r||d&tSt|}|r0||tS||}|rN||d&St d'|}|rt d(|d}|r|d}|d)rd*|}||S| d+d&}t|d,}|d-d.k}|r||}t|jd/|d0ddpt|d1}t|j d2|d3dd}g}| D]\} }!t|!}!|!r|!d4sDq| d5sZ| d6krt|j d7| d8dd}"| | |!|"d9nF| d:kr|!|j"|!|d;d<| d=|d>n| d?kr| | |!d@dAq|#|||||dB|dCt$|dDp|dEt|dFp|dF||t|dGt|dH|dI S)JNZvideoidZ show_inline)actvideolist_idlistal_videorr3ZmvDataplayer%s_%soidr>zhttp://vk.com/video_ext.php?Z embed_queryz<(?s)]+class="video_layer_message"[^>]*>(.+?)z0(?s)]+id="video_ext_msg"[^>]*>(.+?)z error message)defaultTrz&/login\.php\?.*\bact=security_checkzqYou are trying to log in from an unusual location. You should confirm ownership at vk.com to log in with this IP.zJVideo %s has been removed from public access due to rightholder complaint.zvVideo %s is only available for registered users, use --username and --password options to provide account credentials.zVideo %s does not exist.z$Video %s is temporarily unavailable.zAccess denied to video %s.zEVideo %s is no longer available, because its author has been blocked.z=Video %s is no longer available, because it has been deleted.z)Video %s is not available in your region.) u>Видеозапись .*? была изъята из публичного доступа в связи с обращением правообладателя.The video .*? was removed from public access by request of the copyright holder.Please log in or Unknown erroru3Видео временно недоступноzAccess deniedunВидеозапись недоступна, так как её автор был заблокирован.zJThis video is no longer available, because its author has been blocked.zBThis video is no longer available, because it has been deleted.z1The video .+? is not available in your region.z)var\s+playerParams\s*=\s*({.+?})\s*;\s*\nz player paramszG\ssrc="((?:https?:)?//rutube\.ru\\?/(?:video|play)\\?/embed(?:.*?))\\?"\rz(?s)var\s+opts\s*=\s*({.+?});zurl\s*:\s*'((?!/\b)[^']+)//zhttp:rRZmd_titleliverz.class=["\']mv_info_date[^>]+>([^<]+)(?:<|from)z upload datedatez+class=["\']mv_views_count[^>]+>\s*([\d,.]+)z view count)httprgrtmp)rFcache) extra_dataZlive_mp4Z postlive_mp4z^(?:url|cache)(\d+)height) format_idrFrnZhlsr<Z m3u8_nativeF)Zm3u8_idr.rhrkZflv)rorFr?ZjpgZ md_authorZ author_idZauthorIdrCZlikesZ commcount) r>formatsr@Z thumbnailrArBrCrDrJZ like_countZ comment_countis_live)%r$match _VALID_URLrUr7getr#Z_html_search_regexrr%items _parse_jsonZ _search_regexrZ _extract_url url_resultie_keyrrZ_proto_relative_urlreplacerZ _extract_urlsrr[ startswithrZ _live_titlerr rrappendextendZ_extract_m3u8_formatsZ _sort_formatsr )#r&rFrWr5Zmv_datarr^r0Z info_pageoptsra error_messageZERROR_COPYRIGHTZERRORSZerror_re error_msgZ youtube_urlZ vimeo_urlZ pladform_urlZm_rutubeZ rutube_urlZdailymotion_urlsZodnoklassniki_urlZ sibnet_urlsZm_optsZ m_opts_urlZopts_urlr@rqrDrJrproZ format_urlrnr)r)r* _real_extract6s@     !                           zVKIE._real_extractN) r8r9r:IE_NAMEIE_DESCrsint_TESTS staticmethodr[rr)r)r)r*r;NsR      P r;c @seZdZdZdZdZdZdddidd d dd id d d ddddddddddddddgZdZe dddgZ ddZ ddZ dS)VKUserVideosIEz vk:uservideoszVK - User's Videoszvhttps?://(?:(?:m|new)\.)?vk\.com/videos(?P-?[0-9]+)(?!\?.*\bz=video)(?:[/?#&](?:.*?\bsection=(?P
\w+))?|$)zhttps://vk.com/videoszhttps://vk.com/videos-767561r>z -767561_alli~)rFrHZplaylist_mincountz-https://vk.com/videos-767561?section=uploadedz-767561_uploadedizhttp://vk.com/videos205387401TrSzhttp://vk.com/videos-77521z)http://vk.com/videos-97664626?section=allzhttp://m.vk.com/videos205387401z!http://new.vk.com/videos205387401iZVideoowner_idc cst|d|d||j||dd|d}|D]@}|j|dd}d|j|jf}|d|t|Vq.dS) Nr`Zload_videos_silent)r\offsetrcsectionrr_rz%d_%dzhttp://vk.com/video) r7 _PAGE_SIZE_VIDEO_makerr>rwr;rx)r&page_idrpagelr]vr5r)r)r* _fetch_pages(zVKUserVideosIE._fetch_pagecCsJt|j|\}}|sd}tt|j|||j}| |d||fS)Nallrb) r$rrrsgroupsr functoolspartialrrplaylist_result)r&rFrrentriesr)r)r*rszVKUserVideosIE._real_extractN)r8r9r:rrrsZ _TEMPLATE_URLrr collections namedtuplerrrr)r)r)r*rsHrc@seZdZdZdZddddddd d d d d d dddddd ddd d dddgddddddddddddidd d!dd"d#dd"gZd$Zed%d&d'd(d)d*d+d,d-d.d/d0d1d2d3d4d5gZ d6d7Z d8d9Z d:d;Z d-?\d+_\d+)))z-https://vk.com/bs.official?w=wall-23538238_35z -23538238_35z%Black Shadow - Wall post -23538238_35z$md5:3f84b9c4f9ef499731cf1ced9998cc0c)r>r@rPZ 5ba93864ec5b85f7ce19a9af4af080f6Z135220665_111806521r<u.Black Shadow - Слепое Верованиеirz Black ShadowuСлепое Верование)r>r?r@rCrAartisttrack)rGrHZ 4cc7e804579122b17ea95af7834c9233Z135220665_111802303uGBlack Shadow - Война - Негасимое Бездны Пламя!iu8Война - Негасимое Бездны Пламя!T)rQusenetrcrM)rFrHZplaylistrRrKz https://vk.com/wall85155021_6319Z 85155021_6319u7Сергей Горбунов - Wall post 85155021_6319)r>r@rr)rFrHZplaylist_countrRrKzhttps://vk.com/wall-23538238_35rSz!https://m.vk.com/wall-23538238_35zAabcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMN0PQRSTUVWXYZO123456789+/=ZAudior>rrFr@ performerrCZalbum_idZunkZ author_linkZlyricsflagscontextextrahashes cover_urladscCsjd}d}}|D]T}|j|}|d}|r8d||n|}|d7}|r|td|d|d@?@7}q|S) Nrfr@r) _BASE64_CHARSindexchr)r&encdecencrZcondr)r)r*_decodegs zVKWallPostIE._decodec Csd|kr|ddd}||dtd\}}t||d}t|}dg|}t||A}t|dddD]$} || d|| A|}||| <qxtd|D]0} || } ||d| }|||| <| ||<qd|}|S) NZaudio_api_unavailablez?extra=r# rr3rf)splitrrr_lenrrangejoin) r&Zmask_urlvk_idrfuncbaseZurl_lenZindexesrrrr)r)r* _unmask_urlss"      zVKWallPostIE._unmask_urlc Csl||}|d|dd|dd}ttd|}ttd|}g}td|D]}|t||}|j |dd }|j sqRt|j } t|j } | d |j|jf||j |jd | rd | | fn| |jrd d|jdDndt|j|| | ddd qRtd|D]*} | |t|| dtqd|} |t|||rdd || fn| |S)NZwkviewshowZwall)r\wrZwall_post_textauthorzdata-audio="([^"]+)rbrz%s - %scSsg|] }d|iqSrTr))rVZc_urlr)r)r*rXsz.VKWallPostIE._real_extract..,r<Zm3u8) r>rFr@Z thumbnailsrCrArrr?protocolz3]+href=(["\'])(?P/video(?:-?[\d_]+).*?)\1rFz Wall post %s)Z _match_idr7rr r$findallrvr_AUDIOrrFr@rr{rr>rrrrr rCrYrwrurljoinrUr;rxrr ) r&rFZpost_idrZrPrAraudioar@rr]r)r)r*rsX     zVKWallPostIE._real_extractN) r8r9r:rrsrrrrrrrrr)r)r)r*r(sn &9, r)$ __future__rrrr$commonrcompatrutilsrrr r r r r rrrrrZ dailymotionrZ odnoklassnikirZpladformrZvimeorZyoutuberrr;rrr)r)r)r*s$   8     />