U & f((@sjddlZddlZddlZddlZddlmZddlmZddl m Z dZ edde de_ Gd d d ZdS) N)config)build) HttpErrorzX^(https?://)?(www\.)?(youtube\.com/watch\?v=|youtu\.be/|youtube\.com/shorts/)([\w-]{11})ZOPENAPI_API_KEYdefaultcastc@seZdZeedddZeedddZeddZed d Zedd d Z edddZ edddZ edddZ dS)UtilsZvideoUrlcCstt|dk S)N)rematchYOUTUBE_URL_PATTERNr r  $ zUtils.generate_promptstext-embedding-ada-002c sg}tj|dd\}}dd|D}fddtjfdd|D}tj|D]n}||}z|} || Wq\tk r} z,d |d t | WYW5QRSd} ~ XYq\Xq\W5QRX|S) N)r5cSsg|] }|dqS)r1r).0Z prompt_inforrr |sz.Utils.get_comments_reports..cs(tjj|ddddd}|jdjS)Nr0i ffffff?)enginer1nstop max_tokens temperaturer)openai Completioncreatechoicesrr3)r1r*) open_ai_modelrrprocess_promptsz2Utils.get_comments_reports..process_promptcsi|]}||qSr)submit)r<r1)executorrIrr s z.Utils.get_comments_reports..zError processing prompt: z, ) r r9 concurrentfuturesThreadPoolExecutor as_completedresultr%r&r ) comment_listrHreportsZ prompts_infor7ZpromptsZreport_futuresfuturer1reporter)rKrHrIrget_comments_reportsws FzUtils.get_comments_reportscCs^d}t|ddD]\}}||d|d7}q|d7}tjj||ddddd }|jd jS) NzFAnalyze the sentiments and overall themes in the following reports : r0)startz. r/r.r>r?r1rBr@rArCr) enumeraterDrErFrGrr3)Z reports_chunkrHr1irUr*rrrgenerate_summarys zUtils.generate_summarycCsd}g}d}d}|D]h}t|}||kr@||||7}qt||}|g}|||t|7}|t|7}q|rt|}|S)Nrxr)r!r2r%r r])rSrHsummaryZ current_chunkr5Ztotal_words_in_chunkrUZ report_tokensrrrsummarize_reportss"      zUtils.summarize_reportscCsBd}|d|d7}tjj||ddddd}t|jdjS) NaqIMPORTANT THE RESPONSE SHOULD BE JSON FORMAT ONLY!! DO NOT RESPOND WITH ANYTHING ELSE OUTSIDE OF THE JSON FORMAT, THANKS, ... Please generate a sentiment analysis and theme report in JSON format for the following list of mini reports of the same video, Please include the following in the json report: - The average percentage of positive, neutral, and negative feedback in comma to respect json format, it's very urgent! - A summary of what people are generally talking about in 50 words minimum - More insightful data about what people "liked" and what people "didn't like" - Any additional details that may be useful Format the report in JSON and only json format! don't write anything outside of the json {} and make sure the json format is 100% correct and for percentage use quote so it's correct format in json : z Report : z rYr0r>rZr)rDrErFjsonloadsrGrr3)rUrHr1r*rrrdefine_summarys zUtils.define_summaryN)r:)r:)r:)r:) __name__ __module__ __qualname__ staticmethodr rrr-r9rWr]r`rcrrrrr s  + -   r )r rarDconcurrent.futuresrMZdecouplerZgoogleapiclient.discoveryrZgoogleapiclient.errorsrr r r)r rrrrs