U dmK@sdZddlmZddlmZdaeaddZddZ d d Z d d Z d dZ ddZ ddZddZddZddZddZddZddZdd Zd!d"Zd#d$Zd%d&Zd'd(Zd)d*Zd+d,Zd-d.Zd/d0Zd6d2d3Zd7d4d5Zd1S)8z Implement functions for controlling execution of nets and steps, including Do DoParallel For-loop While-loop Do-While-loop Switch If )core) viewitemscCs<d||f}|}|tkr.d|tf}td7aqt||S)Nz%s/%sz%s_%dr)_used_step_names _current_idxadd) control_name base_nameZ concat_nameZ next_namer 9/tmp/pip-unpacked-wheel-ua33x9lu/caffe2/python/control.py_get_next_step_names    r cCsHt|dkrtdn.t|dkr<|d}t|tsD|g}nt|}|S)zx input is a tuple. Example: (a, b, c) --> [a, b, c] (a) --> [a] ([a, b, c]) --> [a, b, c] rzinput cannot be empty.r)len ValueError isinstancelist)inputoutputr r r _MakeList(s   rcCs,t|trtdd|DSt|tjSdS)Ncss|]}t|tjVqdS)N)rrNet).0nr r r =sz_IsNets..)rrallrr) nets_or_stepsr r r _IsNets;s rcGs6t|f}t|}t|r"||Std|g|SdS)NprependrrDornetsr r r _PrependNetsBs  r cGs6t|f}t|}t|r"||S|td|gSdS)Nappendrrr r r _AppendNetsKs  r"cCs6t|jdks"td|jjt|jdS)zW The condition blob is the last external_output that must be a single bool rz6Condition net %s must has at least one external output)r ProtoZexternal_outputAssertionErrornamer BlobReference) condition_netr r r GetConditionBlobFromNetTs r)cGsHt|}td}|D],\}}|jg|gg|tjjd}||q|S)aA net assigning constant bool values to blobs. It is mainly used for initializing condition blobs, for example, in multi-task learning, we need to access reader_done blobs before reader_net run. In that case, the reader_done blobs must be initialized. Args: blobs_with_bool_value: one or more (blob, bool_value) pairs. The net will assign each bool_value to the corresponding blob. returns bool_net: A net assigning constant bool values to blobs. Examples: - BoolNet((blob_1, bool_value_1), ..., (blob_n, bool_value_n)) - BoolNet([(blob_1, net1), ..., (blob_n, bool_value_n)]) - BoolNet((cond_1, bool_value_1)) bool_net)shapevalueZdtype)rrrZ ConstantFillZDataTypeZBOOLAddExternalOutput)Zblobs_with_bool_valuer*ZblobZ bool_valueout_blobr r r BoolNetbs   r/cCs@t|tjrt|}n|}td}||}||||fS)a/Not of a condition blob or net Args: condition_blob_or_net can be either blob or net. If condition_blob_or_net is Net, the condition is its last external_output that must be a single bool. returns not_net: the net NOT the input out_blob: the output blob of the not_net not_net)rrrr)ZNotr-)condition_blob_or_netcondition_blobr0r.r r r NotNets     r3cCs&td}||}||||fS)zMake a condition net that copies the condition_blob Args: condition_blob is a single bool. returns not_net: the net NOT the input out_blob: the output blob of the not_net Zcopy_condition_blob_net)rrZCopyr-)r2r(r.r r r _CopyConditionBlobNets   r4c Cst|ts|St|dkr*|r&|dSdSt|}tt|D]}||}|j|jksdt|j |j ksxt|j |j |j |j t ||}|dkr|}n||||g}t||jD]\}} |j|| 7<qq@|||S)a Merge multi condition nets into a single condition nets. Args: name: name of the new condition net. condition_nets: a list of condition nets. The last external_output of each condition net must be single bool value. relation: can be 'And' or 'Or'. Returns: - A new condition net. Its last external output is relation of all condition_nets. rrN)rrr rrranger$Z device_optionr%typeopextendZexternal_inputr) __getattr__rZ _attr_dictr-) r&condition_netsrelationZ merged_netiZ net_proto curr_cond last_condkvr r r MergeConditionNetss&      rAc Cs|sdSt|tstdt|dkrBt|d}t|\}}|St|}tt|D]0}t||}|dkrv|} qX| || |g} qX| | |S)a Combine conditions of multi nets into a single condition nets. Unlike MergeConditionNets, the actual body of condition_nets is not copied into the combine condition net. One example is about multi readers. Each reader net has a reader_done condition. When we want to check whether all readers are done, we can use this function to build a new net. Args: name: name of the new condition net. condition_nets: a list of condition nets. The last external_output of each condition net must be single bool value. relation: can be 'And' or 'Or'. Returns: - A new condition net. Its last external output is relation of all condition_nets. Nz&condition_nets must be a list of nets.rr) rrrr r)r4rrr5r9r-) r&r:r;r2r(_Z combined_netr<r=r>r r r CombineConditionss$       rCcGsBt|}t|dkr,t|dtjr,|dSttd||SdS)z Execute the sequence of nets or steps once. Examples: - Do('myDo', net1, net2, ..., net_n) - Do('myDo', list_of_nets) - Do('myDo', step1, step2, ..., step_n) - Do('myDo', list_of_steps) rrrNrr rrZ ExecutionStepscoped_execution_stepr r&rr r r rs rcGsFt|}t|dkr,t|dtjr,|dStjtd||ddSdS)a Execute the nets or steps in parallel, waiting for all of them to finish Examples: - DoParallel('pDo', net1, net2, ..., net_n) - DoParallel('pDo', list_of_nets) - DoParallel('pDo', step1, step2, ..., step_n) - DoParallel('pDo', list_of_steps) rr DoParallelT)Zconcurrent_substepsNrDrFr r r rGs rGcstt|\}t|tjr&t||n t|fdd}trhtdf}td||dS|dSdS)a Execute nets_or_steps once if condition_blob_or_net evaluates as true. If condition_blob_or_net is Net, the condition is its last external_output that must be a single bool. And this net will be executed before nets_or_steps so as to get the condition. cstjt|ddS)NTshould_stop_blobZ only_oncerrEr rr&r stop_blobr r if_step7s z_RunOnceIf..if_stepFz /_RunOnceIfz_RunOnceIf-inner _RunOnceIfNr3rrrr rr/r)r&r1rcondition_not_netrNr*r rLr rO(s     rOcCsNt|tjr t|}t||}nt|\}}t||}tjtd|||ddS)zq Similar to _RunOnceIf() but Execute nets_or_steps once if condition_blob_or_net evaluates as false. _RunOnceIfNotTrH)rrrr)r r4rEr )r&r1rr2Zcopy_netr r r rRGs    rRcCsdtd}|jg|d}td}||g}tjtd|t|||d}t|dt|d||S)a Execute nets_or_steps iter_num times. Args: nets_or_steps: a ExecutionStep or a Net or a list of ExecutionSteps or a list nets. iter_num: the number times to execute the nets_or_steps. Returns: A ExecutionStep instance. zinit-net)Z init_countzFor-iterz For-innerrIz/Forz /For-init-net)rrZ CreateCounterZ CountDownrEr r r)r&rZiter_numZinit_netZiter_cntZiter_netZ iter_doneZfor_stepr r r For[s    rTcstt|\}t|tjr&t||n t|fdd}trhtdf}td||dS|dSdS)aX Execute nets_or_steps when condition_blob_or_net returns true. Args: condition_blob_or_net: If it is an instance of Net, its last external_output must be a single bool. nets_or_steps: a ExecutionStep or a Net or a list of ExecutionSteps or a list nets. Returns: A ExecutionStep instance. cstjt|dS)NrSrJrKrLr r while_steps zWhile..while_stepFz/Whilez While-innerWhileNrP)r&r1rrQrUr*r rLr rVus    rVcCsDt|tjr t|}t||}ntt|}tjtd|||dS)zc Similar to While() but execute nets_or_steps when condition_blob_or_net returns false UntilrS) rrrr)r r'strrEr )r&r1rrMr r r rWs  rWcCs^t|\}}t|tjr&t|||}n t||}t|df}t|d|tjtd|||dS)a Execute nets_or_steps when condition_blob_or_net returns true. It will execute nets_or_steps before evaluating condition_blob_or_net. Args: condition_blob_or_net: if it is an instance of Net, tts last external_output must be a single bool. nets_or_steps: a ExecutionStep or a Net or a list of ExecutionSteps or a list nets. Returns: A ExecutionStep instance. Fz/DoWhilez DoWhile-innerrS) r3rrrr"r/rrEr )r&r1rrQrMr*r r r DoWhiles    rYcCslt|tjs,t|}tjtd|||dSt||}t|}t|df}t |d|tjtd|||dS)a Similar to DoWhile() but execute nets_or_steps when condition_blob_or_net returns false. It will execute nets_or_steps before evaluating condition_blob_or_net. Special case: if condition_blob_or_net is a blob and is pre-set to true, then only the first net/step of nets_or_steps will be executed and loop is exited. So you need to be careful about the initial value the condition blob when using DoUntil(), esp when DoUntil() is called twice. DoUntilrSFz/DoUntilz DoUntil-inner) rrrr'rEr r"r)r/r)r&r1rrMr*r r r rZs    rZcs(t|}ttdfdd|DS)a Execute the steps for which the condition is true. Each condition is a tuple (condition_blob_or_net, nets_or_steps). Note: 1. Multi steps can be executed if their conditions are true. 2. The conditions_blob_or_net (if it is Net) of all steps will be executed once. Examples: - Switch('name', (cond_1, net_1), (cond_2, net_2), ..., (cond_n, net_n)) - Switch('name', [(cond_1, net1), (cond_2, net_2), ..., (cond_n, net_n)]) - Switch('name', (cond_1, net_1)) Switchcs g|]\}}td||qS)z/Switch)rOrZcondstepr&r r szSwitch..rrrEr r&Z conditionsr r^r r[s r[cs(t|}ttdfdd|DS)zU Similar to Switch() but execute the steps for which the condition is False. SwitchNotcs g|]\}}td||qS)z /SwitchNot)rRr\r^r r r_ szSwitchNot..r`rar r^r rbs rbNcCsV|st|d||St|tjr*t|}n|}t|dt|d||t|d||S)a condition_blob_or_net is first evaluated or executed. If the condition is true, true_nets_or_steps is then executed, otherwise, false_nets_or_steps is executed. If condition_blob_or_net is Net, the condition is its last external_output that must be a single bool. And this Net will be executred before both true/false_nets_or_steps so as to get the condition. z/Ifz/If-truez /If-false)rOrrrr)rrRr&r1Ztrue_nets_or_stepsZfalse_nets_or_stepsr2r r r Ifs   rdcCsV|st|d||St|tjr*t|}n|}t|dt|d||t|d||S)zy If condition_blob_or_net returns false, executes true_nets_or_steps, otherwise executes false_nets_or_steps z/IfNotz /IfNot-truez /IfNot-false)rRrrrr)rrOrcr r r IfNot+s   re)N)N) __doc__Z caffe2.pythonrZ future.utilsrrsetrr rrr r"r)r/r3r4rArCrrGrOrRrTrVrWrYrZr[rbrdrer r r r s<      ),(!!