U d@s\ddlmZmZddlmZmZmZmZGdddeZ GdddeZ Gddde Z d S) )core workspace)ClusterTask TaskGroup WorkspaceTypec@seZdZdZddZdS)CompiledRunnablez? Wrapper for compiled runnable returned from session.compile() cCs||_||_dSN)obj session_class)selfr r r 9/tmp/pip-unpacked-wheel-ua33x9lu/caffe2/python/session.py__init__szCompiledRunnable.__init__N)__name__ __module__ __qualname____doc__rr r r rr src@szeZdZdZiZddZddZedddZdd d Z d d Z d dZ ddZ edddZ ddZddZddZdS)SessionaD Allows to run Nets, ExecutionSteps, Plans, Tasks and TaskGroups. A session can potentially run in multiple nodes concurrently. Example: from core import Net from caffe2.python.task import Task, TaskGroup, WorkspaceType net = Net('test1') net.Add([net.Const(1), net.Const(2)]) net2 = net.Clone() step = core.execution_step('step1', [net2]) with TaskGroup(WorkspaceType.GLOBAL) as init_tg: with Node('node1'): n1setup = net.Net('n1setup') n1msg = n1setup.Const('Hello from node 1.') Task(step=n1setup) with TaskGroup() as private_tg: with Node('node1'): n1 = net.Net('n1') n1.Print(n1msg, 0) Task(step=n1) with Node('node2'): n2 = net.Net('n2') n2.Print(n2.Const('Hello from node 2.'), 0) Task(step=n2) session = LocalSession() session.run(net) session.run(step) session.run(init_tg) session.run(private_tg) Global Workspace: At the beginning of the session, a global workspace is created and kept alive for the duration of the session. Private Workspace: Tasks can be run either directly on the global workspace, or they can instantiate a private child workspace that is released after each run. Blob visibility: Tasks running in different nodes in parallel will always run under different workspaces, so it must be assumed that they won't be able to access each other's blobs. Tasks running on the same node will follow Workspace hierarchy rules: tasks running on separate private workspaces will only be able to share blobs defined on a common parent Workspace. cCs d|_dS)NT_openr r r rrNszSession.__init__cCs|jSr rrr r ris_openQszSession.is_openNcCsxt|tr2||jks.tdd|j|jjf|S||jkrF|j|St|tr|r|r~||kstd||n||_ |}n|dkrt j }t|d}t|t r| |nt|tjr| t |dnt|tjr:t|dkstt|dkr$| t |ddn| t |dntd|}| t |dt||||d }||j|<|S) Nz2Runnable was compiled for different session type. zNeed: %s, got: %szRequire {} but already have {})workspace_type)steprrunnable)r ) isinstancerr AssertionErrorr_compiled_cacherrformatZ_workspace_typerGLOBALraddrZ ExecutionStepPlanlenZStepsZexecution_step_compile_task_group)clsrrsetup_net_listtgrcompiledr r rcompileTsV            zSession.compilecCs:|std|dk s td|||||jdS)aRun the given runnable. Args: runnable: Object recognized by the Session. Currently, we support TaskGroup, Task, Plan, ExecutionStep, and Net. workspace_type: A string defined in the WorkspaceType object. setup_net_list: A list of Net objects or a list of NetDef protos. So far this is only used by the DistributedSession, in which we need to pass a list of special nets to setup the master. zSession is closed.NzGot a none runnable.)rr _run_compiledr*r )r rrr'r r rruns  z Session.runcCs|r|d|_dS)NF)r _do_closerrr r rclosesz Session.closecCs tdSr NotImplementedErrorr outputr r r fetch_outputszSession.fetch_outputcCs tdSr r/)r task_groupr r rr+szSession._run_compiledcCs|Sr r )r&r4r'r r rr%szSession._compile_task_groupcCsdSr r rr r rr-szSession._do_closecCs|jstd|S)NzSession already closed.)rrrr r r __enter__szSession.__enter__cCs|dkr|dSr )r.)r Zex_typevalue tracebackr r r__exit__szSession.__exit__)NN)NN)N)rrrrrrr classmethodr*r,r.r3r+r%r-r5r8r r r rrs7 0  rc@s8eZdZdZd ddZed ddZddZd d ZdS) LocalSessionaQ Session that runs in a single node. Tasks are all remapped to run in parallel in the 'local' node. Currently, LocalSession runs all parallel tasks in the same workspace, but this behavior may change in the future. Only tasks pointing to the same logical node are guaranteed to always run in the same workspace. NcCst||ptjjj|_dSr )rrrC Workspacecurrent_ws)r wsr r rrs zLocalSession.__init__c CsDt|}W5QRXtd}|||||fS)NZtask_group_plan)rZto_taskrr#ZAddStepZget_step output_listr)r&r4r'Ztaskplanr r rr%s  z LocalSession._compile_task_groupc Cs|\}}}g}|D](}|jt||tt|q|j||jd|t j krht j |jn|j}t |||W5QRXdS)N)Z _fetch_func)namesr>Z create_blobstrappendrZ BlobReferenceZ set_values _fetch_outputrZPRIVATErr;r<ZWorkspaceGuardr,)r r)rAr@routputsnameZtask_wsr r rr+s   zLocalSession._run_compiledcCs|jjt|Sr )r>ZblobsrCfetchr1r r rrEszLocalSession._fetch_output)N)N) rrrrrr9r%r+rEr r r rr:s   r:N) Z caffe2.pythonrrZcaffe2.python.taskrrrrobjectrrr:r r r r s