U 襡c'@sddlZddlZddlZddlZddlZddlZddlZddlZddl Z ddl m Z m Z m Z mZmZmZmZmZejejdddZdaddZddZejd d d ZdS) N)ObjectIDObjectNotAvailable PlasmaBuffer PlasmaClientconnectPlasmaObjectExistsPlasmaObjectNotFoundPlasmaStoreFull tensorflow plasma_op.socCsddl}|tadS)Nr)r load_op_libraryTF_PLASMA_OP_PATH tf_plasma_op)tfr2/tmp/pip-unpacked-wheel-qoi2rb4q/pyarrow/plasma.pyload_plasma_tensorflow_op/src Cs.zddl}td|jWntk r.YnXtdtjtjt}tj |dd}tj |dd}|j }t j dkrdd g|}d d d d |d|ddtg }|ddtD7}|ddddg7}||7}||j 7}|dg7}|jr|dg7}tdt|t||tadS)NrzTensorFlow version: z!Compiling Plasma TensorFlow Op...r z plasma_op.ccr darwinz -undefinedZdynamic_lookupzg++z -std=c++17z-gz-sharedz-oz-DNDEBUGz-IcSsg|] }d|qS)z-Lr).0dirrrr Fsz.build_plasma_tensorflow_op..z-lplasmaz-larrow_pythonz-larrowz-fPICz-O2z -DGOOGLE_CUDAzRunning command )r print __version__ ImportErrorospathdirnamerealpath__file__join sysconfigZget_compile_flagssysplatformpaZ get_includeZget_library_dirsZget_link_flagstestZis_built_with_cudastr subprocess check_callr r r)rZdir_pathZcc_pathZso_pathZ tf_cflagscmdrrrbuild_plasma_tensorflow_op5s8         r)Fc cstdt|r|rtdtjdd}z6t j |d}t j t jdd} t j | slt j tjd d} | d |d t|g} |r| d |g7} |r| d g7} |dk r| d|g7} d} d} |rddddddg| } tj| | | d}tdnH|rddg| } tj| | | d}tdntj| | | d}td|} | dk rTtd| f||fVW5|dkrx|t |XdS)a DEPRECATED: Start a plasma store process. .. deprecated:: 10.0.0 Plasma is deprecated since Arrow 10.0.0. It will be removed in 12.0.0 or so. Parameters ---------- plasma_store_memory : int Capacity of the plasma store in bytes. use_valgrind : bool True if the plasma store should be started inside of valgrind. If this is True, use_profiler must be False. use_profiler : bool True if the plasma store should be started inside a profiler. If this is True, use_valgrind must be False. plasma_directory : str Directory where plasma memory mapped files will be stored. use_hugepages : bool True if the plasma store should use huge pages. external_store : str External store to use for evicted objects. Returns ------- result : (str, subprocess.Popen) A tuple of the name of the plasma store socket and the process ID of the plasma store process. zLPlasma is deprecated since Arrow 10.0.0. It will be removed in 12.0.0 or so.z2Cannot use valgrind and profiler at the same time.z test_plasma-)prefixNz plasma.sockrzplasma-store-serverbinz-sz-mz-dz-hz-eZvalgrindz--track-origins=yesz--leak-check=fullz--show-leak-kinds=allz!--leak-check-heuristics=stdstringz--error-exitcode=1)stdoutstderrg?z--tool=callgrindg?z-plasma_store exited unexpectedly with code %d)warningswarnDeprecationWarning Exceptiontempfilemkdtemppollkillshutilrmtreerrrr#__path__existsr!r*r%r&Popentimesleep RuntimeError)Zplasma_store_memoryZ use_valgrindZ use_profilerZplasma_directoryZ use_hugepagesZexternal_storeZtmpdirprocZplasma_store_nameZplasma_store_executablecommandZ stdout_fileZ stderr_filercrrrstart_plasma_storeRs#          rA)FFNFN) contextlibrZpyarrowr#r6r&r!r2r;r.Zpyarrow._plasmarrrrrrrr rrr8r rrr)contextmanagerrArrrrs((