U <c} @sUddlZddlmZmZmZddlmZeeZ edZ Gdddee Z e dZ de d <e d Zde d <e d Zd e d<e dZd e d<e dZde d<e dZde d<e dZde d<e dZde d<e dZde d<e dZde d<eegdfdddd Zeegdfddd!d"Zeeegdfddd#d$Zeeegdfddd%d&Zeegdfddd'd(Zeegdfddd)d*Zeegdfddd+d,Zegdfddd-d.Zeegdfddd/d0Z eegdfddd1d2Z!dS)3N)CallableGenericList) ParamSpecPc@sHeZdZedddZeedfddddZejej ddd d Z dS) CallbackRegistry)namecCs||_g|_dSN)r callback_list)selfrr ;/tmp/pip-unpacked-wheel-gikjz4vx/torch/utils/_cuda_trace.py__init__ szCallbackRegistry.__init__NcbreturncCs|j|dSr )r append)r rr r r add_callbackszCallbackRegistry.add_callback)argskwargsrc OsV|jD]J}z|||Wqtk rN}ztd|jdW5d}~XYqXqdS)NzException in callback for z registered with CUDA trace)r Exceptionlogger exceptionr)r rrrer r r fire_callbackss  zCallbackRegistry.fire_callbacks) __name__ __module__ __qualname__strrrrrrrrr r r r r srzCUDA event creationzCallbackRegistry[int]CUDAEventCreationCallbackszCUDA event deletionCUDAEventDeletionCallbackszCUDA event recordzCallbackRegistry[int, int]CUDAEventRecordCallbackszCUDA event waitCUDAEventWaitCallbackszCUDA memory allocationCUDAMemoryAllocationCallbackszCUDA memory deallocationCUDAMemoryDeallocationCallbackszCUDA stream creationCUDAStreamCreationCallbackszCUDA device synchronizationzCallbackRegistry[[]]"CUDADeviceSynchronizationCallbackszCUDA stream synchronization"CUDAStreamSynchronizationCallbackszCUDA event synchronization!CUDAEventSynchronizationCallbacksrcCst|dSr )rrrr r r )register_callback_for_cuda_event_creation<sr*cCst|dSr )r rr)r r r )register_callback_for_cuda_event_deletion@sr+cCst|dSr )r!rr)r r r 'register_callback_for_cuda_event_recordDsr,cCst|dSr )r"rr)r r r %register_callback_for_cuda_event_waitHsr-cCst|dSr )r#rr)r r r ,register_callback_for_cuda_memory_allocationLsr.cCst|dSr )r$rr)r r r .register_callback_for_cuda_memory_deallocationPsr/cCst|dSr )r%rr)r r r *register_callback_for_cuda_stream_creationTsr0cCst|dSr )r&rr)r r r 1register_callback_for_cuda_device_synchronizationXsr1cCst|dSr )r'rr)r r r 1register_callback_for_cuda_stream_synchronization\sr2cCst|dSr )r(rr)r r r 0register_callback_for_cuda_event_synchronizationbsr3)"loggingtypingrrrZtyping_extensionsr getLoggerrrrrr__annotations__r r!r"r#r$r%r&r'r(intr*r+r,r-r.r/r0r1r2r3r r r r s`