U VcOa@sPdZddlZddlmZdZdZdZddZd d Zd d Z Gd dde Z dS)zCA wrapper around DebugDataReader used for retrieving tfdbg v2 data.N)errorsZ__default_debugger_run__ics6tfdd}tj|dd}||fS)aRun a target task repeatedly in the background. In the context of this module, `target` is the `update()` method of the underlying reader for tfdbg2-format data. This method is mocked by unit tests for deterministic behaviors during testing. Args: target: The target task to run in the background, a callable with no args. interval_sec: Time interval between repeats, in seconds. Returns: - A `threading.Event` object that can be used to interrupt an ongoing waiting interval between successive runs of `target`. To interrupt the interval, call the `set()` method of the object. - The `threading.Thread` object on which `target` is run repeatedly. csqdSN)waitclearevent interval_sectargetrZ/tmp/pip-unpacked-wheel-g8kmtpbc/tensorboard/plugins/debugger_v2/debug_data_multiplexer.py_run_repeatedly<s z5run_repeatedly_in_background.._run_repeatedlyT)r daemon) threadingEventThreadstart)r r r threadrrr run_repeatedly_in_background(s rc CsTddlm}t||jr@d|j|j|j|j|j|j |j |j d St dt |dS)Nrdebug_events_monitors InfNanAlert) alert_typeop_type output_slotsize num_neg_inf num_pos_infnum_nanexecution_indexgraph_execution_trace_indexzUnrecognized alert subtype: %s)tensorflow.python.debug.libr isinstancerrrrrrrrr TypeErrortype)alertrrrr _alert_to_jsonHs  r&cCs0d}d|kr$|d\}}t|}n|}||fS)z@Helper function that extracts op name and slot from tensor name.r:)splitint)Z tensor_namerop_namerrr parse_tensor_name_s  r+c@seZdZdZddZddZddZdd Zd d Zd d Z ddZ d)ddZ ddZ ddZ d*ddZd+ddZddZddZdd Zd!d"Zd#d$Zd%d&Zd'd(ZdS),DebuggerV2EventMultiplexeraA class used for accessing tfdbg v2 DebugEvent data on local filesystem. This class is a short-term hack, mirroring the EventMultiplexer for the main TensorBoard plugins (e.g., scalar, histogram and graphs.) As such, it only implements the methods relevant to the Debugger V2 pluggin. TODO(cais): Integrate it with EventMultiplexer and use the integrated class from MultiplexerDataProvider for a single path of accessing debugger and non-debugger data. cCs(||_d|_t|_d|_|dS)zConstructor for the `DebugEventMultiplexer`. Args: logdir: Path to the directory to load the tfdbg v2 data from. N)_logdir_readerrLock _reader_lock_reload_needed_event_tryCreateReader)selfZlogdirrrr __init__vs  z#DebuggerV2EventMultiplexer.__init__c Cs|jr dS|j|jszddlm}ddlm}Wn tk rTYW5QRdSXz||j|_Wn>tk rYW5QRdSt k rYW5QRdSX|j |jt dg|_ t |jjt\|_}W5QRXdS)a*Try creating reader for tfdbg2 data in the logdir. If the reader has already been created, a new one will not be created and this function is a no-op. If a reader has not been created, create it and start periodic calls to `update()` on a separate thread. Nr)debug_events_readerr)limit)r.r0r!r5r ImportErrorZDebugDataReaderr-AttributeError ValueError InfNanMonitorDEFAULT_PER_TYPE_ALERT_LIMIT _monitorsrupdateDEFAULT_RELOAD_INTERVAL_SECr1)r3r5r_rrr r2s4   z+DebuggerV2EventMultiplexer._tryCreateReadercCs|jr|jdS)a(If a reader exists and has started period updating, unblock the update. The updates are performed periodically with a sleep interval between successive calls to the reader's update() method. Calling this method interrupts the sleep immediately if one is ongoing. N)r1setr3rrr _reloadReadersz(DebuggerV2EventMultiplexer._reloadReadercCs4|jdkrtd|tkr*tdt|f|jS)aWReturn the timestamp of the first DebugEvent of the given run. This may perform I/O if no events have been loaded yet for the run. Args: run: A string name of the run for which the timestamp is retrieved. This currently must be hardcoded as `DEFAULT_DEBUGGER_RUN_NAME`, as each logdir contains at most one DebugEvent file set (i.e., a run of a tfdbg2-instrumented TensorFlow program.) Returns: The wall_time of the first event of the run, which will be in seconds since the epoch as a `float`. NzNo tfdbg2 runs exists.z&Expected run name to be %s, but got %s)r.r9DEFAULT_DEBUGGER_RUN_NAMEZstarting_wall_time)r3runrrr FirstEventTimestamps z.DebuggerV2EventMultiplexer.FirstEventTimestampcCs tddS)NzLDebugDataMultiplexer.PluginRunToTagToContent() has not been implemented yet.)NotImplementedError)r3Z plugin_namerrr PluginRunToTagToContentsz2DebuggerV2EventMultiplexer.PluginRunToTagToContentcCs*||jr"|tdgiiSiSdS)aReturn all the tfdbg2 run names in the logdir watched by this instance. The `Run()` method of this class is specialized for the tfdbg2-format DebugEvent files. As a side effect, this method unblocks the underlying reader's period reloading if a reader exists. This lets the reader update at a higher frequency than the default one with 30-second sleeping period between reloading when data is being queried actively from this instance. Note that this `Runs()` method is used by all other public data-access methods of this class (e.g., `ExecutionData()`, `GraphExecutionData()`). Hence calls to those methods will lead to accelerated data reloading of the reader. Returns: If tfdbg2-format data exists in the `logdir` of this object, returns: ``` {runName: { "debugger-v2": [tag1, tag2, tag3] } } ``` where `runName` is the hard-coded string `DEFAULT_DEBUGGER_RUN_NAME` string. This is related to the fact that tfdbg2 currently contains at most one DebugEvent file set per directory. If no tfdbg2-format data exists in the `logdir`, an empty `dict`. z debugger-v2N)r2r.rBrCrArrr RunsszDebuggerV2EventMultiplexer.RunscCsb|dkrtd|||kr0td||f|dkrR||krRtd||f|dkr^|}|S)NrzInvalid begin index (%d)z!end index (%d) out of bounds (%d)z9end index (%d) is unexpectedly less than begin index (%d))rInvalidArgumentError)r3beginendZ total_countrrr _checkBeginEndIndices s" z0DebuggerV2EventMultiplexer._checkBeginEndIndicesNc Csddlm}|}||kr dSg}t}t} |jD]F} | } | sHq6|| t| |jrdd} nd} t | || <| | | <q6t |} |dk r||krt d|| |}| ||t |}|||| |t dd|||Dd S) aGet alerts from the debugged TensorFlow program. Args: run: The tfdbg2 run to get Alerts from. begin: Beginning alert index. end: Ending alert index. alert_type_filter: Optional filter string for alert type, used to restrict retrieved alerts data to a single type. If used, `begin` and `end` refer to the beginning and ending indices within the filtered alert type. rrNrZ__MiscellaneousAlert__z8Filtering of alerts failed: alert type %s does not existcSsg|] }t|qSr)r&).0r%rrr Nsz5DebuggerV2EventMultiplexer.Alerts..)rJrKr num_alertsalerts_breakdownZper_type_alert_limitalerts)r!rrHdictr<rQextendr"r:lenrrIrLr;)r3rDrJrKZalert_type_filterrrunsrQrPZalerts_by_typeZmonitorZmonitor_alertsrrOrrr AlertssF      z!DebuggerV2EventMultiplexer.AlertscCsX|}||krdS|jjdd}|||t|}||t|dd|||DdS)a>Get ExecutionDigests. Args: run: The tfdbg2 run to get `ExecutionDigest`s from. begin: Beginning execution index. end: Ending execution index. Returns: A JSON-serializable object containing the `ExecutionDigest`s and related meta-information NTdigestcSsg|] }|qSrto_jsonrMrXrrr rNhsz?DebuggerV2EventMultiplexer.ExecutionDigests..)rJrK num_digestsexecution_digestsrHr. executionsrLrT)r3rDrJrKrUr]rrr ExecutionDigestsQs  z+DebuggerV2EventMultiplexer.ExecutionDigestscCsh|}||krdS|jjdd}|||t|}|||}|jjd||d}||dd|DdS) a`Get Execution data objects (Detailed, non-digest form). Args: run: The tfdbg2 run to get `ExecutionDigest`s from. begin: Beginning execution index. end: Ending execution index. Returns: A JSON-serializable object containing the `ExecutionDigest`s and related meta-information NTrWFrXrJrKcSsg|] }|qSrrY)rMZ executionrrr rNsz.)rJrKr_r^)r3rDrJrKrUr]r_rrr ExecutionDatams   z(DebuggerV2EventMultiplexer.ExecutionDatacCsh|}||krdS|dk r$td|jjdd}|||t|}||t|dd|||DdS)a`Get `GraphExecutionTraceDigest`s. Args: run: The tfdbg2 run to get `GraphExecutionTraceDigest`s from. begin: Beginning graph-execution index. end: Ending graph-execution index. Returns: A JSON-serializable object containing the `ExecutionDigest`s and related meta-information NzFtrace_id support for GraphExecutionTraceDigest is not implemented yet.TrWcSsg|] }|qSrrYr[rrr rNszDDebuggerV2EventMultiplexer.GraphExecutionDigests..)rJrKr\Zgraph_execution_digestsrHrFr.Zgraph_execution_tracesrLrT)r3rDrJrKtrace_idrUZgraph_exec_digestsrrr GraphExecutionDigestss  z0DebuggerV2EventMultiplexer.GraphExecutionDigestscCsl|}||krdS|dk r$td|jjdd}|||t|}|jjd||d}||dd|Dd S) aTGet `GraphExecutionTrace`s. Args: run: The tfdbg2 run to get `GraphExecutionTrace`s from. begin: Beginning graph-execution index. end: Ending graph-execution index. Returns: A JSON-serializable object containing the `ExecutionDigest`s and related meta-information NzDtrace_id support for GraphExecutionTraceData is not implemented yet.TrWFracSsg|] }|qSrrY)rMZ graph_execrrr rNszADebuggerV2EventMultiplexer.GraphExecutionData..)rJrKgraph_executionsrc)r3rDrJrKrdrUdigestsrfrrr GraphExecutionDatas( z-DebuggerV2EventMultiplexer.GraphExecutionDatacCsP|}||krdSz|j|}Wn"tk rFtd|YnX|S)aGet the information regarding a TensorFlow graph. Args: run: Name of the run. graph_id: Debugger-generated ID of the graph in question. This information is available in the return values of `GraphOpInfo`, `GraphExecution`, etc. Returns: A JSON-serializable object containing the information regarding the TensorFlow graph. Raises: NotFoundError if the graph_id is not known to the debugger. NThere is no graph with ID "%s")rHr. graph_by_idKeyErrorr NotFoundErrorrZ)r3rDgraph_idrUgraphrrr GraphInfos z$DebuggerV2EventMultiplexer.GraphInfoc Cs6|}||krdSz|j|}Wn"tk rFtd|YnXz||}Wn&tk r|td||fYnX|||}|dD]D}z||d} Wntk rd} YnX| r|| ||d<q|dD]P} | D]F} z|| d} Wntk rd} YnX| r|| || d<qq|S)abGet the information regarding a graph op's creation. Args: run: Name of the run. graph_id: Debugger-generated ID of the graph that contains the op in question. This ID is available from other methods of this class, e.g., the return value of `GraphExecutionDigests()`. op_name: Name of the op. Returns: A JSON-serializable object containing the information regarding the op's creation and its immediate inputs and consumers. Raises: NotFoundError if the graph_id or op_name does not exist. Nriz/There is no op named "%s" in graph with ID "%s"inputsr*data consumers)rHr.rjrkrrlZget_op_creation_digest_opCreationDigestToDataObject) r3rDrmr*rUrnop_creation_digestZ data_objectZ input_specZinput_op_digestZslot_consumer_specsZ consumer_specrXrrr GraphOpInfos^        z&DebuggerV2EventMultiplexer.GraphOpInfoc Cs|dkr dS|}|d=||j|d<|j|d<|d=g|d<|jpJgD]$}t|\}}|d||dqLg|d<t|dD]}|dgq||dD]"\}} } |d|| | d q|S) Nrm graph_ids num_outputs input_namesrp)r*rrrr*)r*Z input_slot) rZ_getGraphStackIdsrmrwrxr+appendrangeZget_op_consumers) r3rtrnZ json_objectZinput_tensor_nameZ input_op_namerr?Zsrc_slotZconsumer_op_nameZdst_slotrrr rs$s2   z8DebuggerV2EventMultiplexer._opCreationDigestToDataObjectcCs:|g}|j|}|jr6|d|j|j|j}q|S)aLRetrieve the IDs of all outer graphs of a graph. Args: graph_id: Id of the graph being queried with respect to its outer graphs context. Returns: A list of graph_ids, ordered from outermost to innermost, including the input `graph_id` argument as the last item. r)r.rjZouter_graph_idinsert)r3rmrvrnrrr ryAs  z,DebuggerV2EventMultiplexer._getGraphStackIdscCs|}||krdS|jSr)rHr.source_file_list)r3rDrUrrr SourceFileListSsz)DebuggerV2EventMultiplexer.SourceFileListcCsd|}||krdSz|j|\}}Wn"tk rLtd|YnX|||j||dS)Nz(There is no source-code file at index %d) host_name file_pathlines)rHr.r} IndexErrorrrlZ source_lines)r3rDindexrUrrrrr SourceLinesYs  z&DebuggerV2EventMultiplexer.SourceLinescCsV|}||krdSg}|D]0}||jjkr:td|||jj|qd|iS)Nz"Cannot find stack frame with ID %s stack_frames)rHr.Z_stack_frame_by_idrrlrz)r3rDZstack_frame_idsrUrZstack_frame_idrrr StackFramesis z&DebuggerV2EventMultiplexer.StackFrames)N)N)N)__name__ __module__ __qualname____doc__r4r2rBrErGrHrLrVr`rbrerhrorursryr~rrrrrr r,js( 2 + 5 ! #?r,) rrZ tensorboardrrCr;r>rr&r+objectr,rrrr s