U VcA;@s&dZddlZddlZddlZddlmZddlmZddlmZddlm Z ddl m Z dd d d d Z ej D]Zee krlee e<qlee Zd dgZddgeZeeZeddddgZeddddgZdZd.ddZddZd/d d!Zd"d#Zd$d%Zd&d'Zd(d)Zd0d*d+Z d1d,d-Z!dS)2a" Logic for TensorBoard inspector to help humans investigate event files. Example usages: tensorboard --inspect --event_file myevents.out tensorboard --inspect --event_file myevents.out --tag loss tensorboard --inspect --logdir mylogdir tensorboard --inspect --logdir mylogdir --tag loss This script runs over a logdir and creates an InspectionUnit for every subdirectory with event files. If running over an event file, it creates only one InspectionUnit. One block of output is printed to console for each InspectionUnit. The primary content of an InspectionUnit is the dict field_to_obs that maps fields (e.g. "scalar", "histogram", "session_log:start", etc.) to a list of Observations for the field. Observations correspond one-to-one with Events in an event file but contain less information because they only store what is necessary to generate the final console output. The final output is rendered to console by applying some aggregating function to the lists of Observations. Different functions are applied depending on the type of field. For instance, for "scalar" fields, the inspector shows aggregate statistics. For other fields like "session_log:start", all observed steps are printed in order to aid debugging. [1] Query a logdir or an event file for its logged tags and summary statistics using --logdir or --event_file. [[event_file]] contains these tags: histograms binary/Sign/Activations binary/nn_tanh/act/Activations binary/nn_tanh/biases binary/nn_tanh/biases:gradient binary/nn_tanh/weights binary/nn_tanh/weights:gradient images input_images/image/0 input_images/image/1 input_images/image/2 scalars Learning Rate Total Cost Total Cost (raw) Debug output aggregated over all tags: graph first_step 0 last_step 0 max_step 0 min_step 0 num_steps 1 outoforder_steps [] histograms first_step 491 last_step 659823 max_step 659823 min_step 491 num_steps 993 outoforder_steps [] images - scalars first_step 0 last_step 659823 max_step 659823 min_step 0 num_steps 1985 outoforder_steps [] sessionlog:checkpoint first_step 7129 last_step 657167 max_step 657167 min_step 7129 num_steps 99 outoforder_steps [] sessionlog:start outoforder_steps [] steps [0L] sessionlog:stop - [2] Drill down into a particular tag using --tag. Debug output for binary/Sign/Activations: histograms first_step 491 last_step 659823 max_step 659823 min_step 491 num_steps 993 outoforder_steps [] N)event_accumulator)event_file_loader) io_wrapper)tf) event_pb2ZscalarsZ histogramsZimagesaudio)Z simple_valueZhistoimagersessionlog:startsessionlog:stopgraphsessionlog:checkpoint Observationstep wall_timetagInspectionUnitname generator field_to_obszG====================================================================== csd fdd }tddtD|D]}|dr@|s@|d||dr|s|jj}|tjjkrn|d |q|tjjkr|d |q|tjj kr|d |q$|d r$|j j D]>}|r|j |krqt D] \}}||r||||j qqq$S)aEReturn a field to `Observations` dict for the event generator. Args: generator: A generator over event protos. query_for_tag: A string that if specified, only create observations for events with this tag name. Returns: A dict mapping keys in `TRACKED_FIELDS` to an `Observation` list. rcs0|tks t|t|j|j|ddS)N)rrr)TRACKED_FIELDSAssertionErrorappendr rr_asdict)stateventrr]/tmp/pip-unpacked-wheel-g8kmtpbc/tensorboard/backend/event_processing/event_file_inspector.py increments z0get_field_to_observations_map..incrementcSsg|] }|gfqSrr).0trrr sz1get_field_to_observations_map..Z graph_defr session_logr r r summary)r)dictrZHasFieldr#statusrZ SessionLogSTARTSTOP CHECKPOINTr$valuerSUMMARY_TYPE_TO_FIELDitems)rZ query_for_tagrrr&r*Z proto_nameZ display_namerrrget_field_to_observations_maps*           r-cCsdd|DS)aReturns a dictionary of tags that a user could query over. Args: field_to_obs: Dict that maps string field to `Observation` list. Returns: A dict that maps keys in `TAG_FIELDS` to a list of string tags present in the event files. If the dict does not have any observations of the type, maps to an empty list so that we can render this to console. cSs0i|](\}}|tkr|ttdd|DqS)cSsg|]}|ddqS)rr)getr xrrrr"sz.get_unique_tags...) TAG_FIELDSsortedset)r field observationsrrr sz#get_unique_tags..)r,rrrrget_unique_tagss r7TcCst|D]\}}|s,|r,td|q t|trXt||D]}td|qBq t|tr t|t|D]\}}td||qvq dS)zPrints a shallow dict to console. Args: d: Dict to print. show_missing: Whether to show keys with empty values. z{} -z {}z {:<20} {}N)r2r,printformat isinstancelistr%)d show_missingkvitemkkvvrrr print_dicts  rCcCsndd}dd}i}|D]L\}}|s2d||<qdd|D}|tkrT||||<|tkr||||<q|S)zTransform the field-to-obs mapping into a printable dictionary. Args: field_to_obs: Dict that maps string field to `Observation` list. Returns: A dict with the keys and values to print to console. cSs.tt|t|t||d|dt|dS)Nr)Z num_stepsZmin_stepZmax_stepZ last_stepZ first_stepoutoforder_steps)lenr3minmaxget_out_of_orderstepsrrrcompressed_steps s z+get_dict_to_print..compressed_stepscSs|t|dS)N)rKrE)rIrJrrr full_stepssz%get_dict_to_print..full_stepsNcSsg|] }|dqS)rrr/rrrr"sz%get_dict_to_print..)r, SHORT_FIELDS LONG_FIELDS)rrLrMoutputr4r5rKrrrget_dict_to_prints   rQcCsRg}tt|D]<}|dkrq||||dkr|||d||fq|S)aReturns elements that break the monotonically non-decreasing trend. This is used to find instances of global step values that are "out-of-order", which may trigger TensorBoard event discarding logic. Args: list_of_numbers: A list of numbers. Returns: A list of tuples in which each tuple are two elements are adjacent, but the second element is lower than the first. r)rangerFr)Zlist_of_numbersresultirrrrI%srIcCst|}dd|D}|S)aReturns a list of event generators for subdirectories with event files. The number of generators returned should equal the number of directories within logdir that contain event files. If only logdir contains event files, returns a list of length one. Args: logdir: A log directory that contains event files. Returns: List of event generators for each subdirectory with event files. cs.g|]&tjfddtjjDqS)cs2g|]*}ttj|rttj|qSrrIsTensorFlowEventsFileospathjoingenerator_from_event_filer fsubdirrrr"Nsz5generators_from_logdir...) itertoolschainriogfilelistdir)r rr^rr"Ls   z*generators_from_logdir..)rGetLogdirSubdirectories)logdirsubdirs generatorsrrrgenerators_from_logdir>s  ricCst|S)z:Returns a generator that yields events from an event file.)rZLegacyEventFileLoaderLoad) event_filerrrr[Ysr[c s|rt|}g}|D]@tjfddtjjD}|t |t ||dq|r|t d d dd|Dn(t|rt d |nt d ||S|rt|}t ||t ||dgSgS) aReturns a list of InspectionUnit objects given either logdir or event_file. If logdir is given, the number of InspectionUnits should equal the number of directories or subdirectories that contain event files. If event_file is given, the number of InspectionUnits should be 1. Args: logdir: A log directory that contains event files. event_file: Or, a particular event file path. tag: An optional tag name to query for. Returns: A list of InspectionUnit objects. cs2g|]*}ttj|rttj|qSrrVr\r^rrr"ts  z(get_inspection_units..)rrrzFound event files in: {}  cSsg|] }|jqSr)r)r urrrr"szIt seems that {} may be an event file instead of a logdir. If this is the case, use --event_file instead of --logdir to pass it in.z%No event files found within logdir {})rrer`rarrbrcrdrrr-r8r9rZrWr[)rfrkrrginspection_unitsrrr^rget_inspection_units^sN     rocCsttdtt|||}|D]n}|rsL`           - & @