U Vc #@sjddlZddlmZddlmZddlmZddlm Z ddl m Z ddl m Z dZGd d d e jZdS) N)wrappers) plugin_util)provider) http_util) base_plugin)metadatadc@sveZdZdZejZddZej j ddZ ddZ ej j dd Z d d Zd d ZddZddZddZddZdS)PrCurvesPluginz6A plugin that serves PR curves for individual classes.cCs2|j|_|jpitjt|_tj ddd|_ dS)zInstantiates a PrCurvesPlugin. Args: context: A base_plugin.TBContext instance. A magic container that TensorBoard uses to make objects available to the plugin. zPR curver)Z data_kindZlatest_known_versionN) Z data_provider_data_providerZsampling_hintsgetr PLUGIN_NAME_DEFAULT_DOWNSAMPLING_downsample_torZ_MetadataVersionChecker_version_checker)selfcontextrQ/tmp/pip-unpacked-wheel-g8kmtpbc/tensorboard/plugins/pr_curve/pr_curves_plugin.py__init__"s zPrCurvesPlugin.__init__c Cst|j}t|j}|jd}|s6t|ddS|jd}|sTt|ddSzt|| ||||d}Wn:t k r}zt|t |ddWYSd}~XYnX|S) aA route that returns a JSON mapping between runs and PR curve data. Returns: Given a tag and a comma-separated list of runs (both stored within GET parameters), fetches a JSON object that maps between run name and objects containing data required for PR curves for that run. Runs that either cannot be found or that lack tags will be excluded from the response. runz,No runs provided when fetching PR curve dataitagz+No tag provided when fetching PR curve dataapplication/jsonz text/plainN) rrenviron experiment_idargsgetlistrRespondr pr_curves_impl ValueErrorstr)rrequestctx experimentrunsrresponseerrrpr_curves_route2s2    *zPrCurvesPlugin.pr_curves_routec szi}t||g}jj||tj|jd}|D]D}||i|} | dkr^td||ffdd| D||<q0|S)a}Creates the JSON object for the PR curves response for a run-tag combo. Arguments: runs: A list of runs to fetch the curves for. tag: The tag to fetch the curves for. Raises: ValueError: If no PR curves could be fetched for a run and tag. Returns: The JSON object for the PR curves route response. )r plugin_nameZrun_tag_filterZ downsampleNz1No PR curves could be found for run %r and tag %rcsg|]}|qSr)_process_datum).0drrr tsz1PrCurvesPlugin.pr_curves_impl..) rZ RunTagFilterr Z read_tensorsrr rr r) rr!r"r#rZresponse_mappingZrtfZ read_resultrdatarr+rrVs&zPrCurvesPlugin.pr_curves_implcCs.t|j}t|j}t||||dS)aA route (HTTP handler) that returns a response with tags. Returns: A response that contains a JSON object. The keys of the object are all the runs. Each run is mapped to a (potentially empty) dictionary whose keys are tags associated with run and whose values are metadata (dictionaries). The metadata dictionaries contain 2 keys: - displayName: For the display name used atop visualizations in TensorBoard. - description: The description that appears near visualizations upon the user hovering over a certain icon. r)rrrrrr tags_impl)rr r!r"rrr tags_routews   zPrCurvesPlugin.tags_routec Cs|jj||tjd}dd|D}|D]V\}}|D]D\}}t|j} |j| j ||sbq:|j t |j d|||<q:q*|S)zCreates the JSON object for the tags route response. Returns: The JSON object for the tags route response. )rr'cSsi|] }|iqSrr)r)rrrr sz,PrCurvesPlugin.tags_impl..)Z displayName description)r Z list_tensorsrr itemsZparse_plugin_metadataZplugin_contentrokversionZ display_namerZmarkdown_to_safe_htmlr1) rr!r"mappingresultrZtag_to_time_seriesrZ time_seriesZmdrrrr.s" zPrCurvesPlugin.tags_implcCs|j|jdS)zGets all routes offered by the plugin. Returns: A dictionary mapping URL path to route that handles it. )z/tagsz /pr_curves)r/r&r+rrrget_plugin_appsszPrCurvesPlugin.get_plugin_appscCsdS)NFrr+rrr is_activeszPrCurvesPlugin.is_activecCstjdddS)Nztf-pr-curve-dashboardz PR Curves)Z element_nameZtab_name)rZFrontendMetadatar+rrrfrontend_metadatasz PrCurvesPlugin.frontend_metadatacCs||j|j|jS)zConverts a TensorDatum into a dict that encapsulates information on it. Args: datum: The TensorDatum to convert. Returns: A JSON-able dictionary of PR curve data for 1 step. )_make_pr_entrystep wall_timenumpy)rZdatumrrrr(s zPrCurvesPlugin._process_datumc Cs4tj}tj}tj}tj}|||gddftjdd}t|d} | dkrd|| dkrd| d8} qF| d} |j d} t dd| } dd||D} d d||D}d d||D}d d||D}|||tj d| f |tjd| f | d| |d| |d| |d| | d|  d S) a$Creates an entry for PR curve data. Each entry corresponds to 1 step. Args: step: The step. wall_time: The wall time. data_array: A numpy array of PR curve data stored in the summary format. Returns: A PR curve entry. Nr)Zaxisgg?cSsg|] }t|qSrintr)vrrrr,sz1PrCurvesPlugin._make_pr_entry..cSsg|] }t|qSrr?rArrrr,scSsg|] }t|qSrr?rArrrr,scSsg|] }t|qSrr?rArrrr,s) r<r;Z precisionZrecalltrue_positivesfalse_positivestrue_negativesfalse_negatives thresholds)rZTRUE_POSITIVES_INDEXZFALSE_POSITIVES_INDEXZTRUE_NEGATIVES_INDEXZFALSE_NEGATIVES_INDEXZastyper@sumlenshapenpZlinspaceZPRECISION_INDEXtolistZ RECALL_INDEX)rr;r<Z data_arrayZtp_indexZfp_indexZtn_indexZfn_indexZ positivesZend_index_inclusiveZ end_indexZnum_thresholdsrGrCrDrErFrrrr:s: "        zPrCurvesPlugin._make_pr_entryN)__name__ __module__ __qualname____doc__rr r'rrRequestZ applicationr&rr/r.r7r8r9r(r:rrrrr s #!   r )r=rKZwerkzeugrZ tensorboardrZtensorboard.datarZtensorboard.backendrZtensorboard.pluginsrZtensorboard.plugins.pr_curverr ZTBPluginr rrrrs