U JcT'@sddlZddlmZddlmZddlmZmZmZddl m Z ddl m Z ddl mZddlmZdd d d gZed d eedddZed d eeddd ZeeegefeeddddZeeeeeedddZed d eeeddd Zed d Gdd d ZdS)N)Queuewraps)CallableDictList) GraphModule) compatibility PassResultinplace_wrapperpass_result_wrapper this_before_that_pass_constraint PassManagerF)Zis_backward_compatible)fnreturncs8dkr dStfdd}|jdkr4t|_|S)a+ Convenience wrapper for passes which modify an object inplace. This wrapper makes them return a PassResult containing the modified object and True for the "modified" flag. Args: fn (Callable[Module, Any]) Returns: wrapped_fn (Callable[Module, PassResult]) Ncs|pt|dSNTr ZgmrF/tmp/pip-unpacked-wheel-gikjz4vx/torch/fx/passes/infra/pass_manager.py wrapped_fnsz#inplace_wrapper..wrapped_fnr)r__name__strrrrrrr s   cs$dkr dStfdd}|S)a+ Wrapper for passes which currently do not return a PassResult. This wrapper makes them return a PassResult containing the modified object and True for the "modified" flag. Args: fn (Callable[Module, Any]) Returns: wrapped_fn (Callable[Module, PassResult]) Ncs|}t|dSrr rrrrr5sz'pass_result_wrapper..wrapped_fnrrrrrr %s ) constraintpassesrcCsnt|D]`\}}t||ddD]B\}}|||r8q$td|d|d|d|d|d|d q$qdS) Nz,pass schedule constraint violated. Expected z before z but found z at index z and z at indexz in pass list.) enumerate RuntimeError)rriajbrrr"_validate_pass_schedule_constraint<s (r$)r constraintsrc sJt|dkr|Sdd|D}dd|Dt}|D]`}|D]@}||krLq>|D],}|||sP||||d7<qPq>|dkr6||q6dd|D}g}|s |} || d|| <|| D]2} || sֈ| d8<| dkr|| qqttfdd } t| dkrFd | } t | |S) z Args passes: Passes that we are ordering constraints: Constraints applied on these passes Returns A sorted list of callables and a boolean of if a circular dependency existed rcSsi|] }|gqSrr.0prrr Ysz,_topological_sort_passes..cSsi|] }|dqS)rrr&rrrr)ZsrcSsi|] }|dqS)Frr&rrrr)isTcs |dkS)Nrr)r(Z indegree_maprrxz*_topological_sort_passes..z:Circular dependency detected within the following passes: ) lenrappendputemptygetlistfilterkeysr) rr%graph candidatesr!r#rvisitedZ sorted_passesr(nZ cycle_passeserrorrr*r_topological_sort_passesIs>         r:)thisthatrcsttdfdd }|S)a Defines a partial order ('depends on' function) where `this` must occur before `that`. For example, the following pass list and constraint list would be invalid. ``` passes = [pass_b, pass_a] constraints = [ this_before_that_pass_constraint(pass_a, pass_b) ] ``` Args: this (Callable): pass which should occur first that (Callable): pass which should occur later Returns: depends_on (Callable[[Object, Object], bool] r!r#cs|kr|krdSdS)NFTrr=r<r;rr depends_onsz4this_before_that_pass_constraint..depends_on)r)r;r<r?rr>rrsc@seZdZUdZgZeeejge fe d<gZ eeeege fe d<dZ e e d<dZee d<de e e d d d Zed d dZedddZddZddZeddddZejddddZeje dddZdS)rad Construct a PassManager. Collects passes and constraints. This defines the pass schedule, manages pass constraints and pass execution. Args: passes (Optional[List[Callable]]): List of passes. A pass is a callable which modifies an object and returns a PassResult constraint (Optional[List[Callable]]): List of constraints. A constraint is a callable which takes two passes (A, B) and returns True if A depends on B and False otherwise. See implementation of `this_before_that_pass_constraint` for example. steps (int): Max number of times we run the passes (default = 1). run_checks_after_each_pass (bool): Whether to run checks and linting after each pass suppress_check_failures (bool): Whether to raise errors when running checks rr%F _validatedrstepsN)run_checks_after_each_passsuppress_check_failuresdebugcCs4|r ||_|r||_|r||_||_||_||_dSN)rr%rArBrCrD)selfrr%rArBrCrDrrr__init__s zPassManager.__init__)_passcCs|j|d|_dS)z> Adds a pass into the current list of passes. FN)rr.r@)rFrHrrradd_passs zPassManager.add_pass)rcCs|j|d|_dS)zI Adds a constraint into the current list of constraints. FN)r%r.r@rFrrrradd_constraints zPassManager.add_constraintcCs,|jr dS|jD]}t||jqd|_dS)z Validates that current pass schedule defined by `self.passes` is valid according to all constraints in `self.constraints` NT)r@r%r$rrJrrrvalidate_constraintss  z PassManager.validate_constraintscCst|j|j|_d|_dS)ab Finds a valid traversal order based on the given constraints and orders the passes based on this order. If a circular dependency exists between the constraints and steps = 1, then we will raise an error because if steps != 1 this means that we will re-run the passes, allowing for circular dependencies. TN)r:rr%r@)rFrrrsolve_constraintss zPassManager.solve_constraints)checkrcCs8t|}tt|jdkr(tdt|d|dS)z Adds a function which takes runs various checks on a given graph module. This function is run before and after each pass if the `run_checks_after_each_pass` flag is enabled. rzEPassManager check function should only take in one variable, a modulerNN)inspect signaturer-r2 parametersvalues TypeErrorsetattr)rFrNsigrrr add_checkss zPassManager.add_checks)modulercCsdSrEr)rFrWrrrrNszPassManager.checkc Cs|js|||d}t|jD]}d}t|jD]\}}|jrXtd|j dz ||}WnZt k r}z sz(PassManager.__call__..Nz$An error occurred when running the 'z#' pass after the following passes: )r@rMrNrangerArrrDprintr ExceptiontypeZ graph_modulemodified isinstancerZ recompilerBr ) rFrWZoverall_modified_r^r rreseZprev_pass_namesmsgrrr__call__s2       zPassManager.__call__)NNNFFF)r __module__ __qualname____doc__rrrnnModuler __annotations__r%boolr@rAintrGrIrKrLrMrVrNrdrrrrrs.       )rOqueuer functoolsrtypingrrrZtorch.nnrhZtorch.fx.graph_modulerZtorch.fx._compatibilityr Ztorch.fx.passes.infra.pass_baser __all__r r rkr$r:rrrrrrs0         6