U KcC @s,ddlZddlZddlZddlmZddddddd d d d d ddg ZddZGdddeZGdddeZ GdddeZ GdddZ ej j jej j jej j jdZdeZd!edeej j fej j dddZdd Zeddd Zdd ZedddZejd"eedd dZe Ze ZdS)#N)Unionis_builtcuFFTPlanCacheAttrContextPropcuFFTPlanCachecuFFTPlanCacheManager cuBLASModulepreferred_linalg_librarycufft_plan_cachematmulenable_flash_sdpflash_sdp_enabledmath_sdp_enabledenable_math_sdp sdp_kernelcCstjjS)zReturns whether PyTorch is built with CUDA support. Note that this doesn't necessarily mean CUDA is available; just that if this PyTorch binary were run a machine with working CUDA drivers and devices, we would be able to use it.)torch_CZhas_cudarr@/tmp/pip-unpacked-wheel-gikjz4vx/torch/backends/cuda/__init__.pyr sc@s$eZdZddZddZddZdS)rcCs||_||_dSN)gettersetter)selfrrrrr__init__sz&cuFFTPlanCacheAttrContextProp.__init__cCs ||jSr)r device_index)robjZobjtyperrr__get__sz%cuFFTPlanCacheAttrContextProp.__get__cCs(t|jtrt|j||j|dSr) isinstancerstr RuntimeErrorr)rrvalrrr__set__s  z%cuFFTPlanCacheAttrContextProp.__set__N)__name__ __module__ __qualname__rrr rrrrrsc@s:eZdZdZddZeejdZeej ej Z ddZ dS)rz Represents a specific plan cache for a specific `device_index`. The attributes `size` and `max_size`, and method `clear`, can fetch and/ or change properties of the C++ cuFFT plan cache. cCs ||_dSr)r)rrrrrr)szcuFFTPlanCache.__init__z.size is a read-only property showing the number of plans currently in the cache. To change the cache capacity, set cufft_plan_cache.max_size.cCs t|jSr)rZ_cufft_clear_plan_cacherrrrrclear4szcuFFTPlanCache.clearN) r!r"r#__doc__rrrZ_cufft_get_plan_cache_sizesizeZ_cufft_get_plan_cache_max_sizeZ_cufft_set_plan_cache_max_sizemax_sizer%rrrrr#scs<eZdZdZdZddZddZddZfd d ZZ S) raL Represents all cuFFT plan caches. When indexed with a device object/index, this object returns the `cuFFTPlanCache` corresponding to that device. Finally, this object, when used directly as a `cuFFTPlanCache` object (e.g., setting the `.max_size`) attribute, the current device's cuFFT plan cache is used. FcCsg|_d|_dS)NT)caches#_cuFFTPlanCacheManager__initializedr$rrrrDszcuFFTPlanCacheManager.__init__cCsrtjj|}|dks$|tjkr:tdtj|t|jdkrh|j ddt tjD|j|S)NrzOcufft_plan_cache: expected 0 <= device index < {}, but got device with index {}css|]}t|VqdSr)r).0indexrrr Osz4cuFFTPlanCacheManager.__getitem__..) rcuda_utilsZ_get_device_indexZ device_countrformatlenr)extendrange)rZdevicer,rrr __getitem__Hs z!cuFFTPlanCacheManager.__getitem__cCst|tj|Sr)getattrrr.current_devicernamerrr __getattr__Rsz!cuFFTPlanCacheManager.__getattr__cs2|jrt|tj||Stt|||SdSr)r*setattrrr.r6superr __setattr__rr8value __class__rrr<Usz!cuFFTPlanCacheManager.__setattr__) r!r"r#r&r*rr4r9r< __classcell__rrr?rr8s   c@seZdZddZddZdS)rcCs4|dkrtjS|dkr$tjStd|dSNZ allow_tf32Z&allow_fp16_reduced_precision_reductionzUnknown attribute )rrZ_get_cublas_allow_tf32Z2_get_cublas_allow_fp16_reduced_precision_reductionAssertionErrorr7rrrr9]s   zcuBLASModule.__getattr__cCs8|dkrtj|S|dkr(tj|Std|dSrB)rrZ_set_cublas_allow_tf32Z2_set_cublas_allow_fp16_reduced_precision_reductionrCr=rrrr<ds   zcuBLASModule.__setattr__N)r!r"r#r9r<rrrrr\s)defaultZcusolverZmagmaz, )backendreturncCsl|dkr nXt|tr>|tkr,tdtdtjt|n$t|tjjrZtj|ntdtj S)a .. warning:: This flag is experimental and subject to change. When PyTorch runs a CUDA linear algebra operation it often uses the cuSOLVER or MAGMA libraries, and if both are available it decides which to use with a heuristic. This flag (a :class:`str`) allows overriding those heuristics. * If `"cusolver"` is set then cuSOLVER will be used wherever possible. * If `"magma"` is set then MAGMA will be used wherever possible. * If `"default"` (the default) is set then heuristics will be used to pick between cuSOLVER and MAGMA if both are available. * When no input is given, this function returns the currently preferred library. Note: When a library is preferred other libraries may still be used if the preferred library doesn't implement the operation(s) called. This flag may achieve better performance if PyTorch's heuristic library selection is incorrect for your application's inputs. Currently supported linalg operators: * :func:`torch.linalg.inv` * :func:`torch.linalg.inv_ex` * :func:`torch.linalg.cholesky` * :func:`torch.linalg.cholesky_ex` * :func:`torch.cholesky_solve` * :func:`torch.cholesky_inverse` * :func:`torch.linalg.lu_factor` * :func:`torch.linalg.lu` * :func:`torch.linalg.lu_solve` * :func:`torch.linalg.qr` * :func:`torch.linalg.eigh` * :func:`torch.linalg.eighvals` * :func:`torch.linalg.svd` * :func:`torch.linalg.svdvals` Nz"Unknown input value. Choose from: .zUnknown input value type.) rr_LinalgBackendsr_LinalgBackends_strrrZ_set_linalg_preferred_backend_LinalgBackendZ_get_linalg_preferred_backend)rErrrrrs% cCs tjS)zy .. warning:: This flag is experimental and subject to change. Returns whether flash sdp is enabled or not. )rrZ_get_flash_sdp_enabledrrrrr sZenabledcCstj|dS)zk .. warning:: This flag is experimental and subject to change. Enables or disables flash sdp. N)rrZ_set_sdp_use_flashrKrrrr scCs tjS)zx .. warning:: This flag is experimental and subject to change. Returns whether math sdp is enabled or not. )rrZ_get_math_sdp_enabledrrrrr scCstj|dS)zj .. warning:: This flag is experimental and subject to change. Enables or disables math sdp. N)rrZ_set_sdp_use_mathrKrrrrsT) enable_flash enable_mathc csjt}t}zFzt|t|iVWn&tk rN}z|W5d}~XYnXW5t|t|XdS)z .. warning:: This flag is experimental and subject to change. This context manager can be used to temporarily enable or disable flash sdp and math sdp. Upon exiting the context manager, the previous state of the flags will be restored. N)r r r rr)rLrMZprevious_flashZ previous_matherrrrrrs )N)TT) sysr contextlibtypingr__all__robjectrrrrrrJZDefaultZCusolverZMagmarHjoinkeysrIrrr boolr r rcontextmanagerrr r rrrrsB $$4