Uh`8UddlmZmZddlmZ ddlmZmZmZm Z ddlm Z dZ dedd ided d ided ddidedd idZ eeeeeefeffed<ee dZ dZgdZy#e$rdZ GddZdZ dZdZ Y$wxYw))DictUnion)is_torchdynamo_compiling)DeviceLayerRepositoryregister_kernel_mappingreplace_kernel_forward_from_hub)use_kernel_forward_from_hubTcudaz!kernels-community/deformable-detrMultiScaleDeformableAttention)repo_id layer_namezkernels-community/moe Llama4TextMoez#kernels-community/triton-layer-norm LlamaRMSNormzpure-layer-test)rrrevisionzmedmekk/triton-llama-mlpTritonLlamaMLP)r rRMSNormMLP_KERNEL_MAPPINGcfd}|S)a5 Expands `kernels`' `use_kernel_forward_from_hub` to NOT use a kernel at compile time. This should be removed when `kernels` supports `torch.compile`. If the layer has a `config` attribute, we can also set `config.disable_custom_kernels = True` to disable the kernel. cjti}|jfd}|_S)Nctdxrtjdd}ts|r|i|S|i|S)Nconfigdisable_custom_kernels)hasattrgetattrrr) forward_argsforward_kwargsrclskernel_forwardoriginal_forwards w/var/www/catia.catastroantioquia-mas.com/valormas/lib/python3.12/site-packages/transformers/integrations/hub_kernels.pyforward_with_compile_pathzcuse_kernel_forward_from_hub..decorator_with_compile_path..forward_with_compile_pathSsM)0h)?)wGCJJXprvDw&+-1G+\L^LL)<J>JJ)forward$original_use_kernel_forward_from_hub)r decoratorr$r!r"argskwargss` @@r#decorator_with_compile_pathz@use_kernel_forward_from_hub..decorator_with_compile_pathHsF"{{ =dMfMIC.C![[N K4CKJr%)r)r*r+s`` r#r r ?s ,+*r%c d}|S)Nc|SNr,)r s r#r(z.use_kernel_forward_from_hub..decoratoresJr%r,)r)r*r(s r#r r ds r%ceZdZdZy)rctd)NzNLayerRepository requires `kernels` to be installed. Run `pip install kernels`. RuntimeError)selfr)r*s r#__init__zLayerRepository.__init__ksop pr%N)__name__ __module__ __qualname__r5r,r%r#rrjs qr%rctd)Nz^replace_kernel_forward_from_hub requires `kernels` to be installed. Run `pip install kernels`.r2r)r*s r#r r ns l  r%ctd)NzVregister_kernel_mapping requires `kernels` to be installed. Run `pip install kernels`.r2r:s r#r r sssttr%FctSr/)_hub_kernels_availabler,r%r#is_hub_kernels_availabler>ys !!r%)rr>r r r N)typingrrutilsrkernelsrrr r r r'r=rstr__annotations__ ImportErrorr>__all__r,r%r#rFs ,c# " O;:*  O/*  O=)*  O2+ +MOT#tE&#+$6$GHHI:O,+t" 9# qq u#+#sA#A<<BB