vh xUddlmZddlmZmZmZddlZddlZddlm Z m Z ddl Z ddl m Z ddlmZddlmZddlmZdd lmZdd lmZmZmZmZmZmZmZmZmZdd lmZdd l m!Z!m"Z"m#Z#m$Z$m%Z%m&Z'dd lm(Z(e(jRe*e!Z+dHdZ,dIdZ-dJdZ.dKdZ/ej` dLdZ1dZ2ej` dLdZ3dZ4ej`dZ5GddZ6ejnjpejnjrfZ:dMdZ;ejnjpejnjxfZ=ejnjrejnj|fZ? dNdZ@ dO dPdZAdZBejdZD dQdZE dRdZFej dSd ZG dTd!ZHejdUd"ZIe d#$ dO dVd%ZJdWd&ZKd'ZLeMZNd(d(d)d*ZO dXd+ZPej`d,ZQd-ZRejnjrZS dYd.ZT dZd/ZUd0ZVd[d1ZWd2ZXd\d3ZYd4d4dddd5 d]d6ZZd^d7Z[ d_d8Z\e jd9Z^d`d:Z_ dad;Z`d<ZaGd=d>Zbdbd?ZcedZed@efdA<dcdBZgdddCZhGdDdEeiZj dedFZkdfdGZly)g) annotations)CallableIterableSequenceN)partial lru_cache)Any)core)config)dtypes) AbstractRef) PyTreeDef tree_flattentree_unflattentree_maptreedef_childrengenerate_key_pathsbroadcast_prefix prefix_errors_replace_nones) linear_util)safe_map WrapKwArgsHashableHashableFunction Unhashablesafe_zip)traceback_utilctjd|d} tj|S#t$r&t t tj|cYSwxYw)z2Ensure x is either an index or a tuple of indices.N/expected a static index or sequence of indices.r concrete_or_erroroperatorindex TypeErrortuplemapxs L/opt/face_recognition/venv/lib/python3.12/site-packages/jax/_src/api_util.py _ensure_indexr+)sP T1&WX!) >>!  ) X^^Q' (()s.,AActjd|d} tj|fS#t$r&t t tj|cYSwxYw)z Convert x to a tuple of indices.Nr r!r(s r*_ensure_index_tupler-1sS T1&WX!) NN1   ) X^^Q' (()s/,AAcBt|tstd||S)Nzargument is not a string: ) isinstancestrr%r(s r* _ensure_strr19s$ As  04 55 (cZt|tr|fSttt|S)z Convert x to a tuple of strings.)r/r0r&r'r1r(s r*_ensure_str_tupler4>s%3 4K [!$ %%r2crt||\}}||i|}t|\}}|j||SNrrstore)fr8in_tree args_flatpy_args py_kwargsansout_trees r* flatten_funr@EsC&gy9'9 7 i #s#-#x++h *r2cz|\}}t|if\}}||k7rtd|d|||}t||SNz Expected z, got rr%rfunio_treer<in_tree_expectedr?argsr:r>s r*apply_flat_funrINsX&H}--$   i 01yA BB T # # &&r2cft||}||}t|\}}|j||Sr6r7)r9r8r:r;r<r>r?s r*flatten_fun_nokwargsrKVs8 7I .' 7 #s#-#x++h *r2cv|\}}t|\}}||k7rtd|d|||}t||SrBrCrDs r*apply_flat_fun_nokwargsrM_sT&Hw'-$   i 01yA BB T # # &&r2ct||}||}t|ttfrt |dk7rt dt |d||\}}t|\}} t|\} } |j| | f|| fS)NzNexpected function with aux output to return a two-element tuple, but got type z with value ) rr/listr&lenr%typerr8) r9r8r:r;r<pairr>auxans_flatans_treeaux_flataux_trees r*flatten_fun_nokwargs2rYgs 7I .' G$ D4- (CIN ++/:,l4(L MM (#s#C((H#C((H++x"# 8 r2c(eZdZdZdgZdZdZdZy)_HashableWithStrictTypeEqualityz|Box object used when comparing static arguments as a jit key. Requires exact type equality using `is` and value equality.valc||_yr6r\selfr\s r*__init__z(_HashableWithStrictTypeEquality.__init__z DHr2c,t|jSr6)hashr\r`s r*__hash__z(_HashableWithStrictTypeEquality.__hash__}s >r2ct|jt|juxr|j|jk(Sr6)rRr\r`others r*__eq__z&_HashableWithStrictTypeEquality.__eq__s/ >T%))_ , FUYY1FFr2N)__name__ __module__ __qualname____doc__ __slots__rarfrjr2r*r[r[ts!Ag)Gr2r[c 0d}|jjD]B}|jtvr|dz }|jtj j usBy|r3t| |kDst||k\rtd|d|d|dyy)z Validate that the argnums are sensible for a given function. For functions that accept a variable number of positions arguments (`f(..., *args)`) all positive argnums are considered valid. rNzJitted function has =z, but only accepts z positional arguments.) parametersvalueskind_POSITIONAL_ARGUMENTSinspect ParameterVAR_POSITIONALminmax ValueError)sigargnums argnums_name n_pos_argsparams r*_validate_argnumsrs*~~$$& e zz**Aoj w((77 7   3w<-*,G 0J +L>7)D))3 4JL MM1KWr2cd}t}t}|jjD]v\}}|jtvr|j |*|jt jjurd}S|jtvsf|j |x|t|zx}rtd|d|d|ryt||z x}rtd|d|dy)z Validate that the argnames are sensible for a given function. For functions that accept a variable keyword arguments (`f(..., **kwargs)`) all argnames are considered valid except those marked as position-only (`f(pos_only, /, ...)`). FTz%Jitted function has invalid argnames z in z. These are positional-onlyNz$. Function does not take these args.) setrtitemsrv_KEYWORD_ARGUMENTSaddrxry VAR_KEYWORD_INVALID_KEYWORD_ARGUMENTSr}) r~argnames argnames_name var_kwargs valid_kwargsinvalid_kwargs param_namerinvalid_argnamess r*_validate_argnamesrs*5, U.>>//1%j% zz''z" w((44 4j 1 1$%)3x=899 <=Mz"argnums_partial..0q470) r-_ensure_inboundsrQ enumerate is_hashabler}rRrkappendr[rr&_argnums_partial)r9 dyn_argnumsrHrequire_static_args_hashable fixed_argsrargdyn_argss ` r*argnums_partialrs#K0+ D ;?+!JD/>3 k 8   BBCJCyk |3D FG G7<=>1:$+fak)S/+J+ 0K0 0( ![% *; .s&N3z#&Ns)_prepend_static_argsr&)r9 static_argss r*prepend_static_argsrs a&N+&N!N OOr2c@td|D}||z}||i|S)Nc34K|]}|jywr6r^rs r*rz'_prepend_static_args..s5#cgg5s)r&)r9rrHkwargsall_argss r*rrs,555+ 4 ( H  r2cg}|D]>}||k\r|r | |cxkr|ksntd|d|d|j||z@t|S)z?Ensure argnum is within bounds. Also resolves negative argnums.zPositional argument indices, e.g. for `static_argnums`, must have value greater than or equal to -len(args) and less than len(args), but got value z for len(args) == .)r}rr&) allow_invalidnum_argsrresultrs r*rrsu &  aH} 9 $H $  #/z < == MM!h,  vr2c s|fSt|ttfdttD}tfd|D}g}t D]e}|r|tk\r|}t |s(t d|dt|d|jd|jt|gt||t||fS)zIVersion of ``argnums_partial`` that checks hashability of static_argnums.c3,K|] }|vs| ywr6rp)rrstatic_argnumss r*rz)argnums_partial_except..sMAQn5LaMs c3(K|] }| ywr6rprs r*rz)argnums_partial_except..rrrrrr) rrQr&rangesortedrr}rRrkrr[r) r9rrHrrrrr static_args `` r*argnums_partial_exceptrs  d7N#M3t9nM.Ms4y!1MM+ 0K0 0(* . ! Eac$iaJ z "  @@As* *  nQZZL8I K LL 7 CD E ![% *; >)*+ --/2K4H4H4JK-So%f jj&S^^+,- sr2c|s|stt|Stt|}tt|}dx}x}}g}|t|krz|t|kr||||k(rt d|d|d|t|kr||||kr |dz }|dz }n|j |||z |dz }|t|krzt|S)aEShifts donate to account for static. >>> rebase_donate_argnums((3, 4), (0, 1)) (1, 2) Args: donate_argnums: An iterable of ints. static_argnums: An iterable of ints. Returns: A tuple of unique, sorted integer values based on donate_argnums with each element offset to account for static_argnums. rz`static_argnums` z and `donate_argnums` z cannot intersect.rr)r&rrrQr}r)rrrjoouts r*rebase_donate_argnumsrZs  N ' ((#n-..#n-..-!-a! # C 3~ >!#4q8I#I *>*:;++9*::LN OO 3~ >!#4~a7H#H1fa1fa jj"Q&'1fa C  sr2c: t|y#t$rYywxYw)NTF)rdr%)rs r*rr}s#I   s  F)r tupled_argsc  t}t|tg|jz}g fd} t |t ||| D cgc] } | |urdn|  c} t |jk(sJ S#t $r~|rt|\}}|\}}d} |rM| d|dz } t|jdk(r( t|||f| d|dz } n#t $rYnwxYwt |d|d |d | dwxYwcc} w) NcXj|gtt|dzSNr)rrQr)rr)axess r*zflatten_axes..s%DKKc,q/!2D.E(EFr2z Note that za that are non-trivial pytrees should always be wrapped in a tuple representing the argument list.rrzE In particular, you're passing in a single argument which means that z/ might need to be wrapped in a singleton tuple.zS specification must be a tree prefix of the corresponding value, got specification z for value tree r) rrSENTINELrrrr}rrQr flatten_axes) nametreedef axis_treerrproxydummy add_leaves_hintars @r*rrsn (% 8*w/A/A"A B% $F*C Zy95A..2 2!u*$! # 2$ Tg(( (( ( +1 C $G,jgqli D TF#DEFd W    A % * tWyl 3 !!%'() *$    v??HkJ''.iq8 9>BC'C, 3s6A; D;ADC D C'$D&C''Dct|\}}t|t||\}}|t|t||ffS)N)closure)r_flat_out_axesr&r)r9out_specleavesrout_axess r* flat_out_axesrsD!*/&'q%-9+!X Xf w/G H HHr2c||i|}t||} tt||d}|j ||S#t$r4t ||^} } | dj \} | dz } t| dwxYw)Nc |duSr6rpr(s r*rz _flat_out_axes..s AIr2)is_leafz pmap out_axesz The full pytree is the output of the pmapped function. Ensure that the `out_axes` argument to `pmap` is a pytree prefix of the pmapped function's output.)rr&rr}rrHr8) r_store_leaves_treedefrHrr>spec spec_flatermsgs r*rrs df# ' *$ $&tS:MNOI ,,y * $ $ $EA _  " "DC )*C S/t#$s A=A>ct|trtd|t|std|t j |rtd|y)Nz.staticmethod arguments are not supported, got zExpected a callable value, got z/Expected a function, got a generator function: )r/ staticmethodr%callablerxisgeneratorfunctionrEs r*check_callablersa\" DSEJ KK # 5cU; <<   % EcUK LL&r2cXyttfS|j}>Jttfdt |j DfSttfdt |j DfS)z?Infer missing argnums and argnames for a function with inspect.)rprpc3\K|]#\}\}}|jtk(r|vr|%ywr6rv_POSITIONAL_OR_KEYWORD)rrrrrs r*rz-infer_argnums_and_argnames..s4a!U ::/ /AM ),c3\K|]#\}\}}|jtk(r|vr|%ywr6r)rrrrrs r*rz-infer_argnums_and_argnames..s4a!U ::/ /AL r)r-r4rtr&rr)r~rrrts `` r*infer_argnums_and_argnamesrs  _)  X1!'*G *H H ~~* _    *H()9)9);<G (  "'*G()9)9);<H ( r2ct|E|dn t|}|dn t|}|dn t|}|td|d|Jd}nTt|||\}}t|||\}}t ||dt ||dt ||dt ||dt ||t||}||||fS)aValidates and completes the argnum/argname specification for a jit. * fills in any missing pieces (e.g., names given numbers, or vice versa), * validates the argument names/numbers against the function signature, * validates that donated and static arguments don't intersect. * rebases the donated arguments so they index into the dynamic arguments, (after static arguments have been removed), in the order that parameters are passed into the compiled function. rpz"Getting the signature of function z8 failed. Pass donate_argnums instead of donate_argnames.rrrr)r-r4r}rrr_assert_no_intersectionr)rE signaturerrrrs r*resolve_argnumsrs"*1R7J8N+3b9J:O)1R7J8N" ;C5AII JJ  "" "O 'A>?'4#NO&@>?'4#NOi1ABy/3DEi1ABy/3DE/?;(H. ./ IIr2clt|jt|}|rtd|dy)NzEstatic_argnames and donate_argnames cannot intersect. Argument names z3 appear in both static_argnames and donate_argnames)r intersectionr})rrrs r*rr'sD O))#o*>?# O %B D EE r2cFt|trd}tj|j|i|}|j |j r=|j Dcgc] }||vs| }}|rtddj||jScc}w)zResolve input arguments to positional following a function's signature. This will raise a TypeError if any keyword-only arguments were passed by the caller. cyr6rp)rHrs r*rz resolve_kwargs..7sr2zDThe following keyword arguments could not be resolved to positions: z, ) r/rrxrbindapply_defaultsrr%joinrH)rErHrbar passed_kwargss r*resolve_kwargsr)/s W &C"w""D3F3"YY " 91Q&[Q9M9  P YY} % & (  . :s # B-Bc tj|S#t$r"tjt|dcYSwxYw)Ndtype)r result_typer}getattrr(s r*_dtyper.Ds?3   a  3   ga1 223s(AAc|Sr6rp)rEtags r*api_hookr1Ms *r2rp)rrresult_paths_thunk sourceinforc| t|}| t|}t|||||} tj||| |S)aConstructd core.DebugInfo for a function given example args and kwargs. `args` and `kwargs` are example positional and keyword arguments, users with `inspect.Signature` to get the names of arguments. The arguments that are considered static for tracing purposes should be included, and designated using `static_argnums` and `static_argnames`. See docstring for linear_util.DebugInfo. )fun_sourceinfo fun_signature_non_static_arg_namesr DebugInfo) traced_forrErHrrrr2r3r arg_namess r* debug_infor;QsO,$Jc"I#ItV^$35)  J ;M NNr2cX tj|S#ttf$rYywxYwr6)rxrr}r%rs r*r6r6ps/   S !! i  s ))ct|tjr |j}nt |r t |}nJ|t |d|y)N__fun_sourceinfo__)r/r r8 func_src_inforr5setattr)wrapperwrappedr?s r*save_wrapped_fun_sourceinforCvsF())M"7+M'5 ''7r2z(?:)ct|dd}||St|tr|j}t|trt j |} |j j}|j j}|jd|d|S#t$rO} t|}n #YYd}~yxYwtj|x}r|jdcYd}~SYd}~yd}~wwxYw)Nr>z at :z rr)r-r/rfuncrxunwrap__code__ co_filenameco_firstlinenorkAttributeErrorr0 _fun_name_rematchgroup)rErfilenamelinenor fun_strms r*r5r5s)40#_Sj3 ((C 3 s#||''H \\ ( (Fll^4z6( 33  Cg    w ''q' WWQZ  s6?B C- B+*C(+B3-C(3*C(C-(C-c ttdt||}t|}t |Dcgc] \}}||vrn|} }}|j D cic]\} }| | |vrn|} } }d} | |j | i| } td|jj Dd}| jj Dcgc]\}}||vr ||k7r||f}}}td| j Dd}|Dcgc]\}}|| jvr|n|d|d|f!}}}||z} | Dd | fg}t| j Dcgc]\}}|us d |d|fc}}d }||z} tfd | DScc}}wcc}} wcc}}wcc}}w#ttf$rYwxYwcc}}w) aReturns the names of the non-static arguments. If the `fn_signature` is given then we get from it the names of the top-level arguments. In other cases, including when the `args` and `kwargs` do not match the signature, we use names like `args[0[]`, `args[1]`, etc. TNc3tK|]0\}}|jtjjk(r|2ywr6)rvrxryr)rrps r*rz(_non_static_arg_names..s5F74VVw'8'8'D'DDFs68c3*K|] \}}||f ywr6rp)rrr)s r*rz(_non_static_arg_names..sGGD!tQiGsc |dSrrpname_xs r*rz'_non_static_arg_names..s r2)rz['z']rHzkwargs['c |dSrrprXs r*rz'_non_static_arg_names..s q r2c3K|]7\}}t|D]$\}}|ur|tj|&9ywr6)rlu_clean_keystr_arg_names)rrr)pathlstatics r*rz(_non_static_arg_names..sXH403H4q22489:H:Hs=A)rrrQrrrr$rrt argumentsrr}r%r&) fn_signaturerHrrrstatic_argnums_static_argnames_rr)args_rkwargs_ ordered_argsr' kwargs_namer positional sorted_kwargskeywordr`s @r*r7r7s+ 8&$T3t9nE/)=Ft_ MTQQ/)6q 0 M% MCI<<> R41aQ!//Q 6 R' R37,0 <  e /w /b Fl.E.E.K.K.MFGKMk.0\\-?-?-AC'$6)dk.A1ICjCGw}}G":F8F,$F2% G 2 G 8G  G cggg}}}t|D]S\}}t|tvr|jt |2|j||j|Ut |t |t ||fSr6)rrR_class_with_attrsr_HashableByObjectIdrr&)r9 flat_argsidxsobjs flat_args_rr)s r*hoist_obj_attrsrss}r2j$ "da Aw## kk%a() kk!n  !U4[%+ 6 BBr2c$eZdZdgZdZdZdZy)rnr\c||_yr6r^r_s r*raz_HashableByObjectId.__init__rbr2c,t|jSr6)idr\res r*rfz_HashableByObjectId.__hash__s dhh<r2c2|j|juSr6r^rhs r*rjz_HashableByObjectId.__eq__s 88uyy  r2N)rkrlrmrorarfrjrpr2r*rnrnsg)!r2rnc.tj|yr6)rmr)ts r*register_class_with_attrsr{sr2z set[type]rmctjjsJi}tt ||D]\}\}}t |t s|jttj||x}|k7sNt|rSd|jd|jd|jd|j|d|j|d dd|d|dy) Nzconly one reference to a mutable array may be passed as an argument to a function, but when tracing  for z% the mutable array reference of type z appeared at both z and rzat both flat index z and flat index )r mutable_array_checksvaluerrr/r setdefaultrwr get_referentr}r?r9 str_shortr:)dbgavalsrHrefsrrr)dup_idxs r*_check_no_aliased_ref_argsrs  $ $ * ** *$S-. Fia!Q1k"OOBt'8'8';$>BRS//0{{}o=O == ! "% a(8'9 < < BF F gY&6qc:  < BF F Fr2c*tjjsJ|Dchc]C}tt j |t rtt j|E}}t|D]\}}tt j||vs't j|}t|rOd|jd|jd|jd|jt!||dycc}w)Nz when tracing r}z$, a mutable array reference of type z1 was both closed over and passed as the argument zat flat index {i})r r~rr/r get_avalr rwrrshaped_abstractifyr}r?r9rsafe_arg_namesrQ)rconstsrHcrrr)rs r*"_check_no_aliased_closed_over_refsrs  $ $ * ** *6<B!$--"2K@t((+,B$BoQda $  A 4'  ! !! $a 47 #++,E#..1AB%%&[[]O4$   D *1 - . 0 QQ=P  QQQBsADc*eZdZUded<ded<ddZy)InternalFloatingPointErrorr0rtyc ||_||_yr6)rr)r`rrs r*raz#InternalFloatingPointError.__init__sDIDGr2N)rr0rr0)rkrlrm__annotations__rarpr2r*rrs ) 'r2rcvtd ||i|}t|y#ttf$r}|dd}~wwxYw)NzdInvalid nan value encountered in the output of a jax.jit function. Calling the de-optimized version.)print_raise_no_nan_in_deoptimizedFloatingPointErrorZeroDivisionError)r rErHrre2s r*maybe_recursive_nan_checkr sM 67$ TVA!# / 0 $s!838c6t|d}t|d)Na. Because jax_config.debug_nans.value and/or config.jax_debug_infs is set, the de-optimized function (i.e., the function as if the `jit` decorator were removed) was called in an attempt to get a more precise error message. However, the de-optimized function did not produce invalid values during its execution. This behavior can result from `jit` optimizations causing the invalid value to be produced. It may also arise from having nan/inf literals as inputs or outputs, like `jax.jit(lambda ...: jax.numpy.nan)(...)`. It may be possible to avoid the invalid value by removing the `jit` decorator, at the cost of losing optimizations. If you see this error, consider opening a bug report at https://github.com/jax-ml/jax.)r0r)r rs r*rrs& F8) )# 3T)r2)r)r returnzint | tuple[int, ...])r)r rtuple[int, ...])r)r0rr0)r)zstr | Iterable[str]rtuple[str, ...])r9rr8zlu.Storer:r)r~inspect.Signaturerrrr0rNone)r~rrrrr0rr)T)r9 lu.WrappedFunrzint | Sequence[int]rHr)rrrintr Sequence[int]rr)r9rrrrHtuple[Any, ...]rr)rrrrrr)r9rrrrdict[str, Any])rr)rrrztuple[bool, ...])rr)r9rrr rztuple[lu.WrappedFun, Callable])r~rrzint | Iterable[int] | Nonerstr | Iterable[str] | Nonerz'tuple[tuple[int, ...], tuple[str, ...]])rErrinspect.Signature | Nonerint | Sequence[int] | NonerrrrrrrzItuple[tuple[int, ...], tuple[str, ...], tuple[int, ...], tuple[str, ...]])rErrr)r0r0)r9r0rErrH Sequence[Any]rrrrr Sequence[str]r2z$Callable[[], tuple[str, ...]] | Noner3z str | Nonerrrcore.DebugInfo)rErrr)rArrBzCallable | core.DebugInforr)rErrr0) rbrrHrrrrrrrrr)rzrRrr)rr)rrrr)r  ExceptionrErrr)rr)m __future__rcollections.abcrrrrxr# functoolsrrretypingr jax._srcr r r jax._src.state.typesr jax._src.tree_utilrrrrrrrrrrr\ jax._src.utilrrrrrrrrregister_exclusion__file__r'r+r-r1r4transformation_with_aux2r@rIrKrMrYr[ryPOSITIONAL_ONLYPOSITIONAL_OR_KEYWORDrwrrzr KEYWORD_ONLYrrrrtransformation2rrrrrrrrrrrrrrrrrrrr)r.r1r;r6rCcompilerLr5r7rsrnr{rrmrrrrrrrrpr2r*rs#88( ,###'88#!!!(+)) & "  ' "+  '   G G  ## )) M* ## "" ))   #P #P&5#PFI#P #PNBFG"G,P  ) G!0GDHG2 #0 "*  D$2D*  4 $)98 F 838U$LII #I#I  M!**@@  ')/ @2J 2J'2J/2J0 2J / 2J 0 2JO2JjE*3 %'%'?C!*.OO O O  O " O#O=OO(OO> 8)B 8GK 8rzz:; 00H -0H7E0H*70H,90H / 0HfC!!"u9$ F Q $  $*r2