Q i(dZddlZddlmZmZmZmZmZmZddl m Z ddl m Z mZmZddlmZddlmZmZmZddlmZdd lmZdd lmZeeZGd d Zd eeefdedefdZ ded eeefdeeeffdZ!dS)z RedisVL Schema Validation Module This module provides utilities for validating data against RedisVL schemas using dynamically generated Pydantic models. N)AnyDictListOptionalTypeUnion)parse) BaseModelFieldfield_validator) IndexSchema) BaseField FieldTypesVectorDataType) StorageType) TypeInferrer) get_loggerceZdZUdZiZeeeefe d<e de deefdZ e de dedeefdZe de deefd Zd S) SchemaModelGeneratorz Generates and caches Pydantic models based on Redis schema definitions. This class handles the conversion of RedisVL IndexSchema objects into Pydantic models with appropriate field types and validators. _model_cacheschemareturnctttj|d}||jvr|||j|<|j|S)z Get or create a Pydantic model for a schema. Args: schema: The IndexSchema to convert to a Pydantic model Returns: A Pydantic model class that can validate data against the schema T) sort_keys)strhashjsondumpsto_dictencoder _create_model)clsr cache_keys C:\Users\Dell Inspiron 16\Desktop\tws\AgrotaPowerBi\back-agrota-powerbi\mcp-client-agrota\venv\Lib\site-packages\redisvl/schema/validation.pyget_model_for_schemaz)SchemaModelGenerator.get_model_for_schema!suTZ(8(8DIIIPPRRSSTT C, , ,*-*;*;F*C*CC Y ' **field storage_typec|jtjkrtS|jtjkrtS|jtjkrt ttfS|jtj krtS|jtj kr_|tj krH|j jtjtjfvrt$tSt$tSt&St)d|j)a? Map Redis field types to appropriate Pydantic types. Args: field: The Redis field definition storage_type: The storage type (HASH or JSON) Returns: The Pydantic field type Raises: ValueError: If the field type is not supported zUnsupported field type: )typerTEXTrTAGNUMERICrintfloatGEOVECTORrJSONattrsdatatyperINT8UINT8rbytes ValueError)r"r'r(s r$_map_field_to_pydantic_typez0SchemaModelGenerator._map_field_to_pydantic_type4s" : ( (J Z:> ) )J Z:- - -e$ $ Z:> ) )J Z:, , ,{///;'"'"(, 9$E{" @EJ@@AAAr&c|jj}i}i}|jD]\}}|||}t |||<t d||<|jtj krdtfd}|||d|<p|jtj krdtfd} | ||d|<|jtj krD|j j} |j j} dtdt dt"fd } | || | |d|<|jdi|d d d d |jjd} t| t(f|S)z Create a Pydantic model from schema definition using type() approach. Args: schema: The IndexSchema to convert Returns: A Pydantic model class with appropriate fields and validators N)defaultfnamec@tdfd}|S)Naftermodec`|*tj|stdd|d|S)Nz Geo field 'z ' value 'z!' is not a valid 'lat,lon' format)r_is_geographicr8r"valuer<s r$ _validate_geozUSchemaModelGenerator._create_model..make_geo_validator.._validate_geo}sM!,#/#>u#E#E"&0$j%$j$j%$j$j$j'"'"!" % r&r )r<rEs` r$make_geo_validatorz>SchemaModelGenerator._create_model..make_geo_validator|s<$U999%%%%:9%)(r& validate_c@tdfd}|S)Nbeforer?cXt|trtdd|S)NzField 'z' cannot be boolean.) isinstanceboolr8rCs r$_disallow_boolzZSchemaModelGenerator._create_model..make_numeric_validator.._disallow_bools5%eT22T",-Ru-R-R-R"S"SS$ r&rF)r<rNs` r$make_numeric_validatorzBSchemaModelGenerator._create_model..make_numeric_validators<$U:::%%%%;:% *)r&dimsr4cHtdfd}|S)Nr>r?c |t|trt|kr%tdddt|t }|dvre|dkr-t d|Drtddn2|dkr,t d |Drtdd |S) NzVector field 'z ' must have z dimensions, got )r5r6r5c3.K|]}|dkp|dkVdS)iN.0vs r$ znSchemaModelGenerator._create_model..make_vector_validator.._validate_vector..s/.R.Rqq4x/B1s7.R.R.R.R.R.Rr&z6' contains values outside the INT8 range (-128 to 127)r6c3.K|]}|dkp|dkVdS)rNrUrVs r$rYznSchemaModelGenerator._create_model..make_vector_validator.._validate_vector..s/.O.OAq1u/?C.O.O.O.O.O.Or&z4' contains values outside the UINT8 range (0 to 255))rLlistlenr8rupperany)r"rD datatype_strr4rPr<s r$_validate_vectorz[SchemaModelGenerator._create_model..make_vector_validator.._validate_vectors,!,)%66.#&u::#5#5*4(o(o(oD(o(ocfglcmcm(o(o+&+&%&038}}/B/B/D/D #/3D#D#D'3v'='=+..R.RE.R.R.R+R+R).2<0~0~0~0~3.3.-.). *6)@)@+..O.O.O.O.O+O+O).2<0|0|0|0|3.3.-. % r&rF)r<rPr4ras``` r$make_vector_validatorzASchemaModelGenerator._create_model..make_vector_validatorsJ%U999%%%%%%:9%8,+r&Tallow)arbitrary_types_allowedextra)__annotations__ model_config__PydanticModelrU)indexr(fieldsitemsr9rr r*rr0rr-r1r3rPr4r.rupdatenamer )r"rr( annotations class_dict field_namer' field_typerGrOrPr4rb model_names r$r!z"SchemaModelGenerator._create_model]s|0 ') %' "(!4!4!6!6V V  J88 MMJ'/z&:K #&+4%8%8%8Jz "zZ^++ )c ) ) ) )8J7I*7U7U 3z3344z111*#****8N7M88 3z3344 z000{' ;/ , ,&) ,5C , , , ,D8M7Lh88 3z334    #.<@7 S S    )::: J j999r&N)__name__ __module__ __qualname____doc__rrrrr rf classmethodr r%rrrr9r!rUr&r$rrs02L$sDO+,111+++$y/+++[+$&B&B-8&B c&B&B&B[&BPt:;t:4 ?t:t:t:[t:t:t:r&robjpathrc|dsd|}t|}||}|r |djSdS)a Extract a value from a nested JSON object using a JSONPath expression. Args: obj: The object to extract values from path: JSONPath expression (e.g., $.field.subfield, $.[*].name) Returns: The extracted value or None if not found Notes: This function uses the jsonpath-ng library for proper JSONPath parsing and supports the full JSONPath specification including filters, wildcards, and array indexing. $z$.rN) startswithjsonpath_parsefindrD)rxry jsonpath_exprmatchess r$extract_from_json_pathrsa" ??3  D{{#4((M  %%G qz 4r&rcnt|}|jjtjkrUi}|jD]8\}}|jrt||j}||||<)||vr ||||<9n|}| |}| dS)a) Validate an object against a schema. Args: schema: The IndexSchema to validate against obj: The object to validate Returns: Validated object with any type coercions applied Raises: ValueError: If validation fails with enhanced error message NT) exclude_none) rr%rir(rr2rjrkryrmodel_validate model_dump)rrx model_classflat_objrpr'rD validateds r$validate_objectrs';;FCCK| K$444!'!4!4!6!6 7 7 Jz 7.sEJ??$+0HZ(s""'*:$  7**844I   T  2 22r&)"rvrtypingrrrrrr jsonpath_ngr r}pydanticr r r redisvl.schemar redisvl.schema.fieldsrrrredisvl.schema.schemarredisvl.schema.type_utilsrredisvl.utils.logrrsloggerrrrrrUr&r$rs 9999999999999999//////6666666666&&&&&&GGGGGGGGGG------222222(((((( H  {:{:{:{:{:{:{:{:|S#Xcc<"3K"3d38n"3c3h"3"3"3"3"3"3r&