li|TddlmZmZmZmZmZmZddlmZddl m Z m Z m Z m Z mZmZmZmZddlmZmZmZmZddlmZmZmZddlmZddlmZmZm Z m!Z!m"Z"m#Z#m$Z$ddl%m&Z&d Z'Gd d e eeeZ(Gd d e eeeZ)Gdde eeeZ*Gdde eeeZ+y))DictGenericListOptionalSequenceSet)PydanticMetric)ConversionTypeParams DimensionMetricMetricInputMeasureMetricTimeWindowSemanticManifestSemanticManifestT SemanticModel)DimensionReferenceMeasureReferenceMetricModelReferenceMetricReference)AggregationType MetricTypeTimeGranularity)UniqueAndValidNameRule) FileContext MetricContextSemanticManifestValidationRuleValidationErrorValidationIssueValidationWarningvalidate_safely)WhereFiltersAreParseablez:Custom granularities are not supported for this field yet.c ~eZdZdZeeddedeefdZ e d de de d e e d edeef d Zy )CumulativeMetricRulez7Checks that cumulative metrics are configured properly.z>running model validation ensuring cumulative metrics are validwhats_being_donesemantic_manifestreturncg}|jjDchc]}|jD]}|j!}}}tDchc]}|j j }}|jxsgD]p}|jtjk7r"ttj|jt|j} dD]} t!|j"| } |j"j$r t!|j"j$| nd} | dk(sW| sZ| s]| | k7sc|j't)| d| d|jd| d | d | d | d | d  |j"j*} |j"j$r@|j"j$j*r |j"j$j*} |j"j,r |j"j,j nd}|j"j$r@|j"j$j,r |j"j$j,}|r*||vr&|j't)| d|dt. | r|r|j't)| d | sN|j1|j3| | |s|Scc}}wcc}w)Nmetadata metric_name file_contextmetric)window grain_to_dater0zGot differing values for `z` on cumulative metric 'z'. In `type_params.z`, got 'z*'. In `type_params.cumulative_type_params.z-'. Please remove the value from `type_params.z`.contextmessagez4Invalid time granularity found in `grain_to_date`: ''. zUBoth window and grain_to_date set for cumulative metric. Please set one or the other.metric_contextr0custom_granularities)project_configuration time_spinesr8namervaluelowermetricstyper CUMULATIVErr from_metadatar*rgetattr type_paramscumulative_type_paramsappendrr0r1TEMP_CUSTOM_GRAIN_MSGextendvalidate_metric_time_window)clsr&issues time_spine granularitycustom_granularity_namesitemstandard_granularitiesr/r7fieldtype_params_field_value"cumulative_type_params_field_valuer0r1s p/var/www/html/strategist-ai/venv_dbt/lib/python3.12/site-packages/dbt_semantic_interfaces/validations/metrics.pyvalidate_manifestz&CumulativeMetricRule.validate_manifest/s)+0EEQQ$ )>>$    $ $  $ BQ!Q$**"2"2"4!Q!Q'//52D F{{j333*(66P+ DN 5 *1&2D2De*L' ))@@F..EEuM3 X%/::>UUMM'$2"WXGGLgN$$F#GH005wb !:   8''..F!!88V=O=O=f=f=m=m++BBIIFLFXFXFfFfF..<<BBlpM!!88V=O=O=f=f=t=t & 2 2 I I W W 6L!L # .RS`Raad457- # . w 33'5f[s4AD L [$ "Rs $K4 !K:r7r0r8 allow_customcg}tDchc]}|jj}}||z}|j} | j dr | dd|vr| dd} d| d|j d} | |vr|j t|| |S|s*| |vr&|j t|| dztz|Scc}w)NszInvalid time granularity 'z' in window: ''r2 ) rr<r=rLendswith window_stringrErrF) rIr7r0r8rUrJrNrOvalid_granularitieswindow_granularitymsgs rSrHz0CumulativeMetricRule.validate_metric_time_windows)+AP!Q$**"2"2"4!Q!Q25KK#//  & &s +0B3B0GK^0^!3CR!8 *+=*>nVMaMaLbbcd %8 8 MM*  #5=S#S MM*#I(==  /"Rs!B?N)F)__name__ __module__ __qualname____doc__ classmethodr rrrrTrrrstrboolrHrSr#r#,sA&fgP2CPQ`HaPhPd # % ! "#h    / "  rhr#c 2eZdZdZeeddedeefdZ eedde deefd Z eed ded e e deefd Zeed dedeefdZeeddedeefdZy)DerivedMetricRulez4Checks that derived metrics are configured properly.z7checking that the alias set are not unique and distinctr$r/r'c dg}|jtjk(r tt j |j t|j}|jjxsg}|Dchc]}|j}}|D]}|js|tj|j|z }|j|vsB|jt|d|jd|jd|j!|j|Scc}w)Nr)r+r-zAlias 'z' for input metric: 'z5' is already being used. Please choose another alias.r2)r?rDERIVEDrrrAr*rr;rCr>aliasrcheck_valid_namerEradd)r/rJr7 input_metrics input_metric used_namess rS_validate_alias_collisionz+DerivedMetricRule._validate_alias_collisions)+ ;;*,, ,*(66P+ DN#..66<"M@MN ,++NJN - ; %%4EElFXFXZhiiF#))Z7 +(6*1,2D2D1EEZ[g[l[lZmnS)S#|'9'9: ; Os>D-z%checking that the input metrics existr&c g}|jDchc]}|j}}|jD]}ttj|j t |j}|jtjk(sa|jjs*|jt|d|jd|jjxsgD]H}|j|vs|jt|d|jd|jd J|Scc}w) Nr)r+r-z+No input metrics found for derived metric 'z-'. Please add metrics to type_params.metrics.r2z For metric: z, input metric: 'z5' does not exist as a configured metric in the model.) r>r;rrrAr*rr?rrlrCrEr)r&rJm all_metricsr/r7rqs rS_validate_input_metrics_existz/DerivedMetricRule._validate_input_metrics_exists4)+'8'@'@A!qvvA A'// F*(66P+ DN{{j000))11MM'$2&QRXR]R]Q^_I%I%+$6$6$>$>$D"L#(( ; +(6*6v{{mCTUaUfUfTghM)M . 1BsD=z7checking that input metric time offset params are validr8c g}tDchc]}|jj}}tt j |j t|j}|jjxsgD]}|jr&|tj||j|dz }|jr>|j|vr0|jt!|d|jdt"|js|js|jt!|d |jd |jd |Scc}w) Nr)r+r-T)r7r0r8rUz6Invalid time granularity found in `offset_to_grain`: 'r5r2z?Both offset_window and offset_to_grain set for derived metric 'z' on input metric 'z'. Please set one or the other.)rr<r=rrrAr*rr;rCr> offset_windowr#rHoffset_to_grainrErrF)r/r8rJrNrOr7rqs rS_validate_time_offset_paramsz.DerivedMetricRule._validate_time_offset_paramss\)+AP!Q$**"2"2"4!Q!Q&$22FOOL'FKK@ #..66<" L)).JJ#1'55)=!% K ++ 0L0LTj0j # .TUaUqUqTrru457))l.J.J # ."abhbmbmano))5):):(;;Z!\' 6 C"Rs!Ez3checking that the expr field uses the input metricsc g}|jtjk(rR|jjsi|j t ttj|jt|jd|jd|S|jjxsgD]}|jxs |j}||jjvs6|j t ttj|jt|jd|d|jjd |jd |S) Nr)r+r-z!No `expr` set for derived metric z9. Please add an `expr` that references all input metrics.r2zInput metric 'z' is not used in `expr`: 'z' for derived metric 'z7'. Please update the `expr` or remove the input metric.)r?rrlrCexprrErrrrAr*rr;r>rm)r/rJrqr;s rS_validate_exprz DerivedMetricRule._validate_expr sL)+ ;;*,, ,%%** % -)4)B)BFOO)\#7FKK#P!#DFKK=QR!R  2 %+$6$6$>$>$D" L'--B1B1BD6#5#5#:#:: -(51<1J1JTZTcTc1d+?FKK+X)"+9>XY_YkYkYpYpXqr339;;-?v)x    rhzTrunning model validation ensuring derived metrics properties are configured properlycg}|jjDchc]}|jD]}|j!}}}|tj |z }|j xsgD]N}|tj|z }|tj||z }|tj|z }P|Scc}}w)N)r&)r/)r/r8) r9r:r8r;rjrwr>rsr{r~)r&rJrKrLrMr/s rSrTz#DerivedMetricRule.validate_manifest-s )+0EEQQ$ )>>$    $ $  $ #AATeAff'//52 FF 'AAAP PF 'DD4LE F '66f6E EF  F  $ s$B?N)r`rarbrc staticmethodr r rrrsrrwrrer{r~rrTrgrhrSrjrjs$>&_`&Xo5Na0&MN9IhWfNgO:&_`$V$3s8$X`apXq$a$L&[\v(?*C]@o->8OC\rhrjc veZdZdZeeddededee de e fdZ eed ded e d e d e de e f d Zeedded e d e de e fdZeedded e d e de e fdZedededee fdZeeddede e fdZy)ConversionMetricRulez7Checks that conversion metrics are configured properly.zIchecking that the params of metric are valid if it is a conversion metricr$r/conversion_type_paramsrMr'c g}|j}|rX|tjtt j |j t|j||z }|S)Nr)r+r-r6) r0r#rHrrrAr*rr;)r/rrMrJr0s rS_validate_type_paramsz*ConversionMetricRule._validate_type_paramsGsj )+'..  *FF,!,!:!:FOO!T/FKKH %= G F rhzCchecks that the entity exists in the base/conversion semantic modelentitybase_semantic_modelconversion_semantic_modelc ^g}||jDchc]}|jc}vrj|jtt t j |jt|jdd|jd|jDchc]}|jc}vrj|jtt t j |jt|jdd|jd|Scc}wcc}w) Nr)r+r-zEntity: z# not found in base semantic model: .r2z) not found in conversion semantic model: ) entitiesr;rErrrrAr*r)r/rrrrJs rS_validate_entity_existsz,ConversionMetricRule._validate_entity_exists[s )+ 4G4P4PQ&&++Q Q MM)%0%>%>%X3 L'vh.QReRjRjQkklm   4M4V4VW&&++W W MM)%0%>%>%X3 L'vh/22K2P2P1QQRT   +RXs D%"D*zBchecks that the provided measures are valid for conversion metricsc g d dtdtdtddffd }jj}|Jd||j |||j |d S) N input_measuresemantic_modelis_base_measurer'c Nd}|jD]}|j|jk(s|}n|s"Jdjd|jd|jt j k7r|jt jk7r|jt jk7s|jdk7rsjtttjjt!jd|jd |j |j"k|shjt%ttjjt!jd |jd  yyy) Nz Measure 'z"' wasn't found in semantic model 'rY1r)r+r-zRFor conversion metrics, the measure must be COUNT/SUM(1)/COUNT_DISTINCT. Measure: z is agg type: r2zMeasure input zj has a filter. For conversion metrics, filtering on a conversion input measure is not fully supported yet.)measures referencemeasure_referencer;aggrCOUNTCOUNT_DISTINCTSUMr}rErrrrAr*rfilterr)rrrmeasure model_measurerJr/s rS_validate_measurezBConversionMetricRule._validate_measures.._validate_measuresqG!/!8!8   **m.M.MM+G   ti (:(:';;]^l^q^q]rrst t7 444KK?#A#AA[[O$7$777<<3;N # -)4)B)BFOO)\#7FKK#P!#$$+LL> }!N  ##/ % -)4)B)BFOO)\#7FKK#P!#1?_!_  9H/rhGFor a conversion metric, type_params.conversion_type_params must exist.)rrF)rrr)T)r rrfrCr base_measureconversion_measure)r/rrrrrJs` @rS_validate_measuresz'ConversionMetricRule._validate_measuresys )+gk& -& ?L& _c&  & P"(!3!3!J!J " . U T U .0==.  0CC4!  rhz6checks that the provided constant properties are validcN g dttdtddf fd }jj}|Jd|j xsg}g}g}|D]8}|j |j|j |j:|||||| S)N referencesrr'c |jDcgc]}|jc}|jDcgc]}|jc}z}|D]p}||vsjt t t jjtjd|d|jrycc}wcc}w)Nr)r+r-z The provided constant property: z$, cannot be found in semantic model r2) rr; dimensionsrErrrrAr*r)rrr dimensionlinkable_elementsrrJr/s rS_elements_in_modelzNConversionMetricRule._validate_constant_properties.._elements_in_models;I;R;R S S0>0I0IW#, W! (  $55MM'$1-8-F-FPVP_P_-`'; 'T%'GykRAAOATAT@U%W   !TWs CCr)rr) rrerrCrconstant_propertiesrE base_propertyconversion_property) r/rrrrrbase_propertiesconversion_propertiesconstant_propertyrJs ` @rS_validate_constant_propertiesz2ConversionMetricRule._validate_constant_propertiess )+ 49 m X\ ""(!3!3!J!J " . U T U .4HHNB "!4 P   " "#4#B#B C ! ( ():)N)N O P oFYZ&;Lef rhrr&cd}|jD]-}||jDchc]}|jc}vs*|}|S|Scc}w)z;Retrieve the semantic model from a given measure reference.N)semantic_modelsrr)rr&rmodelrs rS _get_semantic_model_from_measurez5ConversionMetricRule._get_semantic_model_from_measuresW &66 E enn$U7W%6%6$UU!&  %VsAzArunning manifest validation ensuring conversion metrics are validc Ng}|jjDchc]}|jD]}|j!}}}|jxsgD]}|j t jk(s"|jjJdtj|jjjj|}tj|jjjj|}||i|jt!t#t%j&|j(t+|jd|jd*|tj-||jjj.|| z }|tj1||| z }|tj3||jj| z }|tj5||| z }|Scc}}w) Nr)rr&r)r+r-z For metric 'z/', conversion measures specified was not found.r2)r/rrr)r/rr)r/rrM)r9r:r8r;r>r?r CONVERSIONrCrrrrrrrErrrrAr*rrrrrr)r&rJrKrLrMr/rrs rSrTz&ConversionMetricRule.validate_manifestsN)+0EEQQ$ )>>$    $ $  $ (//520 F{{j333&&==I]\]I';&[&[&,&8&8&O&O&\&\&n&n&7'\'#-A,a,a&,&8&8&O&O&b&b&t&t&7-b-)'.2K2SMM'$1-8-F-FPVP_P_-`'; 'T%'36;;-?n$o .FF!!--DDKK(;.G G .AA!(;.GB .DD!+1+=+=+T+T-EE .LL!(;.GMY0 b o$ s$H!N)r`rarbrcrr r r rrerrrrrrrrrrrrrTrgrhrSrrDsA&qr0D`cdg`h / "s$&kl #:Gdq / "m8&jk::-::Wd: / ":l:x&^_##-:#Wd# / "#`#J + @P  -   &ij:->:8OC\:k:rhrc eZdZdZededeeefdeee e fde e fdZ ee ddedeeefdeee e fdeefd Zee d d edeefd Zy )MetricTimeGranularityRulezIChecks that time_granularity set for metric is queryable for that metric.r/ metric_indexmeasure_to_agg_time_dimensionr'cd}tj||D]o}|j|}|sy|jr|jjnt j }|r"|j|jkDsn|}q|S)zGet the minimum time granularity this metric is allowed to be queried with. This should be the largest granularity that any of the metric's agg_time_dimensions is defined at. Defaults to DAY in the N)r/r)r all_input_measures_for_metricgetrCtime_granularityrDAYto_int)r/rrmin_queryable_granularityragg_time_dimensiondefined_time_granularitys rS%_min_queryable_granularity_for_metricz?MetricTimeGranularityRule._min_queryable_granularity_for_metric,s@D!!/!M!MU[jv!w E !>!B!BCT!U %&11#..??$(( % -0H0O0O0QTmTtTtTv0v,D) E)(rhzUrunning model validation ensuring a metric's time_granularity is valid for the metricr$c Zg}ttj|jt |j }|j rtj|||}|s,|jt|d|j d|StDcgc]/}|j|jk\r |j1}}|j |vrF|jt|d|j d |j d |j d ||Scc}w) Nr)r+r-r/rrz2Unable to validate `time_granularity` for metric 'zG' due to misconfiguration with measures or related agg_time_dimensions.r2z`time_granularity` for metric 'z ' must be >= z{. Valid options are those that are >= the largest granularity defined for the metric's measures' agg_time_dimensions. Got: z. Valid options: )rrrAr*rr;rrrrErrrr<)r/rrrJr3rrLr]s rS_validate_metricz*MetricTimeGranularityRule._validate_metricGsI)+$22FOOL'FKK@   " "(A(g(gLXu)h) %- # 'PQWQ\Q\P]^]] $3#%%'+D+K+K+MM!!# # &&.AA # '=fkk]-8==>?h%6677HI\H]_  %#s4D(zGrunning manifest validation ensuring metric time_granularitys are validr&cg}i}|jD]z}|jDcic]}t|j|}}|jD]<} |j |j }||j}|||j <>||jD cic]} t| j| } } |jxsgD]} |tj| | |z }|Scc}w#ttf$rd}YwxYwcc} w)aValidate that the time_granularity for each metric is queryable for that metric. TODO: figure out a more efficient way to reference other aspects of the model. This validation essentially requires parsing the entire model, which could be slow and likely is repeated work. The blocker is that the inputs to validations are protocols, which don't easily store parsed metadata. Nr)rrrr;r&checked_agg_time_dimension_for_measurerdimension_referenceAssertionErrorKeyErrorr>rrr) r&rJrrrdimension_indexragg_time_dimension_refrr/rs rSrTz+MetricTimeGranularityRule.validate_manifestysH)+UW%/?? VN^l^w^wxQZ1)..A9LxOx)22 V.-;-b-bcjctct-u*>M.BB?&DV-g.?.?@ V VL]KdKde 4f<e e'//52 F /@@).KA F   )y'1.*.&. fsC-*C2D 2DDN)r`rarbrcrr rrrrr rrr rrrrrTrgrhrSrr)sS))?F23)(,,Q,Q'R) / " ))4p,,?F23,(,,Q,Q'R, / " ,,\&op->8OC\qrhrN),typingrrrrrr.dbt_semantic_interfaces.implementations.metricr !dbt_semantic_interfaces.protocolsr r r r rrrr"dbt_semantic_interfaces.referencesrrrr"dbt_semantic_interfaces.type_enumsrrr5dbt_semantic_interfaces.validations.unique_valid_namer5dbt_semantic_interfaces.validations.validator_helpersrrrrrrr 1dbt_semantic_interfaces.validations.where_filtersr!rFr#rjrrrgrhrSrs??I     YUx9:KLgVgNhxvZ67HI7SdKeZzb9:KLgVgNhbJq >?P QSZ[lSmqrh