Add more JSON-LD benchmark cases

[jviotti]

Signed-off-by: Juan Cruz Viotti jv@jviotti.com

[augmentcode]

🤖 Augment PR Summary

Summary: Expands the JSON-LD benchmark suite to cover more real-world schema/consumer override patterns.

Changes:

• Refactors the catalog benchmark into a shared helper (run_catalog) that prepares the instance, compiles the schema template, and runs JSON-LD evaluation.
• Renames the original single benchmark into JSONLD_Catalog_Simple (no override usage) for a clear baseline.
• Adds JSONLD_Catalog_Override_Agreeing to measure the “dedupe” pattern where consumers wrap refs with x-jsonld-override but keep equivalent values.
• Adds JSONLD_Catalog_Override_Shadowing to measure “specialize” behavior where consumer wrappers intentionally diverge, forcing override shadowing resolution.
• Registers all three benchmarks so they can be compared side-by-side.

Technical Notes: Each benchmark compiles its schema once per invocation (outside the timed loop) using JSON-LD keyword annotations via Tweaks, then emits JSON-LD from a fixed generated catalog instance under Mode::FastValidation.

_{🤖 Was this summary useful? React with 👍 or 👎}

[augmentcode]

Review completed. 1 suggestion posted.

Comment augment review to trigger a new review at any time.

[cubic-dev-ai]

All reported issues were addressed across 1 file

<sub>Reply with feedback, questions, or to request a fix.

Re-trigger cubic</sub>

[github-actions]

Benchmark (macos/llvm)

Details

Benchmark suite	Current: ead49a6	Previous: bb96662	Ratio
Schema_Iterator_ISO_Language	2438702.5602406417 ns/iter	1977186.1501703206 ns/iter	1.23
Schema_Tracker_ISO_Language	4162537.3131874753 ns/iter	2958543.404166865 ns/iter	1.41
Schema_Tracker_ISO_Language_To_JSON	18544403.12499719 ns/iter	15718926.372089703 ns/iter	1.18
Schema_Frame_WoT_References	5463867.089999894 ns/iter	5023120.99358995 ns/iter	1.09
Schema_Frame_OMC_References	26437078.53846641 ns/iter	20413985.29411922 ns/iter	1.30
Schema_Frame_OMC_Locations	26422199.074078083 ns/iter	25369059.210525416 ns/iter	1.04
Schema_Frame_ISO_Language_Locations	89929654.7142967 ns/iter	92568520.75000666 ns/iter	0.97
Schema_Frame_KrakenD_References	44504505.18750415 ns/iter	42044897.38460255 ns/iter	1.06
Schema_Frame_KrakenD_Reachable	415222583.0000589 ns/iter	394691062.4999873 ns/iter	1.05
Schema_Frame_ISO_Language_Locations_To_JSON	90107273.85715914 ns/iter	76087641.59999737 ns/iter	1.18
Schema_Frame_Many_Resources_References	361902208.49994147 ns/iter	279816062.5000037 ns/iter	1.29
Schema_Bundle_Meta_2020_12	1499271.5665957457 ns/iter	1461928.2978788335 ns/iter	1.03
Schema_Format_ISO_Language_To_JSON	99899553.8572152 ns/iter	82088517.85713835 ns/iter	1.22
E2E_Compiler_adaptivecard	69317269.00000452 ns/iter	51135154.20000567 ns/iter	1.36
E2E_Compiler_ansible_meta	27382355.086956523 ns/iter	23226705.645165857 ns/iter	1.18
E2E_Compiler_aws_cdk	415881.06428562815 ns/iter	261121.37549837845 ns/iter	1.59
E2E_Compiler_babelrc	3631070.3733336898 ns/iter	2216256.1239192314 ns/iter	1.64
E2E_Compiler_clang_format	20819218.74999385 ns/iter	15298441.67499732 ns/iter	1.36
E2E_Compiler_cmake_presets	31269491.291662157 ns/iter	23409319.870970357 ns/iter	1.34
E2E_Compiler_code_climate	2436758.5051896297 ns/iter	1975657.5365170576 ns/iter	1.23
E2E_Compiler_cql2	14721027.783336164 ns/iter	10709250.63077084 ns/iter	1.37
E2E_Compiler_cspell	29655229.142861117 ns/iter	20171139.621621672 ns/iter	1.47
E2E_Compiler_cypress	4793433.886228044 ns/iter	3882276.517046534 ns/iter	1.23
E2E_Compiler_deno	9421641.231579328 ns/iter	7075462.962964811 ns/iter	1.33
E2E_Compiler_dependabot	4358856.301281869 ns/iter	3309777.3255809275 ns/iter	1.32
E2E_Compiler_draft_04	2265463.3280760352 ns/iter	1839558.310704921 ns/iter	1.23
E2E_Compiler_fabric_mod	4314130.20833323 ns/iter	3486967.9802963883 ns/iter	1.24
E2E_Compiler_geojson	21129684.906249225 ns/iter	19768414.405406646 ns/iter	1.07
E2E_Compiler_gitpod_configuration	4533811.987653841 ns/iter	3512446.848648127 ns/iter	1.29
E2E_Compiler_helm_chart_lock	557704.65818479 ns/iter	471037.3959001237 ns/iter	1.18
E2E_Compiler_importmap	233125.53348651045 ns/iter	204440.0940021057 ns/iter	1.14
E2E_Compiler_jasmine	1144322.7102651256 ns/iter	946159.79624672 ns/iter	1.21
E2E_Compiler_jshintrc	3614219.8592240904 ns/iter	3088061.880850759 ns/iter	1.17
E2E_Compiler_jsconfig	25233659.891891632 ns/iter	17009936.948718462 ns/iter	1.48
E2E_Compiler_krakend	148757624.99997336 ns/iter	115855465.16668426 ns/iter	1.28
E2E_Compiler_lazygit	38689782.894739196 ns/iter	28387258.319999088 ns/iter	1.36
E2E_Compiler_lerna	1518268.9620757743 ns/iter	1137089.8988391962 ns/iter	1.34
E2E_Compiler_nest_cli	7143629.778688293 ns/iter	5612898.291339991 ns/iter	1.27
E2E_Compiler_omc	192288562.49998215 ns/iter	157399323.00004965 ns/iter	1.22
E2E_Compiler_omnisharp	7699680.989584104 ns/iter	5988553.710936983 ns/iter	1.29
E2E_Compiler_openapi	25646595.833336506 ns/iter	19791447.906250425 ns/iter	1.30
E2E_Compiler_pre_commit_hooks	5396535.9712237315 ns/iter	3726262.7830692492 ns/iter	1.45
E2E_Compiler_pulumi	3135461.8902449748 ns/iter	2758634.2213437282 ns/iter	1.14
E2E_Compiler_semantic_release	1130402.7340763276 ns/iter	1039380.7153392992 ns/iter	1.09
E2E_Compiler_stale	1235960.9641639616 ns/iter	1204835.0787269068 ns/iter	1.03
E2E_Compiler_stylecop	5035022.222222729 ns/iter	4846068.158940397 ns/iter	1.04
E2E_Compiler_tmuxinator	1524851.0742357287 ns/iter	1325932.4521385625 ns/iter	1.15
E2E_Compiler_ui5	49048411.13332926 ns/iter	50008011.13333182 ns/iter	0.98
E2E_Compiler_ui5_manifest	347908541.5000327 ns/iter	278374521.00004613 ns/iter	1.25
E2E_Compiler_unreal_engine_uproject	4656774.709302269 ns/iter	3216672.67441922 ns/iter	1.45
E2E_Compiler_users_array	962249.4600432846 ns/iter	659912.8784964356 ns/iter	1.46
E2E_Compiler_vercel	14551501.765955687 ns/iter	9873777.15151786 ns/iter	1.47
E2E_Compiler_yamllint	371929.0472600372 ns/iter	221481.09775385345 ns/iter	1.68
E2E_Evaluator_adaptivecard	30239.777960833235 ns/iter	17340.209785890078 ns/iter	1.74
E2E_Evaluator_ansible_meta	254684.39795569552 ns/iter	155660.74042272073 ns/iter	1.64
E2E_Evaluator_aws_cdk	53641.75539468611 ns/iter	35278.61714405947 ns/iter	1.52
E2E_Evaluator_babelrc	127330.940875782 ns/iter	78783.4273088708 ns/iter	1.62
E2E_Evaluator_cerebrum_criminal_case	1159392.4002892175 ns/iter	728271.1974708319 ns/iter	1.59
E2E_Evaluator_clang_format	159045.70173602877 ns/iter	98224.71598782147 ns/iter	1.62
E2E_Evaluator_cmake_presets	5970845.829999689 ns/iter	3126087.3623185055 ns/iter	1.91
E2E_Evaluator_code_climate	243177.65639733852 ns/iter	125981.92193762254 ns/iter	1.93
E2E_Evaluator_cql2	238653.9832592859 ns/iter	210372.79999996716 ns/iter	1.13
E2E_Evaluator_cspell	817945.5098038067 ns/iter	393158.54341741104 ns/iter	2.08
E2E_Evaluator_cypress	203445.7554282363 ns/iter	136355.65435799048 ns/iter	1.49
E2E_Evaluator_deno	355645.3994182888 ns/iter	225663.86928318327 ns/iter	1.58
E2E_Evaluator_dependabot	372094.52964039234 ns/iter	237933.2762772944 ns/iter	1.56
E2E_Evaluator_draft_04	8993758.045456637 ns/iter	4745858.164383581 ns/iter	1.90
E2E_Evaluator_fabric_mod	974046.1292199328 ns/iter	442089.8155583282 ns/iter	2.20
E2E_Evaluator_geojson	15878728.260867834 ns/iter	8017543.494506153 ns/iter	1.98
E2E_Evaluator_gitpod_configuration	277183.1089686027 ns/iter	158054.94554010313 ns/iter	1.75
E2E_Evaluator_helm_chart_lock	432942.22255023994 ns/iter	236988.76007619954 ns/iter	1.83
E2E_Evaluator_importmap	64370.500919523394 ns/iter	34120.88561190258 ns/iter	1.89
E2E_Evaluator_jasmine	158997.22215381658 ns/iter	141556.72244323848 ns/iter	1.12
E2E_Evaluator_jshintrc	1615352.2489538502 ns/iter	867757.2086514626 ns/iter	1.86
E2E_Evaluator_jsconfig	528656.7080001987 ns/iter	299589.579055494 ns/iter	1.76
E2E_Evaluator_krakend	222104.94894601093 ns/iter	125231.81636299264 ns/iter	1.77
E2E_Evaluator_lazygit	139141.6280487917 ns/iter	89504.50301630795 ns/iter	1.55
E2E_Evaluator_lerna	158782.67161959966 ns/iter	110527.41303649668 ns/iter	1.44
E2E_Evaluator_nest_cli	210742.6078431143 ns/iter	122767.70486690561 ns/iter	1.72
E2E_Evaluator_omc	20024.20939433213 ns/iter	15114.90372633721 ns/iter	1.32
E2E_Evaluator_omnisharp	645851.220083748 ns/iter	431142.54239260487 ns/iter	1.50
E2E_Evaluator_openapi	10222231.215689758 ns/iter	6782310.239128471 ns/iter	1.51
E2E_Evaluator_pre_commit_hooks	434360.35744426824 ns/iter	322532.69039971294 ns/iter	1.35
E2E_Evaluator_pulumi	625775.5865694787 ns/iter	497691.8572519032 ns/iter	1.26
E2E_Evaluator_semantic_release	79694.8217578406 ns/iter	65163.8015259952 ns/iter	1.22
E2E_Evaluator_stale	144552.0025862183 ns/iter	110336.3216411134 ns/iter	1.31
E2E_Evaluator_stylecop	214353.77833681743 ns/iter	202155.98061100297 ns/iter	1.06
E2E_Evaluator_tmuxinator	74596.74546631628 ns/iter	62952.33303498346 ns/iter	1.18
E2E_Evaluator_ui5	345053.3679794198 ns/iter	344001.40963849484 ns/iter	1.00
E2E_Evaluator_ui5_manifest	1778311.1449700526 ns/iter	1630483.6272042356 ns/iter	1.09
E2E_Evaluator_unreal_engine_uproject	465185.9550622775 ns/iter	327429.4004672683 ns/iter	1.42
E2E_Evaluator_users_array	565289.8603966471 ns/iter	427086.60773138114 ns/iter	1.32
E2E_Evaluator_vercel	254634.97270000793 ns/iter	220940.27788778764 ns/iter	1.15
E2E_Evaluator_yamllint	6942.465994578047 ns/iter	6003.2002821141405 ns/iter	1.16
JSONLD_Catalog_Simple	20969452.20588462 ns/iter
JSONLD_Catalog_Override_Agreeing	21849292.90909608 ns/iter
JSONLD_Catalog_Override_Shadowing	26515310.884615943 ns/iter
Micro_Draft4_Meta_1_No_Callback	149.70750043668951 ns/iter	122.33212179172504 ns/iter	1.22
Micro_Draft4_Required_Properties	691.6993607867593 ns/iter	664.1183644889006 ns/iter	1.04
Micro_Draft4_Many_Optional_Properties_Minimal_Match	18.85178511282244 ns/iter	15.087538583499082 ns/iter	1.25
Micro_Draft4_Few_Optional_Properties_Minimal_Match	9.096655434977327 ns/iter	7.366325682622204 ns/iter	1.23
Micro_Draft4_Items_Schema	248.0323276483397 ns/iter	195.13449131397337 ns/iter	1.27
Micro_Draft4_Nested_Object	1.0968908635370873 ns/iter	0.9807138441321914 ns/iter	1.12
Micro_Draft4_Properties_Triad_Optional	246.32066077556817 ns/iter	193.6826585075292 ns/iter	1.27
Micro_Draft4_Properties_Triad_Closed	194.41416836596935 ns/iter	160.06609424909294 ns/iter	1.21
Micro_Draft4_Properties_Triad_Required	253.5484511707371 ns/iter	206.5191597276524 ns/iter	1.23
Micro_Draft4_Properties_Closed	46.532690568142556 ns/iter	39.659412701809565 ns/iter	1.17
Micro_Draft4_Non_Recursive_Ref	13.092064415220923 ns/iter	12.022924621998323 ns/iter	1.09
Micro_Draft4_Pattern_Properties_True	156.53962651977375 ns/iter	142.6438499868312 ns/iter	1.10
Micro_Draft4_Ref_To_Single_Property	9.841722789249816 ns/iter	7.401743088297273 ns/iter	1.33
Micro_Draft4_Additional_Properties_Type	28.888191805831408 ns/iter	25.050804966894596 ns/iter	1.15
Micro_Draft4_Nested_Oneof	46.04720363854584 ns/iter	32.91779080516011 ns/iter	1.40
Micro_Draft4_Short_Enum	5.767949190834809 ns/iter	4.666322905945697 ns/iter	1.24
Micro_Draft4_Long_Enum	11.903964866532721 ns/iter	9.976706219847227 ns/iter	1.19
Micro_Draft4_Long_Enum_Short_Strings	7.10978024649809 ns/iter	7.134302242601409 ns/iter	1.00
Micro_Draft4_Type_Object	2.585009422134339 ns/iter	2.2456755786757943 ns/iter	1.15
Micro_Draft4_Ref_Single_100	1936491.0549740137 ns/iter	1660555.2993038618 ns/iter	1.17
Micro_Draft4_Compile_Ref_Many_Nested	1296585.7329842104 ns/iter	1174014.7093597446 ns/iter	1.10
Micro_Draft4_Compile_Wrap	2187867.8717107982 ns/iter	1829465.3539323355 ns/iter	1.20
Micro_Draft6_Property_Names	103.13040495074557 ns/iter	86.05306590668863 ns/iter	1.20
Micro_Draft6_Compile_FHIR	12326505083.000029 ns/iter	9893137625.000008 ns/iter	1.25
Micro_Draft7_If_Then_Else	15.969347498263451 ns/iter	15.76448100168368 ns/iter	1.01
Micro_2019_09_Unevaluated_Properties	27.877180240169672 ns/iter	28.642897945514445 ns/iter	0.97
Micro_2019_09_Compile_Wrap	290632229.5000336 ns/iter	261397833.4999274 ns/iter	1.11
Micro_2020_12_Dynamic_Ref	626.1936995236797 ns/iter	560.8495338869243 ns/iter	1.12
Micro_2020_12_Dynamic_Ref_Single	2.3109658749248556 ns/iter	2.239819200203995 ns/iter	1.03
Micro_2020_12_Simple_Output_Mask	848.8457909242989 ns/iter	768.9819887741216 ns/iter	1.10
Micro_2020_12_Simple_Output_Annotations	58230.21012147505 ns/iter	58007.1891270418 ns/iter	1.00
Micro_2020_12_Simple_Output_Annotation_Dropping	1496625.2069825714 ns/iter	1442929.6470587475 ns/iter	1.04
Micro_2020_12_Compile_NonCircular_Shared_Refs	830609.042553204 ns/iter	717183.4361594566 ns/iter	1.16
Micro_2020_12_Exhaustive_Deep_Numeric	5313.896767512872 ns/iter	4599.898441149233 ns/iter	1.16
Micro_2020_12_Exhaustive_Deep_Numeric_SimpleOutput	35314.775758895776 ns/iter	34703.1998180415 ns/iter	1.02
Micro_2020_12_Exhaustive_Deep_Numeric_TraceOutput	14164.688924018232 ns/iter	13401.342465491543 ns/iter	1.06
Micro_2020_12_Exhaustive_Deep_Numeric_Fail	99.74478673785036 ns/iter	80.51366527047833 ns/iter	1.24
Micro_2020_12_Exhaustive_Deep_Numeric_Fail_SimpleOutput	3508.725158106308 ns/iter	3128.9714539362712 ns/iter	1.12
Alterschema_Check_Readibility_ISO_Language_Set_3	221434250.0000536 ns/iter	213746694.66672456 ns/iter	1.04
Alterschema_Check_Readibility_OMC	75435310.22222143 ns/iter	59189093.749997325 ns/iter	1.27
Alterschema_Check_Readibility_KrakenD	687004832.9999464 ns/iter	678251374.9999453 ns/iter	1.01
Alterschema_Apply_Readibility_KrakenD	76521942291.99995 ns/iter	65553018999.99995 ns/iter	1.17
Alterschema_Check_Invalid_External_Refs	167315395.74999487 ns/iter	152004199.99996483 ns/iter	1.10

This comment was automatically generated by workflow using github-action-benchmark.

[github-actions]

JavaScript (macos/llvm)

Details

Benchmark suite	Current: ead49a6	Previous: bb96662	Ratio
E2E_Evaluator_adaptivecard	116643 ns	92124 ns	1.27
E2E_Evaluator_ansible-meta	382661 ns	335329 ns	1.14
E2E_Evaluator_aws-cdk	133756 ns	112674 ns	1.19
E2E_Evaluator_babelrc	307374 ns	256004 ns	1.20
E2E_Evaluator_cerebrum-criminal-case	1635788 ns	1600465 ns	1.02
E2E_Evaluator_clang-format	170682 ns	163947 ns	1.04
E2E_Evaluator_cmake-presets	10960045 ns	11155712 ns	0.98
E2E_Evaluator_code-climate	424143 ns	347678 ns	1.22
E2E_Evaluator_cql2	1044200 ns	938472 ns	1.11
E2E_Evaluator_cspell	1188286 ns	1046354 ns	1.14
E2E_Evaluator_cypress	522641 ns	542233 ns	0.96
E2E_Evaluator_deno	750854 ns	682534 ns	1.10
E2E_Evaluator_dependabot	770784 ns	686562 ns	1.12
E2E_Evaluator_draft-04	15591001 ns	14159097 ns	1.10
E2E_Evaluator_fabric-mod	1434388 ns	1281680 ns	1.12
E2E_Evaluator_geojson	17656757 ns	13813368 ns	1.28
E2E_Evaluator_gitpod-configuration	581134 ns	452442 ns	1.28
E2E_Evaluator_helm-chart-lock	865719 ns	821313 ns	1.05
E2E_Evaluator_importmap	259778 ns	204957 ns	1.27
E2E_Evaluator_jasmine	232652 ns	196074 ns	1.19
E2E_Evaluator_jsconfig	983845 ns	838354 ns	1.17
E2E_Evaluator_jshintrc	2276841 ns	1910687 ns	1.19
E2E_Evaluator_krakend	459986 ns	395948 ns	1.16
E2E_Evaluator_lazygit	325667 ns	257313 ns	1.27
E2E_Evaluator_lerna	366249 ns	315110 ns	1.16
E2E_Evaluator_nest-cli	527961 ns	406204 ns	1.30
E2E_Evaluator_omc	117299 ns	84543 ns	1.39
E2E_Evaluator_omnisharp	1014342 ns	913922 ns	1.11
E2E_Evaluator_openapi	28147654 ns	24254746 ns	1.16
E2E_Evaluator_pre-commit-hooks	1378785 ns	1249201 ns	1.10
E2E_Evaluator_pulumi	1453869 ns	1269144 ns	1.15
E2E_Evaluator_semantic-release	188449 ns	176037 ns	1.07
E2E_Evaluator_stale	307337 ns	270490 ns	1.14
E2E_Evaluator_stylecop	678066 ns	661386 ns	1.03
E2E_Evaluator_tmuxinator	165583 ns	147503 ns	1.12
E2E_Evaluator_ui5	1691035 ns	1419374 ns	1.19
E2E_Evaluator_ui5-manifest	8189118 ns	7134854 ns	1.15
E2E_Evaluator_unreal-engine-uproject	1241045 ns	1096520 ns	1.13
E2E_Evaluator_users-array	2423715 ns	2120106 ns	1.14
E2E_Evaluator_vercel	841263 ns	688531 ns	1.22
E2E_Evaluator_yamllint	27484 ns	21931 ns	1.25

This comment was automatically generated by workflow using github-action-benchmark.

[github-actions]

Benchmark (linux/gcc)

Details

Benchmark suite	Current: ead49a6	Previous: d959933	Ratio
Alterschema_Check_Readibility_ISO_Language_Set_3	358393540.0000655 ns/iter	346499612.4999971 ns/iter	1.03
Alterschema_Check_Readibility_OMC	95199983.42859383 ns/iter	94178190.9999853 ns/iter	1.01
Alterschema_Check_Readibility_KrakenD	1293312708.0000303 ns/iter	1325433272.999817 ns/iter	0.98
Alterschema_Apply_Readibility_KrakenD	123514200039.00012 ns/iter	122820013895.0001 ns/iter	1.01
Alterschema_Check_Invalid_External_Refs	319472091.9999554 ns/iter	306353164.0000292 ns/iter	1.04
Micro_2020_12_Dynamic_Ref	835.8342524533886 ns/iter	819.3109913678165 ns/iter	1.02
Micro_2020_12_Dynamic_Ref_Single	4.6736686972722685 ns/iter	4.359179339442709 ns/iter	1.07
Micro_2020_12_Simple_Output_Mask	1098.7269367952797 ns/iter	1106.7254377489235 ns/iter	0.99
Micro_2020_12_Simple_Output_Annotations	85481.38069571576 ns/iter	82284.06716073451 ns/iter	1.04
Micro_2020_12_Simple_Output_Annotation_Dropping	1963375.440340733 ns/iter	1931803.1181314636 ns/iter	1.02
Micro_2020_12_Compile_NonCircular_Shared_Refs	1099201.7097792102 ns/iter	1090943.4363929757 ns/iter	1.01
Micro_2020_12_Exhaustive_Deep_Numeric	8687.012142033931 ns/iter	8829.149818757787 ns/iter	0.98
Micro_2020_12_Exhaustive_Deep_Numeric_SimpleOutput	52079.82011180755 ns/iter	50709.66275371263 ns/iter	1.03
Micro_2020_12_Exhaustive_Deep_Numeric_TraceOutput	25591.97691155741 ns/iter	25708.642514379484 ns/iter	1.00
Micro_2020_12_Exhaustive_Deep_Numeric_Fail	157.9017725695793 ns/iter	159.1341521304283 ns/iter	0.99
Micro_2020_12_Exhaustive_Deep_Numeric_Fail_SimpleOutput	3283.635452985922 ns/iter	3217.7799213967983 ns/iter	1.02
Micro_2019_09_Unevaluated_Properties	31.495843112721396 ns/iter	31.271957524904185 ns/iter	1.01
Micro_2019_09_Compile_Wrap	292455945.50002354 ns/iter	278852983.49997354 ns/iter	1.05
Micro_Draft7_If_Then_Else	25.55005837055824 ns/iter	24.921957858553103 ns/iter	1.03
Micro_Draft6_Property_Names	150.83191185954541 ns/iter	142.72880393253803 ns/iter	1.06
Micro_Draft6_Compile_FHIR	14014290488.999905 ns/iter	12877859703.000013 ns/iter	1.09
Micro_Draft4_Meta_1_No_Callback	178.84849198445463 ns/iter	176.90601885121043 ns/iter	1.01
Micro_Draft4_Required_Properties	894.8087622862784 ns/iter	887.5296135474938 ns/iter	1.01
Micro_Draft4_Many_Optional_Properties_Minimal_Match	22.262067150687244 ns/iter	22.501480006406037 ns/iter	0.99
Micro_Draft4_Few_Optional_Properties_Minimal_Match	15.905782563465769 ns/iter	16.54615872999954 ns/iter	0.96
Micro_Draft4_Items_Schema	370.97609221652476 ns/iter	330.3660594766295 ns/iter	1.12
Micro_Draft4_Nested_Object	1.8703145489417097 ns/iter	1.86798980232916 ns/iter	1.00
Micro_Draft4_Properties_Triad_Optional	395.5319217914528 ns/iter	382.4639970847312 ns/iter	1.03
Micro_Draft4_Properties_Triad_Closed	361.90457560887813 ns/iter	311.14288479175354 ns/iter	1.16
Micro_Draft4_Properties_Triad_Required	464.031728273373 ns/iter	439.0663486311519 ns/iter	1.06
Micro_Draft4_Properties_Closed	66.42221621580198 ns/iter	66.10815836268196 ns/iter	1.00
Micro_Draft4_Non_Recursive_Ref	9.042343450681281 ns/iter	9.344496497052102 ns/iter	0.97
Micro_Draft4_Pattern_Properties_True	200.39530661338532 ns/iter	207.93693972886615 ns/iter	0.96
Micro_Draft4_Ref_To_Single_Property	15.90226259535118 ns/iter	17.54150346054766 ns/iter	0.91
Micro_Draft4_Additional_Properties_Type	14.327264930369026 ns/iter	14.535319075594561 ns/iter	0.99
Micro_Draft4_Nested_Oneof	63.882527979111934 ns/iter	65.37771541794713 ns/iter	0.98
Micro_Draft4_Short_Enum	14.716254552308373 ns/iter	14.726024442993833 ns/iter	1.00
Micro_Draft4_Long_Enum	13.407725431958847 ns/iter	13.666674762947737 ns/iter	0.98
Micro_Draft4_Long_Enum_Short_Strings	14.735685562637748 ns/iter	14.699648369667402 ns/iter	1.00
Micro_Draft4_Type_Object	4.672120214413358 ns/iter	4.667900659194405 ns/iter	1.00
Micro_Draft4_Ref_Single_100	2500004.2114697862 ns/iter	2461332.5880289227 ns/iter	1.02
Micro_Draft4_Compile_Ref_Many_Nested	1826338.8108806715 ns/iter	1802118.110824675 ns/iter	1.01
Micro_Draft4_Compile_Wrap	2614834.0861423453 ns/iter	2576602.6286763623 ns/iter	1.01
JSONLD_Catalog_Simple	26645134.038464956 ns/iter
JSONLD_Catalog_Override_Agreeing	26922377.391300596 ns/iter
JSONLD_Catalog_Override_Shadowing	38250581.210520886 ns/iter
E2E_Compiler_adaptivecard	61321562.81819334 ns/iter	60407230.99999923 ns/iter	1.02
E2E_Compiler_ansible_meta	27323269.30769292 ns/iter	27959287.039993796 ns/iter	0.98
E2E_Compiler_aws_cdk	375015.2201834685 ns/iter	371560.08311275777 ns/iter	1.01
E2E_Compiler_babelrc	2508005.0323740644 ns/iter	2514260.050359736 ns/iter	1.00
E2E_Compiler_clang_format	17402579.425004207 ns/iter	17304853.97560764 ns/iter	1.01
E2E_Compiler_cmake_presets	26830498.615385506 ns/iter	26669487.846159145 ns/iter	1.01
E2E_Compiler_code_climate	2527228.2410073555 ns/iter	2517571.4676259947 ns/iter	1.00
E2E_Compiler_cql2	14273878.326530024 ns/iter	14083337.73999857 ns/iter	1.01
E2E_Compiler_cspell	23895797.413788073 ns/iter	23483118.066663638 ns/iter	1.02
E2E_Compiler_cypress	4143227.514793564 ns/iter	4077962.465115952 ns/iter	1.02
E2E_Compiler_deno	7717643.662920564 ns/iter	7828438.449438141 ns/iter	0.99
E2E_Compiler_dependabot	3794955.5297301062 ns/iter	3796329.097296522 ns/iter	1.00
E2E_Compiler_draft_04	2733434.7470822213 ns/iter	2721876.9689924973 ns/iter	1.00
E2E_Compiler_fabric_mod	4665725.7284764545 ns/iter	4631909.066225393 ns/iter	1.01
E2E_Compiler_geojson	22045016.59375069 ns/iter	21948876.687503114 ns/iter	1.00
E2E_Compiler_gitpod_configuration	4908530.510489912 ns/iter	4938835.767605679 ns/iter	0.99
E2E_Compiler_helm_chart_lock	668645.0810294377 ns/iter	670000.9751196476 ns/iter	1.00
E2E_Compiler_importmap	277645.9972277069 ns/iter	276569.1760536318 ns/iter	1.00
E2E_Compiler_jasmine	1335302.94847324 ns/iter	1339741.0900383126 ns/iter	1.00
E2E_Compiler_jshintrc	4169131.470237495 ns/iter	4113079.7705872124 ns/iter	1.01
E2E_Compiler_jsconfig	21072817.909092035 ns/iter	20949119.99999953 ns/iter	1.01
E2E_Compiler_krakend	139225826.6000226 ns/iter	136310336.99998623 ns/iter	1.02
E2E_Compiler_lazygit	32186049.227272466 ns/iter	31980664.95454813 ns/iter	1.01
E2E_Compiler_lerna	1581875.2844247487 ns/iter	1561284.7572383604 ns/iter	1.01
E2E_Compiler_nest_cli	7206684.673468661 ns/iter	7210439.2474215 ns/iter	1.00
E2E_Compiler_omc	159894885.24996886 ns/iter	158070980.0000477 ns/iter	1.01
E2E_Compiler_omnisharp	6435526.74999994 ns/iter	6427733.6697251415 ns/iter	1.00
E2E_Compiler_openapi	25350768.999999218 ns/iter	25617783.703704912 ns/iter	0.99
E2E_Compiler_pre_commit_hooks	5055846.071941527 ns/iter	5085458.912408351 ns/iter	0.99
E2E_Compiler_pulumi	3956109.3841812336 ns/iter	3944303.3820224004 ns/iter	1.00
E2E_Compiler_semantic_release	1524967.1956518756 ns/iter	1537357.0831509563 ns/iter	0.99
E2E_Compiler_stale	1512960.7186143845 ns/iter	1512221.5442768023 ns/iter	1.00
E2E_Compiler_stylecop	5588949.695998962 ns/iter	5833683.466666647 ns/iter	0.96
E2E_Compiler_tmuxinator	1876542.664000226 ns/iter	1880704.048128057 ns/iter	1.00
E2E_Compiler_ui5	48638587.92857302 ns/iter	48394912.79999493 ns/iter	1.01
E2E_Compiler_ui5_manifest	317394935.5000332 ns/iter	309270989.49996436 ns/iter	1.03
E2E_Compiler_unreal_engine_uproject	4430102.689873739 ns/iter	4433570.81012638 ns/iter	1.00
E2E_Compiler_users_array	890851.8208386773 ns/iter	875058.2462499778 ns/iter	1.02
E2E_Compiler_vercel	12818475.290908862 ns/iter	12657815.12727451 ns/iter	1.01
E2E_Compiler_yamllint	345669.784371885 ns/iter	342714.0058939337 ns/iter	1.01
E2E_Evaluator_adaptivecard	25338.895655062337 ns/iter	25347.964102563354 ns/iter	1.00
E2E_Evaluator_ansible_meta	286296.46867376 ns/iter	293764.15156580595 ns/iter	0.97
E2E_Evaluator_aws_cdk	62153.97720392622 ns/iter	63445.32832618511 ns/iter	0.98
E2E_Evaluator_babelrc	117561.67955340973 ns/iter	115880.04185277243 ns/iter	1.01
E2E_Evaluator_cerebrum_criminal_case	1145702.4526143095 ns/iter	1132320.7532052347 ns/iter	1.01
E2E_Evaluator_clang_format	110943.19695305092 ns/iter	110197.91179694 ns/iter	1.01
E2E_Evaluator_cmake_presets	4834397.773972702 ns/iter	4743161.054053674 ns/iter	1.02
E2E_Evaluator_code_climate	226652.8034326364 ns/iter	228028.8459037359 ns/iter	0.99
E2E_Evaluator_cql2	225998.78636659615 ns/iter	232319.9137483577 ns/iter	0.97
E2E_Evaluator_cspell	648996.5111706903 ns/iter	601955.1218884456 ns/iter	1.08
E2E_Evaluator_cypress	192187.1487513245 ns/iter	190327.71277176894 ns/iter	1.01
E2E_Evaluator_deno	364865.4678455598 ns/iter	360810.9683350528 ns/iter	1.01
E2E_Evaluator_dependabot	395661.6082820084 ns/iter	388452.58452246623 ns/iter	1.02
E2E_Evaluator_draft_04	8823753.45569719 ns/iter	7043155.0206166385 ns/iter	1.25
E2E_Evaluator_fabric_mod	815116.3809523963 ns/iter	794662.4512469539 ns/iter	1.03
E2E_Evaluator_geojson	17259044.463410802 ns/iter	19041954.35134637 ns/iter	0.91
E2E_Evaluator_gitpod_configuration	271271.8464582698 ns/iter	271240.44096009206 ns/iter	1.00
E2E_Evaluator_helm_chart_lock	326130.3145008997 ns/iter	321460.6099584882 ns/iter	1.01
E2E_Evaluator_importmap	50350.64897870542 ns/iter	48918.290919525454 ns/iter	1.03
E2E_Evaluator_jasmine	123898.03754448626 ns/iter	129636.17476443676 ns/iter	0.96
E2E_Evaluator_jshintrc	1095703.6131043134 ns/iter	1091055.5404984662 ns/iter	1.00
E2E_Evaluator_jsconfig	450676.44494238746 ns/iter	444030.12555491773 ns/iter	1.01
E2E_Evaluator_krakend	234694.16113744676 ns/iter	218856.27434455603 ns/iter	1.07
E2E_Evaluator_lazygit	149250.96845773078 ns/iter	145648.96887403383 ns/iter	1.02
E2E_Evaluator_lerna	170896.37095188434 ns/iter	173902.40068077136 ns/iter	0.98
E2E_Evaluator_nest_cli	208531.82795382 ns/iter	208796.05154031707 ns/iter	1.00
E2E_Evaluator_omc	22613.744230206088 ns/iter	31874.85602951434 ns/iter	0.71
E2E_Evaluator_omnisharp	607298.9670995754 ns/iter	577280.5912467769 ns/iter	1.05
E2E_Evaluator_openapi	15804043.71110894 ns/iter	13589069.839999866 ns/iter	1.16
E2E_Evaluator_pre_commit_hooks	538444.8518518176 ns/iter	545690.7490406802 ns/iter	0.99
E2E_Evaluator_pulumi	788207.0596174749 ns/iter	782796.5454545843 ns/iter	1.01
E2E_Evaluator_semantic_release	108990.63826195523 ns/iter	109211.08269760045 ns/iter	1.00
E2E_Evaluator_stale	176213.34501420232 ns/iter	173573.48627548892 ns/iter	1.02
E2E_Evaluator_stylecop	327495.8829588363 ns/iter	318130.37184785114 ns/iter	1.03
E2E_Evaluator_tmuxinator	111059.4587780422 ns/iter	110164.96310769687 ns/iter	1.01
E2E_Evaluator_ui5	611886.9694854898 ns/iter	598855.6827411498 ns/iter	1.02
E2E_Evaluator_ui5_manifest	3032398.554584319 ns/iter	2993696.1567789507 ns/iter	1.01
E2E_Evaluator_unreal_engine_uproject	502126.7199999784 ns/iter	487967.431454422 ns/iter	1.03
E2E_Evaluator_users_array	671988.7732057406 ns/iter	697641.3041750279 ns/iter	0.96
E2E_Evaluator_vercel	342629.75990222604 ns/iter	339999.5969215972 ns/iter	1.01
E2E_Evaluator_yamllint	13301.325792357407 ns/iter	13642.874375430776 ns/iter	0.97
Schema_Format_ISO_Language_To_JSON	111966771.49996503 ns/iter	106904455.00004639 ns/iter	1.05
Schema_Bundle_Meta_2020_12	1751932.3082701007 ns/iter	1751662.0151102229 ns/iter	1.00
Schema_Frame_WoT_References	5106836.985506575 ns/iter	5099248.306570075 ns/iter	1.00
Schema_Frame_OMC_References	21467118.28125092 ns/iter	21411576.060603637 ns/iter	1.00
Schema_Frame_OMC_Locations	19822894.97142509 ns/iter	19802559.0571433 ns/iter	1.00
Schema_Frame_ISO_Language_Locations	104610463.9999937 ns/iter	100261336.71427877 ns/iter	1.04
Schema_Frame_KrakenD_References	38820073.11110809 ns/iter	37620231.222212575 ns/iter	1.03
Schema_Frame_KrakenD_Reachable	554651300.9999217 ns/iter	529357066.9998644 ns/iter	1.05
Schema_Frame_ISO_Language_Locations_To_JSON	178400280.25000265 ns/iter	184377581.2499757 ns/iter	0.97
Schema_Frame_Many_Resources_References	387570084.999993 ns/iter	382693945.0000282 ns/iter	1.01
Schema_Iterator_ISO_Language	3933627.9217870124 ns/iter	3853383.7540980442 ns/iter	1.02
Schema_Tracker_ISO_Language	5197238.84848521 ns/iter	5206272.208955675 ns/iter	1.00
Schema_Tracker_ISO_Language_To_JSON	28123273.440005507 ns/iter	27490841.079998065 ns/iter	1.02

This comment was automatically generated by workflow using github-action-benchmark.

[github-actions]

JavaScript (linux/gcc)

Details

Benchmark suite	Current: ead49a6	Previous: d959933	Ratio
E2E_Evaluator_adaptivecard	120996 ns	118631 ns	1.02
E2E_Evaluator_ansible-meta	522729 ns	515521 ns	1.01
E2E_Evaluator_aws-cdk	144910 ns	150232 ns	0.96
E2E_Evaluator_babelrc	346126 ns	340940 ns	1.02
E2E_Evaluator_cerebrum-criminal-case	2517645 ns	2406428 ns	1.05
E2E_Evaluator_clang-format	256520 ns	253893 ns	1.01
E2E_Evaluator_cmake-presets	17342275 ns	17407832 ns	1.00
E2E_Evaluator_code-climate	513215 ns	544300 ns	0.94
E2E_Evaluator_cql2	1246311 ns	1270937 ns	0.98
E2E_Evaluator_cspell	1488710 ns	1499291 ns	0.99
E2E_Evaluator_cypress	756814 ns	784732 ns	0.96
E2E_Evaluator_deno	1057593 ns	1075724 ns	0.98
E2E_Evaluator_dependabot	1132813 ns	1109135 ns	1.02
E2E_Evaluator_draft-04	20794393 ns	20235461 ns	1.03
E2E_Evaluator_fabric-mod	2318000 ns	2286053 ns	1.01
E2E_Evaluator_geojson	24321649 ns	21615758 ns	1.13
E2E_Evaluator_gitpod-configuration	720262 ns	704292 ns	1.02
E2E_Evaluator_helm-chart-lock	979441 ns	991199 ns	0.99
E2E_Evaluator_importmap	264753 ns	260922 ns	1.01
E2E_Evaluator_jasmine	296083 ns	300597 ns	0.98
E2E_Evaluator_jsconfig	1206783 ns	1280914 ns	0.94
E2E_Evaluator_jshintrc	2763420 ns	2773091 ns	1.00
E2E_Evaluator_krakend	688343 ns	672499 ns	1.02
E2E_Evaluator_lazygit	507869 ns	488541 ns	1.04
E2E_Evaluator_lerna	456029 ns	457728 ns	1.00
E2E_Evaluator_nest-cli	594848 ns	581448 ns	1.02
E2E_Evaluator_omc	118993 ns	118553 ns	1.00
E2E_Evaluator_omnisharp	1421290 ns	1373426 ns	1.03
E2E_Evaluator_openapi	43320640 ns	39647900 ns	1.09
E2E_Evaluator_pre-commit-hooks	1969247 ns	1978221 ns	1.00
E2E_Evaluator_pulumi	1894226 ns	1918918 ns	0.99
E2E_Evaluator_semantic-release	260151 ns	244863 ns	1.06
E2E_Evaluator_stale	406505 ns	394034 ns	1.03
E2E_Evaluator_stylecop	1249197 ns	1116831 ns	1.12
E2E_Evaluator_tmuxinator	235789 ns	226983 ns	1.04
E2E_Evaluator_ui5	2245750 ns	2222158 ns	1.01
E2E_Evaluator_ui5-manifest	10947939 ns	10199002 ns	1.07
E2E_Evaluator_unreal-engine-uproject	1509769 ns	1481102 ns	1.02
E2E_Evaluator_users-array	2907073 ns	3047280 ns	0.95
E2E_Evaluator_vercel	996533 ns	949375 ns	1.05
E2E_Evaluator_yamllint	25725 ns	25486 ns	1.01

This comment was automatically generated by workflow using github-action-benchmark.

[github-actions]

Benchmark (linux/llvm)

Details

Benchmark suite	Current: ead49a6	Previous: d959933	Ratio
Schema_Iterator_ISO_Language	2893698.269709184 ns/iter	2397785.6494846186 ns/iter	1.21
Schema_Tracker_ISO_Language	4659451.516555773 ns/iter	3707694.8835976906 ns/iter	1.26
Schema_Tracker_ISO_Language_To_JSON	20796001.735294234 ns/iter	17134089.707316734 ns/iter	1.21
Schema_Frame_WoT_References	4636613.194805533 ns/iter	3640991.564767187 ns/iter	1.27
Schema_Frame_OMC_References	19932134.485712335 ns/iter	15953329.659091443 ns/iter	1.25
Schema_Frame_OMC_Locations	18338670.447364118 ns/iter	14630576.520832032 ns/iter	1.25
Schema_Frame_ISO_Language_Locations	100126862.16668953 ns/iter	71825144.87500669 ns/iter	1.39
Schema_Frame_KrakenD_References	36770832.555551656 ns/iter	29730610.750002977 ns/iter	1.24
Schema_Frame_KrakenD_Reachable	529345220.00009567 ns/iter	637608974.0000452 ns/iter	0.83
Schema_Frame_ISO_Language_Locations_To_JSON	119885600.39999357 ns/iter	85222236.83331731 ns/iter	1.41
Schema_Frame_Many_Resources_References	344726934.0000503 ns/iter	289925293.99999964 ns/iter	1.19
Schema_Bundle_Meta_2020_12	1477901.8926272234 ns/iter	1225633.2972053676 ns/iter	1.21
Schema_Format_ISO_Language_To_JSON	106070042.28570206 ns/iter	76775520.00000611 ns/iter	1.38
E2E_Compiler_adaptivecard	57686828.416668355 ns/iter	46467409.26666553 ns/iter	1.24
E2E_Compiler_ansible_meta	24878060.142855573 ns/iter	19785990.114285465 ns/iter	1.26
E2E_Compiler_aws_cdk	333503.55613214016 ns/iter	258001.13733431042 ns/iter	1.29
E2E_Compiler_babelrc	2329700.238409931 ns/iter	1853889.7453581209 ns/iter	1.26
E2E_Compiler_clang_format	16416087.558143264 ns/iter	12932098.814813057 ns/iter	1.27
E2E_Compiler_cmake_presets	25458099.428573992 ns/iter	20977958.72727161 ns/iter	1.21
E2E_Compiler_code_climate	2327732.1860468662 ns/iter	1887354.2108109004 ns/iter	1.23
E2E_Compiler_cql2	12866192.166669592 ns/iter	10588131.35384578 ns/iter	1.22
E2E_Compiler_cspell	22669339.967742708 ns/iter	18615817.97368516 ns/iter	1.22
E2E_Compiler_cypress	3936789.4775285786 ns/iter	3136992.566964076 ns/iter	1.25
E2E_Compiler_deno	7056314.575757282 ns/iter	5538498.228346954 ns/iter	1.27
E2E_Compiler_dependabot	3533543.5202020076 ns/iter	2790694.549800893 ns/iter	1.27
E2E_Compiler_draft_04	2459549.66666623 ns/iter	2003987.7356319674 ns/iter	1.23
E2E_Compiler_fabric_mod	4416147.809815477 ns/iter	3444701.748768584 ns/iter	1.28
E2E_Compiler_geojson	20201525.057141878 ns/iter	16585823.285714425 ns/iter	1.22
E2E_Compiler_gitpod_configuration	4568113.000000385 ns/iter	3625617.2176163704 ns/iter	1.26
E2E_Compiler_helm_chart_lock	627469.7319679257 ns/iter	475138.2152070707 ns/iter	1.32
E2E_Compiler_importmap	248140.27610620414 ns/iter	192783.5412314414 ns/iter	1.29
E2E_Compiler_jasmine	1245525.9103691678 ns/iter	1003649.3204578917 ns/iter	1.24
E2E_Compiler_jshintrc	3895909.6927375575 ns/iter	3018151.357758629 ns/iter	1.29
E2E_Compiler_jsconfig	20258006.08571444 ns/iter	15933079.113634367 ns/iter	1.27
E2E_Compiler_krakend	136856140.39995927 ns/iter	105853853.99999344 ns/iter	1.29
E2E_Compiler_lazygit	30395984.695647 ns/iter	24521874.48276116 ns/iter	1.24
E2E_Compiler_lerna	1444963.9832284935 ns/iter	1159166.7873754324 ns/iter	1.25
E2E_Compiler_nest_cli	6722081.894231189 ns/iter	5308103.136364004 ns/iter	1.27
E2E_Compiler_omc	151441145.7999813 ns/iter	118018837.16666831 ns/iter	1.28
E2E_Compiler_omnisharp	6054254.787611888 ns/iter	4694922.02013431 ns/iter	1.29
E2E_Compiler_openapi	22982784.03332764 ns/iter	18586369.578946758 ns/iter	1.24
E2E_Compiler_pre_commit_hooks	4712514.120805488 ns/iter	3658892.7801044257 ns/iter	1.29
E2E_Compiler_pulumi	3629508.2538870447 ns/iter	2941052.016806588 ns/iter	1.23
E2E_Compiler_semantic_release	1383304.6336633805 ns/iter	1148357.2013092528 ns/iter	1.20
E2E_Compiler_stale	1408257.290909251 ns/iter	1134256.1458669396 ns/iter	1.24
E2E_Compiler_stylecop	5238634.425373376 ns/iter	4039700.7052028957 ns/iter	1.30
E2E_Compiler_tmuxinator	1708217.7372261924 ns/iter	1429261.3713163687 ns/iter	1.20
E2E_Compiler_ui5	45927996.93333897 ns/iter	38598334.66666866 ns/iter	1.19
E2E_Compiler_ui5_manifest	307806676.50003576 ns/iter	235906849.99999213 ns/iter	1.30
E2E_Compiler_unreal_engine_uproject	4149431.289941481 ns/iter	3299577.8076924537 ns/iter	1.26
E2E_Compiler_users_array	797891.696693176 ns/iter	642982.7043159312 ns/iter	1.24
E2E_Compiler_vercel	12162990.879311299 ns/iter	9971641.901409345 ns/iter	1.22
E2E_Compiler_yamllint	308900.5968240218 ns/iter	241721.38448155305 ns/iter	1.28
E2E_Evaluator_adaptivecard	25077.30101217754 ns/iter	16909.6070260229 ns/iter	1.48
E2E_Evaluator_ansible_meta	237046.34361238472 ns/iter	160794.77081900972 ns/iter	1.47
E2E_Evaluator_aws_cdk	53144.58704271853 ns/iter	34326.32487085115 ns/iter	1.55
E2E_Evaluator_babelrc	112827.74346482659 ns/iter	82710.17483833495 ns/iter	1.36
E2E_Evaluator_cerebrum_criminal_case	1025395.3689022509 ns/iter	901195.3126615523 ns/iter	1.14
E2E_Evaluator_clang_format	119581.1106772944 ns/iter	93620.05985003925 ns/iter	1.28
E2E_Evaluator_cmake_presets	4318770.372670454 ns/iter	3830788.994535849 ns/iter	1.13
E2E_Evaluator_code_climate	179971.12438073105 ns/iter	142706.20519533422 ns/iter	1.26
E2E_Evaluator_cql2	215336.02670355403 ns/iter	150328.6014767793 ns/iter	1.43
E2E_Evaluator_cspell	637192.1742287463 ns/iter	506367.11385064456 ns/iter	1.26
E2E_Evaluator_cypress	193620.9089403616 ns/iter	137291.89225323178 ns/iter	1.41
E2E_Evaluator_deno	328841.69648707827 ns/iter	264906.380083615 ns/iter	1.24
E2E_Evaluator_dependabot	327952.453777485 ns/iter	266999.2322183794 ns/iter	1.23
E2E_Evaluator_draft_04	9211950.808823049 ns/iter	5788911.296609528 ns/iter	1.59
E2E_Evaluator_fabric_mod	680910.993089832 ns/iter	550349.2385827034 ns/iter	1.24
E2E_Evaluator_geojson	18041958.923078757 ns/iter	10202101.983870467 ns/iter	1.77
E2E_Evaluator_gitpod_configuration	242284.4432809749 ns/iter	178872.82174688787 ns/iter	1.35
E2E_Evaluator_helm_chart_lock	322593.9780521354 ns/iter	384473.6367122943 ns/iter	0.84
E2E_Evaluator_importmap	51033.6774826392 ns/iter	30432.911466139907 ns/iter	1.68
E2E_Evaluator_jasmine	105443.17122345943 ns/iter	78904.68111871343 ns/iter	1.34
E2E_Evaluator_jshintrc	1190143.3650253143 ns/iter	974174.656903732 ns/iter	1.22
E2E_Evaluator_jsconfig	434016.97091580066 ns/iter	307835.37856828654 ns/iter	1.41
E2E_Evaluator_krakend	211570.9371775447 ns/iter	138901.2679791001 ns/iter	1.52
E2E_Evaluator_lazygit	150980.84849812632 ns/iter	98936.7464371286 ns/iter	1.53
E2E_Evaluator_lerna	144349.41286098084 ns/iter	111807.22122761224 ns/iter	1.29
E2E_Evaluator_nest_cli	190328.63732680347 ns/iter	144721.16420664763 ns/iter	1.32
E2E_Evaluator_omc	21718.870421303833 ns/iter	15002.794688678425 ns/iter	1.45
E2E_Evaluator_omnisharp	617210.5264549972 ns/iter	455592.96148823114 ns/iter	1.35
E2E_Evaluator_openapi	13521799.980391698 ns/iter	10105343.985508401 ns/iter	1.34
E2E_Evaluator_pre_commit_hooks	490617.2533055477 ns/iter	417419.70130641083 ns/iter	1.18
E2E_Evaluator_pulumi	697792.6548322947 ns/iter	628924.4176417527 ns/iter	1.11
E2E_Evaluator_semantic_release	101883.04138029618 ns/iter	67611.96888328422 ns/iter	1.51
E2E_Evaluator_stale	151870.1051463904 ns/iter	107795.82192629523 ns/iter	1.41
E2E_Evaluator_stylecop	300607.5553191701 ns/iter	207697.04110839445 ns/iter	1.45
E2E_Evaluator_tmuxinator	98512.27835051976 ns/iter	71134.29896698652 ns/iter	1.38
E2E_Evaluator_ui5	516227.5415409155 ns/iter	376920.3458646765 ns/iter	1.37
E2E_Evaluator_ui5_manifest	2530436.4270078307 ns/iter	2148792.206790061 ns/iter	1.18
E2E_Evaluator_unreal_engine_uproject	449933.30685446 ns/iter	364505.9020217459 ns/iter	1.23
E2E_Evaluator_users_array	583271.3707397702 ns/iter	595318.9182978446 ns/iter	0.98
E2E_Evaluator_vercel	322199.9853412162 ns/iter	264819.1917651563 ns/iter	1.22
E2E_Evaluator_yamllint	8714.814913762993 ns/iter	5749.851747154356 ns/iter	1.52
JSONLD_Catalog_Simple	23422597.068968665 ns/iter	17174571.69999932 ns/iter	1.36
JSONLD_Catalog_Override_Agreeing	24389841.379310194 ns/iter	17350020.599999994 ns/iter	1.41
JSONLD_Catalog_Override_Shadowing	34579244.84999921 ns/iter	25308388.96296296 ns/iter	1.37
Micro_Draft4_Meta_1_No_Callback	192.3506845974658 ns/iter	138.18172287779905 ns/iter	1.39
Micro_Draft4_Required_Properties	806.2874384549107 ns/iter	592.0706390657065 ns/iter	1.36
Micro_Draft4_Many_Optional_Properties_Minimal_Match	23.367383136149343 ns/iter	17.852871728271662 ns/iter	1.31
Micro_Draft4_Few_Optional_Properties_Minimal_Match	11.601281836556447 ns/iter	8.044787777936781 ns/iter	1.44
Micro_Draft4_Items_Schema	277.6725808118595 ns/iter	226.88752186300914 ns/iter	1.22
Micro_Draft4_Nested_Object	1.8666500100522667 ns/iter	0.9750503855789246 ns/iter	1.91
Micro_Draft4_Properties_Triad_Optional	328.44227230877567 ns/iter	232.82123280546529 ns/iter	1.41
Micro_Draft4_Properties_Triad_Closed	277.6352202781749 ns/iter	192.52715006856576 ns/iter	1.44
Micro_Draft4_Properties_Triad_Required	353.307773385442 ns/iter	247.2143097723633 ns/iter	1.43
Micro_Draft4_Properties_Closed	61.44997136953354 ns/iter	43.1907807614616 ns/iter	1.42
Micro_Draft4_Non_Recursive_Ref	13.911258428101473 ns/iter	11.608652897069568 ns/iter	1.20
Micro_Draft4_Pattern_Properties_True	141.3123211963686 ns/iter	108.49117840592226 ns/iter	1.30
Micro_Draft4_Ref_To_Single_Property	11.65933373080078 ns/iter	8.046545499305491 ns/iter	1.45
Micro_Draft4_Additional_Properties_Type	33.380912194238 ns/iter	31.286845623759127 ns/iter	1.07
Micro_Draft4_Nested_Oneof	57.97518860166792 ns/iter	42.88224485472465 ns/iter	1.35
Micro_Draft4_Short_Enum	12.44108116868904 ns/iter	8.436898978820462 ns/iter	1.47
Micro_Draft4_Long_Enum	14.428443698027321 ns/iter	10.900021657686866 ns/iter	1.32
Micro_Draft4_Long_Enum_Short_Strings	12.44134126931946 ns/iter	8.44604678537389 ns/iter	1.47
Micro_Draft4_Type_Object	3.534010468875997 ns/iter	2.4668970419360496 ns/iter	1.43
Micro_Draft4_Ref_Single_100	2371649.4421769064 ns/iter	1853350.839050022 ns/iter	1.28
Micro_Draft4_Compile_Ref_Many_Nested	1720082.2315271134 ns/iter	1384537.3169291595 ns/iter	1.24
Micro_Draft4_Compile_Wrap	2359928.3050848264 ns/iter	1880493.6846360255 ns/iter	1.25
Micro_Draft6_Property_Names	110.70769212042325 ns/iter	100.88380579751836 ns/iter	1.10
Micro_Draft6_Compile_FHIR	14018681309.000158 ns/iter	16943250799.999987 ns/iter	0.83
Micro_Draft7_If_Then_Else	22.45043821517698 ns/iter	19.148558199712554 ns/iter	1.17
Micro_2019_09_Unevaluated_Properties	27.997350339206278 ns/iter	25.345273687901027 ns/iter	1.10
Micro_2019_09_Compile_Wrap	293811713.0000819 ns/iter	218927681.9999956 ns/iter	1.34
Micro_2020_12_Dynamic_Ref	707.8118481978547 ns/iter	558.1520631222614 ns/iter	1.27
Micro_2020_12_Dynamic_Ref_Single	3.4278066833726943 ns/iter	2.5393289628531632 ns/iter	1.35
Micro_2020_12_Simple_Output_Mask	1071.258708771167 ns/iter	750.2986291124021 ns/iter	1.43
Micro_2020_12_Simple_Output_Annotations	70912.60336686406 ns/iter	55194.99569572872 ns/iter	1.28
Micro_2020_12_Simple_Output_Annotation_Dropping	1702949.4073174247 ns/iter	1311222.593632889 ns/iter	1.30
Micro_2020_12_Compile_NonCircular_Shared_Refs	994625.6737587369 ns/iter	803734.3390804214 ns/iter	1.24
Micro_2020_12_Exhaustive_Deep_Numeric	8480.222034127246 ns/iter	6117.27523842899 ns/iter	1.39
Micro_2020_12_Exhaustive_Deep_Numeric_SimpleOutput	46572.48629407191 ns/iter	38378.46135108685 ns/iter	1.21
Micro_2020_12_Exhaustive_Deep_Numeric_TraceOutput	22710.365374612244 ns/iter	16472.57644075035 ns/iter	1.38
Micro_2020_12_Exhaustive_Deep_Numeric_Fail	152.8871236623951 ns/iter	99.74688612428002 ns/iter	1.53
Micro_2020_12_Exhaustive_Deep_Numeric_Fail_SimpleOutput	2946.8786478423867 ns/iter	2110.1839250226094 ns/iter	1.40
Alterschema_Check_Readibility_ISO_Language_Set_3	380173938.49997914 ns/iter	255445172.00000882 ns/iter	1.49
Alterschema_Check_Readibility_OMC	86921302.87499821 ns/iter	81011935.88888438 ns/iter	1.07
Alterschema_Check_Readibility_KrakenD	1195232137.9999375 ns/iter	1402493636.000031 ns/iter	0.85
Alterschema_Apply_Readibility_KrakenD	121840571794.0002 ns/iter	132565730995.99995 ns/iter	0.92
Alterschema_Check_Invalid_External_Refs	312091296.50005704 ns/iter	155453910.25000298 ns/iter	2.01

This comment was automatically generated by workflow using github-action-benchmark.

[github-actions]

JavaScript (linux/llvm)

Details

Benchmark suite	Current: ead49a6	Previous: d959933	Ratio
E2E_Evaluator_adaptivecard	120645 ns	89884 ns	1.34
E2E_Evaluator_ansible-meta	530382 ns	376483 ns	1.41
E2E_Evaluator_aws-cdk	150789 ns	113636 ns	1.33
E2E_Evaluator_babelrc	354456 ns	306735 ns	1.16
E2E_Evaluator_cerebrum-criminal-case	2543690 ns	1821335 ns	1.40
E2E_Evaluator_clang-format	278768 ns	198987 ns	1.40
E2E_Evaluator_cmake-presets	21047376 ns	14318311 ns	1.47
E2E_Evaluator_code-climate	540695 ns	441485 ns	1.22
E2E_Evaluator_cql2	1344475 ns	1002780 ns	1.34
E2E_Evaluator_cspell	1558931 ns	1235710 ns	1.26
E2E_Evaluator_cypress	791780 ns	668345 ns	1.18
E2E_Evaluator_deno	1079535 ns	851288 ns	1.27
E2E_Evaluator_dependabot	1120057 ns	799131 ns	1.40
E2E_Evaluator_draft-04	23747286 ns	15324998 ns	1.55
E2E_Evaluator_fabric-mod	2343194 ns	1729560 ns	1.35
E2E_Evaluator_geojson	24106800 ns	14512282 ns	1.66
E2E_Evaluator_gitpod-configuration	718940 ns	529576 ns	1.36
E2E_Evaluator_helm-chart-lock	995485 ns	870757 ns	1.14
E2E_Evaluator_importmap	273617 ns	265442 ns	1.03
E2E_Evaluator_jasmine	295757 ns	215975 ns	1.37
E2E_Evaluator_jsconfig	1277289 ns	1069654 ns	1.19
E2E_Evaluator_jshintrc	2811950 ns	2316446 ns	1.21
E2E_Evaluator_krakend	683735 ns	482981 ns	1.42
E2E_Evaluator_lazygit	529061 ns	327082 ns	1.62
E2E_Evaluator_lerna	472593 ns	371288 ns	1.27
E2E_Evaluator_nest-cli	588718 ns	434797 ns	1.35
E2E_Evaluator_omc	117756 ns	89817 ns	1.31
E2E_Evaluator_omnisharp	1435060 ns	1111608 ns	1.29
E2E_Evaluator_openapi	46384855 ns	28701666 ns	1.62
E2E_Evaluator_pre-commit-hooks	1990078 ns	1495939 ns	1.33
E2E_Evaluator_pulumi	1931631 ns	1487328 ns	1.30
E2E_Evaluator_semantic-release	264273 ns	187973 ns	1.41
E2E_Evaluator_stale	399983 ns	289778 ns	1.38
E2E_Evaluator_stylecop	1164265 ns	852024 ns	1.37
E2E_Evaluator_tmuxinator	231767 ns	192667 ns	1.20
E2E_Evaluator_ui5	2248891 ns	1624399 ns	1.38
E2E_Evaluator_ui5-manifest	13765009 ns	7951148 ns	1.73
E2E_Evaluator_unreal-engine-uproject	1508163 ns	1202854 ns	1.25
E2E_Evaluator_users-array	2904602 ns	2308976 ns	1.26
E2E_Evaluator_vercel	982431 ns	771034 ns	1.27
E2E_Evaluator_yamllint	26378 ns	19072 ns	1.38

This comment was automatically generated by workflow using github-action-benchmark.