Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[feature](function) support format function #47102

Open
wants to merge 3 commits into
base: master
Choose a base branch
from
Open

[feature](function) support format function #47102

wants to merge 3 commits into from
+943 −0

Conversation

zhangstar333
Copy link
Contributor

What problem does this PR solve?

Problem Summary:
support parse_data_size,format,format_number function
doc: apache/doris-website#1825

Release note

None

Check List (For Author)

  • Test

    • Regression test
    • Unit Test
    • Manual test (add detailed scripts or steps below)
    • No need to test or manual test. Explain why:
      • This is a refactor/code format and no logic has been changed.
      • Previous test can cover this change.
      • No code files have been changed.
      • Other reason

  • Behavior changed:

    • No.
    • Yes.

  • Does this need documentation?

    • No.
    • Yes.

Check List (For Reviewer who merge this PR)

  • Confirm the release note
  • Confirm test cases
  • Confirm document
  • Add branch pick label

@Thearas
Copy link
Contributor

Thearas commented Jan 16, 2025

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

@zhangstar333
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 32471 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 6975cbb86a2c431f1453e665f2ec01d61b42a45b, data reload: false

------ Round 1 ----------------------------------
q1	17592	5624	5452	5452
q2	2096	326	176	176
q3	10506	1287	791	791
q4	10236	974	524	524
q5	7605	2403	2224	2224
q6	197	167	133	133
q7	923	749	612	612
q8	9252	1393	1197	1197
q9	5370	4921	4894	4894
q10	6824	2321	1877	1877
q11	481	274	266	266
q12	351	354	224	224
q13	17769	3676	3037	3037
q14	229	229	215	215
q15	518	483	468	468
q16	629	610	574	574
q17	567	890	330	330
q18	7100	6408	6609	6408
q19	1478	952	563	563
q20	316	333	196	196
q21	2848	2167	2002	2002
q22	366	345	308	308
Total cold run time: 103253 ms
Total hot run time: 32471 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5531	5458	5515	5458
q2	237	335	245	245
q3	2260	2638	2353	2353
q4	1411	1824	1355	1355
q5	4375	4739	4648	4648
q6	162	158	123	123
q7	2061	1949	1872	1872
q8	2664	2827	2669	2669
q9	7341	7229	7210	7210
q10	3020	3260	2767	2767
q11	597	541	507	507
q12	719	821	667	667
q13	3502	3977	3326	3326
q14	284	283	279	279
q15	513	476	456	456
q16	660	673	635	635
q17	1251	1743	1248	1248
q18	7738	7570	7325	7325
q19	765	1160	1077	1077
q20	2025	2040	1859	1859
q21	5586	5167	4825	4825
q22	613	598	529	529
Total cold run time: 53315 ms
Total hot run time: 51433 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 187401 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 6975cbb86a2c431f1453e665f2ec01d61b42a45b, data reload: false

query1	975	383	379	379
query2	6523	2122	2043	2043
query3	6790	216	223	216
query4	33435	23202	23298	23202
query5	4357	587	456	456
query6	282	206	208	206
query7	4593	491	312	312
query8	294	258	229	229
query9	9270	2674	2685	2674
query10	473	298	250	250
query11	17989	15346	15164	15164
query12	167	112	109	109
query13	1658	539	397	397
query14	10469	7257	6321	6321
query15	224	202	192	192
query16	8498	612	451	451
query17	1614	721	562	562
query18	2062	438	294	294
query19	231	172	155	155
query20	117	111	110	110
query21	223	134	103	103
query22	4208	4222	4320	4222
query23	34030	32991	33132	32991
query24	6531	2269	2221	2221
query25	473	465	378	378
query26	777	273	153	153
query27	1973	475	333	333
query28	5274	2441	2451	2441
query29	537	544	416	416
query30	239	201	161	161
query31	977	855	801	801
query32	68	61	59	59
query33	500	361	303	303
query34	747	855	509	509
query35	831	832	737	737
query36	1012	1010	962	962
query37	123	106	86	86
query38	4172	4188	4185	4185
query39	1462	1446	1384	1384
query40	202	113	101	101
query41	54	50	54	50
query42	117	103	100	100
query43	510	538	502	502
query44	1302	820	809	809
query45	177	170	161	161
query46	852	1045	645	645
query47	1837	1860	1774	1774
query48	385	396	321	321
query49	738	491	401	401
query50	647	661	394	394
query51	6945	6854	6916	6854
query52	103	99	90	90
query53	220	252	190	190
query54	483	483	425	425
query55	84	77	82	77
query56	257	274	250	250
query57	1199	1134	1081	1081
query58	251	235	271	235
query59	3055	3059	2884	2884
query60	284	269	253	253
query61	117	116	118	116
query62	794	688	635	635
query63	222	197	186	186
query64	2839	1011	644	644
query65	3236	3125	3158	3125
query66	873	403	313	313
query67	16018	15617	15561	15561
query68	4722	808	532	532
query69	469	291	261	261
query70	1212	1139	1136	1136
query71	368	289	252	252
query72	5902	3842	3889	3842
query73	661	751	353	353
query74	10072	8990	8721	8721
query75	3204	3151	2659	2659
query76	3113	1166	768	768
query77	543	357	269	269
query78	10022	9916	9347	9347
query79	2894	803	602	602
query80	699	522	452	452
query81	506	273	243	243
query82	477	149	125	125
query83	165	179	151	151
query84	242	95	78	78
query85	797	362	293	293
query86	391	320	311	311
query87	4354	4568	4287	4287
query88	4899	2183	2143	2143
query89	394	337	294	294
query90	1810	193	188	188
query91	167	144	115	115
query92	73	57	55	55
query93	2212	864	526	526
query94	699	392	305	305
query95	335	276	256	256
query96	489	619	284	284
query97	2791	2912	2751	2751
query98	227	204	197	197
query99	1297	1377	1261	1261
Total cold run time: 284185 ms
Total hot run time: 187401 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.62 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 6975cbb86a2c431f1453e665f2ec01d61b42a45b, data reload: false

query1	0.03	0.04	0.04
query2	0.07	0.04	0.02
query3	0.24	0.06	0.07
query4	1.62	0.11	0.11
query5	0.42	0.40	0.42
query6	1.16	0.66	0.64
query7	0.02	0.02	0.02
query8	0.04	0.03	0.03
query9	0.56	0.53	0.52
query10	0.54	0.56	0.54
query11	0.14	0.10	0.10
query12	0.13	0.10	0.11
query13	0.61	0.61	0.59
query14	2.72	2.74	2.82
query15	0.89	0.82	0.81
query16	0.38	0.40	0.39
query17	1.06	1.00	1.05
query18	0.24	0.21	0.21
query19	1.86	1.91	2.00
query20	0.02	0.01	0.02
query21	15.37	0.92	0.57
query22	0.75	0.78	0.74
query23	15.19	1.41	0.54
query24	3.25	0.80	1.12
query25	0.17	0.14	0.12
query26	0.26	0.14	0.13
query27	0.07	0.05	0.06
query28	14.25	1.02	0.43
query29	12.57	3.99	3.29
query30	0.26	0.09	0.06
query31	2.84	0.61	0.37
query32	3.23	0.54	0.46
query33	2.99	3.04	3.08
query34	16.59	5.12	4.49
query35	4.53	4.51	4.52
query36	0.66	0.51	0.48
query37	0.08	0.06	0.06
query38	0.04	0.03	0.04
query39	0.03	0.02	0.03
query40	0.16	0.13	0.13
query41	0.08	0.03	0.02
query42	0.03	0.02	0.02
query43	0.04	0.03	0.02
Total cold run time: 106.19 s
Total hot run time: 30.62 s

@doris-robot
Copy link

TeamCity be ut coverage result:
Function Coverage: 41.51% (10825/26080)
Line Coverage: 31.91% (91474/286657)
Region Coverage: 31.06% (46868/150872)
Branch Coverage: 27.16% (23731/87388)
Coverage Report: http://coverage.selectdb-in.cc/coverage/6975cbb86a2c431f1453e665f2ec01d61b42a45b_6975cbb86a2c431f1453e665f2ec01d61b42a45b/report/index.html

@LiBinfeng-01
Copy link
Collaborator

LiBinfeng-01 commented Jan 17, 2025 •
edited by morrySnow
Loading

need supporting fe fold constant at the same time to follow the same logic with be

@zhangstar333
Copy link
Contributor Author

zhangstar333 commented Jan 17, 2025 •
edited by morrySnow
Loading

need supporting fe fold constant at the same time to follow the same logic with be

some logical is complex, so those I think is support on BE is ok.

@zhangstar333
Copy link
Contributor Author

run buildall

@morrySnow
Copy link
Contributor

string, numeric and datetime function is very important for partition pruning and tablet pruning, so must implement them in FE to ensure we could prune as more partition / tablet as possible

@doris-robot
Copy link

TPC-H: Total hot run time: 32465 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 487e852c7f30cdf8b389b9b3c78e208b8f74e994, data reload: false

------ Round 1 ----------------------------------
q1	17607	5576	5434	5434
q2	2055	308	177	177
q3	10416	1228	756	756
q4	10280	1010	536	536
q5	8687	2424	2154	2154
q6	202	166	130	130
q7	885	788	597	597
q8	9240	1382	1193	1193
q9	5284	4913	4896	4896
q10	6856	2365	1885	1885
q11	473	277	252	252
q12	349	366	233	233
q13	17789	3717	3076	3076
q14	234	249	220	220
q15	519	465	449	449
q16	640	624	587	587
q17	597	869	330	330
q18	6995	6469	6493	6469
q19	2071	962	538	538
q20	318	325	190	190
q21	2828	2214	2051	2051
q22	370	343	312	312
Total cold run time: 104695 ms
Total hot run time: 32465 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5598	5507	5506	5506
q2	237	345	247	247
q3	2267	2677	2331	2331
q4	1410	1821	1413	1413
q5	4322	4812	4725	4725
q6	177	160	132	132
q7	2075	1988	1861	1861
q8	2636	2820	2774	2774
q9	7370	7182	7244	7182
q10	3046	3303	2757	2757
q11	576	514	496	496
q12	672	741	637	637
q13	3591	3984	3292	3292
q14	278	302	278	278
q15	498	490	469	469
q16	663	690	664	664
q17	1237	1766	1268	1268
q18	7764	7462	7459	7459
q19	833	1159	1093	1093
q20	2032	2003	1908	1908
q21	5795	5237	5098	5098
q22	616	623	564	564
Total cold run time: 53693 ms
Total hot run time: 52154 ms

@doris-robot
Copy link

TeamCity be ut coverage result:
Function Coverage: 41.50% (10823/26082)
Line Coverage: 31.90% (91448/286694)
Region Coverage: 31.05% (46844/150886)
Branch Coverage: 27.14% (23724/87398)
Coverage Report: http://coverage.selectdb-in.cc/coverage/487e852c7f30cdf8b389b9b3c78e208b8f74e994_487e852c7f30cdf8b389b9b3c78e208b8f74e994/report/index.html

@doris-robot
Copy link

TPC-DS: Total hot run time: 193609 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 487e852c7f30cdf8b389b9b3c78e208b8f74e994, data reload: false

query1	1318	948	953	948
query2	6306	2116	2067	2067
query3	11001	4310	4343	4310
query4	32680	23236	22970	22970
query5	3449	625	491	491
query6	285	199	188	188
query7	3980	497	306	306
query8	303	253	260	253
query9	9399	2580	2578	2578
query10	475	318	253	253
query11	17758	15181	14861	14861
query12	151	105	106	105
query13	1574	515	398	398
query14	9822	6845	6462	6462
query15	229	191	197	191
query16	7973	647	513	513
query17	1589	806	556	556
query18	2133	404	321	321
query19	233	191	150	150
query20	117	134	125	125
query21	205	130	114	114
query22	4439	4671	4330	4330
query23	34252	33359	33714	33359
query24	6587	2309	2287	2287
query25	477	490	382	382
query26	911	275	155	155
query27	2145	479	334	334
query28	5222	2473	2454	2454
query29	626	563	438	438
query30	216	191	168	168
query31	1032	874	866	866
query32	75	59	61	59
query33	481	361	297	297
query34	807	887	545	545
query35	841	873	759	759
query36	1005	1022	970	970
query37	117	102	79	79
query38	4313	4405	4325	4325
query39	1505	1425	1464	1425
query40	203	117	114	114
query41	60	59	51	51
query42	138	105	109	105
query43	519	515	499	499
query44	1301	839	825	825
query45	180	171	180	171
query46	884	1069	671	671
query47	1900	1919	1860	1860
query48	385	431	320	320
query49	724	487	410	410
query50	655	681	402	402
query51	7020	6859	7022	6859
query52	101	109	93	93
query53	229	263	186	186
query54	482	497	425	425
query55	80	78	87	78
query56	254	277	260	260
query57	1220	1209	1113	1113
query58	280	253	254	253
query59	3089	3422	3157	3157
query60	295	296	274	274
query61	139	140	138	138
query62	844	711	687	687
query63	225	193	196	193
query64	3228	1041	647	647
query65	3223	3142	3180	3142
query66	763	394	300	300
query67	16032	15686	15839	15686
query68	5691	856	528	528
query69	493	288	255	255
query70	1206	1107	1125	1107
query71	386	287	258	258
query72	5918	3849	3878	3849
query73	638	745	360	360
query74	10503	9156	8880	8880
query75	3212	3163	2653	2653
query76	3136	1189	780	780
query77	459	461	277	277
query78	10098	10115	9315	9315
query79	3310	812	588	588
query80	1708	542	452	452
query81	570	278	241	241
query82	377	149	127	127
query83	267	172	154	154
query84	246	105	156	105
query85	771	366	307	307
query86	471	315	308	308
query87	4437	4460	4328	4328
query88	4900	2140	2121	2121
query89	403	332	295	295
query90	1829	192	192	192
query91	133	133	107	107
query92	70	55	55	55
query93	2816	876	535	535
query94	721	409	308	308
query95	340	267	266	266
query96	483	605	280	280
query97	2830	2882	2802	2802
query98	226	201	203	201
query99	1283	1385	1264	1264
Total cold run time: 290415 ms
Total hot run time: 193609 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 29.82 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 487e852c7f30cdf8b389b9b3c78e208b8f74e994, data reload: false

query1	0.03	0.04	0.03
query2	0.08	0.03	0.03
query3	0.23	0.07	0.06
query4	1.61	0.11	0.11
query5	0.42	0.41	0.40
query6	1.17	0.65	0.67
query7	0.02	0.01	0.01
query8	0.04	0.03	0.04
query9	0.59	0.53	0.50
query10	0.56	0.57	0.55
query11	0.14	0.10	0.10
query12	0.14	0.10	0.10
query13	0.62	0.59	0.59
query14	2.85	2.76	2.74
query15	0.90	0.84	0.84
query16	0.39	0.39	0.38
query17	0.99	1.05	1.01
query18	0.23	0.21	0.21
query19	1.96	1.72	2.02
query20	0.01	0.01	0.01
query21	15.36	0.99	0.60
query22	0.75	0.80	0.67
query23	15.32	1.36	0.52
query24	3.03	1.30	0.30
query25	0.18	0.06	0.12
query26	0.37	0.15	0.15
query27	0.05	0.07	0.05
query28	12.97	1.04	0.44
query29	12.56	3.95	3.32
query30	0.25	0.08	0.05
query31	2.84	0.59	0.39
query32	3.23	0.55	0.46
query33	2.97	3.05	2.98
query34	16.50	5.03	4.47
query35	4.50	4.49	4.49
query36	0.65	0.49	0.48
query37	0.09	0.06	0.06
query38	0.04	0.04	0.03
query39	0.03	0.03	0.02
query40	0.16	0.13	0.14
query41	0.08	0.03	0.03
query42	0.04	0.02	0.02
query43	0.04	0.04	0.03
Total cold run time: 104.99 s
Total hot run time: 29.82 s

@zhangstar333
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 32309 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 487e852c7f30cdf8b389b9b3c78e208b8f74e994, data reload: false

------ Round 1 ----------------------------------
q1	17579	6346	5369	5369
q2	2058	308	183	183
q3	10410	1236	764	764
q4	10272	970	520	520
q5	8558	2380	2171	2171
q6	202	171	137	137
q7	913	756	602	602
q8	9250	1394	1198	1198
q9	5285	4899	5026	4899
q10	6829	2350	1886	1886
q11	485	278	253	253
q12	342	363	221	221
q13	17763	3707	3091	3091
q14	231	229	211	211
q15	527	473	473	473
q16	635	606	589	589
q17	551	871	341	341
q18	6863	6440	6406	6406
q19	4161	961	532	532
q20	295	314	184	184
q21	2729	2165	1975	1975
q22	383	337	304	304
Total cold run time: 106321 ms
Total hot run time: 32309 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5653	5481	5522	5481
q2	246	342	234	234
q3	2206	2670	2316	2316
q4	1407	1825	1402	1402
q5	4311	4758	4833	4758
q6	170	163	127	127
q7	2085	1961	1821	1821
q8	2626	2826	2726	2726
q9	7393	7201	7305	7201
q10	3029	3284	2687	2687
q11	576	527	492	492
q12	731	792	612	612
q13	3497	3984	3342	3342
q14	282	296	283	283
q15	515	498	469	469
q16	671	687	652	652
q17	1241	1737	1262	1262
q18	7671	7544	7597	7544
q19	801	1170	1111	1111
q20	2006	2044	1969	1969
q21	5576	5204	5034	5034
q22	592	599	567	567
Total cold run time: 53285 ms
Total hot run time: 52090 ms

@doris-robot
Copy link

TeamCity be ut coverage result:
Function Coverage: 41.50% (10825/26082)
Line Coverage: 31.90% (91432/286652)
Region Coverage: 31.06% (46848/150850)
Branch Coverage: 27.15% (23724/87374)
Coverage Report: http://coverage.selectdb-in.cc/coverage/487e852c7f30cdf8b389b9b3c78e208b8f74e994_487e852c7f30cdf8b389b9b3c78e208b8f74e994/report/index.html

@doris-robot
Copy link

TPC-DS: Total hot run time: 195025 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 487e852c7f30cdf8b389b9b3c78e208b8f74e994, data reload: false

query1	1280	974	917	917
query2	6360	2026	1977	1977
query3	11129	4603	4628	4603
query4	61891	32439	23368	23368
query5	4862	601	469	469
query6	420	185	191	185
query7	5545	509	302	302
query8	319	245	206	206
query9	8392	2585	2597	2585
query10	424	334	254	254
query11	15874	15320	15595	15320
query12	168	109	108	108
query13	1419	594	439	439
query14	11312	6852	6983	6852
query15	210	210	190	190
query16	7415	652	480	480
query17	1105	749	595	595
query18	1987	409	357	357
query19	187	180	170	170
query20	117	121	118	118
query21	221	124	107	107
query22	4481	4806	4556	4556
query23	34027	33395	33594	33395
query24	5671	2318	2338	2318
query25	463	459	392	392
query26	633	280	160	160
query27	1711	473	333	333
query28	4184	2488	2463	2463
query29	551	556	420	420
query30	222	186	150	150
query31	921	860	801	801
query32	75	66	60	60
query33	400	370	294	294
query34	725	873	523	523
query35	809	854	766	766
query36	1010	1056	943	943
query37	118	93	79	79
query38	4199	4474	4429	4429
query39	1474	1446	1470	1446
query40	215	113	101	101
query41	50	52	48	48
query42	120	102	105	102
query43	525	540	494	494
query44	1362	844	822	822
query45	186	174	165	165
query46	888	1055	651	651
query47	1885	1941	1857	1857
query48	396	458	331	331
query49	721	484	387	387
query50	649	682	410	410
query51	7072	7031	6960	6960
query52	101	100	90	90
query53	230	251	182	182
query54	490	499	432	432
query55	88	83	78	78
query56	270	267	268	267
query57	1174	1158	1105	1105
query58	224	234	237	234
query59	2927	3092	2943	2943
query60	273	259	246	246
query61	117	118	116	116
query62	778	710	631	631
query63	225	187	187	187
query64	1312	1008	708	708
query65	3252	3167	3159	3159
query66	680	405	313	313
query67	16227	15574	15505	15505
query68	4436	810	532	532
query69	499	284	256	256
query70	1229	1120	1132	1120
query71	409	279	275	275
query72	6088	3916	3775	3775
query73	756	747	357	357
query74	10096	9127	9117	9117
query75	3217	3162	2677	2677
query76	3516	1186	775	775
query77	473	429	278	278
query78	10072	9963	9285	9285
query79	3576	809	579	579
query80	1720	527	441	441
query81	548	274	234	234
query82	829	150	127	127
query83	274	182	156	156
query84	287	99	74	74
query85	780	346	303	303
query86	457	319	302	302
query87	4558	4521	4460	4460
query88	4478	2134	2104	2104
query89	401	328	288	288
query90	1679	190	190	190
query91	138	133	108	108
query92	72	59	54	54
query93	2779	881	519	519
query94	841	410	299	299
query95	329	262	256	256
query96	480	616	286	286
query97	2822	2855	2728	2728
query98	229	200	197	197
query99	1354	1354	1219	1219
Total cold run time: 314170 ms
Total hot run time: 195025 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.79 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 487e852c7f30cdf8b389b9b3c78e208b8f74e994, data reload: false

query1	0.04	0.03	0.04
query2	0.07	0.04	0.03
query3	0.24	0.07	0.07
query4	1.61	0.11	0.10
query5	0.40	0.41	0.40
query6	1.18	0.65	0.65
query7	0.02	0.01	0.02
query8	0.04	0.04	0.03
query9	0.58	0.52	0.52
query10	0.56	0.57	0.57
query11	0.15	0.10	0.10
query12	0.14	0.11	0.11
query13	0.60	0.59	0.60
query14	2.72	2.72	2.74
query15	0.90	0.82	0.83
query16	0.38	0.40	0.39
query17	1.00	1.05	1.01
query18	0.22	0.21	0.21
query19	1.94	1.81	2.04
query20	0.01	0.01	0.01
query21	15.36	0.96	0.59
query22	0.75	0.77	0.72
query23	15.25	1.44	0.54
query24	2.51	0.98	1.14
query25	0.26	0.20	0.08
query26	0.24	0.15	0.14
query27	0.07	0.05	0.05
query28	14.22	1.00	0.42
query29	12.56	3.99	3.33
query30	0.26	0.09	0.07
query31	2.82	0.58	0.38
query32	3.23	0.54	0.46
query33	2.95	3.05	3.00
query34	16.79	5.16	4.57
query35	4.59	4.50	4.56
query36	0.66	0.48	0.47
query37	0.10	0.06	0.06
query38	0.05	0.04	0.04
query39	0.04	0.02	0.02
query40	0.18	0.13	0.12
query41	0.08	0.03	0.02
query42	0.04	0.02	0.03
query43	0.03	0.04	0.03
Total cold run time: 105.84 s
Total hot run time: 30.79 s

@zhangstar333
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 32230 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit aab5f81f3768f643337ffffcd5fa0af35aec516d, data reload: false

------ Round 1 ----------------------------------
q1	17591	5518	5451	5451
q2	2039	318	168	168
q3	10396	1270	728	728
q4	10216	967	517	517
q5	7562	2428	2233	2233
q6	206	168	137	137
q7	915	774	636	636
q8	9236	1359	1136	1136
q9	5163	4936	4838	4838
q10	6798	2315	1867	1867
q11	458	280	262	262
q12	349	358	217	217
q13	17756	3716	3057	3057
q14	236	221	211	211
q15	507	487	460	460
q16	620	618	578	578
q17	580	854	322	322
q18	6920	6614	6416	6416
q19	1215	948	539	539
q20	329	330	198	198
q21	2840	2205	1953	1953
q22	363	331	306	306
Total cold run time: 102295 ms
Total hot run time: 32230 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5526	5708	5584	5584
q2	239	330	234	234
q3	2281	2676	2324	2324
q4	1394	1822	1368	1368
q5	4339	4780	4685	4685
q6	172	159	128	128
q7	2059	2039	1818	1818
q8	2677	2833	2693	2693
q9	7303	7136	7262	7136
q10	3010	3243	2805	2805
q11	582	513	515	513
q12	690	786	613	613
q13	3566	3919	3238	3238
q14	292	301	271	271
q15	514	484	463	463
q16	669	692	662	662
q17	1222	1735	1274	1274
q18	7699	7479	7266	7266
q19	810	1133	1073	1073
q20	1968	2012	1887	1887
q21	5735	5299	4901	4901
q22	605	564	567	564
Total cold run time: 53352 ms
Total hot run time: 51500 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 187623 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit aab5f81f3768f643337ffffcd5fa0af35aec516d, data reload: false

query1	971	375	376	375
query2	6539	2057	1994	1994
query3	6787	213	215	213
query4	36573	23232	23049	23049
query5	4018	596	447	447
query6	294	209	182	182
query7	4606	512	310	310
query8	289	261	224	224
query9	9391	2566	2573	2566
query10	429	341	256	256
query11	16219	15391	15068	15068
query12	161	114	110	110
query13	1668	531	404	404
query14	9213	6525	6727	6525
query15	266	197	186	186
query16	8103	665	476	476
query17	1626	744	570	570
query18	2141	401	311	311
query19	230	192	161	161
query20	118	113	112	112
query21	212	125	114	114
query22	4157	4227	4305	4227
query23	34012	33398	33141	33141
query24	7294	2319	2287	2287
query25	503	484	378	378
query26	1202	268	159	159
query27	2608	460	333	333
query28	5873	2417	2414	2414
query29	748	563	418	418
query30	229	187	161	161
query31	950	901	823	823
query32	100	63	60	60
query33	507	346	299	299
query34	733	850	501	501
query35	789	825	766	766
query36	1009	1065	973	973
query37	125	104	82	82
query38	4106	4153	4123	4123
query39	1472	1580	1424	1424
query40	203	113	104	104
query41	51	50	52	50
query42	128	103	102	102
query43	524	529	486	486
query44	1263	793	801	793
query45	178	174	167	167
query46	865	1022	661	661
query47	1825	1815	1760	1760
query48	377	411	326	326
query49	795	517	403	403
query50	625	650	405	405
query51	6884	6962	6844	6844
query52	102	105	91	91
query53	237	243	191	191
query54	490	503	431	431
query55	91	81	83	81
query56	269	284	242	242
query57	1180	1119	1066	1066
query58	248	232	242	232
query59	2960	3074	2863	2863
query60	283	278	259	259
query61	120	118	120	118
query62	809	725	642	642
query63	225	195	193	193
query64	4642	1031	659	659
query65	3243	3176	3165	3165
query66	1044	423	317	317
query67	15887	15556	15486	15486
query68	4292	839	539	539
query69	490	296	269	269
query70	1179	1125	1148	1125
query71	393	333	251	251
query72	5893	3837	3894	3837
query73	645	760	356	356
query74	10486	8849	8724	8724
query75	3209	3158	2647	2647
query76	3220	1183	780	780
query77	464	361	280	280
query78	10114	10039	9529	9529
query79	3002	815	593	593
query80	685	551	441	441
query81	524	351	240	240
query82	449	154	121	121
query83	178	189	151	151
query84	242	108	77	77
query85	796	339	306	306
query86	407	324	296	296
query87	4452	4487	4376	4376
query88	4973	2141	2141	2141
query89	401	337	293	293
query90	1863	195	192	192
query91	133	139	107	107
query92	65	65	61	61
query93	2214	853	531	531
query94	687	362	267	267
query95	351	269	254	254
query96	499	612	279	279
query97	2765	2848	2716	2716
query98	230	211	215	211
query99	1319	1408	1274	1274
Total cold run time: 288439 ms
Total hot run time: 187623 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 31.35 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit aab5f81f3768f643337ffffcd5fa0af35aec516d, data reload: false

query1	0.04	0.03	0.03
query2	0.07	0.03	0.04
query3	0.23	0.07	0.07
query4	1.61	0.10	0.11
query5	0.41	0.42	0.43
query6	1.16	0.65	0.67
query7	0.03	0.02	0.01
query8	0.04	0.03	0.03
query9	0.59	0.50	0.50
query10	0.56	0.55	0.55
query11	0.15	0.11	0.11
query12	0.14	0.11	0.12
query13	0.60	0.61	0.58
query14	2.85	2.87	2.82
query15	0.89	0.83	0.83
query16	0.39	0.39	0.37
query17	1.03	1.05	1.04
query18	0.23	0.20	0.20
query19	1.94	1.87	1.98
query20	0.01	0.01	0.01
query21	15.36	0.92	0.56
query22	0.77	0.82	0.68
query23	15.19	1.46	0.51
query24	2.60	1.40	2.18
query25	0.27	0.20	0.06
query26	0.18	0.14	0.13
query27	0.05	0.04	0.05
query28	14.66	0.93	0.43
query29	12.59	4.07	3.37
query30	0.25	0.10	0.06
query31	2.83	0.62	0.40
query32	3.23	0.54	0.46
query33	3.01	2.98	3.03
query34	16.64	5.26	4.60
query35	4.55	4.60	4.55
query36	0.65	0.51	0.48
query37	0.09	0.06	0.06
query38	0.04	0.04	0.03
query39	0.03	0.02	0.02
query40	0.15	0.14	0.13
query41	0.09	0.03	0.02
query42	0.03	0.02	0.02
query43	0.04	0.03	0.03
Total cold run time: 106.27 s
Total hot run time: 31.35 s

@doris-robot
Copy link

TeamCity be ut coverage result:
Function Coverage: 41.50% (10823/26082)
Line Coverage: 31.90% (91438/286663)
Region Coverage: 31.05% (46835/150858)
Branch Coverage: 27.14% (23713/87380)
Coverage Report: http://coverage.selectdb-in.cc/coverage/aab5f81f3768f643337ffffcd5fa0af35aec516d_aab5f81f3768f643337ffffcd5fa0af35aec516d/report/index.html

@zhangstar333
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 32469 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit aab5f81f3768f643337ffffcd5fa0af35aec516d, data reload: false

------ Round 1 ----------------------------------
q1	17592	5521	5438	5438
q2	2060	311	176	176
q3	10511	1228	737	737
q4	10218	974	524	524
q5	7576	2408	2197	2197
q6	190	165	129	129
q7	910	747	608	608
q8	9238	1379	1223	1223
q9	5242	4869	4951	4869
q10	6851	2333	1897	1897
q11	478	267	250	250
q12	344	363	221	221
q13	17774	3651	3082	3082
q14	230	244	216	216
q15	514	484	461	461
q16	653	629	590	590
q17	577	870	316	316
q18	7098	6541	6546	6541
q19	3276	954	525	525
q20	311	315	181	181
q21	2794	2192	1972	1972
q22	367	338	316	316
Total cold run time: 104804 ms
Total hot run time: 32469 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5607	5481	5475	5475
q2	242	336	241	241
q3	2210	2653	2351	2351
q4	1429	1831	1356	1356
q5	4320	4758	4724	4724
q6	174	165	126	126
q7	2085	1952	1836	1836
q8	2629	2836	2728	2728
q9	7377	7282	7358	7282
q10	3018	3285	2750	2750
q11	582	493	495	493
q12	653	733	644	644
q13	3582	3917	3241	3241
q14	275	309	277	277
q15	513	489	462	462
q16	662	685	647	647
q17	1244	1759	1291	1291
q18	7729	7558	7395	7395
q19	832	1051	1130	1051
q20	1995	2070	1899	1899
q21	5838	5006	4983	4983
q22	602	620	554	554
Total cold run time: 53598 ms
Total hot run time: 51806 ms

@doris-robot
Copy link

TeamCity be ut coverage result:
Function Coverage: 41.55% (10837/26081)
Line Coverage: 31.96% (91606/286659)
Region Coverage: 31.09% (46902/150864)
Branch Coverage: 27.18% (23755/87396)
Coverage Report: http://coverage.selectdb-in.cc/coverage/aab5f81f3768f643337ffffcd5fa0af35aec516d_aab5f81f3768f643337ffffcd5fa0af35aec516d/report/index.html

@doris-robot
Copy link

TPC-DS: Total hot run time: 194497 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit aab5f81f3768f643337ffffcd5fa0af35aec516d, data reload: false

query1	1313	986	936	936
query2	6207	2073	2029	2029
query3	10965	4487	4494	4487
query4	60668	29177	22896	22896
query5	5571	591	450	450
query6	434	205	192	192
query7	5567	495	289	289
query8	324	225	220	220
query9	8152	2605	2600	2600
query10	457	315	249	249
query11	17442	15182	15502	15182
query12	164	114	107	107
query13	1469	555	445	445
query14	10429	7663	7483	7483
query15	212	218	193	193
query16	7324	620	454	454
query17	1122	749	609	609
query18	1895	429	338	338
query19	211	207	150	150
query20	119	110	109	109
query21	218	124	104	104
query22	4604	4804	4472	4472
query23	34293	33583	33334	33334
query24	5565	2318	2359	2318
query25	482	486	402	402
query26	644	282	157	157
query27	1678	462	335	335
query28	3980	2483	2436	2436
query29	532	568	423	423
query30	212	187	154	154
query31	929	887	811	811
query32	71	62	59	59
query33	408	360	322	322
query34	749	866	541	541
query35	825	861	795	795
query36	1003	1037	945	945
query37	124	112	80	80
query38	4320	4274	4294	4274
query39	1500	1462	1441	1441
query40	209	116	102	102
query41	59	56	83	56
query42	123	105	112	105
query43	504	513	488	488
query44	1364	843	814	814
query45	178	180	171	171
query46	872	1057	655	655
query47	1890	1896	1811	1811
query48	386	403	322	322
query49	719	507	401	401
query50	680	677	407	407
query51	7069	6877	6993	6877
query52	102	99	97	97
query53	246	251	186	186
query54	478	514	416	416
query55	84	82	84	82
query56	259	259	258	258
query57	1211	1223	1132	1132
query58	242	243	232	232
query59	3036	3123	3175	3123
query60	271	277	246	246
query61	142	111	113	111
query62	716	706	642	642
query63	216	188	183	183
query64	1291	1037	640	640
query65	3222	3154	3149	3149
query66	672	416	308	308
query67	16111	15478	15684	15478
query68	5058	838	521	521
query69	483	298	270	270
query70	1231	1123	1133	1123
query71	404	279	248	248
query72	6362	3917	3840	3840
query73	790	752	358	358
query74	9756	9059	8871	8871
query75	3192	3154	2614	2614
query76	3771	1177	755	755
query77	475	360	281	281
query78	10011	9993	9377	9377
query79	3060	819	586	586
query80	655	539	515	515
query81	500	280	236	236
query82	359	151	122	122
query83	173	171	170	170
query84	284	94	82	82
query85	788	373	303	303
query86	375	315	289	289
query87	4440	4374	4324	4324
query88	4324	2173	2140	2140
query89	397	325	286	286
query90	1640	191	191	191
query91	139	139	111	111
query92	72	56	52	52
query93	2748	871	526	526
query94	696	400	292	292
query95	335	270	258	258
query96	494	621	284	284
query97	2800	2863	2726	2726
query98	235	199	198	198
query99	1297	1354	1235	1235
Total cold run time: 311878 ms
Total hot run time: 194497 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.47 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit aab5f81f3768f643337ffffcd5fa0af35aec516d, data reload: false

query1	0.04	0.04	0.03
query2	0.07	0.04	0.03
query3	0.24	0.08	0.06
query4	1.61	0.10	0.11
query5	0.42	0.43	0.41
query6	1.18	0.66	0.66
query7	0.02	0.01	0.01
query8	0.04	0.03	0.03
query9	0.59	0.48	0.49
query10	0.55	0.56	0.54
query11	0.15	0.10	0.11
query12	0.14	0.11	0.11
query13	0.60	0.60	0.61
query14	2.75	2.77	2.74
query15	0.90	0.83	0.83
query16	0.37	0.37	0.39
query17	1.06	1.07	1.08
query18	0.24	0.23	0.21
query19	1.91	1.83	2.03
query20	0.01	0.01	0.01
query21	15.36	0.96	0.60
query22	0.75	0.75	0.76
query23	15.23	1.40	0.61
query24	3.45	0.72	0.62
query25	0.20	0.22	0.05
query26	0.25	0.14	0.14
query27	0.04	0.04	0.06
query28	13.13	1.04	0.45
query29	12.58	3.92	3.27
query30	0.25	0.09	0.06
query31	2.82	0.59	0.38
query32	3.23	0.56	0.46
query33	3.00	3.04	3.04
query34	16.78	5.11	4.49
query35	4.55	4.48	4.56
query36	0.66	0.49	0.50
query37	0.10	0.06	0.06
query38	0.05	0.04	0.04
query39	0.04	0.03	0.02
query40	0.16	0.13	0.13
query41	0.08	0.03	0.03
query42	0.04	0.02	0.03
query43	0.03	0.03	0.02
Total cold run time: 105.67 s
Total hot run time: 30.47 s

HappenLee
HappenLee previously approved these changes Jan 23, 2025
View reviewed changes
Copy link
Contributor

@HappenLee HappenLee left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@github-actions github-actions bot added the approved Indicates a PR has been approved by one committer. label Jan 23, 2025
@github-actions GitHub Actions
Copy link
Contributor

PR approved by at least one committer and no changes requested.

@github-actions GitHub Actions
Copy link
Contributor

PR approved by anyone and no changes requested.

@zhangstar333
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 31680 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit aab5f81f3768f643337ffffcd5fa0af35aec516d, data reload: false

------ Round 1 ----------------------------------
q1	17600	5268	5136	5136
q2	2057	303	170	170
q3	10404	1291	738	738
q4	10209	1008	549	549
q5	7557	2389	2364	2364
q6	185	162	134	134
q7	1002	768	603	603
q8	9308	1300	1058	1058
q9	4947	4790	4897	4790
q10	6864	2322	1876	1876
q11	477	286	260	260
q12	348	355	224	224
q13	17778	3674	3112	3112
q14	224	226	205	205
q15	524	469	459	459
q16	634	612	571	571
q17	577	882	337	337
q18	6970	6293	6143	6143
q19	1531	957	561	561
q20	315	324	197	197
q21	2740	2205	1895	1895
q22	365	327	298	298
Total cold run time: 102616 ms
Total hot run time: 31680 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5202	5177	5170	5170
q2	235	334	230	230
q3	2176	2703	2330	2330
q4	1419	1850	1371	1371
q5	4211	4109	4163	4109
q6	212	163	127	127
q7	1865	1820	1766	1766
q8	2627	2677	2557	2557
q9	7242	7220	7145	7145
q10	3055	3211	2804	2804
q11	607	511	493	493
q12	687	817	636	636
q13	3370	3944	3291	3291
q14	281	291	285	285
q15	519	457	467	457
q16	653	674	643	643
q17	1147	1635	1330	1330
q18	7570	7425	7154	7154
q19	803	878	938	878
q20	1974	2039	1844	1844
q21	5664	5033	4826	4826
q22	634	616	540	540
Total cold run time: 52153 ms
Total hot run time: 49986 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 190760 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit aab5f81f3768f643337ffffcd5fa0af35aec516d, data reload: false

query1	1331	994	938	938
query2	6221	1932	1906	1906
query3	11044	4681	4522	4522
query4	54999	26303	23925	23925
query5	5093	545	473	473
query6	336	204	176	176
query7	4862	501	293	293
query8	294	236	218	218
query9	5516	2495	2483	2483
query10	426	301	253	253
query11	15048	15197	14861	14861
query12	171	107	107	107
query13	1021	493	379	379
query14	10470	6764	6760	6760
query15	199	196	201	196
query16	7113	661	500	500
query17	1048	708	556	556
query18	1578	414	313	313
query19	201	202	165	165
query20	123	120	120	120
query21	210	129	104	104
query22	4603	4646	4373	4373
query23	33862	33165	33312	33165
query24	5641	2456	2434	2434
query25	493	495	429	429
query26	725	285	164	164
query27	1727	507	343	343
query28	2748	2428	2379	2379
query29	606	586	444	444
query30	214	189	160	160
query31	911	852	826	826
query32	76	69	67	67
query33	468	364	324	324
query34	757	880	509	509
query35	779	874	741	741
query36	939	1014	907	907
query37	119	107	77	77
query38	4215	4395	4224	4224
query39	1474	1443	1437	1437
query40	208	117	110	110
query41	54	50	51	50
query42	125	105	110	105
query43	526	516	480	480
query44	1294	816	829	816
query45	180	178	168	168
query46	869	1059	670	670
query47	1899	1931	1760	1760
query48	377	408	322	322
query49	679	507	401	401
query50	716	762	425	425
query51	4302	4277	4272	4272
query52	108	102	96	96
query53	235	269	204	204
query54	490	492	420	420
query55	78	74	78	74
query56	264	287	291	287
query57	1169	1210	1135	1135
query58	251	254	260	254
query59	2750	2869	2823	2823
query60	284	302	266	266
query61	125	123	117	117
query62	747	732	696	696
query63	243	199	192	192
query64	1534	1013	657	657
query65	3199	3160	3128	3128
query66	762	402	294	294
query67	15807	15687	15428	15428
query68	4040	780	516	516
query69	487	307	272	272
query70	1199	1151	1156	1151
query71	408	282	268	268
query72	6274	3657	3773	3657
query73	763	751	364	364
query74	8975	9055	8644	8644
query75	3149	3128	2691	2691
query76	2753	1164	724	724
query77	533	424	273	273
query78	10220	10182	9341	9341
query79	1284	877	575	575
query80	870	542	446	446
query81	517	278	239	239
query82	416	155	118	118
query83	191	177	155	155
query84	285	96	70	70
query85	734	337	294	294
query86	356	297	294	294
query87	4487	4552	4408	4408
query88	2811	2234	2196	2196
query89	397	323	290	290
query90	1615	195	191	191
query91	149	136	109	109
query92	64	57	59	57
query93	1361	1022	570	570
query94	633	414	292	292
query95	342	267	258	258
query96	479	544	264	264
query97	2766	2864	2707	2707
query98	222	205	203	203
query99	1304	1411	1222	1222
Total cold run time: 287020 ms
Total hot run time: 190760 ms

@doris-robot
Copy link

TeamCity be ut coverage result:
Function Coverage: 42.06% (11021/26204)
Line Coverage: 32.34% (93040/287716)
Region Coverage: 31.50% (47705/151429)
Branch Coverage: 27.52% (24133/87694)
Coverage Report: http://coverage.selectdb-in.cc/coverage/aab5f81f3768f643337ffffcd5fa0af35aec516d_aab5f81f3768f643337ffffcd5fa0af35aec516d/report/index.html

@doris-robot
Copy link

ClickBench: Total hot run time: 31.06 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit aab5f81f3768f643337ffffcd5fa0af35aec516d, data reload: false

query1	0.03	0.03	0.03
query2	0.07	0.03	0.03
query3	0.24	0.08	0.06
query4	1.61	0.10	0.10
query5	0.41	0.43	0.39
query6	1.16	0.64	0.66
query7	0.03	0.02	0.02
query8	0.04	0.03	0.03
query9	0.58	0.51	0.52
query10	0.59	0.58	0.57
query11	0.15	0.10	0.11
query12	0.14	0.11	0.11
query13	0.63	0.60	0.60
query14	2.79	2.78	2.83
query15	0.94	0.84	0.86
query16	0.38	0.37	0.38
query17	1.04	1.02	1.02
query18	0.22	0.20	0.20
query19	1.87	1.80	1.99
query20	0.02	0.00	0.01
query21	15.35	0.88	0.52
query22	0.76	1.21	0.74
query23	14.85	1.42	0.64
query24	6.75	1.92	1.22
query25	0.56	0.13	0.06
query26	0.50	0.17	0.14
query27	0.06	0.05	0.05
query28	10.36	0.93	0.43
query29	12.62	4.04	3.35
query30	0.25	0.08	0.06
query31	2.82	0.59	0.38
query32	3.23	0.54	0.46
query33	2.98	2.99	3.04
query34	15.75	5.28	4.52
query35	4.56	4.54	4.50
query36	0.65	0.50	0.47
query37	0.09	0.07	0.06
query38	0.05	0.04	0.04
query39	0.03	0.03	0.02
query40	0.16	0.13	0.13
query41	0.08	0.03	0.03
query42	0.04	0.03	0.02
query43	0.04	0.03	0.03
Total cold run time: 105.48 s
Total hot run time: 31.06 s

@zhangstar333
Copy link
Contributor Author

run buildall

@github-actions github-actions bot removed the approved Indicates a PR has been approved by one committer. label Feb 7, 2025
@doris-robot
Copy link

TPC-H: Total hot run time: 31438 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 0f0f466754899d13a0240aa1be38b66b5cb7d296, data reload: false

------ Round 1 ----------------------------------
q1	17580	5227	5028	5028
q2	2051	305	197	197
q3	10377	1239	746	746
q4	10203	1004	523	523
q5	7539	2437	2321	2321
q6	180	161	130	130
q7	903	753	599	599
q8	9310	1288	1029	1029
q9	4884	4822	4640	4640
q10	6800	2309	1883	1883
q11	493	284	265	265
q12	340	351	220	220
q13	17771	3688	3149	3149
q14	232	233	216	216
q15	507	471	474	471
q16	623	621	570	570
q17	560	865	327	327
q18	6690	6273	6185	6185
q19	1462	945	533	533
q20	320	320	195	195
q21	2730	2111	1917	1917
q22	358	332	294	294
Total cold run time: 101913 ms
Total hot run time: 31438 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5137	5065	5067	5065
q2	236	331	238	238
q3	2154	2710	2281	2281
q4	1429	1799	1357	1357
q5	4267	4127	4184	4127
q6	212	166	129	129
q7	1896	1864	1660	1660
q8	2601	2770	2648	2648
q9	7240	7225	7130	7130
q10	3023	3210	2813	2813
q11	603	519	496	496
q12	675	779	630	630
q13	3320	3975	3247	3247
q14	274	321	270	270
q15	525	472	471	471
q16	633	683	626	626
q17	1121	1573	1374	1374
q18	7564	7328	7452	7328
q19	737	867	898	867
q20	1981	2003	1877	1877
q21	5474	4996	4727	4727
q22	650	588	544	544
Total cold run time: 51752 ms
Total hot run time: 49905 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 189971 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 0f0f466754899d13a0240aa1be38b66b5cb7d296, data reload: false

query1	1322	944	942	942
query2	6135	1887	1840	1840
query3	10959	4409	4408	4408
query4	54477	25935	23288	23288
query5	5163	552	489	489
query6	364	193	192	192
query7	5050	500	296	296
query8	323	230	210	210
query9	6401	2485	2487	2485
query10	415	330	263	263
query11	15261	15117	14956	14956
query12	154	107	103	103
query13	1126	516	372	372
query14	10677	6781	6429	6429
query15	204	199	177	177
query16	7035	663	493	493
query17	1095	766	587	587
query18	1587	431	314	314
query19	206	197	179	179
query20	128	134	122	122
query21	211	129	106	106
query22	4515	4526	4309	4309
query23	34110	33532	33366	33366
query24	5614	2427	2430	2427
query25	478	443	403	403
query26	713	280	161	161
query27	1833	502	328	328
query28	3070	2422	2409	2409
query29	613	561	423	423
query30	213	199	162	162
query31	884	895	779	779
query32	72	67	68	67
query33	443	366	302	302
query34	766	941	491	491
query35	814	827	744	744
query36	959	985	897	897
query37	131	134	81	81
query38	4370	4320	4298	4298
query39	1533	1426	1417	1417
query40	219	114	106	106
query41	51	49	49	49
query42	128	103	109	103
query43	497	491	475	475
query44	1297	810	828	810
query45	178	177	169	169
query46	870	1053	667	667
query47	1886	1888	1818	1818
query48	400	429	309	309
query49	708	526	434	434
query50	707	746	414	414
query51	4333	4311	4212	4212
query52	107	106	97	97
query53	231	254	194	194
query54	514	485	437	437
query55	84	83	82	82
query56	279	287	257	257
query57	1168	1198	1133	1133
query58	244	249	246	246
query59	2816	2983	2753	2753
query60	299	274	254	254
query61	125	117	154	117
query62	759	761	653	653
query63	234	198	189	189
query64	1808	1022	706	706
query65	3278	3296	3148	3148
query66	777	451	316	316
query67	15928	15672	15586	15586
query68	4551	789	538	538
query69	510	307	269	269
query70	1179	1108	1092	1092
query71	458	287	260	260
query72	6359	3655	3738	3655
query73	830	734	341	341
query74	8981	9168	8684	8684
query75	3196	3139	2744	2744
query76	3658	1171	755	755
query77	528	360	281	281
query78	10060	10218	9277	9277
query79	2175	813	589	589
query80	748	516	444	444
query81	528	281	240	240
query82	422	147	178	147
query83	179	167	153	153
query84	291	89	68	68
query85	737	351	302	302
query86	369	308	288	288
query87	4626	4454	4425	4425
query88	3115	2170	2154	2154
query89	403	310	291	291
query90	1759	186	187	186
query91	139	137	110	110
query92	73	56	55	55
query93	2837	1046	585	585
query94	716	407	302	302
query95	341	269	259	259
query96	472	561	263	263
query97	2823	2839	2723	2723
query98	224	210	199	199
query99	1309	1364	1243	1243
Total cold run time: 293945 ms
Total hot run time: 189971 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.54 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 0f0f466754899d13a0240aa1be38b66b5cb7d296, data reload: false

query1	0.03	0.03	0.03
query2	0.07	0.06	0.04
query3	0.24	0.07	0.07
query4	1.62	0.10	0.11
query5	0.42	0.41	0.40
query6	1.17	0.66	0.65
query7	0.02	0.01	0.01
query8	0.04	0.02	0.04
query9	0.59	0.52	0.51
query10	0.59	0.58	0.57
query11	0.16	0.11	0.11
query12	0.14	0.11	0.12
query13	0.62	0.61	0.61
query14	2.70	2.82	2.74
query15	0.91	0.85	0.85
query16	0.38	0.38	0.38
query17	0.99	1.00	1.01
query18	0.22	0.19	0.19
query19	1.87	1.82	1.94
query20	0.01	0.01	0.01
query21	15.37	0.91	0.54
query22	0.77	1.21	0.68
query23	14.91	1.40	0.65
query24	6.96	1.64	0.61
query25	0.58	0.22	0.16
query26	0.59	0.17	0.13
query27	0.06	0.05	0.04
query28	10.23	0.86	0.42
query29	12.56	3.97	3.32
query30	0.25	0.09	0.07
query31	2.84	0.59	0.38
query32	3.23	0.56	0.47
query33	2.97	3.08	3.04
query34	15.77	5.09	4.56
query35	4.54	4.47	4.51
query36	0.67	0.50	0.49
query37	0.09	0.07	0.06
query38	0.05	0.03	0.03
query39	0.03	0.03	0.02
query40	0.17	0.14	0.12
query41	0.08	0.02	0.02
query42	0.03	0.02	0.03
query43	0.03	0.04	0.02
Total cold run time: 105.57 s
Total hot run time: 30.54 s

@doris-robot
Copy link

TeamCity be ut coverage result:
Function Coverage: 42.06% (11026/26216)
Line Coverage: 32.33% (93056/287836)
Region Coverage: 31.50% (47709/151464)
Branch Coverage: 27.51% (24127/87710)
Coverage Report: http://coverage.selectdb-in.cc/coverage/0f0f466754899d13a0240aa1be38b66b5cb7d296_0f0f466754899d13a0240aa1be38b66b5cb7d296/report/index.html

@zhangstar333
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 31490 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit a2e4ce7406d72c57f4914801d7c4c18d37346229, data reload: false

------ Round 1 ----------------------------------
q1	17585	5322	5132	5132
q2	2055	321	173	173
q3	10388	1247	731	731
q4	10247	1031	528	528
q5	7940	2431	2367	2367
q6	192	175	131	131
q7	898	759	597	597
q8	9314	1279	1110	1110
q9	4851	4783	4540	4540
q10	6829	2314	1885	1885
q11	488	277	256	256
q12	347	360	227	227
q13	17767	3746	3080	3080
q14	234	228	217	217
q15	519	470	464	464
q16	629	623	589	589
q17	591	869	339	339
q18	6636	6359	6210	6210
q19	1240	954	561	561
q20	311	320	185	185
q21	2851	2154	1875	1875
q22	375	325	293	293
Total cold run time: 102287 ms
Total hot run time: 31490 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5181	5148	5147	5147
q2	242	328	230	230
q3	2186	2700	2305	2305
q4	1484	1918	1411	1411
q5	4293	4186	4213	4186
q6	208	175	124	124
q7	1918	1852	1771	1771
q8	2653	2632	2580	2580
q9	7193	7269	7130	7130
q10	3055	3222	2794	2794
q11	586	524	503	503
q12	702	820	676	676
q13	3478	4024	3348	3348
q14	283	289	267	267
q15	521	450	476	450
q16	636	700	654	654
q17	1194	1611	1397	1397
q18	7724	7430	7382	7382
q19	805	805	842	805
q20	1958	2054	1882	1882
q21	5491	5100	4874	4874
q22	656	556	531	531
Total cold run time: 52447 ms
Total hot run time: 50447 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 190012 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit a2e4ce7406d72c57f4914801d7c4c18d37346229, data reload: false

query1	1290	969	951	951
query2	6218	1919	1876	1876
query3	11000	4434	4252	4252
query4	53373	25579	23139	23139
query5	5028	588	474	474
query6	333	195	193	193
query7	4872	520	301	301
query8	316	254	238	238
query9	5428	2516	2514	2514
query10	418	318	260	260
query11	15115	15059	15030	15030
query12	164	116	109	109
query13	1034	537	383	383
query14	10326	6989	6492	6492
query15	212	221	215	215
query16	7170	615	497	497
query17	1061	707	560	560
query18	1630	442	316	316
query19	199	203	174	174
query20	130	129	121	121
query21	203	122	107	107
query22	4573	4404	4160	4160
query23	33833	33484	33413	33413
query24	5594	2455	2449	2449
query25	458	458	413	413
query26	727	292	155	155
query27	1858	488	347	347
query28	2823	2430	2405	2405
query29	616	563	429	429
query30	211	190	155	155
query31	871	885	838	838
query32	71	70	64	64
query33	469	394	328	328
query34	800	874	540	540
query35	825	852	752	752
query36	965	1008	903	903
query37	132	109	81	81
query38	4378	4596	4333	4333
query39	1485	1436	1620	1436
query40	207	138	102	102
query41	54	52	49	49
query42	124	103	105	103
query43	511	524	494	494
query44	1357	804	806	804
query45	189	181	165	165
query46	913	1079	689	689
query47	1850	1846	1777	1777
query48	396	428	305	305
query49	677	496	430	430
query50	736	765	417	417
query51	4268	4333	4249	4249
query52	114	116	102	102
query53	254	274	194	194
query54	494	496	422	422
query55	86	82	84	82
query56	262	291	270	270
query57	1168	1184	1120	1120
query58	249	243	251	243
query59	2952	2921	2688	2688
query60	290	281	275	275
query61	147	122	156	122
query62	754	754	684	684
query63	243	200	197	197
query64	1838	1115	682	682
query65	3243	3202	3156	3156
query66	787	385	293	293
query67	15851	15569	15338	15338
query68	5586	798	516	516
query69	521	302	264	264
query70	1231	1113	1120	1113
query71	447	302	259	259
query72	5934	3701	3800	3701
query73	1395	751	345	345
query74	9018	9284	8784	8784
query75	3169	3146	2695	2695
query76	3902	1187	780	780
query77	555	371	288	288
query78	9901	9919	9290	9290
query79	2786	819	610	610
query80	661	521	460	460
query81	482	269	245	245
query82	527	152	120	120
query83	267	177	159	159
query84	292	87	71	71
query85	765	343	296	296
query86	417	309	292	292
query87	4498	4652	4485	4485
query88	3569	2167	2146	2146
query89	403	310	283	283
query90	1731	196	194	194
query91	130	134	107	107
query92	85	58	52	52
query93	2047	1036	575	575
query94	726	397	299	299
query95	346	271	258	258
query96	485	562	268	268
query97	2813	2850	2723	2723
query98	237	213	206	206
query99	1421	1406	1273	1273
Total cold run time: 292570 ms
Total hot run time: 190012 ms

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@HappenLee HappenLee HappenLee left review comments

At least 1 approving review is required to merge this pull request.

Assignees
No one assigned
Labels
reviewed
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
6 participants
@zhangstar333 @Thearas @doris-robot @LiBinfeng-01 @morrySnow @HappenLee