Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Enhancement] config rf wait time in cloud mode #47579

Open
wants to merge 1 commit into
base: master
Choose a base branch
from

Conversation

xzj7019
Copy link
Contributor

@xzj7019 xzj7019 commented Feb 7, 2025

What problem does this PR solve?

Issue Number: close #xxx

Related PR: #xxx

Problem Summary: config rf wait time in cloud mode

Release note

None

Check List (For Author)

  • Test

    • Regression test
    • Unit Test
    • Manual test (add detailed scripts or steps below)
    • No need to test or manual test. Explain why:
      • This is a refactor/code format and no logic has been changed.
      • Previous test can cover this change.
      • No code files have been changed.
      • Other reason
  • Behavior changed:

    • No.
    • Yes.
  • Does this need documentation?

    • No.
    • Yes.

Check List (For Reviewer who merge this PR)

  • Confirm the release note
  • Confirm test cases
  • Confirm document
  • Add branch pick label

@xzj7019 xzj7019 marked this pull request as draft February 7, 2025 04:37
@hello-stephen
Copy link
Contributor

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

@xzj7019
Copy link
Contributor Author

xzj7019 commented Feb 7, 2025

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 31349 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit b9dcb01c2627017719e4533095e6904546d478b3, data reload: false

------ Round 1 ----------------------------------
q1	17585	5233	5019	5019
q2	2044	300	175	175
q3	10483	1245	773	773
q4	10202	998	546	546
q5	7765	2302	2426	2302
q6	195	171	134	134
q7	912	760	590	590
q8	9303	1287	1098	1098
q9	4782	4628	4785	4628
q10	6813	2313	1875	1875
q11	476	272	247	247
q12	348	354	211	211
q13	17754	3664	3080	3080
q14	223	237	214	214
q15	516	468	461	461
q16	616	611	571	571
q17	578	840	359	359
q18	6875	6140	6116	6116
q19	1198	938	539	539
q20	306	324	179	179
q21	2815	2103	1936	1936
q22	356	330	296	296
Total cold run time: 102145 ms
Total hot run time: 31349 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5070	5074	5083	5074
q2	234	323	228	228
q3	2179	2678	2335	2335
q4	1482	1844	1383	1383
q5	4221	4120	4121	4120
q6	209	163	126	126
q7	1859	1802	1632	1632
q8	2553	2664	2532	2532
q9	7211	7218	7186	7186
q10	3026	3202	2763	2763
q11	566	500	501	500
q12	681	784	604	604
q13	3524	3879	3264	3264
q14	294	303	257	257
q15	522	455	477	455
q16	650	705	638	638
q17	1138	1560	1338	1338
q18	7713	7297	7335	7297
q19	775	775	843	775
q20	1990	1997	1839	1839
q21	5438	5003	4693	4693
q22	646	582	553	553
Total cold run time: 51981 ms
Total hot run time: 49592 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 190159 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit b9dcb01c2627017719e4533095e6904546d478b3, data reload: false

query1	1308	956	928	928
query2	6200	1815	1843	1815
query3	10993	4547	4568	4547
query4	56870	26030	23718	23718
query5	5225	494	472	472
query6	401	180	191	180
query7	5311	508	286	286
query8	324	250	233	233
query9	7351	2494	2523	2494
query10	414	312	254	254
query11	16060	15230	14871	14871
query12	166	111	110	110
query13	1300	568	415	415
query14	10253	6420	7201	6420
query15	213	206	196	196
query16	7079	668	499	499
query17	1046	702	576	576
query18	1542	403	320	320
query19	204	189	157	157
query20	138	119	122	119
query21	207	120	104	104
query22	4258	4335	4467	4335
query23	33914	33505	33158	33158
query24	5707	2446	2418	2418
query25	467	452	397	397
query26	658	269	158	158
query27	1774	500	339	339
query28	3178	2434	2423	2423
query29	581	575	427	427
query30	212	201	157	157
query31	906	905	802	802
query32	75	65	70	65
query33	448	367	308	308
query34	785	846	522	522
query35	813	829	741	741
query36	927	1005	922	922
query37	142	104	78	78
query38	4281	4303	4317	4303
query39	1482	1424	1461	1424
query40	218	120	104	104
query41	49	56	50	50
query42	128	104	104	104
query43	513	494	479	479
query44	1344	808	798	798
query45	178	175	163	163
query46	907	1073	652	652
query47	1869	1846	1780	1780
query48	389	427	314	314
query49	707	531	425	425
query50	726	749	438	438
query51	4191	4287	4379	4287
query52	109	108	92	92
query53	242	271	185	185
query54	493	479	414	414
query55	88	77	78	77
query56	262	288	256	256
query57	1175	1167	1122	1122
query58	261	241	260	241
query59	2828	2800	2632	2632
query60	302	284	280	280
query61	123	118	115	115
query62	750	752	672	672
query63	230	189	189	189
query64	1476	1040	684	684
query65	3311	3146	3118	3118
query66	670	398	298	298
query67	15768	15471	15347	15347
query68	4577	784	522	522
query69	494	296	257	257
query70	1182	1108	1110	1108
query71	414	305	277	277
query72	5234	3696	3800	3696
query73	800	747	341	341
query74	8987	9136	8918	8918
query75	3243	3127	2658	2658
query76	2980	1164	736	736
query77	578	380	289	289
query78	10107	10385	9327	9327
query79	983	897	582	582
query80	785	542	445	445
query81	523	272	236	236
query82	263	153	128	128
query83	188	164	148	148
query84	279	97	75	75
query85	880	352	297	297
query86	320	314	272	272
query87	4521	4550	4430	4430
query88	2761	2192	2149	2149
query89	430	305	287	287
query90	1659	194	187	187
query91	134	146	106	106
query92	67	60	54	54
query93	1545	1005	575	575
query94	601	394	299	299
query95	342	303	251	251
query96	473	577	262	262
query97	2750	2857	2753	2753
query98	227	195	201	195
query99	1311	1399	1292	1292
Total cold run time: 292158 ms
Total hot run time: 190159 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.51 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit b9dcb01c2627017719e4533095e6904546d478b3, data reload: false

query1	0.03	0.03	0.03
query2	0.06	0.04	0.03
query3	0.24	0.07	0.06
query4	1.61	0.10	0.11
query5	0.41	0.42	0.40
query6	1.15	0.67	0.66
query7	0.02	0.02	0.01
query8	0.04	0.03	0.03
query9	0.58	0.55	0.52
query10	0.57	0.59	0.59
query11	0.15	0.11	0.11
query12	0.15	0.10	0.11
query13	0.62	0.60	0.60
query14	2.72	2.85	2.81
query15	0.92	0.85	0.83
query16	0.37	0.38	0.39
query17	1.06	1.03	1.02
query18	0.21	0.19	0.20
query19	1.91	1.84	2.03
query20	0.01	0.01	0.01
query21	15.37	0.89	0.55
query22	0.75	1.07	0.65
query23	15.06	1.39	0.62
query24	7.21	2.02	0.55
query25	0.51	0.25	0.18
query26	0.55	0.17	0.13
query27	0.05	0.05	0.05
query28	9.21	0.84	0.41
query29	12.58	4.04	3.29
query30	0.25	0.08	0.06
query31	2.83	0.59	0.38
query32	3.23	0.54	0.45
query33	2.98	3.04	3.05
query34	15.62	5.10	4.50
query35	4.55	4.52	4.53
query36	0.69	0.50	0.48
query37	0.08	0.06	0.06
query38	0.05	0.04	0.04
query39	0.03	0.03	0.03
query40	0.17	0.14	0.13
query41	0.08	0.02	0.03
query42	0.04	0.02	0.02
query43	0.03	0.03	0.03
Total cold run time: 104.75 s
Total hot run time: 30.51 s

@xzj7019 xzj7019 marked this pull request as ready for review February 7, 2025 07:52
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants