Skip to content

Eager agg 0115#59944

Draft
englefly wants to merge 26 commits intoapache:masterfrom
englefly:eager-agg-0115
Draft

Eager agg 0115#59944
englefly wants to merge 26 commits intoapache:masterfrom
englefly:eager-agg-0115

Conversation

@englefly
Copy link
Contributor

What problem does this PR solve?

Issue Number: close #xxx

Related PR: #xxx

Problem Summary:

Release note

None

Check List (For Author)

  • Test

    • Regression test
    • Unit Test
    • Manual test (add detailed scripts or steps below)
    • No need to test or manual test. Explain why:
      • This is a refactor/code format and no logic has been changed.
      • Previous test can cover this change.
      • No code files have been changed.
      • Other reason
  • Behavior changed:

    • No.
    • Yes.
  • Does this need documentation?

    • No.
    • Yes.

Check List (For Reviewer who merge this PR)

  • Confirm the release note
  • Confirm test cases
  • Confirm document
  • Add branch pick label

@Thearas
Copy link
Contributor

Thearas commented Jan 16, 2026

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

@englefly englefly marked this pull request as draft January 16, 2026 01:05
@englefly
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-DS: Total hot run time: 147914 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit a4174ef9d9794b16a0e782fb94e7916d3c027995, data reload: false

query5	4452	680	515	515
query6	387	250	229	229
query7	4226	488	280	280
query8	365	273	251	251
query9	8721	3180	3162	3162
query10	558	399	344	344
query11	6990	5258	4999	4999
query12	196	126	120	120
query13	1282	538	438	438
query14	5690	3127	2919	2919
query14_1	2815	2789	2771	2771
query15	210	199	177	177
query16	1013	488	482	482
query17	900	717	598	598
query18	2465	456	356	356
query19	238	238	216	216
query20	125	121	128	121
query21	225	143	129	129
query22	3871	4038	3982	3982
query23	15602	15062	14454	14454
query23_1	14701	14564	14968	14564
query24	7277	1643	1314	1314
query24_1	1225	1367	1304	1304
query25	660	473	400	400
query26	1429	287	166	166
query27	3009	511	319	319
query28	4985	2466	2486	2466
query29	913	565	472	472
query30	332	268	221	221
query31	1386	1301	1224	1224
query32	89	74	79	74
query33	547	348	331	331
query34	925	1013	582	582
query35	752	791	708	708
query36	1058	1016	943	943
query37	145	103	85	85
query38	1540	1606	1630	1606
query39	864	798	775	775
query39_1	775	758	776	758
query40	220	147	141	141
query41	71	78	64	64
query42	291	304	284	284
query43	272	278	237	237
query44	1446	819	817	817
query45	185	182	172	172
query46	891	982	606	606
query47	1452	1491	1462	1462
query48	361	341	266	266
query49	614	437	351	351
query50	684	294	218	218
query51	3789	3864	3887	3864
query52	285	288	271	271
query53	327	337	287	287
query54	306	277	273	273
query55	92	89	84	84
query56	314	337	330	330
query57	1075	1011	909	909
query58	293	269	266	266
query59	1377	1471	1288	1288
query60	360	352	338	338
query61	169	155	170	155
query62	405	381	314	314
query63	304	276	269	269
query64	5057	1332	1050	1050
query65	3886	3726	3732	3726
query66	1489	430	338	338
query67	15825	15694	15616	15616
query68	2623	1194	846	846
query69	453	394	368	368
query70	1065	1046	1006	1006
query71	339	329	309	309
query72	5470	3377	3371	3371
query73	663	758	343	343
query74	8698	8773	8629	8629
query75	2739	2810	2507	2507
query76	2264	1090	717	717
query77	384	404	328	328
query78	9862	9941	9155	9155
query79	1147	957	630	630
query80	1334	656	512	512
query81	556	276	233	233
query82	1050	142	118	118
query83	354	270	263	263
query84	311	136	107	107
query85	934	534	471	471
query86	422	352	312	312
query87	1725	1722	1626	1626
query88	3923	2865	2869	2865
query89	408	354	339	339
query90	2009	180	171	171
query91	187	178	148	148
query92	84	75	76	75
query93	1101	967	582	582
query94	661	332	327	327
query95	613	347	382	347
query96	735	543	257	257
query97	2369	2386	2321	2321
query98	243	212	210	210
query99	647	604	562	562
Total cold run time: 233923 ms
Total hot run time: 147914 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 27.27 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit a4174ef9d9794b16a0e782fb94e7916d3c027995, data reload: false

query1	0.06	0.04	0.05
query2	0.12	0.05	0.05
query3	0.26	0.09	0.08
query4	1.64	0.13	0.12
query5	0.28	0.26	0.26
query6	1.15	0.68	0.66
query7	0.03	0.03	0.03
query8	0.06	0.04	0.04
query9	0.58	0.50	0.50
query10	0.56	0.57	0.57
query11	0.15	0.10	0.11
query12	0.16	0.11	0.12
query13	0.61	0.60	0.59
query14	0.95	0.96	0.96
query15	0.80	0.78	0.78
query16	0.40	0.40	0.40
query17	1.07	1.07	1.02
query18	0.24	0.22	0.22
query19	1.94	1.89	1.85
query20	0.02	0.01	0.02
query21	15.42	0.26	0.15
query22	5.45	0.06	0.05
query23	15.81	0.31	0.11
query24	1.57	0.40	0.56
query25	0.09	0.12	0.06
query26	0.15	0.14	0.14
query27	0.08	0.04	0.05
query28	4.20	1.09	0.90
query29	12.53	4.17	3.30
query30	0.28	0.14	0.12
query31	2.82	0.65	0.41
query32	3.25	0.58	0.47
query33	3.19	3.01	3.04
query34	15.86	5.08	4.43
query35	4.49	4.45	4.43
query36	0.65	0.51	0.49
query37	0.11	0.08	0.06
query38	0.08	0.05	0.04
query39	0.05	0.04	0.03
query40	0.19	0.14	0.14
query41	0.09	0.04	0.03
query42	0.05	0.04	0.03
query43	0.04	0.04	0.04
Total cold run time: 97.53 s
Total hot run time: 27.27 s

@englefly
Copy link
Contributor Author

run buildall

的分支,而不是大分支. ds37/38/82/87 受到影响。select distinct A from T1 join T2 on ... group by A`
1. union 的孩子不能部分改写
2. agg 输入字段和 group key 有交集,则不下推
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants