Skip to content

Conversation

@xylaaaaa
Copy link
Contributor

@xylaaaaa xylaaaaa commented Feb 2, 2026

What problem does this PR solve?

Issue Number: close #xxx

Related PR: #xxx

Problem Summary:

  • Upgrade thirdparty Snappy from 1.1.8 to 1.1.10 to match paimon-cpp.

Release note

None

Check List (For Author)

  • Test

    • Regression test
    • Unit Test
    • Manual test (add detailed scripts or steps below)
    • No need to test or manual test. Explain why:
      • This is a refactor/code format and no logic has been changed.
      • Previous test can cover this change.
      • No code files have been changed.
      • Other reason
  • Behavior changed:

    • No.
    • Yes.
  • Does this need documentation?

    • No.
    • Yes.

Check List (For Reviewer who merge this PR)

  • Confirm the release note
  • Confirm test cases
  • Confirm document
  • Add branch pick label

Copilot AI review requested due to automatic review settings February 2, 2026 04:41
@hello-stephen
Copy link
Contributor

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

Copy link

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Upgrades the bundled third-party Snappy dependency to a newer upstream release and records the change in the thirdparty changelog.

Changes:

  • Bump Snappy from 1.1.8 to 1.1.10 in third-party build variables (download URL, source dir, checksum).
  • Add a thirdparty changelog entry documenting the Snappy upgrade.

Reviewed changes

Copilot reviewed 2 out of 2 changed files in this pull request and generated 2 comments.

File Description
thirdparty/vars.sh Updates Snappy download/source/checksum metadata to 1.1.10 for the thirdparty build pipeline.
thirdparty/CHANGELOG.md Adds a dated entry noting the Snappy version upgrade.

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

Comment on lines +5 to 11
## 20260202

- Modified: snappy 1.1.8 -> 1.1.10

## 20151222

- Added: timsort (cpp-TimSort 3.x.y)
Copy link

Copilot AI Feb 2, 2026

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The changelog entries appear intended to be in reverse chronological order (e.g., 20251127 -> 20251031 -> …), but the existing ## 20151222 section now sits between 20260202 and 20251127. To keep the history readable, please move the 20151222 section to the bottom (or otherwise restore consistent chronological ordering).

Copilot uses AI. Check for mistakes.
SNAPPY_DOWNLOAD="https://github.com/google/snappy/archive/1.1.10.tar.gz"
SNAPPY_NAME=snappy-1.1.10.tar.gz
SNAPPY_SOURCE=snappy-1.1.10
SNAPPY_MD5SUM="70153395ebe6d72febe2cf2e40026a44"
Copy link

Copilot AI Feb 2, 2026

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

SNAPPY_MD5SUM uses MD5 to verify the integrity of the downloaded Snappy source archive, relying on a cryptographically broken hash algorithm. An attacker who can influence the downloaded archive could exploit MD5 collision weaknesses to craft a malicious tarball that still matches this checksum, resulting in compromised build artifacts. Prefer a stronger hash function such as SHA-256 and update both the stored checksum and verification logic to use it for third-party downloads.

Suggested change
SNAPPY_MD5SUM="70153395ebe6d72febe2cf2e40026a44"
# Use SHA-256 for integrity verification of the Snappy source archive.
# Compute the correct value with: sha256sum snappy-1.1.10.tar.gz
SNAPPY_SHA256SUM=""
# Deprecated: do not use MD5 for integrity checks.
SNAPPY_MD5SUM=""

Copilot uses AI. Check for mistakes.
morningman
morningman previously approved these changes Feb 2, 2026
Copy link
Contributor

@morningman morningman left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@morningman
Copy link
Contributor

run buildall

@github-actions github-actions bot added the approved Indicates a PR has been approved by one committer. label Feb 2, 2026
@github-actions
Copy link
Contributor

github-actions bot commented Feb 2, 2026

PR approved by at least one committer and no changes requested.

@github-actions
Copy link
Contributor

github-actions bot commented Feb 2, 2026

PR approved by anyone and no changes requested.

@doris-robot
Copy link

TPC-H: Total hot run time: 32106 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 752cd3144edbd60df18b326731b36da73eb08ff7, data reload: false

------ Round 1 ----------------------------------
q1	17660	5179	5028	5028
q2	2033	300	198	198
q3	10213	1301	737	737
q4	10209	855	306	306
q5	7526	2153	1904	1904
q6	195	181	149	149
q7	912	746	606	606
q8	9292	1398	1085	1085
q9	5078	4894	4926	4894
q10	6767	1955	1590	1590
q11	522	304	279	279
q12	337	379	224	224
q13	17759	4076	3226	3226
q14	242	251	222	222
q15	899	817	820	817
q16	696	672	627	627
q17	632	799	463	463
q18	6997	6500	7564	6500
q19	1346	1006	654	654
q20	442	359	241	241
q21	2990	2180	2076	2076
q22	355	318	280	280
Total cold run time: 103102 ms
Total hot run time: 32106 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5548	5463	5485	5463
q2	307	367	259	259
q3	2364	2902	2520	2520
q4	1527	1801	1411	1411
q5	4589	4399	4530	4399
q6	218	178	138	138
q7	2000	1971	1868	1868
q8	2586	2415	2591	2415
q9	7570	7409	7645	7409
q10	2822	3017	2662	2662
q11	548	459	454	454
q12	655	716	585	585
q13	3976	4302	3306	3306
q14	276	288	257	257
q15	835	783	781	781
q16	636	676	635	635
q17	1063	1208	1249	1208
q18	7564	7298	7182	7182
q19	839	795	794	794
q20	1965	2075	1894	1894
q21	4513	4171	4003	4003
q22	570	529	487	487
Total cold run time: 52971 ms
Total hot run time: 50130 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 28.18 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 752cd3144edbd60df18b326731b36da73eb08ff7, data reload: false

query1	0.06	0.05	0.05
query2	0.09	0.04	0.04
query3	0.25	0.08	0.09
query4	1.61	0.11	0.11
query5	0.26	0.24	0.24
query6	1.16	0.68	0.66
query7	0.03	0.03	0.03
query8	0.05	0.03	0.04
query9	0.56	0.51	0.48
query10	0.55	0.55	0.55
query11	0.14	0.09	0.10
query12	0.14	0.10	0.10
query13	0.61	0.61	0.62
query14	1.06	1.06	1.05
query15	0.88	0.86	0.86
query16	0.38	0.40	0.40
query17	1.16	1.15	1.08
query18	0.23	0.21	0.20
query19	2.05	1.96	2.00
query20	0.02	0.01	0.01
query21	15.41	0.28	0.14
query22	5.04	0.05	0.05
query23	15.86	0.28	0.11
query24	1.74	0.77	0.32
query25	0.12	0.06	0.06
query26	0.14	0.14	0.14
query27	0.08	0.05	0.06
query28	4.49	1.13	0.96
query29	12.56	3.88	3.18
query30	0.29	0.14	0.12
query31	2.82	0.63	0.39
query32	3.24	0.59	0.51
query33	3.28	3.26	3.22
query34	16.32	5.39	4.72
query35	4.84	4.79	4.72
query36	0.66	0.51	0.49
query37	0.12	0.07	0.07
query38	0.07	0.04	0.03
query39	0.04	0.03	0.03
query40	0.19	0.16	0.15
query41	0.09	0.03	0.03
query42	0.04	0.02	0.02
query43	0.05	0.05	0.04
Total cold run time: 98.78 s
Total hot run time: 28.18 s

@xylaaaaa
Copy link
Contributor Author

xylaaaaa commented Feb 2, 2026

run buildall

@github-actions github-actions bot removed the approved Indicates a PR has been approved by one committer. label Feb 2, 2026
@doris-robot
Copy link

TPC-H: Total hot run time: 32253 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit ecffa06225edfe1e211308633973f129057f12e9, data reload: false

------ Round 1 ----------------------------------
q1	17649	5239	5064	5064
q2	2015	311	226	226
q3	10203	1400	779	779
q4	10206	854	311	311
q5	7513	2174	1902	1902
q6	194	178	147	147
q7	890	736	615	615
q8	9272	1351	1125	1125
q9	5101	4829	4801	4801
q10	6755	1947	1587	1587
q11	496	299	278	278
q12	335	398	223	223
q13	17785	4060	3214	3214
q14	235	251	218	218
q15	887	841	834	834
q16	685	711	637	637
q17	632	794	507	507
q18	7041	6564	7591	6564
q19	1275	1036	657	657
q20	424	368	260	260
q21	2942	2256	2012	2012
q22	389	334	292	292
Total cold run time: 102924 ms
Total hot run time: 32253 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5658	5476	5424	5424
q2	264	376	268	268
q3	2338	3062	2422	2422
q4	1465	1862	1524	1524
q5	4734	4649	4557	4557
q6	221	176	136	136
q7	2099	1896	1815	1815
q8	2553	2415	2357	2357
q9	7640	7374	7701	7374
q10	2811	2983	2634	2634
q11	582	498	505	498
q12	688	790	623	623
q13	4016	4331	3463	3463
q14	288	320	286	286
q15	885	826	798	798
q16	683	708	634	634
q17	1093	1331	1306	1306
q18	7643	7403	7401	7401
q19	824	792	804	792
q20	1954	2053	1899	1899
q21	4554	4269	4139	4139
q22	558	539	503	503
Total cold run time: 53551 ms
Total hot run time: 50853 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 28.24 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit ecffa06225edfe1e211308633973f129057f12e9, data reload: false

query1	0.06	0.05	0.05
query2	0.10	0.04	0.04
query3	0.26	0.09	0.07
query4	1.60	0.11	0.12
query5	0.27	0.24	0.25
query6	1.17	0.68	0.69
query7	0.03	0.02	0.02
query8	0.06	0.04	0.04
query9	0.58	0.51	0.49
query10	0.54	0.54	0.55
query11	0.15	0.09	0.09
query12	0.14	0.10	0.10
query13	0.63	0.62	0.61
query14	1.07	1.07	1.04
query15	0.88	0.87	0.88
query16	0.40	0.40	0.42
query17	1.13	1.11	1.07
query18	0.22	0.20	0.21
query19	2.12	2.03	2.11
query20	0.02	0.02	0.01
query21	15.42	0.28	0.14
query22	5.17	0.05	0.05
query23	16.05	0.27	0.10
query24	0.93	1.13	0.29
query25	0.09	0.06	0.06
query26	0.14	0.13	0.14
query27	0.06	0.04	0.06
query28	3.72	1.14	0.96
query29	12.60	3.88	3.13
query30	0.28	0.13	0.12
query31	2.81	0.63	0.40
query32	3.26	0.58	0.49
query33	3.19	3.30	3.27
query34	16.28	5.37	4.71
query35	4.77	4.81	4.78
query36	0.65	0.50	0.49
query37	0.11	0.07	0.07
query38	0.06	0.04	0.03
query39	0.05	0.03	0.03
query40	0.18	0.16	0.16
query41	0.09	0.03	0.04
query42	0.04	0.02	0.02
query43	0.05	0.04	0.04
Total cold run time: 97.43 s
Total hot run time: 28.24 s

@xylaaaaa
Copy link
Contributor Author

xylaaaaa commented Feb 2, 2026

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 31798 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 1094976e63b08a1bcf6b9112c2f9f3fe1d432768, data reload: false

------ Round 1 ----------------------------------
q1	17617	5349	5080	5080
q2	2053	302	218	218
q3	10220	1274	731	731
q4	10207	832	319	319
q5	7534	2153	1889	1889
q6	195	180	149	149
q7	886	715	603	603
q8	9263	1394	1093	1093
q9	5245	4794	4820	4794
q10	6810	1959	1560	1560
q11	515	279	286	279
q12	337	374	219	219
q13	17767	4102	3266	3266
q14	231	237	224	224
q15	903	852	810	810
q16	665	673	625	625
q17	656	839	430	430
q18	6910	6673	6495	6495
q19	1119	976	622	622
q20	382	340	229	229
q21	2616	1996	1898	1898
q22	351	311	265	265
Total cold run time: 102482 ms
Total hot run time: 31798 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5337	5304	5299	5299
q2	260	342	239	239
q3	2201	2662	2287	2287
q4	1318	1711	1292	1292
q5	4320	4224	4291	4224
q6	236	188	148	148
q7	2246	2125	1928	1928
q8	2621	2488	2462	2462
q9	7527	7521	7587	7521
q10	2770	3094	2692	2692
q11	571	486	477	477
q12	738	729	604	604
q13	3832	4412	3469	3469
q14	287	314	279	279
q15	872	821	819	819
q16	683	755	687	687
q17	1180	1498	1424	1424
q18	8045	7931	7805	7805
q19	892	856	900	856
q20	2069	2261	2079	2079
q21	4790	4587	4202	4202
q22	568	525	494	494
Total cold run time: 53363 ms
Total hot run time: 51287 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 28.59 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 1094976e63b08a1bcf6b9112c2f9f3fe1d432768, data reload: false

query1	0.06	0.05	0.05
query2	0.10	0.04	0.04
query3	0.26	0.08	0.08
query4	1.61	0.11	0.11
query5	0.27	0.26	0.25
query6	1.16	0.68	0.67
query7	0.04	0.03	0.03
query8	0.06	0.04	0.04
query9	0.58	0.50	0.49
query10	0.55	0.55	0.55
query11	0.14	0.09	0.09
query12	0.14	0.10	0.10
query13	0.65	0.62	0.61
query14	1.08	1.08	1.07
query15	0.90	0.86	0.86
query16	0.41	0.39	0.40
query17	1.10	1.16	1.10
query18	0.22	0.21	0.21
query19	2.03	1.99	2.06
query20	0.02	0.02	0.02
query21	15.40	0.26	0.14
query22	5.34	0.05	0.05
query23	16.15	0.30	0.10
query24	1.43	0.59	0.52
query25	0.11	0.07	0.06
query26	0.13	0.12	0.12
query27	0.09	0.06	0.05
query28	4.43	1.16	0.96
query29	12.58	3.92	3.16
query30	0.29	0.14	0.12
query31	2.81	0.64	0.40
query32	3.24	0.59	0.51
query33	3.20	3.25	3.27
query34	15.99	5.42	4.77
query35	4.78	4.82	4.79
query36	0.65	0.49	0.48
query37	0.12	0.07	0.08
query38	0.08	0.05	0.03
query39	0.04	0.04	0.03
query40	0.20	0.15	0.14
query41	0.09	0.04	0.03
query42	0.04	0.03	0.04
query43	0.05	0.04	0.03
Total cold run time: 98.62 s
Total hot run time: 28.59 s

@doris-robot
Copy link

BE UT Coverage Report

Increment line coverage 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 52.53% (19351/36838)
Line Coverage 35.99% (179676/499172)
Region Coverage 32.37% (139331/430462)
Branch Coverage 33.34% (60298/180838)

@hello-stephen
Copy link
Contributor

BE Regression && UT Coverage Report

Increment line coverage 100% (0/0) 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 71.63% (25860/36103)
Line Coverage 54.29% (270326/497974)
Region Coverage 51.96% (225946/434855)
Branch Coverage 53.28% (96731/181564)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants