Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add CRC64NVME checksum type. #5142

Merged
merged 2 commits into from
Feb 14, 2025
Merged

Conversation

klauspost
Copy link
Contributor

@klauspost klauspost commented Feb 14, 2025

Description

Also adds CRC32-FO and CRC32C-FO for full object checksums.

λ mc cp -checksum=crc64nvme mc.exe myminio/testbucket
...com\minio\mc\mc.exe: 41.95 MiB / 41.95 MiB

λ mc stat myminio/testbucket/mc.exe
Name      : mc.exe
Date      : 2025-02-14 13:59:05 CET
Size      : 42 MiB
ETag      : 7f130846cec6e6ece750565b1f3d9518-3
VersionID : f4daeb78-9eaf-4da9-b9ca-d8b65fbc69e3
Type      : file
Checksum  : CRC64NVME:TOfg0RHhpZk=
Metadata  :
  Content-Type: application/x-msdownload

λ mc cp -checksum=crc32-fo mc.exe myminio/testbucket
...com\minio\mc\mc.exe: 41.95 MiB / 41.95 MiB

λ mc stat myminio/testbucket/mc.exe
Name      : mc.exe
Date      : 2025-02-14 13:58:52 CET
Size      : 42 MiB
ETag      : 7f130846cec6e6ece750565b1f3d9518-3
VersionID : 1ec587dd-9127-42ee-ad82-58b48f9676d5
Type      : file
Checksum  : CRC32:3Dt3fQ==
Metadata  :
  Content-Type: application/x-msdownload

λ _

Upgrades minio-go to version with assembly crc64nvme.

How to test this PR?

Run latest version minio. Run above examples.

Types of changes

  • New feature (non-breaking change which adds functionality)

Also adds `CRC32-FO` and `CRC32C-FO` for full object checksums.

```
λ mc cp -checksum=crc64nvme mc.exe myminio/testbucket
...com\minio\mc\mc.exe: 41.95 MiB / 41.95 MiB

λ mc stat myminio/testbucket/mc.exe
Name      : mc.exe
Date      : 2025-02-14 13:59:05 CET
Size      : 42 MiB
ETag      : 7f130846cec6e6ece750565b1f3d9518-3
VersionID : f4daeb78-9eaf-4da9-b9ca-d8b65fbc69e3
Type      : file
Checksum  : CRC64NVME:TOfg0RHhpZk=
Metadata  :
  Content-Type: application/x-msdownload

λ mc cp -checksum=crc32-fo mc.exe myminio/testbucket
...com\minio\mc\mc.exe: 41.95 MiB / 41.95 MiB

λ mc stat myminio/testbucket/mc.exe
Name      : mc.exe
Date      : 2025-02-14 13:58:52 CET
Size      : 42 MiB
ETag      : 7f130846cec6e6ece750565b1f3d9518-3
VersionID : 1ec587dd-9127-42ee-ad82-58b48f9676d5
Type      : file
Checksum  : CRC32:3Dt3fQ==
Metadata  :
  Content-Type: application/x-msdownload

λ _
```
@harshavardhana harshavardhana merged commit 217d923 into minio:master Feb 14, 2025
5 checks passed
@klauspost klauspost deleted the add-crc64-checksum branch February 14, 2025 16:20
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants