Version
1
DataCap Applicant
Tom
Project ID
9
Data Owner Name
Pangeo Community
Data Owner Country/Region
United States
Data Owner Industry
Life Science / Healthcare
Website
https://wcrp-cmip.org/cmip-phase-6-cmip6/
Social Media Handle
https://wcrp-cmip.org/cmip-phase-6-cmip6/
Social Media Type
Other
What is your role related to the dataset
Data Preparer
Total amount of DataCap being requested
16PiB
Expected size of single dataset (one copy)
1671.7TiB
Number of replicas to store
10
Weekly allocation of DataCap requested
1000TiB
On-chain address for first allocation
f14hw7zmrqi4w7llj3sc27yxn7vuaofgxpcds5opi
Data Type of Application
Public, Open Dataset (Research/Non-Profit)
Custom multisig
Identifier
No response
Share a brief history of your project and organization
CMIP began in 1995 under the auspices of the Working Group on Coupled Modelling (WGCM). The first set of common experiments involved comparing the model response to an idealized forcing – a constant rate of increase which was accomplished using a CO2 increase of 1% per year compounded.
Is this project associated with other projects/ecosystem stakeholders?
No
If answered yes, what are the other projects/ecosystem stakeholders
No response
Describe the data being stored onto Filecoin
The sixth phase of global coupled ocean-atmosphere general circulation model ensemble.
This dataset contains two S3 bucket:
arn:aws:s3:::esgf-world 671.7 TiB
arn:aws:s3:::cmip6-pds 1.0 PiB
Where was the data currently stored in this dataset sourced from
AWS Cloud
If you answered "Other" in the previous question, enter the details here
No response
If you are a data preparer. What is your location (Country/Region)
None
If you are a data preparer, how will the data be prepared? Please include tooling used and technical details?
First, you need to download the CMIP6 dataset from the official source, making sure the data is complete and in the correct format, like NetCDF. Then, use tools such as Python's xarray or netCDF4 libraries to check and preprocess the data, cleaning up unnecessary variables or compressing files to save storage space. Next, package the processed data into a format suitable for Filecoin storage, like CAR files, which can be done using Filecoin's toolchain. After that, upload the data to the Filecoin network via Lotus or other Filecoin clients, and make sure to prepare your wallet and Gas fees in advance.Finally, confirm the deal is successful and save the storage receipt for future data retrieval or management.
If you are not preparing the data, who will prepare the data? (Provide name and business)
No response
Has this dataset been stored on the Filecoin network before? If so, please explain and make the case why you would like to store this dataset again to the network. Provide details on preparation and/or SP distribution.
No response
Please share a sample of the data
https://registry.opendata.aws/cmip6/
Confirm that this is a public dataset that can be retrieved by anyone on the Network
If you chose not to confirm, what was the reason
No response
What is the expected retrieval frequency for this data
Sporadic
For how long do you plan to keep this dataset stored on Filecoin
2 to 3 years
In which geographies do you plan on making storage deals
Greater China, Asia other than Greater China, Africa, North America, South America, Europe, Australia (continent), Antarctica
How will you be distributing your data to storage providers
HTTP or FTP server, Shipping hard drives
How did you find your storage providers
Slack, Filmine, Partners
If you answered "Others" in the previous question, what is the tool or platform you used
No response
Please list the provider IDs and location of the storage providers you will be working with.
f01081394
f01081419
f01083931
f01083939
f01083949
f01084149
f01106668
f01315096
f01518369
f01889668
f03055005
f03055018
f03055029
f0870558
How do you plan to make deals to your storage providers
No response
If you answered "Others/custom tool" in the previous question, enter the details here
No response
Can you confirm that you will follow the Fil+ guideline
Yes
Version
1
DataCap Applicant
Tom
Project ID
9
Data Owner Name
Pangeo Community
Data Owner Country/Region
United States
Data Owner Industry
Life Science / Healthcare
Website
https://wcrp-cmip.org/cmip-phase-6-cmip6/
Social Media Handle
https://wcrp-cmip.org/cmip-phase-6-cmip6/
Social Media Type
Other
What is your role related to the dataset
Data Preparer
Total amount of DataCap being requested
16PiB
Expected size of single dataset (one copy)
1671.7TiB
Number of replicas to store
10
Weekly allocation of DataCap requested
1000TiB
On-chain address for first allocation
f14hw7zmrqi4w7llj3sc27yxn7vuaofgxpcds5opi
Data Type of Application
Public, Open Dataset (Research/Non-Profit)
Custom multisig
Identifier
No response
Share a brief history of your project and organization
Is this project associated with other projects/ecosystem stakeholders?
No
If answered yes, what are the other projects/ecosystem stakeholders
No response
Describe the data being stored onto Filecoin
Where was the data currently stored in this dataset sourced from
AWS Cloud
If you answered "Other" in the previous question, enter the details here
No response
If you are a data preparer. What is your location (Country/Region)
None
If you are a data preparer, how will the data be prepared? Please include tooling used and technical details?
First, you need to download the CMIP6 dataset from the official source, making sure the data is complete and in the correct format, like NetCDF. Then, use tools such as Python's xarray or netCDF4 libraries to check and preprocess the data, cleaning up unnecessary variables or compressing files to save storage space. Next, package the processed data into a format suitable for Filecoin storage, like CAR files, which can be done using Filecoin's toolchain. After that, upload the data to the Filecoin network via Lotus or other Filecoin clients, and make sure to prepare your wallet and Gas fees in advance.Finally, confirm the deal is successful and save the storage receipt for future data retrieval or management.
If you are not preparing the data, who will prepare the data? (Provide name and business)
No response
Has this dataset been stored on the Filecoin network before? If so, please explain and make the case why you would like to store this dataset again to the network. Provide details on preparation and/or SP distribution.
No response
Please share a sample of the data
Confirm that this is a public dataset that can be retrieved by anyone on the Network
If you chose not to confirm, what was the reason
No response
What is the expected retrieval frequency for this data
Sporadic
For how long do you plan to keep this dataset stored on Filecoin
2 to 3 years
In which geographies do you plan on making storage deals
Greater China, Asia other than Greater China, Africa, North America, South America, Europe, Australia (continent), Antarctica
How will you be distributing your data to storage providers
HTTP or FTP server, Shipping hard drives
How did you find your storage providers
Slack, Filmine, Partners
If you answered "Others" in the previous question, what is the tool or platform you used
No response
Please list the provider IDs and location of the storage providers you will be working with.
How do you plan to make deals to your storage providers
No response
If you answered "Others/custom tool" in the previous question, enter the details here
No response
Can you confirm that you will follow the Fil+ guideline
Yes