[DataCap Application] <Allen Institute> - <Allen Institute>

[RainDay1031]

Version

1

DataCap Applicant

Rain

Project ID

54

Data Owner Name

Allen Institute

Data Owner Country/Region

United States

Data Owner Industry

Life Science / Healthcare

Website

https://registry.opendata.aws/?search=managedBy:allen%20institute

Social Media Handle

@AllenInstitute

Social Media Type

Twitter

What is your role related to the dataset

Data Preparer

Total amount of DataCap being requested

3PiB

Expected size of single dataset (one copy)

500TiB

Number of replicas to store

6

Weekly allocation of DataCap requested

1PiB

On-chain address for first allocation

f1dgztjokxdcy7bvo3tsbjjy4qril64hamqgwbgcy

Data Type of Application

Public, Open Dataset (Research/Non-Profit)

Custom multisig

• Use Custom Multisig

Identifier

No response

Share a brief history of your project and organization

Our team is not only a storage provider, but also a technology provider. We have extensive experience in Filecoin node operation and maintenance, and we know how to package and store data.

Is this project associated with other projects/ecosystem stakeholders?

No

If answered yes, what are the other projects/ecosystem stakeholders

Describe the data being stored onto Filecoin

aws s3 ls --no-sign-request s3://allencell/ 68.7 TiB
aws s3 ls --no-sign-request s3://allen-mouse-brain-atlas/ 190.0 TiB
aws s3 ls --no-sign-request s3://ai2-public-datasets/ 38.5 TiB
aws s3 ls --no-sign-request s3://allen-ivy-glioblastoma-atlas/    8.5 TiB
aws s3 ls --no-sign-request s3://aind-benchmark-data/ephys-compression/ Total Size: 487.4 GiB
aws s3 ls --no-sign-request s3://allen-brain-observatory/   158.8 TiB
aws s3 ls --no-sign-request s3://ai2-semanticscholar-cord-19/  4.6T
aws s3 ls --no-sign-request s3://sea-ad-single-cell-profiling/  2.0 TiB
aws s3 ls --no-sign-request s3://sea-ad-quantitative-neuropathology/ 2.1 TiB
aws s3 ls --no-sign-request s3://sea-ad-spatial-transcriptomics/  1.4 TiB

Where was the data currently stored in this dataset sourced from

AWS Cloud

If you answered "Other" in the previous question, enter the details here

If you are a data preparer. What is your location (Country/Region)

None

If you are a data preparer, how will the data be prepared? Please include tooling used and technical details?

After we download data from AWS, the data will be cut into disks through Singularity, and then the hard disk will be shipped to the SPs.

If you are not preparing the data, who will prepare the data? (Provide name and business)

Has this dataset been stored on the Filecoin network before? If so, please explain and make the case why you would like to store this dataset again to the network. Provide details on preparation and/or SP distribution.

Please share a sample of the data

aws s3 ls --no-sign-request s3://allencell/ 68.7 TiB
aws s3 ls --no-sign-request s3://allen-mouse-brain-atlas/ 190.0 TiB
aws s3 ls --no-sign-request s3://ai2-public-datasets/ 38.5 TiB
aws s3 ls --no-sign-request s3://allen-ivy-glioblastoma-atlas/    8.5 TiB
aws s3 ls --no-sign-request s3://aind-benchmark-data/ephys-compression/ Total Size: 487.4 GiB
aws s3 ls --no-sign-request s3://allen-brain-observatory/   158.8 TiB
aws s3 ls --no-sign-request s3://ai2-semanticscholar-cord-19/  4.6T
aws s3 ls --no-sign-request s3://sea-ad-single-cell-profiling/  2.0 TiB
aws s3 ls --no-sign-request s3://sea-ad-quantitative-neuropathology/ 2.1 TiB
aws s3 ls --no-sign-request s3://sea-ad-spatial-transcriptomics/  1.4 TiB

Confirm that this is a public dataset that can be retrieved by anyone on the Network

• I confirm

If you chose not to confirm, what was the reason

What is the expected retrieval frequency for this data

Yearly

For how long do you plan to keep this dataset stored on Filecoin

1.5 to 2 years

In which geographies do you plan on making storage deals

Asia other than Greater China, Europe, North America

How will you be distributing your data to storage providers

HTTP or FTP server, Shipping hard drives

How did you find your storage providers

Partners

If you answered "Others" in the previous question, what is the tool or platform you used

Please list the provider IDs and location of the storage providers you will be working with.

f03289271 Germany
f03315260 Germany
f03367915 United States
f03368008 Vietnam
f03542777 Vietnam

How do you plan to make deals to your storage providers

Boost client

If you answered "Others/custom tool" in the previous question, enter the details here

Can you confirm that you will follow the Fil+ guideline

Yes

[datacap-bot]

Application is waiting for allocator review.
Link to application on Allocator.tech

[datacap-bot]

Similarity Report

This application is similar to the following applications:

filplus-bookkeeping/TopBlocks

• #10 - Allen Institute:
  • Similar project and stored data description
  • The same data owner name

TOPPOOL-LEE/Allocator-Pathway-TOP-POOL

• #93 - Downscaled Climate Data for Alaska:

  • Similar stored data description

• #34 - Allen Institute:

  • The same data owner name

nicelove666/Allocator-Pathway-IPFSTT

• #53 - Allen Institute:
  • Similar project and stored data description
  • The same data owner name

zcfil/ZCFIL

• #3 - Allen Institute:
  • The same data owner name

[shizhigu]

Thank you for your application, please answer the following questions:

1. Could you please further explain the datacap-bot prompt?
2. This dataset was previously stored on the Filecoin network. Please explain and justify why you would like to store this dataset in the network again. Please provide details of the preparation and/or SP distribution. And update in the github application request.
3. Can you ensure that the collaborating SPs meet the Spark retrieval requirements?
4. Can you provide index files? Ideally, the index file provided should contain a visible reference to the original file. https://anyidata.com/image/ This is an example of the official index information.
5. The application application is declared to be 6 replicas but declares only 5 nodes. please elaborate.
6. As a data preparer, can you send a personal ID to shizhigu97@gmail.com for review?

[RainDay1031]

Hello @shizhigu
1-2. we plan to store in Europe, America and other regions, which is different from the existing copy location. Therefore, we hope to store this data again and hope to get your approval. Our SPs are f03289271 Germany｜f03315260 Germany｜f03367915 United States｜f03368008 Vietnam｜f03542777 Vietnam. If there are any additions or changes, I will declare them in advance.
3. Of course, we can ensure that Spark's retrieval requirements are met, and manual retrieval is allowed.
4. We do not have an index file directory for the time being, but we can create one if necessary.
5. We will update the missing SP later.

[RainDay1031]

Emails just sent

[datacap-bot]

Datacap Request Trigger

Total DataCap requested

3PiB

Expected weekly DataCap usage rate

1PiB

DataCap Amount - First Tranche

164926744166400 B

Client address

f1dgztjokxdcy7bvo3tsbjjy4qril64hamqgwbgcy

[datacap-bot]

DataCap Allocation requested

Multisig Notary address

Client address

f1dgztjokxdcy7bvo3tsbjjy4qril64hamqgwbgcy

DataCap allocation requested

150 TiB

Id

30012969-353b-4946-82db-d551d0f3f9ff

[datacap-bot]

Application is ready to sign

[shizhigu]

Got the email.

As a first round, I can support 150 TiB.