Skip to content

ORNL/DataFed

Folders and files

NameName
Last commit message
Last commit date

Latest commit

486d316 · Apr 21, 2025
Apr 21, 2025
Oct 30, 2024
Jun 11, 2024
Apr 10, 2024
Oct 30, 2024
Apr 11, 2023
Oct 30, 2024
Nov 6, 2024
Oct 28, 2024
Apr 3, 2024
Jun 1, 2021
Aug 3, 2024
Sep 18, 2023
May 28, 2024
Aug 10, 2024
Nov 4, 2024
Oct 30, 2024
Aug 31, 2023
Aug 10, 2024
Aug 23, 2024
Oct 28, 2024
Aug 12, 2024
Feb 5, 2024
Nov 7, 2024
Aug 5, 2024
Nov 30, 2020
Apr 18, 2023
Jun 16, 2021
Jan 16, 2019

Repository files navigation

DataFed is a federated scientific data management system, supporting cross-facility research activities including experimentation, simulation, and/or analytics. DataFed provides the software service infrastructure needed to build a loosely-couple data network between geographically distributed and heterogeneous facilities. Within this DataFed network, access to data is simple and uniform regardless of physical storage location, local environment type, or security policies.

DataFed includes a suite of services that are built from code housed in this repository:

  • Core Service - Central service providing record and metadata management as well as orchestration
  • Core Database - Central database containing records, metadata, and relationships - everything but raw data
  • Repository Service - Data repository management service (co-located with raw data storage)
  • Globus Auth-N Module - GridFTP custom authorization module that interfaces with core service
  • Web Service - Web server hosting the DataFed Web Portal - includes core proxy service
  • Web Portal Application - The primary point-of-presence and user interface for DataFed
  • Command Line Interface - Utility for accessing data from compute and data environments (interactive and scriptable)

Please refer to the DataFed homepage for full documentation, papers, and presentations describing the architecture and use cases of DataFed.

Refer to the "BUILD.md" file for instructions on how to configure and build DataFed.

Installation Core Server and Web Server

Please see documentation at doc_source/source/admin/general.rst for installation instructions.

Versions

All versions follow the semantic versioning scheme with the exception of the RELEASE version which follows a calendar release. YEAR.MONTH.DAY.HOUR.MINUTE

Warning

If encountering strange seg faults with zmq, it is possible that it is caused by reusing an address when creating a socket.