For context on getting started with ingestion, check out our metadata ingestion guide.
Note: Feast ingestion requires Docker to be installed.
To install this plugin, run pip install 'acryl-datahub[feast]'.
This plugin extracts the following:
- List of feature tables (modeled as
MLFeatureTables), features (MLFeatures), and entities (MLPrimaryKeys) - Column types associated with each feature and entity
Note: this uses a separate Docker container to extract Feast's metadata into a JSON file, which is then
parsed to DataHub's native objects. This separation was performed because of a dependency conflict in the feast module.
Check out the following recipe to get started with ingestion! See below for full configuration options.
For general pointers on writing and running a recipe, see our main recipe guide.
source:
type: feast
config:
# Coordinates
core_url: "localhost:6565"
sink:
# sink configsNote that a . is used to denote nested fields in the YAML recipe.
| Field | Required | Default | Description |
|---|---|---|---|
core_url |
"localhost:6565" |
URL of Feast Core instance. | |
env |
"PROD" |
Environment to use in namespace when constructing URNs. | |
use_local_build |
False |
Whether to build Feast ingestion Docker image locally. |
Coming soon!
If you've got any questions on configuring this source, feel free to ping us on our Slack!