Skip to content

Commit cc11e52

Browse files
Excavator: Upgrade API Version (#214)
1 parent 7936a34 commit cc11e52

File tree

22 files changed

+925
-45
lines changed

22 files changed

+925
-45
lines changed

README.md

Lines changed: 9 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -635,6 +635,8 @@ Namespace | Resource | Operation | HTTP request |
635635
**Datasets** | Dataset | [**create**](docs/v2/Datasets/Dataset.md#create) | **POST** /v2/datasets |
636636
**Datasets** | Dataset | [**get**](docs/v2/Datasets/Dataset.md#get) | **GET** /v2/datasets/{datasetRid} |
637637
**Datasets** | Dataset | [**get_schedules**](docs/v2/Datasets/Dataset.md#get_schedules) | **GET** /v2/datasets/{datasetRid}/getSchedules |
638+
**Datasets** | Dataset | [**get_schema**](docs/v2/Datasets/Dataset.md#get_schema) | **GET** /v2/datasets/{datasetRid}/getSchema |
639+
**Datasets** | Dataset | [**put_schema**](docs/v2/Datasets/Dataset.md#put_schema) | **PUT** /v2/datasets/{datasetRid}/putSchema |
638640
**Datasets** | Dataset | [**read_table**](docs/v2/Datasets/Dataset.md#read_table) | **GET** /v2/datasets/{datasetRid}/readTable |
639641
**Datasets** | File | [**content**](docs/v2/Datasets/File.md#content) | **GET** /v2/datasets/{datasetRid}/files/{filePath}/content |
640642
**Datasets** | File | [**delete**](docs/v2/Datasets/File.md#delete) | **DELETE** /v2/datasets/{datasetRid}/files/{filePath} |
@@ -1067,6 +1069,8 @@ Namespace | Name | Import |
10671069
**Core** | [CreatedBy](docs/v2/Core/models/CreatedBy.md) | `from foundry_sdk.v2.core.models import CreatedBy` |
10681070
**Core** | [CreatedTime](docs/v2/Core/models/CreatedTime.md) | `from foundry_sdk.v2.core.models import CreatedTime` |
10691071
**Core** | [CustomMetadata](docs/v2/Core/models/CustomMetadata.md) | `from foundry_sdk.v2.core.models import CustomMetadata` |
1072+
**Core** | [DatasetFieldSchema](docs/v2/Core/models/DatasetFieldSchema.md) | `from foundry_sdk.v2.core.models import DatasetFieldSchema` |
1073+
**Core** | [DatasetSchema](docs/v2/Core/models/DatasetSchema.md) | `from foundry_sdk.v2.core.models import DatasetSchema` |
10701074
**Core** | [DateType](docs/v2/Core/models/DateType.md) | `from foundry_sdk.v2.core.models import DateType` |
10711075
**Core** | [DecimalType](docs/v2/Core/models/DecimalType.md) | `from foundry_sdk.v2.core.models import DecimalType` |
10721076
**Core** | [DisplayName](docs/v2/Core/models/DisplayName.md) | `from foundry_sdk.v2.core.models import DisplayName` |
@@ -1163,6 +1167,7 @@ Namespace | Name | Import |
11631167
**Core** | [VectorSimilarityFunction](docs/v2/Core/models/VectorSimilarityFunction.md) | `from foundry_sdk.v2.core.models import VectorSimilarityFunction` |
11641168
**Core** | [VectorSimilarityFunctionValue](docs/v2/Core/models/VectorSimilarityFunctionValue.md) | `from foundry_sdk.v2.core.models import VectorSimilarityFunctionValue` |
11651169
**Core** | [VectorType](docs/v2/Core/models/VectorType.md) | `from foundry_sdk.v2.core.models import VectorType` |
1170+
**Core** | [VersionId](docs/v2/Core/models/VersionId.md) | `from foundry_sdk.v2.core.models import VersionId` |
11661171
**Core** | [ZoneId](docs/v2/Core/models/ZoneId.md) | `from foundry_sdk.v2.core.models import ZoneId` |
11671172
**Datasets** | [Branch](docs/v2/Datasets/models/Branch.md) | `from foundry_sdk.v2.datasets.models import Branch` |
11681173
**Datasets** | [BranchName](docs/v2/Datasets/models/BranchName.md) | `from foundry_sdk.v2.datasets.models import BranchName` |
@@ -1171,6 +1176,7 @@ Namespace | Name | Import |
11711176
**Datasets** | [DatasetRid](docs/v2/Datasets/models/DatasetRid.md) | `from foundry_sdk.v2.datasets.models import DatasetRid` |
11721177
**Datasets** | [File](docs/v2/Datasets/models/File.md) | `from foundry_sdk.v2.datasets.models import File` |
11731178
**Datasets** | [FileUpdatedTime](docs/v2/Datasets/models/FileUpdatedTime.md) | `from foundry_sdk.v2.datasets.models import FileUpdatedTime` |
1179+
**Datasets** | [GetDatasetSchemaResponse](docs/v2/Datasets/models/GetDatasetSchemaResponse.md) | `from foundry_sdk.v2.datasets.models import GetDatasetSchemaResponse` |
11741180
**Datasets** | [ListBranchesResponse](docs/v2/Datasets/models/ListBranchesResponse.md) | `from foundry_sdk.v2.datasets.models import ListBranchesResponse` |
11751181
**Datasets** | [ListFilesResponse](docs/v2/Datasets/models/ListFilesResponse.md) | `from foundry_sdk.v2.datasets.models import ListFilesResponse` |
11761182
**Datasets** | [ListSchedulesResponse](docs/v2/Datasets/models/ListSchedulesResponse.md) | `from foundry_sdk.v2.datasets.models import ListSchedulesResponse` |
@@ -2079,6 +2085,7 @@ Namespace | Name | Import |
20792085
**Datasets** | CreateViewPermissionDenied | `from foundry_sdk.v2.datasets.errors import CreateViewPermissionDenied` |
20802086
**Datasets** | DatasetNotFound | `from foundry_sdk.v2.datasets.errors import DatasetNotFound` |
20812087
**Datasets** | DatasetReadNotSupported | `from foundry_sdk.v2.datasets.errors import DatasetReadNotSupported` |
2088+
**Datasets** | DatasetViewNotFound | `from foundry_sdk.v2.datasets.errors import DatasetViewNotFound` |
20822089
**Datasets** | DeleteBranchPermissionDenied | `from foundry_sdk.v2.datasets.errors import DeleteBranchPermissionDenied` |
20832090
**Datasets** | DeleteFilePermissionDenied | `from foundry_sdk.v2.datasets.errors import DeleteFilePermissionDenied` |
20842091
**Datasets** | DeleteSchemaPermissionDenied | `from foundry_sdk.v2.datasets.errors import DeleteSchemaPermissionDenied` |
@@ -2087,12 +2094,14 @@ Namespace | Name | Import |
20872094
**Datasets** | FileNotFoundOnBranch | `from foundry_sdk.v2.datasets.errors import FileNotFoundOnBranch` |
20882095
**Datasets** | FileNotFoundOnTransactionRange | `from foundry_sdk.v2.datasets.errors import FileNotFoundOnTransactionRange` |
20892096
**Datasets** | GetDatasetSchedulesPermissionDenied | `from foundry_sdk.v2.datasets.errors import GetDatasetSchedulesPermissionDenied` |
2097+
**Datasets** | GetDatasetSchemaPermissionDenied | `from foundry_sdk.v2.datasets.errors import GetDatasetSchemaPermissionDenied` |
20902098
**Datasets** | GetFileContentPermissionDenied | `from foundry_sdk.v2.datasets.errors import GetFileContentPermissionDenied` |
20912099
**Datasets** | InvalidBranchName | `from foundry_sdk.v2.datasets.errors import InvalidBranchName` |
20922100
**Datasets** | InvalidTransactionType | `from foundry_sdk.v2.datasets.errors import InvalidTransactionType` |
20932101
**Datasets** | InvalidViewBackingDataset | `from foundry_sdk.v2.datasets.errors import InvalidViewBackingDataset` |
20942102
**Datasets** | JobTransactionPermissionDenied | `from foundry_sdk.v2.datasets.errors import JobTransactionPermissionDenied` |
20952103
**Datasets** | OpenTransactionAlreadyExists | `from foundry_sdk.v2.datasets.errors import OpenTransactionAlreadyExists` |
2104+
**Datasets** | PutDatasetSchemaPermissionDenied | `from foundry_sdk.v2.datasets.errors import PutDatasetSchemaPermissionDenied` |
20962105
**Datasets** | PutSchemaPermissionDenied | `from foundry_sdk.v2.datasets.errors import PutSchemaPermissionDenied` |
20972106
**Datasets** | ReadTableDatasetPermissionDenied | `from foundry_sdk.v2.datasets.errors import ReadTableDatasetPermissionDenied` |
20982107
**Datasets** | ReadTableError | `from foundry_sdk.v2.datasets.errors import ReadTableError` |

docs-snippets-npm/package.json

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -24,7 +24,7 @@
2424
"sls": {
2525
"dependencies": {
2626
"com.palantir.foundry.api:api-gateway": {
27-
"minVersion": "1.1231.0",
27+
"minVersion": "1.1232.0",
2828
"maxVersion": "1.x.x",
2929
"optional": false
3030
}

docs-snippets-npm/src/index.ts

Lines changed: 11 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -688,6 +688,16 @@ export const PYTHON_PLATFORM_SNIPPETS: SdkSnippets<typeof PLATFORM_API_DOCS_SPEC
688688
"template": "from foundry_sdk import FoundryClient\nimport foundry_sdk\nfrom pprint import pprint\n\nclient = FoundryClient(auth=foundry_sdk.UserTokenAuth(...), hostname=\"example.palantirfoundry.com\")\n\n# DatasetRid\ndataset_rid = None\n# Optional[BranchName] | The name of the Branch. If none is provided, the default Branch name - `master` for most enrollments - will be used.\nbranch_name = None\n# Optional[PageSize]\npage_size = None\n# Optional[PageToken]\npage_token = None\n# Optional[PreviewMode] | Enables the use of preview functionality.\npreview = None\n\n\ntry:\n for dataset in client.datasets.Dataset.get_schedules(\n dataset_rid,\n branch_name=branch_name,\n page_size=page_size,\n page_token=page_token,\n preview=preview,\n ):\n pprint(dataset)\nexcept foundry_sdk.PalantirRPCException as e:\n print(\"HTTP error when calling Dataset.get_schedules: %s\\n\" % e)"
689689
}
690690
],
691+
"v2.getDatasetSchema": [
692+
{
693+
"template": "from foundry_sdk import FoundryClient\nimport foundry_sdk\nfrom pprint import pprint\n\nclient = FoundryClient(auth=foundry_sdk.UserTokenAuth(...), hostname=\"example.palantirfoundry.com\")\n\n# DatasetRid\ndataset_rid = None\n# Optional[BranchName]\nbranch_name = None\n# Optional[TransactionRid] | The Resource Identifier (RID) of the end Transaction. If a user does not provide a value, the RID of the latest committed transaction will be used.\nend_transaction_rid = None\n# Optional[PreviewMode] | Enables the use of preview functionality.\npreview = None\n# Optional[VersionId] | The schema version that should be used. If none is provided, the latest version will be used.\nversion_id = None\n\n\ntry:\n api_response = client.datasets.Dataset.get_schema(\n dataset_rid,\n branch_name=branch_name,\n end_transaction_rid=end_transaction_rid,\n preview=preview,\n version_id=version_id,\n )\n print(\"The get_schema response:\\n\")\n pprint(api_response)\nexcept foundry_sdk.PalantirRPCException as e:\n print(\"HTTP error when calling Dataset.get_schema: %s\\n\" % e)"
694+
}
695+
],
696+
"v2.putDatasetSchema": [
697+
{
698+
"template": "from foundry_sdk import FoundryClient\nimport foundry_sdk\nfrom pprint import pprint\n\nclient = FoundryClient(auth=foundry_sdk.UserTokenAuth(...), hostname=\"example.palantirfoundry.com\")\n\n# DatasetRid\ndataset_rid = None\n# DatasetSchema | The schema that will be added.\nschema = {\n \"fieldSchemaList\": [\n {\n \"name\": \"id\",\n \"type\": \"long\",\n \"nullable\": False,\n \"customMetadata\": {\"description\": \"Primary key\"},\n },\n {\"name\": \"event_time\", \"type\": \"timestamp\", \"nullable\": False},\n {\"name\": \"price\", \"type\": \"decimal\", \"precision\": 10, \"scale\": 2, \"nullable\": True},\n {\n \"name\": \"tags\",\n \"type\": \"array\",\n \"nullable\": True,\n \"arraySubtype\": {\"type\": \"string\", \"nullable\": False},\n },\n {\n \"name\": \"metrics\",\n \"type\": \"struct\",\n \"nullable\": True,\n \"subSchemas\": [\n {\"name\": \"temperature\", \"type\": \"double\", \"nullable\": True},\n {\"name\": \"humidity\", \"type\": \"double\", \"nullable\": True},\n ],\n },\n ]\n}\n# Optional[BranchName]\nbranch_name = \"master\"\n# Optional[TransactionRid] | The Resource Identifier (RID) of the end Transaction.\nend_transaction_rid = \"ri.foundry.main.transaction.0a0207cb-26b7-415b-bc80-66a3aa3933f4\"\n# Optional[PreviewMode] | Enables the use of preview functionality.\npreview = None\n\n\ntry:\n api_response = client.datasets.Dataset.put_schema(\n dataset_rid,\n schema=schema,\n branch_name=branch_name,\n end_transaction_rid=end_transaction_rid,\n preview=preview,\n )\n print(\"The put_schema response:\\n\")\n pprint(api_response)\nexcept foundry_sdk.PalantirRPCException as e:\n print(\"HTTP error when calling Dataset.put_schema: %s\\n\" % e)"
699+
}
700+
],
691701
"v2.readTableDataset": [
692702
{
693703
"template": "from foundry_sdk import FoundryClient\nimport foundry_sdk\nfrom pprint import pprint\n\nclient = FoundryClient(auth=foundry_sdk.UserTokenAuth(...), hostname=\"example.palantirfoundry.com\")\n\n# DatasetRid\ndataset_rid = None\n# TableExportFormat | The export format. Must be `ARROW` or `CSV`.\nformat = None\n# Optional[BranchName] | The name of the Branch.\nbranch_name = None\n# Optional[List[str]] | A subset of the dataset columns to include in the result. Defaults to all columns.\ncolumns = [\"id\", \"firstName\", \"lastName\"]\n# Optional[TransactionRid] | The Resource Identifier (RID) of the end Transaction.\nend_transaction_rid = None\n# Optional[int] | A limit on the number of rows to return. Note that row ordering is non-deterministic.\nrow_limit = None\n# Optional[TransactionRid] | The Resource Identifier (RID) of the start Transaction.\nstart_transaction_rid = None\n\n\ntry:\n api_response = client.datasets.Dataset.read_table(\n dataset_rid,\n format=format,\n branch_name=branch_name,\n columns=columns,\n end_transaction_rid=end_transaction_rid,\n row_limit=row_limit,\n start_transaction_rid=start_transaction_rid,\n )\n print(\"The read_table response:\\n\")\n pprint(api_response)\nexcept foundry_sdk.PalantirRPCException as e:\n print(\"HTTP error when calling Dataset.read_table: %s\\n\" % e)"
@@ -1135,7 +1145,7 @@ export const PYTHON_PLATFORM_SNIPPETS: SdkSnippets<typeof PLATFORM_API_DOCS_SPEC
11351145
],
11361146
"v2.aggregateObjectsV2": [
11371147
{
1138-
"template": "from foundry_sdk import FoundryClient\nimport foundry_sdk\nfrom pprint import pprint\n\nclient = FoundryClient(auth=foundry_sdk.UserTokenAuth(...), hostname=\"example.palantirfoundry.com\")\n\n# OntologyIdentifier | The API name of the ontology. To find the API name, use the **List ontologies** endpoint or check the **Ontology Manager**.\nontology = \"palantir\"\n# ObjectTypeApiName | The type of the object to aggregate on.\nobject_type = \"employee\"\n# List[AggregationV2]\naggregation = [\n {\"type\": \"min\", \"field\": \"properties.tenure\", \"name\": \"min_tenure\"},\n {\"type\": \"avg\", \"field\": \"properties.tenure\", \"name\": \"avg_tenure\"},\n]\n# List[AggregationGroupByV2]\ngroup_by = [\n {\n \"field\": \"startDate\",\n \"type\": \"range\",\n \"ranges\": [{\"startValue\": \"2020-01-01\", \"endValue\": \"2020-06-01\"}],\n },\n {\"field\": \"city\", \"type\": \"exact\"},\n]\n# Optional[AggregationAccuracyRequest]\naccuracy = None\n# Optional[ArtifactRepositoryRid] | The repository associated with a marketplace installation.\nartifact_repository = None\n# Optional[FoundryBranch] | The Foundry branch to aggregate objects from. If not specified, the default branch will be used.\nbranch = None\n# Optional[SdkPackageName] | The package name of the generated SDK.\npackage_name = None\n# Optional[SearchJsonQueryV2]\nwhere = {\"type\": \"eq\", \"field\": \"name\", \"value\": \"john\"}\n\n\ntry:\n api_response = client.ontologies.OntologyObject.aggregate(\n ontology,\n object_type,\n aggregation=aggregation,\n group_by=group_by,\n accuracy=accuracy,\n artifact_repository=artifact_repository,\n branch=branch,\n package_name=package_name,\n where=where,\n )\n print(\"The aggregate response:\\n\")\n pprint(api_response)\nexcept foundry_sdk.PalantirRPCException as e:\n print(\"HTTP error when calling OntologyObject.aggregate: %s\\n\" % e)"
1148+
"template": "from foundry_sdk import FoundryClient\nimport foundry_sdk\nfrom pprint import pprint\n\nclient = FoundryClient(auth=foundry_sdk.UserTokenAuth(...), hostname=\"example.palantirfoundry.com\")\n\n# OntologyIdentifier | The API name of the ontology. To find the API name, use the **List ontologies** endpoint or check the **Ontology Manager**.\nontology = \"palantir\"\n# ObjectTypeApiName | The type of the object to aggregate on.\nobject_type = \"employee\"\n# List[AggregationV2]\naggregation = [\n {\"type\": \"min\", \"field\": \"properties.tenure\", \"name\": \"min_tenure\"},\n {\"type\": \"avg\", \"field\": \"properties.tenure\", \"name\": \"avg_tenure\"},\n]\n# List[AggregationGroupByV2]\ngroup_by = [\n {\n \"field\": \"startDate\",\n \"type\": \"range\",\n \"ranges\": [{\"startValue\": \"2020-01-01\", \"endValue\": \"2020-06-01\"}],\n },\n {\"field\": \"city\", \"type\": \"exact\"},\n]\n# Optional[AggregationAccuracyRequest]\naccuracy = None\n# Optional[FoundryBranch] | The Foundry branch to aggregate objects from. If not specified, the default branch will be used.\nbranch = None\n# Optional[SdkPackageRid] | The package rid of the generated SDK.\nsdk_package_rid = None\n# Optional[SdkVersion] | The version of the generated SDK.\nsdk_version = None\n# Optional[SearchJsonQueryV2]\nwhere = {\"type\": \"eq\", \"field\": \"name\", \"value\": \"john\"}\n\n\ntry:\n api_response = client.ontologies.OntologyObject.aggregate(\n ontology,\n object_type,\n aggregation=aggregation,\n group_by=group_by,\n accuracy=accuracy,\n branch=branch,\n sdk_package_rid=sdk_package_rid,\n sdk_version=sdk_version,\n where=where,\n )\n print(\"The aggregate response:\\n\")\n pprint(api_response)\nexcept foundry_sdk.PalantirRPCException as e:\n print(\"HTTP error when calling OntologyObject.aggregate: %s\\n\" % e)"
11391149
}
11401150
],
11411151
"v2.countObjects": [
Lines changed: 22 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,22 @@
1+
# DatasetFieldSchema
2+
3+
A field in a Foundry dataset.
4+
5+
6+
## Properties
7+
| Name | Type | Required | Description |
8+
| ------------ | ------------- | ------------- | ------------- |
9+
**type** | str | Yes | |
10+
**name** | FieldName | Yes | The name of a column. May be absent in nested schema objects. |
11+
**nullable** | bool | Yes | Indicates whether values of this field may be null. |
12+
**user_defined_type_class** | Optional[str] | No | Canonical classname of the user-defined type for this field. This should be a subclass of Spark's `UserDefinedType`. |
13+
**custom_metadata** | Optional[CustomMetadata] | No | User-supplied custom metadata about the column, such as Foundry web archetypes, descriptions, etc. |
14+
**array_subtype** | Optional[DatasetFieldSchema] | No | Only used with {@link FieldDataType#ARRAY}. |
15+
**precision** | Optional[int] | No | Only used with {@link FieldDataType#DECIMAL}. |
16+
**scale** | Optional[int] | No | Only used with {@link FieldDataType#DECIMAL}. |
17+
**map_key_type** | Optional[DatasetFieldSchema] | No | Only used with {@link FieldDataType#MAP}. |
18+
**map_value_type** | Optional[DatasetFieldSchema] | No | Only used with {@link FieldDataType#MAP}. |
19+
**sub_schemas** | Optional[List[DatasetFieldSchema]] | No | Only used with {@link FieldDataType#STRUCT}. |
20+
21+
22+
[[Back to Model list]](../../../../README.md#models-v2-link) [[Back to API list]](../../../../README.md#apis-v2-link) [[Back to README]](../../../../README.md)
Lines changed: 12 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,12 @@
1+
# DatasetSchema
2+
3+
The schema for a Foundry dataset. Files uploaded to this dataset must match this schema.
4+
5+
6+
## Properties
7+
| Name | Type | Required | Description |
8+
| ------------ | ------------- | ------------- | ------------- |
9+
**field_schema_list** | List[DatasetFieldSchema] | Yes | |
10+
11+
12+
[[Back to Model list]](../../../../README.md#models-v2-link) [[Back to API list]](../../../../README.md#apis-v2-link) [[Back to README]](../../../../README.md)

docs/v2/Core/models/VersionId.md

Lines changed: 12 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,12 @@
1+
# VersionId
2+
3+
The version identifier of a dataset schema.
4+
5+
6+
## Type
7+
```python
8+
UUID
9+
```
10+
11+
12+
[[Back to Model list]](../../../../README.md#models-v2-link) [[Back to API list]](../../../../README.md#apis-v2-link) [[Back to README]](../../../../README.md)

0 commit comments

Comments
 (0)