Skip to content

Commit a1628da

Browse files
committed
Add ability to pass extra server args to postgres_fdw:
``` sgr mount postgres_fdw schema -c [connstr] -o@- <<EOF { "extra_server_args": { "use_remote_estimate": "true", "extensions": "postgis", "fetch_size": "10000" } } EOF ``` Add ability to rename object files in-engine (utility function for some ingestion). Allow disabling `IMPORT FOREIGN SCHEMA` and passing a table schema in Postgres/MySQL FDWs. For example: ``` sgr mount mysql_fdw schema -c [connstr] -o@- <<EOF { "remote_schema": "mysql_schema", "tables": { "table_1": { "t1_col_1": "integer", "t1_col_2": "text" }, "table_2": { "t2_col_1": "bigint", "t2_col_2": "integer" } } } EOF ``` Add a fork (https://github.com/splitgraph/postgres-elasticsearch-fdw) of https://github.com/matthewfranglen/postgres-elasticsearch-fdw to `sgr mount`, letting others mount ES indexes: ``` sgr mount elasticsearch -c elasticsearch:9200 -o@- <<EOF { "table_spec": { "table_1": { "schema": { "id": "text", "@timestamp": "timestamp", "query": "text", "col_1": "text", "col_2": "boolean", } "index": "index-pattern*", "rowid_column": "id", "query_column": "query", } } } EOF ``` Differences: * Pass qualifiers as ElasticSearch queries using the query DSL (was using the `query=...` qual as a Lucene query string, which is useless in JOINs. Now we combine both the query implied from the quals and the Lucene query string, if passed) * Close the search context on `end_scan` (otherwise many ES queries to the FDW in a 10 minute span would cause it to error with a "too many scroll contexts" exception) * Add EXPLAIN support (outputs the used ES query)
1 parent 57ba32f commit a1628da

File tree

5 files changed

+16
-4
lines changed

5 files changed

+16
-4
lines changed

.bumpversion.cfg

+1-1
Original file line numberDiff line numberDiff line change
@@ -1,7 +1,7 @@
11
[bumpversion]
22
commit = True
33
tag = True
4-
current_version = 0.2.1
4+
current_version = 0.2.2
55
parse = (?P<major>\d+)\.(?P<minor>\d+)\.(?P<patch>\d+)(\-(?P<release>[a-z]+))?
66
serialize =
77
{major}.{minor}.{patch}-{release}

CHANGELOG.md

+12
Original file line numberDiff line numberDiff line change
@@ -1,5 +1,17 @@
11
# Changelog
22

3+
## v0.2.2 (2020-09-16)
4+
5+
* Add ability to pass extra server args to postgres_fdw (`extra_server_args`)
6+
* Add ability to rename object files in-engine (utility function for some ingestion).
7+
* Allow disabling `IMPORT FOREIGN SCHEMA` and passing a table schema in Postgres/MySQL FDWs.
8+
* Add a fork (https://github.com/splitgraph/postgres-elasticsearch-fdw) of https://github.com/matthewfranglen/postgres-elasticsearch-fdw to `sgr mount`, letting others mount ES indexes. Fork changes:
9+
* Pass qualifiers as ElasticSearch queries using the query DSL (was using the `query=...` qual as a Lucene query string, which is useless in JOINs. Now we combine both the query implied from the quals and the Lucene query string, if passed)
10+
* Close the search context on `end_scan` (otherwise many ES queries to the FDW in a 10 minute span would cause it to error with a "too many scroll contexts" exception)
11+
* Add EXPLAIN support (outputs the used ES query)
12+
13+
Full set of changes: [`v0.2.1...v0.2.2`](https://github.com/splitgraph/splitgraph/compare/v0.2.1...v0.2.2)
14+
315
## v0.2.1 (2020-09-02)
416

517
* Add ability to skip config injection at the end of config-manipulating functions (pass `-s`) and don't fail if the Docker socket isn't reachable

install.sh

+1-1
Original file line numberDiff line numberDiff line change
@@ -12,7 +12,7 @@
1212

1313
set -eo pipefail
1414

15-
SGR_VERSION=${SGR_VERSION-0.2.1}
15+
SGR_VERSION=${SGR_VERSION-0.2.2}
1616
INSTALL_DIR=${INSTALL_DIR-$HOME/.splitgraph}
1717
# Set IGNORE_SGR_EXISTS to keep going if sgr already exists.
1818
# Set SKIP_BINARY=1 to skip downloading sgr

pyproject.toml

+1-1
Original file line numberDiff line numberDiff line change
@@ -1,6 +1,6 @@
11
[tool.poetry]
22
name = "splitgraph"
3-
version = "0.2.1"
3+
version = "0.2.2"
44
description = "Command line library and Python client for Splitgraph, a version control system for data"
55
license = "Apache 2.0 modified with Commons Clause"
66
authors = ["Splitgraph Limited"]

splitgraph/__version__.py

+1-1
Original file line numberDiff line numberDiff line change
@@ -1 +1 @@
1-
__version__ = "0.2.1"
1+
__version__ = "0.2.2"

0 commit comments

Comments
 (0)