Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat(tblconv/sql): provide bulk sql writer #12

Open
Zaba505 opened this issue Dec 5, 2021 · 0 comments
Open

feat(tblconv/sql): provide bulk sql writer #12

Zaba505 opened this issue Dec 5, 2021 · 0 comments
Labels
enhancement New feature or request

Comments

@Zaba505
Copy link
Owner

Zaba505 commented Dec 5, 2021

Just about all SQL queries for output are going to be INSERTs and currently, each record received from a source is applied to the query to fill in parameter placeholders and then that query is executed. This is obviously inefficient if there are lots of source records where instead of individually INSERTing every record a bulk insert would be much better.

NOTE: By bulk insert, I don't mean the SQL command BULK INSERT but instead supporting queries similar to the following:

INSERT INTO example
VALUES
  (100, 'Name 1', 'Value 1', 'Other 1'),
  (101, 'Name 2', 'Value 2', 'Other 2'),
  (102, 'Name 3', 'Value 3', 'Other 3'),
  (103, 'Name 4', 'Value 4', 'Other 4');

In the above example, 4 records would be read from the source and applied to the query to fill parameter placeholders. Thus, achieving a far more efficient bulk insert to the SQL output.

@Zaba505 Zaba505 added the enhancement New feature or request label Dec 5, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

1 participant