Skip to content

Commit e9a5797

Browse files
committedJun 9, 2022
DataX 通道能力更新(MaxCompute、Hologres、Tdengine、OSS)、安全漏洞更新、通用打包更新等
1 parent 3225f02 commit e9a5797

File tree

261 files changed

+17927
-2379
lines changed

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.

261 files changed

+17927
-2379
lines changed
 

‎NOTICE

+39
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,39 @@
1+
========================================================
2+
DataX 是阿里云 DataWorks数据集成 的开源版本,在阿里巴巴集团内被广泛使用的离线数据同步工具/平台。DataX 实现了包括 MySQL、Oracle、OceanBase、SqlServer、Postgre、HDFS、Hive、ADS、HBase、TableStore(OTS)、MaxCompute(ODPS)、Hologres、DRDS 等各种异构数据源之间高效的数据同步功能。
3+
4+
DataX is an open source offline data synchronization tool / platform widely used in Alibaba group and other companies. DataX implements efficient data synchronization between heterogeneous data sources including mysql, Oracle, oceanbase, sqlserver, postgre, HDFS, hive, ads, HBase, tablestore (OTS), maxcompute (ODPs), hologres, DRDS, etc.
5+
6+
Copyright 1999-2022 Alibaba Group Holding Ltd.
7+
8+
Licensed under the Apache License, Version 2.0 (the "License");
9+
you may not use this file except in compliance with the License.
10+
You may obtain a copy of the License at
11+
12+
http://www.apache.org/licenses/LICENSE-2.0
13+
14+
Unless required by applicable law or agreed to in writing, software
15+
distributed under the License is distributed on an "AS IS" BASIS,
16+
WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
17+
See the License for the specific language governing permissions and
18+
limitations under the License.
19+
20+
===================================================================
21+
文级别引用,按许可证
22+
This product contains various third-party components under other open source licenses.
23+
This section summarizes those components and their licenses.
24+
GNU Lesser General Public License
25+
--------------------------------------
26+
opentsdbreader/src/main/java/com/alibaba/datax/plugin/reader/conn/CliQuery.java
27+
opentsdbreader/src/main/java/com/alibaba/datax/plugin/reader/conn/Connection4TSDB.java
28+
opentsdbreader/src/main/java/com/alibaba/datax/plugin/reader/conn/DataPoint4TSDB.java
29+
opentsdbreader/src/main/java/com/alibaba/datax/plugin/reader/conn/DumpSeries.java
30+
opentsdbreader/src/main/java/com/alibaba/datax/plugin/reader/conn/OpenTSDBConnection.java
31+
opentsdbreader/src/main/java/com/alibaba/datax/plugin/reader/conn/OpenTSDBDump.java
32+
opentsdbreader/src/main/java/com/alibaba/datax/plugin/reader/opentsdbreader/Constant.java
33+
opentsdbreader/src/main/java/com/alibaba/datax/plugin/reader/opentsdbreader/Key.java
34+
opentsdbreader/src/main/java/com/alibaba/datax/plugin/reader/opentsdbreader/OpenTSDBReader.java
35+
opentsdbreader/src/main/java/com/alibaba/datax/plugin/reader/opentsdbreader/OpenTSDBReaderErrorCode.java
36+
opentsdbreader/src/main/java/com/alibaba/datax/plugin/reader/util/HttpUtils.java
37+
opentsdbreader/src/main/java/com/alibaba/datax/plugin/reader/util/TSDBUtils.java
38+
opentsdbreader/src/main/java/com/alibaba/datax/plugin/reader/util/TimeUtils.java
39+
===================================================================

‎README.md

+4-2
Original file line numberDiff line numberDiff line change
@@ -3,7 +3,7 @@
33

44
# DataX
55

6-
DataX 是阿里云 [DataWorks数据集成](https://www.aliyun.com/product/bigdata/ide) 的开源版本,在阿里巴巴集团内被广泛使用的离线数据同步工具/平台。DataX 实现了包括 MySQL、Oracle、SqlServer、Postgre、HDFS、Hive、ADS、HBase、TableStore(OTS)、MaxCompute(ODPS)、Hologres、DRDS 等各种异构数据源之间高效的数据同步功能。
6+
DataX 是阿里云 [DataWorks数据集成](https://www.aliyun.com/product/bigdata/ide) 的开源版本,在阿里巴巴集团内被广泛使用的离线数据同步工具/平台。DataX 实现了包括 MySQL、Oracle、OceanBase、SqlServer、Postgre、HDFS、Hive、ADS、HBase、TableStore(OTS)、MaxCompute(ODPS)、Hologres、DRDS 等各种异构数据源之间高效的数据同步功能。
77

88
# DataX 商业版本
99
阿里云DataWorks数据集成是DataX团队在阿里云上的商业化产品,致力于提供复杂网络环境下、丰富的异构数据源之间高速稳定的数据移动能力,以及繁杂业务背景下的数据同步解决方案。目前已经支持云上近3000家客户,单日同步数据超过3万亿条。DataWorks数据集成目前支持离线50+种数据源,可以进行整库迁移、批量上云、增量同步、分库分表等各类同步解决方案。2020年更新实时同步能力,2020年更新实时同步能力,支持10+种数据源的读写任意组合。提供MySQL,Oracle等多种数据源到阿里云MaxCompute,Hologres等大数据引擎的一键全增量同步解决方案。
@@ -39,14 +39,15 @@ DataX目前已经有了比较全面的插件体系,主流的RDBMS数据库、N
3939
| ------------ | ---------- | :-------: | :-------: |:-------: |
4040
| RDBMS 关系型数据库 | MySQL |||[](https://github.com/alibaba/DataX/blob/master/mysqlreader/doc/mysqlreader.md)[](https://github.com/alibaba/DataX/blob/master/mysqlwriter/doc/mysqlwriter.md)|
4141
|             | Oracle     |     √     |     √     |[](https://github.com/alibaba/DataX/blob/master/oraclereader/doc/oraclereader.md)[](https://github.com/alibaba/DataX/blob/master/oraclewriter/doc/oraclewriter.md)|
42+
|             | OceanBase  |     √     |     √     |[](https://open.oceanbase.com/docs/community/oceanbase-database/V3.1.0/use-datax-to-full-migration-data-to-oceanbase)[](https://open.oceanbase.com/docs/community/oceanbase-database/V3.1.0/use-datax-to-full-migration-data-to-oceanbase)|
4243
| | SQLServer |||[](https://github.com/alibaba/DataX/blob/master/sqlserverreader/doc/sqlserverreader.md)[](https://github.com/alibaba/DataX/blob/master/sqlserverwriter/doc/sqlserverwriter.md)|
4344
| | PostgreSQL |||[](https://github.com/alibaba/DataX/blob/master/postgresqlreader/doc/postgresqlreader.md)[](https://github.com/alibaba/DataX/blob/master/postgresqlwriter/doc/postgresqlwriter.md)|
4445
| | DRDS |||[](https://github.com/alibaba/DataX/blob/master/drdsreader/doc/drdsreader.md)[](https://github.com/alibaba/DataX/blob/master/drdswriter/doc/drdswriter.md)|
4546
| | 通用RDBMS(支持所有关系型数据库) |||[](https://github.com/alibaba/DataX/blob/master/rdbmsreader/doc/rdbmsreader.md)[](https://github.com/alibaba/DataX/blob/master/rdbmswriter/doc/rdbmswriter.md)|
4647
| 阿里云数仓数据存储 | ODPS |||[](https://github.com/alibaba/DataX/blob/master/odpsreader/doc/odpsreader.md)[](https://github.com/alibaba/DataX/blob/master/odpswriter/doc/odpswriter.md)|
4748
| | ADS | ||[](https://github.com/alibaba/DataX/blob/master/adswriter/doc/adswriter.md)|
4849
| | OSS |||[](https://github.com/alibaba/DataX/blob/master/ossreader/doc/ossreader.md)[](https://github.com/alibaba/DataX/blob/master/osswriter/doc/osswriter.md)|
49-
| | OCS | ||[](https://github.com/alibaba/DataX/blob/master/ocsreader/doc/ocsreader.md)[](https://github.com/alibaba/DataX/blob/master/ocswriter/doc/ocswriter.md)|
50+
| | OCS | ||[](https://github.com/alibaba/DataX/blob/master/ocswriter/doc/ocswriter.md)|
5051
| NoSQL数据存储 | OTS |||[](https://github.com/alibaba/DataX/blob/master/otsreader/doc/otsreader.md)[](https://github.com/alibaba/DataX/blob/master/otswriter/doc/otswriter.md)|
5152
| | Hbase0.94 |||[](https://github.com/alibaba/DataX/blob/master/hbase094xreader/doc/hbase094xreader.md)[](https://github.com/alibaba/DataX/blob/master/hbase094xwriter/doc/hbase094xwriter.md)|
5253
| | Hbase1.1 |||[](https://github.com/alibaba/DataX/blob/master/hbase11xreader/doc/hbase11xreader.md)[](https://github.com/alibaba/DataX/blob/master/hbase11xwriter/doc/hbase11xwriter.md)|
@@ -61,6 +62,7 @@ DataX目前已经有了比较全面的插件体系,主流的RDBMS数据库、N
6162
| | Elasticsearch | ||[](https://github.com/alibaba/DataX/blob/master/elasticsearchwriter/doc/elasticsearchwriter.md)|
6263
| 时间序列数据库 | OpenTSDB || |[](https://github.com/alibaba/DataX/blob/master/opentsdbreader/doc/opentsdbreader.md)|
6364
| | TSDB |||[](https://github.com/alibaba/DataX/blob/master/tsdbreader/doc/tsdbreader.md)[](https://github.com/alibaba/DataX/blob/master/tsdbwriter/doc/tsdbhttpwriter.md)|
65+
| | TDengine |||[](https://github.com/alibaba/DataX/blob/master/tdenginereader/doc/tdenginereader-CN.md)[](https://github.com/alibaba/DataX/blob/master/tdenginewriter/doc/tdenginewriter-CN.md)|
6466

6567
# 阿里云DataWorks数据集成
6668

0 commit comments

Comments
 (0)