Skip to content

Commit 5e81740

Browse files
wuchunfuAl-assadwolfboys
authored
[Enhancement apache#512] add header check style (apache#514)
* [WIP] compatible with both flink yarn/k8s modes task submission/termination (apache#261) * [feature] flink k8s native mode support * [feature] flink k8s native mode support * [issue#220] refactoring SubmitRequest, SubmitResponse to adapt k8s submit operations * [issue#220] refactoring SubmitRequest, SubmitResponse to adapt k8s submit operations * [issue#220] New dto object for flink stop action parameter transfer process * [issue#220] refactor: move the parameters of the flink stop method to a dedicated dto object * modify configuration constants of workspace(apache#251) * typo(apache#251) * add isAnyBank method(apache#251) * add unified fs operator defined(apache#251) * register FsOperator to SpringBoot Bean(apache#251) * remove unnecessary import(apache#251) * extend the signature of method upload, copy, copyDir(apache#251) * Separate workspace storage type into configuration(apache#251) * Separate workspace storage type into configuration(apache#251) * add fileMd5 method(apache#251) * replace the code reference of HdfsUtils to FsOperator(apache#251) * change the bean injection behavior of FsOperator(apache#251) * change the config key of streamx.workspace(apache#251) * fix stack overflow bug * LfsOperator.upload support dir source * Update ConfigConst.scala * Update HdfsOperator.scala * Update LfsOperator.scala * Update UnifiledFsOperator.scala * Update Utils.scala * compatible with flink k8s submit * compatible with flink k8s submit Co-authored-by: benjobs <[email protected]> * Revert "[WIP] compatible with both flink yarn/k8s modes task submission/termination (apache#261)" (apache#262) This reverts commit 7ae4d15. * Provide Flink-K8s Runtime Support for StreamX (apache#325) [feature] Support for submit/cancel Flink-SQL-Job on Flink-K8s-native session/application mode. [feature] Support for tracking Flink job status and metrics information from Flink-K8s cluster. [feature] Support for StreamX instance to manage both Flink-Yarn or Flink-K8s runtime Cluster, and to use either * [Enhancement apache#480] add code style framework * [Enhancement apache#480] add code style framework * [Enhancement apache#480] add code style framework * [Enhancement apache#480] add code style framework * [Enhancement apache#512] add header check style * reset Co-authored-by: al-assad <[email protected]> Co-authored-by: benjobs <[email protected]>
1 parent bc027d3 commit 5e81740

File tree

488 files changed

+7515
-8182
lines changed

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.

488 files changed

+7515
-8182
lines changed

pom.xml

+1
Original file line numberDiff line numberDiff line change
@@ -757,6 +757,7 @@
757757
<artifactId>nexus-staging-maven-plugin</artifactId>
758758
</plugin>
759759
-->
760+
760761
</plugins>
761762

762763
</build>

scalastyle-config.xml

+23
Original file line numberDiff line numberDiff line change
@@ -36,6 +36,29 @@ This file is divided into 3 sections:
3636
<scalastyle>
3737
<name>Scalastyle standard configuration</name>
3838

39+
<check level="error" class="org.scalastyle.file.HeaderMatchesChecker" enabled="true">
40+
<parameters>
41+
<parameter name="header"><![CDATA[/*
42+
* Copyright (c) 2019 The StreamX Project
43+
*
44+
* Licensed to the Apache Software Foundation (ASF) under one or more
45+
* contributor license agreements. See the NOTICE file distributed with
46+
* this work for additional information regarding copyright ownership.
47+
* The ASF licenses this file to You under the Apache License, Version 2.0
48+
* (the "License"); you may not use this file except in compliance with
49+
* the License. You may obtain a copy of the License at
50+
*
51+
* https://www.apache.org/licenses/LICENSE-2.0
52+
*
53+
* Unless required by applicable law or agreed to in writing, software
54+
* distributed under the License is distributed on an "AS IS" BASIS,
55+
* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
56+
* See the License for the specific language governing permissions and
57+
* limitations under the License.
58+
*/]]></parameter>
59+
</parameters>
60+
</check>
61+
3962
<check level="error" class="org.scalastyle.file.FileTabChecker" enabled="true"/>
4063

4164
<check level="error" class="org.scalastyle.scalariform.SpacesAfterPlusChecker" enabled="true"/>

streamx-common/src/main/scala/com/streamxhub/streamx/common/conf/ConfigConst.scala

+15-17
Original file line numberDiff line numberDiff line change
@@ -1,22 +1,20 @@
11
/*
22
* Copyright (c) 2019 The StreamX Project
3-
* <p>
4-
* Licensed to the Apache Software Foundation (ASF) under one
5-
* or more contributor license agreements. See the NOTICE file
6-
* distributed with this work for additional information
7-
* regarding copyright ownership. The ASF licenses this file
8-
* to you under the Apache License, Version 2.0 (the
9-
* "License"); you may not use this file except in compliance
10-
* with the License. You may obtain a copy of the License at
11-
* <p>
12-
* http://www.apache.org/licenses/LICENSE-2.0
13-
* <p>
14-
* Unless required by applicable law or agreed to in writing,
15-
* software distributed under the License is distributed on an
16-
* "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
17-
* KIND, either express or implied. See the License for the
18-
* specific language governing permissions and limitations
19-
* under the License.
3+
*
4+
* Licensed to the Apache Software Foundation (ASF) under one or more
5+
* contributor license agreements. See the NOTICE file distributed with
6+
* this work for additional information regarding copyright ownership.
7+
* The ASF licenses this file to You under the Apache License, Version 2.0
8+
* (the "License"); you may not use this file except in compliance with
9+
* the License. You may obtain a copy of the License at
10+
*
11+
* https://www.apache.org/licenses/LICENSE-2.0
12+
*
13+
* Unless required by applicable law or agreed to in writing, software
14+
* distributed under the License is distributed on an "AS IS" BASIS,
15+
* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
16+
* See the License for the specific language governing permissions and
17+
* limitations under the License.
2018
*/
2119
package com.streamxhub.streamx.common.conf
2220

streamx-common/src/main/scala/com/streamxhub/streamx/common/conf/ConfigurationOptions.java

+16-18
Original file line numberDiff line numberDiff line change
@@ -1,22 +1,20 @@
11
/*
2-
* Copyright (c) 2021 The StreamX Project
3-
* <p>
4-
* Licensed to the Apache Software Foundation (ASF) under one
5-
* or more contributor license agreements. See the NOTICE file
6-
* distributed with this work for additional information
7-
* regarding copyright ownership. The ASF licenses this file
8-
* to you under the Apache License, Version 2.0 (the
9-
* "License"); you may not use this file except in compliance
10-
* with the License. You may obtain a copy of the License at
11-
* <p>
12-
* http://www.apache.org/licenses/LICENSE-2.0
13-
* <p>
14-
* Unless required by applicable law or agreed to in writing,
15-
* software distributed under the License is distributed on an
16-
* "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
17-
* KIND, either express or implied. See the License for the
18-
* specific language governing permissions and limitations
19-
* under the License.
2+
* Copyright (c) 2019 The StreamX Project
3+
*
4+
* Licensed to the Apache Software Foundation (ASF) under one or more
5+
* contributor license agreements. See the NOTICE file distributed with
6+
* this work for additional information regarding copyright ownership.
7+
* The ASF licenses this file to You under the Apache License, Version 2.0
8+
* (the "License"); you may not use this file except in compliance with
9+
* the License. You may obtain a copy of the License at
10+
*
11+
* https://www.apache.org/licenses/LICENSE-2.0
12+
*
13+
* Unless required by applicable law or agreed to in writing, software
14+
* distributed under the License is distributed on an "AS IS" BASIS,
15+
* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
16+
* See the License for the specific language governing permissions and
17+
* limitations under the License.
2018
*/
2119
package com.streamxhub.streamx.common.conf;
2220

streamx-common/src/main/scala/com/streamxhub/streamx/common/conf/Workspace.scala

+16-18
Original file line numberDiff line numberDiff line change
@@ -1,22 +1,20 @@
11
/*
2-
* Copyright (c) 2021 The StreamX Project
3-
* <p>
4-
* Licensed to the Apache Software Foundation (ASF) under one
5-
* or more contributor license agreements. See the NOTICE file
6-
* distributed with this work for additional information
7-
* regarding copyright ownership. The ASF licenses this file
8-
* to you under the Apache License, Version 2.0 (the
9-
* "License"); you may not use this file except in compliance
10-
* with the License. You may obtain a copy of the License at
11-
* <p>
12-
* http://www.apache.org/licenses/LICENSE-2.0
13-
* <p>
14-
* Unless required by applicable law or agreed to in writing,
15-
* software distributed under the License is distributed on an
16-
* "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
17-
* KIND, either express or implied. See the License for the
18-
* specific language governing permissions and limitations
19-
* under the License.
2+
* Copyright (c) 2019 The StreamX Project
3+
*
4+
* Licensed to the Apache Software Foundation (ASF) under one or more
5+
* contributor license agreements. See the NOTICE file distributed with
6+
* this work for additional information regarding copyright ownership.
7+
* The ASF licenses this file to You under the Apache License, Version 2.0
8+
* (the "License"); you may not use this file except in compliance with
9+
* the License. You may obtain a copy of the License at
10+
*
11+
* https://www.apache.org/licenses/LICENSE-2.0
12+
*
13+
* Unless required by applicable law or agreed to in writing, software
14+
* distributed under the License is distributed on an "AS IS" BASIS,
15+
* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
16+
* See the License for the specific language governing permissions and
17+
* limitations under the License.
2018
*/
2119
package com.streamxhub.streamx.common.conf
2220

streamx-common/src/main/scala/com/streamxhub/streamx/common/domain/FlinkMemorySize.java

+9-9
Original file line numberDiff line numberDiff line change
@@ -1,13 +1,14 @@
11
/*
2-
* Licensed to the Apache Software Foundation (ASF) under one
3-
* or more contributor license agreements. See the NOTICE file
4-
* distributed with this work for additional information
5-
* regarding copyright ownership. The ASF licenses this file
6-
* to you under the Apache License, Version 2.0 (the
7-
* "License"); you may not use this file except in compliance
8-
* with the License. You may obtain a copy of the License at
2+
* Copyright (c) 2019 The StreamX Project
93
*
10-
* http://www.apache.org/licenses/LICENSE-2.0
4+
* Licensed to the Apache Software Foundation (ASF) under one or more
5+
* contributor license agreements. See the NOTICE file distributed with
6+
* this work for additional information regarding copyright ownership.
7+
* The ASF licenses this file to You under the Apache License, Version 2.0
8+
* (the "License"); you may not use this file except in compliance with
9+
* the License. You may obtain a copy of the License at
10+
*
11+
* https://www.apache.org/licenses/LICENSE-2.0
1112
*
1213
* Unless required by applicable law or agreed to in writing, software
1314
* distributed under the License is distributed on an "AS IS" BASIS,
@@ -17,7 +18,6 @@
1718
*/
1819
package com.streamxhub.streamx.common.domain;
1920

20-
2121
import com.streamxhub.streamx.common.util.AssertUtils;
2222

2323
import java.math.BigDecimal;

streamx-common/src/main/scala/com/streamxhub/streamx/common/domain/FlinkVersion.scala

+16-20
Original file line numberDiff line numberDiff line change
@@ -1,22 +1,20 @@
11
/*
2-
* Copyright (c) 2021 The StreamX Project
3-
* <p>
4-
* Licensed to the Apache Software Foundation (ASF) under one
5-
* or more contributor license agreements. See the NOTICE file
6-
* distributed with this work for additional information
7-
* regarding copyright ownership. The ASF licenses this file
8-
* to you under the Apache License, Version 2.0 (the
9-
* "License"); you may not use this file except in compliance
10-
* with the License. You may obtain a copy of the License at
11-
* <p>
12-
* http://www.apache.org/licenses/LICENSE-2.0
13-
* <p>
14-
* Unless required by applicable law or agreed to in writing,
15-
* software distributed under the License is distributed on an
16-
* "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
17-
* KIND, either express or implied. See the License for the
18-
* specific language governing permissions and limitations
19-
* under the License.
2+
* Copyright (c) 2019 The StreamX Project
3+
*
4+
* Licensed to the Apache Software Foundation (ASF) under one or more
5+
* contributor license agreements. See the NOTICE file distributed with
6+
* this work for additional information regarding copyright ownership.
7+
* The ASF licenses this file to You under the Apache License, Version 2.0
8+
* (the "License"); you may not use this file except in compliance with
9+
* the License. You may obtain a copy of the License at
10+
*
11+
* https://www.apache.org/licenses/LICENSE-2.0
12+
*
13+
* Unless required by applicable law or agreed to in writing, software
14+
* distributed under the License is distributed on an "AS IS" BASIS,
15+
* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
16+
* See the License for the specific language governing permissions and
17+
* limitations under the License.
2018
*/
2119
package com.streamxhub.streamx.common.domain
2220

@@ -29,15 +27,13 @@ import java.util.function.Consumer
2927
import java.util.regex.Pattern
3028
import scala.collection.JavaConversions._
3129

32-
3330
/**
3431
* @author Al-assad
3532
* @author benjobs
3633
* @param flinkHome Autual flink home that must be a readable local path
3734
*/
3835
class FlinkVersion(val flinkHome: String) extends java.io.Serializable {
3936

40-
4137
private[this] lazy val FLINK_VER_PATTERN = Pattern.compile("^(\\d+\\.\\d+)(\\.)?.*$")
4238

4339
private[this] lazy val FLINK_VERSION_PATTERN = Pattern.compile("^Version: (.*), Commit ID: (.*)$")

streamx-common/src/main/scala/com/streamxhub/streamx/common/enums/ApiType.scala

+15-17
Original file line numberDiff line numberDiff line change
@@ -1,22 +1,20 @@
11
/*
22
* Copyright (c) 2019 The StreamX Project
3-
* <p>
4-
* Licensed to the Apache Software Foundation (ASF) under one
5-
* or more contributor license agreements. See the NOTICE file
6-
* distributed with this work for additional information
7-
* regarding copyright ownership. The ASF licenses this file
8-
* to you under the Apache License, Version 2.0 (the
9-
* "License"); you may not use this file except in compliance
10-
* with the License. You may obtain a copy of the License at
11-
* <p>
12-
* http://www.apache.org/licenses/LICENSE-2.0
13-
* <p>
14-
* Unless required by applicable law or agreed to in writing,
15-
* software distributed under the License is distributed on an
16-
* "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
17-
* KIND, either express or implied. See the License for the
18-
* specific language governing permissions and limitations
19-
* under the License.
3+
*
4+
* Licensed to the Apache Software Foundation (ASF) under one or more
5+
* contributor license agreements. See the NOTICE file distributed with
6+
* this work for additional information regarding copyright ownership.
7+
* The ASF licenses this file to You under the Apache License, Version 2.0
8+
* (the "License"); you may not use this file except in compliance with
9+
* the License. You may obtain a copy of the License at
10+
*
11+
* https://www.apache.org/licenses/LICENSE-2.0
12+
*
13+
* Unless required by applicable law or agreed to in writing, software
14+
* distributed under the License is distributed on an "AS IS" BASIS,
15+
* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
16+
* See the License for the specific language governing permissions and
17+
* limitations under the License.
2018
*/
2119
package com.streamxhub.streamx.common.enums
2220

streamx-common/src/main/scala/com/streamxhub/streamx/common/enums/ApplicationType.java

+15-17
Original file line numberDiff line numberDiff line change
@@ -1,22 +1,20 @@
11
/*
22
* Copyright (c) 2019 The StreamX Project
3-
* <p>
4-
* Licensed to the Apache Software Foundation (ASF) under one
5-
* or more contributor license agreements. See the NOTICE file
6-
* distributed with this work for additional information
7-
* regarding copyright ownership. The ASF licenses this file
8-
* to you under the Apache License, Version 2.0 (the
9-
* "License"); you may not use this file except in compliance
10-
* with the License. You may obtain a copy of the License at
11-
* <p>
12-
* http://www.apache.org/licenses/LICENSE-2.0
13-
* <p>
14-
* Unless required by applicable law or agreed to in writing,
15-
* software distributed under the License is distributed on an
16-
* "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
17-
* KIND, either express or implied. See the License for the
18-
* specific language governing permissions and limitations
19-
* under the License.
3+
*
4+
* Licensed to the Apache Software Foundation (ASF) under one or more
5+
* contributor license agreements. See the NOTICE file distributed with
6+
* this work for additional information regarding copyright ownership.
7+
* The ASF licenses this file to You under the Apache License, Version 2.0
8+
* (the "License"); you may not use this file except in compliance with
9+
* the License. You may obtain a copy of the License at
10+
*
11+
* https://www.apache.org/licenses/LICENSE-2.0
12+
*
13+
* Unless required by applicable law or agreed to in writing, software
14+
* distributed under the License is distributed on an "AS IS" BASIS,
15+
* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
16+
* See the License for the specific language governing permissions and
17+
* limitations under the License.
2018
*/
2119
package com.streamxhub.streamx.common.enums;
2220

streamx-common/src/main/scala/com/streamxhub/streamx/common/enums/CheckpointStorage.scala

+15-17
Original file line numberDiff line numberDiff line change
@@ -1,22 +1,20 @@
11
/*
22
* Copyright (c) 2019 The StreamX Project
3-
* <p>
4-
* Licensed to the Apache Software Foundation (ASF) under one
5-
* or more contributor license agreements. See the NOTICE file
6-
* distributed with this work for additional information
7-
* regarding copyright ownership. The ASF licenses this file
8-
* to you under the Apache License, Version 2.0 (the
9-
* "License"); you may not use this file except in compliance
10-
* with the License. You may obtain a copy of the License at
11-
* <p>
12-
* http://www.apache.org/licenses/LICENSE-2.0
13-
* <p>
14-
* Unless required by applicable law or agreed to in writing,
15-
* software distributed under the License is distributed on an
16-
* "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
17-
* KIND, either express or implied. See the License for the
18-
* specific language governing permissions and limitations
19-
* under the License.
3+
*
4+
* Licensed to the Apache Software Foundation (ASF) under one or more
5+
* contributor license agreements. See the NOTICE file distributed with
6+
* this work for additional information regarding copyright ownership.
7+
* The ASF licenses this file to You under the Apache License, Version 2.0
8+
* (the "License"); you may not use this file except in compliance with
9+
* the License. You may obtain a copy of the License at
10+
*
11+
* https://www.apache.org/licenses/LICENSE-2.0
12+
*
13+
* Unless required by applicable law or agreed to in writing, software
14+
* distributed under the License is distributed on an "AS IS" BASIS,
15+
* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
16+
* See the License for the specific language governing permissions and
17+
* limitations under the License.
2018
*/
2119
package com.streamxhub.streamx.common.enums
2220

streamx-common/src/main/scala/com/streamxhub/streamx/common/enums/DevelopmentMode.java

+15-17
Original file line numberDiff line numberDiff line change
@@ -1,22 +1,20 @@
11
/*
22
* Copyright (c) 2019 The StreamX Project
3-
* <p>
4-
* Licensed to the Apache Software Foundation (ASF) under one
5-
* or more contributor license agreements. See the NOTICE file
6-
* distributed with this work for additional information
7-
* regarding copyright ownership. The ASF licenses this file
8-
* to you under the Apache License, Version 2.0 (the
9-
* "License"); you may not use this file except in compliance
10-
* with the License. You may obtain a copy of the License at
11-
* <p>
12-
* http://www.apache.org/licenses/LICENSE-2.0
13-
* <p>
14-
* Unless required by applicable law or agreed to in writing,
15-
* software distributed under the License is distributed on an
16-
* "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
17-
* KIND, either express or implied. See the License for the
18-
* specific language governing permissions and limitations
19-
* under the License.
3+
*
4+
* Licensed to the Apache Software Foundation (ASF) under one or more
5+
* contributor license agreements. See the NOTICE file distributed with
6+
* this work for additional information regarding copyright ownership.
7+
* The ASF licenses this file to You under the Apache License, Version 2.0
8+
* (the "License"); you may not use this file except in compliance with
9+
* the License. You may obtain a copy of the License at
10+
*
11+
* https://www.apache.org/licenses/LICENSE-2.0
12+
*
13+
* Unless required by applicable law or agreed to in writing, software
14+
* distributed under the License is distributed on an "AS IS" BASIS,
15+
* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
16+
* See the License for the specific language governing permissions and
17+
* limitations under the License.
2018
*/
2119
package com.streamxhub.streamx.common.enums;
2220

0 commit comments

Comments
 (0)