SCSB-ETL

ETL (Extract Load Transform)

The SCSB Middleware codebase and components are all licensed under the Apache 2.0 license, with the exception of a set of API design components (JSF, JQuery, and Angular JS), which are licensed under MIT X11.

SCSB-ETL is a microservice application that provides a major functionality for loading data into the database and exporting data as incremental, full or deleted data dumps.

Software Required

• Java 11
• Docker 19.03.13

Prerequisite

1.Cloud Config Server

Dspring.cloud.config.uri=http://scsb-config-server:

Build

Download the Project , navigate inside project folder and build the project using below command

./gradlew clean build -x test

Docker Image Creation

Naviagte Inside project folder where Dockerfile is present and Execute the below command

sudo docker build -t scsb-etl .

Docker Run

User the below command to Run the Docker

sudo docker run --name scsb-etl -v --label collect_logs_with_filebeat="true" --label decode_log_event_to_json_object="true" -p : -e "ENV= -XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath=/recap-vol/scsb-etl/heapdump/
-Dorg.apache.activemq.SERIALIZABLE_PACKAGES="*" -Dspring.cloud.config.uri=http://scsb-config-server: " --network=scsb -d scsb-etl