bigtop-mpack

This was forked from @guyuqi who created all of this. It was forked so I could make changes to start making forward progress.

Please put 'bgtp-ambari-mpack' in the path: $Ambari_Source/contrib/management-packs

To build:

cd bigtop-mpack/bgtp-ambari-mpack/
mvn clean package -DskipTests # mpack will now be located in the ./target/

To Install into ambari: (on the Ambari server run)

sudo ambari-server stop
sudo ambari-server install-mpack --mpack=./target/bgtp-ambari-mpack-1.0.0.0-SNAPSHOT-bgtp-ambari-mpack.tar.gz
sudo ambari-server start

As with any installation you will need to setup your hive database before installing the hive metastore. Here are some easy to follow instructions to help you complete that: Warning: if you blindly follow instructions your install will fail as by default the database is called 'hive' in ambari configuration, but the below instructions use 'metastore' you have been warned https://docs.cloudera.com/runtime/7.0.0/hive-metastore/topics/hive-mysql_.html

Troubleshooting:

Read the ambari server logs located: /var/log/ambari-server/ambari-server.log

Usefull commands for development.

sudo ambari-server install-mpack --mpack=./target/bgtp-ambari-mpack-1.0.0.0-SNAPSHOT-bgtp-ambari-mpack.tar.gz --purge # will delete previously installed mpacks only use it if you want to delete prevoiusly installed mpacks

sudo ambari-server reset # --> will reset ambari back to "new install"  only use if you mean it. It will delete *ALL* config.

ERROR Messages

Underlying cause: java.sql.SQLException : No timezone mapping entry for 'EDT'

When you are trying to start the hiev meta server and you get this error alter your database JDBC string

Adjust your Database URL jdbc:mysql://localhost/hive?createDatabaseIfNotExist=true&serverTimezone=EST

Underlying cause: java.sql.SQLSyntaxErrorException : Access denied for user 'hive'@'localhost' to database 'hive'

When starting the hive metadata server. You likely need to follow these steps to create the hive user and give it access to create a hive database: Warning: if you blindly follow instructions your install will fail as by default the database is called 'hive' in ambari configuration, but the below instructions use 'metastore' you have been warned https://docs.cloudera.com/runtime/7.0.0/hive-metastore/topics/hive-mysql_.html