Skip to content
This repository has been archived by the owner on May 21, 2018. It is now read-only.

Zookeeper Process failed when HDFS process started in Mesos #269

Open
mytechskill opened this issue Aug 12, 2016 · 4 comments
Open

Zookeeper Process failed when HDFS process started in Mesos #269

mytechskill opened this issue Aug 12, 2016 · 4 comments

Comments

@mytechskill
Copy link

mytechskill commented Aug 12, 2016

I have setup a cluster with 7 node each having 4cpu, 16GB RAM and 50GB memory. Trying to setup hdfs on it. 1st 3 node as a master unfortunately when I started HDFS it is giving me error "Offer does not have enough resources" continuously.

While checking the status of zookeeper it also giving below error
"INFO [ProcessThread(sid:2 cport:-1)::PrepRequestProcessor@645] - Got user-level KeeperException when processing sessionid:0x25679a5dc6b001d type:create cxid:0x57b38785 zxid:0x8a000015b5 txntype:-1 reqpath:n/a Error Path:/hdfs-mesos/hdfs/tasks Error:KeeperErrorCode = NodeExists for /hdfs-mesos/hdfs/tasks"

Every time it creates a new zkfc and namenode process but after certain interval it fails but journalnode remain in running state. In sandbox log getting below error

"INFO zookeeper.ClientCnxn: Opening socket connection to server localhost/127.0.0.1:2181. Will not attempt to authenticate using SASL (unknown error)"

Note: Previously when I was using mesos0.28 with zookeeper3.4.5 there were no such error once I upgraded to mesos1.0 and zookeeper3.4.6 the above error being displayed.

Can anyone please let me know the minimum requirement to do the setup or where I am missing.

Thanks in Advance!!!

@kensipe
Copy link

kensipe commented Aug 22, 2016

perhaps you have exceeded the maxclientcnxns of zk. that is a common issue.

@mytechskill
Copy link
Author

Hi Ken,

What and where I should change maxclientcnxns value.

On Tue, Aug 23, 2016 at 12:27 AM, Ken Sipe [email protected] wrote:

perhaps you have exceeded the maxclientcnxns of zk. that is a common
issue.


You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
#269 (comment),
or mute the thread
https://github.com/notifications/unsubscribe-auth/AUA2YRJshH3I1HvtZrQHqi2LEK7pxwvuks5qifEsgaJpZM4Ji1qW
.

@kensipe
Copy link

kensipe commented Aug 25, 2016

maxclientcnxns is a configuration in zoo.cfg

https://zookeeper.apache.org/doc/r3.2.2/zookeeperAdmin.html

let me know if it doesn't help

@triclambert
Copy link

Please note that this repository is now deprecated. See this issue for a more detailed explanation.

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants