dimanche 18 août 2019

How to fix `Master not active after 30000 seconds` using hadoop-mini-clusters hbase?

I'm trying to create integration tests for HBase (0.1.16) using https://github.com/sakserv/hadoop-mini-clusters. My settings in tests almost identical to sample in README:

  val zookeeperLocalCluster = new ZookeeperLocalCluster.Builder()
    .setPort(12345)
    .setTempDir("embedded_zookeeper")
    .setZookeeperConnectionString("localhost:12345")
    .setMaxClientCnxns(60)
    .setElectionPort(20001)
    .setQuorumPort(20002)
    .setDeleteDataDirectoryOnClose(true)
    .setServerId(1)
    .setTickTime(2000)
    .build()

  val hbaseLocalCluster = new HbaseLocalCluster.Builder()
    .setHbaseMasterPort(-1)
    .setHbaseMasterInfoPort(-1)
    .setNumRegionServers(1)
    .setHbaseRootDir("embedded_hbase")
    .setZookeeperPort(12345)
    .setZookeeperConnectionString("localhost:12345")
    .setZookeeperZnodeParent("/hbase-unsecure")
    .setHbaseWalReplicationEnabled(false)
    .setHbaseConfiguration(new Configuration())
    .build()

Thre problem is that when i start my tests i got this:

Master not active after 30000 seconds

My gradle build:

dependencies {
    constraints {
        compile group: 'ch.qos.logback', name: 'logback-classic', version: '1.2.3'
        compile group: 'org.apache.hbase', name: 'hbase-client', version: '1.1.2.2.6.5.0-292'

        testCompile group: 'org.eclipse.jetty', name: 'jetty-servlet', version: '9.2.28.v20190418'
        testCompile group: 'org.eclipse.jetty', name: 'jetty-jsp', version: '9.2.28.v20190418'
        testCompile group: 'org.scalatest', name: 'scalatest_2.11', version: '3.0.8'
        testCompile group: 'com.github.sakserv', name: 'hadoop-mini-clusters-zookeeper', version: '0.1.16'
        testCompile group: 'com.github.sakserv', name: 'hadoop-mini-clusters-hbase', version: '0.1.16'
    }

    implementation 'org.scala-lang:scala-library:2.11.12'

    compile group: 'ch.qos.logback', name: 'logback-classic'
    compile group: 'org.apache.hbase', name: 'hbase-client'

    testCompile group: 'org.eclipse.jetty', name: 'jetty-servlet'
    testCompile group: 'org.eclipse.jetty', name: 'jetty-jsp'
    testCompile group: 'org.scalatest', name: 'scalatest_2.11'
    testCompile group: 'com.github.sakserv', name: 'hadoop-mini-clusters-zookeeper'
    testCompile(group: 'com.github.sakserv', name: 'hadoop-mini-clusters-hbase') {
        exclude group: 'tomcat'
        exclude group: 'org.mortbay.jetty'
    }
}

Maybe the problem is in exclusions in versions, but if i remove them i got error about NoSuchMethods or Field does not exist in jetty.

Aucun commentaire:

Enregistrer un commentaire