I'd be interested to know more about an hdfs issue. I was go to look
to getAddress.
So that one of getSelfAddr or getAddress returned NULL. Is there
Most likely this is an hdfs issue.
Post by David WilliamsHi Ted,
I updated the dependencies and ran the tests again, and on my Mac OSX
$ lein test
Retrieving org/apache/hbase/hbase/0.94.9/hbase-0.94.9.pom from central
Retrieving org/apache/hbase/hbase/0.94.9/hbase-0.94.9.jar from central
Retrieving org/apache/hbase/hbase/0.94.9/hbase-0.94.9-tests.jar from central
lein test hbase.config-test
lein test hbase.table-test
/home/dwilliams/Desktop/Repos/hbase/target/test-data/1140edc6-7242-40cd-8ed8-05847fb14949/dfscluster_1e40ce89-1986-450b-ba6d-983caa9aeb78/dfs/data/data1,/home/dwilliams/Desktop/Repos/hbase/target/test-data/1140edc6-7242-40cd-8ed8-05847fb14949/dfscluster_1e40ce89-1986-450b-ba6d-983caa9aeb78/dfs/data/data2
lein test :only hbase.table-test/create-table
ERROR in (create-table) (MiniDFSCluster.java:426)
Uncaught exception, not in assertion.
expected: nil
actual: java.lang.NullPointerException: null
at org.apache.hadoop.hdfs.MiniDFSCluster.startDataNodes
(MiniDFSCluster.java:426)
org.apache.hadoop.hdfs.MiniDFSCluster.<init>
(MiniDFSCluster.java:284)
org.apache.hadoop.hbase.HBaseTestingUtility.startMiniDFSCluster
(HBaseTestingUtility.java:451)
org.apache.hadoop.hbase.HBaseTestingUtility.startMiniCluster
(HBaseTestingUtility.java:619)
org.apache.hadoop.hbase.HBaseTestingUtility.startMiniCluster
(HBaseTestingUtility.java:575)
org.apache.hadoop.hbase.HBaseTestingUtility.startMiniCluster
(HBaseTestingUtility.java:562)
hbase.table_test$test_config.doInvoke (table_test.clj:10)
clojure.lang.RestFn.invoke (RestFn.java:397)
hbase.table_test/fn (table_test.clj:19)
Do you mind trying the following change to see if the problem persists
for latest 0.94 release ?
Thanks
diff --git a/project.clj b/project.clj
index 2554784..0d8be0e 100644
--- a/project.clj
+++ b/project.clj
@@ -5,8 +5,8 @@
:dependencies [
[org.clojure/clojure "1.5.1"]
[org.apache.hadoop/hadoop-core "1.2.0"]
- [org.apache.hbase/hbase "0.94.6.1"]
+ [org.apache.hbase/hbase "0.94.9"]
[org.apache.hadoop/hadoop-test "1.2.0"]
- [org.apache.hbase/hbase "0.94.6.1" :classifier "tests"]]
+ [org.apache.hbase/hbase "0.94.9" :classifier "tests"]]
:plugins [[lein-marginalia "0.7.1"]])
On Fri, Jul 12, 2013 at 10:22 PM, David Williams <
Post by David WilliamsHi Ted,
In terms of versions, here are the jars I'm using, which come from Maven Central.
org.apache.hadoop/hadoop-core "1.2.0"
org.apache.hbase/hbase "0.94.6.1"
org.apache.hadoop/hadoop-test "1.2.0"
org.apache.hbase/hbase "0.94.6.1" :classifier "tests"
The flag ':classifier "tests"' above is a specific instruction to to
the Leiningen 2.0 to use the pomegranate library to handle Sonatype Aether
and dynamic runtime modification of the classpath, which in this case is
needed to import org.apache.hadoop.hbase HBaseTestingUtility.
https://github.com/cemerick/pomegranate
user=> (import 'java.net.InetSocketAddress)
java.net.InetSocketAddress
user=> (def x (InetSocketAddress. 8000))
#'user/x
user=> (.getAddress x)
#<Inet4Address 0.0.0.0/0.0.0.0>
user=>
Then I check on a CentOS vm, the unit tests still fail but the address
resolution also worked in the repl and produced the same output as above.
I installed lein on Mac and Linux.
lein test hbase.table-test
/homes/hortonzy/mobius/target/test-data/246828b9-1be9-4949-9bbc-b215b378fb67/dfscluster_9ed0bd88-d309-4fed-9823-3bbf86973ae4/dfs/data/data1,/homes/hortonzy/mobius/target/test-data/246828b9-1be9-4949-9bbc-b215b378fb67/dfscluster_9ed0bd88-d309-4fed-9823-3bbf86973ae4/dfs/data/data2
Cluster is active
Ran 11 tests containing 14 assertions.
0 failures, 0 errors.
Linux a.net 2.6.32-220.23.1.el6.YAHOO.20120713.x86_64 #1 SMP Fri Jul
13 11:40:51 CDT 2012 x86_64 x86_64 x86_64 GNU/Linux
String ipAddr = dn.getSelfAddr().getAddress().getHostAddress();
It seems dn.getSelfAddr().getAddress() returned null.
http://docs.oracle.com/javase/7/docs/api/java/net/InetSocketAddress.html#getAddress()
This would mean address resolution problem.
Can you check ?
Cheers
On Fri, Jul 12, 2013 at 7:37 PM, David Williams <
Post by David WilliamsHi all,
I am having an issue starting the a mini cluster for the
HBaseTestingUtility. In short I can on Mac OSX, but cannot on Linux. But
the error is cryptic and I don't know what to do next.
I submitted a ticket with full details on StackOverflow,
http://stackoverflow.com/questions/17625938/hbase-minidfscluster-java-fails-in-certain-environments
But when I call .startMiniCluster on an instance of
ERROR in (create-table) (MiniDFSCluster.java:426)
Uncaught exception, not in assertion.
expected: nil
actual: java.lang.NullPointerException: null
at org.apache.hadoop.hdfs.MiniDFSCluster.startDataNodes
(MiniDFSCluster.java:426)
org.apache.hadoop.hdfs.MiniDFSCluster.<init>
(MiniDFSCluster.java:284)
org.apache.hadoop.hbase.HBaseTestingUtility.startMiniDFSCluster
(HBaseTestingUtility.java:444)
org.apache.hadoop.hbase.HBaseTestingUtility.startMiniCluster
(HBaseTestingUtility.java:612)
org.apache.hadoop.hbase.HBaseTestingUtility.startMiniCluster
(HBaseTestingUtility.java:568)
org.apache.hadoop.hbase.HBaseTestingUtility.startMiniCluster
(HBaseTestingUtility.java:555)
I would appreciate help in finding out whats going on and how to set
up my ENV to use the HBaseTestingUtility.
Thanks
David