Quantcast

remote hbase connection failure

classic Classic list List threaded Threaded
10 messages Options
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

remote hbase connection failure

ranInc
I am trying to connect to hbase that I installed on hadoop that I installed on a ubuntu machine. when using hbase shell, I can create tables and get data.

I cannot remotely connect to to hbase (using java). This is what I get on the client side:13/03/12 16:12:59 WARN zookeeper.ClientCnxn: Session 0x13d5eef63760003 for server null, unexpected error, closing socket connection and attempting reconnect
java.net.ConnectException: Connection refused: no further information
    at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
    at sun.nio.ch.SocketChannelImpl.finishConnect(Unknown Source)
    at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)

On the hbase log I see that the session is expired, thus closing the connection to my client, but looking back on the log, I see this error: execption in region server:
java.lang.IllegalArgumentException: Pathname /hbase/.logs/0:0:0:0:0:0:0:1,48170,1363095825458 from hdfs://147.11.88.163:8020/hbase/.logs/0:0:0:0:0:0:0:1,48170,1363095825458 is not a valid DFS filename.

After this error I see that it seems like the region server (what ever it is) is aborted and goes down - this might be why I cannot successfully connect to the hbase remotely.

Can someone help?
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Re: remote hbase connection failure

gaurhari dass
can you paste configuration code which your are using in java??

On Wed, Mar 13, 2013 at 7:53 PM, ranInc <[hidden email]> wrote:

> I am trying to connect to hbase that I installed on hadoop that I installed
> on a ubuntu machine. when using hbase shell, I can create tables and get
> data.
>
> I cannot remotely connect to to hbase (using java). This is what I get on
> the client side:13/03/12 16:12:59 WARN zookeeper.ClientCnxn: Session
> 0x13d5eef63760003 for server null, unexpected error, closing socket
> connection and attempting reconnect
> java.net.ConnectException: Connection refused: no further information
>     at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
>     at sun.nio.ch.SocketChannelImpl.finishConnect(Unknown Source)
>     at
>
> org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
>
> On the hbase log I see that the session is expired, thus closing the
> connection to my client, but looking back on the log, I see this error:
> execption in region server:
> java.lang.IllegalArgumentException: Pathname
> /hbase/.logs/0:0:0:0:0:0:0:1,48170,1363095825458 from
> hdfs://147.11.88.163:8020/hbase/.logs/0:0:0:0:0:0:0:1,48170,1363095825458is
> not a valid DFS filename.
>
> After this error I see that it seems like the region server (what ever it
> is) is aborted and goes down - this might be why I cannot successfully
> connect to the hbase remotely.
>
> Can someone help?
>
>
>
>
> --
> View this message in context:
> http://apache-hbase.679495.n3.nabble.com/remote-hbase-connection-failure-tp4040140.html
> Sent from the HBase User mailing list archive at Nabble.com.
>
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Re: remote hbase connection failure

gaurhari dass
Are you using configuration settings for zookeepr in java

On Wed, Mar 13, 2013 at 9:05 PM, gaurhari dass <[hidden email]>wrote:

> can you paste configuration code which your are using in java??
>
>
> On Wed, Mar 13, 2013 at 7:53 PM, ranInc <[hidden email]> wrote:
>
>> I am trying to connect to hbase that I installed on hadoop that I
>> installed
>> on a ubuntu machine. when using hbase shell, I can create tables and get
>> data.
>>
>> I cannot remotely connect to to hbase (using java). This is what I get on
>> the client side:13/03/12 16:12:59 WARN zookeeper.ClientCnxn: Session
>> 0x13d5eef63760003 for server null, unexpected error, closing socket
>> connection and attempting reconnect
>> java.net.ConnectException: Connection refused: no further information
>>     at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
>>     at sun.nio.ch.SocketChannelImpl.finishConnect(Unknown Source)
>>     at
>>
>> org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
>>
>> On the hbase log I see that the session is expired, thus closing the
>> connection to my client, but looking back on the log, I see this error:
>> execption in region server:
>> java.lang.IllegalArgumentException: Pathname
>> /hbase/.logs/0:0:0:0:0:0:0:1,48170,1363095825458 from
>> hdfs://147.11.88.163:8020/hbase/.logs/0:0:0:0:0:0:0:1,48170,1363095825458is
>> not a valid DFS filename.
>>
>> After this error I see that it seems like the region server (what ever it
>> is) is aborted and goes down - this might be why I cannot successfully
>> connect to the hbase remotely.
>>
>> Can someone help?
>>
>>
>>
>>
>> --
>> View this message in context:
>> http://apache-hbase.679495.n3.nabble.com/remote-hbase-connection-failure-tp4040140.html
>> Sent from the HBase User mailing list archive at Nabble.com.
>>
>
>
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Re: remote hbase connection failure

ranInc
Hi,
this is my configuration settings:

Configuration conf = HBaseConfiguration.create();
                        conf.set("hbase.master", "147.11.88.163:60000");
                        conf.set("hbase.zookeeper.quorum", "147.11.88.163");
                        conf.set("hbase.zookeeper.property.clientPort", "2181");
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Re: remote hbase connection failure

shashwat shriparv
what your jps or ps -ef |grep java says?

and please check if the zookeeper is running

netstat -nl|grep 2181
what it give?




Shashwat Shriparv



On Thu, Mar 14, 2013 at 3:41 PM, ranInc <[hidden email]> wrote:

> Hi,
> this is my configuration settings:
>
> Configuration conf = HBaseConfiguration.create();
>                         conf.set("hbase.master", "147.11.88.163:60000");
>                         conf.set("hbase.zookeeper.quorum",
> "147.11.88.163");
>                         conf.set("hbase.zookeeper.property.clientPort",
> "2181");
>
>
>
> --
> View this message in context:
> http://apache-hbase.679495.n3.nabble.com/remote-hbase-connection-failure-tp4040140p4040218.html
> Sent from the HBase User mailing list archive at Nabble.com.
>
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Re: remote hbase connection failure

shashwat shriparv
Try to give hostname with mapped ip in hosts file instead of IP

Try

# Do not remove the following line, or various programs
# that require network functionality will fail.
127.0.0.1 myserver localhost.localdomain localhost
::1 localhost6.localdomain6 localhost6

Change it to:
 # Do not remove the following line, or various programs
# that require network functionality will fail.
127.0.0.1 myserver localhost.localdomain localhost
::1 localhost6.localdomain6 localhost6
x.x.x.x myserver

Where x.x.x.x is the IPv4 address of your server and myserver is your
server name.





Shashwat Shriparv



On Thu, Mar 14, 2013 at 11:26 PM, shashwat shriparv <
[hidden email]> wrote:

> what your jps or ps -ef |grep java says?
>
> and please check if the zookeeper is running
>
> netstat -nl|grep 2181
> what it give?
>
>
>
> ∞
> Shashwat Shriparv
>
>
>
> On Thu, Mar 14, 2013 at 3:41 PM, ranInc <[hidden email]> wrote:
>
>> Hi,
>> this is my configuration settings:
>>
>> Configuration conf = HBaseConfiguration.create();
>>                         conf.set("hbase.master", "147.11.88.163:60000");
>>                         conf.set("hbase.zookeeper.quorum",
>> "147.11.88.163");
>>                         conf.set("hbase.zookeeper.property.clientPort",
>> "2181");
>>
>>
>>
>> --
>> View this message in context:
>> http://apache-hbase.679495.n3.nabble.com/remote-hbase-connection-failure-tp4040140p4040218.html
>> Sent from the HBase User mailing list archive at Nabble.com.
>>
>
>
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Re: remote hbase connection failure

Tariq
Add the IP address of the hmaster along with the hostname in the /etc/hosts
file of your client and see if it works.

Warm Regards,
Tariq
https://mtariq.jux.com/
cloudfront.blogspot.com


On Thu, Mar 14, 2013 at 11:28 PM, shashwat shriparv <
[hidden email]> wrote:

> Try to give hostname with mapped ip in hosts file instead of IP
>
> Try
>
> # Do not remove the following line, or various programs
> # that require network functionality will fail.
> 127.0.0.1 myserver localhost.localdomain localhost
> ::1 localhost6.localdomain6 localhost6
>
> Change it to:
>  # Do not remove the following line, or various programs
> # that require network functionality will fail.
> 127.0.0.1 myserver localhost.localdomain localhost
> ::1 localhost6.localdomain6 localhost6
> x.x.x.x myserver
>
> Where x.x.x.x is the IPv4 address of your server and myserver is your
> server name.
>
>
>
>
> ∞
> Shashwat Shriparv
>
>
>
> On Thu, Mar 14, 2013 at 11:26 PM, shashwat shriparv <
> [hidden email]> wrote:
>
> > what your jps or ps -ef |grep java says?
> >
> > and please check if the zookeeper is running
> >
> > netstat -nl|grep 2181
> > what it give?
> >
> >
> >
> > ∞
> > Shashwat Shriparv
> >
> >
> >
> > On Thu, Mar 14, 2013 at 3:41 PM, ranInc <[hidden email]> wrote:
> >
> >> Hi,
> >> this is my configuration settings:
> >>
> >> Configuration conf = HBaseConfiguration.create();
> >>                         conf.set("hbase.master", "147.11.88.163:60000
> ");
> >>                         conf.set("hbase.zookeeper.quorum",
> >> "147.11.88.163");
> >>                         conf.set("hbase.zookeeper.property.clientPort",
> >> "2181");
> >>
> >>
> >>
> >> --
> >> View this message in context:
> >>
> http://apache-hbase.679495.n3.nabble.com/remote-hbase-connection-failure-tp4040140p4040218.html
> >> Sent from the HBase User mailing list archive at Nabble.com.
> >>
> >
> >
>
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Re: remote hbase connection failure

ameya
In reply to this post by ranInc
I think you need to also setup zookeeper parent


Configuration conf = HBaseConfiguration.create();
                        conf.set("hbase.master", "147.11.88.163:60000");
                        conf.set("hbase.zookeeper.quorum", "147.11.88.163");
                        conf.set("hbase.zookeeper.property.clientPort",
"2181");

conf.set("zookeeper.znode.parent", "/zooParentNode");

On Thu, Mar 14, 2013 at 3:11 AM, ranInc <[hidden email]> wrote:

> Hi,
> this is my configuration settings:
>
> Configuration conf = HBaseConfiguration.create();
>                         conf.set("hbase.master", "147.11.88.163:60000");
>                         conf.set("hbase.zookeeper.quorum",
> "147.11.88.163");
>                         conf.set("hbase.zookeeper.property.clientPort",
> "2181");
>
>
>
> --
> View this message in context:
> http://apache-hbase.679495.n3.nabble.com/remote-hbase-connection-failure-tp4040140p4040218.html
> Sent from the HBase User mailing list archive at Nabble.com.
>
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Re: remote hbase connection failure

gaurhari dass
I think you dont need to specify master IP zookeeper will take care of
master be sure that you haven't setup client port in configuration file or
if you have specified client port number then only that port number should
be used.


On Fri, Mar 15, 2013 at 3:35 AM, Ameya Kantikar <[hidden email]> wrote:

> I think you need to also setup zookeeper parent
>
>
> Configuration conf = HBaseConfiguration.create();
>                         conf.set("hbase.master", "147.11.88.163:60000");
>                         conf.set("hbase.zookeeper.quorum",
> "147.11.88.163");
>                         conf.set("hbase.zookeeper.property.clientPort",
> "2181");
>
> conf.set("zookeeper.znode.parent", "/zooParentNode");
>
> On Thu, Mar 14, 2013 at 3:11 AM, ranInc <[hidden email]> wrote:
>
> > Hi,
> > this is my configuration settings:
> >
> > Configuration conf = HBaseConfiguration.create();
> >                         conf.set("hbase.master", "147.11.88.163:60000");
> >                         conf.set("hbase.zookeeper.quorum",
> > "147.11.88.163");
> >                         conf.set("hbase.zookeeper.property.clientPort",
> > "2181");
> >
> >
> >
> > --
> > View this message in context:
> >
> http://apache-hbase.679495.n3.nabble.com/remote-hbase-connection-failure-tp4040140p4040218.html
> > Sent from the HBase User mailing list archive at Nabble.com.
> >
>
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Re: remote hbase connection failure

ranInc
In reply to this post by Tariq
zookeeper is up and running and the java client connects to it, it only fails probably because of the region server - whatever it is.

all of the configuration uses ip's and not names, so I dont think changing the hosts file will do much.
keep in mind that my configuration is all on one machine. the same machine for hbase and hadoop.

also I think it has something to do with ipv6, though I did disable it - I think of this because the error that says the region server goes down has something to do with the server name that is somehow "0:0:0:0:0:0:0:1" - which looks like ipv6.

I have no idea what is going on...
Loading...