Re: ipv6? org.apache.pig.backend.executionengine.ExecException: ERROR 2118: For input string: 4f8:0:a0a1::add:1010

2015-03-19 Thread Serega Sheypak
Hm... So client or sever running openjdk?

четверг, 19 марта 2015 г. пользователь Alok Singh написал:

 Looks like ipv6 address is not being parsed correctly. Maybe related
 to : https://bugs.openjdk.java.net/browse/JDK-6991580

 Alok

 On Wed, Mar 18, 2015 at 3:13 PM, Serega Sheypak
 serega.shey...@gmail.com javascript:; wrote:
  Hi, I'm trying to use HBaseStorage to read data from HBase
  1. I do persist smth to hbase each day using hbase-client java api
  2. using HBaseStorage vis oozie
  Now I failed to read persisted data using pig script via HUE or plain
 pig.
  I don't have any problem reading data using java client api.
  What do I do wrong?
 
  Caused by: java.lang.NumberFormatException: For input string:
  4f8:0:a0a1::add:1010
  at
 
 java.lang.NumberFormatException.forInputString(NumberFormatException.java:65)
  at java.lang.Integer.parseInt(Integer.java:492)
  at java.lang.Integer.parseInt(Integer.java:527)
  at com.sun.jndi.dns.DnsClient.init(DnsClient.java:125)
  at com.sun.jndi.dns.Resolver.init(Resolver.java:61)
  at com.sun.jndi.dns.DnsContext.getResolver(DnsContext.java:570)
  at com.sun.jndi.dns.DnsContext.c_getAttributes(DnsContext.java:430)
  at
 
 com.sun.jndi.toolkit.ctx.ComponentDirContext.p_getAttributes(ComponentDirContext.java:231)
  at
 
 com.sun.jndi.toolkit.ctx.PartialCompositeDirContext.getAttributes(PartialCompositeDirContext.java:139)
  at
 
 com.sun.jndi.toolkit.url.GenericURLDirContext.getAttributes(GenericURLDirContext.java:103)
  at
 
 javax.naming.directory.InitialDirContext.getAttributes(InitialDirContext.java:142)
  at org.apache.hadoop.net.DNS.reverseDns(DNS.java:84)
  at
 
 org.apache.hadoop.hbase.mapreduce.TableInputFormatBase.reverseDNS(TableInputFormatBase.java:228)
  at
 
 org.apache.hadoop.hbase.mapreduce.TableInputFormatBase.getSplits(TableInputFormatBase.java:191)
  at
 
 org.apache.pig.backend.hadoop.hbase.HBaseTableInputFormat.getSplits(HBaseTableInputFormat.java:87)
  at
 
 org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigInputFormat.getSplits(PigInputFormat.java:274)
  ... 18 more



Re: ipv6? org.apache.pig.backend.executionengine.ExecException: ERROR 2118: For input string: 4f8:0:a0a1::add:1010

2015-03-19 Thread Serega Sheypak
I can give 100% we are not using openjdk or ipv6
I see that people felt the same pain before:
http://mail-archives.apache.org/mod_mbox/hbase-user/201305.mbox/%3ca7f70ff1-b24f-403c-b3e8-7ae18e72d...@gmail.com%3E

Does anybody knows how to overcome such problem?

2015-03-19 9:59 GMT+03:00 Serega Sheypak serega.shey...@gmail.com:

 Hm... So client or sever running openjdk?

 четверг, 19 марта 2015 г. пользователь Alok Singh написал:

 Looks like ipv6 address is not being parsed correctly. Maybe related
 to : https://bugs.openjdk.java.net/browse/JDK-6991580

 Alok

 On Wed, Mar 18, 2015 at 3:13 PM, Serega Sheypak
 serega.shey...@gmail.com wrote:
  Hi, I'm trying to use HBaseStorage to read data from HBase
  1. I do persist smth to hbase each day using hbase-client java api
  2. using HBaseStorage vis oozie
  Now I failed to read persisted data using pig script via HUE or plain
 pig.
  I don't have any problem reading data using java client api.
  What do I do wrong?
 
  Caused by: java.lang.NumberFormatException: For input string:
  4f8:0:a0a1::add:1010
  at
 
 java.lang.NumberFormatException.forInputString(NumberFormatException.java:65)
  at java.lang.Integer.parseInt(Integer.java:492)
  at java.lang.Integer.parseInt(Integer.java:527)
  at com.sun.jndi.dns.DnsClient.init(DnsClient.java:125)
  at com.sun.jndi.dns.Resolver.init(Resolver.java:61)
  at com.sun.jndi.dns.DnsContext.getResolver(DnsContext.java:570)
  at com.sun.jndi.dns.DnsContext.c_getAttributes(DnsContext.java:430)
  at
 
 com.sun.jndi.toolkit.ctx.ComponentDirContext.p_getAttributes(ComponentDirContext.java:231)
  at
 
 com.sun.jndi.toolkit.ctx.PartialCompositeDirContext.getAttributes(PartialCompositeDirContext.java:139)
  at
 
 com.sun.jndi.toolkit.url.GenericURLDirContext.getAttributes(GenericURLDirContext.java:103)
  at
 
 javax.naming.directory.InitialDirContext.getAttributes(InitialDirContext.java:142)
  at org.apache.hadoop.net.DNS.reverseDns(DNS.java:84)
  at
 
 org.apache.hadoop.hbase.mapreduce.TableInputFormatBase.reverseDNS(TableInputFormatBase.java:228)
  at
 
 org.apache.hadoop.hbase.mapreduce.TableInputFormatBase.getSplits(TableInputFormatBase.java:191)
  at
 
 org.apache.pig.backend.hadoop.hbase.HBaseTableInputFormat.getSplits(HBaseTableInputFormat.java:87)
  at
 
 org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigInputFormat.getSplits(PigInputFormat.java:274)
  ... 18 more




Re: ipv6? org.apache.pig.backend.executionengine.ExecException: ERROR 2118: For input string: 4f8:0:a0a1::add:1010

2015-03-19 Thread Esteban Gutierrez
Hi Serega,

Sounds like one of your DNS servers has an IPv6 address. If you look
into JDK-6991580 it comes with a very simple test and the problem is very
easy to reproduce with jdk8 or jdk7

cheers,
esteban.


--
Cloudera, Inc.


On Thu, Mar 19, 2015 at 4:56 AM, Serega Sheypak serega.shey...@gmail.com
wrote:

 I can give 100% we are not using openjdk or ipv6
 I see that people felt the same pain before:

 http://mail-archives.apache.org/mod_mbox/hbase-user/201305.mbox/%3ca7f70ff1-b24f-403c-b3e8-7ae18e72d...@gmail.com%3E

 Does anybody knows how to overcome such problem?

 2015-03-19 9:59 GMT+03:00 Serega Sheypak serega.shey...@gmail.com:

  Hm... So client or sever running openjdk?
 
  четверг, 19 марта 2015 г. пользователь Alok Singh написал:
 
  Looks like ipv6 address is not being parsed correctly. Maybe related
  to : https://bugs.openjdk.java.net/browse/JDK-6991580
 
  Alok
 
  On Wed, Mar 18, 2015 at 3:13 PM, Serega Sheypak
  serega.shey...@gmail.com wrote:
   Hi, I'm trying to use HBaseStorage to read data from HBase
   1. I do persist smth to hbase each day using hbase-client java api
   2. using HBaseStorage vis oozie
   Now I failed to read persisted data using pig script via HUE or plain
  pig.
   I don't have any problem reading data using java client api.
   What do I do wrong?
  
   Caused by: java.lang.NumberFormatException: For input string:
   4f8:0:a0a1::add:1010
   at
  
 
 java.lang.NumberFormatException.forInputString(NumberFormatException.java:65)
   at java.lang.Integer.parseInt(Integer.java:492)
   at java.lang.Integer.parseInt(Integer.java:527)
   at com.sun.jndi.dns.DnsClient.init(DnsClient.java:125)
   at com.sun.jndi.dns.Resolver.init(Resolver.java:61)
   at com.sun.jndi.dns.DnsContext.getResolver(DnsContext.java:570)
   at com.sun.jndi.dns.DnsContext.c_getAttributes(DnsContext.java:430)
   at
  
 
 com.sun.jndi.toolkit.ctx.ComponentDirContext.p_getAttributes(ComponentDirContext.java:231)
   at
  
 
 com.sun.jndi.toolkit.ctx.PartialCompositeDirContext.getAttributes(PartialCompositeDirContext.java:139)
   at
  
 
 com.sun.jndi.toolkit.url.GenericURLDirContext.getAttributes(GenericURLDirContext.java:103)
   at
  
 
 javax.naming.directory.InitialDirContext.getAttributes(InitialDirContext.java:142)
   at org.apache.hadoop.net.DNS.reverseDns(DNS.java:84)
   at
  
 
 org.apache.hadoop.hbase.mapreduce.TableInputFormatBase.reverseDNS(TableInputFormatBase.java:228)
   at
  
 
 org.apache.hadoop.hbase.mapreduce.TableInputFormatBase.getSplits(TableInputFormatBase.java:191)
   at
  
 
 org.apache.pig.backend.hadoop.hbase.HBaseTableInputFormat.getSplits(HBaseTableInputFormat.java:87)
   at
  
 
 org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigInputFormat.getSplits(PigInputFormat.java:274)
   ... 18 more
 
 



Re: ipv6? org.apache.pig.backend.executionengine.ExecException: ERROR 2118: For input string: 4f8:0:a0a1::add:1010

2015-03-19 Thread Serega Sheypak
Hi, there was dns ipv6 on datacenter side. We just delete ALL packages
having ipv6 in their name.
it helped.


2015-03-19 22:31 GMT+03:00 Esteban Gutierrez este...@cloudera.com:

 Hi Serega,

 Sounds like one of your DNS servers has an IPv6 address. If you look
 into JDK-6991580 it comes with a very simple test and the problem is very
 easy to reproduce with jdk8 or jdk7

 cheers,
 esteban.


 --
 Cloudera, Inc.


 On Thu, Mar 19, 2015 at 4:56 AM, Serega Sheypak serega.shey...@gmail.com
 wrote:

  I can give 100% we are not using openjdk or ipv6
  I see that people felt the same pain before:
 
 
 http://mail-archives.apache.org/mod_mbox/hbase-user/201305.mbox/%3ca7f70ff1-b24f-403c-b3e8-7ae18e72d...@gmail.com%3E
 
  Does anybody knows how to overcome such problem?
 
  2015-03-19 9:59 GMT+03:00 Serega Sheypak serega.shey...@gmail.com:
 
   Hm... So client or sever running openjdk?
  
   четверг, 19 марта 2015 г. пользователь Alok Singh написал:
  
   Looks like ipv6 address is not being parsed correctly. Maybe related
   to : https://bugs.openjdk.java.net/browse/JDK-6991580
  
   Alok
  
   On Wed, Mar 18, 2015 at 3:13 PM, Serega Sheypak
   serega.shey...@gmail.com wrote:
Hi, I'm trying to use HBaseStorage to read data from HBase
1. I do persist smth to hbase each day using hbase-client java api
2. using HBaseStorage vis oozie
Now I failed to read persisted data using pig script via HUE or
 plain
   pig.
I don't have any problem reading data using java client api.
What do I do wrong?
   
Caused by: java.lang.NumberFormatException: For input string:
4f8:0:a0a1::add:1010
at
   
  
 
 java.lang.NumberFormatException.forInputString(NumberFormatException.java:65)
at java.lang.Integer.parseInt(Integer.java:492)
at java.lang.Integer.parseInt(Integer.java:527)
at com.sun.jndi.dns.DnsClient.init(DnsClient.java:125)
at com.sun.jndi.dns.Resolver.init(Resolver.java:61)
at com.sun.jndi.dns.DnsContext.getResolver(DnsContext.java:570)
at com.sun.jndi.dns.DnsContext.c_getAttributes(DnsContext.java:430)
at
   
  
 
 com.sun.jndi.toolkit.ctx.ComponentDirContext.p_getAttributes(ComponentDirContext.java:231)
at
   
  
 
 com.sun.jndi.toolkit.ctx.PartialCompositeDirContext.getAttributes(PartialCompositeDirContext.java:139)
at
   
  
 
 com.sun.jndi.toolkit.url.GenericURLDirContext.getAttributes(GenericURLDirContext.java:103)
at
   
  
 
 javax.naming.directory.InitialDirContext.getAttributes(InitialDirContext.java:142)
at org.apache.hadoop.net.DNS.reverseDns(DNS.java:84)
at
   
  
 
 org.apache.hadoop.hbase.mapreduce.TableInputFormatBase.reverseDNS(TableInputFormatBase.java:228)
at
   
  
 
 org.apache.hadoop.hbase.mapreduce.TableInputFormatBase.getSplits(TableInputFormatBase.java:191)
at
   
  
 
 org.apache.pig.backend.hadoop.hbase.HBaseTableInputFormat.getSplits(HBaseTableInputFormat.java:87)
at
   
  
 
 org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigInputFormat.getSplits(PigInputFormat.java:274)
... 18 more
  
  
 



Re: ipv6? org.apache.pig.backend.executionengine.ExecException: ERROR 2118: For input string: 4f8:0:a0a1::add:1010

2015-03-18 Thread Alok Singh
Looks like ipv6 address is not being parsed correctly. Maybe related
to : https://bugs.openjdk.java.net/browse/JDK-6991580

Alok

On Wed, Mar 18, 2015 at 3:13 PM, Serega Sheypak
serega.shey...@gmail.com wrote:
 Hi, I'm trying to use HBaseStorage to read data from HBase
 1. I do persist smth to hbase each day using hbase-client java api
 2. using HBaseStorage vis oozie
 Now I failed to read persisted data using pig script via HUE or plain pig.
 I don't have any problem reading data using java client api.
 What do I do wrong?

 Caused by: java.lang.NumberFormatException: For input string:
 4f8:0:a0a1::add:1010
 at
 java.lang.NumberFormatException.forInputString(NumberFormatException.java:65)
 at java.lang.Integer.parseInt(Integer.java:492)
 at java.lang.Integer.parseInt(Integer.java:527)
 at com.sun.jndi.dns.DnsClient.init(DnsClient.java:125)
 at com.sun.jndi.dns.Resolver.init(Resolver.java:61)
 at com.sun.jndi.dns.DnsContext.getResolver(DnsContext.java:570)
 at com.sun.jndi.dns.DnsContext.c_getAttributes(DnsContext.java:430)
 at
 com.sun.jndi.toolkit.ctx.ComponentDirContext.p_getAttributes(ComponentDirContext.java:231)
 at
 com.sun.jndi.toolkit.ctx.PartialCompositeDirContext.getAttributes(PartialCompositeDirContext.java:139)
 at
 com.sun.jndi.toolkit.url.GenericURLDirContext.getAttributes(GenericURLDirContext.java:103)
 at
 javax.naming.directory.InitialDirContext.getAttributes(InitialDirContext.java:142)
 at org.apache.hadoop.net.DNS.reverseDns(DNS.java:84)
 at
 org.apache.hadoop.hbase.mapreduce.TableInputFormatBase.reverseDNS(TableInputFormatBase.java:228)
 at
 org.apache.hadoop.hbase.mapreduce.TableInputFormatBase.getSplits(TableInputFormatBase.java:191)
 at
 org.apache.pig.backend.hadoop.hbase.HBaseTableInputFormat.getSplits(HBaseTableInputFormat.java:87)
 at
 org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigInputFormat.getSplits(PigInputFormat.java:274)
 ... 18 more


ipv6? org.apache.pig.backend.executionengine.ExecException: ERROR 2118: For input string: 4f8:0:a0a1::add:1010

2015-03-18 Thread Serega Sheypak
Hi, I'm trying to use HBaseStorage to read data from HBase
1. I do persist smth to hbase each day using hbase-client java api
2. using HBaseStorage vis oozie
Now I failed to read persisted data using pig script via HUE or plain pig.
I don't have any problem reading data using java client api.
What do I do wrong?

Caused by: java.lang.NumberFormatException: For input string:
4f8:0:a0a1::add:1010
at
java.lang.NumberFormatException.forInputString(NumberFormatException.java:65)
at java.lang.Integer.parseInt(Integer.java:492)
at java.lang.Integer.parseInt(Integer.java:527)
at com.sun.jndi.dns.DnsClient.init(DnsClient.java:125)
at com.sun.jndi.dns.Resolver.init(Resolver.java:61)
at com.sun.jndi.dns.DnsContext.getResolver(DnsContext.java:570)
at com.sun.jndi.dns.DnsContext.c_getAttributes(DnsContext.java:430)
at
com.sun.jndi.toolkit.ctx.ComponentDirContext.p_getAttributes(ComponentDirContext.java:231)
at
com.sun.jndi.toolkit.ctx.PartialCompositeDirContext.getAttributes(PartialCompositeDirContext.java:139)
at
com.sun.jndi.toolkit.url.GenericURLDirContext.getAttributes(GenericURLDirContext.java:103)
at
javax.naming.directory.InitialDirContext.getAttributes(InitialDirContext.java:142)
at org.apache.hadoop.net.DNS.reverseDns(DNS.java:84)
at
org.apache.hadoop.hbase.mapreduce.TableInputFormatBase.reverseDNS(TableInputFormatBase.java:228)
at
org.apache.hadoop.hbase.mapreduce.TableInputFormatBase.getSplits(TableInputFormatBase.java:191)
at
org.apache.pig.backend.hadoop.hbase.HBaseTableInputFormat.getSplits(HBaseTableInputFormat.java:87)
at
org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigInputFormat.getSplits(PigInputFormat.java:274)
... 18 more