[GitHub] spark issue #17342: [SPARK-12868][SQL] Allow adding jars from hdfs

2018-08-21 Thread rajeshcode 
Github user rajeshcode commented on the issue:

https://github.com/apache/spark/pull/17342
  
Sorry about above stack. The actual error is  as below. Thats why  relates 
to SPARK-21697 
Removing commons-logging jar fixes it. copying back  common-logging jar 
never complains  again that doesn't  make sense..

18/08/20 11:47:29 ERROR SparkSQLDriver: Failed in [select check('abc')]
java.lang.ExceptionInInitializerError
at 
org.apache.hadoop.hdfs.DFSInputStream.blockSeekTo(DFSInputStream.java:656)
at 
org.apache.hadoop.hdfs.DFSInputStream.readWithStrategy(DFSInputStream.java:882)
at 
org.apache.hadoop.hdfs.DFSInputStream.read(DFSInputStream.java:934)

..
at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
Caused by: java.lang.NullPointerException
at 
org.apache.hadoop.hdfs.BlockReaderFactory.getRemoteBlockReaderFromTcp(BlockReaderFactory.java:685)
at 
org.apache.hadoop.hdfs.BlockReaderFactory.build(BlockReaderFactory.java:355)


---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark issue #17342: [SPARK-12868][SQL] Allow adding jars from hdfs

2018-08-20 Thread rajeshcode 
Github user rajeshcode commented on the issue:

https://github.com/apache/spark/pull/17342
  
Will check , But looks like its related to SPARK-21697


---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark issue #18146: [SPARK-20924] [SQL] Unable to call the function register...

2018-08-20 Thread rajeshcode 
Github user rajeshcode commented on the issue:

https://github.com/apache/spark/pull/18146
  
@gatorsmile 
We can't backport this into spark2.1.0  ...


---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark issue #17342: [SPARK-12868][SQL] Allow adding jars from hdfs

2018-08-19 Thread rajeshcode 
Github user rajeshcode commented on the issue:

https://github.com/apache/spark/pull/17342
  
Patching this to spark-2.1.0 , had several issues ..
java.lang.NoClassDefFoundError: Could not initialize class 
org.apache.hadoop.hdfs.BlockReaderFactory
at 
org.apache.hadoop.hdfs.DFSInputStream.blockSeekTo(DFSInputStream.java:618)
at 
org.apache.hadoop.hdfs.DFSInputStream.readWithStrategy(DFSInputStream.java:844)
at 
org.apache.hadoop.hdfs.DFSInputStream.read(DFSInputStream.java:896)
at java.io.DataInputStream.read(DataInputStream.java:100)
at org.apache.hadoop.io.IOUtils.copyBytes(IOUtils.java:85)
at org.apache.hadoop.io.IOUtils.copyBytes(IOUtils.java:59)
at org.apache.hadoop.io.IOUtils.copyBytes(IOUtils.java:119)
at org.apache.hadoop.fs.FileUtil.copy(FileUtil.java:366)
at org.apache.hadoop.fs.FileUtil.copy(FileUtil.java:338)
at org.apache.hadoop.fs.FileUtil.copy(FileUtil.java:289)
at 
org.apache.hadoop.fs.FileSystem.copyToLocalFile(FileSystem.java:2030)
at 
org.apache.hadoop.fs.FileSystem.copyToLocalFile(FileSystem.java:1999)
at 
org.apache.hadoop.fs.FileSystem.copyToLocalFile(FileSystem.java:1975)
at 
org.apache.hadoop.hive.ql.session.SessionState.downloadResource(SessionState.java:1274)
at 
org.apache.hadoop.hive.ql.session.SessionState.resolveAndDownload(SessionState.java:1242)
at 
org.apache.hadoop.hive.ql.session.SessionState.add_resources(SessionState.java:1163)
at 
org.apache.hadoop.hive.ql.session.SessionState.add_resources(SessionState.java:1149)
at 
org.apache.hadoop.hive.ql.processors.AddResourceProcessor.run(AddResourceProcessor.java:67)
at 
org.apache.spark.sql.hive.client.HiveClientImpl$$anonfun$runHive$1.apply(HiveClientImpl.scala:633)
at 
org.apache.spark.sql.hive.client.HiveClientImpl$$anonfun$runHive$1.apply(HiveClientImpl.scala:602)
at 
org.apache.spark.sql.hive.client.HiveClientImpl$$anonfun$withHiveState$1.apply(HiveClientImpl.scala:287...

at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
java.lang.NoClassDefFoundError: Could not initialize class 
org.apache.hadoop.hdfs.BlockReaderFactory
at 
org.apache.hadoop.hdfs.DFSInputStream.blockSeekTo(DFSInputStream.java:618)
at 
org.apache.hadoop.hdfs.DFSInputStream.readWithStrategy(DFSInputStream.java:844)
at 
org.apache.hadoop.hdfs.DFSInputStream.read(DFSInputStream.java:896)
at java.io.DataInputStream.read(DataInputStream.java:100)
at org.apache.hadoop.io.IOUtils.copyBytes(IOUtils.java:85)
at org.apache.hadoop.io.IOUtils.copyBytes(IOUtils.java:59)
at org.apache.hadoop.io.IOUtils.copyBytes(IOUtils.java:119)
at org.apache.hadoop.fs.FileUtil.copy(FileUtil.java:366)


---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark issue #17335: [SPARK-19995][YARN] Register tokens to current UGI to av...

2018-05-14 Thread rajeshcode 
Github user rajeshcode commented on the issue:

https://github.com/apache/spark/pull/17335
  
Is this patch will work for spark-sql --master local mode as well.
 
In our environment  localmode is not supporting proxy user where as yarn 
mode looks ok. Do we have a solution for proxy user support on localmode


---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org