[jira] [Updated] (SPARK-16083) spark HistoryServer memory increases until gets killed by OS.

[ https://issues.apache.org/jira/browse/SPARK-16083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sudhakar Thota updated SPARK-16083: --- Attachment: (was: 27814004000_spark_heap_2016-06-17_12-05.hprof.gz) > spark HistoryServer

[jira] [Updated] (SPARK-16083) spark HistoryServer memory increases until gets killed by OS.

[ https://issues.apache.org/jira/browse/SPARK-16083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sudhakar Thota updated SPARK-16083: --- Attachment: (was: spark-spark-org.apache.spark.deploy.history.HistoryServer-1-testbic1on5

[jira] [Updated] (SPARK-16083) spark HistoryServer memory increases until gets killed by OS.

[ https://issues.apache.org/jira/browse/SPARK-16083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sudhakar Thota updated SPARK-16083: --- Attachment: (was: 27814.004.000.sparkhistoryservermemory.log.1) > spark HistoryServer mem

[jira] [Commented] (SPARK-16083) spark HistoryServer memory increases until gets killed by OS.

[ https://issues.apache.org/jira/browse/SPARK-16083?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15342214#comment-15342214 ] Sudhakar Thota commented on SPARK-16083: I can try. But, I think similar problem

[jira] [Commented] (SPARK-16083) spark HistoryServer memory increases until gets killed by OS.

[ https://issues.apache.org/jira/browse/SPARK-16083?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15341832#comment-15341832 ] Sudhakar Thota commented on SPARK-16083: 1. JVM is not allowed to use more than 1

[jira] [Updated] (SPARK-16083) spark HistoryServer memory increases until gets killed by OS.

[ https://issues.apache.org/jira/browse/SPARK-16083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sudhakar Thota updated SPARK-16083: --- Attachment: 27814004000_spark_heap_2016-06-17_12-05.hprof.gz > spark HistoryServer memory inc

[jira] [Updated] (SPARK-16083) spark HistoryServer memory increases until gets killed by OS.

[ https://issues.apache.org/jira/browse/SPARK-16083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sudhakar Thota updated SPARK-16083: --- Attachment: spark-spark-org.apache.spark.deploy.history.HistoryServer-1-testbic1on5l.out.4 >

[jira] [Updated] (SPARK-16083) spark HistoryServer memory increases until gets killed by OS.

[ https://issues.apache.org/jira/browse/SPARK-16083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sudhakar Thota updated SPARK-16083: --- Attachment: 27814.004.000.sparkhistoryservermemory.log.1 > spark HistoryServer memory increas

[jira] [Created] (SPARK-16083) spark HistoryServer memory increases until gets killed by OS.

Sudhakar Thota created SPARK-16083: -- Summary: spark HistoryServer memory increases until gets killed by OS. Key: SPARK-16083 URL: https://issues.apache.org/jira/browse/SPARK-16083 Project: Spark

[jira] [Updated] (SPARK-14442) Error: Cannot load main class from JAR file:/usr/iop/current/spark-client/lib/datanucleus-core-3.2.10.jar

[ https://issues.apache.org/jira/browse/SPARK-14442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sudhakar Thota updated SPARK-14442: --- Attachment: simple-project_2.10-1.0.jar Jar file I am using. > Error: Cannot load main clas

[jira] [Commented] (SPARK-14442) Error: Cannot load main class from JAR file:/usr/iop/current/spark-client/lib/datanucleus-core-3.2.10.jar

[ https://issues.apache.org/jira/browse/SPARK-14442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15229139#comment-15229139 ] Sudhakar Thota commented on SPARK-14442: The similar I found with this JIRA too.

[jira] [Commented] (SPARK-14442) Error: Cannot load main class from JAR file:/usr/iop/current/spark-client/lib/datanucleus-core-3.2.10.jar

[ https://issues.apache.org/jira/browse/SPARK-14442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15229161#comment-15229161 ] Sudhakar Thota commented on SPARK-14442: These are the details: 1. Error I am fa

[jira] [Created] (SPARK-14442) Error: Cannot load main class from JAR file:/usr/iop/current/spark-client/lib/datanucleus-core-3.2.10.jar

Sudhakar Thota created SPARK-14442: -- Summary: Error: Cannot load main class from JAR file:/usr/iop/current/spark-client/lib/datanucleus-core-3.2.10.jar Key: SPARK-14442 URL: https://issues.apache.org/jira/browse/

[jira] [Commented] (SPARK-7012) Add support for NOT NULL modifier for column definitions on DDLParser

[ https://issues.apache.org/jira/browse/SPARK-7012?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14741558#comment-14741558 ] Sudhakar Thota commented on SPARK-7012: --- Sameer, I am not working on this. Please pr

[jira] [Commented] (SPARK-9776) Another instance of Derby may have already booted the database

[ https://issues.apache.org/jira/browse/SPARK-9776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14700526#comment-14700526 ] Sudhakar Thota commented on SPARK-9776: --- Thanks Michael and Eugene for your quick re

[jira] [Commented] (SPARK-9776) Another instance of Derby may have already booted the database

[ https://issues.apache.org/jira/browse/SPARK-9776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14700377#comment-14700377 ] Sudhakar Thota commented on SPARK-9776: --- Thanks Michael and Eugene. I have no probl

[jira] [Commented] (SPARK-9776) Another instance of Derby may have already booted the database

[ https://issues.apache.org/jira/browse/SPARK-9776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14700284#comment-14700284 ] Sudhakar Thota commented on SPARK-9776: --- Michael, I am confused. These are the steps

[jira] [Commented] (SPARK-9776) Another instance of Derby may have already booted the database

[ https://issues.apache.org/jira/browse/SPARK-9776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14700137#comment-14700137 ] Sudhakar Thota commented on SPARK-9776: --- Michael, I am not creating another HiveCont

[jira] [Commented] (SPARK-9776) Another instance of Derby may have already booted the database

[ https://issues.apache.org/jira/browse/SPARK-9776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14698022#comment-14698022 ] Sudhakar Thota commented on SPARK-9776: --- my apologies it is SPARK-8064 > Another in

[jira] [Commented] (SPARK-9776) Another instance of Derby may have already booted the database

[ https://issues.apache.org/jira/browse/SPARK-9776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14698021#comment-14698021 ] Sudhakar Thota commented on SPARK-9776: --- Thanks for correcting Sean. I did the gle

[jira] [Updated] (SPARK-9776) Another instance of Derby may have already booted the database

[ https://issues.apache.org/jira/browse/SPARK-9776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sudhakar Thota updated SPARK-9776: -- Priority: Blocker (was: Major) > Another instance of Derby may have already booted the database

[jira] [Commented] (SPARK-9600) DataFrameWriter.saveAsTable always writes data to "/user/hive/warehouse"

[ https://issues.apache.org/jira/browse/SPARK-9600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14682389#comment-14682389 ] Sudhakar Thota commented on SPARK-9600: --- Hi, I am blocked by derby database already

[jira] [Commented] (SPARK-9776) Another instance of Derby may have already booted the database

[ https://issues.apache.org/jira/browse/SPARK-9776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14680977#comment-14680977 ] Sudhakar Thota commented on SPARK-9776: --- Sean, I have requested my colleague Mike t

[jira] [Commented] (SPARK-9776) Another instance of Derby may have already booted the database

[ https://issues.apache.org/jira/browse/SPARK-9776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14679390#comment-14679390 ] Sudhakar Thota commented on SPARK-9776: --- Hi, No, I am not trying to open multiple h

[jira] [Updated] (SPARK-9776) Another instance of Derby may have already booted the database

[ https://issues.apache.org/jira/browse/SPARK-9776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sudhakar Thota updated SPARK-9776: -- Attachment: SPARK-9776-FL1.rtf Screen content > Another instance of Derby may have already boot

[jira] [Created] (SPARK-9776) Another instance of Derby may have already booted the database

Sudhakar Thota created SPARK-9776: - Summary: Another instance of Derby may have already booted the database Key: SPARK-9776 URL: https://issues.apache.org/jira/browse/SPARK-9776 Project: Spark

[jira] [Commented] (SPARK-9600) DataFrameWriter.saveAsTable always writes data to "/user/hive/warehouse"

[ https://issues.apache.org/jira/browse/SPARK-9600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14679251#comment-14679251 ] Sudhakar Thota commented on SPARK-9600: --- Cheng Lian, Your statements above have giv

[jira] [Commented] (SPARK-9600) DataFrameWriter.saveAsTable always writes data to "/user/hive/warehouse"

[ https://issues.apache.org/jira/browse/SPARK-9600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14662558#comment-14662558 ] Sudhakar Thota commented on SPARK-9600: --- [~marmbrus] Michael, I have tested using l

[jira] [Updated] (SPARK-9600) DataFrameWriter.saveAsTable always writes data to "/user/hive/warehouse"

[ https://issues.apache.org/jira/browse/SPARK-9600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sudhakar Thota updated SPARK-9600: -- Attachment: SPARK-9600-fl1.txt my screen content > DataFrameWriter.saveAsTable always writes da

[jira] [Commented] (SPARK-9600) DataFrameWriter.saveAsTable always writes data to "/user/hive/warehouse"

[ https://issues.apache.org/jira/browse/SPARK-9600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14662125#comment-14662125 ] Sudhakar Thota commented on SPARK-9600: --- Hi, I tested this on 1.4.1 and 1.5.0 both s

[jira] [Commented] (SPARK-9600) DataFrameWriter.saveAsTable always writes data to "/user/hive/warehouse"

[ https://issues.apache.org/jira/browse/SPARK-9600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14659476#comment-14659476 ] Sudhakar Thota commented on SPARK-9600: --- I will work on this. Thanks Sudhakar Thota

[jira] [Comment Edited] (SPARK-8333) Spark failed to delete temp directory created by HiveContext

[ https://issues.apache.org/jira/browse/SPARK-8333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14650555#comment-14650555 ] Sudhakar Thota edited comment on SPARK-8333 at 8/5/15 9:14 PM: -

[jira] [Comment Edited] (SPARK-8333) Spark failed to delete temp directory created by HiveContext

[ https://issues.apache.org/jira/browse/SPARK-8333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14652531#comment-14652531 ] Sudhakar Thota edited comment on SPARK-8333 at 8/5/15 9:12 PM: -

[jira] [Updated] (SPARK-8333) Spark failed to delete temp directory created by HiveContext

[ https://issues.apache.org/jira/browse/SPARK-8333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sudhakar Thota updated SPARK-8333: -- Attachment: test.tar Here is the packaged standalone application testing this issue. Thanks Sud

[jira] [Commented] (SPARK-4678) A SQL query with subquery fails with TreeNodeException

[ https://issues.apache.org/jira/browse/SPARK-4678?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14658821#comment-14658821 ] Sudhakar Thota commented on SPARK-4678: --- Please let me know if that works for you.

[jira] [Commented] (SPARK-8333) Spark failed to delete temp directory created by HiveContext

[ https://issues.apache.org/jira/browse/SPARK-8333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14658776#comment-14658776 ] Sudhakar Thota commented on SPARK-8333: --- The above statements and scripts were run o

[jira] [Commented] (SPARK-8333) Spark failed to delete temp directory created by HiveContext

[ https://issues.apache.org/jira/browse/SPARK-8333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14652531#comment-14652531 ] Sudhakar Thota commented on SPARK-8333: --- Hi Sheng, I have verified in spark applica

[jira] [Commented] (SPARK-8333) Spark failed to delete temp directory created by HiveContext

[ https://issues.apache.org/jira/browse/SPARK-8333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14650555#comment-14650555 ] Sudhakar Thota commented on SPARK-8333: --- Thanks for the clarification. I have used t

[jira] [Commented] (SPARK-8333) Spark failed to delete temp directory created by HiveContext

[ https://issues.apache.org/jira/browse/SPARK-8333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14649150#comment-14649150 ] Sudhakar Thota commented on SPARK-8333: --- I verified this using val sqlContext = new

[jira] [Commented] (SPARK-8921) Add @since tags to mllib.stat

[ https://issues.apache.org/jira/browse/SPARK-8921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14640979#comment-14640979 ] Sudhakar Thota commented on SPARK-8921: --- I will work on this. > Add @since tags to

[jira] [Commented] (SPARK-8359) Spark SQL Decimal type precision loss on multiplication

[ https://issues.apache.org/jira/browse/SPARK-8359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14639472#comment-14639472 ] Sudhakar Thota commented on SPARK-8359: --- This is not working and breaking at 2^112 w

[jira] [Commented] (SPARK-8911) Local mode endless heartbeat warnings

[ https://issues.apache.org/jira/browse/SPARK-8911?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14622957#comment-14622957 ] Sudhakar Thota commented on SPARK-8911: --- I had the same issue and used this. For the

[jira] [Commented] (SPARK-8925) Add @since tags to mllib.util

[ https://issues.apache.org/jira/browse/SPARK-8925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14619864#comment-14619864 ] Sudhakar Thota commented on SPARK-8925: --- Being starter I would like to work on this

[jira] [Commented] (SPARK-4678) A SQL query with subquery fails with TreeNodeException

[ https://issues.apache.org/jira/browse/SPARK-4678?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14603884#comment-14603884 ] Sudhakar Thota commented on SPARK-4678: --- Hi Tsuyoshi, There was a SQL framing issu

[jira] [Updated] (SPARK-4678) A SQL query with subquery fails with TreeNodeException

[ https://issues.apache.org/jira/browse/SPARK-4678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sudhakar Thota updated SPARK-4678: -- Attachment: spark-4678-1.rtf > A SQL query with subquery fails with TreeNodeException >

[jira] [Commented] (SPARK-4678) A SQL query with subquery fails with TreeNodeException

[ https://issues.apache.org/jira/browse/SPARK-4678?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14603861#comment-14603861 ] Sudhakar Thota commented on SPARK-4678: --- I would like to work on this. > A SQL quer

[jira] [Updated] (SPARK-4988) "Create table ..as select ..from..order by .. limit 10" report error when one col is a Decimal

[ https://issues.apache.org/jira/browse/SPARK-4988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sudhakar Thota updated SPARK-4988: -- Attachment: spark-4988-1.txt SQL statements and data > "Create table ..as select ..from..order

[jira] [Commented] (SPARK-4988) "Create table ..as select ..from..order by .. limit 10" report error when one col is a Decimal

[ https://issues.apache.org/jira/browse/SPARK-4988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14603766#comment-14603766 ] Sudhakar Thota commented on SPARK-4988: --- Both the spark-sql statements are working.

[jira] [Commented] (SPARK-8648) Documented command not working

[ https://issues.apache.org/jira/browse/SPARK-8648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14602225#comment-14602225 ] Sudhakar Thota commented on SPARK-8648: --- I will work on this. > Documented command

[jira] [Updated] (SPARK-8648) Documented command not working

[ https://issues.apache.org/jira/browse/SPARK-8648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sudhakar Thota updated SPARK-8648: -- Attachment: SPARK-8648-1.rtf Documentation > Documented command not working >

[jira] [Created] (SPARK-8648) Documented command not working

Sudhakar Thota created SPARK-8648: - Summary: Documented command not working Key: SPARK-8648 URL: https://issues.apache.org/jira/browse/SPARK-8648 Project: Spark Issue Type: Documentation

[jira] [Commented] (SPARK-7012) Add support for NOT NULL modifier for column definitions on DDLParser

[ https://issues.apache.org/jira/browse/SPARK-7012?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14601740#comment-14601740 ] Sudhakar Thota commented on SPARK-7012: --- I would like to explore for a solution on t