[jira] [Updated] (SPARK-16249) Change visibility of Object ml.clustering.LDA to public for loading

2016-07-14 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-16249: Fix Version/s: (was: 2.0.1) (was: 2.1.0) 2.0.0 > Chan

[jira] [Updated] (SPARK-16278) Implement map_keys SQL function

2016-07-14 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-16278: Fix Version/s: (was: 2.0.1) (was: 2.1.0) 2.0.0 > Impl

[jira] [Updated] (SPARK-16538) Cannot use "SparkR::sql"

2016-07-14 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-16538: Fix Version/s: (was: 2.0.1) (was: 2.1.0) 2.0.0 > Cann

[jira] [Updated] (SPARK-15740) Word2VecSuite "big model load / save" caused OOM in maven jenkins builds

2016-07-14 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-15740: Fix Version/s: (was: 2.0.1) (was: 2.1.0) 2.0.0 > Word

[jira] [Updated] (SPARK-16401) Data Source APIs: Extending RelationProvider and CreatableRelationProvider Without SchemaRelationProvider

2016-07-14 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16401?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-16401: Fix Version/s: (was: 2.0.1) (was: 2.1.0) 2.0.0 > Data

[jira] [Updated] (SPARK-16509) Rename window.partitionBy and window.orderBy

2016-07-14 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-16509: Fix Version/s: (was: 2.0.1) (was: 2.1.0) 2.0.0 > Rena

[jira] [Updated] (SPARK-16425) SparkR summary() fails on column of type logical

2016-07-14 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-16425: Fix Version/s: (was: 2.0.1) (was: 2.1.0) 2.0.0 > Spar

[jira] [Updated] (SPARK-16438) Add Asynchronous Actions documentation

2016-07-14 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-16438: Fix Version/s: (was: 2.0.1) 2.0.0 > Add Asynchronous Actions documentation >

[jira] [Updated] (SPARK-16439) Incorrect information in SQL Query details

2016-07-14 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-16439: Fix Version/s: (was: 2.0.1) 2.0.0 > Incorrect information in SQL Query detai

[jira] [Updated] (SPARK-16285) Implement sentences SQL function

2016-07-14 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-16285: Fix Version/s: (was: 2.0.1) (was: 2.1.0) 2.0.0 > Impl

[jira] [Updated] (SPARK-16469) Long running Driver task while multiplying big matrices

2016-07-14 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-16469: Fix Version/s: (was: 2.0.1) 2.0.0 > Long running Driver task while multiplyi

[jira] [Updated] (SPARK-14812) ML, Graph 2.0 QA: API: Experimental, DeveloperApi, final, sealed audit

2016-07-14 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-14812: Fix Version/s: (was: 2.0.1) (was: 2.1.0) 2.0.0 > ML,

[jira] [Updated] (SPARK-16286) Implement stack table generating function

2016-07-14 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-16286: Fix Version/s: (was: 2.0.1) (was: 2.1.0) 2.0.0 > Impl

[jira] [Updated] (SPARK-16453) release script does not publish spark-hive-thriftserver_2.10

2016-07-14 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-16453: Fix Version/s: (was: 2.0.1) (was: 2.1.0) 2.0.0 > rele

[jira] [Updated] (SPARK-16284) Implement reflect and java_method SQL function

2016-07-14 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-16284: Fix Version/s: (was: 2.0.1) (was: 2.1.0) 2.0.0 > Impl

[jira] [Updated] (SPARK-16288) Implement inline table generating function

2016-07-14 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-16288: Fix Version/s: (was: 2.0.1) (was: 2.1.0) 2.0.0 > Impl

[jira] [Updated] (SPARK-16470) ml.regression.LinearRegression training data do not check whether the result actually reach convergence

2016-07-14 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16470?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-16470: Fix Version/s: (was: 2.0.1) 2.0.0 > ml.regression.LinearRegression training

[jira] [Updated] (SPARK-16372) Retag RDD to tallSkinnyQR of RowMatrix

2016-07-14 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-16372: Fix Version/s: (was: 2.0.1) (was: 2.1.0) 2.0.0 > Reta

[jira] [Updated] (SPARK-16274) Implement xpath_boolean

2016-07-14 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-16274: Fix Version/s: (was: 2.0.1) (was: 2.1.0) 2.0.0 > Impl

[jira] [Updated] (SPARK-16310) SparkR csv source should have the same default na.string as R

2016-07-14 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-16310: Fix Version/s: (was: 2.0.1) (was: 2.1.0) 2.0.0 > Spar

[jira] [Updated] (SPARK-16339) ScriptTransform does not print stderr when outstream is lost

2016-07-14 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-16339: Fix Version/s: (was: 2.0.1) 2.0.0 > ScriptTransform does not print stderr wh

[jira] [Updated] (SPARK-16485) Additional fixes to Mllib 2.0 documentation

2016-07-14 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-16485: Fix Version/s: (was: 2.0.1) (was: 2.1.0) 2.0.0 > Addi

[jira] [Updated] (SPARK-16529) SQLTestUtils.withTempDatabase should set `default` database before dropping

2016-07-14 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-16529: --- Assignee: Dongjoon Hyun > SQLTestUtils.withTempDatabase should set `default` database before dropping

[jira] [Resolved] (SPARK-16529) SQLTestUtils.withTempDatabase should set `default` database before dropping

2016-07-14 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian resolved SPARK-16529. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 14184 [https://github.

[jira] [Updated] (SPARK-16375) [Spark web UI]:The wrong value(numCompletedTasks) has been assigned to the variable numSkippedTasks

2016-07-14 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-16375: Fix Version/s: (was: 2.0.1) 2.0.0 > [Spark web UI]:The wrong value(numComple

[jira] [Updated] (SPARK-16538) Cannot use "SparkR::sql"

2016-07-14 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-16538: -- Assignee: Felix Cheung > Cannot use "SparkR::sql" > >

[jira] [Commented] (SPARK-16547) EventLoggingListener to auto create log base dir if it does not exist

2016-07-14 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15377281#comment-15377281 ] Marcelo Vanzin commented on SPARK-16547: This has come up a bunch of times and th

[jira] [Created] (SPARK-16548) java.io.CharConversionException: Invalid UTF-32 character prevents me from querying my data

2016-07-14 Thread Egor Pahomov (JIRA)
Egor Pahomov created SPARK-16548: Summary: java.io.CharConversionException: Invalid UTF-32 character prevents me from querying my data Key: SPARK-16548 URL: https://issues.apache.org/jira/browse/SPARK-16548

[jira] [Resolved] (SPARK-16547) EventLoggingListener to auto create log base dir if it does not exist

2016-07-14 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-16547. Resolution: Duplicate > EventLoggingListener to auto create log base dir if it does not exi

[jira] [Commented] (SPARK-15815) Hang while enable blacklistExecutor and DynamicExecutorAllocator

2016-07-14 Thread Imran Rashid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15377283#comment-15377283 ] Imran Rashid commented on SPARK-15815: -- [~SuYan] I've been thinking about this more,

[jira] [Commented] (SPARK-5311) EventLoggingListener throws exception if log directory does not exist

2016-07-14 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15377285#comment-15377285 ] Marcelo Vanzin commented on SPARK-5311: --- Pasting the PR comments here for posterity:

[jira] [Comment Edited] (SPARK-10063) Remove DirectParquetOutputCommitter

2016-07-14 Thread Matt Martin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15377301#comment-15377301 ] Matt Martin edited comment on SPARK-10063 at 7/14/16 5:16 PM: -

[jira] [Commented] (SPARK-10063) Remove DirectParquetOutputCommitter

2016-07-14 Thread Matt Martin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15377301#comment-15377301 ] Matt Martin commented on SPARK-10063: - For what it's worth, I gather that the Netflix

[jira] [Comment Edited] (SPARK-12945) ERROR LiveListenerBus: Listener JobProgressListener threw an exception

2016-07-14 Thread Ella Peltonen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15377322#comment-15377322 ] Ella Peltonen edited comment on SPARK-12945 at 7/14/16 5:23 PM: ---

[jira] [Commented] (SPARK-12945) ERROR LiveListenerBus: Listener JobProgressListener threw an exception

2016-07-14 Thread Ella Peltonen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15377322#comment-15377322 ] Ella Peltonen commented on SPARK-12945: --- I got that error too multiple times from d

[jira] [Resolved] (SPARK-16528) HiveClientImpl throws NPE when reading database from a custom metastore

2016-07-14 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-16528. - Resolution: Fixed Assignee: Jacek Lewandowski Fix Version/s: 2.1.0

[jira] [Commented] (SPARK-12945) ERROR LiveListenerBus: Listener JobProgressListener threw an exception

2016-07-14 Thread Ben Huntley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15377331#comment-15377331 ] Ben Huntley commented on SPARK-12945: - Hi Ella, This approach worked for us as well.

[jira] [Created] (SPARK-16549) GC Overhead Limit Reached and Core Dump

2016-07-14 Thread Niels Becker (JIRA)
Niels Becker created SPARK-16549: Summary: GC Overhead Limit Reached and Core Dump Key: SPARK-16549 URL: https://issues.apache.org/jira/browse/SPARK-16549 Project: Spark Issue Type: Bug A

[jira] [Commented] (SPARK-15799) Release SparkR on CRAN

2016-07-14 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15799?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15377343#comment-15377343 ] Shivaram Venkataraman commented on SPARK-15799: --- I have written a design do

[jira] [Commented] (SPARK-15799) Release SparkR on CRAN

2016-07-14 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15799?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15377347#comment-15377347 ] Shivaram Venkataraman commented on SPARK-15799: --- cc [~javierluraschi] [~j..

[jira] [Resolved] (SPARK-16540) Jars specified with --jars will added twice when running on YARN

2016-07-14 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-16540. Resolution: Fixed Assignee: Saisai Shao Fix Version/s: 2.0.0 > Jars specifi

[jira] [Commented] (SPARK-16548) java.io.CharConversionException: Invalid UTF-32 character prevents me from querying my data

2016-07-14 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15377352#comment-15377352 ] Sean Owen commented on SPARK-16548: --- Tough call, just because returning 'null' is also

[jira] [Commented] (SPARK-16522) [MESOS] Spark application throws exception on exit

2016-07-14 Thread Michael Gummelt (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15377353#comment-15377353 ] Michael Gummelt commented on SPARK-16522: - [~srowen] I'm going to look into this

[jira] [Commented] (SPARK-16522) [MESOS] Spark application throws exception on exit

2016-07-14 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15377361#comment-15377361 ] Sean Owen commented on SPARK-16522: --- I'm not the release guy, but I also saw that RC3 l

[jira] [Commented] (SPARK-16480) Streaming checkpointing does not work well with SIGTERM

2016-07-14 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15377364#comment-15377364 ] Stavros Kontopoulos commented on SPARK-16480: - [~nmemond] thnx for the verifi

[jira] [Commented] (SPARK-16480) Streaming checkpointing does not work well with SIGTERM

2016-07-14 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15377616#comment-15377616 ] Sean Owen commented on SPARK-16480: --- It's just reading serialized data, here apparently

[jira] [Resolved] (SPARK-16549) GC Overhead Limit Reached and Core Dump

2016-07-14 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-16549. --- Resolution: Fixed "Out of memory" isn't a Spark bug. From your description, it's not clear that you

[jira] [Updated] (SPARK-16549) GC Overhead Limit Reached and Core Dump

2016-07-14 Thread Niels Becker (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Niels Becker updated SPARK-16549: - Description: I'm submitting my application via spark-submit. It is running a long living Context

[jira] [Updated] (SPARK-16538) Cannot use "SparkR::sql"

2016-07-14 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-16538: -- Fix Version/s: 1.6.3 > Cannot use "SparkR::sql" > > >

[jira] [Updated] (SPARK-16549) GC Overhead Limit Reached and Core Dump

2016-07-14 Thread Niels Becker (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Niels Becker updated SPARK-16549: - Description: I'm submitting my application via spark-submit. It is running a long living Context

[jira] [Updated] (SPARK-16549) GC Overhead Limit Reached and Core Dump

2016-07-14 Thread Niels Becker (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Niels Becker updated SPARK-16549: - Description: I'm submitting my application via spark-submit. It is running a long living Context

[jira] [Updated] (SPARK-16549) GC Overhead Limit Reached and Core Dump

2016-07-14 Thread Niels Becker (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Niels Becker updated SPARK-16549: - Description: I'm submitting my application via spark-submit. It is running a long living Context

[jira] [Updated] (SPARK-16549) GC Overhead Limit Reached and Core Dump

2016-07-14 Thread Niels Becker (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Niels Becker updated SPARK-16549: - Description: I'm submitting my application via spark-submit. It is running a long living Context

[jira] [Updated] (SPARK-16549) GC Overhead Limit Reached and Core Dump

2016-07-14 Thread Niels Becker (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Niels Becker updated SPARK-16549: - Description: I'm submitting my application via spark-submit. It is running a long living Context

[jira] [Commented] (SPARK-16549) GC Overhead Limit Reached and Core Dump

2016-07-14 Thread Niels Becker (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16549?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15377884#comment-15377884 ] Niels Becker commented on SPARK-16549: -- I added my Code, there is realy not mush I d

[jira] [Commented] (SPARK-16528) HiveClientImpl throws NPE when reading database from a custom metastore

2016-07-14 Thread Jacek Lewandowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15377892#comment-15377892 ] Jacek Lewandowski commented on SPARK-16528: --- so it won't be available in 2.0.0

[jira] [Updated] (SPARK-16549) GC Overhead Limit Reached and Core Dump

2016-07-14 Thread Niels Becker (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Niels Becker updated SPARK-16549: - Description: I'm submitting my application via spark-submit. It is running a long living Context

[jira] [Updated] (SPARK-16538) Cannot use "SparkR::sql"

2016-07-14 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-16538: - Fix Version/s: (was: 1.6.3) > Cannot use "SparkR::sql" > > >

[jira] [Commented] (SPARK-16538) Cannot use "SparkR::sql"

2016-07-14 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15378054#comment-15378054 ] Felix Cheung commented on SPARK-16538: -- Remove Fix 1.6.3 since SPARK-10903 was not i

[jira] [Comment Edited] (SPARK-16538) Cannot use "SparkR::sql"

2016-07-14 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15378054#comment-15378054 ] Felix Cheung edited comment on SPARK-16538 at 7/14/16 6:23 PM:

[jira] [Updated] (SPARK-16538) Cannot use "SparkR::sql"

2016-07-14 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-16538: - Affects Version/s: (was: 1.6.2) > Cannot use "SparkR::sql" > > >

[jira] [Commented] (SPARK-16528) HiveClientImpl throws NPE when reading database from a custom metastore

2016-07-14 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15378078#comment-15378078 ] Sean Owen commented on SPARK-16528: --- No, but the latest RC could theoretically be the r

[jira] [Reopened] (SPARK-16549) GC Overhead Limit Reached and Core Dump

2016-07-14 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reopened SPARK-16549: --- (Oops, didn't mean to resolve yet) > GC Overhead Limit Reached and Core Dump > -

[jira] [Commented] (SPARK-16548) java.io.CharConversionException: Invalid UTF-32 character prevents me from querying my data

2016-07-14 Thread Egor Pahomov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15378112#comment-15378112 ] Egor Pahomov commented on SPARK-16548: -- [~sowen] if your concern is "silently" we ca

[jira] [Commented] (SPARK-16548) java.io.CharConversionException: Invalid UTF-32 character prevents me from querying my data

2016-07-14 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15378123#comment-15378123 ] Sean Owen commented on SPARK-16548: --- Yeah sure, but is that much better? the job contin

[jira] [Updated] (SPARK-16545) Structured Streaming : foreachSink creates the Physical Plan multiple times per TriggerInterval

2016-07-14 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-16545: -- Fix Version/s: (was: 2.0.0) > Structured Streaming : foreachSink creates the Physical Plan multiple

[jira] [Commented] (SPARK-16313) Spark should not silently drop exceptions in file listing

2016-07-14 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15378139#comment-15378139 ] Yin Huai commented on SPARK-16313: -- https://github.com/apache/spark/pull/14139 has been

[jira] [Updated] (SPARK-16313) Spark should not silently drop exceptions in file listing

2016-07-14 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-16313: - Fix Version/s: 1.6.3 > Spark should not silently drop exceptions in file listing > --

[jira] [Created] (SPARK-16550) Caching data with replication doesn't replicate data

2016-07-14 Thread Shubham Chopra (JIRA)
Shubham Chopra created SPARK-16550: -- Summary: Caching data with replication doesn't replicate data Key: SPARK-16550 URL: https://issues.apache.org/jira/browse/SPARK-16550 Project: Spark Issu

[jira] [Commented] (SPARK-16522) [MESOS] Spark application throws exception on exit

2016-07-14 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15378150#comment-15378150 ] Reynold Xin commented on SPARK-16522: - Does this fail the job? If it doesn't fail the

[jira] [Updated] (SPARK-16522) [MESOS] Spark application throws exception on exit

2016-07-14 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-16522: Description: Spark applications running on Mesos throw exception upon exit as follows: {noformat} 1

[jira] [Commented] (SPARK-16550) Caching data with replication doesn't replicate data

2016-07-14 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15378167#comment-15378167 ] Sean Owen commented on SPARK-16550: --- You have a shell-related problem here that caused

[jira] [Commented] (SPARK-16538) Cannot use "SparkR::sql"

2016-07-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15378171#comment-15378171 ] Apache Spark commented on SPARK-16538: -- User 'felixcheung' has created a pull reques

[jira] [Commented] (SPARK-5311) EventLoggingListener throws exception if log directory does not exist

2016-07-14 Thread Tejas Patil (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15378177#comment-15378177 ] Tejas Patil commented on SPARK-5311: [~vanzin] : Thanks for pointing that out. I went

[jira] [Commented] (SPARK-16522) [MESOS] Spark application throws exception on exit

2016-07-14 Thread Michael Gummelt (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15378178#comment-15378178 ] Michael Gummelt commented on SPARK-16522: - I don't think so. Please give me a co

[jira] [Commented] (SPARK-16534) Kafka 0.10 Python support

2016-07-14 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15378179#comment-15378179 ] Tathagata Das commented on SPARK-16534: --- No we dont need to fix this for 2.0. [~c..

[jira] [Updated] (SPARK-16428) Spark file system watcher not working on Windows

2016-07-14 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-16428: -- Priority: Major (was: Blocker) > Spark file system watcher not working on Windows > --

[jira] [Updated] (SPARK-16533) Spark application not handling preemption messages

2016-07-14 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-16533: -- Priority: Major (was: Blocker) > Spark application not handling preemption messages >

[jira] [Updated] (SPARK-16550) Caching data with replication doesn't replicate data

2016-07-14 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-16550: -- Priority: Major (was: Blocker) > Caching data with replication doesn't replicate data > --

[jira] [Updated] (SPARK-16011) SQL metrics include duplicated attempts

2016-07-14 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-16011: -- Target Version/s: 2.0.0 I assume you mean this blocks 2.0? > SQL metrics include duplicated attempts >

[jira] [Resolved] (SPARK-15578) Run Spark jobs in Mesos sequentially

2016-07-14 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-15578. --- Resolution: Invalid > Run Spark jobs in Mesos sequentially > > >

[jira] [Updated] (SPARK-15578) Run Spark jobs in Mesos sequentially

2016-07-14 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-15578: -- Priority: Major (was: Blocker) Don't set Blocker. I don't think this is true; most likely a problem in

[jira] [Updated] (SPARK-14818) Move sketch, mllibLocal, and hivecontext-compatibility out from mima exclusion

2016-07-14 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-14818: -- Target Version/s: 2.0.0 (was: ) [~yhuai] what is this a blocker for -- 2.0? > Move sketch, mllibLocal

[jira] [Updated] (SPARK-15118) spark couldn't get hive properyties in hive-site.xml

2016-07-14 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-15118: -- Priority: Major (was: Blocker) Don't set Blocker. I don't even see a valid issue description here. >

[jira] [Resolved] (SPARK-15118) spark couldn't get hive properyties in hive-site.xml

2016-07-14 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-15118. --- Resolution: Invalid > spark couldn't get hive properyties in hive-site.xml > ---

[jira] [Updated] (SPARK-16112) R programming guide update for gapply and gapplyCollect

2016-07-14 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-16112: -- Priority: Major (was: Blocker) > R programming guide update for gapply and gapplyCollect > ---

[jira] [Updated] (SPARK-15666) Join on two tables generated from a same table throwing query analyzer issue

2016-07-14 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-15666: -- Priority: Major (was: Blocker) > Join on two tables generated from a same table throwing query analyze

[jira] [Updated] (SPARK-16475) Broadcast Hint for SQL Queries

2016-07-14 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-16475: Description: Broadcast hint is a way for users to manually annotate a query and suggest to the que

[jira] [Commented] (SPARK-16534) Kafka 0.10 Python support

2016-07-14 Thread Cody Koeninger (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15378240#comment-15378240 ] Cody Koeninger commented on SPARK-16534: [~jerryshao] if you want to work on this

[jira] [Updated] (SPARK-16540) Jars specified with --jars will added twice when running on YARN

2016-07-14 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-16540: Fix Version/s: (was: 2.0.0) 2.0.1 > Jars specified with --jars will added tw

[jira] [Updated] (SPARK-16540) Jars specified with --jars will added twice when running on YARN

2016-07-14 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin updated SPARK-16540: --- Affects Version/s: (was: 2.0.0) 2.0.1 > Jars specified with --jars

[jira] [Updated] (SPARK-16540) Jars specified with --jars will added twice when running on YARN

2016-07-14 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin updated SPARK-16540: --- Affects Version/s: (was: 2.0.1) 2.0.0 > Jars specified with --jars

[jira] [Commented] (SPARK-14818) Move sketch, mllibLocal, and hivecontext-compatibility out from mima exclusion

2016-07-14 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14818?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15378255#comment-15378255 ] Yin Huai commented on SPARK-14818: -- oh, it is a post-2.0-release task. > Move sketch,

[jira] [Updated] (SPARK-14818) Move sketch, mllibLocal, and hivecontext-compatibility out from mima exclusion

2016-07-14 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-14818: - Target Version/s: 2.0.1, 2.1.0 (was: 2.0.0) > Move sketch, mllibLocal, and hivecontext-compatibility out

[jira] [Updated] (SPARK-14818) Move sketch and mllibLocal out from mima exclusion

2016-07-14 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-14818: - Description: In SparkBuild.scala, we exclude sketch and mllibLocal from mima check (see the definition of

[jira] [Commented] (SPARK-14818) Move sketch, mllibLocal, and hivecontext-compatibility out from mima exclusion

2016-07-14 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14818?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15378258#comment-15378258 ] Yin Huai commented on SPARK-14818: -- Seems we need to set the target versions to 2.0.1 an

[jira] [Updated] (SPARK-14818) Move sketch and mllibLocal out from mima exclusion

2016-07-14 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-14818: - Summary: Move sketch and mllibLocal out from mima exclusion (was: Move sketch, mllibLocal, and hiveconte

[jira] [Created] (SPARK-16551) Accumulator Examples should demonstrate different use case from UDAFs

2016-07-14 Thread Vladimir Feinberg (JIRA)
Vladimir Feinberg created SPARK-16551: - Summary: Accumulator Examples should demonstrate different use case from UDAFs Key: SPARK-16551 URL: https://issues.apache.org/jira/browse/SPARK-16551 Proje

[jira] [Updated] (SPARK-16552) Store the Inferred Schemas into External Catalog Tables when Creating Tables

2016-07-14 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-16552: Issue Type: Improvement (was: Bug) > Store the Inferred Schemas into External Catalog Tables when Creating

[jira] [Created] (SPARK-16552) Store the Inferred Schemas into External Catalog Tables when Creating Tables

2016-07-14 Thread Xiao Li (JIRA)
Xiao Li created SPARK-16552: --- Summary: Store the Inferred Schemas into External Catalog Tables when Creating Tables Key: SPARK-16552 URL: https://issues.apache.org/jira/browse/SPARK-16552 Project: Spark

<    1   2   3   >