[jira] [Resolved] (SPARK-13182) Spark Executor retries infinitely

2016-02-07 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13182?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-13182. --- Resolution: Not A Problem Fix Version/s: (was: 1.5.2) I'm afraid that's an app problem.

[jira] [Updated] (SPARK-13197) When trying to select from the data frame which contains the columns with . in it, it is throwing exception.

2016-02-07 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-13197: -- Fix Version/s: (was: 2.0.0) > When trying to select from the data frame which contains the columns

[jira] [Updated] (SPARK-13197) When trying to select from the data frame which contains the columns with . in it, it is throwing exception.

2016-02-07 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-13197: -- Affects Version/s: (was: 2.0.0) > When trying to select from the data frame which contains the

[jira] [Updated] (SPARK-13102) Run query using ThriftServer, and open web using IE11, i click ”+detail" in SQLPage, but not response

2016-02-07 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-13102: -- Labels: (was: UI) Fix Version/s: (was: 2.0.0) > Run query using ThriftServer, and

[jira] [Commented] (SPARK-13172) Stop using RichException.getStackTrace it is deprecated

2016-02-07 Thread holdenk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15136173#comment-15136173 ] holdenk commented on SPARK-13172: - Great! Let me know if you have any questions :) > Stop using

[jira] [Updated] (SPARK-12868) ADD JAR via sparkSQL JDBC will fail when using a HDFS URL

2016-02-07 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12868: -- Fix Version/s: (was: 1.6.1) > ADD JAR via sparkSQL JDBC will fail when using a HDFS URL >

[jira] [Updated] (SPARK-13072) simplify and improve murmur3 hash expression codegen

2016-02-07 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-13072: -- Assignee: Wenchen Fan > simplify and improve murmur3 hash expression codegen >

[jira] [Updated] (SPARK-13098) remove GenericInternalRowWithSchema

2016-02-07 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-13098: -- Assignee: Wenchen Fan > remove GenericInternalRowWithSchema > --- > >

[jira] [Updated] (SPARK-13215) Remove fallback in codegen

2016-02-07 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-13215: -- Assignee: Davies Liu > Remove fallback in codegen > -- > >

[jira] [Updated] (SPARK-12989) Bad interaction between StarExpansion and ExtractWindowExpressions

2016-02-07 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12989: -- Assignee: Xiao Li > Bad interaction between StarExpansion and ExtractWindowExpressions >

[jira] [Updated] (SPARK-13073) creating R like summary for logistic Regression in Spark - Scala

2016-02-07 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13073?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-13073: -- Target Version/s: (was: 1.6.0) > creating R like summary for logistic Regression in Spark - Scala >

[jira] [Updated] (SPARK-12992) Vectorize parquet decoding using ColumnarBatch

2016-02-07 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12992?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12992: -- Fix Version/s: (was: 2.0.0) > Vectorize parquet decoding using ColumnarBatch >

[jira] [Updated] (SPARK-13180) Protect against SessionState being null when accessing HiveClientImpl#conf

2016-02-07 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-13180: -- Component/s: SQL > Protect against SessionState being null when accessing HiveClientImpl#conf >

[jira] [Created] (SPARK-13228) HiveSparkSubmitSuite is flaky

2016-02-07 Thread Herman van Hovell (JIRA)
Herman van Hovell created SPARK-13228: - Summary: HiveSparkSubmitSuite is flaky Key: SPARK-13228 URL: https://issues.apache.org/jira/browse/SPARK-13228 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-13113) Remove unnecessary bit operation when decoding page number

2016-02-07 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-13113: -- Assignee: Liang-Chi Hsieh > Remove unnecessary bit operation when decoding page number >

[jira] [Updated] (SPARK-13067) DataFrameSuite.simple explode fail locally

2016-02-07 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-13067: -- Assignee: Wenchen Fan > DataFrameSuite.simple explode fail locally >

[jira] [Updated] (SPARK-12926) SQLContext to display warning message when non-sql configs are being set

2016-02-07 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12926: -- Assignee: Tejas Patil > SQLContext to display warning message when non-sql configs are being set >

[jira] [Updated] (SPARK-12261) pyspark crash for large dataset

2016-02-07 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12261: -- Component/s: PySpark [~joshrosen] do you have a lead on what else is at issue here? it did not look

[jira] [Updated] (SPARK-13064) api/v1/application/jobs/attempt lacks "attempId" field for spark-shell

2016-02-07 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-13064: -- Component/s: Spark Shell > api/v1/application/jobs/attempt lacks "attempId" field for spark-shell >

[jira] [Updated] (SPARK-13117) WebUI should use the local ip not 0.0.0.0

2016-02-07 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13117?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-13117: -- Component/s: Web UI > WebUI should use the local ip not 0.0.0.0 >

[jira] [Updated] (SPARK-13083) Small spark sql queries get blocked if there is a long running query over a lot a partitions

2016-02-07 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-13083: -- Component/s: SQL > Small spark sql queries get blocked if there is a long running query over a > lot

[jira] [Resolved] (SPARK-13104) Spark Metrics currently does not return executors hostname

2016-02-07 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-13104. --- Resolution: Invalid Questions should really go to u...@spark.apache.org > Spark Metrics currently

[jira] [Commented] (SPARK-12591) NullPointerException using checkpointed mapWithState with KryoSerializer

2016-02-07 Thread Yuval Itzchakov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12591?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15136208#comment-15136208 ] Yuval Itzchakov commented on SPARK-12591: - I'm seeing this error as well running Spark 1.6.0 with

[jira] [Comment Edited] (SPARK-12591) NullPointerException using checkpointed mapWithState with KryoSerializer

2016-02-07 Thread Yuval Itzchakov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12591?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15136208#comment-15136208 ] Yuval Itzchakov edited comment on SPARK-12591 at 2/7/16 10:04 AM: -- I'm

[jira] [Resolved] (SPARK-13132) LogisticRegression spends 35% of its time fetching the standardization parameter

2016-02-07 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13132?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-13132. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 11027

[jira] [Updated] (SPARK-13132) LogisticRegression spends 35% of its time fetching the standardization parameter

2016-02-07 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13132?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-13132: -- Priority: Minor (was: Major) > LogisticRegression spends 35% of its time fetching the standardization

[jira] [Updated] (SPARK-13132) LogisticRegression spends 35% of its time fetching the standardization parameter

2016-02-07 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13132?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-13132: -- Assignee: Gary King > LogisticRegression spends 35% of its time fetching the standardization >

[jira] [Assigned] (SPARK-13200) Investigate math.round on integer number in MFDataGenerator.scala:109

2016-02-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13200: Assignee: Apache Spark > Investigate math.round on integer number in

[jira] [Assigned] (SPARK-13200) Investigate math.round on integer number in MFDataGenerator.scala:109

2016-02-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13200: Assignee: (was: Apache Spark) > Investigate math.round on integer number in

[jira] [Commented] (SPARK-13200) Investigate math.round on integer number in MFDataGenerator.scala:109

2016-02-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15136177#comment-15136177 ] Apache Spark commented on SPARK-13200: -- User 'holdenk' has created a pull request for this issue:

[jira] [Resolved] (SPARK-5159) Thrift server does not respect hive.server2.enable.doAs=true

2016-02-07 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-5159. -- Resolution: Cannot Reproduce Fix Version/s: (was: 1.5.2) > Thrift server does not respect

[jira] [Resolved] (SPARK-13140) spark sql aggregate performance decrease

2016-02-07 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-13140. --- Resolution: Invalid Since there's no real way to understand enough from this description to make an

[jira] [Updated] (SPARK-13213) BroadcastNestedLoopJoin is very slow

2016-02-07 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-13213: -- Component/s: SQL [~davies] again you'd be doing us a favor if you would set component on your JIRAs.

[jira] [Updated] (SPARK-13173) Fail to load CSV file with NPE

2016-02-07 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-13173: -- Component/s: SQL Input/Output > Fail to load CSV file with NPE >

[jira] [Updated] (SPARK-13174) Add API and options for csv data sources

2016-02-07 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-13174: -- Component/s: Input/Output > Add API and options for csv data sources >

[jira] [Comment Edited] (SPARK-12591) NullPointerException using checkpointed mapWithState with KryoSerializer

2016-02-07 Thread Yuval Itzchakov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12591?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15136208#comment-15136208 ] Yuval Itzchakov edited comment on SPARK-12591 at 2/7/16 10:03 AM: -- I'm

[jira] [Reopened] (SPARK-12423) Mesos executor home should not be resolved on the driver's file system

2016-02-07 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reopened SPARK-12423: --- > Mesos executor home should not be resolved on the driver's file system >

[jira] [Updated] (SPARK-5331) Spark workers can't find tachyon master as spark-ec2 doesn't set spark.tachyonStore.url

2016-02-07 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-5331: - Assignee: Shivaram Venkataraman > Spark workers can't find tachyon master as spark-ec2 doesn't set >

[jira] [Resolved] (SPARK-12423) Mesos executor home should not be resolved on the driver's file system

2016-02-07 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-12423. --- Resolution: Duplicate Fix Version/s: (was: 2.0.0) > Mesos executor home should not be

[jira] [Reopened] (SPARK-5159) Thrift server does not respect hive.server2.enable.doAs=true

2016-02-07 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reopened SPARK-5159: -- > Thrift server does not respect hive.server2.enable.doAs=true >

[jira] [Resolved] (SPARK-9975) Add Normalized Closeness Centrality to Spark GraphX

2016-02-07 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-9975. -- Resolution: Won't Fix I don't think anyone is merging GraphX changes at this stage. If it's an

[jira] [Resolved] (SPARK-13129) Spark SQL can't query hive table, which is create by Hive HCatalog Streaming API

2016-02-07 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-13129. --- Resolution: Not A Problem > Spark SQL can't query hive table, which is create by Hive HCatalog

[jira] [Commented] (SPARK-13156) JDBC using multiple partitions creates additional tasks but only executes on one

2016-02-07 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15136195#comment-15136195 ] Sean Owen commented on SPARK-13156: --- What do you mean when you say only 1 is querying? is there

[jira] [Resolved] (SPARK-13120) Shade protobuf-java

2016-02-07 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13120?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-13120. --- Resolution: Won't Fix At the moment I don't see an argument for shading this, although I suspect it

[jira] [Commented] (SPARK-13127) Upgrade Parquet to 1.9 (Fixes parquet sorting)

2016-02-07 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15136236#comment-15136236 ] Sean Owen commented on SPARK-13127: --- [~JustinPihony] I suspect this is a good idea, but whenever

[jira] [Updated] (SPARK-10963) Make KafkaCluster api public

2016-02-07 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-10963: -- Assignee: Cody Koeninger > Make KafkaCluster api public > > >

[jira] [Commented] (SPARK-13211) StreamingContext throws NoSuchElementException when created from non-existent checkpoint directory

2016-02-07 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15136265#comment-15136265 ] Sean Owen commented on SPARK-13211: --- Yes, I'm agreeing that there is a code change. You do not need it

[jira] [Commented] (SPARK-9975) Add Normalized Closeness Centrality to Spark GraphX

2016-02-07 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15136249#comment-15136249 ] Sean Owen commented on SPARK-9975: -- Yeah, that's why I replied. I have seen a number of PRs for GraphX

[jira] [Resolved] (SPARK-13226) MLLib PowerIteration Clustering depends on deprecated KMeans setRuns API

2016-02-07 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-13226. --- Resolution: Duplicate > MLLib PowerIteration Clustering depends on deprecated KMeans setRuns API >

[jira] [Assigned] (SPARK-13170) Investigate replacing SynchronizedQueue as it is deprecated

2016-02-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13170: Assignee: Apache Spark > Investigate replacing SynchronizedQueue as it is deprecated >

[jira] [Commented] (SPARK-13170) Investigate replacing SynchronizedQueue as it is deprecated

2016-02-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15136281#comment-15136281 ] Apache Spark commented on SPARK-13170: -- User 'srowen' has created a pull request for this issue:

[jira] [Assigned] (SPARK-13170) Investigate replacing SynchronizedQueue as it is deprecated

2016-02-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13170: Assignee: (was: Apache Spark) > Investigate replacing SynchronizedQueue as it is

[jira] [Comment Edited] (SPARK-11472) SparkContext creation error after sc.stop() when Spark is compiled for Hive

2016-02-07 Thread Atkins (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15136127#comment-15136127 ] Atkins edited comment on SPARK-11472 at 2/7/16 4:19 PM: Reproduced in kerberized

[jira] [Commented] (SPARK-13211) StreamingContext throws NoSuchElementException when created from non-existent checkpoint directory

2016-02-07 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15136255#comment-15136255 ] Sean Owen commented on SPARK-13211: --- Yeah I think this code path which returns {{None}} needs to match

[jira] [Commented] (SPARK-9975) Add Normalized Closeness Centrality to Spark GraphX

2016-02-07 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15136220#comment-15136220 ] Stavros Kontopoulos commented on SPARK-9975: What do you mean no-one is merging? Is this an

[jira] [Comment Edited] (SPARK-9975) Add Normalized Closeness Centrality to Spark GraphX

2016-02-07 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15136220#comment-15136220 ] Stavros Kontopoulos edited comment on SPARK-9975 at 2/7/16 10:56 AM: -

[jira] [Resolved] (SPARK-10963) Make KafkaCluster api public

2016-02-07 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-10963. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 9007

[jira] [Commented] (SPARK-13170) Investigate replacing SynchronizedQueue as it is deprecated

2016-02-07 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15136273#comment-15136273 ] Sean Owen commented on SPARK-13170: --- Yeah, tough one. The problem with the API is that it assumes the

[jira] [Created] (SPARK-13229) When checkpoint interval for ConstantInputDStream is lower than batch duration IllegalArgumentException says it is due to slide time instead

2016-02-07 Thread Jacek Laskowski (JIRA)
Jacek Laskowski created SPARK-13229: --- Summary: When checkpoint interval for ConstantInputDStream is lower than batch duration IllegalArgumentException says it is due to slide time instead Key: SPARK-13229 URL:

[jira] [Updated] (SPARK-13229) When checkpoint interval for ConstantInputDStream is lower than batch duration IllegalArgumentException says it is due to slide time instead

2016-02-07 Thread Jacek Laskowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jacek Laskowski updated SPARK-13229: Priority: Minor (was: Major) Issue Type: Improvement (was: Bug) > When checkpoint

[jira] [Resolved] (SPARK-13190) Update pom.xml to reference Scala 2.11

2016-02-07 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-13190. --- Resolution: Duplicate > Update pom.xml to reference Scala 2.11 >

[jira] [Resolved] (SPARK-13193) Update Docker tests to use Scala 2.11

2016-02-07 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-13193. --- Resolution: Duplicate > Update Docker tests to use Scala 2.11 >

[jira] [Resolved] (SPARK-13191) Update LICENSE with Scala 2.11 dependencies

2016-02-07 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-13191. --- Resolution: Duplicate > Update LICENSE with Scala 2.11 dependencies >

[jira] [Resolved] (SPARK-13194) Update release audit tools to use Scala 2.11

2016-02-07 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-13194. --- Resolution: Duplicate > Update release audit tools to use Scala 2.11 >

[jira] [Comment Edited] (SPARK-12591) NullPointerException using checkpointed mapWithState with KryoSerializer

2016-02-07 Thread Yuval Itzchakov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12591?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15136208#comment-15136208 ] Yuval Itzchakov edited comment on SPARK-12591 at 2/7/16 10:47 AM: -- I'm

[jira] [Commented] (SPARK-13211) StreamingContext throws NoSuchElementException when created from non-existent checkpoint directory

2016-02-07 Thread Jacek Laskowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15136262#comment-15136262 ] Jacek Laskowski commented on SPARK-13211: - Can I read it as if you'd approve a pull request for

[jira] [Commented] (SPARK-13211) StreamingContext throws NoSuchElementException when created from non-existent checkpoint directory

2016-02-07 Thread Jacek Laskowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15136266#comment-15136266 ] Jacek Laskowski commented on SPARK-13211: - Thanks! I'm on it. > StreamingContext throws

[jira] [Commented] (SPARK-12261) pyspark crash for large dataset

2016-02-07 Thread Christopher Bourez (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15136229#comment-15136229 ] Christopher Bourez commented on SPARK-12261: I'm still here if you need any more info about

[jira] [Updated] (SPARK-13189) Cleanup build references to Scala 2.10

2016-02-07 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-13189: -- Assignee: Luciano Resende Priority: Minor (was: Major) > Cleanup build references to Scala 2.10 >

[jira] [Updated] (SPARK-13229) When checkpoint interval for ConstantInputDStream is lower than batch duration IllegalArgumentException says it is due to slide time instead

2016-02-07 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-13229: -- Priority: Trivial (was: Minor) If you're just quibbling with "has been set to", then I agree this can

[jira] [Commented] (SPARK-9763) Minimize exposure of internal SQL classes

2016-02-07 Thread Junyang Shen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15136480#comment-15136480 ] Junyang Shen commented on SPARK-9763: - May I ask why the StructType is always defined as "asNullable"

[jira] [Commented] (SPARK-9975) Add Normalized Closeness Centrality to Spark GraphX

2016-02-07 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15136339#comment-15136339 ] Stavros Kontopoulos commented on SPARK-9975: Thank you for answering back, however i would say

[jira] [Commented] (SPARK-13120) Shade protobuf-java

2016-02-07 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15136320#comment-15136320 ] Ted Yu commented on SPARK-13120: I do see the advantage of shading protobuf-java which would make user

[jira] [Updated] (SPARK-13120) Shade protobuf-java

2016-02-07 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13120?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated SPARK-13120: --- Description: https://groups.google.com/forum/#!topic/protobuf/wAqvtPLBsE8 PB2 and PB3 are wire compatible,

[jira] [Commented] (SPARK-13120) Shade protobuf-java

2016-02-07 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15136383#comment-15136383 ] Ted Yu commented on SPARK-13120: I don't think this JIRA is limited to the scenario from the thread

[jira] [Commented] (SPARK-13120) Shade protobuf-java

2016-02-07 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15136360#comment-15136360 ] Sean Owen commented on SPARK-13120: --- What problem does that solve then? shading really helps when the

[jira] [Updated] (SPARK-13026) Umbrella: Allow user to specify initial model when training

2016-02-07 Thread Xusen Yin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xusen Yin updated SPARK-13026: -- Description: Umbrella JIRA for allowing the user to set the initial model when training. Move [design

[jira] [Updated] (SPARK-13026) Umbrella: Allow user to specify initial model when training

2016-02-07 Thread Xusen Yin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xusen Yin updated SPARK-13026: -- Description: Umbrella JIRA for allowing the user to set the initial model when training. Move the

[jira] [Commented] (SPARK-12261) pyspark crash for large dataset

2016-02-07 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15136515#comment-15136515 ] Josh Rosen commented on SPARK-12261: [~srowen], I reopened this after it was updated with

[jira] [Commented] (SPARK-12591) NullPointerException using checkpointed mapWithState with KryoSerializer

2016-02-07 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12591?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15136519#comment-15136519 ] Shixiong Zhu commented on SPARK-12591: -- Yes. You need to apply this patch for 1.6.0 by yourself. For

[jira] [Issue Comment Deleted] (SPARK-12720) SQL generation support for cube, rollup, and grouping set

2016-02-07 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-12720: Comment: was deleted (was: Since Subquery Alias does not work well, my PR has to wait until Spark-13206

[jira] [Created] (SPARK-13230) HashMap.merged not working properly with Spark

2016-02-07 Thread Alin Treznai (JIRA)
Alin Treznai created SPARK-13230: Summary: HashMap.merged not working properly with Spark Key: SPARK-13230 URL: https://issues.apache.org/jira/browse/SPARK-13230 Project: Spark Issue Type:

[jira] [Updated] (SPARK-13230) HashMap.merged not working properly with Spark

2016-02-07 Thread Alin Treznai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alin Treznai updated SPARK-13230: - Description: Using HashMap.merged with Spark fails with NullPointerException. {noformat} import

[jira] [Commented] (SPARK-13201) Make a private non-deprecated version of setRuns

2016-02-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15136651#comment-15136651 ] Apache Spark commented on SPARK-13201: -- User 'holdenk' has created a pull request for this issue:

[jira] [Commented] (SPARK-13200) Investigate math.round on integer number in MFDataGenerator.scala:109

2016-02-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15136652#comment-15136652 ] Apache Spark commented on SPARK-13200: -- User 'holdenk' has created a pull request for this issue:

[jira] [Assigned] (SPARK-13201) Make a private non-deprecated version of setRuns

2016-02-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13201: Assignee: (was: Apache Spark) > Make a private non-deprecated version of setRuns >

[jira] [Assigned] (SPARK-13201) Make a private non-deprecated version of setRuns

2016-02-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13201: Assignee: Apache Spark > Make a private non-deprecated version of setRuns >

[jira] [Commented] (SPARK-13230) HashMap.merged not working properly with Spark

2016-02-07 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15136654#comment-15136654 ] Sean Owen commented on SPARK-13230: --- That's a weird one. This is a little simpler as {code}

[jira] [Updated] (SPARK-13230) HashMap.merged not working properly with Spark

2016-02-07 Thread Alin Treznai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alin Treznai updated SPARK-13230: - Description: Using HashMap.merged with Spark fails with NullPointerException. {noformat} import

[jira] [Updated] (SPARK-13230) HashMap.merged not working properly with Spark

2016-02-07 Thread Alin Treznai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alin Treznai updated SPARK-13230: - Description: Using HashMap.merged with Spark fails with NullPointerException. import

[jira] [Updated] (SPARK-13201) Make a private non-deprecated version of setRuns

2016-02-07 Thread holdenk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] holdenk updated SPARK-13201: Issue Type: Sub-task (was: Improvement) Parent: SPARK-13175 > Make a private non-deprecated