[jira] [Resolved] (SPARK-6182) spark-parent pom needs to be published for both 2.10 and 2.11

[ https://issues.apache.org/jira/browse/SPARK-6182?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-6182. Resolution: Fixed Fix Version/s: 1.3.0 Assignee: Sean Owen > spark-parent po

[jira] [Updated] (SPARK-6175) Executor log links are using internal addresses in EC2; display `:0` when ephemeral ports are used

[ https://issues.apache.org/jira/browse/SPARK-6175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-6175: --- Priority: Blocker (was: Major) > Executor log links are using internal addresses in EC2; disp

[jira] [Updated] (SPARK-6141) Upgrade Breeze to 0.11 to fix convergence bug

[ https://issues.apache.org/jira/browse/SPARK-6141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-6141: --- Fix Version/s: (was: 1.3.1) 1.3.0 > Upgrade Breeze to 0.11 to fix conve

[jira] [Updated] (SPARK-5345) Flaky test: o.a.s.deploy.history.FsHistoryProviderSuite

[ https://issues.apache.org/jira/browse/SPARK-5345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-5345: --- Fix Version/s: 1.3.0 > Flaky test: o.a.s.deploy.history.FsHistoryProviderSuite > -

[jira] [Updated] (SPARK-6154) Build error with Scala 2.11 for v1.3.0-rc2

[ https://issues.apache.org/jira/browse/SPARK-6154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-6154: --- Component/s: (was: SQL) Build > Build error with Scala 2.11 for v1.3.0-rc

[jira] [Commented] (SPARK-6154) Build error with Scala 2.11 for v1.3.0-rc2

[ https://issues.apache.org/jira/browse/SPARK-6154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14350915#comment-14350915 ] Patrick Wendell commented on SPARK-6154: Can you give the exact set of flags you a

[jira] [Commented] (SPARK-6154) Build error with Scala 2.11 for v1.3.0-rc2

[ https://issues.apache.org/jira/browse/SPARK-6154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14350975#comment-14350975 ] Patrick Wendell commented on SPARK-6154: Oh I remember now, we don't support this

[jira] [Updated] (SPARK-6128) Update Spark Streaming Guide for Spark 1.3

[ https://issues.apache.org/jira/browse/SPARK-6128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-6128: --- Priority: Critical (was: Blocker) > Update Spark Streaming Guide for Spark 1.3 >

[jira] [Updated] (SPARK-5183) Document data source API

[ https://issues.apache.org/jira/browse/SPARK-5183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-5183: --- Priority: Critical (was: Blocker) > Document data source API > > >

[jira] [Updated] (SPARK-5310) Update SQL programming guide for 1.3

[ https://issues.apache.org/jira/browse/SPARK-5310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-5310: --- Priority: Critical (was: Blocker) > Update SQL programming guide for 1.3 > --

[jira] [Updated] (SPARK-4123) Show new dependencies added in pull requests

[ https://issues.apache.org/jira/browse/SPARK-4123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-4123: --- Assignee: Brennon York > Show new dependencies added in pull requests > --

[jira] [Commented] (SPARK-4123) Show new dependencies added in pull requests

[ https://issues.apache.org/jira/browse/SPARK-4123?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14351932#comment-14351932 ] Patrick Wendell commented on SPARK-4123: Hey [~boyork] sorry for the delay. Are yo

[jira] [Updated] (SPARK-6208) executor-memory does not work when using local cluster

[ https://issues.apache.org/jira/browse/SPARK-6208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-6208: --- Issue Type: New Feature (was: Bug) > executor-memory does not work when using local cluster >

[jira] [Commented] (SPARK-6208) executor-memory does not work when using local cluster

[ https://issues.apache.org/jira/browse/SPARK-6208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14351951#comment-14351951 ] Patrick Wendell commented on SPARK-6208: I'm not sure we've ever tested much using

[jira] [Updated] (SPARK-6207) YARN secure cluster mode doesn't obtain a hive-metastore token

[ https://issues.apache.org/jira/browse/SPARK-6207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-6207: --- Component/s: SQL > YARN secure cluster mode doesn't obtain a hive-metastore token > -

[jira] [Updated] (SPARK-6189) Pandas to DataFrame conversion should check field names for periods

[ https://issues.apache.org/jira/browse/SPARK-6189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-6189: --- Component/s: DataFrame > Pandas to DataFrame conversion should check field names for periods >

[jira] [Commented] (SPARK-5134) Bump default Hadoop version to 2+

[ https://issues.apache.org/jira/browse/SPARK-5134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14352268#comment-14352268 ] Patrick Wendell commented on SPARK-5134: Hey [~rdub] [~srowen], As part of the 1.

[jira] [Comment Edited] (SPARK-5134) Bump default Hadoop version to 2+

[ https://issues.apache.org/jira/browse/SPARK-5134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14352268#comment-14352268 ] Patrick Wendell edited comment on SPARK-5134 at 3/8/15 11:27 PM: ---

[jira] [Commented] (SPARK-5134) Bump default Hadoop version to 2+

[ https://issues.apache.org/jira/browse/SPARK-5134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14352341#comment-14352341 ] Patrick Wendell commented on SPARK-5134: [~shivaram] did it end up working alright

[jira] [Commented] (SPARK-1239) Don't fetch all map output statuses at each reducer during shuffles

[ https://issues.apache.org/jira/browse/SPARK-1239?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14352356#comment-14352356 ] Patrick Wendell commented on SPARK-1239: It would be helpful if any users who have

[jira] [Updated] (SPARK-6050) Spark on YARN does not work --executor-cores is specified

[ https://issues.apache.org/jira/browse/SPARK-6050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-6050: --- Fix Version/s: (was: 1.4.0) > Spark on YARN does not work --executor-cores is specified >

[jira] [Resolved] (SPARK-4924) Factor out code to launch Spark applications into a separate library

[ https://issues.apache.org/jira/browse/SPARK-4924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-4924. Resolution: Fixed Fix Version/s: 1.4.0 Glad to finally have this in. Thanks for all t

[jira] [Commented] (SPARK-5654) Integrate SparkR into Apache Spark

[ https://issues.apache.org/jira/browse/SPARK-5654?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14359166#comment-14359166 ] Patrick Wendell commented on SPARK-5654: I see the decision here as somewhat ortho

[jira] [Resolved] (SPARK-6311) ChiSqTest should check for too few counts

[ https://issues.apache.org/jira/browse/SPARK-6311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-6311. Resolution: Duplicate > ChiSqTest should check for too few counts >

[jira] [Resolved] (SPARK-6310) ChiSqTest should check for too few counts

[ https://issues.apache.org/jira/browse/SPARK-6310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-6310. Resolution: Duplicate > ChiSqTest should check for too few counts >

[jira] [Updated] (SPARK-6313) Fetch File Lock file creation doesnt work when Spark working dir is on a NFS mount

[ https://issues.apache.org/jira/browse/SPARK-6313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-6313: --- Priority: Critical (was: Major) > Fetch File Lock file creation doesnt work when Spark workin

[jira] [Updated] (SPARK-4964) Exactly-once + WAL-free Kafka Support in Spark Streaming

[ https://issues.apache.org/jira/browse/SPARK-4964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-4964: --- Assignee: Cody Koeninger > Exactly-once + WAL-free Kafka Support in Spark Streaming >

[jira] [Updated] (SPARK-6313) Fetch File Lock file creation doesnt work when Spark working dir is on a NFS mount

[ https://issues.apache.org/jira/browse/SPARK-6313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-6313: --- Target Version/s: 1.3.1 > Fetch File Lock file creation doesnt work when Spark working dir is

[jira] [Commented] (SPARK-6313) Fetch File Lock file creation doesnt work when Spark working dir is on a NFS mount

[ https://issues.apache.org/jira/browse/SPARK-6313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14362687#comment-14362687 ] Patrick Wendell commented on SPARK-6313: [~joshrosen] changing default caching beh

[jira] [Commented] (SPARK-6307) Executers fetches the same rdd-block 100's or 1000's of times

[ https://issues.apache.org/jira/browse/SPARK-6307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14362689#comment-14362689 ] Patrick Wendell commented on SPARK-6307: Thanks for reporting this and attempting

[jira] [Commented] (SPARK-5310) Update SQL programming guide for 1.3

[ https://issues.apache.org/jira/browse/SPARK-5310?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14362757#comment-14362757 ] Patrick Wendell commented on SPARK-5310: [~lian cheng] and [~marmbrus] this result

[jira] [Updated] (SPARK-6362) Broken pipe error when training a RandomForest on a union of two RDDs

[ https://issues.apache.org/jira/browse/SPARK-6362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-6362: --- Component/s: PySpark > Broken pipe error when training a RandomForest on a union of two RDDs >

[jira] [Updated] (SPARK-6415) Spark Streaming fail-fast: Stop scheduling jobs when a batch fails, and kills the app

[ https://issues.apache.org/jira/browse/SPARK-6415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-6415: --- Component/s: Streaming > Spark Streaming fail-fast: Stop scheduling jobs when a batch fails, a

[jira] [Commented] (SPARK-6436) io/netty missing from external shuffle service jars for yarn

[ https://issues.apache.org/jira/browse/SPARK-6436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14371642#comment-14371642 ] Patrick Wendell commented on SPARK-6436: This might be related to SPARK-6070 by [~

[jira] [Updated] (SPARK-6414) Spark driver failed with NPE on job cancelation

[ https://issues.apache.org/jira/browse/SPARK-6414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-6414: --- Affects Version/s: 1.3.0 > Spark driver failed with NPE on job cancelation > -

[jira] [Updated] (SPARK-6414) Spark driver failed with NPE on job cancelation

[ https://issues.apache.org/jira/browse/SPARK-6414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-6414: --- Description: When a job group is cancelled, we scan through all jobs to determine which are m

[jira] [Updated] (SPARK-6414) Spark driver failed with NPE on job cancelation

[ https://issues.apache.org/jira/browse/SPARK-6414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-6414: --- Priority: Critical (was: Major) > Spark driver failed with NPE on job cancelation > -

[jira] [Resolved] (SPARK-6404) Call broadcast() in each interval for spark streaming programs.

[ https://issues.apache.org/jira/browse/SPARK-6404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-6404. Resolution: Invalid I'm closing the issue because broadcast variables are immutable, so you

[jira] [Updated] (SPARK-6403) Launch master as spot instance on EC2

[ https://issues.apache.org/jira/browse/SPARK-6403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-6403: --- Fix Version/s: (was: 1.2.1) > Launch master as spot instance on EC2 >

[jira] [Updated] (SPARK-6403) Launch master as spot instance on EC2

[ https://issues.apache.org/jira/browse/SPARK-6403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-6403: --- Target Version/s: (was: 1.2.1) > Launch master as spot instance on EC2 > ---

[jira] [Commented] (SPARK-6401) Unable to load a old API input format in Spark streaming

[ https://issues.apache.org/jira/browse/SPARK-6401?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14371699#comment-14371699 ] Patrick Wendell commented on SPARK-6401: If this is a matter of just adding a simp

[jira] [Commented] (SPARK-6335) REPL :reset command also removes refs to SparkContext and SQLContext

[ https://issues.apache.org/jira/browse/SPARK-6335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14371743#comment-14371743 ] Patrick Wendell commented on SPARK-6335: Yes - I agree with [~srowen] here. I don'

[jira] [Commented] (SPARK-5081) Shuffle write increases

[ https://issues.apache.org/jira/browse/SPARK-5081?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14372266#comment-14372266 ] Patrick Wendell commented on SPARK-5081: Hey @cbbetz - the last movement on this i

[jira] [Updated] (SPARK-4123) Show dependency changes in pull requests

[ https://issues.apache.org/jira/browse/SPARK-4123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-4123: --- Summary: Show dependency changes in pull requests (was: Show new dependencies added in pull r

[jira] [Updated] (SPARK-4925) Publish Spark SQL hive-thriftserver maven artifact

[ https://issues.apache.org/jira/browse/SPARK-4925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-4925: --- Affects Version/s: (was: 1.2.0) 1.3.0 1.2.1

[jira] [Updated] (SPARK-4925) Publish Spark SQL hive-thriftserver maven artifact

[ https://issues.apache.org/jira/browse/SPARK-4925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-4925: --- Fix Version/s: (was: 1.2.1) (was: 1.3.0) > Publish Spark SQL hive-t

[jira] [Updated] (SPARK-4925) Publish Spark SQL hive-thriftserver maven artifact

[ https://issues.apache.org/jira/browse/SPARK-4925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-4925: --- Priority: Critical (was: Major) > Publish Spark SQL hive-thriftserver maven artifact > -

[jira] [Reopened] (SPARK-4925) Publish Spark SQL hive-thriftserver maven artifact

[ https://issues.apache.org/jira/browse/SPARK-4925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell reopened SPARK-4925: Thanks for bringing this up. Actually - realized this wasn't fixed by some of the other work we

[jira] [Updated] (SPARK-4925) Publish Spark SQL hive-thriftserver maven artifact

[ https://issues.apache.org/jira/browse/SPARK-4925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-4925: --- Target Version/s: 1.3.1 > Publish Spark SQL hive-thriftserver maven artifact > --

[jira] [Updated] (SPARK-6449) Driver OOM results in reported application result SUCCESS

[ https://issues.apache.org/jira/browse/SPARK-6449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-6449: --- Component/s: (was: Spark Core) YARN > Driver OOM results in reported appl

[jira] [Updated] (SPARK-6456) Spark Sql throwing exception on large partitioned data

[ https://issues.apache.org/jira/browse/SPARK-6456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-6456: --- Component/s: (was: Spark Core) > Spark Sql throwing exception on large partitioned data >

[jira] [Commented] (SPARK-5863) Improve performance of convertToScala codepath.

[ https://issues.apache.org/jira/browse/SPARK-5863?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14375229#comment-14375229 ] Patrick Wendell commented on SPARK-5863: This seems worth potentially fixing in 1.

[jira] [Updated] (SPARK-5863) Improve performance of convertToScala codepath.

[ https://issues.apache.org/jira/browse/SPARK-5863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-5863: --- Target Version/s: 1.3.1, 1.4.0 (was: 1.4.0) > Improve performance of convertToScala codepath.

[jira] [Updated] (SPARK-6012) Deadlock when asking for partitions from CoalescedRDD on top of a TakeOrdered operator

[ https://issues.apache.org/jira/browse/SPARK-6012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-6012: --- Target Version/s: 1.3.1, 1.4.0 (was: 1.4.0) > Deadlock when asking for partitions from Coales

[jira] [Commented] (SPARK-5863) Improve performance of convertToScala codepath.

[ https://issues.apache.org/jira/browse/SPARK-5863?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14375230#comment-14375230 ] Patrick Wendell commented on SPARK-5863: Ah actually - I see [~marmbrus] was the o

[jira] [Updated] (SPARK-5863) Improve performance of convertToScala codepath.

[ https://issues.apache.org/jira/browse/SPARK-5863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-5863: --- Target Version/s: 1.4.0 (was: 1.3.1, 1.4.0) > Improve performance of convertToScala codepath.

[jira] [Updated] (SPARK-6012) Deadlock when asking for partitions from CoalescedRDD on top of a TakeOrdered operator

[ https://issues.apache.org/jira/browse/SPARK-6012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-6012: --- Target Version/s: 1.4.0 (was: 1.3.1, 1.4.0) > Deadlock when asking for partitions from Coales

[jira] [Resolved] (SPARK-2858) Default log4j configuration no longer seems to work

[ https://issues.apache.org/jira/browse/SPARK-2858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-2858. Resolution: Invalid This is really old and I don't think it still an issue. I'm just closing

[jira] [Updated] (SPARK-4227) Document external shuffle service

[ https://issues.apache.org/jira/browse/SPARK-4227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-4227: --- Target Version/s: 1.3.1, 1.4.0 (was: 1.3.0, 1.4.0) > Document external shuffle service >

[jira] [Updated] (SPARK-4227) Document external shuffle service

[ https://issues.apache.org/jira/browse/SPARK-4227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-4227: --- Priority: Critical (was: Major) > Document external shuffle service > ---

[jira] [Commented] (SPARK-2331) SparkContext.emptyRDD should return RDD[T] not EmptyRDD[T]

[ https://issues.apache.org/jira/browse/SPARK-2331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14376495#comment-14376495 ] Patrick Wendell commented on SPARK-2331: By the way - [~rxin] recently pointed out

[jira] [Reopened] (SPARK-6122) Upgrade Tachyon dependency to 0.6.0

[ https://issues.apache.org/jira/browse/SPARK-6122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell reopened SPARK-6122: I reverted this because it looks like it was responsible for some testing failures due to the d

[jira] [Created] (SPARK-6511) Publish "hadoop provided" build with instructions for different distros

Patrick Wendell created SPARK-6511: -- Summary: Publish "hadoop provided" build with instructions for different distros Key: SPARK-6511 URL: https://issues.apache.org/jira/browse/SPARK-6511 Project: Sp

[jira] [Updated] (SPARK-6504) Cannot read Parquet files generated from different versions at once

[ https://issues.apache.org/jira/browse/SPARK-6504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-6504: --- Component/s: SQL > Cannot read Parquet files generated from different versions at once > -

[jira] [Updated] (SPARK-6499) pyspark: printSchema command on a dataframe hangs

[ https://issues.apache.org/jira/browse/SPARK-6499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-6499: --- Component/s: PySpark > pyspark: printSchema command on a dataframe hangs > ---

[jira] [Updated] (SPARK-6520) Kyro serialization broken in the shell

[ https://issues.apache.org/jira/browse/SPARK-6520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-6520: --- Component/s: Spark Shell > Kyro serialization broken in the shell > --

[jira] [Commented] (SPARK-6481) Set "In Progress" when a PR is opened for an issue

[ https://issues.apache.org/jira/browse/SPARK-6481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14380432#comment-14380432 ] Patrick Wendell commented on SPARK-6481: Hey All, One issue here, (I think?) righ

[jira] [Resolved] (SPARK-6549) Spark console logger logs to stderr by default

[ https://issues.apache.org/jira/browse/SPARK-6549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-6549. Resolution: Won't Fix I think this is a wont fix due to compatibility issues. If I'm wrong p

[jira] [Resolved] (SPARK-6405) Spark Kryo buffer should be forced to be max. 2GB

[ https://issues.apache.org/jira/browse/SPARK-6405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-6405. Resolution: Fixed Assignee: Matthew Cheah > Spark Kryo buffer should be forced to be m

[jira] [Commented] (SPARK-6561) Add partition support in saveAsParquet

[ https://issues.apache.org/jira/browse/SPARK-6561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14383413#comment-14383413 ] Patrick Wendell commented on SPARK-6561: FYI - I just removed "Affects Version's"

[jira] [Updated] (SPARK-6561) Add partition support in saveAsParquet

[ https://issues.apache.org/jira/browse/SPARK-6561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-6561: --- Affects Version/s: (was: 1.3.1) (was: 1.3.0) > Add partition su

[jira] [Updated] (SPARK-6544) Problem with Avro and Kryo Serialization

[ https://issues.apache.org/jira/browse/SPARK-6544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-6544: --- Fix Version/s: 1.3.1 > Problem with Avro and Kryo Serialization >

[jira] [Commented] (SPARK-6544) Problem with Avro and Kryo Serialization

[ https://issues.apache.org/jira/browse/SPARK-6544?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14384459#comment-14384459 ] Patrick Wendell commented on SPARK-6544: Back-ported to 1.3.1 per discussion on is

[jira] [Resolved] (SPARK-5025) Write a guide for creating well-formed packages for Spark

[ https://issues.apache.org/jira/browse/SPARK-5025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-5025. Resolution: Won't Fix I'm closing this as wont fix. There are now a bunch of community packa

[jira] [Resolved] (SPARK-4073) Parquet+Snappy can cause significant off-heap memory usage

[ https://issues.apache.org/jira/browse/SPARK-4073?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-4073. Resolution: Won't Fix I have never seen someone else run into this, so closing as not urgent

[jira] [Resolved] (SPARK-1844) Support maven-style dependency resolution in sbt build

[ https://issues.apache.org/jira/browse/SPARK-1844?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1844. Resolution: Won't Fix Closing given the combination of (a) this is not that important and (b

[jira] [Updated] (SPARK-2709) Add a tool for certifying Spark API compatiblity

[ https://issues.apache.org/jira/browse/SPARK-2709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2709: --- Priority: Critical (was: Major) > Add a tool for certifying Spark API compatiblity >

[jira] [Reopened] (SPARK-2709) Add a tool for certifying Spark API compatiblity

[ https://issues.apache.org/jira/browse/SPARK-2709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell reopened SPARK-2709: This came up in some recent conversations. I actually don't think we ever merged this into Spar

[jira] [Updated] (SPARK-2709) Add a tool for certifying Spark API compatiblity

[ https://issues.apache.org/jira/browse/SPARK-2709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2709: --- Target Version/s: (was: 1.2.0) > Add a tool for certifying Spark API compatiblity >

[jira] [Created] (SPARK-6627) Clean up of shuffle code and interfaces

Patrick Wendell created SPARK-6627: -- Summary: Clean up of shuffle code and interfaces Key: SPARK-6627 URL: https://issues.apache.org/jira/browse/SPARK-6627 Project: Spark Issue Type: Improve

[jira] [Updated] (SPARK-6659) Spark SQL 1.3 cannot read json file that only with a record.

[ https://issues.apache.org/jira/browse/SPARK-6659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-6659: --- Component/s: SQL > Spark SQL 1.3 cannot read json file that only with a record. >

[jira] [Closed] (SPARK-6659) Spark SQL 1.3 cannot read json file that only with a record.

[ https://issues.apache.org/jira/browse/SPARK-6659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell closed SPARK-6659. -- Resolution: Invalid Per the comment, I think the issue is the JSON is not correctly formatted.

[jira] [Resolved] (SPARK-6627) Clean up of shuffle code and interfaces

[ https://issues.apache.org/jira/browse/SPARK-6627?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-6627. Resolution: Fixed Fix Version/s: 1.4.0 > Clean up of shuffle code and interfaces > --

[jira] [Created] (SPARK-6703) Provide a way to discover existing SparkContext's

Patrick Wendell created SPARK-6703: -- Summary: Provide a way to discover existing SparkContext's Key: SPARK-6703 URL: https://issues.apache.org/jira/browse/SPARK-6703 Project: Spark Issue Typ

[jira] [Commented] (SPARK-6676) Add hadoop 2.4+ for profiles in POM.xml

[ https://issues.apache.org/jira/browse/SPARK-6676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14395932#comment-14395932 ] Patrick Wendell commented on SPARK-6676: [~srowen] This is such a common source of

[jira] [Updated] (SPARK-6703) Provide a way to discover existing SparkContext's

[ https://issues.apache.org/jira/browse/SPARK-6703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-6703: --- Description: Right now it is difficult to write a Spark application in a way that can be run

[jira] [Updated] (SPARK-6222) [STREAMING] All data may not be recovered from WAL when driver is killed

[ https://issues.apache.org/jira/browse/SPARK-6222?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-6222: --- Fix Version/s: 1.4.0 1.3.1 > [STREAMING] All data may not be recovered from

[jira] [Updated] (SPARK-6765) Turn scalastyle on for test code

[ https://issues.apache.org/jira/browse/SPARK-6765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-6765: --- Component/s: Tests Project Infra > Turn scalastyle on for test code > ---

[jira] [Resolved] (SPARK-6792) pySpark groupByKey returns rows with the same key

[ https://issues.apache.org/jira/browse/SPARK-6792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-6792. Resolution: Not A Problem Resolving per Josh's comment. > pySpark groupByKey returns rows w

[jira] [Updated] (SPARK-6785) DateUtils can not handle date before 1970/01/01 correctly

[ https://issues.apache.org/jira/browse/SPARK-6785?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-6785: --- Component/s: SQL > DateUtils can not handle date before 1970/01/01 correctly > ---

[jira] [Resolved] (SPARK-6778) SQL contexts in spark-shell and pyspark should both be called sqlContext

[ https://issues.apache.org/jira/browse/SPARK-6778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-6778. Resolution: Duplicate > SQL contexts in spark-shell and pyspark should both be called sqlCon

[jira] [Commented] (SPARK-6399) Code compiled against 1.3.0 may not run against older Spark versions

[ https://issues.apache.org/jira/browse/SPARK-6399?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14486595#comment-14486595 ] Patrick Wendell commented on SPARK-6399: It would be good to document more clearly

[jira] [Updated] (SPARK-6784) Clean up all the inbound/outbound conversions for DateType

[ https://issues.apache.org/jira/browse/SPARK-6784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-6784: --- Component/s: SQL > Clean up all the inbound/outbound conversions for DateType > --

[jira] [Updated] (SPARK-6783) Add timing and test output for PR tests

[ https://issues.apache.org/jira/browse/SPARK-6783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-6783: --- Component/s: Project Infra > Add timing and test output for PR tests > ---

[jira] [Updated] (SPARK-6863) Formatted list broken on Hive compatibility section of SQL programming guide

[ https://issues.apache.org/jira/browse/SPARK-6863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-6863: --- Assignee: Santiago M. Mola > Formatted list broken on Hive compatibility section of SQL progra

[jira] [Updated] (SPARK-6611) Add support for INTEGER as synonym of INT to DDLParser

[ https://issues.apache.org/jira/browse/SPARK-6611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-6611: --- Assignee: Santiago M. Mola > Add support for INTEGER as synonym of INT to DDLParser >

[jira] [Updated] (SPARK-6858) Register Java HashMap for SparkSqlSerializer

[ https://issues.apache.org/jira/browse/SPARK-6858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-6858: --- Assignee: Liang-Chi Hsieh > Register Java HashMap for SparkSqlSerializer > ---

[jira] [Resolved] (SPARK-4760) "ANALYZE TABLE table COMPUTE STATISTICS noscan" failed estimating table size for tables created from Parquet files

[ https://issues.apache.org/jira/browse/SPARK-4760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-4760. Resolution: Not A Problem > "ANALYZE TABLE table COMPUTE STATISTICS noscan" failed estimatin

[jira] [Reopened] (SPARK-4760) "ANALYZE TABLE table COMPUTE STATISTICS noscan" failed estimating table size for tables created from Parquet files

[ https://issues.apache.org/jira/browse/SPARK-4760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell reopened SPARK-4760: > "ANALYZE TABLE table COMPUTE STATISTICS noscan" failed estimating table size > for tables cre

[jira] [Updated] (SPARK-6179) Support "SHOW PRINCIPALS role_name;"

[ https://issues.apache.org/jira/browse/SPARK-6179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-6179: --- Assignee: Zhongshuai Pei > Support "SHOW PRINCIPALS role_name;" >

<    3   4   5   6   7   8   9   10   11   >