[jira] [Resolved] (SPARK-6390) Add MatrixUDT in PySpark

[ https://issues.apache.org/jira/browse/SPARK-6390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-6390. --- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 6354

[jira] [Commented] (SPARK-8410) Hive VersionsSuite RuntimeException

[ https://issues.apache.org/jira/browse/SPARK-8410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14590270#comment-14590270 ] Sean Owen commented on SPARK-8410: -- Did you {{install}} the artifacts before this?

[jira] [Updated] (SPARK-8406) Race condition when writing Parquet files

[ https://issues.apache.org/jira/browse/SPARK-8406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-8406: Target Version/s: 1.4.1, 1.5.0 (was: 1.4.1) Race condition when writing Parquet files

[jira] [Commented] (SPARK-8406) Race condition when writing Parquet files

[ https://issues.apache.org/jira/browse/SPARK-8406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14590315#comment-14590315 ] Michael Armbrust commented on SPARK-8406: - It seems to me that ORC is not free of

[jira] [Commented] (SPARK-4123) Show dependency changes in pull requests

[ https://issues.apache.org/jira/browse/SPARK-4123?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14590389#comment-14590389 ] Josh Rosen commented on SPARK-4123: --- Hasn't this been re-enabled? Did we ever end up

[jira] [Updated] (SPARK-5787) Protect JVM from some not-important exceptions

[ https://issues.apache.org/jira/browse/SPARK-5787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-5787: --- Target Version/s: 1.5.0 (was: 1.4.0) Protect JVM from some not-important exceptions

[jira] [Updated] (SPARK-7448) Implement custom bye array serializer for use in PySpark shuffle

[ https://issues.apache.org/jira/browse/SPARK-7448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-7448: --- Target Version/s: 1.5.0 (was: 1.4.0) Implement custom bye array serializer for use in

[jira] [Updated] (SPARK-7078) Cache-aware binary processing in-memory sort

[ https://issues.apache.org/jira/browse/SPARK-7078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-7078: --- Target Version/s: 1.5.0 (was: 1.4.0) Cache-aware binary processing in-memory sort

[jira] [Updated] (SPARK-7041) Avoid writing empty files in BypassMergeSortShuffleWriter

[ https://issues.apache.org/jira/browse/SPARK-7041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-7041: --- Target Version/s: 1.5.0 (was: 1.4.0) Avoid writing empty files in

[jira] [Updated] (SPARK-8368) ClassNotFoundException in closure for map

[ https://issues.apache.org/jira/browse/SPARK-8368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-8368: Target Version/s: 1.4.1, 1.5.0 ClassNotFoundException in closure for map

[jira] [Commented] (SPARK-8356) Reconcile callUDF and callUdf

[ https://issues.apache.org/jira/browse/SPARK-8356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14590491#comment-14590491 ] Benjamin Fradet commented on SPARK-8356: Somewhat related, about being coherent,

[jira] [Resolved] (SPARK-7017) Refactor dev/run-tests into Python

[ https://issues.apache.org/jira/browse/SPARK-7017?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-7017. --- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 5694

[jira] [Updated] (SPARK-8406) Race condition when writing Parquet files

[ https://issues.apache.org/jira/browse/SPARK-8406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-8406: -- Description: To support appending, the Parquet data source tries to find out the max part number of

[jira] [Updated] (SPARK-8391) showDagViz throws OutOfMemoryError, cause the whole jobPage dies

[ https://issues.apache.org/jira/browse/SPARK-8391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-8391: - Affects Version/s: 1.4.0 showDagViz throws OutOfMemoryError, cause the whole jobPage dies

[jira] [Commented] (SPARK-6393) Extra RPC to the AM during killExecutor invocation

[ https://issues.apache.org/jira/browse/SPARK-6393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14590426#comment-14590426 ] Patrick Wendell commented on SPARK-6393: [~sandyryza] I'm un-targeting this. If

[jira] [Updated] (SPARK-6393) Extra RPC to the AM during killExecutor invocation

[ https://issues.apache.org/jira/browse/SPARK-6393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-6393: --- Target Version/s: (was: 1.4.0) Extra RPC to the AM during killExecutor invocation

[jira] [Commented] (SPARK-6783) Add timing and test output for PR tests

[ https://issues.apache.org/jira/browse/SPARK-6783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14590439#comment-14590439 ] Josh Rosen commented on SPARK-6783: --- Don't we already get this via the Jenkins JUnit XML

[jira] [Commented] (SPARK-7888) Be able to disable intercept in Linear Regression in ML package

[ https://issues.apache.org/jira/browse/SPARK-7888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14590201#comment-14590201 ] holdenk commented on SPARK-7888: So it seems like scikit learn takes the easy approach and

[jira] [Resolved] (SPARK-8411) No space left on device

[ https://issues.apache.org/jira/browse/SPARK-8411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-8411. -- Resolution: Invalid This isn't nearly enough information to help with the issue; I also think you'll

[jira] [Commented] (SPARK-3854) Scala style: require spaces before `{`

[ https://issues.apache.org/jira/browse/SPARK-3854?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14590394#comment-14590394 ] Josh Rosen commented on SPARK-3854: --- Does anyone know whether we're now enforcing this?

[jira] [Updated] (SPARK-8390) Update DirectKafkaWordCount examples to show how offset ranges can be used

[ https://issues.apache.org/jira/browse/SPARK-8390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-8390: --- Issue Type: Improvement (was: Bug) Update DirectKafkaWordCount examples to show how offset

[jira] [Updated] (SPARK-8389) Expose KafkaRDDs offsetRange in Java and Python

[ https://issues.apache.org/jira/browse/SPARK-8389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-8389: --- Issue Type: New Feature (was: Bug) Expose KafkaRDDs offsetRange in Java and Python

[jira] [Updated] (SPARK-7689) Deprecate spark.cleaner.ttl

[ https://issues.apache.org/jira/browse/SPARK-7689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-7689: --- Target Version/s: 1.4.1 (was: 1.4.0) Deprecate spark.cleaner.ttl

[jira] [Commented] (SPARK-7521) Allow all required release credentials to be specified with env vars

[ https://issues.apache.org/jira/browse/SPARK-7521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14590451#comment-14590451 ] Patrick Wendell commented on SPARK-7521: Sort of - I still need to actually

[jira] [Commented] (SPARK-5178) Integrate Python unit tests into Jenkins

[ https://issues.apache.org/jira/browse/SPARK-5178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14590452#comment-14590452 ] Josh Rosen commented on SPARK-5178: --- This is a duplicate of SPARK-7021. Integrate

[jira] [Resolved] (SPARK-5178) Integrate Python unit tests into Jenkins

[ https://issues.apache.org/jira/browse/SPARK-5178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-5178. --- Resolution: Duplicate Integrate Python unit tests into Jenkins

[jira] [Resolved] (SPARK-8077) Optimisation of TreeNode for large number of children

[ https://issues.apache.org/jira/browse/SPARK-8077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-8077. - Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 6673

[jira] [Commented] (SPARK-6557) Only set bold text on PR github test output for problems

[ https://issues.apache.org/jira/browse/SPARK-6557?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14590457#comment-14590457 ] Josh Rosen commented on SPARK-6557: --- We could also use GitHub Emoji or colored text to

[jira] [Commented] (SPARK-3244) Add fate sharing across related files in Jenkins

[ https://issues.apache.org/jira/browse/SPARK-3244?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14590462#comment-14590462 ] Josh Rosen commented on SPARK-3244: --- Now that dev/run-tests and the associated scripts

[jira] [Commented] (SPARK-595) Document local-cluster mode

[ https://issues.apache.org/jira/browse/SPARK-595?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14590486#comment-14590486 ] Justin Uang commented on SPARK-595: --- +1 We are using for internal testing to ensure that

[jira] [Commented] (SPARK-8356) Reconcile callUDF and callUdf

[ https://issues.apache.org/jira/browse/SPARK-8356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14590483#comment-14590483 ] Michael Armbrust commented on SPARK-8356: - Hmm, maybe not. [~rxin] any idea why

[jira] [Updated] (SPARK-7546) Example code for ML Pipelines feature transformations

[ https://issues.apache.org/jira/browse/SPARK-7546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ram Sriharsha updated SPARK-7546: - Target Version/s: 1.5.0 (was: 1.4.0) Example code for ML Pipelines feature transformations

[jira] [Updated] (SPARK-8392) RDDOperationGraph: getting cached nodes is slow

[ https://issues.apache.org/jira/browse/SPARK-8392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-8392: - Assignee: meiyoula RDDOperationGraph: getting cached nodes is slow

[jira] [Resolved] (SPARK-8412) java#KafkaUtils.createDirectStream Java(Pair)RDDs do not implement HasOffsetRanges

[ https://issues.apache.org/jira/browse/SPARK-8412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-8412. -- Resolution: Not A Problem The JavaPairRDD doesn't implementing it, but the underlying RDD ({{.rdd()}})

[jira] [Updated] (SPARK-8371) improve unit test for MaxOf and MinOf

[ https://issues.apache.org/jira/browse/SPARK-8371?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-8371: Target Version/s: 1.5.0 Shepherd: Davies Liu Assignee: Wenchen Fan

[jira] [Updated] (SPARK-8397) Allow custom configuration for TestHive

[ https://issues.apache.org/jira/browse/SPARK-8397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-8397: --- Component/s: SQL Allow custom configuration for TestHive

[jira] [Updated] (SPARK-8388) The script docs/_plugins/copy_api_dirs.rb should be run anywhere

[ https://issues.apache.org/jira/browse/SPARK-8388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-8388: --- Target Version/s: (was: 1.4.0) The script docs/_plugins/copy_api_dirs.rb should be run

[jira] [Updated] (SPARK-8406) Race condition when writing Parquet files

[ https://issues.apache.org/jira/browse/SPARK-8406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-8406: -- Description: To support appending, the Parquet data source tries to find out the max part number of

[jira] [Created] (SPARK-8414) Ensure ClosureCleaner actually triggers clean ups

Andrew Or created SPARK-8414: Summary: Ensure ClosureCleaner actually triggers clean ups Key: SPARK-8414 URL: https://issues.apache.org/jira/browse/SPARK-8414 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-7888) Be able to disable intercept in Linear Regression in ML package

[ https://issues.apache.org/jira/browse/SPARK-7888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14590380#comment-14590380 ] DB Tsai commented on SPARK-7888: Last night, I figured out how to do this. If you look at

[jira] [Updated] (SPARK-6923) Spark SQL CLI does not read Data Source schema correctly

[ https://issues.apache.org/jira/browse/SPARK-6923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-6923: Assignee: Cheng Hao Spark SQL CLI does not read Data Source schema correctly

[jira] [Updated] (SPARK-6923) Spark SQL CLI does not read Data Source schema correctly

[ https://issues.apache.org/jira/browse/SPARK-6923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-6923: Shepherd: Cheng Lian Spark SQL CLI does not read Data Source schema correctly

[jira] [Updated] (SPARK-8325) Ability to provide role based row level authorization through Spark SQL

[ https://issues.apache.org/jira/browse/SPARK-8325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-8325: --- Target Version/s: (was: 1.4.0) Ability to provide role based row level authorization

[jira] [Updated] (SPARK-8388) The script docs/_plugins/copy_api_dirs.rb should be run anywhere

[ https://issues.apache.org/jira/browse/SPARK-8388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-8388: --- Fix Version/s: (was: 1.4.1) The script docs/_plugins/copy_api_dirs.rb should be run

[jira] [Commented] (SPARK-8388) The script docs/_plugins/copy_api_dirs.rb should be run anywhere

[ https://issues.apache.org/jira/browse/SPARK-8388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14590408#comment-14590408 ] Patrick Wendell commented on SPARK-8388: Hi [~kaixin9ok] - please don't set fix

[jira] [Updated] (SPARK-8325) Ability to provide role based row level authorization through Spark SQL

[ https://issues.apache.org/jira/browse/SPARK-8325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-8325: --- Fix Version/s: (was: 1.4.1) Ability to provide role based row level authorization

[jira] [Updated] (SPARK-8324) Register Query as view through JDBC interface

[ https://issues.apache.org/jira/browse/SPARK-8324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-8324: --- Target Version/s: (was: 1.4.0) Register Query as view through JDBC interface

[jira] [Updated] (SPARK-8324) Register Query as view through JDBC interface

[ https://issues.apache.org/jira/browse/SPARK-8324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-8324: --- Fix Version/s: (was: 1.4.1) Register Query as view through JDBC interface

[jira] [Updated] (SPARK-7025) Create a Java-friendly input source API

[ https://issues.apache.org/jira/browse/SPARK-7025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-7025: --- Target Version/s: 1.5.0 (was: 1.4.0) Create a Java-friendly input source API

[jira] [Commented] (SPARK-7521) Allow all required release credentials to be specified with env vars

[ https://issues.apache.org/jira/browse/SPARK-7521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14590444#comment-14590444 ] Josh Rosen commented on SPARK-7521: --- Has this been done now that we're publishing

[jira] [Commented] (SPARK-8406) Race condition when writing Parquet files

[ https://issues.apache.org/jira/browse/SPARK-8406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14590494#comment-14590494 ] Cheng Lian commented on SPARK-8406: --- Yeah, just updated the JIRA description. ORC may

[jira] [Updated] (SPARK-8406) Race condition when writing Parquet files

[ https://issues.apache.org/jira/browse/SPARK-8406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-8406: -- Description: To support appending, the Parquet data source tries to find out the max part number of

[jira] [Commented] (SPARK-8365) pyspark does not retain --packages or --jars passed on the command line as of 1.4.0

[ https://issues.apache.org/jira/browse/SPARK-8365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14590290#comment-14590290 ] Don Drake commented on SPARK-8365: -- Is there a workaround that you are aware of?

[jira] [Updated] (SPARK-6208) executor-memory does not work when using local cluster

[ https://issues.apache.org/jira/browse/SPARK-6208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-6208: --- Target Version/s: (was: 1.4.0) executor-memory does not work when using local cluster

[jira] [Updated] (SPARK-7019) Build docs on doc changes

[ https://issues.apache.org/jira/browse/SPARK-7019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-7019: --- Target Version/s: 1.5.0 (was: 1.4.0) Build docs on doc changes -

[jira] [Updated] (SPARK-7018) Refactor dev/run-tests-jenkins into Python

[ https://issues.apache.org/jira/browse/SPARK-7018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-7018: --- Target Version/s: 1.5.0 (was: 1.4.0) Refactor dev/run-tests-jenkins into Python

[jira] [Resolved] (SPARK-7560) Make flaky tests easier to debug

[ https://issues.apache.org/jira/browse/SPARK-7560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-7560. --- Resolution: Fixed Make flaky tests easier to debug

[jira] [Commented] (SPARK-6557) Only set bold text on PR github test output for problems

[ https://issues.apache.org/jira/browse/SPARK-6557?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14590454#comment-14590454 ] Josh Rosen commented on SPARK-6557: --- I'm going to mark this as being blocked by the

[jira] [Commented] (SPARK-7889) Jobs progress of apps on complete page of HistoryServer shows uncompleted

[ https://issues.apache.org/jira/browse/SPARK-7889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14590215#comment-14590215 ] Steve Loughran commented on SPARK-7889: --- Is JIRA about (a) the status on the

[jira] [Updated] (SPARK-8406) Race condition when writing Parquet files

[ https://issues.apache.org/jira/browse/SPARK-8406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-8406: -- Description: To support appending, the Parquet data source tries to find out the max part number of

[jira] [Updated] (SPARK-4605) Proposed Contribution: Spark Kernel to enable interactive Spark applications

[ https://issues.apache.org/jira/browse/SPARK-4605?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-4605: -- Component/s: (was: Project Infra) Proposed Contribution: Spark Kernel to enable interactive Spark

[jira] [Created] (SPARK-8415) Jenkins compilation spends lots of time re-resolving dependencies and waiting to acquire Ivy cache lock

Josh Rosen created SPARK-8415: - Summary: Jenkins compilation spends lots of time re-resolving dependencies and waiting to acquire Ivy cache lock Key: SPARK-8415 URL: https://issues.apache.org/jira/browse/SPARK-8415

[jira] [Commented] (SPARK-5178) Integrate Python unit tests into Jenkins

[ https://issues.apache.org/jira/browse/SPARK-5178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14590442#comment-14590442 ] Josh Rosen commented on SPARK-5178: --- This is made slightly more complicated by the fact

[jira] [Commented] (SPARK-8356) Reconcile callUDF and callUdf

[ https://issues.apache.org/jira/browse/SPARK-8356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14590513#comment-14590513 ] Benjamin Fradet commented on SPARK-8356: Ok, I'll make sure Udf disappear, should

[jira] [Commented] (SPARK-8356) Reconcile callUDF and callUdf

[ https://issues.apache.org/jira/browse/SPARK-8356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14590505#comment-14590505 ] Michael Armbrust commented on SPARK-8356: - Sure, (and the convention in spark

[jira] [Updated] (SPARK-7160) Support converting DataFrames to typed RDDs.

[ https://issues.apache.org/jira/browse/SPARK-7160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-7160: Assignee: Ray Ortigas Support converting DataFrames to typed RDDs.

[jira] [Updated] (SPARK-7160) Support converting DataFrames to typed RDDs.

[ https://issues.apache.org/jira/browse/SPARK-7160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-7160: Priority: Critical (was: Major) Target Version/s: 1.5.0 Shepherd:

[jira] [Commented] (SPARK-3854) Scala style: require spaces before `{`

[ https://issues.apache.org/jira/browse/SPARK-3854?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14590596#comment-14590596 ] Reynold Xin commented on SPARK-3854: I don't think we have this yet. Scala style:

[jira] [Updated] (SPARK-8144) For PySpark SQL, automatically convert values provided in readwriter options to string

[ https://issues.apache.org/jira/browse/SPARK-8144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-8144: Summary: For PySpark SQL, automatically convert values provided in readwriter options to string (was:

[jira] [Updated] (SPARK-7626) Actions on DataFrame created from HIVE table with newly added column throw NPE

[ https://issues.apache.org/jira/browse/SPARK-7626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-7626: Description: We recently added a new column page_context to a hive table named clicks,

[jira] [Updated] (SPARK-7626) Actions on DataFrame created from HIVE table with newly added column throw NPE

[ https://issues.apache.org/jira/browse/SPARK-7626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-7626: Component/s: (was: Spark Core) SQL Actions on DataFrame created from

[jira] [Resolved] (SPARK-7067) Can't resolve nested column in ORDER BY

[ https://issues.apache.org/jira/browse/SPARK-7067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-7067. - Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 5659

[jira] [Updated] (SPARK-7026) LeftSemiJoin can not work when it has both equal condition and not equal condition.

[ https://issues.apache.org/jira/browse/SPARK-7026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-7026: Target Version/s: 1.5.0 LeftSemiJoin can not work when it has both equal condition and

[jira] [Commented] (SPARK-8390) Update DirectKafkaWordCount examples to show how offset ranges can be used

[ https://issues.apache.org/jira/browse/SPARK-8390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14590720#comment-14590720 ] Cody Koeninger commented on SPARK-8390: --- Did we actually want to update the

[jira] [Updated] (SPARK-8368) ClassNotFoundException in closure for map

[ https://issues.apache.org/jira/browse/SPARK-8368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-8368: Priority: Blocker (was: Major) ClassNotFoundException in closure for map

[jira] [Commented] (SPARK-8368) ClassNotFoundException in closure for map

[ https://issues.apache.org/jira/browse/SPARK-8368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14590731#comment-14590731 ] Yin Huai commented on SPARK-8368: - Right now, looks like it is a problem caused by spark

[jira] [Resolved] (SPARK-8397) Allow custom configuration for TestHive

[ https://issues.apache.org/jira/browse/SPARK-8397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-8397. - Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 6844

[jira] [Updated] (SPARK-8332) NoSuchMethodError: com.fasterxml.jackson.module.scala.deser.BigDecimalDeserializer

[ https://issues.apache.org/jira/browse/SPARK-8332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Olivier Girardot updated SPARK-8332: Description: I complied new spark 1.4.0 version. But when I run a simple WordCount demo,

[jira] [Updated] (SPARK-5971) Add Mesos support to spark-ec2

[ https://issues.apache.org/jira/browse/SPARK-5971?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-5971: - Target Version/s: 1.5.0 (was: 1.4.0) Add Mesos support to spark-ec2

[jira] [Commented] (SPARK-6218) Upgrade spark-ec2 from optparse to argparse

[ https://issues.apache.org/jira/browse/SPARK-6218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14590791#comment-14590791 ] Shivaram Venkataraman commented on SPARK-6218: -- [~nchammas] I just updated

[jira] [Commented] (SPARK-5971) Add Mesos support to spark-ec2

[ https://issues.apache.org/jira/browse/SPARK-5971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14590799#comment-14590799 ] Shivaram Venkataraman commented on SPARK-5971: -- Moving this to target 1.5.0

[jira] [Commented] (SPARK-7814) Turn code generation on by default

[ https://issues.apache.org/jira/browse/SPARK-7814?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14590885#comment-14590885 ] Herman van Hovell tot Westerflier commented on SPARK-7814: -- I

[jira] [Created] (SPARK-8417) spark-class has illegal statement

jweinste created SPARK-8417: --- Summary: spark-class has illegal statement Key: SPARK-8417 URL: https://issues.apache.org/jira/browse/SPARK-8417 Project: Spark Issue Type: Bug Components:

[jira] [Reopened] (SPARK-8412) java#KafkaUtils.createDirectStream Java(Pair)RDDs do not implement HasOffsetRanges

[ https://issues.apache.org/jira/browse/SPARK-8412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jweinste reopened SPARK-8412: - This is improperly implemented or improperly documented. Either way something needs to be corrected.

[jira] [Commented] (SPARK-7017) Refactor dev/run-tests into Python

[ https://issues.apache.org/jira/browse/SPARK-7017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14590826#comment-14590826 ] Apache Spark commented on SPARK-7017: - User 'brennonyork' has created a pull request

[jira] [Commented] (SPARK-8348) Add in operator to DataFrame Column

[ https://issues.apache.org/jira/browse/SPARK-8348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14590880#comment-14590880 ] Yu Ishikawa commented on SPARK-8348: Hi [~shivaram], Thank you for letting me know

[jira] [Assigned] (SPARK-8406) Race condition when writing Parquet files

[ https://issues.apache.org/jira/browse/SPARK-8406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8406: --- Assignee: Apache Spark (was: Cheng Lian) Race condition when writing Parquet files

[jira] [Commented] (SPARK-8406) Race condition when writing Parquet files

[ https://issues.apache.org/jira/browse/SPARK-8406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14590770#comment-14590770 ] Apache Spark commented on SPARK-8406: - User 'liancheng' has created a pull request for

[jira] [Assigned] (SPARK-8406) Race condition when writing Parquet files

[ https://issues.apache.org/jira/browse/SPARK-8406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8406: --- Assignee: Cheng Lian (was: Apache Spark) Race condition when writing Parquet files

[jira] [Updated] (SPARK-6218) Upgrade spark-ec2 from optparse to argparse

[ https://issues.apache.org/jira/browse/SPARK-6218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-6218: - Target Version/s: 1.5.0 (was: 1.4.0) Upgrade spark-ec2 from optparse to

[jira] [Commented] (SPARK-6813) SparkR style guide

[ https://issues.apache.org/jira/browse/SPARK-6813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14590862#comment-14590862 ] Yu Ishikawa commented on SPARK-6813: Before discussing the details of coding style,

[jira] [Created] (SPARK-8418) Add single- and multi-value support to ML Transformers

Joseph K. Bradley created SPARK-8418: Summary: Add single- and multi-value support to ML Transformers Key: SPARK-8418 URL: https://issues.apache.org/jira/browse/SPARK-8418 Project: Spark

[jira] [Created] (SPARK-8419) Statistics.colStats could avoid an extra count()

Joseph K. Bradley created SPARK-8419: Summary: Statistics.colStats could avoid an extra count() Key: SPARK-8419 URL: https://issues.apache.org/jira/browse/SPARK-8419 Project: Spark Issue

[jira] [Updated] (SPARK-7814) Turn code generation on by default

[ https://issues.apache.org/jira/browse/SPARK-7814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-7814: --- Description: Turn code gen on, find a lot of bugs, and see what happens. Turn code generation on by

[jira] [Commented] (SPARK-8335) DecisionTreeModel.predict() return type not convenient!

[ https://issues.apache.org/jira/browse/SPARK-8335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14590922#comment-14590922 ] Joseph K. Bradley commented on SPARK-8335: -- I've discussed this with [~mengxr]

[jira] [Resolved] (SPARK-8010) Implict promote Numeric type to String type in HiveTypeCoercion

[ https://issues.apache.org/jira/browse/SPARK-8010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-8010. - Resolution: Fixed Fix Version/s: (was: 1.3.1) 1.5.0 Issue

[jira] [Closed] (SPARK-8372) History server shows incorrect information for application not started

[ https://issues.apache.org/jira/browse/SPARK-8372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-8372. Resolution: Fixed Fix Version/s: 1.5.0 1.4.1 Assignee: Carson

[jira] [Closed] (SPARK-8373) When an RDD has no partition, Python sum will throw Can not reduce() empty RDD

[ https://issues.apache.org/jira/browse/SPARK-8373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-8373. Resolution: Fixed Fix Version/s: 1.5.0 1.4.1 Assignee:

[jira] [Updated] (SPARK-8373) When an RDD has no partition, Python sum will throw Can not reduce() empty RDD

[ https://issues.apache.org/jira/browse/SPARK-8373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-8373: - Affects Version/s: (was: 1.4.0) 1.2.0 When an RDD has no partition, Python

[jira] [Updated] (SPARK-8373) When an RDD has no partition, Python sum will throw Can not reduce() empty RDD

[ https://issues.apache.org/jira/browse/SPARK-8373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-8373: - Affects Version/s: 1.4.0 When an RDD has no partition, Python sum will throw Can not reduce() empty

  1   2   3   4   >