[jira] [Resolved] (SPARK-22596) set ctx.currentVars in CodegenSupport.consume

[ https://issues.apache.org/jira/browse/SPARK-22596?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-22596. - Resolution: Fixed Fix Version/s: 2.3.0 > set ctx.currentVars in CodegenSupport.consume > -

[jira] [Resolved] (SPARK-22604) remove the get address methods from ColumnVector

[ https://issues.apache.org/jira/browse/SPARK-22604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-22604. - Resolution: Fixed Fix Version/s: 2.3.0 > remove the get address methods from ColumnVector > --

[jira] [Commented] (SPARK-7721) Generate test coverage report from Python

[ https://issues.apache.org/jira/browse/SPARK-7721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16265588#comment-16265588 ] Hyukjin Kwon commented on SPARK-7721: - Hey [~rxin] and [~joshrosen], I just did a simp

[jira] [Updated] (SPARK-22402) Allow fetcher URIs to be downloaded to specific locations relative to Mesos Sandbox

[ https://issues.apache.org/jira/browse/SPARK-22402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22402: - Affects Version/s: (was: 2.2.2) 2.2.0 > Allow fetcher URIs to be downl

[jira] [Commented] (SPARK-22402) Allow fetcher URIs to be downloaded to specific locations relative to Mesos Sandbox

[ https://issues.apache.org/jira/browse/SPARK-22402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16265584#comment-16265584 ] Felix Cheung commented on SPARK-22402: -- Any update on this one? > Allow fetcher UR

[jira] [Created] (SPARK-22605) OutputMetrics empty for DataFrame writes

Jason White created SPARK-22605: --- Summary: OutputMetrics empty for DataFrame writes Key: SPARK-22605 URL: https://issues.apache.org/jira/browse/SPARK-22605 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-14651) CREATE TEMPORARY TABLE is not supported yet

[ https://issues.apache.org/jira/browse/SPARK-14651?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16265545#comment-16265545 ] Ameen Tayyebi commented on SPARK-14651: --- This blocks some of our production use cas

[jira] [Commented] (SPARK-22393) spark-shell can't find imported types in class constructors, extends clause

[ https://issues.apache.org/jira/browse/SPARK-22393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16265543#comment-16265543 ] Ryan Williams commented on SPARK-22393: --- Just confirming: it's expected that the Sc

[jira] [Updated] (SPARK-22495) Fix setup of SPARK_HOME variable on Windows

[ https://issues.apache.org/jira/browse/SPARK-22495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22495: - Fix Version/s: 2.2.1 > Fix setup of SPARK_HOME variable on Windows >

[jira] [Updated] (SPARK-22595) flaky test: CastSuite.SPARK-22500: cast for struct should not generate codes beyond 64KB

[ https://issues.apache.org/jira/browse/SPARK-22595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22595: - Target Version/s: 2.2.1, 2.3.0 (was: 2.3.0, 2.2.2) > flaky test: CastSuite.SPARK-22500: cast for

[jira] [Updated] (SPARK-22591) GenerateOrdering shouldn't change ctx.INPUT_ROW

[ https://issues.apache.org/jira/browse/SPARK-22591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22591: - Target Version/s: 2.2.1, 2.3.0 (was: 2.3.0, 2.2.2) > GenerateOrdering shouldn't change ctx.INPUT

[jira] [Updated] (SPARK-22548) Incorrect nested AND expression pushed down to JDBC data source

[ https://issues.apache.org/jira/browse/SPARK-22548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22548: - Target Version/s: 2.2.1, 2.3.0 (was: 2.3.0, 2.2.2) > Incorrect nested AND expression pushed down

[jira] [Updated] (SPARK-17920) HiveWriterContainer passes null configuration to serde.initialize, causing NullPointerException in AvroSerde when using avro.schema.url

[ https://issues.apache.org/jira/browse/SPARK-17920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-17920: - Target Version/s: 2.2.1, 2.3.0 (was: 2.3.0, 2.2.2) > HiveWriterContainer passes null configurati

[jira] [Updated] (SPARK-22500) 64KB JVM bytecode limit problem with cast

[ https://issues.apache.org/jira/browse/SPARK-22500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22500: - Target Version/s: 2.2.1, 2.3.0 (was: 2.2.0, 2.3.0) > 64KB JVM bytecode limit problem with cast >

[jira] [Updated] (SPARK-22549) 64KB JVM bytecode limit problem with concat_ws

[ https://issues.apache.org/jira/browse/SPARK-22549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22549: - Target Version/s: 2.2.1, 2.3.0 (was: 2.3.0, 2.2.2) > 64KB JVM bytecode limit problem with concat

[jira] [Updated] (SPARK-22550) 64KB JVM bytecode limit problem with elt

[ https://issues.apache.org/jira/browse/SPARK-22550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22550: - Target Version/s: 2.2.1, 2.3.0 > 64KB JVM bytecode limit problem with elt > -

[jira] [Updated] (SPARK-22508) 64KB JVM bytecode limit problem with GenerateUnsafeRowJoiner.create()

[ https://issues.apache.org/jira/browse/SPARK-22508?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22508: - Target Version/s: 2.2.1, 2.3.0 (was: 2.3.0, 2.2.2) > 64KB JVM bytecode limit problem with Genera

[jira] [Updated] (SPARK-22544) FileStreamSource should use its own hadoop conf to call globPathIfNecessary

[ https://issues.apache.org/jira/browse/SPARK-22544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22544: - Target Version/s: 2.2.1, 2.3.0 (was: 2.3.0, 2.2.2) Fix Version/s: (was: 2.2.2)

[jira] [Updated] (SPARK-22538) SQLTransformer.transform(inputDataFrame) uncaches inputDataFrame

[ https://issues.apache.org/jira/browse/SPARK-22538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22538: - Target Version/s: 2.2.1, 2.3.0 (was: 2.3.0, 2.2.2) > SQLTransformer.transform(inputDataFrame) un

[jira] [Updated] (SPARK-22498) 64KB JVM bytecode limit problem with concat

[ https://issues.apache.org/jira/browse/SPARK-22498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22498: - Target Version/s: 2.2.1, 2.3.0 (was: 2.3.0, 2.2.2) > 64KB JVM bytecode limit problem with concat

[jira] [Updated] (SPARK-22535) PythonRunner.MonitorThread should give the task a little time to finish before killing the python worker

[ https://issues.apache.org/jira/browse/SPARK-22535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22535: - Target Version/s: 2.2.1 (was: 2.2.2) Fix Version/s: (was: 2.2.2)

[jira] [Updated] (SPARK-22501) 64KB JVM bytecode limit problem with in

[ https://issues.apache.org/jira/browse/SPARK-22501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22501: - Target Version/s: 2.2.1, 2.3.0 (was: 2.3.0, 2.2.2) > 64KB JVM bytecode limit problem with in > -

[jira] [Updated] (SPARK-22499) 64KB JVM bytecode limit problem with least and greatest

[ https://issues.apache.org/jira/browse/SPARK-22499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22499: - Target Version/s: 2.2.1, 2.3.0 (was: 2.3.0, 2.2.2) > 64KB JVM bytecode limit problem with least

[jira] [Updated] (SPARK-22494) Coalesce and AtLeastNNonNulls can cause 64KB JVM bytecode limit exception

[ https://issues.apache.org/jira/browse/SPARK-22494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22494: - Target Version/s: 2.2.1 (was: 2.2.2) > Coalesce and AtLeastNNonNulls can cause 64KB JVM bytecode

[jira] [Updated] (SPARK-22540) HighlyCompressedMapStatus's avgSize is incorrect

[ https://issues.apache.org/jira/browse/SPARK-22540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22540: - Target Version/s: 2.2.1, 2.3.0 (was: 2.3.0, 2.2.2) Fix Version/s: (was: 2.2.2)

[jira] [Updated] (SPARK-22479) SaveIntoDataSourceCommand logs jdbc credentials

[ https://issues.apache.org/jira/browse/SPARK-22479?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22479: - Target Version/s: 2.2.1, 2.3.0 (was: 2.3.0, 2.2.2) Fix Version/s: (was: 2.2.2)

[jira] [Updated] (SPARK-22469) Accuracy problem in comparison with string and numeric

[ https://issues.apache.org/jira/browse/SPARK-22469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22469: - Target Version/s: 2.2.1, 2.3.0 (was: 2.3.0, 2.2.2) Fix Version/s: (was: 2.2.2)

[jira] [Updated] (SPARK-22471) SQLListener consumes much memory causing OutOfMemoryError

[ https://issues.apache.org/jira/browse/SPARK-22471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22471: - Target Version/s: 2.2.1 (was: 2.2.2) Fix Version/s: (was: 2.2.2)

[jira] [Updated] (SPARK-22490) PySpark doc has misleading string for SparkSession.builder

[ https://issues.apache.org/jira/browse/SPARK-22490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22490: - Target Version/s: 2.2.1, 2.3.0 (was: 2.3.0, 2.2.2) Fix Version/s: (was: 2.2.2)

[jira] [Updated] (SPARK-22377) Maven nightly snapshot jenkins jobs are broken on multiple workers due to lsof

[ https://issues.apache.org/jira/browse/SPARK-22377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22377: - Target Version/s: 2.2.1 (was: 2.2.2) Fix Version/s: (was: 2.2.2)

[jira] [Updated] (SPARK-22511) Update maven central repo address

[ https://issues.apache.org/jira/browse/SPARK-22511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22511: - Affects Version/s: (was: 2.2.2) Target Version/s: 2.2.1, 2.3.0 (was: 2.3.0, 2.2.2)

[jira] [Updated] (SPARK-22377) Maven nightly snapshot jenkins jobs are broken on multiple workers due to lsof

[ https://issues.apache.org/jira/browse/SPARK-22377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22377: - Fix Version/s: 2.2.2 > Maven nightly snapshot jenkins jobs are broken on multiple workers due to

[jira] [Updated] (SPARK-22540) HighlyCompressedMapStatus's avgSize is incorrect

[ https://issues.apache.org/jira/browse/SPARK-22540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22540: - Target Version/s: 2.3.0, 2.2.2 > HighlyCompressedMapStatus's avgSize is incorrect > -

[jira] [Updated] (SPARK-22501) 64KB JVM bytecode limit problem with in

[ https://issues.apache.org/jira/browse/SPARK-22501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22501: - Target Version/s: 2.3.0, 2.2.2 > 64KB JVM bytecode limit problem with in > --

[jira] [Updated] (SPARK-22498) 64KB JVM bytecode limit problem with concat

[ https://issues.apache.org/jira/browse/SPARK-22498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22498: - Target Version/s: 2.3.0, 2.2.2 > 64KB JVM bytecode limit problem with concat > --

[jira] [Updated] (SPARK-22538) SQLTransformer.transform(inputDataFrame) uncaches inputDataFrame

[ https://issues.apache.org/jira/browse/SPARK-22538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22538: - Target Version/s: 2.3.0, 2.2.2 > SQLTransformer.transform(inputDataFrame) uncaches inputDataFrame

[jira] [Updated] (SPARK-22544) FileStreamSource should use its own hadoop conf to call globPathIfNecessary

[ https://issues.apache.org/jira/browse/SPARK-22544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22544: - Target Version/s: 2.3.0, 2.2.2 > FileStreamSource should use its own hadoop conf to call globPath

[jira] [Updated] (SPARK-22549) 64KB JVM bytecode limit problem with concat_ws

[ https://issues.apache.org/jira/browse/SPARK-22549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22549: - Target Version/s: 2.3.0, 2.2.2 > 64KB JVM bytecode limit problem with concat_ws > ---

[jira] [Updated] (SPARK-22508) 64KB JVM bytecode limit problem with GenerateUnsafeRowJoiner.create()

[ https://issues.apache.org/jira/browse/SPARK-22508?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22508: - Target Version/s: 2.3.0, 2.2.2 > 64KB JVM bytecode limit problem with GenerateUnsafeRowJoiner.cre

[jira] [Updated] (SPARK-22500) 64KB JVM bytecode limit problem with cast

[ https://issues.apache.org/jira/browse/SPARK-22500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22500: - Target Version/s: 2.2.0, 2.3.0 > 64KB JVM bytecode limit problem with cast >

[jira] [Updated] (SPARK-22548) Incorrect nested AND expression pushed down to JDBC data source

[ https://issues.apache.org/jira/browse/SPARK-22548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22548: - Target Version/s: 2.3.0, 2.2.2 > Incorrect nested AND expression pushed down to JDBC data source

[jira] [Updated] (SPARK-22591) GenerateOrdering shouldn't change ctx.INPUT_ROW

[ https://issues.apache.org/jira/browse/SPARK-22591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22591: - Target Version/s: 2.3.0, 2.2.2 > GenerateOrdering shouldn't change ctx.INPUT_ROW > --

[jira] [Updated] (SPARK-22595) flaky test: CastSuite.SPARK-22500: cast for struct should not generate codes beyond 64KB

[ https://issues.apache.org/jira/browse/SPARK-22595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22595: - Target Version/s: 2.3.0, 2.2.2 > flaky test: CastSuite.SPARK-22500: cast for struct should not ge

[jira] [Updated] (SPARK-17920) HiveWriterContainer passes null configuration to serde.initialize, causing NullPointerException in AvroSerde when using avro.schema.url

[ https://issues.apache.org/jira/browse/SPARK-17920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-17920: - Target Version/s: 2.3.0, 2.2.2 > HiveWriterContainer passes null configuration to serde.initializ

[jira] [Commented] (SPARK-22393) spark-shell can't find imported types in class constructors, extends clause

[ https://issues.apache.org/jira/browse/SPARK-22393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16265522#comment-16265522 ] Sean Owen commented on SPARK-22393: --- That's great detective work. You may be able to te

[jira] [Resolved] (SPARK-22597) Add spark-sql script for Windows users

[ https://issues.apache.org/jira/browse/SPARK-22597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-22597. - Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by pull request 19808 [https://githu

[jira] [Assigned] (SPARK-22597) Add spark-sql script for Windows users

[ https://issues.apache.org/jira/browse/SPARK-22597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-22597: --- Assignee: Hyukjin Kwon > Add spark-sql script for Windows users > --

[jira] [Commented] (SPARK-22393) spark-shell can't find imported types in class constructors, extends clause

[ https://issues.apache.org/jira/browse/SPARK-22393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16265445#comment-16265445 ] Mark Petruska commented on SPARK-22393: --- Created a PR to retrofit the fix to scala

[jira] [Assigned] (SPARK-22604) remove the get address methods from ColumnVector

[ https://issues.apache.org/jira/browse/SPARK-22604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22604: Assignee: Apache Spark (was: Wenchen Fan) > remove the get address methods from ColumnVec

[jira] [Commented] (SPARK-22604) remove the get address methods from ColumnVector

[ https://issues.apache.org/jira/browse/SPARK-22604?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16265427#comment-16265427 ] Apache Spark commented on SPARK-22604: -- User 'cloud-fan' has created a pull request

[jira] [Assigned] (SPARK-22604) remove the get address methods from ColumnVector

[ https://issues.apache.org/jira/browse/SPARK-22604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22604: Assignee: Wenchen Fan (was: Apache Spark) > remove the get address methods from ColumnVec

[jira] [Created] (SPARK-22604) remove the get address methods from ColumnVector

Wenchen Fan created SPARK-22604: --- Summary: remove the get address methods from ColumnVector Key: SPARK-22604 URL: https://issues.apache.org/jira/browse/SPARK-22604 Project: Spark Issue Type: Su

[jira] [Assigned] (SPARK-22604) remove the get address methods from ColumnVector

[ https://issues.apache.org/jira/browse/SPARK-22604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-22604: --- Assignee: Wenchen Fan > remove the get address methods from ColumnVector > -

[jira] [Assigned] (SPARK-22603) 64KB JVM bytecode limit problem with FormatString

[ https://issues.apache.org/jira/browse/SPARK-22603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22603: Assignee: Apache Spark > 64KB JVM bytecode limit problem with FormatString > -

[jira] [Assigned] (SPARK-22603) 64KB JVM bytecode limit problem with FormatString

[ https://issues.apache.org/jira/browse/SPARK-22603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22603: Assignee: (was: Apache Spark) > 64KB JVM bytecode limit problem with FormatString > --

[jira] [Commented] (SPARK-22603) 64KB JVM bytecode limit problem with FormatString

[ https://issues.apache.org/jira/browse/SPARK-22603?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16265415#comment-16265415 ] Apache Spark commented on SPARK-22603: -- User 'kiszk' has created a pull request for

[jira] [Comment Edited] (SPARK-10848) Applied JSON Schema Works for json RDD but not when loading json file

[ https://issues.apache.org/jira/browse/SPARK-10848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16265406#comment-16265406 ] Nurdin Premji edited comment on SPARK-10848 at 11/24/17 4:26 PM: --

[jira] [Commented] (SPARK-10848) Applied JSON Schema Works for json RDD but not when loading json file

[ https://issues.apache.org/jira/browse/SPARK-10848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16265406#comment-16265406 ] Nurdin Premji commented on SPARK-10848: --- I've also encountered this issue with spar

[jira] [Updated] (SPARK-22603) 64KB JVM bytecode limit problem with FormatString

[ https://issues.apache.org/jira/browse/SPARK-22603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kazuaki Ishizaki updated SPARK-22603: - Issue Type: Sub-task (was: Bug) Parent: SPARK-22510 > 64KB JVM bytecode limit pr

[jira] [Commented] (SPARK-22393) spark-shell can't find imported types in class constructors, extends clause

[ https://issues.apache.org/jira/browse/SPARK-22393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16265401#comment-16265401 ] Mark Petruska commented on SPARK-22393: --- The fix for this went into the 2.12 branch

[jira] [Updated] (SPARK-22603) 64KB JVM bytecode limit problem with FormatString

[ https://issues.apache.org/jira/browse/SPARK-22603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kazuaki Ishizaki updated SPARK-22603: - Description: {{FormatString}} can throw an exception due to the 64KB JVM bytecode limit w

[jira] [Created] (SPARK-22603) 64KB JVM bytecode limit problem with FormatString

Kazuaki Ishizaki created SPARK-22603: Summary: 64KB JVM bytecode limit problem with FormatString Key: SPARK-22603 URL: https://issues.apache.org/jira/browse/SPARK-22603 Project: Spark Iss

[jira] [Commented] (SPARK-22393) spark-shell can't find imported types in class constructors, extends clause

[ https://issues.apache.org/jira/browse/SPARK-22393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16265398#comment-16265398 ] Mark Petruska commented on SPARK-22393: --- https://github.com/scala/bug/issues/9881

[jira] [Commented] (SPARK-21693) AppVeyor tests reach the time limit, 1.5 hours, sometimes in SparkR tests

[ https://issues.apache.org/jira/browse/SPARK-21693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16265397#comment-16265397 ] Apache Spark commented on SPARK-21693: -- User 'HyukjinKwon' has created a pull reques

[jira] [Commented] (SPARK-22393) spark-shell can't find imported types in class constructors, extends clause

[ https://issues.apache.org/jira/browse/SPARK-22393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16265394#comment-16265394 ] Mark Petruska commented on SPARK-22393: --- Proof for the above statement: Tracing the

[jira] [Assigned] (SPARK-22602) remove ColumnVector#loadBytes

[ https://issues.apache.org/jira/browse/SPARK-22602?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22602: Assignee: Wenchen Fan (was: Apache Spark) > remove ColumnVector#loadBytes > -

[jira] [Commented] (SPARK-22602) remove ColumnVector#loadBytes

[ https://issues.apache.org/jira/browse/SPARK-22602?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16265392#comment-16265392 ] Apache Spark commented on SPARK-22602: -- User 'cloud-fan' has created a pull request

[jira] [Assigned] (SPARK-22602) remove ColumnVector#loadBytes

[ https://issues.apache.org/jira/browse/SPARK-22602?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22602: Assignee: Apache Spark (was: Wenchen Fan) > remove ColumnVector#loadBytes > -

[jira] [Created] (SPARK-22602) remove ColumnVector#loadBytes

Wenchen Fan created SPARK-22602: --- Summary: remove ColumnVector#loadBytes Key: SPARK-22602 URL: https://issues.apache.org/jira/browse/SPARK-22602 Project: Spark Issue Type: Sub-task Co

[jira] [Commented] (SPARK-22393) spark-shell can't find imported types in class constructors, extends clause

[ https://issues.apache.org/jira/browse/SPARK-22393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16265385#comment-16265385 ] Mark Petruska commented on SPARK-22393: --- After digging in deeper, I found that ther

[jira] [Commented] (SPARK-22484) PySpark DataFrame.write.csv(quote="") uses nullchar as quote

[ https://issues.apache.org/jira/browse/SPARK-22484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16265361#comment-16265361 ] Apache Spark commented on SPARK-22484: -- User 'gaborgsomogyi' has created a pull requ

[jira] [Assigned] (SPARK-22484) PySpark DataFrame.write.csv(quote="") uses nullchar as quote

[ https://issues.apache.org/jira/browse/SPARK-22484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22484: Assignee: (was: Apache Spark) > PySpark DataFrame.write.csv(quote="") uses nullchar as

[jira] [Assigned] (SPARK-22484) PySpark DataFrame.write.csv(quote="") uses nullchar as quote

[ https://issues.apache.org/jira/browse/SPARK-22484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22484: Assignee: Apache Spark > PySpark DataFrame.write.csv(quote="") uses nullchar as quote > --

[jira] [Updated] (SPARK-22601) Data load is getting displayed successful on providing non existing hdfs file path

[ https://issues.apache.org/jira/browse/SPARK-22601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-22601: -- Issue Type: Improvement (was: Bug) [~S71955] this shouldn't be considered a bug. Reading a non-existen

[jira] [Updated] (SPARK-22601) Data load is getting displayed successful on providing non existing hdfs file path

[ https://issues.apache.org/jira/browse/SPARK-22601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sujith updated SPARK-22601: --- Issue Type: Bug (was: Improvement) > Data load is getting displayed successful on providing non existing hdf

[jira] [Assigned] (SPARK-22537) Aggregation of map output statistics on driver faces single point bottleneck

[ https://issues.apache.org/jira/browse/SPARK-22537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-22537: --- Assignee: Chenzhao Guo > Aggregation of map output statistics on driver faces single point b

[jira] [Resolved] (SPARK-22537) Aggregation of map output statistics on driver faces single point bottleneck

[ https://issues.apache.org/jira/browse/SPARK-22537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-22537. - Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by pull request 19763 [https://githu

[jira] [Updated] (SPARK-22559) history server: handle exception on opening corrupted listing.ldb

[ https://issues.apache.org/jira/browse/SPARK-22559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-22559: Affects Version/s: (was: 2.2.0) 2.3.0 > history server: handle exception

[jira] [Assigned] (SPARK-22559) history server: handle exception on opening corrupted listing.ldb

[ https://issues.apache.org/jira/browse/SPARK-22559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-22559: --- Assignee: Gengliang Wang > history server: handle exception on opening corrupted listing.ldb

[jira] [Resolved] (SPARK-22559) history server: handle exception on opening corrupted listing.ldb

[ https://issues.apache.org/jira/browse/SPARK-22559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-22559. - Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by pull request 19786 [https://githu

[jira] [Resolved] (SPARK-22556) WrappedArray with Explode Function create WrappedArray with 1 object.

[ https://issues.apache.org/jira/browse/SPARK-22556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-22556. --- Resolution: Not A Problem > WrappedArray with Explode Function create WrappedArray with 1 object. > -

[jira] [Comment Edited] (SPARK-22601) Data load is getting displayed successful on providing non existing hdfs file path

[ https://issues.apache.org/jira/browse/SPARK-22601?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16265264#comment-16265264 ] Sujith edited comment on SPARK-22601 at 11/24/17 1:32 PM: -- I thi

[jira] [Comment Edited] (SPARK-22601) Data load is getting displayed successful on providing non existing hdfs file path

[ https://issues.apache.org/jira/browse/SPARK-22601?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16265264#comment-16265264 ] Sujith edited comment on SPARK-22601 at 11/24/17 1:14 PM: -- I thi

[jira] [Commented] (SPARK-22601) Data load is getting displayed successful on providing non existing hdfs file path

[ https://issues.apache.org/jira/browse/SPARK-22601?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16265264#comment-16265264 ] Sujith commented on SPARK-22601: I am working on this issue. > Data load is getting disp

[jira] [Updated] (SPARK-22574) Wrong request causing Spark Dispatcher going inactive

[ https://issues.apache.org/jira/browse/SPARK-22574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-22574: -- Due Date: (was: 21/Nov/17) > Wrong request causing Spark Dispatcher going inactive > --

[jira] [Updated] (SPARK-22598) ExecutorAllocationManager does not requests new executors when executor fail and target has not change

[ https://issues.apache.org/jira/browse/SPARK-22598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-22598: -- Due Date: (was: 24/Nov/17) > ExecutorAllocationManager does not requests new executors when executo

[jira] [Updated] (SPARK-22601) Data load is getting displayed successful on providing non existing hdfs file path

[ https://issues.apache.org/jira/browse/SPARK-22601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-22601: -- Due Date: (was: 25/Nov/17) Issue Type: Improvement (was: Bug) > Data load is getting display

[jira] [Created] (SPARK-22601) Data load is getting displayed successful on providing non existing hdfs file path

Sujith created SPARK-22601: -- Summary: Data load is getting displayed successful on providing non existing hdfs file path Key: SPARK-22601 URL: https://issues.apache.org/jira/browse/SPARK-22601 Project: Spark

[jira] [Commented] (SPARK-22526) Document closing of PortableDataInputStream in binaryFiles

[ https://issues.apache.org/jira/browse/SPARK-22526?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16265248#comment-16265248 ] mohamed imran commented on SPARK-22526: --- Sure [~srowen]. will do and update the PR

[jira] [Commented] (SPARK-22594) Handling spark-submit and master version mismatch

[ https://issues.apache.org/jira/browse/SPARK-22594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16265245#comment-16265245 ] Sean Owen commented on SPARK-22594: --- Yes, I know this isn't providing compatibility, ju

[jira] [Comment Edited] (SPARK-22526) Document closing of PortableDataInputStream in binaryFiles

[ https://issues.apache.org/jira/browse/SPARK-22526?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16265232#comment-16265232 ] mohamed imran edited comment on SPARK-22526 at 11/24/17 12:44 PM: -

[jira] [Commented] (SPARK-22594) Handling spark-submit and master version mismatch

[ https://issues.apache.org/jira/browse/SPARK-22594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16265242#comment-16265242 ] Jiri Kremser commented on SPARK-22594: -- To be clear, it doesn't try to solve of some

[jira] [Commented] (SPARK-22526) Document closing of PortableDataInputStream in binaryFiles

[ https://issues.apache.org/jira/browse/SPARK-22526?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16265241#comment-16265241 ] Sean Owen commented on SPARK-22526: --- You just open a pull request against the master br

[jira] [Comment Edited] (SPARK-22526) Document closing of PortableDataInputStream in binaryFiles

[ https://issues.apache.org/jira/browse/SPARK-22526?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16265232#comment-16265232 ] mohamed imran edited comment on SPARK-22526 at 11/24/17 12:37 PM: -

[jira] [Commented] (SPARK-22579) BlockManager.getRemoteValues and BlockManager.getRemoteBytes should be implemented using streaming

[ https://issues.apache.org/jira/browse/SPARK-22579?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16265234#comment-16265234 ] Sean Owen commented on SPARK-22579: --- Yes, the problem is reading the data across the ne

[jira] [Commented] (SPARK-22526) Document closing of PortableDataInputStream in binaryFiles

[ https://issues.apache.org/jira/browse/SPARK-22526?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16265232#comment-16265232 ] mohamed imran commented on SPARK-22526: --- [~ste...@apache.org] Thanks for your sugge

[jira] [Updated] (SPARK-22526) Document closing of PortableDataInputStream in binaryFiles

[ https://issues.apache.org/jira/browse/SPARK-22526?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-22526: -- Priority: Minor (was: Major) Component/s: Documentation Issue Type: Improvement (was: Bug)

[jira] [Commented] (SPARK-22526) Spark hangs while reading binary files from S3

[ https://issues.apache.org/jira/browse/SPARK-22526?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16265167#comment-16265167 ] Steve Loughran commented on SPARK-22526: it says it in the javadocs for [Portable

[jira] [Resolved] (SPARK-22595) flaky test: CastSuite.SPARK-22500: cast for struct should not generate codes beyond 64KB

[ https://issues.apache.org/jira/browse/SPARK-22595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-22595. - Resolution: Fixed Fix Version/s: 2.3.0 2.2.1 Issue resolved by pull req

[jira] [Resolved] (SPARK-22591) GenerateOrdering shouldn't change ctx.INPUT_ROW

[ https://issues.apache.org/jira/browse/SPARK-22591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-22591. - Resolution: Fixed Fix Version/s: 2.3.0 2.2.1 Issue resolved by pull req

  1   2   >