[jira] [Created] (SPARK-13101) Dataset complex types mapping to DataFrame (element nullability) mismatch

Deenar Toraskar created SPARK-13101: --- Summary: Dataset complex types mapping to DataFrame (element nullability) mismatch Key: SPARK-13101 URL: https://issues.apache.org/jira/browse/SPARK-13101

[jira] [Created] (SPARK-13100) improving the performance of stringToDate method in DateTimeUtils.scala

Yang Wang created SPARK-13100: - Summary: improving the performance of stringToDate method in DateTimeUtils.scala Key: SPARK-13100 URL: https://issues.apache.org/jira/browse/SPARK-13100 Project: Spark

[jira] [Updated] (SPARK-13100) improving the performance of stringToDate method in DateTimeUtils.scala

[ https://issues.apache.org/jira/browse/SPARK-13100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Wang updated SPARK-13100: -- Attachment: screenshot-1.png > improving the performance of stringToDate method in DateTimeUtils.scala

[jira] [Assigned] (SPARK-13100) improving the performance of stringToDate method in DateTimeUtils.scala

[ https://issues.apache.org/jira/browse/SPARK-13100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13100: Assignee: Apache Spark > improving the performance of stringToDate method in

[jira] [Commented] (SPARK-13100) improving the performance of stringToDate method in DateTimeUtils.scala

[ https://issues.apache.org/jira/browse/SPARK-13100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15124810#comment-15124810 ] Apache Spark commented on SPARK-13100: -- User 'wangyang1992' has created a pull request for this

[jira] [Assigned] (SPARK-13100) improving the performance of stringToDate method in DateTimeUtils.scala

[ https://issues.apache.org/jira/browse/SPARK-13100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13100: Assignee: (was: Apache Spark) > improving the performance of stringToDate method in

[jira] [Updated] (SPARK-6363) make scala 2.11 default language

[ https://issues.apache.org/jira/browse/SPARK-6363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-6363: --- Labels: releasenotes (was: scala) > make scala 2.11 default language >

[jira] [Resolved] (SPARK-6363) make scala 2.11 default language

[ https://issues.apache.org/jira/browse/SPARK-6363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-6363. Resolution: Fixed Fix Version/s: 2.0.0 > make scala 2.11 default language >

[jira] [Updated] (SPARK-6363) Switch to Scala 2.11 for default build

[ https://issues.apache.org/jira/browse/SPARK-6363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-6363: --- Summary: Switch to Scala 2.11 for default build (was: make scala 2.11 default language) > Switch to

[jira] [Commented] (SPARK-13085) Add scalastyle command used in build testing

[ https://issues.apache.org/jira/browse/SPARK-13085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15125067#comment-15125067 ] Marcelo Vanzin commented on SPARK-13085: No harm is keeping this open until we can upgrade

[jira] [Updated] (SPARK-13101) Dataset complex types mapping to DataFrame (element nullability) mismatch

[ https://issues.apache.org/jira/browse/SPARK-13101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-13101: --- Target Version/s: 1.6.1 Priority: Blocker (was: Major) I'm temporarily marking this as

[jira] [Updated] (SPARK-13101) Dataset complex types mapping to DataFrame (element nullability) mismatch

[ https://issues.apache.org/jira/browse/SPARK-13101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-13101: --- Fix Version/s: (was: 1.6.1) > Dataset complex types mapping to DataFrame (element nullability)

[jira] [Commented] (SPARK-13104) Spark Metrics currently does not return executors hostname

[ https://issues.apache.org/jira/browse/SPARK-13104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15125083#comment-15125083 ] Josh Rosen commented on SPARK-13104: Which Spark version? And which metrics? TaskMetrics? The

[jira] [Updated] (SPARK-13102) Run query using ThriftServer, and open web using IE11, i click ”+detail" in SQLPage, but not response

[ https://issues.apache.org/jira/browse/SPARK-13102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] KaiXinXIaoLei updated SPARK-13102: -- Affects Version/s: 1.6.0 > Run query using ThriftServer, and open web using IE11, i click

[jira] [Updated] (SPARK-13102) Run query using ThriftServer, and open web using IE11, i click ”+detail" in SQLPage, but not response

[ https://issues.apache.org/jira/browse/SPARK-13102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] KaiXinXIaoLei updated SPARK-13102: -- Fix Version/s: 2.0.0 > Run query using ThriftServer, and open web using IE11, i click

[jira] [Updated] (SPARK-13102) Run query using ThriftServer, and open web using IE11, i click ”+detail" in SQLPage, but not response

[ https://issues.apache.org/jira/browse/SPARK-13102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] KaiXinXIaoLei updated SPARK-13102: -- Component/s: Web UI > Run query using ThriftServer, and open web using IE11, i click

[jira] [Updated] (SPARK-13102) Run query using ThriftServer, and open web using IE11, i click ”+detail" in SQLPage, but not response

[ https://issues.apache.org/jira/browse/SPARK-13102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] KaiXinXIaoLei updated SPARK-13102: -- Attachment: details in SQLPage.png I click “+detais" in SQLpage, but it has no response. >

[jira] [Updated] (SPARK-13100) improving the performance of stringToDate method in DateTimeUtils.scala

[ https://issues.apache.org/jira/browse/SPARK-13100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-13100: -- Labels: (was: performance) Priority: Minor (was: Major) > improving the performance of

[jira] [Commented] (SPARK-13103) HashTF dosn't count TF correctly

[ https://issues.apache.org/jira/browse/SPARK-13103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15124937#comment-15124937 ] yuhao yang commented on SPARK-13103: Thanks for finding this. I'm not sure what's the historical

[jira] [Created] (SPARK-13104) Spark Metrics currently does not return executors hostname

Karthik created SPARK-13104: --- Summary: Spark Metrics currently does not return executors hostname Key: SPARK-13104 URL: https://issues.apache.org/jira/browse/SPARK-13104 Project: Spark Issue

[jira] [Updated] (SPARK-13102) Run query using ThriftServer, and open web using IE11, i click ”+detail" in SQLPage, but not response

[ https://issues.apache.org/jira/browse/SPARK-13102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] KaiXinXIaoLei updated SPARK-13102: -- Attachment: dag info is blank.png Using IE11, I click the "DAG Visualization" in StagesPage,

[jira] [Created] (SPARK-13102) Run query using ThriftServer, and open web using IE11, i click ”+detail" in SQLPage, but not response

KaiXinXIaoLei created SPARK-13102: - Summary: Run query using ThriftServer, and open web using IE11, i click ”+detail" in SQLPage, but not response Key: SPARK-13102 URL:

[jira] [Updated] (SPARK-13102) Run query using ThriftServer, and open web using IE11, i click ”+detail" in SQLPage, but not response

[ https://issues.apache.org/jira/browse/SPARK-13102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] KaiXinXIaoLei updated SPARK-13102: -- Labels: UI (was: ) > Run query using ThriftServer, and open web using IE11, i click

[jira] [Commented] (SPARK-13089) spark.ml Naive Bayes user guide

[ https://issues.apache.org/jira/browse/SPARK-13089?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15124889#comment-15124889 ] yuhao yang commented on SPARK-13089: I'll start on this. > spark.ml Naive Bayes user guide >

[jira] [Resolved] (SPARK-13099) ccjlbr

[ https://issues.apache.org/jira/browse/SPARK-13099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-13099. --- Resolution: Invalid Assuming this was a typo > ccjlbr > -- > > Key: SPARK-13099

[jira] [Created] (SPARK-13103) HashTF dosn't count TF correctly

Louis Liu created SPARK-13103: - Summary: HashTF dosn't count TF correctly Key: SPARK-13103 URL: https://issues.apache.org/jira/browse/SPARK-13103 Project: Spark Issue Type: Bug

[jira] [Resolved] (SPARK-13100) improving the performance of stringToDate method in DateTimeUtils.scala

[ https://issues.apache.org/jira/browse/SPARK-13100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-13100. - Resolution: Fixed Assignee: Yang Wang Fix Version/s: 2.0.0 > improving the

[jira] [Commented] (SPARK-7019) Build docs on doc changes

[ https://issues.apache.org/jira/browse/SPARK-7019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15125150#comment-15125150 ] Josh Rosen commented on SPARK-7019: --- This would be great to do but is somewhat blocked at the moment by

[jira] [Commented] (SPARK-11416) Upgrade kryo package to version 3.0

[ https://issues.apache.org/jira/browse/SPARK-11416?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15125149#comment-15125149 ] Josh Rosen commented on SPARK-11416: Since we're in the middle of 2.0.0 development, now seems like a

[jira] [Commented] (SPARK-12154) Upgrade to Jersey 2

[ https://issues.apache.org/jira/browse/SPARK-12154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15125151#comment-15125151 ] Josh Rosen commented on SPARK-12154: Since we're in the middle of the 2.0.0 development cycle right

[jira] [Resolved] (SPARK-6029) Unshaded "clearspring" classpath leakage + excluded fastutil interferes with apps using clearspring

[ https://issues.apache.org/jira/browse/SPARK-6029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-6029. --- Resolution: Incomplete Resolving as "incomplete", since it's not clear whether this issue is still

[jira] [Resolved] (SPARK-5330) Core | Scala 2.11 | Transitive dependency on com.fasterxml.jackson.core :jackson-core:2.3.1 causes compatibility issues

[ https://issues.apache.org/jira/browse/SPARK-5330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-5330. --- Resolution: Incomplete I'm going to resolve this as "incomplete" since I'm not sure whether it's

[jira] [Commented] (SPARK-7481) Add Hadoop 2.6+ profile to pull in object store FS accessors

[ https://issues.apache.org/jira/browse/SPARK-7481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15125143#comment-15125143 ] Josh Rosen commented on SPARK-7481: --- How does this proposal change if we just remove the assembly and

[jira] [Reopened] (SPARK-12261) pyspark crash for large dataset

[ https://issues.apache.org/jira/browse/SPARK-12261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen reopened SPARK-12261: > pyspark crash for large dataset > --- > > Key:

[jira] [Resolved] (SPARK-12822) Change default build to Hadoop 2.7

[ https://issues.apache.org/jira/browse/SPARK-12822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-12822. Resolution: Won't Fix It sounds like this is a clear "Won't Fix" as long as we continue to support

[jira] [Commented] (SPARK-11157) Allow Spark to be built without assemblies

[ https://issues.apache.org/jira/browse/SPARK-11157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15125147#comment-15125147 ] Josh Rosen commented on SPARK-11157: I'd love to start making progress towards removing the

[jira] [Commented] (SPARK-6305) Add support for log4j 2.x to Spark

[ https://issues.apache.org/jira/browse/SPARK-6305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15125152#comment-15125152 ] Josh Rosen commented on SPARK-6305: --- Hey [~srowen], what do you think the next steps are in evaluating

[jira] [Commented] (SPARK-7009) Build assembly JAR via ant to avoid zip64 problems

[ https://issues.apache.org/jira/browse/SPARK-7009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15125153#comment-15125153 ] Josh Rosen commented on SPARK-7009: --- I believe that this will be obsoleted by SPARK-11157, no? > Build

[jira] [Created] (SPARK-13105) Spark 1.6 and earlier should reject NATURAL JOIN queries instead of returning wrong answers

Josh Rosen created SPARK-13105: -- Summary: Spark 1.6 and earlier should reject NATURAL JOIN queries instead of returning wrong answers Key: SPARK-13105 URL: https://issues.apache.org/jira/browse/SPARK-13105

[jira] [Resolved] (SPARK-13070) Points out which physical file is the trouble maker when Parquet schema merging fails

[ https://issues.apache.org/jira/browse/SPARK-13070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-13070. - Resolution: Fixed Fix Version/s: 2.0.0 > Points out which physical file is the trouble

[jira] [Commented] (SPARK-12951) Support spilling in generate aggregate

[ https://issues.apache.org/jira/browse/SPARK-12951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15125245#comment-15125245 ] Apache Spark commented on SPARK-12951: -- User 'davies' has created a pull request for this issue:

[jira] [Resolved] (SPARK-12689) Migrate DDL parsing to the newly absorbed parser

[ https://issues.apache.org/jira/browse/SPARK-12689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-12689. - Resolution: Fixed Assignee: Liang-Chi Hsieh Fix Version/s: 2.0.0 > Migrate DDL

[jira] [Commented] (SPARK-13105) Spark 1.6 and earlier should reject NATURAL JOIN queries instead of returning wrong answers

[ https://issues.apache.org/jira/browse/SPARK-13105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15125199#comment-15125199 ] Apache Spark commented on SPARK-13105: -- User 'JoshRosen' has created a pull request for this issue:

[jira] [Commented] (SPARK-7009) Build assembly JAR via ant to avoid zip64 problems

[ https://issues.apache.org/jira/browse/SPARK-7009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15125205#comment-15125205 ] Zhan Zhang commented on SPARK-7009: --- Yes. This one is obsoleted. > Build assembly JAR via ant to avoid

[jira] [Commented] (SPARK-12772) Better error message for parsing failure?

[ https://issues.apache.org/jira/browse/SPARK-12772?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15125246#comment-15125246 ] Reynold Xin commented on SPARK-12772: - cc [~hvanhovell] / [~viirya] any idea about this one? >

[jira] [Commented] (SPARK-12715) Improve test coverage

[ https://issues.apache.org/jira/browse/SPARK-12715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15125247#comment-15125247 ] Reynold Xin commented on SPARK-12715: - [~davies] are there specific things you have in mind? cc