[jira] [Commented] (SPARK-20496) KafkaWriter Uses Unanalyzed Logical Plan

[ https://issues.apache.org/jira/browse/SPARK-20496?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15988953#comment-15988953 ] Bill Chambers commented on SPARK-20496: --- This should probably be backported too. > KafkaWriter

[jira] [Updated] (SPARK-20496) KafkaWriter Uses Unanalyzed Logical Plan

[ https://issues.apache.org/jira/browse/SPARK-20496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bill Chambers updated SPARK-20496: -- Affects Version/s: 2.1.0 > KafkaWriter Uses Unanalyzed Logical Plan >

[jira] [Updated] (SPARK-20496) KafkaWriter Uses Unanalyzed Logical Plan

[ https://issues.apache.org/jira/browse/SPARK-20496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bill Chambers updated SPARK-20496: -- Description: Right now we use the unanalyzed logical plan for writing to Kafka, we should use

[jira] [Created] (SPARK-20496) KafkaWriter Uses Unanalyzed Logical Plan

Bill Chambers created SPARK-20496: - Summary: KafkaWriter Uses Unanalyzed Logical Plan Key: SPARK-20496 URL: https://issues.apache.org/jira/browse/SPARK-20496 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-20400) Remove References to Third Party Vendors from Spark ASF Documentation

[ https://issues.apache.org/jira/browse/SPARK-20400?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15976102#comment-15976102 ] Bill Chambers commented on SPARK-20400: --- I'd like to see what others have to say, maybe this isn't

[jira] [Updated] (SPARK-20400) Remove References to Third Party Vendors from Spark ASF Documentation

[ https://issues.apache.org/jira/browse/SPARK-20400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bill Chambers updated SPARK-20400: -- Description: Similar to SPARK-17445, vendors should probably not be referenced on the ASF

[jira] [Created] (SPARK-20400) Remove References to Third Party Vendors from Spark ASF Documentation

Bill Chambers created SPARK-20400: - Summary: Remove References to Third Party Vendors from Spark ASF Documentation Key: SPARK-20400 URL: https://issues.apache.org/jira/browse/SPARK-20400 Project:

[jira] [Commented] (SPARK-19714) Bucketizer Bug Regarding Handling Unbucketed Inputs

[ https://issues.apache.org/jira/browse/SPARK-19714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15886109#comment-15886109 ] Bill Chambers commented on SPARK-19714: --- Agree with your first and second paragraphs. Regarding

[jira] [Comment Edited] (SPARK-19714) Bucketizer Bug Regarding Handling Unbucketed Inputs

[ https://issues.apache.org/jira/browse/SPARK-19714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15883125#comment-15883125 ] Bill Chambers edited comment on SPARK-19714 at 2/24/17 5:15 PM: The thing

[jira] [Commented] (SPARK-19714) Bucketizer Bug Regarding Handling Unbucketed Inputs

[ https://issues.apache.org/jira/browse/SPARK-19714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15883125#comment-15883125 ] Bill Chambers commented on SPARK-19714: --- The thing is QuantileDiscretizer and Bucketizer do

[jira] [Commented] (SPARK-19714) Bucketizer Bug Regarding Handling Unbucketed Inputs

[ https://issues.apache.org/jira/browse/SPARK-19714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15881676#comment-15881676 ] Bill Chambers commented on SPARK-19714: --- "Invalid" is a poor descriptor IMO. Invalid should be

[jira] [Created] (SPARK-19714) Bucketizer Bug Regarding Handling Unbucketed Inputs

Bill Chambers created SPARK-19714: - Summary: Bucketizer Bug Regarding Handling Unbucketed Inputs Key: SPARK-19714 URL: https://issues.apache.org/jira/browse/SPARK-19714 Project: Spark Issue

[jira] [Commented] (SPARK-19127) Inconsistencies in dense_rank and rank documentation

[ https://issues.apache.org/jira/browse/SPARK-19127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15809726#comment-15809726 ] Bill Chambers commented on SPARK-19127: --- https://github.com/apache/spark/pull/16505 >

[jira] [Updated] (SPARK-19126) Join Documentation Improvements

[ https://issues.apache.org/jira/browse/SPARK-19126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bill Chambers updated SPARK-19126: -- Priority: Minor (was: Major) > Join Documentation Improvements >

[jira] [Updated] (SPARK-19127) Inconsistencies in dense_rank and rank documentation

[ https://issues.apache.org/jira/browse/SPARK-19127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bill Chambers updated SPARK-19127: -- Priority: Minor (was: Major) > Inconsistencies in dense_rank and rank documentation >

[jira] [Updated] (SPARK-19127) Inconsistencies in dense_rank and rank documentation

[ https://issues.apache.org/jira/browse/SPARK-19127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bill Chambers updated SPARK-19127: -- Summary: Inconsistencies in dense_rank and rank documentation (was: Errors in Window

[jira] [Created] (SPARK-19127) Errors in Window Functions Documentation

Bill Chambers created SPARK-19127: - Summary: Errors in Window Functions Documentation Key: SPARK-19127 URL: https://issues.apache.org/jira/browse/SPARK-19127 Project: Spark Issue Type:

[jira] [Commented] (SPARK-19127) Errors in Window Functions Documentation

[ https://issues.apache.org/jira/browse/SPARK-19127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15809697#comment-15809697 ] Bill Chambers commented on SPARK-19127: --- PR coming > Errors in Window Functions Documentation >

[jira] [Commented] (SPARK-19126) Join Documentation Improvements

[ https://issues.apache.org/jira/browse/SPARK-19126?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15809690#comment-15809690 ] Bill Chambers commented on SPARK-19126: --- PR Ready: https://github.com/apache/spark/pull/16504 >

[jira] [Updated] (SPARK-19126) Join Documentation Improvements

[ https://issues.apache.org/jira/browse/SPARK-19126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bill Chambers updated SPARK-19126: -- Description: - Some join types are missing (no mention of anti join) - Joins are labelled

[jira] [Updated] (SPARK-19126) Join Documentation Improvements

[ https://issues.apache.org/jira/browse/SPARK-19126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bill Chambers updated SPARK-19126: -- Description: - Some join types are missing (no mention of anti join) - Joins are labelled

[jira] [Updated] (SPARK-19126) Join Documentation Improvements

[ https://issues.apache.org/jira/browse/SPARK-19126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bill Chambers updated SPARK-19126: -- Description: - Some join types are missing or inconsistent (no mention of anti join) Pull

[jira] [Created] (SPARK-19126) Join Documentation Incomplete

Bill Chambers created SPARK-19126: - Summary: Join Documentation Incomplete Key: SPARK-19126 URL: https://issues.apache.org/jira/browse/SPARK-19126 Project: Spark Issue Type: Improvement

[jira] [Resolved] (SPARK-18424) Single Function for Parsing Dates and Times with Formats

[ https://issues.apache.org/jira/browse/SPARK-18424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bill Chambers resolved SPARK-18424. --- Resolution: Duplicate This is a duplicate of SPARK-16609. Work will continue there. >

[jira] [Commented] (SPARK-16609) Single function for parsing timestamps/dates

[ https://issues.apache.org/jira/browse/SPARK-16609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15671632#comment-15671632 ] Bill Chambers commented on SPARK-16609: --- I am working on this. > Single function for parsing

[jira] [Updated] (SPARK-18424) Single Function for Parsing Dates and Times with Formats

[ https://issues.apache.org/jira/browse/SPARK-18424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bill Chambers updated SPARK-18424: -- Summary: Single Function for Parsing Dates and Times with Formats (was: Single Funct) >

[jira] [Updated] (SPARK-18424) Single Funct

[ https://issues.apache.org/jira/browse/SPARK-18424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bill Chambers updated SPARK-18424: -- Summary: Single Funct (was: Improve Date Parsing Semantics & Functionality) > Single Funct >

[jira] [Updated] (SPARK-18424) Improve Date Parsing Semantics & Functionality

[ https://issues.apache.org/jira/browse/SPARK-18424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bill Chambers updated SPARK-18424: -- Summary: Improve Date Parsing Semantics & Functionality (was: Improve Date Parsing

[jira] [Comment Edited] (SPARK-18424) Improve Date Parsing Functionality

[ https://issues.apache.org/jira/browse/SPARK-18424?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15660291#comment-15660291 ] Bill Chambers edited comment on SPARK-18424 at 11/12/16 10:09 PM: -- For

[jira] [Comment Edited] (SPARK-18424) Improve Date Parsing Functionality

[ https://issues.apache.org/jira/browse/SPARK-18424?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15660291#comment-15660291 ] Bill Chambers edited comment on SPARK-18424 at 11/12/16 9:31 PM: - For the

[jira] [Comment Edited] (SPARK-18424) Improve Date Parsing Functionality

[ https://issues.apache.org/jira/browse/SPARK-18424?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15660291#comment-15660291 ] Bill Chambers edited comment on SPARK-18424 at 11/12/16 9:30 PM: - For the

[jira] [Commented] (SPARK-18424) Improve Date Parsing Functionality

[ https://issues.apache.org/jira/browse/SPARK-18424?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15660291#comment-15660291 ] Bill Chambers commented on SPARK-18424: --- For the record I would like to work on this one. >

[jira] [Updated] (SPARK-18424) Improve Date Parsing Functionality

[ https://issues.apache.org/jira/browse/SPARK-18424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bill Chambers updated SPARK-18424: -- Summary: Improve Date Parsing Functionality (was: Cumbersome Date Manipulation) > Improve

[jira] [Updated] (SPARK-18424) Improve Date Parsing Functionality

[ https://issues.apache.org/jira/browse/SPARK-18424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bill Chambers updated SPARK-18424: -- Description: I've found it quite cumbersome to work with dates thus far in Spark, it can be

[jira] [Created] (SPARK-18424) Cumbersome Date Manipulation

Bill Chambers created SPARK-18424: - Summary: Cumbersome Date Manipulation Key: SPARK-18424 URL: https://issues.apache.org/jira/browse/SPARK-18424 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-18365) Improve Documentation for Sample Methods

[ https://issues.apache.org/jira/browse/SPARK-18365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bill Chambers updated SPARK-18365: -- Description: The documentation for sample is a little unintuitive. It was difficult to

[jira] [Updated] (SPARK-18365) Improve Documentation for Sample Methods

[ https://issues.apache.org/jira/browse/SPARK-18365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bill Chambers updated SPARK-18365: -- Summary: Improve Documentation for Sample Methods (was: Improve Documentation for Sample

[jira] [Updated] (SPARK-18365) Improve Documentation for Sample Method

[ https://issues.apache.org/jira/browse/SPARK-18365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bill Chambers updated SPARK-18365: -- Summary: Improve Documentation for Sample Method (was: Documentation for Sampling is

[jira] [Created] (SPARK-18365) Documentation for Sampling is Incorrect

Bill Chambers created SPARK-18365: - Summary: Documentation for Sampling is Incorrect Key: SPARK-18365 URL: https://issues.apache.org/jira/browse/SPARK-18365 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-16234) Speculative Task may not be able to overwrite file

[ https://issues.apache.org/jira/browse/SPARK-16234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bill Chambers updated SPARK-16234: -- Description: resolved... (was: given spark.speculative set to true, I'm running a large spark

[jira] [Closed] (SPARK-16234) Speculative Task may not be able to overwrite file

[ https://issues.apache.org/jira/browse/SPARK-16234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bill Chambers closed SPARK-16234. - Resolution: Resolved > Speculative Task may not be able to overwrite file >

[jira] [Updated] (SPARK-16234) Speculative Task may not be able to overwrite file

[ https://issues.apache.org/jira/browse/SPARK-16234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bill Chambers updated SPARK-16234: -- Description: given spark.speculative set to true, I'm running a large spark job with parquet

[jira] [Created] (SPARK-16234) Speculative Task may not be able to overwrite file

Bill Chambers created SPARK-16234: - Summary: Speculative Task may not be able to overwrite file Key: SPARK-16234 URL: https://issues.apache.org/jira/browse/SPARK-16234 Project: Spark Issue

[jira] [Comment Edited] (SPARK-16220) Revert ShowFunctions/ListFunctions in 2.0 to Reflect 1.6 Functionality

[ https://issues.apache.org/jira/browse/SPARK-16220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15351686#comment-15351686 ] Bill Chambers edited comment on SPARK-16220 at 6/27/16 7:53 PM: happy to

[jira] [Commented] (SPARK-16220) Revert ShowFunctions/ListFunctions in 2.0 to Reflect 1.6 Functionality

[ https://issues.apache.org/jira/browse/SPARK-16220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15351686#comment-15351686 ] Bill Chambers commented on SPARK-16220: --- [~hvanhovell] I imagine I should just resolve this as

[jira] [Created] (SPARK-16220) Revert ShowFunctions/ListFunctions in 2.0 to Reflect 1.6 Functionality

Bill Chambers created SPARK-16220: - Summary: Revert ShowFunctions/ListFunctions in 2.0 to Reflect 1.6 Functionality Key: SPARK-16220 URL: https://issues.apache.org/jira/browse/SPARK-16220 Project:

[jira] [Commented] (SPARK-16077) Python UDF may fail because of six

[ https://issues.apache.org/jira/browse/SPARK-16077?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15340459#comment-15340459 ] Bill Chambers commented on SPARK-16077: --- [~davies] was this one the one that I had reported? >

[jira] [Created] (SPARK-15264) Spark 2.0 CSV Reader: Error on Blank Column Names

Bill Chambers created SPARK-15264: - Summary: Spark 2.0 CSV Reader: Error on Blank Column Names Key: SPARK-15264 URL: https://issues.apache.org/jira/browse/SPARK-15264 Project: Spark Issue

[jira] [Commented] (SPARK-14708) Repl Serialization Issue

[ https://issues.apache.org/jira/browse/SPARK-14708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15246230#comment-15246230 ] Bill Chambers commented on SPARK-14708: --- cc:[~joshrosen] > Repl Serialization Issue >

[jira] [Updated] (SPARK-14708) Repl Serialization Issue

[ https://issues.apache.org/jira/browse/SPARK-14708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bill Chambers updated SPARK-14708: -- Description: Run this code 6 times with the :paste command in Spark. You'll see exponential

[jira] [Created] (SPARK-14708) Repl Serialization Issue

Bill Chambers created SPARK-14708: - Summary: Repl Serialization Issue Key: SPARK-14708 URL: https://issues.apache.org/jira/browse/SPARK-14708 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-13214) Fix dynamic allocation docs

[ https://issues.apache.org/jira/browse/SPARK-13214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bill Chambers updated SPARK-13214: -- Description: Update docs to reflect dynamicAllocation to be available for all cluster managers

[jira] [Created] (SPARK-13214) Update docs to reflect dynamicAllocation to be true

Bill Chambers created SPARK-13214: - Summary: Update docs to reflect dynamicAllocation to be true Key: SPARK-13214 URL: https://issues.apache.org/jira/browse/SPARK-13214 Project: Spark Issue

[jira] [Commented] (SPARK-11964) Create user guide section explaining export/import

[ https://issues.apache.org/jira/browse/SPARK-11964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15035480#comment-15035480 ] Bill Chambers commented on SPARK-11964: --- quick question, am I to assume that all pieces mentioned

[jira] [Comment Edited] (SPARK-11964) Create user guide section explaining export/import

[ https://issues.apache.org/jira/browse/SPARK-11964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15035480#comment-15035480 ] Bill Chambers edited comment on SPARK-11964 at 12/2/15 8:52 AM: quick

[jira] [Comment Edited] (SPARK-11964) Create user guide section explaining export/import

[ https://issues.apache.org/jira/browse/SPARK-11964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15034178#comment-15034178 ] Bill Chambers edited comment on SPARK-11964 at 12/1/15 8:27 PM: Happy to

[jira] [Commented] (SPARK-11964) Create user guide section explaining export/import

[ https://issues.apache.org/jira/browse/SPARK-11964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15034178#comment-15034178 ] Bill Chambers commented on SPARK-11964: --- Happy to help out with this. Should this belong in a new

[jira] [Comment Edited] (SPARK-7130) spark.ml RandomForest* should always do bootstrapping

[ https://issues.apache.org/jira/browse/SPARK-7130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14994307#comment-14994307 ] Bill Chambers edited comment on SPARK-7130 at 11/6/15 7:39 PM: --- Looking at

[jira] [Commented] (SPARK-7130) spark.ml RandomForest* should always do bootstrapping

[ https://issues.apache.org/jira/browse/SPARK-7130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14994307#comment-14994307 ] Bill Chambers commented on SPARK-7130: -- Looking at this issue, the change needs to occur within the

[jira] [Comment Edited] (SPARK-10528) spark-shell throws java.lang.RuntimeException: The root scratch dir: /tmp/hive on HDFS should be writable.

[ https://issues.apache.org/jira/browse/SPARK-10528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14741715#comment-14741715 ] Bill Chambers edited comment on SPARK-10528 at 9/11/15 11:17 PM: - This

[jira] [Commented] (SPARK-10528) spark-shell throws java.lang.RuntimeException: The root scratch dir: /tmp/hive on HDFS should be writable.

[ https://issues.apache.org/jira/browse/SPARK-10528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14741715#comment-14741715 ] Bill Chambers commented on SPARK-10528: --- This came up for me when I used the spark_ec2 launcher.