[jira] [Commented] (SPARK-22231) Support of map, filter, withColumn, dropColumn in nested list of structures

2017-10-16 Thread Jeremy Smith (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16206143#comment-16206143 ] Jeremy Smith commented on SPARK-22231: -- [~viirya] - It is confusing that the lambda is {{Column =>

[jira] [Commented] (SPARK-22231) Support of map, filter, withColumn, dropColumn in nested list of structures

2017-10-10 Thread Jeremy Smith (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16198965#comment-16198965 ] Jeremy Smith commented on SPARK-22231: -- I implemented these at Netflix, so I wanted to provide some

[jira] [Commented] (SPARK-20395) Upgrade to Scala 2.11.11

2017-04-19 Thread Jeremy Smith (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20395?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15975637#comment-15975637 ] Jeremy Smith commented on SPARK-20395: -- [~srowen] genjavadoc version tracks the complete Scala

[jira] [Commented] (SPARK-20395) Upgrade to Scala 2.11.11

2017-04-19 Thread Jeremy Smith (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20395?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15975458#comment-15975458 ] Jeremy Smith commented on SPARK-20395: -- Depends on

[jira] [Created] (SPARK-20395) Upgrade to Scala 2.11.11

2017-04-19 Thread Jeremy Smith (JIRA)
Jeremy Smith created SPARK-20395: Summary: Upgrade to Scala 2.11.11 Key: SPARK-20395 URL: https://issues.apache.org/jira/browse/SPARK-20395 Project: Spark Issue Type: Dependency upgrade

[jira] [Created] (SPARK-18199) Support appending to Parquet files

2016-11-01 Thread Jeremy Smith (JIRA)
Jeremy Smith created SPARK-18199: Summary: Support appending to Parquet files Key: SPARK-18199 URL: https://issues.apache.org/jira/browse/SPARK-18199 Project: Spark Issue Type: Improvement

[jira] [Comment Edited] (SPARK-17344) Kafka 0.8 support for Structured Streaming

2016-10-11 Thread Jeremy Smith (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15567367#comment-15567367 ] Jeremy Smith edited comment on SPARK-17344 at 10/12/16 2:56 AM: {quote}

[jira] [Commented] (SPARK-17344) Kafka 0.8 support for Structured Streaming

2016-10-11 Thread Jeremy Smith (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15567367#comment-15567367 ] Jeremy Smith commented on SPARK-17344: -- > By contrast, writing a streaming source shim around the

[jira] [Commented] (SPARK-17344) Kafka 0.8 support for Structured Streaming

2016-10-07 Thread Jeremy Smith (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15556129#comment-15556129 ] Jeremy Smith commented on SPARK-17344: -- +1 We're on CDH, and it will probably be a while before

[jira] [Commented] (SPARK-14536) NPE in JDBCRDD when array column contains nulls (postgresql)

2016-04-11 Thread Jeremy Smith (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14536?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15235400#comment-15235400 ] Jeremy Smith commented on SPARK-14536: -- Actually, H2 seems to do the same thing:

[jira] [Created] (SPARK-14536) NPE in JDBCRDD when array column contains nulls (postgresql)

2016-04-11 Thread Jeremy Smith (JIRA)
Jeremy Smith created SPARK-14536: Summary: NPE in JDBCRDD when array column contains nulls (postgresql) Key: SPARK-14536 URL: https://issues.apache.org/jira/browse/SPARK-14536 Project: Spark