[jira] [Assigned] (SPARK-22197) push down operators to data source before planning

2017-10-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22197: Assignee: Wenchen Fan (was: Apache Spark) > push down operators to data source before pla

[jira] [Commented] (SPARK-22195) Add cosine similarity to org.apache.spark.ml.linalg.Vectors

2017-10-03 Thread yuhao yang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16190884#comment-16190884 ] yuhao yang commented on SPARK-22195: Exactly, the implementation is straight forward,

[jira] [Assigned] (SPARK-22197) push down operators to data source before planning

2017-10-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22197: Assignee: Apache Spark (was: Wenchen Fan) > push down operators to data source before pla

[jira] [Commented] (SPARK-22197) push down operators to data source before planning

2017-10-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16190883#comment-16190883 ] Apache Spark commented on SPARK-22197: -- User 'cloud-fan' has created a pull request

[jira] [Created] (SPARK-22197) push down operators to data source before planning

2017-10-03 Thread Wenchen Fan (JIRA)
Wenchen Fan created SPARK-22197: --- Summary: push down operators to data source before planning Key: SPARK-22197 URL: https://issues.apache.org/jira/browse/SPARK-22197 Project: Spark Issue Type:

[jira] [Updated] (SPARK-22196) Combine multiple input splits into a HadoopPartition

2017-10-03 Thread Vinitha Reddy Gankidi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinitha Reddy Gankidi updated SPARK-22196: -- Summary: Combine multiple input splits into a HadoopPartition (was: Combine mu

[jira] [Created] (SPARK-22196) Combine multiple input splits into HadoopPartition

2017-10-03 Thread Vinitha Reddy Gankidi (JIRA)
Vinitha Reddy Gankidi created SPARK-22196: - Summary: Combine multiple input splits into HadoopPartition Key: SPARK-22196 URL: https://issues.apache.org/jira/browse/SPARK-22196 Project: Spark

[jira] [Commented] (SPARK-22195) Add cosine similarity to org.apache.spark.ml.linalg.Vectors

2017-10-03 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16190868#comment-16190868 ] Sean Owen commented on SPARK-22195: --- Does this add much? it's just dot(A,B) / (norm(A)

[jira] [Resolved] (SPARK-20557) JdbcUtils doesn't support java.sql.Types.TIMESTAMP_WITH_TIMEZONE

2017-10-03 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-20557. --- Resolution: Fixed Assignee: Xiao Li Fix Version/s: 2.3.0 I think that may have been a

[jira] [Resolved] (SPARK-22193) SortMergeJoinExec: typo correction

2017-10-03 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-22193. --- Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by pull request 19422 [https://github.co

[jira] [Assigned] (SPARK-22193) SortMergeJoinExec: typo correction

2017-10-03 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-22193: - Assignee: Rekha Joshi > SortMergeJoinExec: typo correction > --

[jira] [Closed] (SPARK-21951) Unable to add the new column and writing into the Hive using spark

2017-10-03 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21951?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen closed SPARK-21951. - > Unable to add the new column and writing into the Hive using spark > --

[jira] [Resolved] (SPARK-21952) Unable to load the csv file into Dataset using Spark with java

2017-10-03 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-21952. --- > Unable to load the csv file into Dataset using Spark with java > -

[jira] [Resolved] (SPARK-21951) Unable to add the new column and writing into the Hive using spark

2017-10-03 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21951?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-21951. --- Resolution: Invalid > Unable to add the new column and writing into the Hive using spark > --

[jira] [Deleted] (SPARK-21952) Unable to load the csv file into Dataset using Spark with java

2017-10-03 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen deleted SPARK-21952: -- > Unable to load the csv file into Dataset using Spark with java > --

[jira] [Commented] (SPARK-22192) An RDD of nested POJO objects cannot be converted into a DataFrame using SQLContext.createDataFrame API

2017-10-03 Thread Asif Hussain Shahid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16190852#comment-16190852 ] Asif Hussain Shahid commented on SPARK-22192: - Not at all. I have added a bug

[jira] [Commented] (SPARK-22192) An RDD of nested POJO objects cannot be converted into a DataFrame using SQLContext.createDataFrame API

2017-10-03 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16190838#comment-16190838 ] Hyukjin Kwon commented on SPARK-22192: -- Would you mind if I ask a reproducer? > An

[jira] [Resolved] (SPARK-22136) Implement stream-stream outer joins in append mode

2017-10-03 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das resolved SPARK-22136. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 19327 [https://g

[jira] [Updated] (SPARK-21951) Unable to add the new column and writing into the Hive using spark

2017-10-03 Thread jalendhar Baddam (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21951?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jalendhar Baddam updated SPARK-21951: - Issue Type: Question (was: Bug) > Unable to add the new column and writing into the Hive

[jira] [Updated] (SPARK-21952) Unable to load the csv file into Dataset using Spark with java

2017-10-03 Thread jalendhar Baddam (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jalendhar Baddam updated SPARK-21952: - Issue Type: Question (was: Bug) > Unable to load the csv file into Dataset using Spark

[jira] [Resolved] (SPARK-22171) Describe Table Extended Failed when Table Owner is Empty

2017-10-03 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-22171. - Resolution: Fixed Fix Version/s: 2.3.0 > Describe Table Extended Failed when Table Owner is Empty

[jira] [Commented] (SPARK-20557) JdbcUtils doesn't support java.sql.Types.TIMESTAMP_WITH_TIMEZONE

2017-10-03 Thread Dan Stine (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20557?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16190706#comment-16190706 ] Dan Stine commented on SPARK-20557: --- [~JannikArndt] [~smilegator] Can you help me under

[jira] [Created] (SPARK-22195) Add cosine similarity to org.apache.spark.ml.linalg.Vectors

2017-10-03 Thread yuhao yang (JIRA)
yuhao yang created SPARK-22195: -- Summary: Add cosine similarity to org.apache.spark.ml.linalg.Vectors Key: SPARK-22195 URL: https://issues.apache.org/jira/browse/SPARK-22195 Project: Spark Issu

[jira] [Commented] (SPARK-22193) SortMergeJoinExec: typo correction

2017-10-03 Thread Takeshi Yamamuro (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16190580#comment-16190580 ] Takeshi Yamamuro commented on SPARK-22193: -- You probably don't file a jira for t

[jira] [Closed] (SPARK-19426) Add support for custom coalescers on Data

2017-10-03 Thread Takeshi Yamamuro (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro closed SPARK-19426. Resolution: Later > Add support for custom coalescers on Data > ---

[jira] [Commented] (SPARK-19426) Add support for custom coalescers on Data

2017-10-03 Thread Takeshi Yamamuro (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19426?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16190578#comment-16190578 ] Takeshi Yamamuro commented on SPARK-19426: -- I'll close for now cuz the priority

[jira] [Resolved] (SPARK-20466) HadoopRDD#addLocalConfiguration throws NPE

2017-10-03 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-20466. Resolution: Fixed Assignee: Sahil Takiar Fix Version/s: 2.1.3

[jira] [Created] (SPARK-22194) Allow namespacing of configs in spark.internal.config

2017-10-03 Thread Gregory Owen (JIRA)
Gregory Owen created SPARK-22194: Summary: Allow namespacing of configs in spark.internal.config Key: SPARK-22194 URL: https://issues.apache.org/jira/browse/SPARK-22194 Project: Spark Issue T

[jira] [Assigned] (SPARK-22193) SortMergeJoinExec: typo correction

2017-10-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22193: Assignee: Apache Spark > SortMergeJoinExec: typo correction >

[jira] [Commented] (SPARK-22193) SortMergeJoinExec: typo correction

2017-10-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16190365#comment-16190365 ] Apache Spark commented on SPARK-22193: -- User 'rekhajoshm' has created a pull request

[jira] [Assigned] (SPARK-22193) SortMergeJoinExec: typo correction

2017-10-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22193: Assignee: (was: Apache Spark) > SortMergeJoinExec: typo correction > -

[jira] [Created] (SPARK-22193) SortMergeJoinExec: typo correction

2017-10-03 Thread Rekha Joshi (JIRA)
Rekha Joshi created SPARK-22193: --- Summary: SortMergeJoinExec: typo correction Key: SPARK-22193 URL: https://issues.apache.org/jira/browse/SPARK-22193 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-21866) SPIP: Image support in Spark

2017-10-03 Thread yuhao yang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16190239#comment-16190239 ] yuhao yang commented on SPARK-21866: My two cents, 1. In most scenarios, deep learni

[jira] [Resolved] (SPARK-21644) LocalLimit.maxRows is defined incorrectly

2017-10-03 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-21644. - Resolution: Fixed Fix Version/s: 2.3.0 > LocalLimit.maxRows is defined incorrectly > -

[jira] [Created] (SPARK-22192) An RDD of nested POJO objects cannot be converted into a DataFrame using SQLContext.createDataFrame API

2017-10-03 Thread Asif Hussain Shahid (JIRA)
Asif Hussain Shahid created SPARK-22192: --- Summary: An RDD of nested POJO objects cannot be converted into a DataFrame using SQLContext.createDataFrame API Key: SPARK-22192 URL: https://issues.apache.org/jira

[jira] [Resolved] (SPARK-22158) convertMetastore should not ignore table properties

2017-10-03 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-22158. - Resolution: Fixed Assignee: Dongjoon Hyun Fix Version/s: 2.3.0 2.2.1 >

[jira] [Commented] (SPARK-19984) ERROR codegen.CodeGenerator: failed to compile: org.codehaus.commons.compiler.CompileException: File 'generated.java'

2017-10-03 Thread Kazuaki Ishizaki (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16190050#comment-16190050 ] Kazuaki Ishizaki commented on SPARK-19984: -- [~JohnSteidley] Thank you for provid

[jira] [Commented] (SPARK-22191) Add hive serde example with serde properties

2017-10-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16190047#comment-16190047 ] Apache Spark commented on SPARK-22191: -- User 'crlalam' has created a pull request fo

[jira] [Assigned] (SPARK-22191) Add hive serde example with serde properties

2017-10-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22191: Assignee: Apache Spark > Add hive serde example with serde properties > --

[jira] [Assigned] (SPARK-22191) Add hive serde example with serde properties

2017-10-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22191: Assignee: (was: Apache Spark) > Add hive serde example with serde properties > ---

[jira] [Created] (SPARK-22191) Add hive serde example with serde properties

2017-10-03 Thread Chinna Rao Lalam (JIRA)
Chinna Rao Lalam created SPARK-22191: Summary: Add hive serde example with serde properties Key: SPARK-22191 URL: https://issues.apache.org/jira/browse/SPARK-22191 Project: Spark Issue Ty

[jira] [Assigned] (SPARK-22184) GraphX fails in case of insufficient memory and checkpoints enabled

2017-10-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22184: Assignee: (was: Apache Spark) > GraphX fails in case of insufficient memory and checkp

[jira] [Assigned] (SPARK-22184) GraphX fails in case of insufficient memory and checkpoints enabled

2017-10-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22184: Assignee: Apache Spark > GraphX fails in case of insufficient memory and checkpoints enabl

[jira] [Commented] (SPARK-22167) Spark Packaging w/R distro issues

2017-10-03 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16189954#comment-16189954 ] Felix Cheung commented on SPARK-22167: -- There are likely 2 stages to this. More pres

[jira] [Comment Edited] (SPARK-14172) Hive table partition predicate not passed down correctly

2017-10-03 Thread Saktheesh Balaraj (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16189481#comment-16189481 ] Saktheesh Balaraj edited comment on SPARK-14172 at 10/3/17 3:21 PM: ---

[jira] [Updated] (SPARK-21549) Spark fails to complete job correctly in case of OutputFormat which do not write into hdfs

2017-10-03 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-21549: -- Fix Version/s: (was: 2.2.1) > Spark fails to complete job correctly in case of OutputFormat which d

[jira] [Resolved] (SPARK-22189) Number of jobs created while querying partitioned table in hive using spark

2017-10-03 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-22189. --- Resolution: Invalid Questions should go to the mailing list, please. > Number of jobs created while

[jira] [Created] (SPARK-22190) Add Spark executor task metrics to Dropwizard metrics

2017-10-03 Thread Luca Canali (JIRA)
Luca Canali created SPARK-22190: --- Summary: Add Spark executor task metrics to Dropwizard metrics Key: SPARK-22190 URL: https://issues.apache.org/jira/browse/SPARK-22190 Project: Spark Issue Typ

[jira] [Updated] (SPARK-22190) Add Spark executor task metrics to Dropwizard metrics

2017-10-03 Thread Luca Canali (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luca Canali updated SPARK-22190: Attachment: SparkTaskMetrics_Grafana_example.PNG !SparkTaskMetrics_Grafana_example.PNG|thumbnail!

[jira] [Created] (SPARK-22189) Number of jobs created while querying partitioned table in hive using spark

2017-10-03 Thread Astha Arya (JIRA)
Astha Arya created SPARK-22189: -- Summary: Number of jobs created while querying partitioned table in hive using spark Key: SPARK-22189 URL: https://issues.apache.org/jira/browse/SPARK-22189 Project: Spar

[jira] [Commented] (SPARK-22188) Add defense against Cross-Site Scripting, MIME-sniffing and MitM attack

2017-10-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16189700#comment-16189700 ] Apache Spark commented on SPARK-22188: -- User 'krishna-pandey' has created a pull req

[jira] [Assigned] (SPARK-22188) Add defense against Cross-Site Scripting, MIME-sniffing and MitM attack

2017-10-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22188: Assignee: Apache Spark > Add defense against Cross-Site Scripting, MIME-sniffing and MitM

[jira] [Assigned] (SPARK-22188) Add defense against Cross-Site Scripting, MIME-sniffing and MitM attack

2017-10-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22188: Assignee: (was: Apache Spark) > Add defense against Cross-Site Scripting, MIME-sniffin

[jira] [Updated] (SPARK-22188) Add defense against Cross-Site Scripting, MIME-sniffing and MitM attack

2017-10-03 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-22188: -- Shepherd: (was: Sean Owen) Flags: (was: Important) Priority: Minor (was: Critical)

[jira] [Created] (SPARK-22188) Add defense against Cross-Site Scripting, MIME-sniffing and MitM attack

2017-10-03 Thread Krishna Pandey (JIRA)
Krishna Pandey created SPARK-22188: -- Summary: Add defense against Cross-Site Scripting, MIME-sniffing and MitM attack Key: SPARK-22188 URL: https://issues.apache.org/jira/browse/SPARK-22188 Project:

[jira] [Closed] (SPARK-16709) Task with commit failed will retry infinite when speculation set to true

2017-10-03 Thread Artur Sukhenko (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Artur Sukhenko closed SPARK-16709. -- Resolution: Duplicate Fix Version/s: 1.6.2 > Task with commit failed will retry infinite

[jira] [Comment Edited] (SPARK-17885) Spark Streaming deletes checkpointed RDD then tries to load it after restart

2017-10-03 Thread Vishal John (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16189483#comment-16189483 ] Vishal John edited comment on SPARK-17885 at 10/3/17 11:27 AM:

[jira] [Comment Edited] (SPARK-14172) Hive table partition predicate not passed down correctly

2017-10-03 Thread Saktheesh Balaraj (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16189481#comment-16189481 ] Saktheesh Balaraj edited comment on SPARK-14172 at 10/3/17 10:06 AM: --

[jira] [Comment Edited] (SPARK-14172) Hive table partition predicate not passed down correctly

2017-10-03 Thread Saktheesh Balaraj (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16189481#comment-16189481 ] Saktheesh Balaraj edited comment on SPARK-14172 at 10/3/17 10:06 AM: --

[jira] [Comment Edited] (SPARK-14172) Hive table partition predicate not passed down correctly

2017-10-03 Thread Saktheesh Balaraj (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16189481#comment-16189481 ] Saktheesh Balaraj edited comment on SPARK-14172 at 10/3/17 9:52 AM: ---

[jira] [Comment Edited] (SPARK-14172) Hive table partition predicate not passed down correctly

2017-10-03 Thread Saktheesh Balaraj (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16189481#comment-16189481 ] Saktheesh Balaraj edited comment on SPARK-14172 at 10/3/17 9:52 AM: ---

[jira] [Commented] (SPARK-17885) Spark Streaming deletes checkpointed RDD then tries to load it after restart

2017-10-03 Thread Vishal John (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16189483#comment-16189483 ] Vishal John commented on SPARK-17885: - I can see that the checkpointed folder was exp

[jira] [Commented] (SPARK-14172) Hive table partition predicate not passed down correctly

2017-10-03 Thread Saktheesh Balaraj (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16189481#comment-16189481 ] Saktheesh Balaraj commented on SPARK-14172: --- Similar problem is observed while

[jira] [Commented] (SPARK-17885) Spark Streaming deletes checkpointed RDD then tries to load it after restart

2017-10-03 Thread Vishal John (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16189403#comment-16189403 ] Vishal John commented on SPARK-17885: - Hello all, Our application also suffers from

[jira] [Resolved] (SPARK-22176) Dataset.show(Int.MaxValue) hits integer overflows

2017-10-03 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-22176. - Resolution: Fixed Assignee: Takeshi Yamamuro Fix Version/s: 2.3.0 > Dataset.show(Int.MaxV