[jira] [Commented] (SPARK-21554) Spark Hive reporting pyspark.sql.utils.AnalysisException: u'Table not found: XXX' when run on yarn cluster

2017-07-27 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21554?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16104472#comment-16104472 ] Hyukjin Kwon commented on SPARK-21554: -- Would you mind describing steps to reproduce this? > Spark

[jira] [Created] (SPARK-21554) Spark Hive reporting pyspark.sql.utils.AnalysisException: u'Table not found: XXX' when run on yarn cluster

2017-07-27 Thread Subhod Lagade (JIRA)
Subhod Lagade created SPARK-21554: - Summary: Spark Hive reporting pyspark.sql.utils.AnalysisException: u'Table not found: XXX' when run on yarn cluster Key: SPARK-21554 URL:

[jira] [Commented] (SPARK-21553) Added the description of the default value of master parameter in the spark-shell

2017-07-27 Thread Donghui Xu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21553?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16104424#comment-16104424 ] Donghui Xu commented on SPARK-21553: Please review the code on

[jira] [Commented] (SPARK-21548) Support insert into serial columns of table

2017-07-27 Thread Takeshi Yamamuro (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16104420#comment-16104420 ] Takeshi Yamamuro commented on SPARK-21548: -- It makes some sense to me cuz this is SQL-compliant:

[jira] [Closed] (SPARK-21509) Add a config to enable adaptive query execution only for the last query execution.

2017-07-27 Thread jin xing (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jin xing closed SPARK-21509. Resolution: Won't Fix > Add a config to enable adaptive query execution only for the last query >

[jira] [Commented] (SPARK-15345) SparkSession's conf doesn't take effect when there's already an existing SparkContext

2017-07-27 Thread Subhod Lagade (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16104418#comment-16104418 ] Subhod Lagade commented on SPARK-15345: --- Spark Hive reporting pyspark.sql.utils.AnalysisException:

[jira] [Resolved] (SPARK-21325) The shell of 'spark-submit' about '--jars' and '--fils', jars and files can be placed on local and hdfs.

2017-07-27 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-21325. -- Resolution: Invalid The affected version you set is 2.3.0 and that looks fixed in the master

[jira] [Reopened] (SPARK-21325) The shell of 'spark-submit' about '--jars' and '--fils', jars and files can be placed on local and hdfs.

2017-07-27 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reopened SPARK-21325: -- > The shell of 'spark-submit' about '--jars' and '--fils', jars and files can > be placed on

[jira] [Commented] (SPARK-21325) The shell of 'spark-submit' about '--jars' and '--fils', jars and files can be placed on local and hdfs.

2017-07-27 Thread guoxiaolongzte (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16104410#comment-16104410 ] guoxiaolongzte commented on SPARK-21325: https://issues.apache.org/jira/browse/SPARK-21012 Help

[jira] [Created] (SPARK-21553) Added the description of the default value of master parameter in the spark-shell

2017-07-27 Thread Donghui Xu (JIRA)
Donghui Xu created SPARK-21553: -- Summary: Added the description of the default value of master parameter in the spark-shell Key: SPARK-21553 URL: https://issues.apache.org/jira/browse/SPARK-21553

[jira] [Commented] (SPARK-21325) The shell of 'spark-submit' about '--jars' and '--fils', jars and files can be placed on local and hdfs.

2017-07-27 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16104402#comment-16104402 ] Hyukjin Kwon commented on SPARK-21325: -- [~guoxiaolongzte], Would you point out which JIRA this one

[jira] [Created] (SPARK-21552) Add decimal type support to ArrowWriter.

2017-07-27 Thread Takuya Ueshin (JIRA)
Takuya Ueshin created SPARK-21552: - Summary: Add decimal type support to ArrowWriter. Key: SPARK-21552 URL: https://issues.apache.org/jira/browse/SPARK-21552 Project: Spark Issue Type:

[jira] [Commented] (SPARK-17321) YARN shuffle service should use good disk from yarn.nodemanager.local-dirs

2017-07-27 Thread roncenzhao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16104373#comment-16104373 ] roncenzhao commented on SPARK-17321: Hi, I encounter this problem too. Any process about this bug?

[jira] [Resolved] (SPARK-21306) OneVsRest Conceals Columns That May Be Relevant To Underlying Classifier

2017-07-27 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang resolved SPARK-21306. - Resolution: Fixed Fix Version/s: 2.3.0 2.2.1 2.1.2

[jira] [Commented] (SPARK-18016) Code Generation: Constant Pool Past Limit for Wide/Nested Dataset

2017-07-27 Thread Kazuaki Ishizaki (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16104284#comment-16104284 ] Kazuaki Ishizaki commented on SPARK-18016: -- [~jamcon] Thank you reporting the problem. We fixed

[jira] [Closed] (SPARK-21325) The shell of 'spark-submit' about '--jars' and '--fils', jars and files can be placed on local and hdfs.

2017-07-27 Thread guoxiaolongzte (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] guoxiaolongzte closed SPARK-21325. -- duplicate > The shell of 'spark-submit' about '--jars' and '--fils', jars and files can > be

[jira] [Comment Edited] (SPARK-21067) Thrift Server - CTAS fail with Unable to move source

2017-07-27 Thread xinzhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16103202#comment-16103202 ] xinzhang edited comment on SPARK-21067 at 7/28/17 1:06 AM: --- same here. problem

[jira] [Resolved] (SPARK-21538) Attribute resolution inconsistency in Dataset API

2017-07-27 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-21538. - Resolution: Fixed Assignee: Anton Okolnychyi Fix Version/s: 2.3.0

[jira] [Comment Edited] (SPARK-18016) Code Generation: Constant Pool Past Limit for Wide/Nested Dataset

2017-07-27 Thread James Conner (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16103853#comment-16103853 ] James Conner edited comment on SPARK-18016 at 7/27/17 8:31 PM: --- The issue

[jira] [Commented] (SPARK-18016) Code Generation: Constant Pool Past Limit for Wide/Nested Dataset

2017-07-27 Thread James Conner (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16103853#comment-16103853 ] James Conner commented on SPARK-18016: -- The issue does not appear to be completely fixed. I

[jira] [Commented] (SPARK-21550) approxQuantiles throws "next on empty iterator" on empty data

2017-07-27 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16103629#comment-16103629 ] Sean Owen commented on SPARK-21550: --- I think this was fixed in

[jira] [Closed] (SPARK-21550) approxQuantiles throws "next on empty iterator" on empty data

2017-07-27 Thread peay (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] peay closed SPARK-21550. Resolution: Duplicate Fix Version/s: 2.2.0 > approxQuantiles throws "next on empty iterator" on empty data

[jira] [Commented] (SPARK-21535) Reduce memory requirement for CrossValidator and TrainValidationSplit

2017-07-27 Thread yuhao yang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16103547#comment-16103547 ] yuhao yang commented on SPARK-21535: It's not in my opinion.

[jira] [Commented] (SPARK-21551) pyspark's collect fails when getaddrinfo is too slow

2017-07-27 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16103543#comment-16103543 ] Reynold Xin commented on SPARK-21551: - Sure. > pyspark's collect fails when getaddrinfo is too slow

[jira] [Commented] (SPARK-21551) pyspark's collect fails when getaddrinfo is too slow

2017-07-27 Thread peay (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16103539#comment-16103539 ] peay commented on SPARK-21551: -- Sure, does 15 seconds sound good? > pyspark's collect fails when

[jira] [Commented] (SPARK-21551) pyspark's collect fails when getaddrinfo is too slow

2017-07-27 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16103536#comment-16103536 ] Reynold Xin commented on SPARK-21551: - Do you want to submit a pull request? > pyspark's collect

[jira] [Created] (SPARK-21551) pyspark's collect fails when getaddrinfo is too slow

2017-07-27 Thread peay (JIRA)
peay created SPARK-21551: Summary: pyspark's collect fails when getaddrinfo is too slow Key: SPARK-21551 URL: https://issues.apache.org/jira/browse/SPARK-21551 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-21550) approxQuantiles throws "next on empty iterator" on empty data

2017-07-27 Thread peay (JIRA)
peay created SPARK-21550: Summary: approxQuantiles throws "next on empty iterator" on empty data Key: SPARK-21550 URL: https://issues.apache.org/jira/browse/SPARK-21550 Project: Spark Issue Type:

[jira] [Updated] (SPARK-21549) Spark fails to abort job correctly in case of custom OutputFormat implementations

2017-07-27 Thread Sergey Zhemzhitsky (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Zhemzhitsky updated SPARK-21549: --- Description: Spark fails to abort job correctly in case of custom OutputFormat

[jira] [Created] (SPARK-21549) Spark fails to abort job correctly in case of custom OutputFormat implementations

2017-07-27 Thread Sergey Zhemzhitsky (JIRA)
Sergey Zhemzhitsky created SPARK-21549: -- Summary: Spark fails to abort job correctly in case of custom OutputFormat implementations Key: SPARK-21549 URL: https://issues.apache.org/jira/browse/SPARK-21549

[jira] [Commented] (SPARK-21547) Spark cleaner cost too many time

2017-07-27 Thread DjvuLee (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16103459#comment-16103459 ] DjvuLee commented on SPARK-21547: - Yes, I agree that this has a relationship with the work, but doing

[jira] [Commented] (SPARK-21548) Support insert into serial columns of table

2017-07-27 Thread LvDongrong (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16103336#comment-16103336 ] LvDongrong commented on SPARK-21548: we try to solve it through this way:

[jira] [Resolved] (SPARK-21319) UnsafeExternalRowSorter.RowComparator memory leak

2017-07-27 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-21319. - Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by pull request 18679

[jira] [Assigned] (SPARK-21319) UnsafeExternalRowSorter.RowComparator memory leak

2017-07-27 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-21319: --- Assignee: Wenchen Fan > UnsafeExternalRowSorter.RowComparator memory leak >

[jira] [Closed] (SPARK-21539) Job should not be aborted when dynamic allocation is enabled or spark.executor.instances larger then current allocated number by yarn

2017-07-27 Thread zhoukang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21539?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhoukang closed SPARK-21539. Resolution: Duplicate > Job should not be aborted when dynamic allocation is enabled or >

[jira] [Resolved] (SPARK-19270) Add summary table to GLM summary

2017-07-27 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang resolved SPARK-19270. - Resolution: Fixed Fix Version/s: 2.3.0 > Add summary table to GLM summary >

[jira] [Commented] (SPARK-19700) Design an API for pluggable scheduler implementations

2017-07-27 Thread Rob Genova (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19700?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16103228#comment-16103228 ] Rob Genova commented on SPARK-19700: FYI, The Apache Spark fork enhanced to support HashiCorp Nomad

[jira] [Commented] (SPARK-20992) Support for Nomad as scheduler backend

2017-07-27 Thread Rob Genova (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20992?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16103224#comment-16103224 ] Rob Genova commented on SPARK-20992: The Apache Spark fork enhanced to support HashiCorp Nomad as a

[jira] [Commented] (SPARK-21067) Thrift Server - CTAS fail with Unable to move source

2017-07-27 Thread xinzhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16103202#comment-16103202 ] xinzhang commented on SPARK-21067: -- same here. problem reappeared in Spark 2.1.0 thriftserver :

[jira] [Comment Edited] (SPARK-21067) Thrift Server - CTAS fail with Unable to move source

2017-07-27 Thread xinzhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16103202#comment-16103202 ] xinzhang edited comment on SPARK-21067 at 7/27/17 1:27 PM: --- same here. problem

[jira] [Created] (SPARK-21548) Support insert into serial columns of table

2017-07-27 Thread LvDongrong (JIRA)
LvDongrong created SPARK-21548: -- Summary: Support insert into serial columns of table Key: SPARK-21548 URL: https://issues.apache.org/jira/browse/SPARK-21548 Project: Spark Issue Type: New

[jira] [Commented] (SPARK-21535) Reduce memory requirement for CrossValidator and TrainValidationSplit

2017-07-27 Thread Nick Pentreath (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16103152#comment-16103152 ] Nick Pentreath commented on SPARK-21535: Isn't this in direct opposition to

[jira] [Resolved] (SPARK-21440) Refactor ArrowConverters and add ArrayType and StructType support.

2017-07-27 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-21440. - Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by pull request 18655

[jira] [Assigned] (SPARK-21440) Refactor ArrowConverters and add ArrayType and StructType support.

2017-07-27 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-21440: --- Assignee: Takuya Ueshin > Refactor ArrowConverters and add ArrayType and StructType

[jira] [Comment Edited] (SPARK-15142) Spark Mesos dispatcher becomes unusable when the Mesos master restarts

2017-07-27 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16103035#comment-16103035 ] Stavros Kontopoulos edited comment on SPARK-15142 at 7/27/17 10:12 AM:

[jira] [Commented] (SPARK-15142) Spark Mesos dispatcher becomes unusable when the Mesos master restarts

2017-07-27 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16103035#comment-16103035 ] Stavros Kontopoulos commented on SPARK-15142: - [~devaraj.k] Thnx. Btw I was not able to

[jira] [Commented] (SPARK-21547) Spark cleaner cost too many time

2017-07-27 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16103021#comment-16103021 ] Sean Owen commented on SPARK-21547: --- It's not clear that this is "too slow", relative to whatever work

[jira] [Updated] (SPARK-21547) Spark cleaner cost too many time

2017-07-27 Thread DjvuLee (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DjvuLee updated SPARK-21547: Description: Spark Streaming sometime cost so many time deal with cleaning, and this can become worse

[jira] [Updated] (SPARK-21547) Spark cleaner cost too many time

2017-07-27 Thread DjvuLee (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DjvuLee updated SPARK-21547: Description: Spark Streaming sometime cost so many time deal with cleaning, and this can become worse

[jira] [Commented] (SPARK-21547) Spark cleaner cost too many time

2017-07-27 Thread DjvuLee (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16103005#comment-16103005 ] DjvuLee commented on SPARK-21547: - 17/07/27 11:29:51 INFO TaskSetManager: Finished task 169.0 in stage

[jira] [Updated] (SPARK-21547) Spark cleaner cost too many time

2017-07-27 Thread DjvuLee (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DjvuLee updated SPARK-21547: Description: Spark Streaming sometime cost so many time deal with cleaning, and this can become worse when

[jira] [Created] (SPARK-21547) Spark cleaner cost too many time

2017-07-27 Thread DjvuLee (JIRA)
DjvuLee created SPARK-21547: --- Summary: Spark cleaner cost too many time Key: SPARK-21547 URL: https://issues.apache.org/jira/browse/SPARK-21547 Project: Spark Issue Type: Bug Components:

[jira] [Commented] (SPARK-20990) Multi-line support for JSON

2017-07-27 Thread Marco Gaido (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16102975#comment-16102975 ] Marco Gaido commented on SPARK-20990: - A PR fixing it is ready:

[jira] [Commented] (SPARK-10802) Let ALS recommend for subset of data

2017-07-27 Thread Nick Pentreath (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16102971#comment-16102971 ] Nick Pentreath commented on SPARK-10802: For those that may be interested - I opened a PR to add

[jira] [Commented] (SPARK-21274) Implement EXCEPT ALL and INTERSECT ALL

2017-07-27 Thread Liang-Chi Hsieh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16102969#comment-16102969 ] Liang-Chi Hsieh commented on SPARK-21274: - [~Tagar] Is the rewrite of INTERSECT ALL correct?

[jira] [Updated] (SPARK-21546) dropDuplicates with watermark yields RuntimeException due to binding failure

2017-07-27 Thread Jacek Laskowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jacek Laskowski updated SPARK-21546: Description: With today's master... The following streaming query with watermark and

[jira] [Commented] (SPARK-21544) Test jar of some module should not install or deploy twice

2017-07-27 Thread zhoukang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21544?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16102954#comment-16102954 ] zhoukang commented on SPARK-21544: -- This is not a serious problem,and actually it depends on the maven

[jira] [Updated] (SPARK-21546) dropDuplicates with watermark yields RuntimeException due to binding failure

2017-07-27 Thread Jacek Laskowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jacek Laskowski updated SPARK-21546: Summary: dropDuplicates with watermark yields RuntimeException due to binding failure

[jira] [Commented] (SPARK-21544) Test jar of some module should not install or deploy twice

2017-07-27 Thread zhoukang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21544?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16102950#comment-16102950 ] zhoukang commented on SPARK-21544: -- This depends on maven central's strategy,whether can override or

[jira] [Created] (SPARK-21546) dropDuplicates followed by select yields RuntimeException due to binding failure

2017-07-27 Thread Jacek Laskowski (JIRA)
Jacek Laskowski created SPARK-21546: --- Summary: dropDuplicates followed by select yields RuntimeException due to binding failure Key: SPARK-21546 URL: https://issues.apache.org/jira/browse/SPARK-21546

[jira] [Commented] (SPARK-21543) Should not count executor initialize failed towards task failures

2017-07-27 Thread zhoukang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21543?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16102937#comment-16102937 ] zhoukang commented on SPARK-21543: -- And in my production cluster,there is a case:executor init failed

[jira] [Commented] (SPARK-21543) Should not count executor initialize failed towards task failures

2017-07-27 Thread zhoukang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21543?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16102934#comment-16102934 ] zhoukang commented on SPARK-21543: -- >From my understanding, executor init failed then actually task has

[jira] [Commented] (SPARK-21544) Test jar of some module should not install or deploy twice

2017-07-27 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21544?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16102929#comment-16102929 ] Sean Owen commented on SPARK-21544: --- Spark is successfully released to Maven Central by its

[jira] [Commented] (SPARK-21544) Test jar of some module should not install or deploy twice

2017-07-27 Thread zhoukang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21544?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16102918#comment-16102918 ] zhoukang commented on SPARK-21544: -- i have updated log.This will cause we deploy to nexus failed.

[jira] [Updated] (SPARK-21544) Test jar of some module should not install or deploy twice

2017-07-27 Thread zhoukang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhoukang updated SPARK-21544: - Description: For moudle below: common/network-common streaming sql/core sql/catalyst tests.jar will

[jira] [Resolved] (SPARK-21545) pyspark2

2017-07-27 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-21545. --- Resolution: Invalid Fix Version/s: (was: 2.2.0) Target Version/s: (was: 2.2.0)

[jira] [Commented] (SPARK-21544) Test jar of some module should not install or deploy twice

2017-07-27 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21544?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16102856#comment-16102856 ] Sean Owen commented on SPARK-21544: --- What is the problem? I don't see two installations from the log

[jira] [Commented] (SPARK-21543) Should not count executor initialize failed towards task failures

2017-07-27 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21543?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16102854#comment-16102854 ] Sean Owen commented on SPARK-21543: --- Why shouldn't it? > Should not count executor initialize failed

[jira] [Assigned] (SPARK-21271) UnsafeRow.hashCode assertion when sizeInBytes not multiple of 8

2017-07-27 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21271?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-21271: --- Assignee: Kazuaki Ishizaki > UnsafeRow.hashCode assertion when sizeInBytes not multiple of

[jira] [Resolved] (SPARK-21271) UnsafeRow.hashCode assertion when sizeInBytes not multiple of 8

2017-07-27 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21271?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-21271. - Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by pull request 18503

[jira] [Commented] (SPARK-19511) insert into table does not work on second session of beeline

2017-07-27 Thread xinzhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16102804#comment-16102804 ] xinzhang commented on SPARK-19511: -- [~chenerlu] hi it always appear . which scene does it do not

[jira] [Commented] (SPARK-21538) Attribute resolution inconsistency in Dataset API

2017-07-27 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16102782#comment-16102782 ] Xiao Li commented on SPARK-21538: - https://github.com/apache/spark/pull/18740 > Attribute resolution

[jira] [Commented] (SPARK-11083) insert overwrite table failed when beeline reconnect

2017-07-27 Thread xinzhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11083?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16102775#comment-16102775 ] xinzhang commented on SPARK-11083: -- reappeared in Spark 2.1.0. any one working on this issue? > insert

[jira] [Commented] (SPARK-21543) Should not count executor initialize failed towards task failures

2017-07-27 Thread zhoukang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21543?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16102767#comment-16102767 ] zhoukang commented on SPARK-21543: -- I have created a pr https://github.com/apache/spark/pull/18743 >

[jira] [Commented] (SPARK-21544) Test jar of some module should not install or deploy twice

2017-07-27 Thread zhoukang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21544?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16102766#comment-16102766 ] zhoukang commented on SPARK-21544: -- I have create a pr: https://github.com/apache/spark/pull/18745 >