[jira] [Commented] (SPARK-28444) Bump Kubernetes Client Version to 4.3.0

2019-09-02 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-28444?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16921202#comment-16921202 ] Björn commented on SPARK-28444: --- This is fixed in SPARK-28921 Workaround in 2.4.3 is to r

[jira] [Updated] (SPARK-28930) Spark DESC FORMATTED TABLENAME information display issues

2019-09-02 Thread jobit mathew (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jobit mathew updated SPARK-28930: - Description: Spark DESC FORMATTED TABLENAME information display issues.Showing incorrect  *Last

[jira] [Resolved] (SPARK-28946) Add some more information about building SparkR on Windows

2019-09-02 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-28946. -- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 25647 [https://gi

[jira] [Assigned] (SPARK-28946) Add some more information about building SparkR on Windows

2019-09-02 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-28946: Assignee: Hyukjin Kwon > Add some more information about building SparkR on Windows > ---

[jira] [Updated] (SPARK-28930) Spark DESC FORMATTED TABLENAME information display issues

2019-09-02 Thread Sujith Chacko (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sujith Chacko updated SPARK-28930: -- Description: Spark DESC FORMATTED TABLENAME information display issues.Showing incorrect  *Las

[jira] [Updated] (SPARK-28930) Spark DESC FORMATTED TABLENAME information display issues

2019-09-02 Thread jobit mathew (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jobit mathew updated SPARK-28930: - Description: Spark DESC FORMATTED TABLENAME information display issues.Showing incorrect  *Last

[jira] [Updated] (SPARK-28930) Spark DESC FORMATTED TABLENAME information display issues

2019-09-02 Thread jobit mathew (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jobit mathew updated SPARK-28930: - Description: Spark DESC FORMATTED TABLENAME information display issues.Showing incorrect  *Last

[jira] [Assigned] (SPARK-28573) Convert InsertIntoTable(HiveTableRelation) to Datasource inserting for partitioned table

2019-09-02 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-28573: --- Assignee: Xianjin YE > Convert InsertIntoTable(HiveTableRelation) to Datasource inserting f

[jira] [Resolved] (SPARK-28573) Convert InsertIntoTable(HiveTableRelation) to Datasource inserting for partitioned table

2019-09-02 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-28573. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 25306 [https://gith

[jira] [Updated] (SPARK-28942) [Spark][WEB UI]Spark in local mode hostname display localhost in the Host Column of Task Summary Page

2019-09-02 Thread ABHISHEK KUMAR GUPTA (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ABHISHEK KUMAR GUPTA updated SPARK-28942: - Summary: [Spark][WEB UI]Spark in local mode hostname display localhost in the Ho

[jira] [Commented] (SPARK-28372) Document Spark WEB UI

2019-09-02 Thread zhengruifeng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16921151#comment-16921151 ] zhengruifeng commented on SPARK-28372: -- [~smilegator] I think we may need to add a

[jira] [Commented] (SPARK-28373) Document JDBC/ODBC Server page

2019-09-02 Thread zhengruifeng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16921138#comment-16921138 ] zhengruifeng commented on SPARK-28373: -- [~planga82] Thanks!:D > Document JDBC/ODBC

[jira] [Issue Comment Deleted] (SPARK-28953) Integration tests fail due to malformed URL

2019-09-02 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-28953: Comment: was deleted (was: What is your Hadoop version and JDK version? Please see SPARK-27177 and

[jira] [Comment Edited] (SPARK-28953) Integration tests fail due to malformed URL

2019-09-02 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28953?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16921115#comment-16921115 ] Yuming Wang edited comment on SPARK-28953 at 9/3/19 2:31 AM: -

[jira] [Commented] (SPARK-28953) Integration tests fail due to malformed URL

2019-09-02 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28953?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16921115#comment-16921115 ] Yuming Wang commented on SPARK-28953: - What is you Hadoop version and JDK version? P

[jira] [Created] (SPARK-28955) Support for LocalDateTime semantics

2019-09-02 Thread Bill Schneider (Jira)
Bill Schneider created SPARK-28955: -- Summary: Support for LocalDateTime semantics Key: SPARK-28955 URL: https://issues.apache.org/jira/browse/SPARK-28955 Project: Spark Issue Type: Wish

[jira] [Updated] (SPARK-28954) For SparkCLI, start up with conf of HIVEAUXJARS, we add jar with SessionStateResourceLoader's addJar() API

2019-09-02 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28954?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-28954: -- Description: When startup SparkSQL CLI . For extra jar passed through hive conf {{HiveConf.ConfVars.H

[jira] [Created] (SPARK-28954) For SparkCLI, start up with conf of HIVEAUXJARS, we add jar with SessionStateResourceLoader's addJar() API

2019-09-02 Thread angerszhu (Jira)
angerszhu created SPARK-28954: - Summary: For SparkCLI, start up with conf of HIVEAUXJARS, we add jar with SessionStateResourceLoader's addJar() API Key: SPARK-28954 URL: https://issues.apache.org/jira/browse/SPARK-289

[jira] [Commented] (SPARK-28864) Add spark connector for Alibaba Log Service

2019-09-02 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28864?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16921096#comment-16921096 ] Jungtaek Lim commented on SPARK-28864: -- I guess general recommendation of new conne

[jira] [Updated] (SPARK-28864) Add spark source connector for Alibaba Log Service

2019-09-02 Thread Ke Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ke Li updated SPARK-28864: -- Summary: Add spark source connector for Alibaba Log Service (was: Add spark source connector for Aliyun Log S

[jira] [Updated] (SPARK-28864) Add spark connector for Alibaba Log Service

2019-09-02 Thread Ke Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ke Li updated SPARK-28864: -- Summary: Add spark connector for Alibaba Log Service (was: Add spark source connector for Alibaba Log Service

[jira] [Updated] (SPARK-28921) Spark jobs failing on latest versions of Kubernetes (1.15.3, 1.14.6, 1,13.10, 1.12.10, 1.11.10)

2019-09-02 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-28921: -- Fix Version/s: 2.4.5 > Spark jobs failing on latest versions of Kubernetes (1.15.3, 1.14.6, 1,

[jira] [Comment Edited] (SPARK-28953) Integration tests fail due to malformed URL

2019-09-02 Thread Stavros Kontopoulos (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28953?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16921087#comment-16921087 ] Stavros Kontopoulos edited comment on SPARK-28953 at 9/3/19 12:04 AM:

[jira] [Comment Edited] (SPARK-28953) Integration tests fail due to malformed URL

2019-09-02 Thread Stavros Kontopoulos (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28953?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16921087#comment-16921087 ] Stavros Kontopoulos edited comment on SPARK-28953 at 9/3/19 12:03 AM:

[jira] [Commented] (SPARK-28953) Integration tests fail due to malformed URL

2019-09-02 Thread Stavros Kontopoulos (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28953?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16921087#comment-16921087 ] Stavros Kontopoulos commented on SPARK-28953: - [~shaneknapp] I can fix this

[jira] [Created] (SPARK-28953) Integration tests fail due to malformed URL

2019-09-02 Thread Stavros Kontopoulos (Jira)
Stavros Kontopoulos created SPARK-28953: --- Summary: Integration tests fail due to malformed URL Key: SPARK-28953 URL: https://issues.apache.org/jira/browse/SPARK-28953 Project: Spark Iss

[jira] [Comment Edited] (SPARK-24227) Not able to submit spark job to kubernetes on 2.3

2019-09-02 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-24227?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16921082#comment-16921082 ] Dongjoon Hyun edited comment on SPARK-24227 at 9/2/19 11:58 PM: --

[jira] [Resolved] (SPARK-24227) Not able to submit spark job to kubernetes on 2.3

2019-09-02 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-24227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-24227. --- Resolution: Not A Problem Apache Spark 2.3.4 was the last release and `branch-2.3` becomes E

[jira] [Resolved] (SPARK-28921) Spark jobs failing on latest versions of Kubernetes (1.15.3, 1.14.6, 1,13.10, 1.12.10, 1.11.10)

2019-09-02 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-28921. --- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 25640 [https://

[jira] [Assigned] (SPARK-28921) Spark jobs failing on latest versions of Kubernetes (1.15.3, 1.14.6, 1,13.10, 1.12.10, 1.11.10)

2019-09-02 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-28921: - Assignee: Andy Grove > Spark jobs failing on latest versions of Kubernetes (1.15.3, 1.1

[jira] [Commented] (SPARK-24227) Not able to submit spark job to kubernetes on 2.3

2019-09-02 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-24227?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16921076#comment-16921076 ] Dongjoon Hyun commented on SPARK-24227: --- Thank you for reporting and analysis, [~f

[jira] [Updated] (SPARK-24227) Not able to submit spark job to kubernetes on 2.3

2019-09-02 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-24227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-24227: -- Labels: kubernetes (was: kubernetes spark) > Not able to submit spark job to kubernetes on 2.

[jira] [Updated] (SPARK-24227) Not able to submit spark job to kubernetes on 2.3

2019-09-02 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-24227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-24227: -- Labels: (was: kubernetes) > Not able to submit spark job to kubernetes on 2.3 >

[jira] [Updated] (SPARK-24227) Not able to submit spark job to kubernetes on 2.3

2019-09-02 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-24227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-24227: -- Component/s: (was: Spark Submit) (was: Spark Core) Ku

[jira] [Assigned] (SPARK-28951) Add release announce template

2019-09-02 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28951?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-28951: - Assignee: Dongjoon Hyun > Add release announce template > -

[jira] [Resolved] (SPARK-28951) Add release announce template

2019-09-02 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28951?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-28951. --- Fix Version/s: 3.0.0 2.4.5 Resolution: Fixed Issue resolved by pul

[jira] [Commented] (SPARK-28372) Document Spark WEB UI

2019-09-02 Thread Pablo Langa Blanco (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16921026#comment-16921026 ] Pablo Langa Blanco commented on SPARK-28372: [~smilegator] We have a streami

[jira] [Commented] (SPARK-28373) Document JDBC/ODBC Server page

2019-09-02 Thread Pablo Langa Blanco (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16921019#comment-16921019 ] Pablo Langa Blanco commented on SPARK-28373: [~podongfeng] Ok i can take car

[jira] [Commented] (SPARK-27733) Upgrade to Avro 1.9.x

2019-09-02 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16921009#comment-16921009 ] Dongjoon Hyun commented on SPARK-27733: --- Great! Thank you for the follow-ups, [~Fo

[jira] [Created] (SPARK-28952) Getting Error using 'Linearregression' in spark 2.3.4

2019-09-02 Thread Sandeep Singh (Jira)
Sandeep Singh created SPARK-28952: - Summary: Getting Error using 'Linearregression' in spark 2.3.4 Key: SPARK-28952 URL: https://issues.apache.org/jira/browse/SPARK-28952 Project: Spark Issue

[jira] [Created] (SPARK-28951) Add release announce template

2019-09-02 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-28951: - Summary: Add release announce template Key: SPARK-28951 URL: https://issues.apache.org/jira/browse/SPARK-28951 Project: Spark Issue Type: Task Co

[jira] [Commented] (SPARK-28912) MatchError exception in CheckpointWriteHandler

2019-09-02 Thread Aleksandr Kashkirov (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16920979#comment-16920979 ] Aleksandr Kashkirov commented on SPARK-28912: - Steps to reproduce the error:

[jira] [Assigned] (SPARK-28463) Thriftserver throws java.math.BigDecimal incompatible with org.apache.hadoop.hive.common.type.HiveDecimal

2019-09-02 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang reassigned SPARK-28463: --- Assignee: Yuming Wang > Thriftserver throws java.math.BigDecimal incompatible with > org.a

[jira] [Resolved] (SPARK-28463) Thriftserver throws java.math.BigDecimal incompatible with org.apache.hadoop.hive.common.type.HiveDecimal

2019-09-02 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-28463. - Resolution: Fixed > Thriftserver throws java.math.BigDecimal incompatible with > org.apache.had

[jira] [Updated] (SPARK-28463) Thriftserver throws java.math.BigDecimal incompatible with org.apache.hadoop.hive.common.type.HiveDecimal

2019-09-02 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-28463: Fix Version/s: 3.0.0 > Thriftserver throws java.math.BigDecimal incompatible with > org.apache.ha

[jira] [Created] (SPARK-28950) FollowingUp: Change whereClause to be optional in DELETE

2019-09-02 Thread Xianyin Xin (Jira)
Xianyin Xin created SPARK-28950: --- Summary: FollowingUp: Change whereClause to be optional in DELETE Key: SPARK-28950 URL: https://issues.apache.org/jira/browse/SPARK-28950 Project: Spark Issue

[jira] [Updated] (SPARK-28950) [SPARK-28351] FollowingUp: Change whereClause to be optional in DELETE

2019-09-02 Thread Xianyin Xin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xianyin Xin updated SPARK-28950: Summary: [SPARK-28351] FollowingUp: Change whereClause to be optional in DELETE (was: FollowingUp

[jira] [Resolved] (SPARK-28705) drop the tables in AnalysisExternalCatalogSuite after the testcase execution

2019-09-02 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-28705. -- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 25427 [https://gi

[jira] [Assigned] (SPARK-28705) drop the tables in AnalysisExternalCatalogSuite after the testcase execution

2019-09-02 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-28705: Assignee: Sandeep Katta > drop the tables in AnalysisExternalCatalogSuite after the testc

[jira] [Updated] (SPARK-28949) Kubernetes CGroup leaking leads to Spark Pods hang in Pending status

2019-09-02 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28949?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-28949: - Description: After running Spark on k8s for a few days, some kubelet fails to create pod caused by warn

[jira] [Updated] (SPARK-28949) Kubernetes CGroup leaking leads to Spark Pods hang in Pending status

2019-09-02 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28949?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-28949: - Attachment: describe-executor-pod.txt > Kubernetes CGroup leaking leads to Spark Pods hang in Pending st

[jira] [Updated] (SPARK-28949) Kubernetes CGroup leaking leads to Spark Pods hang in Pending status

2019-09-02 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28949?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-28949: - Attachment: describe-driver-pod.txt > Kubernetes CGroup leaking leads to Spark Pods hang in Pending stat

[jira] [Created] (SPARK-28949) Kubernetes CGroup leaking leads to Spark Pods hang in Pending status

2019-09-02 Thread Kent Yao (Jira)
Kent Yao created SPARK-28949: Summary: Kubernetes CGroup leaking leads to Spark Pods hang in Pending status Key: SPARK-28949 URL: https://issues.apache.org/jira/browse/SPARK-28949 Project: Spark

[jira] [Commented] (SPARK-28025) HDFSBackedStateStoreProvider should not leak .crc files

2019-09-02 Thread Gabor Somogyi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16920706#comment-16920706 ] Gabor Somogyi commented on SPARK-28025: --- [~ste...@apache.org] I think adding "file

[jira] [Comment Edited] (SPARK-28906) `bin/spark-submit --version` shows incorrect info

2019-09-02 Thread Kazuaki Ishizaki (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16920594#comment-16920594 ] Kazuaki Ishizaki edited comment on SPARK-28906 at 9/2/19 8:48 AM:

[jira] [Commented] (SPARK-28916) Generated SpecificSafeProjection.apply method grows beyond 64 KB when use SparkSQL

2019-09-02 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16920692#comment-16920692 ] Wenchen Fan commented on SPARK-28916: - to double-check, this is just error message n

[jira] [Commented] (SPARK-27733) Upgrade to Avro 1.9.x

2019-09-02 Thread Fokko Driesprong (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16920685#comment-16920685 ] Fokko Driesprong commented on SPARK-27733: -- The regression issue has been resol

[jira] [Commented] (SPARK-28694) Add Java/Scala StructuredKerberizedKafkaWordCount examples

2019-09-02 Thread daile (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16920677#comment-16920677 ] daile commented on SPARK-28694: --- ok > Add Java/Scala StructuredKerberizedKafkaWordCount e

[jira] [Commented] (SPARK-18084) write.partitionBy() does not recognize nested columns that select() can access

2019-09-02 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-18084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16920676#comment-16920676 ] Wenchen Fan commented on SPARK-18084: - It looks to me that we should just add more d

[jira] [Commented] (SPARK-10892) Join with Data Frame returns wrong results

2019-09-02 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-10892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16920675#comment-16920675 ] Wenchen Fan commented on SPARK-10892: - This is kind of fixed in 3.0 by https://githu

[jira] [Commented] (SPARK-28694) Add Java/Scala StructuredKerberizedKafkaWordCount examples

2019-09-02 Thread hong dongdong (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16920674#comment-16920674 ] hong dongdong commented on SPARK-28694: --- [~726575...@qq.com] thanks, but I working

[jira] [Created] (SPARK-28948) support data source v2 in CREATE TABLE USING

2019-09-02 Thread Wenchen Fan (Jira)
Wenchen Fan created SPARK-28948: --- Summary: support data source v2 in CREATE TABLE USING Key: SPARK-28948 URL: https://issues.apache.org/jira/browse/SPARK-28948 Project: Spark Issue Type: New Fe

[jira] [Commented] (SPARK-28694) Add Java/Scala StructuredKerberizedKafkaWordCount examples

2019-09-02 Thread daile (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16920665#comment-16920665 ] daile commented on SPARK-28694: --- I will work on this > Add Java/Scala StructuredKerberize

[jira] [Created] (SPARK-28947) Status logging occurs on every state change but not at an interval for liveness.

2019-09-02 Thread Kent Yao (Jira)
Kent Yao created SPARK-28947: Summary: Status logging occurs on every state change but not at an interval for liveness. Key: SPARK-28947 URL: https://issues.apache.org/jira/browse/SPARK-28947 Project: Spa