[jira] [Created] (SPARK-30343) Skip unnecessary checks in RewriteDistinctAggregates

2019-12-24 Thread Takeshi Yamamuro (Jira)
Takeshi Yamamuro created SPARK-30343: Summary: Skip unnecessary checks in RewriteDistinctAggregates Key: SPARK-30343 URL: https://issues.apache.org/jira/browse/SPARK-30343 Project: Spark

[jira] [Commented] (SPARK-28990) SparkSQL invalid call to toAttribute on unresolved object, tree: *

2019-12-24 Thread lucusguo (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17002724#comment-17002724 ] lucusguo commented on SPARK-28990: -- [~fengchaoge] [~stephenwoo] [~xiaozhang] spark-sql

[jira] [Created] (SPARK-30344) After compilation, no available jar package was generated

2019-12-24 Thread liu (Jira)
liu created SPARK-30344: --- Summary: After compilation, no available jar package was generated Key: SPARK-30344 URL: https://issues.apache.org/jira/browse/SPARK-30344 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-30344) After compilation, no available jar package was generated

2019-12-24 Thread liu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liu updated SPARK-30344: Attachment: spark-build.jpg > After compilation, no available jar package was generated >

[jira] [Updated] (SPARK-30344) After compilation, no available jar package was generated

2019-12-24 Thread liu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liu updated SPARK-30344: Environment: CentOS7 + scala 2.12.10 + jdk1.8.0_232 (was: Build Env : CentOS7 + scala 2.12.10 + jdk1.8.0_232) >

[jira] [Updated] (SPARK-30344) After compilation, no available jar package was generated

2019-12-24 Thread liu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liu updated SPARK-30344: Environment: Spark3.0.0 + CentOS7 + scala 2.12.10 + jdk1.8.0_232 (was: CentOS7 + scala 2.12.10 + jdk1.8.0_232) >

[jira] [Created] (SPARK-30345) Flaky test failure: ThriftServerWithSparkContextSuite.SPARK-29911: Uncache cached tables when session closed

2019-12-24 Thread Jungtaek Lim (Jira)
Jungtaek Lim created SPARK-30345: Summary: Flaky test failure: ThriftServerWithSparkContextSuite.SPARK-29911: Uncache cached tables when session closed Key: SPARK-30345 URL: https://issues.apache.org/jira/browse/

[jira] [Resolved] (SPARK-30344) After compilation, no available jar package was generated

2019-12-24 Thread liu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liu resolved SPARK-30344. - Resolution: Fixed  Run the following command: {{./dev/make-distribution.sh}} Fill in the required parameters,t

[jira] [Created] (SPARK-30346) Improve logging when events dropped

2019-12-24 Thread liupengcheng (Jira)
liupengcheng created SPARK-30346: Summary: Improve logging when events dropped Key: SPARK-30346 URL: https://issues.apache.org/jira/browse/SPARK-30346 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-30347) LibSVMDataSource attach AttributeGroup

2019-12-24 Thread zhengruifeng (Jira)
zhengruifeng created SPARK-30347: Summary: LibSVMDataSource attach AttributeGroup Key: SPARK-30347 URL: https://issues.apache.org/jira/browse/SPARK-30347 Project: Spark Issue Type: Improvemen

[jira] [Created] (SPARK-30348) Flaky test: org.apache.spark.deploy.master.MasterSuite.SPARK-27510: Master should avoid dead loop while launching executor failed in Worker

2019-12-24 Thread Jungtaek Lim (Jira)
Jungtaek Lim created SPARK-30348: Summary: Flaky test: org.apache.spark.deploy.master.MasterSuite.SPARK-27510: Master should avoid dead loop while launching executor failed in Worker Key: SPARK-30348 URL: https:

[jira] [Commented] (SPARK-30332) When running sql query with limit catalyst throw StackOverFlow exception

2019-12-24 Thread TALIBI Omar (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17002923#comment-17002923 ] TALIBI Omar commented on SPARK-30332: - Do you get all the results when you don't use

[jira] [Resolved] (SPARK-29505) desc extended is case sensitive

2019-12-24 Thread Takeshi Yamamuro (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-29505. -- Fix Version/s: 3.0.0 Assignee: pavithra ramachandran Resolution: Fixed

[jira] [Commented] (SPARK-24783) spark.sql.shuffle.partitions=0 should throw exception

2019-12-24 Thread Cheng Shi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-24783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17003033#comment-17003033 ] Cheng Shi commented on SPARK-24783: --- What's the point of setting it to 0? > spark.sql

[jira] [Assigned] (SPARK-30178) RobustScaler support bigger numFeatures

2019-12-24 Thread zhengruifeng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhengruifeng reassigned SPARK-30178: Assignee: zhengruifeng > RobustScaler support bigger numFeatures > --

[jira] [Resolved] (SPARK-30178) RobustScaler support bigger numFeatures

2019-12-24 Thread zhengruifeng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhengruifeng resolved SPARK-30178. -- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 26803 [https://gi

[jira] [Created] (SPARK-30349) The result is wrong when joining tables with selecting the same columns

2019-12-24 Thread cen yuhai (Jira)
cen yuhai created SPARK-30349: - Summary: The result is wrong when joining tables with selecting the same columns Key: SPARK-30349 URL: https://issues.apache.org/jira/browse/SPARK-30349 Project: Spark

[jira] [Updated] (SPARK-30349) The result is wrong when joining tables with selecting the same columns

2019-12-24 Thread cen yuhai (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] cen yuhai updated SPARK-30349: -- Environment: hadoop-2.8.4 spark 2.4.4 (was:       ```sql with tmp as( select log_date, buvid,

[jira] [Updated] (SPARK-30349) The result is wrong when joining tables with selecting the same columns

2019-12-24 Thread cen yuhai (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] cen yuhai updated SPARK-30349: -- Description: ```sql with tmp as( select log_date, buvid, manga_id, sum(readtime) readtime from

[jira] [Updated] (SPARK-30349) The result is wrong when joining tables with selecting the same columns

2019-12-24 Thread cen yuhai (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] cen yuhai updated SPARK-30349: -- Description: ```sql       ```sql with tmp as( select log_date, buvid, manga_id, sum(readtime

[jira] [Updated] (SPARK-30349) The result is wrong when joining tables with selecting the same columns

2019-12-24 Thread cen yuhai (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] cen yuhai updated SPARK-30349: -- Description: ```sql with tmp as( select log_date, buvid, manga_id, sum(readtime) readtime from

[jira] [Updated] (SPARK-30349) The result is wrong when joining tables with selecting the same columns

2019-12-24 Thread cen yuhai (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] cen yuhai updated SPARK-30349: -- Description: {code:java} // code placeholder {code} with tmp as( select log_date, buvid, manga_id,

[jira] [Updated] (SPARK-30349) The result is wrong when joining tables with selecting the same columns

2019-12-24 Thread cen yuhai (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] cen yuhai updated SPARK-30349: -- Description: {code:java} // code placeholder with tmp as( select log_date, buvid, manga_id, sum(readti

[jira] [Updated] (SPARK-30349) The result is wrong when joining tables with selecting the same columns

2019-12-24 Thread cen yuhai (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] cen yuhai updated SPARK-30349: -- Description: {code:java} // code placeholder with tmp as( select log_date, buvid, manga_id, sum(readti

[jira] [Updated] (SPARK-30349) The result is wrong when joining tables with selecting the same columns

2019-12-24 Thread cen yuhai (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] cen yuhai updated SPARK-30349: -- Description: {code:java} // code placeholder with tmp as( select log_date, buvid, manga_id, sum(readti

[jira] [Updated] (SPARK-30349) The result is wrong when joining tables with selecting the same columns

2019-12-24 Thread cen yuhai (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] cen yuhai updated SPARK-30349: -- Attachment: screenshot-1.png > The result is wrong when joining tables with selecting the same columns

[jira] [Updated] (SPARK-30349) The result is wrong when joining tables with selecting the same columns

2019-12-24 Thread cen yuhai (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] cen yuhai updated SPARK-30349: -- Description: {code:sql} // code placeholder with tmp as( select log_date, buvid, manga_id, sum(readtim

[jira] [Updated] (SPARK-30349) The result is wrong when joining tables with selecting the same columns

2019-12-24 Thread cen yuhai (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] cen yuhai updated SPARK-30349: -- Description: {code:sql} // code placeholder with tmp as( select log_date, buvid, manga_id, sum(readtim

[jira] [Updated] (SPARK-30349) The result is wrong when joining tables with selecting the same columns

2019-12-24 Thread cen yuhai (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] cen yuhai updated SPARK-30349: -- Attachment: screenshot-2.png > The result is wrong when joining tables with selecting the same columns

[jira] [Commented] (SPARK-30349) The result is wrong when joining tables with selecting the same columns

2019-12-24 Thread cen yuhai (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17003063#comment-17003063 ] cen yuhai commented on SPARK-30349: --- [~smilegator] > The result is wrong when joinin

[jira] [Commented] (SPARK-30349) The result is wrong when joining tables with selecting the same columns

2019-12-24 Thread cen yuhai (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17003065#comment-17003065 ] cen yuhai commented on SPARK-30349: --- {code} select a.name, b.name from a join b on a.

[jira] [Comment Edited] (SPARK-30349) The result is wrong when joining tables with selecting the same columns

2019-12-24 Thread cen yuhai (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17003065#comment-17003065 ] cen yuhai edited comment on SPARK-30349 at 12/25/19 3:49 AM: -

[jira] [Created] (SPARK-30350) Fix ScalaReflection to use an empty array for getting its class object

2019-12-24 Thread Kengo Seki (Jira)
Kengo Seki created SPARK-30350: -- Summary: Fix ScalaReflection to use an empty array for getting its class object Key: SPARK-30350 URL: https://issues.apache.org/jira/browse/SPARK-30350 Project: Spark

[jira] [Issue Comment Deleted] (SPARK-30349) The result is wrong when joining tables with selecting the same columns

2019-12-24 Thread cen yuhai (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] cen yuhai updated SPARK-30349: -- Comment: was deleted (was: {code} select a.name, b.name from a join b on a.id = b.id {code} this sql

[jira] [Created] (SPARK-30351) BisectingKMeans support instance weighting

2019-12-24 Thread zhengruifeng (Jira)
zhengruifeng created SPARK-30351: Summary: BisectingKMeans support instance weighting Key: SPARK-30351 URL: https://issues.apache.org/jira/browse/SPARK-30351 Project: Spark Issue Type: Improv