[jira] [Updated] (SPARK-26138) Cross join requires push LocalLimit in LimitPushDown rule
[ https://issues.apache.org/jira/browse/SPARK-26138?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] guoxiaolong updated SPARK-26138: Summary: Cross join requires push LocalLimit in LimitPushDown rule (was: LimitPushDown cross join requires maybeBushLocalLimit) > Cross join requires push LocalLimit in LimitPushDown rule > - > > Key: SPARK-26138 > URL: https://issues.apache.org/jira/browse/SPARK-26138 > Project: Spark > Issue Type: Improvement > Components: SQL >Affects Versions: 2.3.2, 2.4.0 >Reporter: guoxiaolong >Priority: Minor > > In LimitPushDown batch, cross join can push down the limit. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-26138) LimitPushDown cross join requires maybeBushLocalLimit
guoxiaolong created SPARK-26138: --- Summary: LimitPushDown cross join requires maybeBushLocalLimit Key: SPARK-26138 URL: https://issues.apache.org/jira/browse/SPARK-26138 Project: Spark Issue Type: Improvement Components: SQL Affects Versions: 2.4.0, 2.3.2 Reporter: guoxiaolong In LimitPushDown batch, cross join can push down the limit. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Issue Comment Deleted] (SPARK-19862) In SparkEnv.scala,shortShuffleMgrNames tungsten-sort can be deleted.
[ https://issues.apache.org/jira/browse/SPARK-19862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] guoxiaolong updated SPARK-19862: Comment: was deleted (was: @srowen In spark2.1.0,"tungsten-sort" -> classOf[org.apache.spark.shuffle.sort.SortShuffleManager].getName has been deleted,but you didn't agree with my issue SPARK-19862.why?) > In SparkEnv.scala,shortShuffleMgrNames tungsten-sort can be deleted. > - > > Key: SPARK-19862 > URL: https://issues.apache.org/jira/browse/SPARK-19862 > Project: Spark > Issue Type: Improvement > Components: Spark Core >Affects Versions: 2.0.2 >Reporter: guoxiaolong >Priority: Trivial > > "tungsten-sort" -> > classOf[org.apache.spark.shuffle.sort.SortShuffleManager].getName can be > deleted. Because it is the same of "sort" -> > classOf[org.apache.spark.shuffle.sort.SortShuffleManager].getName. -- This message was sent by Atlassian JIRA (v6.3.15#6346) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-19862) In SparkEnv.scala,shortShuffleMgrNames tungsten-sort can be deleted.
[ https://issues.apache.org/jira/browse/SPARK-19862?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15950438#comment-15950438 ] guoxiaolong commented on SPARK-19862: - @srowen In spark2.1.0,"tungsten-sort" -> classOf[org.apache.spark.shuffle.sort.SortShuffleManager].getName has been deleted,but you didn't agree with my issue SPARK-19862.why? > In SparkEnv.scala,shortShuffleMgrNames tungsten-sort can be deleted. > - > > Key: SPARK-19862 > URL: https://issues.apache.org/jira/browse/SPARK-19862 > Project: Spark > Issue Type: Improvement > Components: Spark Core >Affects Versions: 2.0.2 >Reporter: guoxiaolong >Priority: Trivial > > "tungsten-sort" -> > classOf[org.apache.spark.shuffle.sort.SortShuffleManager].getName can be > deleted. Because it is the same of "sort" -> > classOf[org.apache.spark.shuffle.sort.SortShuffleManager].getName. -- This message was sent by Atlassian JIRA (v6.3.15#6346) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-19862) In SparkEnv.scala,shortShuffleMgrNames tungsten-sort can be deleted.
[ https://issues.apache.org/jira/browse/SPARK-19862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] guoxiaolong updated SPARK-19862: Affects Version/s: (was: 2.1.0) 2.0.2 > In SparkEnv.scala,shortShuffleMgrNames tungsten-sort can be deleted. > - > > Key: SPARK-19862 > URL: https://issues.apache.org/jira/browse/SPARK-19862 > Project: Spark > Issue Type: Improvement > Components: Spark Core >Affects Versions: 2.0.2 >Reporter: guoxiaolong >Priority: Trivial > > "tungsten-sort" -> > classOf[org.apache.spark.shuffle.sort.SortShuffleManager].getName can be > deleted. Because it is the same of "sort" -> > classOf[org.apache.spark.shuffle.sort.SortShuffleManager].getName. -- This message was sent by Atlassian JIRA (v6.3.15#6346) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-19880) About spark2.0.2 and spark1.4.1 beeline to show the database, use the default operation such as dealing with different
[ https://issues.apache.org/jira/browse/SPARK-19880?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15902679#comment-15902679 ] guoxiaolong commented on SPARK-19880: - But When a job dispose time is very long,such as query operation.lead to the back of the show databases, use the default operations need to wait a long time. > About spark2.0.2 and spark1.4.1 beeline to show the database, use the default > operation such as dealing with different > -- > > Key: SPARK-19880 > URL: https://issues.apache.org/jira/browse/SPARK-19880 > Project: Spark > Issue Type: Bug > Components: SQL >Affects Versions: 2.1.0 >Reporter: guoxiaolong > > About spark2.0.2 and spark1.4.1 beeline to show the database, use the default > operation such as dealing with different > .why show databases,use default such operation need execute a job in > spark2.0.2 .When a job task is very much, time is very long,such as query > operation, lead to the back of the show databases, use the default operations > such as waiting in line.But When a job task is very much, time is very > long,such as query operation, lead to the back of the show databases, use the > default operations no need to wait -- This message was sent by Atlassian JIRA (v6.3.15#6346) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-19880) About spark2.0.2 and spark1.4.1 beeline to show the database, use the default operation such as dealing with different
[ https://issues.apache.org/jira/browse/SPARK-19880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] guoxiaolong updated SPARK-19880: Description: About spark2.0.2 and spark1.4.1 beeline to show the database, use the default operation such as dealing with different .why show databases,use default such operation need execute a job in spark2.0.2 .When a job task is very much, time is very long,such as query operation, lead to the back of the show databases, use the default operations such as waiting in line.But When a job task is very much, time is very long,such as query operation, lead to the back of the show databases, use the default operations no need to wait was: About spark2.0.2 and spark1.4.1 beeline to show the database, use the default operation such as dealing with different .why show databases,use default such operation need execute a job in spark2.0.2 .When a job task is very much, time is very long,such as query operation, lead to the back of the show databases, use the default operations such as waiting in line > About spark2.0.2 and spark1.4.1 beeline to show the database, use the default > operation such as dealing with different > -- > > Key: SPARK-19880 > URL: https://issues.apache.org/jira/browse/SPARK-19880 > Project: Spark > Issue Type: Bug > Components: SQL >Affects Versions: 2.1.0 >Reporter: guoxiaolong > > About spark2.0.2 and spark1.4.1 beeline to show the database, use the default > operation such as dealing with different > .why show databases,use default such operation need execute a job in > spark2.0.2 .When a job task is very much, time is very long,such as query > operation, lead to the back of the show databases, use the default operations > such as waiting in line.But When a job task is very much, time is very > long,such as query operation, lead to the back of the show databases, use the > default operations no need to wait -- This message was sent by Atlassian JIRA (v6.3.15#6346) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-19880) About spark2.0.2 and spark1.4.1 beeline to show the database, use the default operation such as dealing with different
guoxiaolong created SPARK-19880: --- Summary: About spark2.0.2 and spark1.4.1 beeline to show the database, use the default operation such as dealing with different Key: SPARK-19880 URL: https://issues.apache.org/jira/browse/SPARK-19880 Project: Spark Issue Type: Bug Components: SQL Affects Versions: 2.1.0 Reporter: guoxiaolong About spark2.0.2 and spark1.4.1 beeline to show the database, use the default operation such as dealing with different .why show databases,use default such operation need execute a job in spark2.0.2 .When a job task is very much, time is very long,such as query operation, lead to the back of the show databases, use the default operations such as waiting in line -- This message was sent by Atlassian JIRA (v6.3.15#6346) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-19862) In SparkEnv.scala,shortShuffleMgrNames tungsten-sort can be deleted.
[ https://issues.apache.org/jira/browse/SPARK-19862?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15902263#comment-15902263 ] guoxiaolong commented on SPARK-19862: - remove tungsten-sort.Because it is not represent 'org.apache.spark.shuffle.unsafe.UnsafeShuffleManager'.so,it should be deleted. > In SparkEnv.scala,shortShuffleMgrNames tungsten-sort can be deleted. > - > > Key: SPARK-19862 > URL: https://issues.apache.org/jira/browse/SPARK-19862 > Project: Spark > Issue Type: Improvement > Components: Spark Core >Affects Versions: 2.1.0 >Reporter: guoxiaolong >Priority: Trivial > > "tungsten-sort" -> > classOf[org.apache.spark.shuffle.sort.SortShuffleManager].getName can be > deleted. Because it is the same of "sort" -> > classOf[org.apache.spark.shuffle.sort.SortShuffleManager].getName. -- This message was sent by Atlassian JIRA (v6.3.15#6346) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-19862) In SparkEnv.scala,shortShuffleMgrNames tungsten-sort can be deleted.
guoxiaolong created SPARK-19862: --- Summary: In SparkEnv.scala,shortShuffleMgrNames tungsten-sort can be deleted. Key: SPARK-19862 URL: https://issues.apache.org/jira/browse/SPARK-19862 Project: Spark Issue Type: Bug Components: Spark Core Affects Versions: 2.1.0 Reporter: guoxiaolong Priority: Minor "tungsten-sort" -> classOf[org.apache.spark.shuffle.sort.SortShuffleManager].getName can be deleted. Because it is the same of "sort" -> classOf[org.apache.spark.shuffle.sort.SortShuffleManager].getName. -- This message was sent by Atlassian JIRA (v6.3.15#6346) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-19103) In web ui,URL's host name should be a specific IP address.
[ https://issues.apache.org/jira/browse/SPARK-19103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15810312#comment-15810312 ] guoxiaolong commented on SPARK-19103: - Yes,if is not a ip,browser opens this address 404.Please see the attachment 3.png. > In web ui,URL's host name should be a specific IP address. > -- > > Key: SPARK-19103 > URL: https://issues.apache.org/jira/browse/SPARK-19103 > Project: Spark > Issue Type: Bug > Components: Web UI > Environment: spark 2.0.2 >Reporter: guoxiaolong >Priority: Minor > Attachments: 1.png, 2.png, 3.png > > > In web ui,URL's host name should be a specific IP address.Because open URL > must be resolve host name.It can not find host name.So URL can not > find.Please see the attachment.Thank you! -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-19103) In web ui,URL's host name should be a specific IP address.
[ https://issues.apache.org/jira/browse/SPARK-19103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] guoxiaolong updated SPARK-19103: Attachment: 3.png > In web ui,URL's host name should be a specific IP address. > -- > > Key: SPARK-19103 > URL: https://issues.apache.org/jira/browse/SPARK-19103 > Project: Spark > Issue Type: Bug > Components: Web UI > Environment: spark 2.0.2 >Reporter: guoxiaolong >Priority: Minor > Attachments: 1.png, 2.png, 3.png > > > In web ui,URL's host name should be a specific IP address.Because open URL > must be resolve host name.It can not find host name.So URL can not > find.Please see the attachment.Thank you! -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-19103) In web ui,URL's host name should be a specific IP address.
[ https://issues.apache.org/jira/browse/SPARK-19103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15807033#comment-15807033 ] guoxiaolong commented on SPARK-19103: - Because the browser opens this address 404.We must configure the domain name and IP mapping in the hosts file..Please see the attachment.3.png > In web ui,URL's host name should be a specific IP address. > -- > > Key: SPARK-19103 > URL: https://issues.apache.org/jira/browse/SPARK-19103 > Project: Spark > Issue Type: Bug > Components: Web UI > Environment: spark 2.0.2 >Reporter: guoxiaolong >Priority: Minor > Attachments: 1.png, 2.png > > > In web ui,URL's host name should be a specific IP address.Because open URL > must be resolve host name.It can not find host name.So URL can not > find.Please see the attachment.Thank you! -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-19103) In web ui,URL's host name should be a specific IP address.
[ https://issues.apache.org/jira/browse/SPARK-19103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] guoxiaolong updated SPARK-19103: Attachment: 2.png 1.png > In web ui,URL's host name should be a specific IP address. > -- > > Key: SPARK-19103 > URL: https://issues.apache.org/jira/browse/SPARK-19103 > Project: Spark > Issue Type: Bug > Components: Web UI > Environment: spark 2.0.2 >Reporter: guoxiaolong >Priority: Minor > Attachments: 1.png, 2.png > > > In web ui,URL's host name should be a specific IP address.Because open URL > must be resolve host name.It can not find host name.So URL can not > find.Please see the attachment.Thank you! -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-19103) In web ui,URL's host name should be a specific IP address.
guoxiaolong created SPARK-19103: --- Summary: In web ui,URL's host name should be a specific IP address. Key: SPARK-19103 URL: https://issues.apache.org/jira/browse/SPARK-19103 Project: Spark Issue Type: Bug Components: Web UI Environment: spark 2.0.2 Reporter: guoxiaolong Priority: Minor In web ui,URL's host name should be a specific IP address.Because open URL must be resolve host name.It can not find host name.So URL can not find.Please see the attachment.Thank you! -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
