[
https://issues.apache.org/jira/browse/SPARK-39153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
jingxiong zhong resolved SPARK-39153.
-
Resolution: Not A Problem
> When we look at spark UI or History, we can see the failed
[
https://issues.apache.org/jira/browse/SPARK-39967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
jingxiong zhong resolved SPARK-39967.
-
Resolution: Fixed
New version not reproduced
> Instead of using the scalar
jingxiong zhong created SPARK-42392:
---
Summary: Add a new case of TriggeredByExecutorDecommissionInfo to
remove unnecessary param
Key: SPARK-42392
URL: https://issues.apache.org/jira/browse/SPARK-42392
[
https://issues.apache.org/jira/browse/SPARK-42336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
jingxiong zhong updated SPARK-42336:
Summary: Use getOrElse() instead of contains() in(was: Use OpenHashMap
instead of
[
https://issues.apache.org/jira/browse/SPARK-42336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
jingxiong zhong updated SPARK-42336:
Summary: Use getOrElse() instead of contains() in ResourceAllocator (was:
Use
[
https://issues.apache.org/jira/browse/SPARK-42336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
jingxiong zhong updated SPARK-42336:
Description: In ResourceAllocator, we can use `.getOrElse(address, throw
new
jingxiong zhong created SPARK-42336:
---
Summary: Use OpenHashMap instead of HashMap
Key: SPARK-42336
URL: https://issues.apache.org/jira/browse/SPARK-42336
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-41982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17672320#comment-17672320
]
jingxiong zhong commented on SPARK-41982:
-
cc [~cloud_fan] [~gurwls223] I want to know your
[
https://issues.apache.org/jira/browse/SPARK-41982?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
jingxiong zhong updated SPARK-41982:
Description:
At present, during the process of upgrading Spark2.4 to Spark3.2, we
[
https://issues.apache.org/jira/browse/SPARK-41982?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
jingxiong zhong updated SPARK-41982:
Description:
At present, during the process of upgrading Spark2.4 to Spark3.2, we
[
https://issues.apache.org/jira/browse/SPARK-41982?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
jingxiong zhong updated SPARK-41982:
Description:
At present, during the process of upgrading Spark2.4 to Spark3.2, we
jingxiong zhong created SPARK-41982:
---
Summary: When the inserted partition type is of string type,
similar `dt=01` will be converted to `dt=1`
Key: SPARK-41982
URL:
jingxiong zhong created SPARK-41943:
---
Summary: Use java api to create files and grant permissions is
DiskBlockManager
Key: SPARK-41943
URL: https://issues.apache.org/jira/browse/SPARK-41943
[
https://issues.apache.org/jira/browse/SPARK-37677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17653733#comment-17653733
]
jingxiong zhong commented on SPARK-37677:
-
At present, I have repaired Hadoop version 3.3.5, but
[
https://issues.apache.org/jira/browse/SPARK-37521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
jingxiong zhong resolved SPARK-37521.
-
Resolution: Won't Fix
> insert overwrite table but the partition information stored in
[
https://issues.apache.org/jira/browse/SPARK-41769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
jingxiong zhong resolved SPARK-41769.
-
Resolution: Won't Fix
> Remove useless semicolons
> -
>
>
[
https://issues.apache.org/jira/browse/SPARK-41769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
jingxiong zhong updated SPARK-41769:
Component/s: (was: Spark Core)
> Remove useless semicolons
>
jingxiong zhong created SPARK-41769:
---
Summary: Remove useless semicolons
Key: SPARK-41769
URL: https://issues.apache.org/jira/browse/SPARK-41769
Project: Spark
Issue Type: Improvement
[
https://issues.apache.org/jira/browse/SPARK-41236?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17638532#comment-17638532
]
jingxiong zhong commented on SPARK-41236:
-
I think you can a pr for it [~huldar]
> The renamed
[
https://issues.apache.org/jira/browse/SPARK-41236?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17638532#comment-17638532
]
jingxiong zhong edited comment on SPARK-41236 at 11/25/22 7:14 AM:
---
I
[
https://issues.apache.org/jira/browse/SPARK-41236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
jingxiong zhong updated SPARK-41236:
Description:
{code:java}
select collect_set(age) as age
from db_table.table1
group by
[
https://issues.apache.org/jira/browse/SPARK-41229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
jingxiong zhong updated SPARK-41229:
Description:
SQL1:
{code:java}
with table_hive1 as(select * from db1.table_hive)
select *
[
https://issues.apache.org/jira/browse/SPARK-41236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
jingxiong zhong updated SPARK-41236:
Description:
{code:java}
select collect_set(age) as age
from db_table.table1
group by
[
https://issues.apache.org/jira/browse/SPARK-41236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
jingxiong zhong updated SPARK-41236:
Description:
{code:java}
select collect_set(age) as age
from db_table.table1
group by
[
https://issues.apache.org/jira/browse/SPARK-41236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
jingxiong zhong updated SPARK-41236:
Description:
{code:java}
select collect_set(age) as age
from db_table.table1
group by
[
https://issues.apache.org/jira/browse/SPARK-41236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
jingxiong zhong updated SPARK-41236:
Description:
`select collect_set(age) as age
from db_table.table1
group by name
having
[
https://issues.apache.org/jira/browse/SPARK-41236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
jingxiong zhong updated SPARK-41236:
Description:
`select collect_set(age) as age
from db_table.table1
group by name
having
[
https://issues.apache.org/jira/browse/SPARK-41229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17638148#comment-17638148
]
jingxiong zhong commented on SPARK-41229:
-
Sorry,:(I don't know what’s the self-contained
[
https://issues.apache.org/jira/browse/SPARK-41229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
jingxiong zhong updated SPARK-41229:
Description:
SQL1:
```with table_hive1 as(select * from db1.table_hive)
select * from
[
https://issues.apache.org/jira/browse/SPARK-41229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
jingxiong zhong updated SPARK-41229:
Description:
SQL1:
```with table_hive1 as(select * from db1.table_hive)
select * from
[
https://issues.apache.org/jira/browse/SPARK-41236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
jingxiong zhong updated SPARK-41236:
Description:
`select collect_set(age) as age
from db_table.table1
group by name
having
[
https://issues.apache.org/jira/browse/SPARK-41236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
jingxiong zhong updated SPARK-41236:
Description:
`select collect_set(age) as age
from db_table.table1
group by name
having
[
https://issues.apache.org/jira/browse/SPARK-41236?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17638142#comment-17638142
]
jingxiong zhong commented on SPARK-41236:
-
Thanks a lot, Is it to write the specific case like
[
https://issues.apache.org/jira/browse/SPARK-41236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
jingxiong zhong updated SPARK-41236:
Description:
`select collect_set(age) as age
from db_table.table1
group by name
having
[
https://issues.apache.org/jira/browse/SPARK-41236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
jingxiong zhong updated SPARK-41236:
Summary: The renamed field name cannot be recognized after group filtering
(was: The
jingxiong zhong created SPARK-41236:
---
Summary: The renamed field name cannot be recognized after group
filtering, but it is the same as the original field name
Key: SPARK-41236
URL:
[
https://issues.apache.org/jira/browse/SPARK-41229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
jingxiong zhong updated SPARK-41229:
Description:
SQL1:
```with table_hive1 as(select * from db1.table_hive)
select * from
[
https://issues.apache.org/jira/browse/SPARK-41229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17637595#comment-17637595
]
jingxiong zhong commented on SPARK-41229:
-
[~cloud_fan] Could you help me about this?
> When
[
https://issues.apache.org/jira/browse/SPARK-41229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
jingxiong zhong updated SPARK-41229:
Description:
SQL1:
```with table_hive1 as(select * from db1.table_hive)
select * from
jingxiong zhong created SPARK-41229:
---
Summary: When using `db_ name.temp_ table_name`, an exception will
be thrown
Key: SPARK-41229
URL: https://issues.apache.org/jira/browse/SPARK-41229
Project:
[
https://issues.apache.org/jira/browse/SPARK-40916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
jingxiong zhong resolved SPARK-40916.
-
Resolution: Fixed
add --conf spark.sql.subexpressionElimination.enabled=false
> udf
jingxiong zhong created SPARK-40916:
---
Summary: udf could not filter null value cause npe
Key: SPARK-40916
URL: https://issues.apache.org/jira/browse/SPARK-40916
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-39967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
jingxiong zhong updated SPARK-39967:
Description: When counting the number of successful tasks in the stage of
spark, spark
[
https://issues.apache.org/jira/browse/SPARK-39967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
jingxiong zhong updated SPARK-39967:
Attachment: spark1-1.png
spark2.png
spark3-1.png
>
jingxiong zhong created SPARK-39967:
---
Summary: Instead of using the scalar tasksSuccessful, use the
successful array to calculate whether the task is completed
Key: SPARK-39967
URL:
jingxiong zhong created SPARK-39153:
---
Summary: When we look at spark UI or History, we can see the
failed tasks first
Key: SPARK-39153
URL: https://issues.apache.org/jira/browse/SPARK-39153
[
https://issues.apache.org/jira/browse/SPARK-37677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17480381#comment-17480381
]
jingxiong zhong commented on SPARK-37677:
-
[~hyukjin.kwon] Hey sir, I brought up another one for
[
https://issues.apache.org/jira/browse/SPARK-37708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
jingxiong zhong resolved SPARK-37708.
-
Resolution: Not A Problem
> pyspark adding third-party Dependencies on k8s
>
[
https://issues.apache.org/jira/browse/SPARK-35715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17475135#comment-17475135
]
jingxiong zhong edited comment on SPARK-35715 at 1/13/22, 7:00 AM:
---
It
[
https://issues.apache.org/jira/browse/SPARK-35715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17475135#comment-17475135
]
jingxiong zhong commented on SPARK-35715:
-
t seems that spark 3 does not support the schema
[
https://issues.apache.org/jira/browse/SPARK-37708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17471014#comment-17471014
]
jingxiong zhong commented on SPARK-37708:
-
[~hyukjin.kwon]In the end, we found that the
[
https://issues.apache.org/jira/browse/SPARK-37677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17467251#comment-17467251
]
jingxiong zhong commented on SPARK-37677:
-
I found that unzip is implemented by decompressing
[
https://issues.apache.org/jira/browse/SPARK-37708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17465060#comment-17465060
]
jingxiong zhong edited comment on SPARK-37708 at 12/24/21, 5:28 PM:
[
https://issues.apache.org/jira/browse/SPARK-37708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17465060#comment-17465060
]
jingxiong zhong edited comment on SPARK-37708 at 12/24/21, 5:24 PM:
[
https://issues.apache.org/jira/browse/SPARK-37708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17465060#comment-17465060
]
jingxiong zhong commented on SPARK-37708:
-
[~hyukjin.kwon] I found some packages downloaded,
[
https://issues.apache.org/jira/browse/SPARK-37708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17465058#comment-17465058
]
jingxiong zhong commented on SPARK-37708:
-
I used wget to download and compile the source code,
[
https://issues.apache.org/jira/browse/SPARK-37708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
jingxiong zhong updated SPARK-37708:
Component/s: Kubernetes
> pyspark adding third-party Dependencies on k8s
>
[
https://issues.apache.org/jira/browse/SPARK-37708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
jingxiong zhong updated SPARK-37708:
Description:
I have a question about that how do I add my Python dependencies to Spark
[
https://issues.apache.org/jira/browse/SPARK-37708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
jingxiong zhong updated SPARK-37708:
Description:
I have a question about that how do I add my Python dependencies to Spark
jingxiong zhong created SPARK-37708:
---
Summary: pyspark adding third-party Dependencies on k8s
Key: SPARK-37708
URL: https://issues.apache.org/jira/browse/SPARK-37708
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-26404?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17463384#comment-17463384
]
jingxiong zhong edited comment on SPARK-26404 at 12/21/21, 5:52 PM:
[
https://issues.apache.org/jira/browse/SPARK-26404?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17463384#comment-17463384
]
jingxiong zhong commented on SPARK-26404:
-
@gollum999Tim Sanders,hey sir, I have a question
[
https://issues.apache.org/jira/browse/SPARK-37677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17461800#comment-17461800
]
jingxiong zhong commented on SPARK-37677:
-
:D
> spark on k8s, when the user want to push
[
https://issues.apache.org/jira/browse/SPARK-37677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17461799#comment-17461799
]
jingxiong zhong commented on SPARK-37677:
-
Let me have a try.
> spark on k8s, when the user
[ https://issues.apache.org/jira/browse/SPARK-37677 ]
jingxiong zhong deleted comment on SPARK-37677:
-
was (Author: JIRAUSER281124):
:D
> spark on k8s, when the user want to push python3.6.6.zip to the pod , but no
> permission to execute
[
https://issues.apache.org/jira/browse/SPARK-37677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17461797#comment-17461797
]
jingxiong zhong commented on SPARK-37677:
-
can we fix it throuth modify file permissions when
[
https://issues.apache.org/jira/browse/SPARK-36088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17461405#comment-17461405
]
jingxiong zhong commented on SPARK-36088:
-
@hyukjin.kwon I make an issue at
jingxiong zhong created SPARK-37677:
---
Summary: spark on k8s, when the user want to push python3.6.6.zip
to the pod , but no permission to execute
Key: SPARK-37677
URL:
[
https://issues.apache.org/jira/browse/SPARK-37521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17452521#comment-17452521
]
jingxiong zhong edited comment on SPARK-37521 at 12/17/21, 10:45 AM:
-
[
https://issues.apache.org/jira/browse/SPARK-36088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17461230#comment-17461230
]
jingxiong zhong edited comment on SPARK-36088 at 12/17/21, 6:53 AM:
[
https://issues.apache.org/jira/browse/SPARK-36088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17461230#comment-17461230
]
jingxiong zhong commented on SPARK-36088:
-
In cluster mode, I hava another question that when I
[
https://issues.apache.org/jira/browse/SPARK-37521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
jingxiong zhong updated SPARK-37521:
Issue Type: Bug (was: New Bugzilla Project)
> insert overwrite table but the partition
[
https://issues.apache.org/jira/browse/SPARK-37521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
jingxiong zhong updated SPARK-37521:
Issue Type: New Bugzilla Project (was: Question)
> insert overwrite table but the
[
https://issues.apache.org/jira/browse/SPARK-37521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
jingxiong zhong updated SPARK-37521:
Summary: insert overwrite table but the partition information stored in
Metastore was not
[
https://issues.apache.org/jira/browse/SPARK-37521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17452521#comment-17452521
]
jingxiong zhong commented on SPARK-37521:
-
The schema of metasotre's updated partition was not
[
https://issues.apache.org/jira/browse/SPARK-37521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
jingxiong zhong updated SPARK-37521:
Description:
I create a partitioned table in SparkSQL, insert a data entry, add a regular
jingxiong zhong created SPARK-37521:
---
Summary: insert overwrite table but didn't change the message of
metastore
Key: SPARK-37521
URL: https://issues.apache.org/jira/browse/SPARK-37521
Project:
77 matches
Mail list logo
