Simon Tao created SPARK-45152:
-
Summary: Add left-inclusive Param to Bucketizer
Key: SPARK-45152
URL: https://issues.apache.org/jira/browse/SPARK-45152
Project: Spark
Issue Type: New Feature
[
https://issues.apache.org/jira/browse/SPARK-45078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ran Tao updated SPARK-45078:
Description:
Generally speaking, array_insert has same insert semantic with
array_prepend/array_append.
[
https://issues.apache.org/jira/browse/SPARK-45078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ran Tao updated SPARK-45078:
Description:
Generally speaking, array_insert has same insert semantic with
array_prepend/array_append.
[
https://issues.apache.org/jira/browse/SPARK-45078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ran Tao updated SPARK-45078:
Description:
Generally speaking, array_insert has same insert semantic with
array_prepend/array_append.
Ran Tao created SPARK-45078:
---
Summary: The ArrayInsert function should make explicit casting
when element type not equals derived component type
Key: SPARK-45078
URL: https://issues.apache.org/jira/browse/SPARK-45078
[
https://issues.apache.org/jira/browse/SPARK-37285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17569887#comment-17569887
]
Simon Tao commented on SPARK-37285:
---
[~podongfeng] This algorithm has been implemented
Xinran Tao created SPARK-39257:
--
Summary: use spark.read.jdbc() to read data from SQL databse into
dataframe, it fails silently, when the session is killed from SQL server side
Key: SPARK-39257
URL: https://issues.ap
Hai Tao created SPARK-39232:
---
Summary: Spark History Main Page App List Filtering
Key: SPARK-39232
URL: https://issues.apache.org/jira/browse/SPARK-39232
Project: Spark
Issue Type: Improvement
[
https://issues.apache.org/jira/browse/SPARK-39225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hai Tao updated SPARK-39225:
Target Version/s: 3.2.1, 3.1.2, 3.0.3, 3.4.0, 3.3.1 (was: 3.0.3, 3.1.2,
3.2.1, 3.4.0, 3.3.1)
[
https://issues.apache.org/jira/browse/SPARK-39225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17538953#comment-17538953
]
Hai Tao commented on SPARK-39225:
-
Created PR https://github.com/apache/spark/pull/36597
Hai Tao created SPARK-39225:
---
Summary: History Server initial scan may block new eventlog update
Key: SPARK-39225
URL: https://issues.apache.org/jira/browse/SPARK-39225
Project: Spark
Issue Type: I
Simon Tao created SPARK-37285:
-
Summary: Add Weight of Evidence and Information value to ml.feature
Key: SPARK-37285
URL: https://issues.apache.org/jira/browse/SPARK-37285
Project: Spark
Issue Ty
Simon Tao created SPARK-37178:
-
Summary: Add Target Encoding to ml.feature
Key: SPARK-37178
URL: https://issues.apache.org/jira/browse/SPARK-37178
Project: Spark
Issue Type: New Feature
[
https://issues.apache.org/jira/browse/SPARK-27546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16871213#comment-16871213
]
Jiatao Tao commented on SPARK-27546:
Hello [~dongjoon]
Anyone ?
> Should repalce D
[
https://issues.apache.org/jira/browse/SPARK-28035?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16862928#comment-16862928
]
Jiatao Tao commented on SPARK-28035:
this test "multiple-key equi-join is hash-join"
[
https://issues.apache.org/jira/browse/SPARK-28035?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16862927#comment-16862927
]
Jiatao Tao commented on SPARK-28035:
The title means hash-join, but when I debug, fo
[
https://issues.apache.org/jira/browse/SPARK-28035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jiatao Tao updated SPARK-28035:
---
Attachment: image-2019-06-13-10-32-06-759.png
> Test JoinSuite."equi-join is hash-join" is incompati
Jiatao Tao created SPARK-28035:
--
Summary: Test JoinSuite."equi-join is hash-join" is incompatible
with its title.
Key: SPARK-28035
URL: https://issues.apache.org/jira/browse/SPARK-28035
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-27546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jiatao Tao reopened SPARK-27546:
Hi, I update the comment, could someone take a look?
> Should repalce DateTimeUtils#defaultTimeZoneus
[
https://issues.apache.org/jira/browse/SPARK-27546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16860491#comment-16860491
]
Jiatao Tao edited comment on SPARK-27546 at 6/11/19 2:46 AM:
-
[
https://issues.apache.org/jira/browse/SPARK-27546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16860491#comment-16860491
]
Jiatao Tao commented on SPARK-27546:
After reading the code,
Although I have set "
[
https://issues.apache.org/jira/browse/SPARK-27546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16860491#comment-16860491
]
Jiatao Tao edited comment on SPARK-27546 at 6/11/19 2:42 AM:
-
[
https://issues.apache.org/jira/browse/SPARK-27546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16860489#comment-16860489
]
Jiatao Tao edited comment on SPARK-27546 at 6/11/19 2:40 AM:
-
[
https://issues.apache.org/jira/browse/SPARK-27546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16860489#comment-16860489
]
Jiatao Tao commented on SPARK-27546:
Hi [~dongjoon]
What I get is "ts", not the
[
https://issues.apache.org/jira/browse/SPARK-27546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16823808#comment-16823808
]
Jiatao Tao edited comment on SPARK-27546 at 5/13/19 7:18 AM:
-
[
https://issues.apache.org/jira/browse/SPARK-27546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16823801#comment-16823801
]
Jiatao Tao edited comment on SPARK-27546 at 4/23/19 8:17 AM:
-
[
https://issues.apache.org/jira/browse/SPARK-27546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16823808#comment-16823808
]
Jiatao Tao commented on SPARK-27546:
So in my opinion, we should change DateTimeUtil
[
https://issues.apache.org/jira/browse/SPARK-27546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16823801#comment-16823801
]
Jiatao Tao edited comment on SPARK-27546 at 4/23/19 8:10 AM:
-
[
https://issues.apache.org/jira/browse/SPARK-27546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16823801#comment-16823801
]
Jiatao Tao commented on SPARK-27546:
see an example like this:
{code:java}
// con
Jiatao Tao created SPARK-27546:
--
Summary: Should repalce DateTimeUtils#defaultTimeZoneuse with
sessionLocalTimeZone
Key: SPARK-27546
URL: https://issues.apache.org/jira/browse/SPARK-27546
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-12154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16730601#comment-16730601
]
Jiatao Tao commented on SPARK-12154:
Hadoop use 1.x, it's a nightmare.
> Upgrade to
[
https://issues.apache.org/jira/browse/SPARK-23002?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16629859#comment-16629859
]
Rann Tao commented on SPARK-23002:
--
got It. thanks! :) [~Adam Wang]
> SparkUI inconsis
[
https://issues.apache.org/jira/browse/SPARK-23002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ran Tao updated SPARK-23002:
Description:
As the picture shows, driver name is ip address and other executors are machine
hostname.
!h
[
https://issues.apache.org/jira/browse/SPARK-23002?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16319653#comment-16319653
]
Ran Tao edited comment on SPARK-23002 at 1/10/18 3:46 AM:
--
I fou
[
https://issues.apache.org/jira/browse/SPARK-23002?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16319653#comment-16319653
]
Ran Tao edited comment on SPARK-23002 at 1/10/18 3:44 AM:
--
I fou
[
https://issues.apache.org/jira/browse/SPARK-23002?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16319653#comment-16319653
]
Ran Tao edited comment on SPARK-23002 at 1/10/18 3:43 AM:
--
I fou
[
https://issues.apache.org/jira/browse/SPARK-23002?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16319653#comment-16319653
]
Ran Tao edited comment on SPARK-23002 at 1/10/18 3:43 AM:
--
I fou
[
https://issues.apache.org/jira/browse/SPARK-23002?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16319653#comment-16319653
]
Ran Tao commented on SPARK-23002:
-
I found that in the YARN mode, how to get driver hostn
[
https://issues.apache.org/jira/browse/SPARK-23002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ran Tao updated SPARK-23002:
Priority: Major (was: Minor)
> SparkUI inconsistent driver hostname compare with other executors
> ---
[
https://issues.apache.org/jira/browse/SPARK-23002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ran Tao updated SPARK-23002:
Description:
As the picture shows, driver name is ip address and other executors are machine
hostname.
!h
[
https://issues.apache.org/jira/browse/SPARK-23002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ran Tao updated SPARK-23002:
Priority: Minor (was: Major)
Description:
As the picture shows, driver name is ip address and other
[
https://issues.apache.org/jira/browse/SPARK-23002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ran Tao updated SPARK-23002:
Description:
!https://raw.githubusercontent.com/Lemonjing/issues-assets/master/pics/driver.png!
as the pict
[
https://issues.apache.org/jira/browse/SPARK-23002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ran Tao updated SPARK-23002:
Description:
!https://raw.githubusercontent.com/Lemonjing/issues-assets/master/pics/driver.png!
*As the pi
Ran Tao created SPARK-23002:
---
Summary: SparkUI inconsistent driver hostname compare with other
executors
Key: SPARK-23002
URL: https://issues.apache.org/jira/browse/SPARK-23002
Project: Spark
Issu
[
https://issues.apache.org/jira/browse/SPARK-21118?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16051766#comment-16051766
]
tao commented on SPARK-21118:
-
ok,thanks
> OOM with 2 handred million vertex when mitrx mul
[
https://issues.apache.org/jira/browse/SPARK-21118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
tao updated SPARK-21118:
Description:
i have 2 matrix each one is 200milions*200milions.
i want to multiply them ,but run out with oom .
fin
[
https://issues.apache.org/jira/browse/SPARK-21118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
tao updated SPARK-21118:
Description:
i have 2 matrix each one is 200milions*200milions.
i want to multiply them ,but run out with oom .
fin
[
https://issues.apache.org/jira/browse/SPARK-21118?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16051604#comment-16051604
]
tao edited comment on SPARK-21118 at 6/16/17 8:47 AM:
--
i add some i
[
https://issues.apache.org/jira/browse/SPARK-21118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
tao reopened SPARK-21118:
-
i add some mot information to desciption,please have a look
> OOM with 2 handred million vertex when mitrx multply
[
https://issues.apache.org/jira/browse/SPARK-21118?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16051602#comment-16051602
]
tao edited comment on SPARK-21118 at 6/16/17 8:43 AM:
--
is there othe
[
https://issues.apache.org/jira/browse/SPARK-21118?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16051602#comment-16051602
]
tao commented on SPARK-21118:
-
is there other way to do matirx multiply
> OOM with 2 handred
[
https://issues.apache.org/jira/browse/SPARK-21118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
tao updated SPARK-21118:
Description:
i have 2 matrix each one is 200milions*200milions.
i want to multiply them ,but run out with oom .
fin
[
https://issues.apache.org/jira/browse/SPARK-21118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
tao updated SPARK-21118:
Description:
i have 2 matrix each one is 200milions*200milions.
i want to multiply them ,but run out with oom .
fin
[
https://issues.apache.org/jira/browse/SPARK-21118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
tao updated SPARK-21118:
Description:
i have 2 matrix each one is 200milions*200milions.
i want to multiply them ,but run out with oom .
fin
[
https://issues.apache.org/jira/browse/SPARK-21118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
tao updated SPARK-21118:
Description:
i have 2 matrix each one is 200milions*200milions.
i want to build the mcl so must to multiply then ,b
[
https://issues.apache.org/jira/browse/SPARK-21118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
tao updated SPARK-21118:
Description:
i have 2 matrix each on is 200milions*200milions.
i want to build the mcl so must to multiy then ,but
[
https://issues.apache.org/jira/browse/SPARK-21118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
tao updated SPARK-21118:
Description:
i have 2 matrix each one is 200milions*200milions.
i want to build the mcl so must to multiy then ,but
[
https://issues.apache.org/jira/browse/SPARK-21118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
tao updated SPARK-21118:
Description:
i have 2 dateset with 200 milion vertex.
i build the two dataset to tow matrix then to multiply them .
[
https://issues.apache.org/jira/browse/SPARK-21118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
tao updated SPARK-21118:
Description:
i have 2 dateset with 2000 milion vertex.
i build the two dataset to tow matrix then to multiply them
tao created SPARK-21118:
---
Summary: OOM with 2 handred million vertex when mitrx multply
Key: SPARK-21118
URL: https://issues.apache.org/jira/browse/SPARK-21118
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-4036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14942708#comment-14942708
]
Narisu Tao commented on SPARK-4036:
---
What is the current status of the ticket? Is it sti
61 matches
Mail list logo
