[
https://issues.apache.org/jira/browse/SPARK-24402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-24402:
Assignee: Apache Spark (was: DB Tsai)
> Optimize `In` expression when only one element i
[
https://issues.apache.org/jira/browse/SPARK-24402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-24402:
Assignee: DB Tsai (was: Apache Spark)
> Optimize `In` expression when only one element i
[
https://issues.apache.org/jira/browse/SPARK-24828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Romeo Kienzer updated SPARK-24828:
--
Description:
As requested by [~hyukjin.kwon] here a new issue - related issue can be found
he
[
https://issues.apache.org/jira/browse/SPARK-17557?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16546059#comment-16546059
]
Romeo Kienzer commented on SPARK-17557:
---
Dear [~hyukjin.kwon] - I've done so - new
Romeo Kienzer created SPARK-24828:
-
Summary: Incompatible parquet formats -
java.lang.UnsupportedOperationException:
org.apache.parquet.column.values.dictionary.PlainValuesDictionary$PlainLongDictionary
Key: SPARK-24828
[
https://issues.apache.org/jira/browse/SPARK-24568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16546009#comment-16546009
]
Apache Spark commented on SPARK-24568:
--
User 'swapnilushinde' has created a pull re
[
https://issues.apache.org/jira/browse/SPARK-24568?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-24568:
Assignee: (was: Apache Spark)
> Code refactoring for DataType equalsXXX methods
> ---
[
https://issues.apache.org/jira/browse/SPARK-24568?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-24568:
Assignee: Apache Spark
> Code refactoring for DataType equalsXXX methods
> --
[
https://issues.apache.org/jira/browse/SPARK-24402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon updated SPARK-24402:
-
Fix Version/s: (was: 2.4.0)
> Optimize `In` expression when only one element in the collecti
[
https://issues.apache.org/jira/browse/SPARK-24402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon reopened SPARK-24402:
--
This was reverted.
> Optimize `In` expression when only one element in the collection or
> colle
[
https://issues.apache.org/jira/browse/SPARK-24798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
shengyao piao resolved SPARK-24798.
---
Resolution: Not A Problem
> sortWithinPartitions(xx) will failed in java.lang.NullPointerExc
[
https://issues.apache.org/jira/browse/SPARK-24798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16545973#comment-16545973
]
shengyao piao commented on SPARK-24798:
---
Hi [~mahmoudmahdi24] , [~dmateusp]
Thank
[
https://issues.apache.org/jira/browse/SPARK-24615?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16545962#comment-16545962
]
Saisai Shao commented on SPARK-24615:
-
Sorry [~tgraves] for the late response. Yes,
[
https://issues.apache.org/jira/browse/SPARK-17557?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16545961#comment-16545961
]
Hyukjin Kwon commented on SPARK-17557:
--
Please go ahead but I would alternatively o
[
https://issues.apache.org/jira/browse/SPARK-23255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16545960#comment-16545960
]
Hyukjin Kwon commented on SPARK-23255:
--
Please go ahead.
> Add user guide and exam
[
https://issues.apache.org/jira/browse/SPARK-24644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-24644.
--
Resolution: Invalid
Let me leave this resolved. Please reopen this if the same issue exists in
[
https://issues.apache.org/jira/browse/SPARK-20220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-20220.
--
Resolution: Fixed
Fix Version/s: 2.4.0
Issue resolved by pull request 21778
[https://gi
[
https://issues.apache.org/jira/browse/SPARK-20220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon reassigned SPARK-20220:
Assignee: Miklos Christine
> Add thrift scheduling pool config in scheduling docs
> -
[
https://issues.apache.org/jira/browse/SPARK-23259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-23259.
--
Resolution: Fixed
Fix Version/s: 2.4.0
Issue resolved by pull request 21780
[https://gi
[
https://issues.apache.org/jira/browse/SPARK-23259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon reassigned SPARK-23259:
Assignee: Feng Liu
> Clean up legacy code around hive external catalog
>
[
https://issues.apache.org/jira/browse/SPARK-21481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
chenzhiming updated SPARK-21481:
Attachment: idea64.exe
> Add indexOf method in ml.feature.HashingTF similar to mllib.feature.Hashi
[
https://issues.apache.org/jira/browse/SPARK-21481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
chenzhiming updated SPARK-21481:
Attachment: (was: idea64.exe)
> Add indexOf method in ml.feature.HashingTF similar to mllib.fe
[
https://issues.apache.org/jira/browse/SPARK-24615?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiangrui Meng updated SPARK-24615:
--
Summary: Accelerator-aware task scheduling for Spark (was: Accelerator
aware task scheduling
[
https://issues.apache.org/jira/browse/SPARK-24826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Michael Yannakopoulos updated SPARK-24826:
--
Description:
Running a self-join against a table derived from a parquet file w
Misha Dmitriev created SPARK-24827:
--
Summary: Some memory waste in History Server by strings in
AccumulableInfo objects
Key: SPARK-24827
URL: https://issues.apache.org/jira/browse/SPARK-24827
Project
[
https://issues.apache.org/jira/browse/SPARK-24826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Michael Yannakopoulos updated SPARK-24826:
--
Description:
Running a self-join against a table derived from a parquet file w
[
https://issues.apache.org/jira/browse/SPARK-24826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Michael Yannakopoulos updated SPARK-24826:
--
Attachment: part-0-48210471-3088-4cee-8670-a332444bae66-c000.gz.parquet
>
Michael Yannakopoulos created SPARK-24826:
-
Summary: Self-Join not working in Apache Spark 2.2.2
Key: SPARK-24826
URL: https://issues.apache.org/jira/browse/SPARK-24826
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-24801?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16545820#comment-16545820
]
Misha Dmitriev commented on SPARK-24801:
Correct, there are indeed 40583 instanc
[
https://issues.apache.org/jira/browse/SPARK-24402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiao Li resolved SPARK-24402.
-
Resolution: Fixed
Fix Version/s: 2.4.0
> Optimize `In` expression when only one element in the co
[
https://issues.apache.org/jira/browse/SPARK-24825?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Matt Cheah updated SPARK-24825:
---
Issue Type: Bug (was: Improvement)
> [K8S][TEST] Kubernetes integration tests don't trace the maven
Matt Cheah created SPARK-24825:
--
Summary: [K8S][TEST] Kubernetes integration tests don't trace the
maven project dependency structure
Key: SPARK-24825
URL: https://issues.apache.org/jira/browse/SPARK-24825
[
https://issues.apache.org/jira/browse/SPARK-24825?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Matt Cheah updated SPARK-24825:
---
Priority: Critical (was: Major)
> [K8S][TEST] Kubernetes integration tests don't trace the maven pr
[
https://issues.apache.org/jira/browse/SPARK-24805?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiao Li resolved SPARK-24805.
-
Resolution: Fixed
Assignee: Maxim Gekk
Fix Version/s: 2.4.0
> Don't ignore files without
[
https://issues.apache.org/jira/browse/SPARK-23901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiao Li updated SPARK-23901:
Fix Version/s: (was: 2.4.0)
> Data Masking Functions
> --
>
> Key:
[
https://issues.apache.org/jira/browse/SPARK-23901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiao Li resolved SPARK-23901.
-
Resolution: Won't Fix
> Data Masking Functions
> --
>
> Key: SPARK-2
[
https://issues.apache.org/jira/browse/SPARK-23901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiao Li reopened SPARK-23901:
-
> Data Masking Functions
> --
>
> Key: SPARK-23901
> URL
[
https://issues.apache.org/jira/browse/SPARK-24801?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16545676#comment-16545676
]
Imran Rashid commented on SPARK-24801:
--
I'm surprised there are so many {{Encrypted
[
https://issues.apache.org/jira/browse/SPARK-16617?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16545625#comment-16545625
]
Thomas Omans commented on SPARK-16617:
--
My code is getting the Schema.getLogicalTyp
[
https://issues.apache.org/jira/browse/SPARK-24644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16545589#comment-16545589
]
Bryan Cutler commented on SPARK-24644:
--
[~helkhalfi], the error in the stack trace
[
https://issues.apache.org/jira/browse/SPARK-24295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16545577#comment-16545577
]
Iqbal Singh commented on SPARK-24295:
-
Hey [~XuanYuan],
We are processing 3000 file
[
https://issues.apache.org/jira/browse/SPARK-17557?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16545557#comment-16545557
]
Romeo Kienzer commented on SPARK-17557:
---
[~jayadevan.m] [~hyukjin.kwon] can you pl
[
https://issues.apache.org/jira/browse/SPARK-17557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Romeo Kienzer updated SPARK-17557:
--
Attachment: a2_m2.parquet.zip
> SQL query on parquet table java.lang.UnsupportedOperationExcep
[
https://issues.apache.org/jira/browse/SPARK-23874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16545519#comment-16545519
]
Bryan Cutler commented on SPARK-23874:
--
[~smilegator], we are aiming to have the Ar
[
https://issues.apache.org/jira/browse/SPARK-23901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16545491#comment-16545491
]
Apache Spark commented on SPARK-23901:
--
User 'mn-mikke' has created a pull request
[
https://issues.apache.org/jira/browse/SPARK-23901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16545446#comment-16545446
]
Reynold Xin edited comment on SPARK-23901 at 7/16/18 4:31 PM:
[
https://issues.apache.org/jira/browse/SPARK-23901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16545446#comment-16545446
]
Reynold Xin commented on SPARK-23901:
-
I actually feel pretty strongly we should rem
[
https://issues.apache.org/jira/browse/SPARK-23901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16545443#comment-16545443
]
Marek Novotny commented on SPARK-23901:
---
Is there a consensus on getting the maski
[
https://issues.apache.org/jira/browse/SPARK-24787?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16545436#comment-16545436
]
Sanket Reddy commented on SPARK-24787:
--
[~vanzin] do you have any suggestions regar
[
https://issues.apache.org/jira/browse/SPARK-24734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan reassigned SPARK-24734:
---
Assignee: Takuya Ueshin
> Fix containsNull of Concat for array type.
>
[
https://issues.apache.org/jira/browse/SPARK-24734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-24734.
-
Resolution: Fixed
Fix Version/s: 2.4.0
Issue resolved by pull request 21704
[https://gith
[
https://issues.apache.org/jira/browse/SPARK-20174?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16545314#comment-16545314
]
Valery Khamenya commented on SPARK-20174:
-
Ok, I found a combo-workaround that s
[
https://issues.apache.org/jira/browse/SPARK-24813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen updated SPARK-24813:
--
Affects Version/s: (was: 2.1.3)
> HiveExternalCatalogVersionsSuite still flaky; fall back to Apach
[
https://issues.apache.org/jira/browse/SPARK-24529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16545284#comment-16545284
]
Apache Spark commented on SPARK-24529:
--
User 'wangyum' has created a pull request f
[
https://issues.apache.org/jira/browse/SPARK-18230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen resolved SPARK-18230.
---
Resolution: Fixed
Fix Version/s: 2.4.0
Issue resolved by pull request 21740
[https://github.c
[
https://issues.apache.org/jira/browse/SPARK-20174?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16545282#comment-16545282
]
Valery Khamenya commented on SPARK-20174:
-
Guys, I am tracking this issue for qu
[
https://issues.apache.org/jira/browse/SPARK-18230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen reassigned SPARK-18230:
-
Assignee: shahid
> MatrixFactorizationModel.recommendProducts throws NoSuchElement exception
>
[
https://issues.apache.org/jira/browse/SPARK-24615?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16545253#comment-16545253
]
Thomas Graves commented on SPARK-24615:
---
[~jerryshao] ^
> Accelerator aware task
[
https://issues.apache.org/jira/browse/SPARK-21097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16545240#comment-16545240
]
Brad commented on SPARK-21097:
--
Hi [~menelaus]
The processing time delay is just a way to
[
https://issues.apache.org/jira/browse/SPARK-15343?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16545225#comment-16545225
]
Antony commented on SPARK-15343:
{{--conf spark.hadoop.yarn.timeline-service.enabled=fal
[
https://issues.apache.org/jira/browse/SPARK-24182?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16545167#comment-16545167
]
Apache Spark commented on SPARK-24182:
--
User 'wangyum' has created a pull request f
[
https://issues.apache.org/jira/browse/SPARK-20050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sasaki Toru resolved SPARK-20050.
-
Resolution: Not A Problem
> Kafka 0.10 DirectStream doesn't commit last processed batch's offset
[
https://issues.apache.org/jira/browse/SPARK-24799?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16545032#comment-16545032
]
Apache Spark commented on SPARK-24799:
--
User 'marymwu' has created a pull request f
[
https://issues.apache.org/jira/browse/SPARK-24812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sujith updated SPARK-24812:
---
Description:
Last Access Time in the table description is not valid,
Test steps:
Step 1 - create a table
[
https://issues.apache.org/jira/browse/SPARK-24812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sujith updated SPARK-24812:
---
Attachment: image-2018-07-16-15-38-26-717.png
> Last Access Time in the table description is not valid
> ---
[
https://issues.apache.org/jira/browse/SPARK-24812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sujith updated SPARK-24812:
---
Attachment: image-2018-07-16-15-37-28-896.png
> Last Access Time in the table description is not valid
> ---
[
https://issues.apache.org/jira/browse/SPARK-24816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-24816:
Comment: was deleted
(was: I'm working on.)
> SQL interface support repartitionByRange
>
[
https://issues.apache.org/jira/browse/SPARK-24816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-24816:
Assignee: Apache Spark
> SQL interface support repartitionByRange
> -
[
https://issues.apache.org/jira/browse/SPARK-24816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-24816:
Assignee: (was: Apache Spark)
> SQL interface support repartitionByRange
> --
[
https://issues.apache.org/jira/browse/SPARK-24816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16544980#comment-16544980
]
Apache Spark commented on SPARK-24816:
--
User 'wangyum' has created a pull request f
[
https://issues.apache.org/jira/browse/SPARK-24794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16544973#comment-16544973
]
Ecaterina commented on SPARK-24794:
---
Yes, I also face this problem. Would be nice if s
[
https://issues.apache.org/jira/browse/SPARK-24816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-24816:
Description:
SQL interface support {{repartitionByRange}} to improvement data pushdown. I
have te
Jiang Xingbo created SPARK-24824:
Summary: Make Spark task speculation a per-stage config
Key: SPARK-24824
URL: https://issues.apache.org/jira/browse/SPARK-24824
Project: Spark
Issue Type: Im
Jiang Xingbo created SPARK-24823:
Summary: Cancel a job that contains barrier stage(s) if the
barrier tasks don't get launched within a configured time
Key: SPARK-24823
URL: https://issues.apache.org/jira/browse/S
Jiang Xingbo created SPARK-24822:
Summary: Python support for barrier execution mode
Key: SPARK-24822
URL: https://issues.apache.org/jira/browse/SPARK-24822
Project: Spark
Issue Type: New Fea
Jiang Xingbo created SPARK-24821:
Summary: Fail fast when submitted job compute on a subset of all
the partitions for a barrier stage
Key: SPARK-24821
URL: https://issues.apache.org/jira/browse/SPARK-24821
Jiang Xingbo created SPARK-24820:
Summary: Fail fast when submitted job contains PartitionPruningRDD
in a barrier stage
Key: SPARK-24820
URL: https://issues.apache.org/jira/browse/SPARK-24820
Project:
Jiang Xingbo created SPARK-24819:
Summary: Fail fast when no enough slots to launch the barrier
stage on job submitted
Key: SPARK-24819
URL: https://issues.apache.org/jira/browse/SPARK-24819
Project:
Jiang Xingbo created SPARK-24818:
Summary: Ensure all the barrier tasks in the same stage are
launched together
Key: SPARK-24818
URL: https://issues.apache.org/jira/browse/SPARK-24818
Project: Spark
Jiang Xingbo created SPARK-24817:
Summary: Implement BarrierTaskContext.barrier()
Key: SPARK-24817
URL: https://issues.apache.org/jira/browse/SPARK-24817
Project: Spark
Issue Type: New Featur
[
https://issues.apache.org/jira/browse/SPARK-24538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan updated SPARK-24538:
Summary: ByteArrayDecimalType support push down to parquet data sources
(was: ByteArrayDecimalTyp
[
https://issues.apache.org/jira/browse/SPARK-24538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-24538.
-
Resolution: Fixed
Assignee: Yuming Wang
Fix Version/s: 2.4.0
Target
[
https://issues.apache.org/jira/browse/SPARK-24549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan reassigned SPARK-24549:
---
Assignee: Yuming Wang
> Support DecimalType push down to the parquet data sources
> ---
[
https://issues.apache.org/jira/browse/SPARK-21791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16544899#comment-16544899
]
Furcy Pin commented on SPARK-21791:
---
Indeed, it works like this.
Awesome! thanks!
[
https://issues.apache.org/jira/browse/SPARK-24816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-24816:
Attachment: DISTRIBUTE_BY_SORT_BY.png
RANGE_DISTRIBUTE_BY_SORT_BY.png
> SQL interf
85 matches
Mail list logo