Yuming Wang created SPARK-28510:
---
Summary: Implement Spark's own GetFunctionsOperation
Key: SPARK-28510
URL: https://issues.apache.org/jira/browse/SPARK-28510
Project: Spark
Issue Type: Sub-tas
[
https://issues.apache.org/jira/browse/SPARK-28377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16892414#comment-16892414
]
Takeshi Yamamuro commented on SPARK-28377:
--
ur, I see.
> Fully support correla
[
https://issues.apache.org/jira/browse/SPARK-28377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16892404#comment-16892404
]
Yuming Wang commented on SPARK-28377:
-
It’s SQL standard. *Feature ID*: E051-08
>
[
https://issues.apache.org/jira/browse/SPARK-28497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16892369#comment-16892369
]
Dongjoon Hyun commented on SPARK-28497:
---
Is this issue targeting `master` only, [~
[
https://issues.apache.org/jira/browse/SPARK-25590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun closed SPARK-25590.
-
> kubernetes-model-2.0.0.jar masks default Spark logging config
> --
[
https://issues.apache.org/jira/browse/SPARK-27442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16892366#comment-16892366
]
angerszhu commented on SPARK-27442:
---
auto writing data, change format to orc. orc can
[
https://issues.apache.org/jira/browse/SPARK-28152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16892362#comment-16892362
]
Dongjoon Hyun commented on SPARK-28152:
---
This is merged to `branch-2.4` via https:
[
https://issues.apache.org/jira/browse/SPARK-28152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-28152:
--
Fix Version/s: 2.4.4
> Mapped ShortType to SMALLINT and FloatType to REAL for MsSqlServerDiale
[
https://issues.apache.org/jira/browse/SPARK-27442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16892358#comment-16892358
]
Hyukjin Kwon commented on SPARK-27442:
--
simply rename it before writing out.
> Par
[
https://issues.apache.org/jira/browse/SPARK-28377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16892351#comment-16892351
]
Takeshi Yamamuro commented on SPARK-28377:
--
In the other systems, this column r
[
https://issues.apache.org/jira/browse/SPARK-27442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16892348#comment-16892348
]
angerszhu commented on SPARK-27442:
---
Meet same problem, can't write parquet file with
[
https://issues.apache.org/jira/browse/SPARK-27931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16892324#comment-16892324
]
Yuming Wang commented on SPARK-27931:
-
This ticket has a low priority.
> Accept 'on
[
https://issues.apache.org/jira/browse/SPARK-28377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16892323#comment-16892323
]
Yuming Wang commented on SPARK-28377:
-
[~younggyuchun] [~maropu] I think this ticket
[
https://issues.apache.org/jira/browse/SPARK-28496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-28496:
--
Fix Version/s: 2.4.4
> Use branch name instead of tag during dry-run
> ---
[
https://issues.apache.org/jira/browse/SPARK-28465?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Marcelo Vanzin resolved SPARK-28465.
Resolution: Fixed
Fix Version/s: 3.0.0
Issue resolved by pull request 25222
[https:
[
https://issues.apache.org/jira/browse/SPARK-28465?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Marcelo Vanzin reassigned SPARK-28465:
--
Assignee: Stavros Kontopoulos
> K8s integration tests fail due to missing ceph-nano i
[
https://issues.apache.org/jira/browse/SPARK-28509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16892219#comment-16892219
]
shane knapp commented on SPARK-28509:
-
ok, all fixed and builds are passing on this
[
https://issues.apache.org/jira/browse/SPARK-28509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
shane knapp resolved SPARK-28509.
-
Resolution: Fixed
> K8S integration tests are failing
> -
>
>
[
https://issues.apache.org/jira/browse/SPARK-28237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yesheng Ma updated SPARK-28237:
---
Summary: Idempotence checker for Idempotent batches in RuleExecutors (was:
Add a new batch strategy
[
https://issues.apache.org/jira/browse/SPARK-28496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Marcelo Vanzin resolved SPARK-28496.
Resolution: Fixed
Fix Version/s: 3.0.0
Issue resolved by pull request 25240
[https:
[
https://issues.apache.org/jira/browse/SPARK-28496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Marcelo Vanzin reassigned SPARK-28496:
--
Assignee: Dongjoon Hyun
> Use branch name instead of tag during dry-run
> ---
[
https://issues.apache.org/jira/browse/SPARK-28482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-28482:
--
Summary: Data incomplete when using pandas udf in Python 3 (was: Data
incomplete when using p
[
https://issues.apache.org/jira/browse/SPARK-28489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Shixiong Zhu updated SPARK-28489:
-
Affects Version/s: 2.4.0
2.4.1
2.4.2
> KafkaOffset
[
https://issues.apache.org/jira/browse/SPARK-28509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16892165#comment-16892165
]
shane knapp commented on SPARK-28509:
-
the entire k8s config on worker-09 is complet
[
https://issues.apache.org/jira/browse/SPARK-28509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16892142#comment-16892142
]
shane knapp commented on SPARK-28509:
-
ah, got it!
it's research-jenkins-worker-09!
[
https://issues.apache.org/jira/browse/SPARK-28509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
shane knapp reassigned SPARK-28509:
---
Assignee: shane knapp
> K8S integration tests are failing
> ---
[
https://issues.apache.org/jira/browse/SPARK-28509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16892137#comment-16892137
]
shane knapp commented on SPARK-28509:
-
as a precautionary step, on all ubuntu worker
[
https://issues.apache.org/jira/browse/SPARK-28489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Shixiong Zhu updated SPARK-28489:
-
Description:
KafkaOffsetRangeCalculator.getRanges may drop offsets due to round off errors.
[
https://issues.apache.org/jira/browse/SPARK-16548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16892098#comment-16892098
]
ShivaKumar SS commented on SPARK-16548:
---
Hello guys,
I am using Spark 2.3.0 and
[
https://issues.apache.org/jira/browse/SPARK-28509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16892079#comment-16892079
]
Marcelo Vanzin commented on SPARK-28509:
[~shaneknapp] in case this is an infra
Marcelo Vanzin created SPARK-28509:
--
Summary: K8S integration tests are failing
Key: SPARK-28509
URL: https://issues.apache.org/jira/browse/SPARK-28509
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-28293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiao Li resolved SPARK-28293.
-
Resolution: Fixed
Assignee: Yuming Wang
Fix Version/s: 3.0.0
> Implement Spark's own Get
Dylan Guedes created SPARK-28508:
Summary: Support for range frame+row frame in the same query
Key: SPARK-28508
URL: https://issues.apache.org/jira/browse/SPARK-28508
Project: Spark
Issue Typ
[
https://issues.apache.org/jira/browse/SPARK-27812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16892037#comment-16892037
]
Erik Erlandson commented on SPARK-27812:
Agreed with [~skonto] that downgrading
Huaxin Gao created SPARK-28507:
--
Summary: remove deprecated API context(self, sqlContext) from
pyspark/ml/util.py
Key: SPARK-28507
URL: https://issues.apache.org/jira/browse/SPARK-28507
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-28506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dylan Guedes updated SPARK-28506:
-
Summary: not handling usage of group function and window function at some
conditions (was: now
Dylan Guedes created SPARK-28506:
Summary: now handling usage of group function and window function
at some conditions
Key: SPARK-28506
URL: https://issues.apache.org/jira/browse/SPARK-28506
Project:
[
https://issues.apache.org/jira/browse/SPARK-20856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dylan Guedes updated SPARK-20856:
-
Description:
While DB2, ORACLE etc support a join expressed as follows, SPARK SQL does not.
Not
Juarez Rudsatz created SPARK-28505:
--
Summary: Add data source option for omitting partitioned columns
when saving to file
Key: SPARK-28505
URL: https://issues.apache.org/jira/browse/SPARK-28505
Proje
Kyle Winkelman created SPARK-28504:
--
Summary: Web UI does not always honor spark.ui.proxyBase and
X-Forwarded-Context
Key: SPARK-28504
URL: https://issues.apache.org/jira/browse/SPARK-28504
Project:
[
https://issues.apache.org/jira/browse/SPARK-28502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Nasir Ali updated SPARK-28502:
--
Description:
What I am trying to do: Group data based on time intervals (e.g., 15 days
window) and pe
[
https://issues.apache.org/jira/browse/SPARK-28503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16891982#comment-16891982
]
Gengliang Wang commented on SPARK-28503:
I am working on this.
> Return null re
Gengliang Wang created SPARK-28503:
--
Summary: Return null result on cast an out-of-range value to a
numeric type
Key: SPARK-28503
URL: https://issues.apache.org/jira/browse/SPARK-28503
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-28502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Nasir Ali updated SPARK-28502:
--
Description:
What I am trying to do: Group data based on time intervals (e.g., 15 days
window) and pe
[
https://issues.apache.org/jira/browse/SPARK-25590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Marcelo Vanzin resolved SPARK-25590.
Resolution: Duplicate
> kubernetes-model-2.0.0.jar masks default Spark logging config
> --
Nasir Ali created SPARK-28502:
-
Summary: Error with struct conversion while using pandas_udf
Key: SPARK-28502
URL: https://issues.apache.org/jira/browse/SPARK-28502
Project: Spark
Issue Type: Que
[
https://issues.apache.org/jira/browse/SPARK-28483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Weichen Xu updated SPARK-28483:
---
Summary: Canceling a spark job using barrier mode but barrier tasks do not
exit (was: Canceling a s
[
https://issues.apache.org/jira/browse/SPARK-28091?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Luca Canali updated SPARK-28091:
Summary: Extend Spark metrics system with user-defined metrics using
executor plugins (was: Exten
[
https://issues.apache.org/jira/browse/SPARK-28091?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Luca Canali updated SPARK-28091:
Description:
This proposes to improve Spark instrumentation by adding a hook for
user-defined met
[
https://issues.apache.org/jira/browse/SPARK-28500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16891930#comment-16891930
]
Yuming Wang commented on SPARK-28500:
-
ok. thank you.
> adds support for `filter` c
[
https://issues.apache.org/jira/browse/SPARK-25382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen updated SPARK-25382:
--
Docs Text: In Spark 3.0.0, the deprecated ImageSchema class and its
readImages methods have been remov
[
https://issues.apache.org/jira/browse/SPARK-27931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16891867#comment-16891867
]
YoungGyu Chun commented on SPARK-27931:
---
[~yumwang] [~maropu]
Does SPARK-27764 it
[
https://issues.apache.org/jira/browse/SPARK-28500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16891833#comment-16891833
]
Dylan Guedes commented on SPARK-28500:
--
Hmm you are correct, there's some overlappi
[
https://issues.apache.org/jira/browse/SPARK-28500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16891832#comment-16891832
]
Yuming Wang commented on SPARK-28500:
-
Duplicate with SPARK-27986?
> adds support f
[
https://issues.apache.org/jira/browse/SPARK-27986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-27986:
Comment: was deleted
(was: Duplicate with SPARK-27986?)
> Support Aggregate Expressions
> ---
[
https://issues.apache.org/jira/browse/SPARK-27986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16891831#comment-16891831
]
Yuming Wang commented on SPARK-27986:
-
Duplicate with SPARK-27986?
> Support Aggreg
Dylan Guedes created SPARK-28501:
Summary: frame bound must be a literal
Key: SPARK-28501
URL: https://issues.apache.org/jira/browse/SPARK-28501
Project: Spark
Issue Type: Sub-task
[
https://issues.apache.org/jira/browse/SPARK-28065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dylan Guedes updated SPARK-28065:
-
Description:
Currently, Spark does not accept null as an input for `ntile`, or zero, however
Po
[
https://issues.apache.org/jira/browse/SPARK-28065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dylan Guedes updated SPARK-28065:
-
Summary: ntile only accepting posivile (>0) values (was: ntile does not
accept NULL as input)
[
https://issues.apache.org/jira/browse/SPARK-28065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dylan Guedes updated SPARK-28065:
-
Summary: ntile only accepting positive (>0) values (was: ntile only
accepting posivile (>0) val
Dylan Guedes created SPARK-28500:
Summary: adds support for `filter` clause
Key: SPARK-28500
URL: https://issues.apache.org/jira/browse/SPARK-28500
Project: Spark
Issue Type: Sub-task
[
https://issues.apache.org/jira/browse/SPARK-18356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16891759#comment-16891759
]
Konstantin Sk commented on SPARK-18356:
---
Hey, I have a spark version 2.4.3 and I s
[
https://issues.apache.org/jira/browse/SPARK-8165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
David Berger closed SPARK-8165.
---
> sqlContext.createDataFrame(dataWithoutHeader, csvSchema) type conversion
> error after .cache
> --
[
https://issues.apache.org/jira/browse/SPARK-28499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
zhengruifeng updated SPARK-28499:
-
Description:
current impl of MinMaxScaler has some small places to be optimized:
1, avoid call
zhengruifeng created SPARK-28499:
Summary: Optimize MinMaxScaler
Key: SPARK-28499
URL: https://issues.apache.org/jira/browse/SPARK-28499
Project: Spark
Issue Type: Improvement
Compo
Wenchen Fan created SPARK-28498:
---
Summary: always create a fresh copy of the SparkSession before
each test
Key: SPARK-28498
URL: https://issues.apache.org/jira/browse/SPARK-28498
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-28482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-28482:
--
Affects Version/s: 2.3.3
> Data incomplete when using pandas udf in pyspark
>
[
https://issues.apache.org/jira/browse/SPARK-28482?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16891692#comment-16891692
]
Dongjoon Hyun commented on SPARK-28482:
---
Thank you for the confirmation, [~jiangyu
Gengliang Wang created SPARK-28497:
--
Summary: Disallow upcasting complex data types to string type
Key: SPARK-28497
URL: https://issues.apache.org/jira/browse/SPARK-28497
Project: Spark
Issu
[
https://issues.apache.org/jira/browse/SPARK-28494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16891669#comment-16891669
]
Hyukjin Kwon commented on SPARK-28494:
--
Nope but seems like the argument is that we
[
https://issues.apache.org/jira/browse/SPARK-18805?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16891667#comment-16891667
]
Cosmin Ciobanu commented on SPARK-18805:
This issue just occurred in one of our
[
https://issues.apache.org/jira/browse/SPARK-28424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-28424:
Comment: was deleted
(was: I'm working on.)
> Support typed interval expression
> ---
[
https://issues.apache.org/jira/browse/SPARK-28424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-28424:
Summary: Support typed interval expression (was: Improve interval input)
> Support typed interva
Dongjoon Hyun created SPARK-28496:
-
Summary: Use branch name instead of tag during dry-run
Key: SPARK-28496
URL: https://issues.apache.org/jira/browse/SPARK-28496
Project: Spark
Issue Type: I
Gengliang Wang created SPARK-28495:
--
Summary: AssignableCast: A new type coercion following store
assignment rules of ANSI SQL
Key: SPARK-28495
URL: https://issues.apache.org/jira/browse/SPARK-28495
75 matches
Mail list logo