Shingo Furuyama created SPARK-31432:
---
Summary: bin/sbin scripts should allow to customize jars dir
Key: SPARK-31432
URL: https://issues.apache.org/jira/browse/SPARK-31432
Project: Spark
Iss
[
https://issues.apache.org/jira/browse/SPARK-31432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Shingo Furuyama updated SPARK-31432:
Environment: (was: In the script under bin/sbin, it is better that we
can specify SPAR
[
https://issues.apache.org/jira/browse/SPARK-31432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Shingo Furuyama updated SPARK-31432:
Description:
In the script under bin/sbin, it is better that we can specify SPARK_JARS_DIR
[
https://issues.apache.org/jira/browse/SPARK-31432?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17082129#comment-17082129
]
Shingo Furuyama commented on SPARK-31432:
-
I will soon send a PR to the master b
[
https://issues.apache.org/jira/browse/SPARK-31432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon updated SPARK-31432:
-
Target Version/s: (was: 2.4.6, 3.0.1)
> bin/sbin scripts should allow to customize jars dir
>
[
https://issues.apache.org/jira/browse/SPARK-31408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan updated SPARK-31408:
Summary: Build Spark’s own datetime pattern definition (was: Build Spark’s
own Datetime patterns)
zhengruifeng created SPARK-31433:
Summary: Summarizer supports string arguments
Key: SPARK-31433
URL: https://issues.apache.org/jira/browse/SPARK-31433
Project: Spark
Issue Type: Improvement
[
https://issues.apache.org/jira/browse/SPARK-31427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17082163#comment-17082163
]
Nick Hryhoriev commented on SPARK-31427:
[~kabhwan] I will try to do it, but do
Takeshi Yamamuro created SPARK-31434:
Summary: Drop builtin function pages from SQL references
Key: SPARK-31434
URL: https://issues.apache.org/jira/browse/SPARK-31434
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-31429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon updated SPARK-31429:
-
Affects Version/s: (was: 3.1.0)
3.0.0
> Add additional fields in Expr
[
https://issues.apache.org/jira/browse/SPARK-31429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon updated SPARK-31429:
-
Parent: SPARK-28588
Issue Type: Sub-task (was: Improvement)
> Add additional fields in
[
https://issues.apache.org/jira/browse/SPARK-31429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon updated SPARK-31429:
-
Target Version/s: 3.0.0
> Add additional fields in ExpressionDescription for more granular categ
[
https://issues.apache.org/jira/browse/SPARK-31429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17082190#comment-17082190
]
Hyukjin Kwon commented on SPARK-31429:
--
[~huaxingao], [~nchammas], [~kevinyu98], [~
[
https://issues.apache.org/jira/browse/SPARK-31429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17082196#comment-17082196
]
Hyukjin Kwon commented on SPARK-31429:
--
Actually, let me retarget this as Spark 3.1
[
https://issues.apache.org/jira/browse/SPARK-31429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon updated SPARK-31429:
-
Target Version/s: (was: 3.0.0)
> Add additional fields in ExpressionDescription for more granu
[
https://issues.apache.org/jira/browse/SPARK-31429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon updated SPARK-31429:
-
Parent: (was: SPARK-28588)
Issue Type: Bug (was: Sub-task)
> Add additional fields
[
https://issues.apache.org/jira/browse/SPARK-31407?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-31407.
--
Fix Version/s: 3.0.0
Resolution: Fixed
Fixed in https://github.com/apache/spark/pull/28
[
https://issues.apache.org/jira/browse/SPARK-31423?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17082228#comment-17082228
]
Wenchen Fan commented on SPARK-31423:
-
FYI this is the behavior of Spark 2.4:
```
sc
[
https://issues.apache.org/jira/browse/SPARK-31423?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17082228#comment-17082228
]
Wenchen Fan edited comment on SPARK-31423 at 4/13/20, 10:54 AM:
--
[
https://issues.apache.org/jira/browse/SPARK-31435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17082233#comment-17082233
]
Pablo Langa Blanco commented on SPARK-31435:
I'm working on this
> Add SPAR
Pablo Langa Blanco created SPARK-31435:
--
Summary: Add SPARK_JARS_DIR enviroment variable (new) to Spark
configuration documentation
Key: SPARK-31435
URL: https://issues.apache.org/jira/browse/SPARK-31435
zhengruifeng created SPARK-31436:
Summary: MinHash keyDistance optimization
Key: SPARK-31436
URL: https://issues.apache.org/jira/browse/SPARK-31436
Project: Spark
Issue Type: Improvement
Hongze Zhang created SPARK-31437:
Summary: Try assigning tasks to existing executors by which
required resources in ResourceProfile are satisfied
Key: SPARK-31437
URL: https://issues.apache.org/jira/browse/SPARK-3
[
https://issues.apache.org/jira/browse/SPARK-31435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean R. Owen resolved SPARK-31435.
--
Resolution: Duplicate
> Add SPARK_JARS_DIR enviroment variable (new) to Spark configuration
>
[
https://issues.apache.org/jira/browse/SPARK-31409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan reassigned SPARK-31409:
---
Assignee: wuyi
> Fix failed tests due to result order changing when we enable AQE
> ---
[
https://issues.apache.org/jira/browse/SPARK-31409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-31409.
-
Fix Version/s: 3.0.0
Resolution: Fixed
Issue resolved by pull request 28178
[https://gith
[
https://issues.apache.org/jira/browse/SPARK-31391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-31391.
-
Fix Version/s: 3.0.0
Resolution: Fixed
Issue resolved by pull request 28162
[https://gith
[
https://issues.apache.org/jira/browse/SPARK-31391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan reassigned SPARK-31391:
---
Assignee: wuyi
> Add AdaptiveTestUtils to ease the test of AQE
> --
Jackey Lee created SPARK-31438:
--
Summary: Support JobCleaned Status in SparkListener
Key: SPARK-31438
URL: https://issues.apache.org/jira/browse/SPARK-31438
Project: Spark
Issue Type: Improvemen
[
https://issues.apache.org/jira/browse/SPARK-31438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jackey Lee updated SPARK-31438:
---
Description:
In Spark, we need do some hook, such as cleaning hive external temporary paths,
after
[
https://issues.apache.org/jira/browse/SPARK-31438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jackey Lee updated SPARK-31438:
---
Description:
In Spark, we need do some hook after job cleaned, such as cleaning hive
external tempo
[
https://issues.apache.org/jira/browse/SPARK-31423?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17082498#comment-17082498
]
Bruce Robbins commented on SPARK-31423:
---
[~cloud_fan]
{quote}FYI this is the beha
[
https://issues.apache.org/jira/browse/SPARK-31426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Maxim Gekk updated SPARK-31426:
---
Parent: SPARK-31404
Issue Type: Sub-task (was: Bug)
> Regression in loading/saving timestam
Maxim Gekk created SPARK-31439:
--
Summary: Perf regression of fromJavaDate
Key: SPARK-31439
URL: https://issues.apache.org/jira/browse/SPARK-31439
Project: Spark
Issue Type: Sub-task
Co
[
https://issues.apache.org/jira/browse/SPARK-18299?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiao Li reassigned SPARK-18299:
---
Assignee: nooberfsh
> Allow more aggregations on KeyValueGroupedDataset
> -
Eren Avsarogullari created SPARK-31440:
--
Summary: Improve SQL Rest API
Key: SPARK-31440
URL: https://issues.apache.org/jira/browse/SPARK-31440
Project: Spark
Issue Type: Improvement
[
https://issues.apache.org/jira/browse/SPARK-31440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Eren Avsarogullari updated SPARK-31440:
---
Description:
SQL Rest API exposes query execution metrics as Public API. This Jira a
[
https://issues.apache.org/jira/browse/SPARK-31440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Eren Avsarogullari updated SPARK-31440:
---
Attachment: improved_version.json
> Improve SQL Rest API
>
>
>
[
https://issues.apache.org/jira/browse/SPARK-31440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Eren Avsarogullari updated SPARK-31440:
---
Attachment: current_version.json
> Improve SQL Rest API
>
>
>
[
https://issues.apache.org/jira/browse/SPARK-31440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Eren Avsarogullari updated SPARK-31440:
---
Description:
SQL Rest API exposes query execution metrics as Public API. This Jira a
[
https://issues.apache.org/jira/browse/SPARK-31306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bryan Cutler reassigned SPARK-31306:
Assignee: Ben
> rand() function documentation suggests an inclusive upper bound of 1.0
>
[
https://issues.apache.org/jira/browse/SPARK-31418?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17082731#comment-17082731
]
Venkata krishnan Sowrirajan commented on SPARK-31418:
-
[~tgraves] Cu
[
https://issues.apache.org/jira/browse/SPARK-31418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves updated SPARK-31418:
--
Issue Type: Improvement (was: Bug)
> Blacklisting feature aborts Spark job without retrying f
[
https://issues.apache.org/jira/browse/SPARK-22148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17082736#comment-17082736
]
Erik Krogen commented on SPARK-22148:
-
For future folks: the JIRA created for the is
[
https://issues.apache.org/jira/browse/SPARK-31420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17082743#comment-17082743
]
Dongjoon Hyun commented on SPARK-31420:
---
Thank you for confirming, [~sarutak]!
>
[
https://issues.apache.org/jira/browse/SPARK-31411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Gengliang Wang resolved SPARK-31411.
Fix Version/s: 3.1.0
Resolution: Fixed
The issue is resolved in https://github.com/
[
https://issues.apache.org/jira/browse/SPARK-31434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon reassigned SPARK-31434:
Assignee: Takeshi Yamamuro
> Drop builtin function pages from SQL references
> --
[
https://issues.apache.org/jira/browse/SPARK-31434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-31434.
--
Fix Version/s: 3.0.0
Resolution: Fixed
Issue resolved by pull request 28203
[https://gi
Takuya Ueshin created SPARK-31441:
-
Summary: Support duplicated column names for toPandas with arrow
execution.
Key: SPARK-31441
URL: https://issues.apache.org/jira/browse/SPARK-31441
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-31441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Takuya Ueshin updated SPARK-31441:
--
Summary: Support duplicated column names for toPandas with Arrow execution.
(was: Support dup
[
https://issues.apache.org/jira/browse/SPARK-31426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan reassigned SPARK-31426:
---
Assignee: Maxim Gekk
> Regression in loading/saving timestamps from/to ORC files
>
[
https://issues.apache.org/jira/browse/SPARK-31426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-31426.
-
Fix Version/s: 3.0.0
Resolution: Fixed
Issue resolved by pull request 28189
[https://gith
[
https://issues.apache.org/jira/browse/SPARK-31441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon reassigned SPARK-31441:
Assignee: Takuya Ueshin
> Support duplicated column names for toPandas with Arrow executi
[
https://issues.apache.org/jira/browse/SPARK-31441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-31441.
--
Fix Version/s: 3.0.0
Resolution: Fixed
Issue resolved by pull request 28210
[https://gi
[
https://issues.apache.org/jira/browse/SPARK-31392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan updated SPARK-31392:
Fix Version/s: (was: 3.1.0)
3.0.0
> Support CalendarInterval to be reflect
[
https://issues.apache.org/jira/browse/SPARK-30953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan reassigned SPARK-30953:
---
Assignee: wuyi
> InsertAdaptiveSparkPlan should apply AQE on child plan of write commands
>
[
https://issues.apache.org/jira/browse/SPARK-30953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-30953.
-
Fix Version/s: 3.0.0
Resolution: Fixed
Issue resolved by pull request 27701
[https://gith
[
https://issues.apache.org/jira/browse/SPARK-31432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-31432:
--
Affects Version/s: (was: 2.4.5)
(was: 3.0.0)
[
https://issues.apache.org/jira/browse/SPARK-26385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17082896#comment-17082896
]
Zhou Jiashuai commented on SPARK-26385:
---
I enable the log with -Dsun.security.krb5
[
https://issues.apache.org/jira/browse/SPARK-31301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
zhengruifeng reassigned SPARK-31301:
Assignee: zhengruifeng
> flatten the result dataframe of tests in stat
>
[
https://issues.apache.org/jira/browse/SPARK-31301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
zhengruifeng resolved SPARK-31301.
--
Fix Version/s: 3.1.0
Resolution: Fixed
Issue resolved by pull request 28176
[https://gi
61 matches
Mail list logo
