[jira] [Created] (SPARK-29239) Subquery should not cause NPE when eliminating subexpression

2019-09-25 Thread Liang-Chi Hsieh (Jira)
Liang-Chi Hsieh created SPARK-29239: --- Summary: Subquery should not cause NPE when eliminating subexpression Key: SPARK-29239 URL: https://issues.apache.org/jira/browse/SPARK-29239 Project: Spark

[jira] [Commented] (SPARK-29239) Subquery should not cause NPE when eliminating subexpression

2019-09-25 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29239?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16937485#comment-16937485 ] Yuming Wang commented on SPARK-29239: - Is it related to SPARK-29221? > Subquery sho

[jira] [Commented] (SPARK-29239) Subquery should not cause NPE when eliminating subexpression

2019-09-25 Thread Liang-Chi Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29239?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16937486#comment-16937486 ] Liang-Chi Hsieh commented on SPARK-29239: - Yes. > Subquery should not cause NPE

[jira] [Commented] (SPARK-29239) Subquery should not cause NPE when eliminating subexpression

2019-09-25 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29239?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16937491#comment-16937491 ] Jungtaek Lim commented on SPARK-29239: -- Would we link SPARK-23239 to SPARK-29221 or

[jira] [Comment Edited] (SPARK-29239) Subquery should not cause NPE when eliminating subexpression

2019-09-25 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29239?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16937491#comment-16937491 ] Jungtaek Lim edited comment on SPARK-29239 at 9/25/19 7:58 AM: ---

[jira] [Commented] (SPARK-29239) Subquery should not cause NPE when eliminating subexpression

2019-09-25 Thread Liang-Chi Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29239?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16937495#comment-16937495 ] Liang-Chi Hsieh commented on SPARK-29239: - I added SPARK-29221 to the title of t

[jira] [Resolved] (SPARK-28957) Copy any "spark.hive.foo=bar" spark properties into hadoop conf as "hive.foo=bar"

2019-09-25 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-28957. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 25661 [https://gith

[jira] [Assigned] (SPARK-28957) Copy any "spark.hive.foo=bar" spark properties into hadoop conf as "hive.foo=bar"

2019-09-25 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-28957: --- Assignee: Weichen Xu > Copy any "spark.hive.foo=bar" spark properties into hadoop conf as

[jira] [Created] (SPARK-29240) PySpark 2.4 about sql function 'element_at' param 'extraction'

2019-09-25 Thread Simon Reon (Jira)
Simon Reon created SPARK-29240: -- Summary: PySpark 2.4 about sql function 'element_at' param 'extraction' Key: SPARK-29240 URL: https://issues.apache.org/jira/browse/SPARK-29240 Project: Spark I

[jira] [Resolved] (SPARK-29215) current namespace should be tracked in SessionCatalog if the current catalog is session catalog

2019-09-25 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-29215. Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 25903 [https:

[jira] [Created] (SPARK-29241) Show alternative names in the function description

2019-09-25 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-29241: -- Summary: Show alternative names in the function description Key: SPARK-29241 URL: https://issues.apache.org/jira/browse/SPARK-29241 Project: Spark Issue Type: Do

[jira] [Created] (SPARK-29242) Check results of expression examples automatically

2019-09-25 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-29242: -- Summary: Check results of expression examples automatically Key: SPARK-29242 URL: https://issues.apache.org/jira/browse/SPARK-29242 Project: Spark Issue Type: Te

[jira] [Created] (SPARK-29243) hadoop-3.x profiles should use hadoop shaded client jars

2019-09-25 Thread Terry Moschou (Jira)
Terry Moschou created SPARK-29243: - Summary: hadoop-3.x profiles should use hadoop shaded client jars Key: SPARK-29243 URL: https://issues.apache.org/jira/browse/SPARK-29243 Project: Spark Is

[jira] [Created] (SPARK-29244) ArrayIndexOutOfBoundsException on TaskCompletionListener during releasing of memory blocks

2019-09-25 Thread Viacheslav Tradunsky (Jira)
Viacheslav Tradunsky created SPARK-29244: Summary: ArrayIndexOutOfBoundsException on TaskCompletionListener during releasing of memory blocks Key: SPARK-29244 URL: https://issues.apache.org/jira/browse/SPA

[jira] [Updated] (SPARK-29244) ArrayIndexOutOfBoundsException on TaskCompletionListener during releasing of memory blocks

2019-09-25 Thread Viacheslav Tradunsky (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29244?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Viacheslav Tradunsky updated SPARK-29244: - Attachment: executor_oom.txt > ArrayIndexOutOfBoundsException on TaskCompletionL

[jira] [Created] (SPARK-29245) CCE during creating HiveMetaStoreClient

2019-09-25 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-29245: - Summary: CCE during creating HiveMetaStoreClient Key: SPARK-29245 URL: https://issues.apache.org/jira/browse/SPARK-29245 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-29245) CCE during creating HiveMetaStoreClient

2019-09-25 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16937637#comment-16937637 ] Dongjoon Hyun commented on SPARK-29245: --- We need HIVE-21508 which is Hive 2.3.7.

[jira] [Commented] (SPARK-29245) CCE during creating HiveMetaStoreClient

2019-09-25 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16937638#comment-16937638 ] Dongjoon Hyun commented on SPARK-29245: --- cc [~yumwang] > CCE during creating Hive

[jira] [Updated] (SPARK-29245) CCE during creating HiveMetaStoreClient

2019-09-25 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-29245: -- Environment: CDH 6.3 > CCE during creating HiveMetaStoreClient >

[jira] [Updated] (SPARK-29245) CCE during creating HiveMetaStoreClient

2019-09-25 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-29245: -- Description: When I try to connect an external HMS, I hit the following. {code} 19/09/25 10:58

[jira] [Updated] (SPARK-29245) CCE during creating HiveMetaStoreClient

2019-09-25 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-29245: -- Description: >From `master` branch build, when I try to connect to an external HMS, I hit >th

[jira] [Updated] (SPARK-29245) CCE during creating HiveMetaStoreClient

2019-09-25 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-29245: -- Parent: SPARK-28684 Issue Type: Sub-task (was: Bug) > CCE during creating HiveMetaSto

[jira] [Commented] (SPARK-29245) CCE during creating HiveMetaStoreClient

2019-09-25 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16937646#comment-16937646 ] Yuming Wang commented on SPARK-29245: - Thank you [~dongjoon] > CCE during creating

[jira] [Updated] (SPARK-29245) CCE during creating HiveMetaStoreClient

2019-09-25 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-29245: -- Description: >From `master` branch build, when I try to connect to an external HMS, I hit >th

[jira] [Updated] (SPARK-29245) CCE during creating HiveMetaStoreClient

2019-09-25 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-29245: -- Priority: Blocker (was: Major) > CCE during creating HiveMetaStoreClient > -

[jira] [Commented] (SPARK-29243) hadoop-3.x profiles should use hadoop shaded client jars

2019-09-25 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16937662#comment-16937662 ] Dongjoon Hyun commented on SPARK-29243: --- Thank you for filing a JIRA. This is a ni

[jira] [Updated] (SPARK-29243) hadoop-3.x profiles should use hadoop shaded client jars

2019-09-25 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29243?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-29243: -- Fix Version/s: (was: 3.0.0) > hadoop-3.x profiles should use hadoop shaded client jars > -

[jira] [Comment Edited] (SPARK-29243) hadoop-3.x profiles should use hadoop shaded client jars

2019-09-25 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16937662#comment-16937662 ] Dongjoon Hyun edited comment on SPARK-29243 at 9/25/19 11:56 AM: -

[jira] [Commented] (SPARK-29232) RandomForestRegressionModel does not update the parameter maps of the DecisionTreeRegressionModels underneath

2019-09-25 Thread Aman Omer (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29232?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16937694#comment-16937694 ] Aman Omer commented on SPARK-29232: --- I would like to analyse this.  Thanks [~jiaqig]

[jira] [Commented] (SPARK-28990) SparkSQL invalid call to toAttribute on unresolved object, tree: *

2019-09-25 Thread fengchaoge (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16937725#comment-16937725 ] fengchaoge commented on SPARK-28990:  spark3.0 does fix this problem, but i'd like t

[jira] [Assigned] (SPARK-29236) Access 'executorDataMap' out of 'DriverEndpoint' should be protected by lock

2019-09-25 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-29236: --- Assignee: Xianyang Liu > Access 'executorDataMap' out of 'DriverEndpoint' should be protect

[jira] [Resolved] (SPARK-29236) Access 'executorDataMap' out of 'DriverEndpoint' should be protected by lock

2019-09-25 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-29236. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 25922 [https://gith

[jira] [Created] (SPARK-29246) Remove unnecessary imports in CoarseGrainedExecutorBackendSuite

2019-09-25 Thread Jiaqi Li (Jira)
Jiaqi Li created SPARK-29246: Summary: Remove unnecessary imports in CoarseGrainedExecutorBackendSuite Key: SPARK-29246 URL: https://issues.apache.org/jira/browse/SPARK-29246 Project: Spark Issu

[jira] [Updated] (SPARK-29246) Remove unnecessary imports in CoarseGrainedExecutorBackendSuite

2019-09-25 Thread Jiaqi Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiaqi Li updated SPARK-29246: - Component/s: Tests > Remove unnecessary imports in CoarseGrainedExecutorBackendSuite > -

[jira] [Created] (SPARK-29247) HiveClientImpl may be log sensitive information

2019-09-25 Thread Yuming Wang (Jira)
Yuming Wang created SPARK-29247: --- Summary: HiveClientImpl may be log sensitive information Key: SPARK-29247 URL: https://issues.apache.org/jira/browse/SPARK-29247 Project: Spark Issue Type: Imp

[jira] [Updated] (SPARK-29247) HiveClientImpl may be log sensitive information

2019-09-25 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-29247: Description: {{HiveClientImpl}} may be log sensitive information. e.g. url, secret and token: {cod

[jira] [Updated] (SPARK-29235) CrossValidatorModel.avgMetrics disappears after model is written/read again

2019-09-25 Thread Matthew Bedford (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthew Bedford updated SPARK-29235: Description:   Right after a CrossValidatorModel is trained, it has avgMetrics.  After th

[jira] [Created] (SPARK-29248) Pass in number of partitions to BuildWriter

2019-09-25 Thread Ximo Guanter (Jira)
Ximo Guanter created SPARK-29248: Summary: Pass in number of partitions to BuildWriter Key: SPARK-29248 URL: https://issues.apache.org/jira/browse/SPARK-29248 Project: Spark Issue Type: Sub-t

[jira] [Updated] (SPARK-29248) Pass in number of partitions to BuildWriter

2019-09-25 Thread Ximo Guanter (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ximo Guanter updated SPARK-29248: - Target Version/s: (was: 3.0.0) > Pass in number of partitions to BuildWriter > ---

[jira] [Commented] (SPARK-28592) Mark new Shuffle apis as @Experimental (instead of @Private)

2019-09-25 Thread Imran Rashid (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28592?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16938028#comment-16938028 ] Imran Rashid commented on SPARK-28592: -- [~holden] no, I think this is intentionally

[jira] [Commented] (SPARK-29248) Pass in number of partitions to BuildWriter

2019-09-25 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16938041#comment-16938041 ] Jungtaek Lim commented on SPARK-29248: -- SPARK-23889 would be the correct approach t

[jira] [Commented] (SPARK-29248) Pass in number of partitions to BuildWriter

2019-09-25 Thread Ximo Guanter (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16938050#comment-16938050 ] Ximo Guanter commented on SPARK-29248: -- Thanks for the quick reply [~kabhwan]! The

[jira] [Commented] (SPARK-29248) Pass in number of partitions to BuildWriter

2019-09-25 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16938060#comment-16938060 ] Jungtaek Lim commented on SPARK-29248: -- Assuming writer got the information of numb

[jira] [Commented] (SPARK-23197) Flaky test: spark.streaming.ReceiverSuite."receiver_life_cycle"

2019-09-25 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-23197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16938071#comment-16938071 ] Dongjoon Hyun commented on SPARK-23197: --- This is resolved via https://github.com/a

[jira] [Resolved] (SPARK-23197) Flaky test: spark.streaming.ReceiverSuite."receiver_life_cycle"

2019-09-25 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-23197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-23197. --- Fix Version/s: 3.0.0 Assignee: Jungtaek Lim (was: Tathagata Das) Resolution:

[jira] [Updated] (SPARK-23197) Flaky test: spark.streaming.ReceiverSuite."receiver_life_cycle"

2019-09-25 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-23197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-23197: -- Fix Version/s: 2.4.5 > Flaky test: spark.streaming.ReceiverSuite."receiver_life_cycle" > -

[jira] [Resolved] (SPARK-29237) Use _FUNC_ in expression examples

2019-09-25 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-29237. --- Fix Version/s: 3.0.0 Assignee: Maxim Gekk Resolution: Fixed This is resolved

[jira] [Commented] (SPARK-23197) Flaky test: spark.streaming.ReceiverSuite."receiver_life_cycle"

2019-09-25 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-23197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16938101#comment-16938101 ] Dongjoon Hyun commented on SPARK-23197: --- This is backported to `branch-2.4` via h

[jira] [Updated] (SPARK-29249) DataFrameWriterV2 should not allow setting table properties for existing tables

2019-09-25 Thread Ryan Blue (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ryan Blue updated SPARK-29249: -- Description: tableProperty should return CreateTableWriter, not DataFrameWriterV2. > DataFrameWriterV

[jira] [Created] (SPARK-29249) DataFrameWriterV2 should not allow setting table properties for existing tables

2019-09-25 Thread Ryan Blue (Jira)
Ryan Blue created SPARK-29249: - Summary: DataFrameWriterV2 should not allow setting table properties for existing tables Key: SPARK-29249 URL: https://issues.apache.org/jira/browse/SPARK-29249 Project: Sp

[jira] [Created] (SPARK-29250) Upgrade to Hadoop 3.2.1

2019-09-25 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-29250: - Summary: Upgrade to Hadoop 3.2.1 Key: SPARK-29250 URL: https://issues.apache.org/jira/browse/SPARK-29250 Project: Spark Issue Type: Improvement C

[jira] [Commented] (SPARK-29038) SPIP: Support Spark Materialized View

2019-09-25 Thread Amogh Margoor (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16938134#comment-16938134 ] Amogh Margoor commented on SPARK-29038: --- Hi [~cltlfcjin] We have written code aro

[jira] [Created] (SPARK-29251) intermittent serialization failures in spark

2019-09-25 Thread Jerry Vinokurov (Jira)
Jerry Vinokurov created SPARK-29251: --- Summary: intermittent serialization failures in spark Key: SPARK-29251 URL: https://issues.apache.org/jira/browse/SPARK-29251 Project: Spark Issue Type

[jira] [Commented] (SPARK-29247) HiveClientImpl may be log sensitive information

2019-09-25 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29247?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16938202#comment-16938202 ] angerszhu commented on SPARK-29247: --- I will check this > HiveClientImpl may be log se

[jira] [Commented] (SPARK-29212) Add common classes without using JVM backend

2019-09-25 Thread zhengruifeng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16938205#comment-16938205 ] zhengruifeng commented on SPARK-29212: -- [~zero323] Would you like to help work on t

[jira] [Created] (SPARK-29252) Upgrade zookeeper to 3.4.14 and fix vulnerabilities.

2019-09-25 Thread jiaan.geng (Jira)
jiaan.geng created SPARK-29252: -- Summary: Upgrade zookeeper to 3.4.14 and fix vulnerabilities. Key: SPARK-29252 URL: https://issues.apache.org/jira/browse/SPARK-29252 Project: Spark Issue Type:

[jira] [Created] (SPARK-29253) Add agg(Spark, Spark*) to SQL Dataset

2019-09-25 Thread Tomoko Komiyama (Jira)
Tomoko Komiyama created SPARK-29253: --- Summary: Add agg(Spark, Spark*) to SQL Dataset Key: SPARK-29253 URL: https://issues.apache.org/jira/browse/SPARK-29253 Project: Spark Issue Type: Impro

[jira] [Created] (SPARK-29254) Failed to include jars passed in through --jars when isolatedLoader is enabled()

2019-09-25 Thread Yuming Wang (Jira)
Yuming Wang created SPARK-29254: --- Summary: Failed to include jars passed in through --jars when isolatedLoader is enabled() Key: SPARK-29254 URL: https://issues.apache.org/jira/browse/SPARK-29254 Projec

[jira] [Updated] (SPARK-29254) Failed to include jars passed in through --jars when isolatedLoader is enabled()

2019-09-25 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-29254: Description: Failed to include jars passed in through --jars when isolatedLoader is enabled({{spa

[jira] [Updated] (SPARK-29254) Failed to include jars passed in through --jars when isolatedLoader is enabled()

2019-09-25 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-29254: Description: Failed to include jars passed in through --jars when {{isolatedLoader}} is enabled({

[jira] [Updated] (SPARK-29254) Failed to include jars passed in through --jars when isolatedLoader is enabled()

2019-09-25 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-29254: Description: Failed to include jars passed in through --jars when {{isolatedLoader}} is enabled({

[jira] [Updated] (SPARK-29254) Failed to include jars passed in through --jars when isolatedLoader is enabled

2019-09-25 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-29254: Summary: Failed to include jars passed in through --jars when isolatedLoader is enabled (was: Fai

[jira] [Updated] (SPARK-29254) Failed to include jars passed in through --jars when isolatedLoader is enabled

2019-09-25 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-29254: Description: Failed to include jars passed in through --jars when {{isolatedLoader}} is enabled({

[jira] [Assigned] (SPARK-29249) DataFrameWriterV2 should not allow setting table properties for existing tables

2019-09-25 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-29249: --- Assignee: Ryan Blue > DataFrameWriterV2 should not allow setting table properties for exist

[jira] [Resolved] (SPARK-29249) DataFrameWriterV2 should not allow setting table properties for existing tables

2019-09-25 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-29249. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 25931 [https://gith

[jira] [Created] (SPARK-29256) Fix typo in building document

2019-09-25 Thread Tomoko Komiyama (Jira)
Tomoko Komiyama created SPARK-29256: --- Summary: Fix typo in building document Key: SPARK-29256 URL: https://issues.apache.org/jira/browse/SPARK-29256 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-29255) Rename package pgSQL to postgreSQL

2019-09-25 Thread Gengliang Wang (Jira)
Gengliang Wang created SPARK-29255: -- Summary: Rename package pgSQL to postgreSQL Key: SPARK-29255 URL: https://issues.apache.org/jira/browse/SPARK-29255 Project: Spark Issue Type: Task

[jira] [Commented] (SPARK-29248) Pass in number of partitions to BuildWriter

2019-09-25 Thread Ximo Guanter (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16938320#comment-16938320 ] Ximo Guanter commented on SPARK-29248: -- In general, the number of partitions can be