[jira] [Assigned] (SPARK-29249) DataFrameWriterV2 should not allow setting table properties for existing tables

[ https://issues.apache.org/jira/browse/SPARK-29249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-29249: --- Assignee: Ryan Blue > DataFrameWriterV2 should not allow setting table properties for

[jira] [Resolved] (SPARK-29249) DataFrameWriterV2 should not allow setting table properties for existing tables

[ https://issues.apache.org/jira/browse/SPARK-29249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-29249. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 25931

[jira] [Updated] (SPARK-29254) Failed to include jars passed in through --jars when isolatedLoader is enabled

[ https://issues.apache.org/jira/browse/SPARK-29254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-29254: Description: Failed to include jars passed in through --jars when {{isolatedLoader}} is

[jira] [Updated] (SPARK-29254) Failed to include jars passed in through --jars when isolatedLoader is enabled

[ https://issues.apache.org/jira/browse/SPARK-29254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-29254: Summary: Failed to include jars passed in through --jars when isolatedLoader is enabled (was:

[jira] [Updated] (SPARK-29254) Failed to include jars passed in through --jars when isolatedLoader is enabled()

[ https://issues.apache.org/jira/browse/SPARK-29254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-29254: Description: Failed to include jars passed in through --jars when {{isolatedLoader}} is

[jira] [Updated] (SPARK-29254) Failed to include jars passed in through --jars when isolatedLoader is enabled()

[ https://issues.apache.org/jira/browse/SPARK-29254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-29254: Description: Failed to include jars passed in through --jars when {{isolatedLoader}} is

[jira] [Created] (SPARK-29254) Failed to include jars passed in through --jars when isolatedLoader is enabled()

Yuming Wang created SPARK-29254: --- Summary: Failed to include jars passed in through --jars when isolatedLoader is enabled() Key: SPARK-29254 URL: https://issues.apache.org/jira/browse/SPARK-29254

[jira] [Updated] (SPARK-29254) Failed to include jars passed in through --jars when isolatedLoader is enabled()

[ https://issues.apache.org/jira/browse/SPARK-29254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-29254: Description: Failed to include jars passed in through --jars when isolatedLoader is

[jira] [Created] (SPARK-29253) Add agg(Spark, Spark*) to SQL Dataset

Tomoko Komiyama created SPARK-29253: --- Summary: Add agg(Spark, Spark*) to SQL Dataset Key: SPARK-29253 URL: https://issues.apache.org/jira/browse/SPARK-29253 Project: Spark Issue Type:

[jira] [Created] (SPARK-29252) Upgrade zookeeper to 3.4.14 and fix vulnerabilities.

jiaan.geng created SPARK-29252: -- Summary: Upgrade zookeeper to 3.4.14 and fix vulnerabilities. Key: SPARK-29252 URL: https://issues.apache.org/jira/browse/SPARK-29252 Project: Spark Issue Type:

[jira] [Commented] (SPARK-29212) Add common classes without using JVM backend

[ https://issues.apache.org/jira/browse/SPARK-29212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16938205#comment-16938205 ] zhengruifeng commented on SPARK-29212: -- [~zero323] Would you like to help work on this? > Add

[jira] [Commented] (SPARK-29247) HiveClientImpl may be log sensitive information

[ https://issues.apache.org/jira/browse/SPARK-29247?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16938202#comment-16938202 ] angerszhu commented on SPARK-29247: --- I will check this > HiveClientImpl may be log sensitive

[jira] [Created] (SPARK-29251) intermittent serialization failures in spark

Jerry Vinokurov created SPARK-29251: --- Summary: intermittent serialization failures in spark Key: SPARK-29251 URL: https://issues.apache.org/jira/browse/SPARK-29251 Project: Spark Issue

[jira] [Commented] (SPARK-29038) SPIP: Support Spark Materialized View

[ https://issues.apache.org/jira/browse/SPARK-29038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16938134#comment-16938134 ] Amogh Margoor commented on SPARK-29038: --- Hi [~cltlfcjin] We have written code around Catalyst

[jira] [Created] (SPARK-29250) Upgrade to Hadoop 3.2.1

Dongjoon Hyun created SPARK-29250: - Summary: Upgrade to Hadoop 3.2.1 Key: SPARK-29250 URL: https://issues.apache.org/jira/browse/SPARK-29250 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-29249) DataFrameWriterV2 should not allow setting table properties for existing tables

[ https://issues.apache.org/jira/browse/SPARK-29249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ryan Blue updated SPARK-29249: -- Description: tableProperty should return CreateTableWriter, not DataFrameWriterV2. >

[jira] [Created] (SPARK-29249) DataFrameWriterV2 should not allow setting table properties for existing tables

Ryan Blue created SPARK-29249: - Summary: DataFrameWriterV2 should not allow setting table properties for existing tables Key: SPARK-29249 URL: https://issues.apache.org/jira/browse/SPARK-29249 Project:

[jira] [Commented] (SPARK-23197) Flaky test: spark.streaming.ReceiverSuite."receiver_life_cycle"

[ https://issues.apache.org/jira/browse/SPARK-23197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16938101#comment-16938101 ] Dongjoon Hyun commented on SPARK-23197: --- This is backported to `branch-2.4` via

[jira] [Resolved] (SPARK-29237) Use _FUNC_ in expression examples

[ https://issues.apache.org/jira/browse/SPARK-29237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-29237. --- Fix Version/s: 3.0.0 Assignee: Maxim Gekk Resolution: Fixed This is

[jira] [Updated] (SPARK-23197) Flaky test: spark.streaming.ReceiverSuite."receiver_life_cycle"

[ https://issues.apache.org/jira/browse/SPARK-23197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-23197: -- Fix Version/s: 2.4.5 > Flaky test: spark.streaming.ReceiverSuite."receiver_life_cycle" >

[jira] [Resolved] (SPARK-23197) Flaky test: spark.streaming.ReceiverSuite."receiver_life_cycle"

[ https://issues.apache.org/jira/browse/SPARK-23197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-23197. --- Fix Version/s: 3.0.0 Assignee: Jungtaek Lim (was: Tathagata Das)

[jira] [Commented] (SPARK-23197) Flaky test: spark.streaming.ReceiverSuite."receiver_life_cycle"

[ https://issues.apache.org/jira/browse/SPARK-23197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16938071#comment-16938071 ] Dongjoon Hyun commented on SPARK-23197: --- This is resolved via

[jira] [Commented] (SPARK-29248) Pass in number of partitions to BuildWriter

[ https://issues.apache.org/jira/browse/SPARK-29248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16938060#comment-16938060 ] Jungtaek Lim commented on SPARK-29248: -- Assuming writer got the information of number of

[jira] [Commented] (SPARK-29248) Pass in number of partitions to BuildWriter

[ https://issues.apache.org/jira/browse/SPARK-29248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16938050#comment-16938050 ] Ximo Guanter commented on SPARK-29248: -- Thanks for the quick reply [~kabhwan]! The issue you linked

[jira] [Commented] (SPARK-29248) Pass in number of partitions to BuildWriter

[ https://issues.apache.org/jira/browse/SPARK-29248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16938041#comment-16938041 ] Jungtaek Lim commented on SPARK-29248: -- SPARK-23889 would be the correct approach to address this -

[jira] [Updated] (SPARK-29248) Pass in number of partitions to BuildWriter

[ https://issues.apache.org/jira/browse/SPARK-29248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ximo Guanter updated SPARK-29248: - Target Version/s: (was: 3.0.0) > Pass in number of partitions to BuildWriter >

[jira] [Commented] (SPARK-28592) Mark new Shuffle apis as @Experimental (instead of @Private)

[ https://issues.apache.org/jira/browse/SPARK-28592?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16938028#comment-16938028 ] Imran Rashid commented on SPARK-28592: -- [~holden] no, I think this is intentionally *not* a

[jira] [Created] (SPARK-29248) Pass in number of partitions to BuildWriter

Ximo Guanter created SPARK-29248: Summary: Pass in number of partitions to BuildWriter Key: SPARK-29248 URL: https://issues.apache.org/jira/browse/SPARK-29248 Project: Spark Issue Type:

[jira] [Updated] (SPARK-29235) CrossValidatorModel.avgMetrics disappears after model is written/read again

[ https://issues.apache.org/jira/browse/SPARK-29235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthew Bedford updated SPARK-29235: Description:   Right after a CrossValidatorModel is trained, it has avgMetrics.  After

[jira] [Updated] (SPARK-29247) HiveClientImpl may be log sensitive information

[ https://issues.apache.org/jira/browse/SPARK-29247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-29247: Description: {{HiveClientImpl}} may be log sensitive information. e.g. url, secret and token:

[jira] [Created] (SPARK-29247) HiveClientImpl may be log sensitive information

Yuming Wang created SPARK-29247: --- Summary: HiveClientImpl may be log sensitive information Key: SPARK-29247 URL: https://issues.apache.org/jira/browse/SPARK-29247 Project: Spark Issue Type:

[jira] [Updated] (SPARK-29246) Remove unnecessary imports in CoarseGrainedExecutorBackendSuite

[ https://issues.apache.org/jira/browse/SPARK-29246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiaqi Li updated SPARK-29246: - Component/s: Tests > Remove unnecessary imports in CoarseGrainedExecutorBackendSuite >

[jira] [Created] (SPARK-29246) Remove unnecessary imports in CoarseGrainedExecutorBackendSuite

Jiaqi Li created SPARK-29246: Summary: Remove unnecessary imports in CoarseGrainedExecutorBackendSuite Key: SPARK-29246 URL: https://issues.apache.org/jira/browse/SPARK-29246 Project: Spark

[jira] [Assigned] (SPARK-29236) Access 'executorDataMap' out of 'DriverEndpoint' should be protected by lock

[ https://issues.apache.org/jira/browse/SPARK-29236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-29236: --- Assignee: Xianyang Liu > Access 'executorDataMap' out of 'DriverEndpoint' should be

[jira] [Resolved] (SPARK-29236) Access 'executorDataMap' out of 'DriverEndpoint' should be protected by lock

[ https://issues.apache.org/jira/browse/SPARK-29236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-29236. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 25922

[jira] [Commented] (SPARK-28990) SparkSQL invalid call to toAttribute on unresolved object, tree: *

[ https://issues.apache.org/jira/browse/SPARK-28990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16937725#comment-16937725 ] fengchaoge commented on SPARK-28990:  spark3.0 does fix this problem, but i'd like to know what have

[jira] [Commented] (SPARK-29232) RandomForestRegressionModel does not update the parameter maps of the DecisionTreeRegressionModels underneath

[ https://issues.apache.org/jira/browse/SPARK-29232?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16937694#comment-16937694 ] Aman Omer commented on SPARK-29232: --- I would like to analyse this.  Thanks [~jiaqig] >

[jira] [Updated] (SPARK-29243) hadoop-3.x profiles should use hadoop shaded client jars

[ https://issues.apache.org/jira/browse/SPARK-29243?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-29243: -- Fix Version/s: (was: 3.0.0) > hadoop-3.x profiles should use hadoop shaded client jars >

[jira] [Comment Edited] (SPARK-29243) hadoop-3.x profiles should use hadoop shaded client jars

[ https://issues.apache.org/jira/browse/SPARK-29243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16937662#comment-16937662 ] Dongjoon Hyun edited comment on SPARK-29243 at 9/25/19 11:56 AM: - Thank

[jira] [Commented] (SPARK-29243) hadoop-3.x profiles should use hadoop shaded client jars

[ https://issues.apache.org/jira/browse/SPARK-29243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16937662#comment-16937662 ] Dongjoon Hyun commented on SPARK-29243: --- Thank you for filing a JIRA. This is a nice-to-have. >

[jira] [Updated] (SPARK-29245) CCE during creating HiveMetaStoreClient

[ https://issues.apache.org/jira/browse/SPARK-29245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-29245: -- Priority: Blocker (was: Major) > CCE during creating HiveMetaStoreClient >

[jira] [Updated] (SPARK-29245) CCE during creating HiveMetaStoreClient

[ https://issues.apache.org/jira/browse/SPARK-29245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-29245: -- Description: >From `master` branch build, when I try to connect to an external HMS, I hit

[jira] [Commented] (SPARK-29245) CCE during creating HiveMetaStoreClient

[ https://issues.apache.org/jira/browse/SPARK-29245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16937646#comment-16937646 ] Yuming Wang commented on SPARK-29245: - Thank you [~dongjoon] > CCE during creating

[jira] [Updated] (SPARK-29245) CCE during creating HiveMetaStoreClient

[ https://issues.apache.org/jira/browse/SPARK-29245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-29245: -- Parent: SPARK-28684 Issue Type: Sub-task (was: Bug) > CCE during creating

[jira] [Updated] (SPARK-29245) CCE during creating HiveMetaStoreClient

[ https://issues.apache.org/jira/browse/SPARK-29245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-29245: -- Description: >From `master` branch build, when I try to connect to an external HMS, I hit

[jira] [Updated] (SPARK-29245) CCE during creating HiveMetaStoreClient

[ https://issues.apache.org/jira/browse/SPARK-29245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-29245: -- Description: When I try to connect an external HMS, I hit the following. {code} 19/09/25

[jira] [Updated] (SPARK-29245) CCE during creating HiveMetaStoreClient

[ https://issues.apache.org/jira/browse/SPARK-29245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-29245: -- Environment: CDH 6.3 > CCE during creating HiveMetaStoreClient >

[jira] [Commented] (SPARK-29245) CCE during creating HiveMetaStoreClient

[ https://issues.apache.org/jira/browse/SPARK-29245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16937638#comment-16937638 ] Dongjoon Hyun commented on SPARK-29245: --- cc [~yumwang] > CCE during creating HiveMetaStoreClient

[jira] [Commented] (SPARK-29245) CCE during creating HiveMetaStoreClient

[ https://issues.apache.org/jira/browse/SPARK-29245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16937637#comment-16937637 ] Dongjoon Hyun commented on SPARK-29245: --- We need HIVE-21508 which is Hive 2.3.7. > CCE during

[jira] [Created] (SPARK-29245) CCE during creating HiveMetaStoreClient

Dongjoon Hyun created SPARK-29245: - Summary: CCE during creating HiveMetaStoreClient Key: SPARK-29245 URL: https://issues.apache.org/jira/browse/SPARK-29245 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-29244) ArrayIndexOutOfBoundsException on TaskCompletionListener during releasing of memory blocks

[ https://issues.apache.org/jira/browse/SPARK-29244?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Viacheslav Tradunsky updated SPARK-29244: - Attachment: executor_oom.txt > ArrayIndexOutOfBoundsException on

[jira] [Created] (SPARK-29244) ArrayIndexOutOfBoundsException on TaskCompletionListener during releasing of memory blocks

Viacheslav Tradunsky created SPARK-29244: Summary: ArrayIndexOutOfBoundsException on TaskCompletionListener during releasing of memory blocks Key: SPARK-29244 URL:

[jira] [Created] (SPARK-29243) hadoop-3.x profiles should use hadoop shaded client jars

Terry Moschou created SPARK-29243: - Summary: hadoop-3.x profiles should use hadoop shaded client jars Key: SPARK-29243 URL: https://issues.apache.org/jira/browse/SPARK-29243 Project: Spark

[jira] [Created] (SPARK-29242) Check results of expression examples automatically

Maxim Gekk created SPARK-29242: -- Summary: Check results of expression examples automatically Key: SPARK-29242 URL: https://issues.apache.org/jira/browse/SPARK-29242 Project: Spark Issue Type:

[jira] [Created] (SPARK-29241) Show alternative names in the function description

Maxim Gekk created SPARK-29241: -- Summary: Show alternative names in the function description Key: SPARK-29241 URL: https://issues.apache.org/jira/browse/SPARK-29241 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-29215) current namespace should be tracked in SessionCatalog if the current catalog is session catalog

[ https://issues.apache.org/jira/browse/SPARK-29215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-29215. Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 25903

[jira] [Created] (SPARK-29240) PySpark 2.4 about sql function 'element_at' param 'extraction'

Simon Reon created SPARK-29240: -- Summary: PySpark 2.4 about sql function 'element_at' param 'extraction' Key: SPARK-29240 URL: https://issues.apache.org/jira/browse/SPARK-29240 Project: Spark

[jira] [Resolved] (SPARK-28957) Copy any "spark.hive.foo=bar" spark properties into hadoop conf as "hive.foo=bar"

[ https://issues.apache.org/jira/browse/SPARK-28957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-28957. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 25661

[jira] [Assigned] (SPARK-28957) Copy any "spark.hive.foo=bar" spark properties into hadoop conf as "hive.foo=bar"

[ https://issues.apache.org/jira/browse/SPARK-28957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-28957: --- Assignee: Weichen Xu > Copy any "spark.hive.foo=bar" spark properties into hadoop conf as

[jira] [Commented] (SPARK-29239) Subquery should not cause NPE when eliminating subexpression

[ https://issues.apache.org/jira/browse/SPARK-29239?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16937495#comment-16937495 ] Liang-Chi Hsieh commented on SPARK-29239: - I added SPARK-29221 to the title of the PR. >

[jira] [Comment Edited] (SPARK-29239) Subquery should not cause NPE when eliminating subexpression

[ https://issues.apache.org/jira/browse/SPARK-29239?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16937491#comment-16937491 ] Jungtaek Lim edited comment on SPARK-29239 at 9/25/19 7:58 AM: --- Would we

[jira] [Commented] (SPARK-29239) Subquery should not cause NPE when eliminating subexpression

[ https://issues.apache.org/jira/browse/SPARK-29239?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16937491#comment-16937491 ] Jungtaek Lim commented on SPARK-29239: -- Would we link SPARK-23239 to SPARK-29221 or add

[jira] [Commented] (SPARK-29239) Subquery should not cause NPE when eliminating subexpression

[ https://issues.apache.org/jira/browse/SPARK-29239?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16937486#comment-16937486 ] Liang-Chi Hsieh commented on SPARK-29239: - Yes. > Subquery should not cause NPE when

[jira] [Commented] (SPARK-29239) Subquery should not cause NPE when eliminating subexpression

[ https://issues.apache.org/jira/browse/SPARK-29239?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16937485#comment-16937485 ] Yuming Wang commented on SPARK-29239: - Is it related to SPARK-29221? > Subquery should not cause

[jira] [Created] (SPARK-29239) Subquery should not cause NPE when eliminating subexpression

Liang-Chi Hsieh created SPARK-29239: --- Summary: Subquery should not cause NPE when eliminating subexpression Key: SPARK-29239 URL: https://issues.apache.org/jira/browse/SPARK-29239 Project: Spark

[jira] [Commented] (SPARK-29186) SubqueryAlias name value is null in Spark 2.4.3 Logical plan.

[ https://issues.apache.org/jira/browse/SPARK-29186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16937464#comment-16937464 ] Tarun Khaneja commented on SPARK-29186: --- [~hyukjin.kwon] I have cleaned the code by adding

[jira] [Updated] (SPARK-29186) SubqueryAlias name value is null in Spark 2.4.3 Logical plan.

[ https://issues.apache.org/jira/browse/SPARK-29186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tarun Khaneja updated SPARK-29186: -- Description: I am writing a program to analyze sql query. So I am using Spark logical plan.I

[jira] [Updated] (SPARK-29238) Add newColumn using withColumn to an empty Dataframe

[ https://issues.apache.org/jira/browse/SPARK-29238?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ARUN KINDRA updated SPARK-29238: Description: Hi I'm trying to add a newColumn to an empty DF but I don't see the new column is

[jira] [Updated] (SPARK-29238) Add newColumn using withColumn to an empty Dataframe

[ https://issues.apache.org/jira/browse/SPARK-29238?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ARUN KINDRA updated SPARK-29238: Description: Hi I'm trying to add a newColumn to an empty DF but I don't see the new column is

[jira] [Updated] (SPARK-29186) SubqueryAlias name value is null in Spark 2.4.3 Logical plan.

[ https://issues.apache.org/jira/browse/SPARK-29186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tarun Khaneja updated SPARK-29186: -- Attachment: image-2019-09-25-12-21-52-136.png > SubqueryAlias name value is null in Spark

[jira] [Updated] (SPARK-29238) Add newColumn using withColumn to an empty Dataframe

[ https://issues.apache.org/jira/browse/SPARK-29238?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ARUN KINDRA updated SPARK-29238: Description: Hi I'm trying to add a newColumn to an empty DF but I don't see the new column is

[jira] [Created] (SPARK-29238) Add newColumn using withColumn to an empty Dataframe

ARUN KINDRA created SPARK-29238: --- Summary: Add newColumn using withColumn to an empty Dataframe Key: SPARK-29238 URL: https://issues.apache.org/jira/browse/SPARK-29238 Project: Spark Issue

[jira] [Updated] (SPARK-29186) SubqueryAlias name value is null in Spark 2.4.3 Logical plan.

[ https://issues.apache.org/jira/browse/SPARK-29186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tarun Khaneja updated SPARK-29186: -- Description: I am writing a program to analyze sql query. So I am using Spark logical plan.I

[jira] [Updated] (SPARK-29186) SubqueryAlias name value is null in Spark 2.4.3 Logical plan.

[ https://issues.apache.org/jira/browse/SPARK-29186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tarun Khaneja updated SPARK-29186: -- Attachment: image-2019-09-25-12-17-53-552.png > SubqueryAlias name value is null in Spark

[jira] [Updated] (SPARK-29186) SubqueryAlias name value is null in Spark 2.4.3 Logical plan.

[ https://issues.apache.org/jira/browse/SPARK-29186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tarun Khaneja updated SPARK-29186: -- Description: I am writing a program to analyze sql query. So I am using Spark logical plan.I

[jira] [Updated] (SPARK-29186) SubqueryAlias name value is null in Spark 2.4.3 Logical plan.

[ https://issues.apache.org/jira/browse/SPARK-29186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tarun Khaneja updated SPARK-29186: -- Description: I am writing a program to analyze sql query. So I am using Spark logical plan.I

[jira] [Closed] (SPARK-29230) Fix NullPointerException in the test class ProcfsMetricsGetterSuite

[ https://issues.apache.org/jira/browse/SPARK-29230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiaqi Li closed SPARK-29230. Work completed! > Fix NullPointerException in the test class ProcfsMetricsGetterSuite >

[jira] [Updated] (SPARK-29186) SubqueryAlias name value is null in Spark 2.4.3 Logical plan.

[ https://issues.apache.org/jira/browse/SPARK-29186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tarun Khaneja updated SPARK-29186: -- Description: I am writing a program to analyze sql query. So I am using Spark logical plan.I

[jira] [Updated] (SPARK-29186) SubqueryAlias name value is null in Spark 2.4.3 Logical plan.

[ https://issues.apache.org/jira/browse/SPARK-29186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tarun Khaneja updated SPARK-29186: -- Description: I am writing a program to analyze sql query. So I am using Spark logical plan.I

[jira] [Updated] (SPARK-29186) SubqueryAlias name value is null in Spark 2.4.3 Logical plan.

[ https://issues.apache.org/jira/browse/SPARK-29186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tarun Khaneja updated SPARK-29186: -- Description: I am writing a program to analyze sql query. So I am using Spark logical plan.I

[jira] [Commented] (SPARK-29186) SubqueryAlias name value is null in Spark 2.4.3 Logical plan.

[ https://issues.apache.org/jira/browse/SPARK-29186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16937439#comment-16937439 ] Tarun Khaneja commented on SPARK-29186: --- [~hyukjin.kwon] I have added an external link of

[jira] [Created] (SPARK-29237) Use _FUNC_ in expression examples

Maxim Gekk created SPARK-29237: -- Summary: Use _FUNC_ in expression examples Key: SPARK-29237 URL: https://issues.apache.org/jira/browse/SPARK-29237 Project: Spark Issue Type: Improvement