[jira] [Commented] (SPARK-46778) get_json_object flattens wildcard queries that match a single value

2024-03-04 Thread Pablo Langa Blanco (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17823371#comment-17823371 ] Pablo Langa Blanco commented on SPARK-46778: I was looking at it and I found a comment in

[jira] [Commented] (SPARK-47063) CAST long to timestamp has different behavior for codegen vs interpreted

2024-02-27 Thread Pablo Langa Blanco (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17821273#comment-17821273 ] Pablo Langa Blanco commented on SPARK-47063: Ok, personally I would prefer the truncation

[jira] [Commented] (SPARK-47063) CAST long to timestamp has different behavior for codegen vs interpreted

2024-02-26 Thread Pablo Langa Blanco (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17820853#comment-17820853 ] Pablo Langa Blanco commented on SPARK-47063: [~revans2] are you working on the fix? > CAST

[jira] [Created] (SPARK-47123) JDBCRDD does not correctly handle errors in getQueryOutputSchema

2024-02-21 Thread Pablo Langa Blanco (Jira)
Pablo Langa Blanco created SPARK-47123: -- Summary: JDBCRDD does not correctly handle errors in getQueryOutputSchema Key: SPARK-47123 URL: https://issues.apache.org/jira/browse/SPARK-47123

[jira] [Commented] (SPARK-47123) JDBCRDD does not correctly handle errors in getQueryOutputSchema

2024-02-21 Thread Pablo Langa Blanco (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47123?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17819413#comment-17819413 ] Pablo Langa Blanco commented on SPARK-47123: I'm working on it > JDBCRDD does not correctly

[jira] [Commented] (SPARK-45039) Include full identifier in Storage tab

2023-09-01 Thread Pablo Langa Blanco (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17761295#comment-17761295 ] Pablo Langa Blanco commented on SPARK-45039: https://github.com/apache/spark/pull/42759 >

[jira] [Commented] (SPARK-45039) Include full identifier in Storage tab

2023-08-31 Thread Pablo Langa Blanco (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17761108#comment-17761108 ] Pablo Langa Blanco commented on SPARK-45039: I'm working on it > Include full identifier in

[jira] [Updated] (SPARK-45039) Include full identifier in Storage tab

2023-08-31 Thread Pablo Langa Blanco (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Langa Blanco updated SPARK-45039: --- Description: If you have 2 databases with tables with the same name like: 

[jira] [Updated] (SPARK-45039) Include full identifier in Storage tab

2023-08-31 Thread Pablo Langa Blanco (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Langa Blanco updated SPARK-45039: --- Attachment: image-2023-08-31-18-38-37-856.png > Include full identifier in Storage

[jira] [Created] (SPARK-45039) Include full identifier in Storage tab

2023-08-31 Thread Pablo Langa Blanco (Jira)
Pablo Langa Blanco created SPARK-45039: -- Summary: Include full identifier in Storage tab Key: SPARK-45039 URL: https://issues.apache.org/jira/browse/SPARK-45039 Project: Spark Issue

[jira] [Commented] (SPARK-44500) parse_url treats key as regular expression

2023-07-24 Thread Pablo Langa Blanco (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17746705#comment-17746705 ] Pablo Langa Blanco commented on SPARK-44500: [~jan.chou...@gmail.com] What do you think? >

[jira] [Commented] (SPARK-40679) add named_struct to spark scala api for parity to spark sql

2023-02-28 Thread Pablo Langa Blanco (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17694757#comment-17694757 ] Pablo Langa Blanco commented on SPARK-40679: I think the original development supports the

[jira] [Commented] (SPARK-42407) `with as` executed again

2023-02-26 Thread Pablo Langa Blanco (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42407?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17693723#comment-17693723 ] Pablo Langa Blanco commented on SPARK-42407: In my opinion, "WITH AS" syntax is intended to

[jira] [Comment Edited] (SPARK-40525) Floating-point value with an INT/BYTE/SHORT/LONG type errors out in DataFrame but evaluates to a rounded value in SparkSQL

2023-02-26 Thread Pablo Langa Blanco (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17693721#comment-17693721 ] Pablo Langa Blanco edited comment on SPARK-40525 at 2/26/23 10:57 PM:

[jira] [Commented] (SPARK-40525) Floating-point value with an INT/BYTE/SHORT/LONG type errors out in DataFrame but evaluates to a rounded value in SparkSQL

2023-02-26 Thread Pablo Langa Blanco (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17693721#comment-17693721 ] Pablo Langa Blanco commented on SPARK-40525: Hi [~x/sys] , When you are working with Spark

[jira] [Commented] (SPARK-42262) Table schema changes via V2SessionCatalog with HiveExternalCatalog

2023-01-31 Thread Pablo Langa Blanco (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42262?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17682727#comment-17682727 ] Pablo Langa Blanco commented on SPARK-42262: I'm working on this > Table schema changes via

[jira] [Created] (SPARK-42262) Table schema changes via V2SessionCatalog with HiveExternalCatalog

2023-01-31 Thread Pablo Langa Blanco (Jira)
Pablo Langa Blanco created SPARK-42262: -- Summary: Table schema changes via V2SessionCatalog with HiveExternalCatalog Key: SPARK-42262 URL: https://issues.apache.org/jira/browse/SPARK-42262

[jira] [Commented] (SPARK-41344) Reading V2 datasource masks underlying error

2022-12-06 Thread Pablo Langa Blanco (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17644061#comment-17644061 ] Pablo Langa Blanco commented on SPARK-41344: In this case the provider has been detected as

[jira] [Resolved] (SPARK-39623) partitionng by datestamp leads to wrong query on backend?

2022-08-17 Thread Pablo Langa Blanco (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Langa Blanco resolved SPARK-39623. Resolution: Not A Problem > partitionng by datestamp leads to wrong query on

[jira] [Commented] (SPARK-39915) Dataset.repartition(N) may not create N partitions

2022-08-06 Thread Pablo Langa Blanco (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17576282#comment-17576282 ] Pablo Langa Blanco commented on SPARK-39915: Hi [~zsxwing] , I can't reproduce it, do you

[jira] [Comment Edited] (SPARK-39796) Add a regexp_extract variant which returns an array of all the matched capture groups

2022-08-06 Thread Pablo Langa Blanco (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17576281#comment-17576281 ] Pablo Langa Blanco edited comment on SPARK-39796 at 8/6/22 9:17 PM:

[jira] [Commented] (SPARK-39796) Add a regexp_extract variant which returns an array of all the matched capture groups

2022-08-06 Thread Pablo Langa Blanco (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17576281#comment-17576281 ] Pablo Langa Blanco commented on SPARK-39796: Hi [~augustine_theodore] , Is this what are

[jira] [Commented] (SPARK-39426) Subquery star select creates broken plan in case of self join

2022-07-10 Thread Pablo Langa Blanco (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39426?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17564735#comment-17564735 ] Pablo Langa Blanco commented on SPARK-39426: I tested it on master and 3.3.0 and it seems to

[jira] [Commented] (SPARK-39623) partitionng by datestamp leads to wrong query on backend?

2022-07-10 Thread Pablo Langa Blanco (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17564730#comment-17564730 ] Pablo Langa Blanco commented on SPARK-39623: I think the problem here is a misunderstanding

[jira] [Resolved] (SPARK-38714) Interval multiplication error

2022-07-09 Thread Pablo Langa Blanco (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Langa Blanco resolved SPARK-38714. Resolution: Resolved > Interval multiplication error >

[jira] [Commented] (SPARK-38714) Interval multiplication error

2022-07-09 Thread Pablo Langa Blanco (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17564619#comment-17564619 ] Pablo Langa Blanco commented on SPARK-38714: I have tested it in master and branch 3.3 and

[jira] [Commented] (SPARK-37895) Error while joining two tables with non-english field names

2022-03-02 Thread Pablo Langa Blanco (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17500419#comment-17500419 ] Pablo Langa Blanco commented on SPARK-37895: I'm working on a fix > Error while joining two

[jira] [Updated] (SPARK-36698) Allow expand 'quotedRegexColumnNames' in all expressions when it’s expanded to one named expression

2021-09-08 Thread Pablo Langa Blanco (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Langa Blanco updated SPARK-36698: --- Description: With {code:java} spark.sql.parser.quotedRegexColumnNames=true{code}

[jira] [Commented] (SPARK-36698) Allow expand 'quotedRegexColumnNames' in all expressions when it’s expanded to one named expression

2021-09-08 Thread Pablo Langa Blanco (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17412220#comment-17412220 ] Pablo Langa Blanco commented on SPARK-36698: I'm working on it > Allow expand

[jira] [Created] (SPARK-36698) Allow expand 'quotedRegexColumnNames' in all expressions when it’s expanded to one named expression

2021-09-08 Thread Pablo Langa Blanco (Jira)
Pablo Langa Blanco created SPARK-36698: -- Summary: Allow expand 'quotedRegexColumnNames' in all expressions when it’s expanded to one named expression Key: SPARK-36698 URL:

[jira] [Commented] (SPARK-36488) "Invalid usage of '*' in expression" error due to the feature of 'quotedRegexColumnNames' in some scenarios.

2021-08-23 Thread Pablo Langa Blanco (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17403329#comment-17403329 ] Pablo Langa Blanco commented on SPARK-36488: Yes, I'm with you that it's not very intuitive

[jira] [Commented] (SPARK-35933) PartitionFilters and pushFilters not applied to window functions

2021-08-19 Thread Pablo Langa Blanco (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17401895#comment-17401895 ] Pablo Langa Blanco commented on SPARK-35933: can we close this ticket? > PartitionFilters

[jira] [Commented] (SPARK-36488) "Invalid usage of '*' in expression" error due to the feature of 'quotedRegexColumnNames' in some scenarios.

2021-08-18 Thread Pablo Langa Blanco (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17401401#comment-17401401 ] Pablo Langa Blanco commented on SPARK-36488: Hi [~merrily01] , I think these are not bugs.

[jira] [Commented] (SPARK-36453) Improve consistency processing floating point special literals

2021-08-08 Thread Pablo Langa Blanco (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17395658#comment-17395658 ] Pablo Langa Blanco commented on SPARK-36453: I'm working on it > Improve consistency

[jira] [Created] (SPARK-36453) Improve consistency processing floating point special literals

2021-08-08 Thread Pablo Langa Blanco (Jira)
Pablo Langa Blanco created SPARK-36453: -- Summary: Improve consistency processing floating point special literals Key: SPARK-36453 URL: https://issues.apache.org/jira/browse/SPARK-36453 Project:

[jira] [Commented] (SPARK-35320) from_json cannot parse maps with timestamp as key

2021-05-16 Thread Pablo Langa Blanco (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17345782#comment-17345782 ] Pablo Langa Blanco commented on SPARK-35320: I'm taking a look at this > from_json cannot

[jira] [Commented] (SPARK-35207) hash() and other hash builtins do not normalize negative zero

2021-05-03 Thread Pablo Langa Blanco (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17338698#comment-17338698 ] Pablo Langa Blanco commented on SPARK-35207: Hi [~tarmstrong] , I have read about signed

[jira] [Commented] (SPARK-35249) to_timestamp can't parse 6 digit microsecond SSSSSS

2021-05-02 Thread Pablo Langa Blanco (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35249?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17338139#comment-17338139 ] Pablo Langa Blanco commented on SPARK-35249: Hi [~toopt4], I think there are two different

[jira] [Commented] (SPARK-34464) `first` function is sorting the dataset while sometimes it is used to get "any value"

2021-04-06 Thread Pablo Langa Blanco (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34464?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17315782#comment-17315782 ] Pablo Langa Blanco commented on SPARK-34464: Hi [~lfruleux] , Thank you for reporting it! I

[jira] [Commented] (SPARK-34464) `first` function is sorting the dataset while sometimes it is used to get "any value"

2021-04-05 Thread Pablo Langa Blanco (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34464?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17315152#comment-17315152 ] Pablo Langa Blanco commented on SPARK-34464: I've open SPARK-34961 because I think It's an

[jira] [Resolved] (SPARK-34464) `first` function is sorting the dataset while sometimes it is used to get "any value"

2021-04-05 Thread Pablo Langa Blanco (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Langa Blanco resolved SPARK-34464. Resolution: Not A Bug > `first` function is sorting the dataset while sometimes

[jira] [Created] (SPARK-34961) Migrate First function from DeclarativeAggregate to TypedImperativeAggregate to improve performance

2021-04-05 Thread Pablo Langa Blanco (Jira)
Pablo Langa Blanco created SPARK-34961: -- Summary: Migrate First function from DeclarativeAggregate to TypedImperativeAggregate to improve performance Key: SPARK-34961 URL:

[jira] [Commented] (SPARK-34464) `first` function is sorting the dataset while sometimes it is used to get "any value"

2021-03-30 Thread Pablo Langa Blanco (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34464?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17311845#comment-17311845 ] Pablo Langa Blanco commented on SPARK-34464: Hi [~lfruleux], Here it's a link that explain

[jira] [Commented] (SPARK-33744) Canonicalization error in SortAggregate

2020-12-13 Thread Pablo Langa Blanco (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33744?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17248574#comment-17248574 ] Pablo Langa Blanco commented on SPARK-33744: I have seen the problem, but I don't have

[jira] [Commented] (SPARK-33744) Canonicalization error in SortAggregate

2020-12-12 Thread Pablo Langa Blanco (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33744?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17248417#comment-17248417 ] Pablo Langa Blanco commented on SPARK-33744: I'm taking a look at it, thanks for reporting.

[jira] [Commented] (SPARK-33118) CREATE TEMPORARY TABLE fails with location

2020-10-12 Thread Pablo Langa Blanco (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33118?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17212242#comment-17212242 ] Pablo Langa Blanco commented on SPARK-33118: I'm working on it > CREATE TEMPORARY TABLE

[jira] [Updated] (SPARK-33118) CREATE TEMPORARY TABLE fails with location

2020-10-12 Thread Pablo Langa Blanco (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Langa Blanco updated SPARK-33118: --- Description: The problem is produced when you use CREATE TEMPORARY TABLE with

[jira] [Created] (SPARK-33118) CREATE TEMPORARY TABLE fails with location

2020-10-12 Thread Pablo Langa Blanco (Jira)
Pablo Langa Blanco created SPARK-33118: -- Summary: CREATE TEMPORARY TABLE fails with location Key: SPARK-33118 URL: https://issues.apache.org/jira/browse/SPARK-33118 Project: Spark Issue

[jira] [Commented] (SPARK-32046) current_timestamp called in a cache dataframe freezes the time for all future calls

2020-09-29 Thread Pablo Langa Blanco (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32046?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17203733#comment-17203733 ] Pablo Langa Blanco commented on SPARK-32046: When you cache a Dataframe, you do not save the

[jira] [Commented] (SPARK-32046) current_timestamp called in a cache dataframe freezes the time for all future calls

2020-09-28 Thread Pablo Langa Blanco (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32046?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17203345#comment-17203345 ] Pablo Langa Blanco commented on SPARK-32046: [~smilegator] why are we computing current time

[jira] [Comment Edited] (SPARK-32046) current_timestamp called in a cache dataframe freezes the time for all future calls

2020-09-28 Thread Pablo Langa Blanco (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32046?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17203040#comment-17203040 ] Pablo Langa Blanco edited comment on SPARK-32046 at 9/28/20, 4:20 PM:

[jira] [Commented] (SPARK-32046) current_timestamp called in a cache dataframe freezes the time for all future calls

2020-09-28 Thread Pablo Langa Blanco (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32046?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17203159#comment-17203159 ] Pablo Langa Blanco commented on SPARK-32046: Ok, I see, it make sense. I'll think about a

[jira] [Commented] (SPARK-32046) current_timestamp called in a cache dataframe freezes the time for all future calls

2020-09-28 Thread Pablo Langa Blanco (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32046?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17203040#comment-17203040 ] Pablo Langa Blanco commented on SPARK-32046: I have been looking at the problem and I think

[jira] [Commented] (SPARK-32463) Document Data Type inference rule in SQL reference

2020-07-28 Thread Pablo Langa Blanco (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17166168#comment-17166168 ] Pablo Langa Blanco commented on SPARK-32463: Thanks [~huaxingao], I'll take a look on this

[jira] [Commented] (SPARK-32025) CSV schema inference with boolean & integer

2020-06-20 Thread Pablo Langa Blanco (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17141213#comment-17141213 ] Pablo Langa Blanco commented on SPARK-32025: I'm looking for the problem, as a workaround

[jira] [Commented] (SPARK-31779) Redefining struct inside array incorrectly wraps child fields in array

2020-05-29 Thread Pablo Langa Blanco (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17119319#comment-17119319 ] Pablo Langa Blanco commented on SPARK-31779: How about using array_zip? {code:java} // code

[jira] [Commented] (SPARK-31779) Redefining struct inside array incorrectly wraps child fields in array

2020-05-23 Thread Pablo Langa Blanco (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17114866#comment-17114866 ] Pablo Langa Blanco commented on SPARK-31779: Hi [~jeff.w.evans] I think this is not a bug

[jira] [Issue Comment Deleted] (SPARK-31561) Add QUALIFY Clause

2020-05-10 Thread Pablo Langa Blanco (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Langa Blanco updated SPARK-31561: --- Comment: was deleted (was: I'm working on this) > Add QUALIFY Clause >

[jira] [Commented] (SPARK-31561) Add QUALIFY Clause

2020-05-01 Thread Pablo Langa Blanco (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17097360#comment-17097360 ] Pablo Langa Blanco commented on SPARK-31561: I'm working on this > Add QUALIFY Clause >

[jira] [Commented] (SPARK-31574) Schema evolution in spark while using the storage format as parquet

2020-04-30 Thread Pablo Langa Blanco (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17096805#comment-17096805 ] Pablo Langa Blanco commented on SPARK-31574: Spark have a functionality to read multiple

[jira] [Commented] (SPARK-31566) Add SQL Rest API Documentation

2020-04-30 Thread Pablo Langa Blanco (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17096188#comment-17096188 ] Pablo Langa Blanco commented on SPARK-31566: Ok, perfect, thank you! > Add SQL Rest API

[jira] [Commented] (SPARK-31566) Add SQL Rest API Documentation

2020-04-29 Thread Pablo Langa Blanco (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17095881#comment-17095881 ] Pablo Langa Blanco commented on SPARK-31566: I'm taking a look on this. I think is useful to

[jira] [Commented] (SPARK-31500) collect_set() of BinaryType returns duplicate elements

2020-04-26 Thread Pablo Langa Blanco (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17092818#comment-17092818 ] Pablo Langa Blanco commented on SPARK-31500: [https://github.com/apache/spark/pull/28351] >

[jira] [Commented] (SPARK-31500) collect_set() of BinaryType returns duplicate elements

2020-04-24 Thread Pablo Langa Blanco (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17091833#comment-17091833 ] Pablo Langa Blanco commented on SPARK-31500: Hi [~ewasserman], This is a scala base

[jira] [Created] (SPARK-31435) Add SPARK_JARS_DIR enviroment variable (new) to Spark configuration documentation

2020-04-13 Thread Pablo Langa Blanco (Jira)
Pablo Langa Blanco created SPARK-31435: -- Summary: Add SPARK_JARS_DIR enviroment variable (new) to Spark configuration documentation Key: SPARK-31435 URL: https://issues.apache.org/jira/browse/SPARK-31435

[jira] [Commented] (SPARK-31435) Add SPARK_JARS_DIR enviroment variable (new) to Spark configuration documentation

2020-04-13 Thread Pablo Langa Blanco (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17082233#comment-17082233 ] Pablo Langa Blanco commented on SPARK-31435: I'm working on this > Add SPARK_JARS_DIR

[jira] [Commented] (SPARK-30077) create TEMPORARY VIEW USING should look up catalog/table like v2 commands

2019-12-13 Thread Pablo Langa Blanco (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30077?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16995945#comment-16995945 ] Pablo Langa Blanco commented on SPARK-30077: [~huaxingao] Can we close this ticket? Reading

[jira] [Commented] (SPARK-29563) CREATE TABLE LIKE should look up catalog/table like v2 commands

2019-12-13 Thread Pablo Langa Blanco (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16995942#comment-16995942 ] Pablo Langa Blanco commented on SPARK-29563: [~dkbiswal] Are you still working on this? If

[jira] [Commented] (SPARK-30040) DROP FUNCTION should look up catalog/table like v2 commands

2019-11-25 Thread Pablo Langa Blanco (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16982215#comment-16982215 ] Pablo Langa Blanco commented on SPARK-30040: I'm working on this > DROP FUNCTION should

[jira] [Created] (SPARK-30040) DROP FUNCTION should look up catalog/table like v2 commands

2019-11-25 Thread Pablo Langa Blanco (Jira)
Pablo Langa Blanco created SPARK-30040: -- Summary: DROP FUNCTION should look up catalog/table like v2 commands Key: SPARK-30040 URL: https://issues.apache.org/jira/browse/SPARK-30040 Project:

[jira] [Commented] (SPARK-30039) CREATE FUNCTION should look up catalog/table like v2 commands

2019-11-25 Thread Pablo Langa Blanco (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16982214#comment-16982214 ] Pablo Langa Blanco commented on SPARK-30039: I am working on this > CREATE FUNCTION should

[jira] [Created] (SPARK-30039) CREATE FUNCTION should look up catalog/table like v2 commands

2019-11-25 Thread Pablo Langa Blanco (Jira)
Pablo Langa Blanco created SPARK-30039: -- Summary: CREATE FUNCTION should look up catalog/table like v2 commands Key: SPARK-30039 URL: https://issues.apache.org/jira/browse/SPARK-30039 Project:

[jira] [Commented] (SPARK-30038) DESCRIBE FUNCTION should look up catalog/table like v2 commands

2019-11-25 Thread Pablo Langa Blanco (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16982213#comment-16982213 ] Pablo Langa Blanco commented on SPARK-30038: I am working on this > DESCRIBE FUNCTION

[jira] [Created] (SPARK-30038) DESCRIBE FUNCTION should look up catalog/table like v2 commands

2019-11-25 Thread Pablo Langa Blanco (Jira)
Pablo Langa Blanco created SPARK-30038: -- Summary: DESCRIBE FUNCTION should look up catalog/table like v2 commands Key: SPARK-30038 URL: https://issues.apache.org/jira/browse/SPARK-30038 Project:

[jira] [Created] (SPARK-29922) SHOW FUNCTIONS should look up catalog/table like v2 commands

2019-11-15 Thread Pablo Langa Blanco (Jira)
Pablo Langa Blanco created SPARK-29922: -- Summary: SHOW FUNCTIONS should look up catalog/table like v2 commands Key: SPARK-29922 URL: https://issues.apache.org/jira/browse/SPARK-29922 Project:

[jira] [Commented] (SPARK-29922) SHOW FUNCTIONS should look up catalog/table like v2 commands

2019-11-15 Thread Pablo Langa Blanco (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16975272#comment-16975272 ] Pablo Langa Blanco commented on SPARK-29922: I'm working on this > SHOW FUNCTIONS should

[jira] [Commented] (SPARK-29829) SHOW TABLE EXTENDED should look up catalog/table like v2 commands

2019-11-10 Thread Pablo Langa Blanco (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16971191#comment-16971191 ] Pablo Langa Blanco commented on SPARK-29829: I am working on this > SHOW TABLE EXTENDED

[jira] [Created] (SPARK-29829) SHOW TABLE EXTENDED should look up catalog/table like v2 commands

2019-11-10 Thread Pablo Langa Blanco (Jira)
Pablo Langa Blanco created SPARK-29829: -- Summary: SHOW TABLE EXTENDED should look up catalog/table like v2 commands Key: SPARK-29829 URL: https://issues.apache.org/jira/browse/SPARK-29829

[jira] [Commented] (SPARK-29523) SHOW COLUMNS should look up catalog/table like v2 commands

2019-10-20 Thread Pablo Langa Blanco (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16955422#comment-16955422 ] Pablo Langa Blanco commented on SPARK-29523: I am working on this > SHOW COLUMNS should

[jira] [Created] (SPARK-29523) SHOW COLUMNS should look up catalog/table like v2 commands

2019-10-20 Thread Pablo Langa Blanco (Jira)
Pablo Langa Blanco created SPARK-29523: -- Summary: SHOW COLUMNS should look up catalog/table like v2 commands Key: SPARK-29523 URL: https://issues.apache.org/jira/browse/SPARK-29523 Project: Spark

[jira] [Commented] (SPARK-29519) SHOW TBLPROPERTIES should look up catalog/table like v2 commands

2019-10-19 Thread Pablo Langa Blanco (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29519?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16955207#comment-16955207 ] Pablo Langa Blanco commented on SPARK-29519: I am working on this > SHOW TBLPROPERTIES

[jira] [Created] (SPARK-29519) SHOW TBLPROPERTIES should look up catalog/table like v2 commands

2019-10-19 Thread Pablo Langa Blanco (Jira)
Pablo Langa Blanco created SPARK-29519: -- Summary: SHOW TBLPROPERTIES should look up catalog/table like v2 commands Key: SPARK-29519 URL: https://issues.apache.org/jira/browse/SPARK-29519

[jira] [Created] (SPARK-29433) Web UI Stages table tooltip correction

2019-10-10 Thread Pablo Langa Blanco (Jira)
Pablo Langa Blanco created SPARK-29433: -- Summary: Web UI Stages table tooltip correction Key: SPARK-29433 URL: https://issues.apache.org/jira/browse/SPARK-29433 Project: Spark Issue

[jira] [Created] (SPARK-29431) Improve Web UI / Sql tab visualization with cached dataframes.

2019-10-10 Thread Pablo Langa Blanco (Jira)
Pablo Langa Blanco created SPARK-29431: -- Summary: Improve Web UI / Sql tab visualization with cached dataframes. Key: SPARK-29431 URL: https://issues.apache.org/jira/browse/SPARK-29431 Project:

[jira] [Created] (SPARK-29019) Improve tooltip information in JDBC/ODBC Server tab

2019-09-08 Thread Pablo Langa Blanco (Jira)
Pablo Langa Blanco created SPARK-29019: -- Summary: Improve tooltip information in JDBC/ODBC Server tab Key: SPARK-29019 URL: https://issues.apache.org/jira/browse/SPARK-29019 Project: Spark

[jira] [Commented] (SPARK-28372) Document Spark WEB UI

2019-09-02 Thread Pablo Langa Blanco (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16921026#comment-16921026 ] Pablo Langa Blanco commented on SPARK-28372: [~smilegator] We have a streaming tab section

[jira] [Commented] (SPARK-28373) Document JDBC/ODBC Server page

2019-09-02 Thread Pablo Langa Blanco (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16921019#comment-16921019 ] Pablo Langa Blanco commented on SPARK-28373: [~podongfeng] Ok i can take care of it  >

[jira] [Commented] (SPARK-28542) Document Stages page

2019-08-18 Thread Pablo Langa Blanco (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16909985#comment-16909985 ] Pablo Langa Blanco commented on SPARK-28542: I want to contribution on this if you are not

[jira] [Commented] (SPARK-28543) Document Spark Jobs page

2019-08-13 Thread Pablo Langa Blanco (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28543?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16905988#comment-16905988 ] Pablo Langa Blanco commented on SPARK-28543: Hi [~podongfeng], i have seen it when i do the

[jira] [Commented] (SPARK-28543) Document Spark Jobs page

2019-08-03 Thread Pablo Langa Blanco (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28543?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16899482#comment-16899482 ] Pablo Langa Blanco commented on SPARK-28543: Hi! I want to contribute on this. > Document

[jira] [Closed] (SPARK-28585) Improve WebUI DAG information: Add extra info to rdd from spark plan

2019-08-03 Thread Pablo Langa Blanco (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28585?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Langa Blanco closed SPARK-28585. -- > Improve WebUI DAG information: Add extra info to rdd from spark plan >

[jira] [Resolved] (SPARK-28585) Improve WebUI DAG information: Add extra info to rdd from spark plan

2019-08-03 Thread Pablo Langa Blanco (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28585?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Langa Blanco resolved SPARK-28585. Resolution: Won't Fix > Improve WebUI DAG information: Add extra info to rdd from

[jira] [Created] (SPARK-28585) Improve WebUI DAG information: Add extra info to rdd from spark plan

2019-07-31 Thread Pablo Langa Blanco (JIRA)
Pablo Langa Blanco created SPARK-28585: -- Summary: Improve WebUI DAG information: Add extra info to rdd from spark plan Key: SPARK-28585 URL: https://issues.apache.org/jira/browse/SPARK-28585

[jira] [Commented] (SPARK-26648) Noop Streaming Sink using DSV2

2019-01-17 Thread Pablo Langa Blanco (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16745506#comment-16745506 ] Pablo Langa Blanco commented on SPARK-26648: Duplicated with SPARK-26649? > Noop Streaming

[jira] [Commented] (SPARK-24701) SparkMaster WebUI allow all appids to be shown in detail on port 4040 rather than different ports per app

2019-01-07 Thread Pablo Langa Blanco (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24701?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16736366#comment-16736366 ] Pablo Langa Blanco commented on SPARK-24701: Hi [~toopt4] i think you have this

[jira] [Commented] (SPARK-26518) UI Application Info Race Condition Can Throw NoSuchElement

2019-01-07 Thread Pablo Langa Blanco (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16736087#comment-16736087 ] Pablo Langa Blanco commented on SPARK-26518: i was trying to find and easy solution to this

[jira] [Commented] (SPARK-26457) Show hadoop configurations in HistoryServer environment tab

2019-01-07 Thread Pablo Langa Blanco (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16736024#comment-16736024 ] Pablo Langa Blanco commented on SPARK-26457: Ok, I don't know that you are working on it.

[jira] [Commented] (SPARK-26518) UI Application Info Race Condition Can Throw NoSuchElement

2019-01-06 Thread Pablo Langa Blanco (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16735135#comment-16735135 ] Pablo Langa Blanco commented on SPARK-26518: Hi I'm looking into it.  Pablo > UI

[jira] [Commented] (SPARK-26457) Show hadoop configurations in HistoryServer environment tab

2019-01-05 Thread Pablo Langa Blanco (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16734986#comment-16734986 ] Pablo Langa Blanco commented on SPARK-26457: Hi [~deshanxiao], What configurations are you

[jira] [Commented] (SPARK-25917) Spark UI's executors page loads forever when memoryMetrics in None. Fix is to JSON ignore memorymetrics when it is None.

2019-01-05 Thread Pablo Langa Blanco (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25917?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16734984#comment-16734984 ] Pablo Langa Blanco commented on SPARK-25917: The pull request was closed because the problem

  1   2   >