[jira] [Commented] (SPARK-35885) Use keyserver.ubuntu.com as a keyserver for CRAN

2021-11-22 Thread Marek Novotny (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17447386#comment-17447386 ] Marek Novotny commented on SPARK-35885: --- [~dongjoon] FYI, buster-cran35 is signed

[jira] [Commented] (SPARK-25469) Eval methods of Concat, Reverse and ElementAt should use pattern matching only once

2018-09-21 Thread Marek Novotny (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25469?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16623222#comment-16623222 ] Marek Novotny commented on SPARK-25469: --- [~hyukjin.kwon] Thanks for your help! >

[jira] [Commented] (SPARK-25469) Eval methods of Concat, Reverse and ElementAt should use pattern matching only once

2018-09-20 Thread Marek Novotny (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25469?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16621792#comment-16621792 ] Marek Novotny commented on SPARK-25469: --- [~hyukjin.kwon] Appologize for the duplic

[jira] [Updated] (SPARK-25469) Eval methods of Concat, Reverse and ElementAt should use pattern matching only once

2018-09-20 Thread Marek Novotny (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marek Novotny updated SPARK-25469: -- Description: Pattern matching is utilized for each call of {{Concat.eval}}, {{Reverse.nullSafe

[jira] [Updated] (SPARK-25469) Eval methods of Concat, Reverse and ElementAt should use pattern matching only once

2018-09-20 Thread Marek Novotny (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marek Novotny updated SPARK-25469: -- Summary: Eval methods of Concat, Reverse and ElementAt should use pattern matching only once

[jira] [Created] (SPARK-25469) Eval method of Concat expression should call pattern matching only once

2018-09-19 Thread Marek Novotny (JIRA)
Marek Novotny created SPARK-25469: - Summary: Eval method of Concat expression should call pattern matching only once Key: SPARK-25469 URL: https://issues.apache.org/jira/browse/SPARK-25469 Project: Sp

[jira] [Created] (SPARK-25470) Eval method of Concat expression should call pattern matching only once

2018-09-19 Thread Marek Novotny (JIRA)
Marek Novotny created SPARK-25470: - Summary: Eval method of Concat expression should call pattern matching only once Key: SPARK-25470 URL: https://issues.apache.org/jira/browse/SPARK-25470 Project: Sp

[jira] [Updated] (SPARK-25122) Deduplication of supports equals code

2018-08-15 Thread Marek Novotny (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marek Novotny updated SPARK-25122: -- Description: The method {{*supportEquals}} determining whether elements of a data type could

[jira] [Created] (SPARK-25122) Deduplication of supports equals code

2018-08-15 Thread Marek Novotny (JIRA)
Marek Novotny created SPARK-25122: - Summary: Deduplication of supports equals code Key: SPARK-25122 URL: https://issues.apache.org/jira/browse/SPARK-25122 Project: Spark Issue Type: Improveme

[jira] [Commented] (SPARK-25068) High-order function: exists(array, function) → boolean

2018-08-14 Thread Marek Novotny (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16579386#comment-16579386 ] Marek Novotny commented on SPARK-25068: --- That's a good point. Thanks for your answ

[jira] [Commented] (SPARK-25068) High-order function: exists(array, function) → boolean

2018-08-13 Thread Marek Novotny (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16578087#comment-16578087 ] Marek Novotny commented on SPARK-25068: --- I am curious about the motivation for add

[jira] [Resolved] (SPARK-24042) High-order function: zip_with_index

2018-08-09 Thread Marek Novotny (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marek Novotny resolved SPARK-24042. --- Resolution: Won't Fix > High-order function: zip_with_index > --

[jira] [Commented] (SPARK-23938) High-order function: map_zip_with(map, map, function) → map

2018-08-06 Thread Marek Novotny (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16570148#comment-16570148 ] Marek Novotny commented on SPARK-23938: --- I'm working on this. Thanks. > High-orde

[jira] [Commented] (SPARK-23901) Data Masking Functions

2018-07-16 Thread Marek Novotny (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16545443#comment-16545443 ] Marek Novotny commented on SPARK-23901: --- Is there a consensus on getting the maski

[jira] [Commented] (SPARK-24741) Have a built-in AVRO data source implementation

2018-07-13 Thread Marek Novotny (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16543367#comment-16543367 ] Marek Novotny commented on SPARK-24741: --- Hi [~smilegator], The main motivation fo

[jira] [Commented] (SPARK-24741) Have a built-in AVRO data source implementation

2018-07-09 Thread Marek Novotny (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16536907#comment-16536907 ] Marek Novotny commented on SPARK-24741: --- It would be nice if the build-in data sou

[jira] [Commented] (SPARK-24165) UDF within when().otherwise() raises NullPointerException

2018-06-29 Thread Marek Novotny (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16527734#comment-16527734 ] Marek Novotny commented on SPARK-24165: --- [~jingxuan001] Please could you provide a

[jira] [Comment Edited] (SPARK-24165) UDF within when().otherwise() raises NullPointerException

2018-06-29 Thread Marek Novotny (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16527556#comment-16527556 ] Marek Novotny edited comment on SPARK-24165 at 6/29/18 12:33 PM: -

[jira] [Commented] (SPARK-24165) UDF within when().otherwise() raises NullPointerException

2018-06-29 Thread Marek Novotny (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16527556#comment-16527556 ] Marek Novotny commented on SPARK-24165: --- It seems that Spark is not able resolve n

[jira] [Updated] (SPARK-24636) Type Coercion of Arrays for array_join Function

2018-06-23 Thread Marek Novotny (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marek Novotny updated SPARK-24636: -- Description: The description of SPARK-23916 refers to the implementation of {{array_join}} fu

[jira] [Created] (SPARK-24636) Type Coercion of Arrays for array_join Function

2018-06-23 Thread Marek Novotny (JIRA)
Marek Novotny created SPARK-24636: - Summary: Type Coercion of Arrays for array_join Function Key: SPARK-24636 URL: https://issues.apache.org/jira/browse/SPARK-24636 Project: Spark Issue Type:

[jira] [Updated] (SPARK-24331) Add arrays_overlap / array_repeat / map_entries

2018-05-25 Thread Marek Novotny (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marek Novotny updated SPARK-24331: -- Description: Add SparkR equivalent to: * arrays_overlap - SPARK-23922 * array_repeat - SPARK-

[jira] [Updated] (SPARK-24331) Add arrays_overlap / array_repeat / map_entries

2018-05-25 Thread Marek Novotny (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marek Novotny updated SPARK-24331: -- Summary: Add arrays_overlap / array_repeat / map_entries(was: Add cardinality / arrays_over

[jira] [Commented] (SPARK-24331) Add cardinality / arrays_overlap / array_repeat / map_entries

2018-05-21 Thread Marek Novotny (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16482577#comment-16482577 ] Marek Novotny commented on SPARK-24331: --- I will work on this. Thanks! > Add cardin

[jira] [Created] (SPARK-24331) Add cardinality / arrays_overlap / array_repeat / map_entries

2018-05-21 Thread Marek Novotny (JIRA)
Marek Novotny created SPARK-24331: - Summary: Add cardinality / arrays_overlap / array_repeat / map_entries Key: SPARK-24331 URL: https://issues.apache.org/jira/browse/SPARK-24331 Project: Spark

[jira] [Created] (SPARK-24305) Avoid serialization of private fields in new collection expressions

2018-05-17 Thread Marek Novotny (JIRA)
Marek Novotny created SPARK-24305: - Summary: Avoid serialization of private fields in new collection expressions Key: SPARK-24305 URL: https://issues.apache.org/jira/browse/SPARK-24305 Project: Spark

[jira] [Commented] (SPARK-23928) High-order function: shuffle(x) → array

2018-05-15 Thread Marek Novotny (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16476108#comment-16476108 ] Marek Novotny commented on SPARK-23928: --- [~hzlu] Cool. (Re: Testing) Sounds good to

[jira] [Commented] (SPARK-23928) High-order function: shuffle(x) → array

2018-05-15 Thread Marek Novotny (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16475451#comment-16475451 ] Marek Novotny commented on SPARK-23928: --- [~hzlu] Any joy? I can take this one or he

[jira] [Commented] (SPARK-23931) High-order function: zip(array1, array2[, ...]) → array

2018-05-11 Thread Marek Novotny (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16472169#comment-16472169 ] Marek Novotny commented on SPARK-23931: --- Ok. Good luck! > High-order function: zip

[jira] [Commented] (SPARK-23931) High-order function: zip(array1, array2[, ...]) → array

2018-05-11 Thread Marek Novotny (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16472157#comment-16472157 ] Marek Novotny commented on SPARK-23931: --- [~DylanGuedes] Any joy? I can take this on

[jira] [Updated] (SPARK-24197) add array_sort function

2018-05-07 Thread Marek Novotny (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marek Novotny updated SPARK-24197: -- Description: Add a SparkR equivalent function to  [SPARK-23921|https://issues.apache.org/jira/br

[jira] [Updated] (SPARK-24197) add array_sort function

2018-05-07 Thread Marek Novotny (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marek Novotny updated SPARK-24197: -- Description: Add a SparkR equivalent function to SPARK-23921. (was: Add a SparkR equivalent fu

[jira] [Commented] (SPARK-24198) add slice function

2018-05-07 Thread Marek Novotny (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16465627#comment-16465627 ] Marek Novotny commented on SPARK-24198: --- I will work on this. Thanks. > add slice

[jira] [Created] (SPARK-24198) add slice function

2018-05-07 Thread Marek Novotny (JIRA)
Marek Novotny created SPARK-24198: - Summary: add slice function Key: SPARK-24198 URL: https://issues.apache.org/jira/browse/SPARK-24198 Project: Spark Issue Type: Sub-task Component

[jira] [Commented] (SPARK-24197) add array_sort function

2018-05-07 Thread Marek Novotny (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16465626#comment-16465626 ] Marek Novotny commented on SPARK-24197: --- I will work on this. Thanks. > add array_

[jira] [Created] (SPARK-24197) add array_sort function

2018-05-07 Thread Marek Novotny (JIRA)
Marek Novotny created SPARK-24197: - Summary: add array_sort function Key: SPARK-24197 URL: https://issues.apache.org/jira/browse/SPARK-24197 Project: Spark Issue Type: Sub-task Comp

[jira] [Created] (SPARK-24148) Adding Ability to Specify SQL Type of Empty Arrays

2018-05-02 Thread Marek Novotny (JIRA)
Marek Novotny created SPARK-24148: - Summary: Adding Ability to Specify SQL Type of Empty Arrays Key: SPARK-24148 URL: https://issues.apache.org/jira/browse/SPARK-24148 Project: Spark Issue Ty

[jira] [Commented] (SPARK-23935) High-order function: map_entries(map) → array>

2018-04-27 Thread Marek Novotny (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16456274#comment-16456274 ] Marek Novotny commented on SPARK-23935: --- I will work on this one. Thanks. > High-o

[jira] [Commented] (SPARK-23934) High-order function: map_from_entries(array>) → map

2018-04-27 Thread Marek Novotny (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16456272#comment-16456272 ] Marek Novotny commented on SPARK-23934: --- I will work on this one. Thanks. > High-o

[jira] [Comment Edited] (SPARK-23925) High-order function: repeat(element, count) → array

2018-04-26 Thread Marek Novotny (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16454526#comment-16454526 ] Marek Novotny edited comment on SPARK-23925 at 4/26/18 4:47 PM: ---

[jira] [Commented] (SPARK-23925) High-order function: repeat(element, count) → array

2018-04-26 Thread Marek Novotny (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16454526#comment-16454526 ] Marek Novotny commented on SPARK-23925: --- @pepinoflo Any joy? I can take this one or

[jira] [Created] (SPARK-24042) High-order function: zip_with_index

2018-04-21 Thread Marek Novotny (JIRA)
Marek Novotny created SPARK-24042: - Summary: High-order function: zip_with_index Key: SPARK-24042 URL: https://issues.apache.org/jira/browse/SPARK-24042 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-23936) High-order function: map_concat(map1, map2, ..., mapN) → map

2018-04-11 Thread Marek Novotny (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23936?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16434185#comment-16434185 ] Marek Novotny commented on SPARK-23936: --- Shouldn't we overload _concat_ function fo

[jira] [Commented] (SPARK-23926) High-order function: reverse(x) → array

2018-04-09 Thread Marek Novotny (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16430539#comment-16430539 ] Marek Novotny commented on SPARK-23926: --- I take this one. > High-order function: r

[jira] [Updated] (SPARK-23821) Collection function: flatten

2018-03-29 Thread Marek Novotny (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marek Novotny updated SPARK-23821: -- Summary: Collection function: flatten (was: Collection functions: flatten) > Collection functi

[jira] [Created] (SPARK-23821) Collection functions: flatten

2018-03-29 Thread Marek Novotny (JIRA)
Marek Novotny created SPARK-23821: - Summary: Collection functions: flatten Key: SPARK-23821 URL: https://issues.apache.org/jira/browse/SPARK-23821 Project: Spark Issue Type: New Feature

[jira] [Created] (SPARK-23798) The CreateArray and ConcatArray should return the default array type when no children provided

2018-03-27 Thread Marek Novotny (JIRA)
Marek Novotny created SPARK-23798: - Summary: The CreateArray and ConcatArray should return the default array type when no children provided Key: SPARK-23798 URL: https://issues.apache.org/jira/browse/SPARK-23798

[jira] [Commented] (SPARK-23504) Flaky test: RateSourceV2Suite.basic microbatch execution

2018-03-27 Thread Marek Novotny (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16415313#comment-16415313 ] Marek Novotny commented on SPARK-23504: --- Experienced the [same problem|https://amp

[jira] [Updated] (SPARK-23736) Extension of the concat function to support array columns

2018-03-26 Thread Marek Novotny (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marek Novotny updated SPARK-23736: -- Description: Extend the _concat_ function to also support array columns. Example: {{concat(ar

[jira] [Updated] (SPARK-23736) Extension of the concat function to support array columns

2018-03-26 Thread Marek Novotny (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marek Novotny updated SPARK-23736: -- Description: Extend the _concat_ function to also support array columns. Example: concat(arra

[jira] [Updated] (SPARK-23736) collection function: concat_arrays

2018-03-19 Thread Marek Novotny (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marek Novotny updated SPARK-23736: -- Issue Type: New Feature (was: Story) > collection function: concat_arrays > --

[jira] [Created] (SPARK-23736) collection function: concat_arrays

2018-03-19 Thread Marek Novotny (JIRA)
Marek Novotny created SPARK-23736: - Summary: collection function: concat_arrays Key: SPARK-23736 URL: https://issues.apache.org/jira/browse/SPARK-23736 Project: Spark Issue Type: Story