[
https://issues.apache.org/jira/browse/SPARK-23930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Takuya Ueshin resolved SPARK-23930.
---
Resolution: Fixed
Fix Version/s: 2.4.0
Issue resolved by pull request 21040
[
https://issues.apache.org/jira/browse/SPARK-23930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Takuya Ueshin reassigned SPARK-23930:
-
Assignee: Marco Gaido
> High-order function: slice(x, start, length) → array
>
[
https://issues.apache.org/jira/browse/SPARK-23921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Takuya Ueshin resolved SPARK-23921.
---
Resolution: Fixed
Fix Version/s: 2.4.0
Issue resolved by pull request 21021
[
https://issues.apache.org/jira/browse/SPARK-23921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Takuya Ueshin reassigned SPARK-23921:
-
Assignee: Kazuaki Ishizaki
> High-order function: array_sort(x) → array
>
[
https://issues.apache.org/jira/browse/SPARK-23916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Takuya Ueshin resolved SPARK-23916.
---
Resolution: Fixed
Fix Version/s: 2.4.0
Issue resolved by pull request 21011
[
https://issues.apache.org/jira/browse/SPARK-23916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Takuya Ueshin reassigned SPARK-23916:
-
Assignee: Marco Gaido
> High-order function: array_join(x, delimiter, null_replacement)
[
https://issues.apache.org/jira/browse/SPARK-23902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Takuya Ueshin resolved SPARK-23902.
---
Resolution: Fixed
Fix Version/s: 2.4.0
Issue resolved by pull request 21008
[
https://issues.apache.org/jira/browse/SPARK-23902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Takuya Ueshin reassigned SPARK-23902:
-
Assignee: Marco Gaido
> Provide an option in months_between UDF to disable rounding-off
[
https://issues.apache.org/jira/browse/SPARK-23821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Takuya Ueshin resolved SPARK-23821.
---
Resolution: Fixed
Fix Version/s: 2.4.0
Issue resolved by pull request 20938
[
https://issues.apache.org/jira/browse/SPARK-23821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Takuya Ueshin reassigned SPARK-23821:
-
Assignee: Marek Novotny
> High-order function: flatten(x) → array
>
[
https://issues.apache.org/jira/browse/SPARK-23736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Takuya Ueshin resolved SPARK-23736.
---
Resolution: Fixed
Fix Version/s: 2.4.0
Issue resolved by pull request 20858
[
https://issues.apache.org/jira/browse/SPARK-23736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Takuya Ueshin reassigned SPARK-23736:
-
Assignee: Marek Novotny
> High-order function: concat(array1, array2, ..., arrayN) →
[
https://issues.apache.org/jira/browse/SPARK-23924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Takuya Ueshin reassigned SPARK-23924:
-
Assignee: Kazuaki Ishizaki
> High-order function: element_at
>
[
https://issues.apache.org/jira/browse/SPARK-23924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Takuya Ueshin resolved SPARK-23924.
---
Resolution: Fixed
Fix Version/s: 2.4.0
Issue resolved by pull request 21053
[
https://issues.apache.org/jira/browse/SPARK-23919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Takuya Ueshin resolved SPARK-23919.
---
Resolution: Fixed
Fix Version/s: 2.4.0
Issue resolved by pull request 21037
[
https://issues.apache.org/jira/browse/SPARK-23919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Takuya Ueshin reassigned SPARK-23919:
-
Assignee: Kazuaki Ishizaki
> High-order function: array_position(x, element) → bigint
>
[
https://issues.apache.org/jira/browse/SPARK-23926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Takuya Ueshin resolved SPARK-23926.
---
Resolution: Fixed
Fix Version/s: 2.4.0
Issue resolved by pull request 21034
[
https://issues.apache.org/jira/browse/SPARK-23926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Takuya Ueshin reassigned SPARK-23926:
-
Assignee: Marek Novotny
> High-order function: reverse(x) → array
>
Takuya Ueshin created SPARK-24007:
-
Summary: EqualNullSafe for FloatType and DoubleType might generate
a wrong result by codegen.
Key: SPARK-24007
URL: https://issues.apache.org/jira/browse/SPARK-24007
[
https://issues.apache.org/jira/browse/SPARK-23918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Takuya Ueshin resolved SPARK-23918.
---
Resolution: Fixed
Fix Version/s: 2.4.0
Issue resolved by pull request 21025
[
https://issues.apache.org/jira/browse/SPARK-23918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Takuya Ueshin reassigned SPARK-23918:
-
Assignee: Marco Gaido
> High-order function: array_min(x) → x
>
[
https://issues.apache.org/jira/browse/SPARK-23695?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Takuya Ueshin resolved SPARK-23695.
---
Resolution: Fixed
Fix Version/s: 2.4.0
2.3.1
Issue resolved by
[
https://issues.apache.org/jira/browse/SPARK-23695?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Takuya Ueshin reassigned SPARK-23695:
-
Assignee: Hyukjin Kwon
> Confusing error message for PySpark's Kinesis tests when its
Takuya Ueshin created SPARK-23387:
-
Summary: Backport assertPandasEqual to branch-2.3.
Key: SPARK-23387
URL: https://issues.apache.org/jira/browse/SPARK-23387
Project: Spark
Issue Type: Bug
Takuya Ueshin created SPARK-23334:
-
Summary: Fix pandas_udf with return type StringType() to handle
str type properly in Python 2.
Key: SPARK-23334
URL: https://issues.apache.org/jira/browse/SPARK-23334
[
https://issues.apache.org/jira/browse/SPARK-23290?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16352120#comment-16352120
]
Takuya Ueshin commented on SPARK-23290:
---
Thanks [~amenck] for clarifying.
I'll submit a pr for
[
https://issues.apache.org/jira/browse/SPARK-23290?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16349796#comment-16349796
]
Takuya Ueshin commented on SPARK-23290:
---
Thanks for the report!
I'm afraid I couldn't figure out
[
https://issues.apache.org/jira/browse/SPARK-1?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Takuya Ueshin updated SPARK-1:
--
Target Version/s: 2.3.0
> Add User Documentation for Working with Arrow in Spark
>
[
https://issues.apache.org/jira/browse/SPARK-22809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16336881#comment-16336881
]
Takuya Ueshin commented on SPARK-22809:
---
I agree with [~dongjoon].
[~CricketScience] Ah, I tried
[
https://issues.apache.org/jira/browse/SPARK-22809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16335536#comment-16335536
]
Takuya Ueshin commented on SPARK-22809:
---
[~holdenk] Hi, any updates on this?
I might miss
[
https://issues.apache.org/jira/browse/SPARK-22274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Takuya Ueshin resolved SPARK-22274.
---
Resolution: Fixed
Fix Version/s: 2.4.0
Issue resolved by pull request 19872
[
https://issues.apache.org/jira/browse/SPARK-22274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Takuya Ueshin reassigned SPARK-22274:
-
Assignee: Li Jin
> User-defined aggregation functions with pandas udf
>
Takuya Ueshin created SPARK-23141:
-
Summary: Support data type string as a returnType for
registerJavaFunction.
Key: SPARK-23141
URL: https://issues.apache.org/jira/browse/SPARK-23141
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-23122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16330076#comment-16330076
]
Takuya Ueshin edited comment on SPARK-23122 at 1/18/18 5:57 AM:
Issue
[
https://issues.apache.org/jira/browse/SPARK-23122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Takuya Ueshin resolved SPARK-23122.
---
Resolution: Fixed
Fix Version/s: 2.3.0
Issue resolved by pull request 20288
[
https://issues.apache.org/jira/browse/SPARK-23122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Takuya Ueshin reassigned SPARK-23122:
-
Assignee: Hyukjin Kwon
> Deprecate register* for UDFs in SQLContext and Catalog in
[
https://issues.apache.org/jira/browse/SPARK-23018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Takuya Ueshin resolved SPARK-23018.
---
Resolution: Fixed
Fix Version/s: 2.3.0
Issue resolved by pull request 20213
[
https://issues.apache.org/jira/browse/SPARK-23018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Takuya Ueshin reassigned SPARK-23018:
-
Assignee: Bryan Cutler
> PySpark creatDataFrame causes Pandas warning of assignment to
[
https://issues.apache.org/jira/browse/SPARK-22566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Takuya Ueshin resolved SPARK-22566.
---
Resolution: Fixed
Fix Version/s: 2.3.0
Issue resolved by pull request 19792
[
https://issues.apache.org/jira/browse/SPARK-22566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Takuya Ueshin reassigned SPARK-22566:
-
Assignee: Guilherme Berger
> Better error message for `_merge_type` in Pandas to Spark
[
https://issues.apache.org/jira/browse/SPARK-22757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Takuya Ueshin resolved SPARK-22757.
---
Resolution: Fixed
Fix Version/s: 2.3.0
Issue resolved by pull request 19954
[
https://issues.apache.org/jira/browse/SPARK-22757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Takuya Ueshin reassigned SPARK-22757:
-
Assignee: Yinan Li
> Init-container in the driver/executor pods for downloading remote
Takuya Ueshin created SPARK-22874:
-
Summary: Modify checking pandas version to use LooseVersion.
Key: SPARK-22874
URL: https://issues.apache.org/jira/browse/SPARK-22874
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-22535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Takuya Ueshin resolved SPARK-22535.
---
Resolution: Fixed
Fix Version/s: 2.3.0
Issue resolved by pull request 19762
[
https://issues.apache.org/jira/browse/SPARK-22535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Takuya Ueshin reassigned SPARK-22535:
-
Assignee: Shixiong Zhu
> PythonRunner.MonitorThread should give the task a little time
Takuya Ueshin created SPARK-22395:
-
Summary: Fix the behavior of timestamp values for Pandas to
respect session timezone
Key: SPARK-22395
URL: https://issues.apache.org/jira/browse/SPARK-22395
[
https://issues.apache.org/jira/browse/SPARK-22379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Takuya Ueshin resolved SPARK-22379.
---
Resolution: Resolved
> Reduce duplication setUpClass and tearDownClass in PySpark SQL tests
[
https://issues.apache.org/jira/browse/SPARK-22379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16224333#comment-16224333
]
Takuya Ueshin commented on SPARK-22379:
---
Issue resolved by pull request 19595
[
https://issues.apache.org/jira/browse/SPARK-22379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Takuya Ueshin updated SPARK-22379:
--
Fix Version/s: 2.3.0
> Reduce duplication setUpClass and tearDownClass in PySpark SQL tests
>
[
https://issues.apache.org/jira/browse/SPARK-22379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Takuya Ueshin reassigned SPARK-22379:
-
Assignee: Hyukjin Kwon
> Reduce duplication setUpClass and tearDownClass in PySpark SQL
[
https://issues.apache.org/jira/browse/SPARK-22370?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16221976#comment-16221976
]
Takuya Ueshin commented on SPARK-22370:
---
[~srowen] I updated the description. Thanks.
> Config
[
https://issues.apache.org/jira/browse/SPARK-22370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Takuya Ueshin updated SPARK-22370:
--
Description: {{ArrowEvalPythonExec}} and {{FlatMapGroupsInPandasExec}} are
refering config
[
https://issues.apache.org/jira/browse/SPARK-22370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Takuya Ueshin updated SPARK-22370:
--
Description: {{ArrowEvalPythonExec}} and {{FlatMapGroupsInPandasExec}} are
refering config
[
https://issues.apache.org/jira/browse/SPARK-22370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Takuya Ueshin updated SPARK-22370:
--
Description: {{ArrowEvalPythonExec}} and {{FlatMapGroupsInPandasExec}} are
refering config
Takuya Ueshin created SPARK-22370:
-
Summary: Config values should be captured in Driver.
Key: SPARK-22370
URL: https://issues.apache.org/jira/browse/SPARK-22370
Project: Spark
Issue Type:
Takuya Ueshin created SPARK-22273:
-
Summary: Fix key/value schema field names in HashMapGenerators.
Key: SPARK-22273
URL: https://issues.apache.org/jira/browse/SPARK-22273
Project: Spark
Takuya Ueshin created SPARK-22125:
-
Summary: Enable Arrow Stream format for vectorized UDF.
Key: SPARK-22125
URL: https://issues.apache.org/jira/browse/SPARK-22125
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-22109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Takuya Ueshin updated SPARK-22109:
--
Fix Version/s: 2.2.1
> Reading tables partitioned by columns that look like timestamps has
>
[
https://issues.apache.org/jira/browse/SPARK-22109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Takuya Ueshin updated SPARK-22109:
--
Fix Version/s: 2.3.0
> Reading tables partitioned by columns that look like timestamps has
>
[
https://issues.apache.org/jira/browse/SPARK-22109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Takuya Ueshin resolved SPARK-22109.
---
Resolution: Fixed
> Reading tables partitioned by columns that look like timestamps has
>
[
https://issues.apache.org/jira/browse/SPARK-22109?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16177841#comment-16177841
]
Takuya Ueshin commented on SPARK-22109:
---
Issue resolved by pull request 19331
[
https://issues.apache.org/jira/browse/SPARK-22109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Takuya Ueshin reassigned SPARK-22109:
-
Assignee: Hyukjin Kwon
> Reading tables partitioned by columns that look like
[
https://issues.apache.org/jira/browse/SPARK-22067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Takuya Ueshin resolved SPARK-22067.
---
Resolution: Fixed
Fix Version/s: 2.3.0
Issue resolved by pull request 19284
[
https://issues.apache.org/jira/browse/SPARK-22067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Takuya Ueshin reassigned SPARK-22067:
-
Assignee: Bryan Cutler
> ArrowWriter StringWriter not using position of ByteBuffer
[
https://issues.apache.org/jira/browse/SPARK-21190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16162646#comment-16162646
]
Takuya Ueshin commented on SPARK-21190:
---
[~icexelloss] Thank you for your suggestion. I agree that
[
https://issues.apache.org/jira/browse/SPARK-21950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Takuya Ueshin resolved SPARK-21950.
---
Resolution: Fixed
Fix Version/s: 2.1.2
2.3.0
[
https://issues.apache.org/jira/browse/SPARK-21950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Takuya Ueshin reassigned SPARK-21950:
-
Assignee: Takuya Ueshin
> pyspark.sql.tests.SQLTests2 should stop SparkContext.
>
Takuya Ueshin created SPARK-21950:
-
Summary: pyspark.sql.tests.SQLTests2 should stop SparkContext.
Key: SPARK-21950
URL: https://issues.apache.org/jira/browse/SPARK-21950
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-21190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16155270#comment-16155270
]
Takuya Ueshin commented on SPARK-21190:
---
[~leif], [~bryanc] Thanks for the instruction about
[
https://issues.apache.org/jira/browse/SPARK-21190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16153978#comment-16153978
]
Takuya Ueshin commented on SPARK-21190:
---
[~leif] Thank you for your proposal.
I'm sorry but I
[
https://issues.apache.org/jira/browse/SPARK-21190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16153955#comment-16153955
]
Takuya Ueshin commented on SPARK-21190:
---
[~bryanc] Thank you for your suggestion. {{**kwargs}}
[
https://issues.apache.org/jira/browse/SPARK-21583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Takuya Ueshin resolved SPARK-21583.
---
Resolution: Fixed
Fix Version/s: 2.3.0
Issue resolved by pull request 18787
[
https://issues.apache.org/jira/browse/SPARK-21583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Takuya Ueshin reassigned SPARK-21583:
-
Assignee: Bryan Cutler
> Create a ColumnarBatch with ArrowColumnVectors for row based
[
https://issues.apache.org/jira/browse/SPARK-21745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Takuya Ueshin updated SPARK-21745:
--
Description:
This is a refactoring of {{ColumnVector}} hierarchy and related classes.
# make
[
https://issues.apache.org/jira/browse/SPARK-21190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16139507#comment-16139507
]
Takuya Ueshin commented on SPARK-21190:
---
[~icexelloss]
We can know the length of input from
[
https://issues.apache.org/jira/browse/SPARK-21190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16137897#comment-16137897
]
Takuya Ueshin commented on SPARK-21190:
---
Hi all,
I'd like to summarize this discussion about APIs
Takuya Ueshin created SPARK-21781:
-
Summary: Modify DataSourceScanExec to use concrete ColumnVector
type.
Key: SPARK-21781
URL: https://issues.apache.org/jira/browse/SPARK-21781
Project: Spark
Takuya Ueshin created SPARK-21745:
-
Summary: Refactor ColumnVector hierarchy to make ColumnVector
read-only and to introduce MutableColumnVector.
Key: SPARK-21745
URL:
Takuya Ueshin created SPARK-21722:
-
Summary: Enable timezone-aware timestamp type when creating Pandas
DataFrame.
Key: SPARK-21722
URL: https://issues.apache.org/jira/browse/SPARK-21722
Project:
Takuya Ueshin created SPARK-21552:
-
Summary: Add decimal type support to ArrowWriter.
Key: SPARK-21552
URL: https://issues.apache.org/jira/browse/SPARK-21552
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-21440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Takuya Ueshin updated SPARK-21440:
--
Description:
This is a refactoring of {{ArrowConverters}} and related classes.
# Refactor
[
https://issues.apache.org/jira/browse/SPARK-21440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Takuya Ueshin updated SPARK-21440:
--
Summary: Refactor ArrowConverters and add ArrayType and StructType support.
(was: Refactor
[
https://issues.apache.org/jira/browse/SPARK-16542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Takuya Ueshin resolved SPARK-16542.
---
Resolution: Fixed
Fix Version/s: 2.3.0
Issue resolved by pull request 18444
[
https://issues.apache.org/jira/browse/SPARK-16542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Takuya Ueshin reassigned SPARK-16542:
-
Assignee: Xiang Gao
> bugs about types that result an array of null when creating
[
https://issues.apache.org/jira/browse/SPARK-21472?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Takuya Ueshin updated SPARK-21472:
--
Description:
Introducing {{ArrowColumnVector}} as a reader for Arrow vectors.
It extends
[
https://issues.apache.org/jira/browse/SPARK-21472?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Takuya Ueshin updated SPARK-21472:
--
Description:
Introducing {{ArrowColumnVector}} as a reader for Arrow vectors.
It extends
[
https://issues.apache.org/jira/browse/SPARK-21472?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Takuya Ueshin updated SPARK-21472:
--
Description:
Introducing {{ArrowColumnVector}} as a reader for Arrow vectors.
This extends
Takuya Ueshin created SPARK-21472:
-
Summary: Introduce ArrowColumnVector as a reader for Arrow vectors.
Key: SPARK-21472
URL: https://issues.apache.org/jira/browse/SPARK-21472
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-21440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Takuya Ueshin updated SPARK-21440:
--
Description:
This is a refactoring of {{ArrowConverters}} and related classes.
# Refactor
Takuya Ueshin created SPARK-21440:
-
Summary: Refactor ArrowConverters and add DecimalType, ArrayType
and StructType support.
Key: SPARK-21440
URL: https://issues.apache.org/jira/browse/SPARK-21440
[
https://issues.apache.org/jira/browse/SPARK-21327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Takuya Ueshin resolved SPARK-21327.
---
Resolution: Fixed
Fix Version/s: 2.3.0
Issue resolved by pull request 18553
[
https://issues.apache.org/jira/browse/SPARK-21327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Takuya Ueshin reassigned SPARK-21327:
-
Assignee: Takuya Ueshin
> ArrayConstructor should handle an array of typecode 'l' as
Takuya Ueshin created SPARK-21327:
-
Summary: ArrayConstructor should handle an array of typecode 'l'
as long rather than int in Python 2.
Key: SPARK-21327
URL: https://issues.apache.org/jira/browse/SPARK-21327
Takuya Ueshin created SPARK-21300:
-
Summary: ExternalMapToCatalyst should null-check map key prior to
converting to internal value.
Key: SPARK-21300
URL: https://issues.apache.org/jira/browse/SPARK-21300
[
https://issues.apache.org/jira/browse/SPARK-21264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Takuya Ueshin resolved SPARK-21264.
---
Resolution: Fixed
Fix Version/s: 2.3.0
Issue resolved by pull request 18484
[
https://issues.apache.org/jira/browse/SPARK-21264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Takuya Ueshin reassigned SPARK-21264:
-
Assignee: Hyukjin Kwon
> Omitting columns with 'how' specified in join in PySpark
[
https://issues.apache.org/jira/browse/SPARK-20830?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Takuya Ueshin resolved SPARK-20830.
---
Resolution: Fixed
Fix Version/s: 2.3.0
Issue resolved by pull request 18049
[
https://issues.apache.org/jira/browse/SPARK-20830?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Takuya Ueshin reassigned SPARK-20830:
-
Assignee: Maciej Szymkiewicz
> PySpark wrappers for explode_outer and posexplode_outer
[
https://issues.apache.org/jira/browse/SPARK-21125?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Takuya Ueshin resolved SPARK-21125.
---
Resolution: Fixed
Fix Version/s: 2.3.0
Issue resolved by pull request 18332
[
https://issues.apache.org/jira/browse/SPARK-21125?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Takuya Ueshin reassigned SPARK-21125:
-
Assignee: Shane Jarvie
> PySpark context missing function to set Job Description.
>
601 - 700 of 852 matches
Mail list logo
