[
https://issues.apache.org/jira/browse/SPARK-27612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-27612.
--
Resolution: Fixed
Fix Version/s: 3.0.0
Issue resolved by pull request 24519
[
https://issues.apache.org/jira/browse/SPARK-27612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon reassigned SPARK-27612:
Assignee: Hyukjin Kwon
> Creating a DataFrame in PySpark with ArrayType produces some
[
https://issues.apache.org/jira/browse/SPARK-27586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-27586:
--
Affects Version/s: (was: 2.4.2)
3.0.0
> Improve binary comparison:
[
https://issues.apache.org/jira/browse/SPARK-27586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-27586.
---
Resolution: Fixed
Assignee: WoudyGao
Fix Version/s: 3.0.0
This is resolved
[
https://issues.apache.org/jira/browse/SPARK-27612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-27612:
Assignee: Apache Spark
> Creating a DataFrame in PySpark with ArrayType produces some
[
https://issues.apache.org/jira/browse/SPARK-27467?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-27467.
---
Resolution: Fixed
Assignee: Dongjoon Hyun
Fix Version/s: 3.0.0
This is
[
https://issues.apache.org/jira/browse/SPARK-27612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-27612:
Assignee: (was: Apache Spark)
> Creating a DataFrame in PySpark with ArrayType
[
https://issues.apache.org/jira/browse/SPARK-27612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon updated SPARK-27612:
-
Priority: Blocker (was: Critical)
> Creating a DataFrame in PySpark with ArrayType produces
[
https://issues.apache.org/jira/browse/SPARK-27623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16832140#comment-16832140
]
Yuming Wang commented on SPARK-27623:
-
[~abarbulescu] We have a built-in AVRO data source
[
https://issues.apache.org/jira/browse/SPARK-27396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16832136#comment-16832136
]
Bryan Cutler commented on SPARK-27396:
--
The revisions sound good to me, it has a little more focus
[
https://issues.apache.org/jira/browse/SPARK-27620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-27620.
--
Resolution: Fixed
Fix Version/s: 3.0.0
Issue resolved by pull request 24513
[
https://issues.apache.org/jira/browse/SPARK-27620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon reassigned SPARK-27620:
Assignee: yuming.wang
> Update jetty to 9.4.18.v20190429
>
[
https://issues.apache.org/jira/browse/SPARK-27627?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-27627:
Assignee: Apache Spark
> Make option "pathGlobFilter" as a general option for all file
[
https://issues.apache.org/jira/browse/SPARK-27627?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-27627:
Assignee: (was: Apache Spark)
> Make option "pathGlobFilter" as a general option for
Gengliang Wang created SPARK-27627:
--
Summary: Make option "pathGlobFilter" as a general option for all
file sources
Key: SPARK-27627
URL: https://issues.apache.org/jira/browse/SPARK-27627
Project:
[
https://issues.apache.org/jira/browse/SPARK-27626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-27626:
Assignee: Apache Spark
> Fix `docker-image-tool.sh` to be robust in non-bash shell env
>
[
https://issues.apache.org/jira/browse/SPARK-27626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-27626:
Assignee: (was: Apache Spark)
> Fix `docker-image-tool.sh` to be robust in non-bash
Dongjoon Hyun created SPARK-27626:
-
Summary: Fix `docker-image-tool.sh` to be robust in non-bash shell
env
Key: SPARK-27626
URL: https://issues.apache.org/jira/browse/SPARK-27626
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-27625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Patrick Grandjean updated SPARK-27625:
--
Description:
ScalaRelfection.serializerFor fails for annotated type. Example:
[
https://issues.apache.org/jira/browse/SPARK-27625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Patrick Grandjean updated SPARK-27625:
--
Description:
ScalaRelfection.serializerFor fails for annotated type. Example:
Patrick Grandjean created SPARK-27625:
-
Summary: ScalaReflection.serializerFor fails for annotated types
Key: SPARK-27625
URL: https://issues.apache.org/jira/browse/SPARK-27625
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-27601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen reassigned SPARK-27601:
-
Assignee: Yuming Wang
Priority: Minor (was: Major)
BTW I wouldn't call these "Major", but
[
https://issues.apache.org/jira/browse/SPARK-27601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen resolved SPARK-27601.
---
Resolution: Fixed
Fix Version/s: 3.0.0
Issue resolved by pull request 24492
[
https://issues.apache.org/jira/browse/SPARK-27598?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16831861#comment-16831861
]
Gabor Somogyi commented on SPARK-27598:
---
Shell works differently somehow. I've seen problems with
[
https://issues.apache.org/jira/browse/SPARK-27624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-27624:
Assignee: Apache Spark
> Fix CalenderInterval to show an empty interval correctly
>
[
https://issues.apache.org/jira/browse/SPARK-27624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-27624:
Assignee: (was: Apache Spark)
> Fix CalenderInterval to show an empty interval
Dongjoon Hyun created SPARK-27624:
-
Summary: Fix CalenderInterval to show an empty interval correctly
Key: SPARK-27624
URL: https://issues.apache.org/jira/browse/SPARK-27624
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-27194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-27194:
Assignee: Apache Spark
> Job failures when task attempts do not clean up spark-staging
[
https://issues.apache.org/jira/browse/SPARK-27194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-27194:
Assignee: (was: Apache Spark)
> Job failures when task attempts do not clean up
[
https://issues.apache.org/jira/browse/SPARK-27194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Marcelo Vanzin reassigned SPARK-27194:
--
Assignee: (was: Marcelo Vanzin)
> Job failures when task attempts do not clean
[
https://issues.apache.org/jira/browse/SPARK-27194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Marcelo Vanzin reassigned SPARK-27194:
--
Assignee: Marcelo Vanzin
> Job failures when task attempts do not clean up
[
https://issues.apache.org/jira/browse/SPARK-14083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-14083:
Assignee: (was: Apache Spark)
> Analyze JVM bytecode and turn closures into Catalyst
[
https://issues.apache.org/jira/browse/SPARK-14083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-14083:
Assignee: Apache Spark
> Analyze JVM bytecode and turn closures into Catalyst
[
https://issues.apache.org/jira/browse/SPARK-27619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Josh Rosen updated SPARK-27619:
---
Description:
Spark currently allows MapType expressions to be used as input to hash
expressions,
[
https://issues.apache.org/jira/browse/SPARK-27619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Josh Rosen updated SPARK-27619:
---
Description:
Spark currently allows MapType expressions to be used as input to hash
expressions,
[
https://issues.apache.org/jira/browse/SPARK-27623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16831684#comment-16831684
]
Alexandru Barbulescu commented on SPARK-27623:
--
The problem might be related to the fact
[
https://issues.apache.org/jira/browse/SPARK-27612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16831680#comment-16831680
]
Liang-Chi Hsieh commented on SPARK-27612:
-
yeah, seems the issue is happened when python object
[
https://issues.apache.org/jira/browse/SPARK-27607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-27607.
---
Resolution: Fixed
Assignee: Marco Gaido
Fix Version/s: 3.0.0
This is
Alexandru Barbulescu created SPARK-27623:
Summary: Provider org.apache.spark.sql.avro.AvroFileFormat could
not be instantiated
Key: SPARK-27623
URL: https://issues.apache.org/jira/browse/SPARK-27623
[
https://issues.apache.org/jira/browse/SPARK-27612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16831623#comment-16831623
]
Hyukjin Kwon commented on SPARK-27612:
--
Argh, this happens after we upgraded the cloudpickle to
[
https://issues.apache.org/jira/browse/SPARK-27612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16831602#comment-16831602
]
Hyukjin Kwon commented on SPARK-27612:
--
Argh, seems to be a regression.
{code}
>>> from
[
https://issues.apache.org/jira/browse/SPARK-23098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16831601#comment-16831601
]
Gabor Somogyi commented on SPARK-23098:
---
[~DylanGuedes] are you working on this?
> Migrate Kafka
[
https://issues.apache.org/jira/browse/SPARK-27612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon updated SPARK-27612:
-
Labels: correctness (was: )
> Creating a DataFrame in PySpark with ArrayType produces some
[
https://issues.apache.org/jira/browse/SPARK-27612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon updated SPARK-27612:
-
Priority: Critical (was: Major)
> Creating a DataFrame in PySpark with ArrayType produces some
[
https://issues.apache.org/jira/browse/SPARK-27612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16831600#comment-16831600
]
Liang-Chi Hsieh commented on SPARK-27612:
-
Yup, I can reproduce it too. No worry [~bryanc]. :)
[
https://issues.apache.org/jira/browse/SPARK-27612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16831596#comment-16831596
]
Hyukjin Kwon commented on SPARK-27612:
--
haha, you're not crazy
{code}
Welcome to
[
https://issues.apache.org/jira/browse/SPARK-26759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-26759.
--
Resolution: Done
> Arrow optimization in SparkR's interoperability
>
[
https://issues.apache.org/jira/browse/SPARK-26759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon updated SPARK-26759:
-
Fix Version/s: 3.0.0
> Arrow optimization in SparkR's interoperability
>
[
https://issues.apache.org/jira/browse/SPARK-26924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16831594#comment-16831594
]
Hyukjin Kwon commented on SPARK-26924:
--
I am going to make this as a standalone issue. I dont'
[
https://issues.apache.org/jira/browse/SPARK-26924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon updated SPARK-26924:
-
Issue Type: Bug (was: Sub-task)
Parent: (was: SPARK-26759)
> Fix CRAN hack as soon
[
https://issues.apache.org/jira/browse/SPARK-26921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon updated SPARK-26921:
-
Summary: Document Arrow optimization and vectorized R APIs (was: Fix CRAN
hack as soon as
[
https://issues.apache.org/jira/browse/SPARK-26924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon updated SPARK-26924:
-
Summary: Fix CRAN hack as soon as Arrow is available on CRAN (was:
Document Arrow optimization
[
https://issues.apache.org/jira/browse/SPARK-26921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon updated SPARK-26921:
-
Description:
We should update SparkR guide documentation, and some related documents,
comments
[
https://issues.apache.org/jira/browse/SPARK-26924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon updated SPARK-26924:
-
Description:
Arrow optimization was added but Arrow is not available on CRAN.
So, it had to
[
https://issues.apache.org/jira/browse/SPARK-27606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-27606.
--
Resolution: Fixed
Fix Version/s: 3.0.0
Issue resolved by pull request 24500
[
https://issues.apache.org/jira/browse/SPARK-27606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon reassigned SPARK-27606:
Assignee: Hyukjin Kwon
> Deprecate `extended` field in
[
https://issues.apache.org/jira/browse/SPARK-27622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16831553#comment-16831553
]
Attila Zsolt Piros commented on SPARK-27622:
I am already working on this. A working
Attila Zsolt Piros created SPARK-27622:
--
Summary: Avoiding network communication when block mangers are
running on the host
Key: SPARK-27622
URL: https://issues.apache.org/jira/browse/SPARK-27622
[
https://issues.apache.org/jira/browse/SPARK-27621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Anca Sarb updated SPARK-27621:
--
Comment: was deleted
(was: I've created a PR with the fix here
[
https://issues.apache.org/jira/browse/SPARK-27621?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16831502#comment-16831502
]
Apache Spark commented on SPARK-27621:
--
User 'ancasarb' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-27621?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16831501#comment-16831501
]
Apache Spark commented on SPARK-27621:
--
User 'ancasarb' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-27621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-27621:
Assignee: Apache Spark
> Calling transform() method on a LinearRegressionModel throws
>
[
https://issues.apache.org/jira/browse/SPARK-27621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-27621:
Assignee: (was: Apache Spark)
> Calling transform() method on a
[
https://issues.apache.org/jira/browse/SPARK-27621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Anca Sarb updated SPARK-27621:
--
Description:
When transform(...) method is called on a LinearRegressionModel created
directly with
[
https://issues.apache.org/jira/browse/SPARK-27621?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16831499#comment-16831499
]
Anca Sarb commented on SPARK-27621:
---
I've created a PR with the fix here
Anca Sarb created SPARK-27621:
-
Summary: Calling transform() method on a LinearRegressionModel
throws NoSuchElementException
Key: SPARK-27621
URL: https://issues.apache.org/jira/browse/SPARK-27621
66 matches
Mail list logo
