[
https://issues.apache.org/jira/browse/SPARK-22396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16224426#comment-16224426
]
Apache Spark commented on SPARK-22396:
--
User 'gatorsmile' has created a pull request
[
https://issues.apache.org/jira/browse/SPARK-22396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-22396:
Assignee: Apache Spark (was: Xiao Li)
> Unresolved operator InsertIntoDir for Hive format
[
https://issues.apache.org/jira/browse/SPARK-22396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-22396:
Assignee: Xiao Li (was: Apache Spark)
> Unresolved operator InsertIntoDir for Hive format
Xiao Li created SPARK-22396:
---
Summary: Unresolved operator InsertIntoDir for Hive format when
Hive Support is not enabled
Key: SPARK-22396
URL: https://issues.apache.org/jira/browse/SPARK-22396
Project: Spa
[
https://issues.apache.org/jira/browse/SPARK-21657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16224420#comment-16224420
]
Ohad Raviv commented on SPARK-21657:
After some debugging, I think I understand the t
[
https://issues.apache.org/jira/browse/SPARK-22395?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16224399#comment-16224399
]
Apache Spark commented on SPARK-22395:
--
User 'ueshin' has created a pull request for
[
https://issues.apache.org/jira/browse/SPARK-22395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-22395:
Assignee: (was: Apache Spark)
> Fix the behavior of timestamp values for Pandas to res
[
https://issues.apache.org/jira/browse/SPARK-22395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-22395:
Assignee: Apache Spark
> Fix the behavior of timestamp values for Pandas to respect sessio
[
https://issues.apache.org/jira/browse/SPARK-7019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16224388#comment-16224388
]
Xin Lu commented on SPARK-7019:
---
recent pr here:
https://amplab.cs.berkeley.edu/jenkins/job
[
https://issues.apache.org/jira/browse/SPARK-7019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16224386#comment-16224386
]
Xin Lu commented on SPARK-7019:
---
It looks like unidoc is running on new PRs now. Maybe this
[
https://issues.apache.org/jira/browse/SPARK-21657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16224374#comment-16224374
]
Ohad Raviv commented on SPARK-21657:
ok i found the relevant rule:
{code:java|title=O
[
https://issues.apache.org/jira/browse/SPARK-21657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16224365#comment-16224365
]
Ohad Raviv commented on SPARK-21657:
After futher investigating I believe that my ass
[
https://issues.apache.org/jira/browse/SPARK-2?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16224358#comment-16224358
]
Xin Lu edited comment on SPARK-2 at 10/30/17 4:12 AM:
--
I che
Takuya Ueshin created SPARK-22395:
-
Summary: Fix the behavior of timestamp values for Pandas to
respect session timezone
Key: SPARK-22395
URL: https://issues.apache.org/jira/browse/SPARK-22395
Project
[
https://issues.apache.org/jira/browse/SPARK-2?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16224358#comment-16224358
]
Xin Lu edited comment on SPARK-2 at 10/30/17 4:04 AM:
--
I che
[
https://issues.apache.org/jira/browse/SPARK-2?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16224358#comment-16224358
]
Xin Lu commented on SPARK-2:
I checked the dependencies and it looks like lz4-java al
[
https://issues.apache.org/jira/browse/SPARK-22333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16224342#comment-16224342
]
Apache Spark commented on SPARK-22333:
--
User 'DonnyZone' has created a pull request
[
https://issues.apache.org/jira/browse/SPARK-21625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-21625:
Description:
SQRT:
{code:sql}
hive> select SQRT(-10.0);
OK
NULL
Time taken: 0.384 seconds, Fetched
[
https://issues.apache.org/jira/browse/SPARK-21625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-21625:
Component/s: (was: SQL)
Documentation
> sqrt(negative number) should be null
>
[
https://issues.apache.org/jira/browse/SPARK-21625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-21625:
Summary: Add incompatible Hive UDF describe to DOC (was: sqrt(negative
number) should be null)
>
[
https://issues.apache.org/jira/browse/SPARK-22379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Takuya Ueshin resolved SPARK-22379.
---
Resolution: Resolved
> Reduce duplication setUpClass and tearDownClass in PySpark SQL tests
>
[
https://issues.apache.org/jira/browse/SPARK-22379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16224333#comment-16224333
]
Takuya Ueshin commented on SPARK-22379:
---
Issue resolved by pull request 19595
https
[
https://issues.apache.org/jira/browse/SPARK-22379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Takuya Ueshin updated SPARK-22379:
--
Fix Version/s: 2.3.0
> Reduce duplication setUpClass and tearDownClass in PySpark SQL tests
> -
[
https://issues.apache.org/jira/browse/SPARK-22379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Takuya Ueshin reassigned SPARK-22379:
-
Assignee: Hyukjin Kwon
> Reduce duplication setUpClass and tearDownClass in PySpark SQL
[
https://issues.apache.org/jira/browse/SPARK-22344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16224301#comment-16224301
]
Shivaram Venkataraman commented on SPARK-22344:
---
well uninstall is just rem
[
https://issues.apache.org/jira/browse/SPARK-22394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-22394:
Assignee: (was: Apache Spark)
> Redundant synchronization for metastore access
> -
[
https://issues.apache.org/jira/browse/SPARK-22394?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16224296#comment-16224296
]
Apache Spark commented on SPARK-22394:
--
User 'wzhfy' has created a pull request for
[
https://issues.apache.org/jira/browse/SPARK-22394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-22394:
Assignee: Apache Spark
> Redundant synchronization for metastore access
>
[
https://issues.apache.org/jira/browse/SPARK-22291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16224289#comment-16224289
]
Apache Spark commented on SPARK-22291:
--
User 'jmchung' has created a pull request fo
[
https://issues.apache.org/jira/browse/SPARK-22365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16224284#comment-16224284
]
guoxiaolongzte commented on SPARK-22365:
You need to provide a snapshot to help o
[
https://issues.apache.org/jira/browse/SPARK-22308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon reopened SPARK-22308:
--
> Support unit tests of spark code using ScalaTest using suites other than
> FunSuite
> --
[
https://issues.apache.org/jira/browse/SPARK-22291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16224248#comment-16224248
]
Jen-Ming Chung commented on SPARK-22291:
Thank you all :)
> Postgresql UUID[] to
[
https://issues.apache.org/jira/browse/SPARK-22291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16224247#comment-16224247
]
Liang-Chi Hsieh commented on SPARK-22291:
-
Thanks [~hyukjin.kwon].
> Postgresql
[
https://issues.apache.org/jira/browse/SPARK-22291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon reassigned SPARK-22291:
Assignee: Jen-Ming Chung (was: Fabio J. Walter)
> Postgresql UUID[] to Cassandra: Convers
[
https://issues.apache.org/jira/browse/SPARK-22291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16224246#comment-16224246
]
Hyukjin Kwon commented on SPARK-22291:
--
I happened to see this comment first and jus
[
https://issues.apache.org/jira/browse/SPARK-22291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16224245#comment-16224245
]
Liang-Chi Hsieh commented on SPARK-22291:
-
[~cloud_fan] The Assignee should be [~
[
https://issues.apache.org/jira/browse/SPARK-15689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan reopened SPARK-15689:
-
> Data source API v2
> --
>
> Key: SPARK-15689
> URL:
[
https://issues.apache.org/jira/browse/SPARK-15689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16224224#comment-16224224
]
Wenchen Fan commented on SPARK-15689:
-
ah missed this one, reopen this ticket. My con
[
https://issues.apache.org/jira/browse/SPARK-22393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16224194#comment-16224194
]
Sean Owen commented on SPARK-22393:
---
I'm guessing it's something to do with how it over
[
https://issues.apache.org/jira/browse/SPARK-22393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16224158#comment-16224158
]
Ryan Williams commented on SPARK-22393:
---
Everything works fine in a Scala shell ({{
[
https://issues.apache.org/jira/browse/SPARK-22344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16224139#comment-16224139
]
Felix Cheung commented on SPARK-22344:
--
Kinda we don't have any uninstall feature th
[
https://issues.apache.org/jira/browse/SPARK-2465?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16224124#comment-16224124
]
Matteo Cossu commented on SPARK-2465:
-
For example, with this limitation it is not pos
[
https://issues.apache.org/jira/browse/SPARK-15689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16224122#comment-16224122
]
Reynold Xin commented on SPARK-15689:
-
Why not put all of them as subtasks here?
Als
[
https://issues.apache.org/jira/browse/SPARK-22394?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16224120#comment-16224120
]
Wenchen Fan commented on SPARK-22394:
-
looks like so, can you send a PR? thanks!
> R
[
https://issues.apache.org/jira/browse/SPARK-22291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-22291.
-
Resolution: Fixed
Assignee: Fabio J. Walter
Fix Version/s: 2.3.0
> Postgresql UUI
[
https://issues.apache.org/jira/browse/SPARK-22393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen updated SPARK-22393:
--
Priority: Minor (was: Major)
> spark-shell can't find imported types in class constructors, extends cl
[
https://issues.apache.org/jira/browse/SPARK-22393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16224040#comment-16224040
]
Sean Owen commented on SPARK-22393:
---
That's a weird one. {{class P(p: org.apache.spark.
[
https://issues.apache.org/jira/browse/SPARK-22394?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16224028#comment-16224028
]
Zhenhua Wang commented on SPARK-22394:
--
[~cloud_fan] [~smilegator] [~rxin] Do I unde
Zhenhua Wang created SPARK-22394:
Summary: Redundant synchronization for metastore access
Key: SPARK-22394
URL: https://issues.apache.org/jira/browse/SPARK-22394
Project: Spark
Issue Type: Im
[
https://issues.apache.org/jira/browse/SPARK-22393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ryan Williams updated SPARK-22393:
--
Affects Version/s: (was: 2.0.0)
2.0.2
> spark-shell can't find impor
Ryan Williams created SPARK-22393:
-
Summary: spark-shell can't find imported types in class
constructors, extends clause
Key: SPARK-22393
URL: https://issues.apache.org/jira/browse/SPARK-22393
Project
[
https://issues.apache.org/jira/browse/SPARK-15689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-15689.
-
Resolution: Fixed
Fix Version/s: 2.3.0
> Data source API v2
> --
>
>
[
https://issues.apache.org/jira/browse/SPARK-15689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16223988#comment-16223988
]
Wenchen Fan commented on SPARK-15689:
-
The basic read/write interfaces are done, I'm
Wenchen Fan created SPARK-22392:
---
Summary: columnar reader interface
Key: SPARK-22392
URL: https://issues.apache.org/jira/browse/SPARK-22392
Project: Spark
Issue Type: Sub-task
Compo
[
https://issues.apache.org/jira/browse/SPARK-22391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan updated SPARK-22391:
Description: please refer to the discussion in the dev list with this
email: *[discuss] Data Source
[
https://issues.apache.org/jira/browse/SPARK-21657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16223987#comment-16223987
]
Wenchen Fan commented on SPARK-21657:
-
I'd say they are different issues, and I haven
[
https://issues.apache.org/jira/browse/SPARK-22391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan updated SPARK-22391:
Description: please refer to the discussion and the dev list with this
email: *[discuss] Data Sourc
Wenchen Fan created SPARK-22391:
---
Summary: add `MetadataCreationSupport` trait to separate data and
metadata handling at write path
Key: SPARK-22391
URL: https://issues.apache.org/jira/browse/SPARK-22391
[
https://issues.apache.org/jira/browse/SPARK-22389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan reassigned SPARK-22389:
---
Assignee: Wenchen Fan
> partitioning reporting
> --
>
>
Wenchen Fan created SPARK-22390:
---
Summary: Aggregate push down
Key: SPARK-22390
URL: https://issues.apache.org/jira/browse/SPARK-22390
Project: Spark
Issue Type: Sub-task
Components:
Wenchen Fan created SPARK-22389:
---
Summary: partitioning reporting
Key: SPARK-22389
URL: https://issues.apache.org/jira/browse/SPARK-22389
Project: Spark
Issue Type: Sub-task
Component
[
https://issues.apache.org/jira/browse/SPARK-22387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan updated SPARK-22387:
Description:
This is an open discussion. The general idea is we should allow users to set
some com
Wenchen Fan created SPARK-22388:
---
Summary: Limit push down
Key: SPARK-22388
URL: https://issues.apache.org/jira/browse/SPARK-22388
Project: Spark
Issue Type: Sub-task
Components: SQL
[
https://issues.apache.org/jira/browse/SPARK-22387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan updated SPARK-22387:
Description:
This is an open discussion. The general idea is we should allow users to set
some com
[
https://issues.apache.org/jira/browse/SPARK-22387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan updated SPARK-22387:
Description:
This is an open discussion. The general idea is we should allow users to set
some com
[
https://issues.apache.org/jira/browse/SPARK-22387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan updated SPARK-22387:
Description:
This is an open discussion. The general idea is we should allow users to set
some com
Wenchen Fan created SPARK-22387:
---
Summary: propagate session configs to data source read/write
options
Key: SPARK-22387
URL: https://issues.apache.org/jira/browse/SPARK-22387
Project: Spark
Is
Wenchen Fan created SPARK-22386:
---
Summary: Data Source V2 improvements
Key: SPARK-22386
URL: https://issues.apache.org/jira/browse/SPARK-22386
Project: Spark
Issue Type: Improvement
C
[
https://issues.apache.org/jira/browse/SPARK-21657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16223971#comment-16223971
]
Sean Owen commented on SPARK-21657:
---
Thanks [~cloud_fan] for the fast look. You're sayi
[
https://issues.apache.org/jira/browse/SPARK-22385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-22385:
Assignee: Wenchen Fan (was: Apache Spark)
> MapObjects should not access list element by
[
https://issues.apache.org/jira/browse/SPARK-22385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-22385:
Assignee: Apache Spark (was: Wenchen Fan)
> MapObjects should not access list element by
[
https://issues.apache.org/jira/browse/SPARK-22385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16223958#comment-16223958
]
Apache Spark commented on SPARK-22385:
--
User 'cloud-fan' has created a pull request
[
https://issues.apache.org/jira/browse/SPARK-22385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan updated SPARK-22385:
Issue Type: Improvement (was: Bug)
> MapObjects should not access list element by index
>
Wenchen Fan created SPARK-22385:
---
Summary: MapObjects should not access list element by index
Key: SPARK-22385
URL: https://issues.apache.org/jira/browse/SPARK-22385
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-21657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16223946#comment-16223946
]
Ohad Raviv commented on SPARK-21657:
Sure,
the plan for
{code:java}
val df_exploded =
[
https://issues.apache.org/jira/browse/SPARK-21657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16223927#comment-16223927
]
Sean Owen commented on SPARK-21657:
---
Can you paste the plans? this difference might be
[
https://issues.apache.org/jira/browse/SPARK-22380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen resolved SPARK-22380.
---
Resolution: Won't Fix
You need to shade your dependencies in your app, not Spark. Look at the
maven-
[
https://issues.apache.org/jira/browse/SPARK-21657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16223902#comment-16223902
]
Ohad Raviv commented on SPARK-21657:
I Switched to toArray instead of toList in the a
[
https://issues.apache.org/jira/browse/SPARK-22375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-22375.
--
Resolution: Fixed
Fix Version/s: 2.3.0
> Test script can fail if eggs are installed by s
79 matches
Mail list logo
