[
https://issues.apache.org/jira/browse/SPARK-2141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14593802#comment-14593802
]
Ruslan Dautkhanov commented on SPARK-2141:
--
Would be gread to have this
[
https://issues.apache.org/jira/browse/SPARK-11150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14963849#comment-14963849
]
Ruslan Dautkhanov commented on SPARK-11150:
---
Will partition-wise join will also be handled by
[
https://issues.apache.org/jira/browse/SPARK-10935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15136053#comment-15136053
]
Ruslan Dautkhanov commented on SPARK-10935:
---
I noticed outer joins. Spark before 1.5 used
[
https://issues.apache.org/jira/browse/SPARK-10935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15136053#comment-15136053
]
Ruslan Dautkhanov edited comment on SPARK-10935 at 2/6/16 11:16 PM:
I
[
https://issues.apache.org/jira/browse/SPARK-1?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15125659#comment-15125659
]
Ruslan Dautkhanov commented on SPARK-1:
---
Does this affect all OUTER JOINS? I have poor
[
https://issues.apache.org/jira/browse/SPARK-13335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15192588#comment-15192588
]
Ruslan Dautkhanov commented on SPARK-13335:
---
It would be great to have this optimization in.
In
Ruslan Dautkhanov created SPARK-13849:
-
Summary: REGEX Column Specification
Key: SPARK-13849
URL: https://issues.apache.org/jira/browse/SPARK-13849
Project: Spark
Issue Type: Wish
[
https://issues.apache.org/jira/browse/SPARK-12139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15193636#comment-15193636
]
Ruslan Dautkhanov commented on SPARK-12139:
---
Please check if
[
https://issues.apache.org/jira/browse/SPARK-13849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15193632#comment-15193632
]
Ruslan Dautkhanov commented on SPARK-13849:
---
Thank you, Sean.
I suspect this is a duplicate of
Ruslan Dautkhanov created SPARK-14017:
-
Summary: dataframe.dtypes -> pyspark.sql.types aliases
Key: SPARK-14017
URL: https://issues.apache.org/jira/browse/SPARK-14017
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-13866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15197595#comment-15197595
]
Ruslan Dautkhanov commented on SPARK-13866:
---
Would be great to have this fix in.
It makes
Ruslan Dautkhanov created SPARK-14166:
-
Summary: Add deterministic sampling like in Hive
Key: SPARK-14166
URL: https://issues.apache.org/jira/browse/SPARK-14166
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-13263?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15211047#comment-15211047
]
Ruslan Dautkhanov commented on SPARK-13263:
---
Would Spark support deterministic sampling too?
Ruslan Dautkhanov created SPARK-15302:
-
Summary: Implement FK/PK "rely novalidate" constraints for better
CBO
Key: SPARK-15302
URL: https://issues.apache.org/jira/browse/SPARK-15302
Project:
[
https://issues.apache.org/jira/browse/SPARK-15302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ruslan Dautkhanov updated SPARK-15302:
--
Description:
Oracle has "RELY NOVALIDATE" option for constraints.. Could be easier for
[
https://issues.apache.org/jira/browse/SPARK-15302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15283194#comment-15283194
]
Ruslan Dautkhanov commented on SPARK-15302:
---
Yes, it's a feature request for Spark.
See for
[
https://issues.apache.org/jira/browse/SPARK-15302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15283194#comment-15283194
]
Ruslan Dautkhanov edited comment on SPARK-15302 at 5/13/16 9:45 PM:
Title: Message Title
Ruslan Dautkhanov commented on SPARK-18105
Title: Message Title
Ruslan Dautkhanov commented on SPARK-18105
Title: Message Title
Ruslan Dautkhanov commented on SPARK-18105
[
https://issues.apache.org/jira/browse/SPARK-19038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15864968#comment-15864968
]
Ruslan Dautkhanov commented on SPARK-19038:
---
[~jerryshao] PR 16482 is for a different issue
[
https://issues.apache.org/jira/browse/SPARK-19588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ruslan Dautkhanov updated SPARK-19588:
--
Summary: Allow putting keytab file to HDFS location specified in
spark.yarn.keytab
[
https://issues.apache.org/jira/browse/SPARK-16026?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15864992#comment-15864992
]
Ruslan Dautkhanov commented on SPARK-16026:
---
[~ioana-delaney], (y)
> Cost-based Optimizer
Ruslan Dautkhanov created SPARK-19588:
-
Summary: Allow putting keytab files specified by
Key: SPARK-19588
URL: https://issues.apache.org/jira/browse/SPARK-19588
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-19038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15864995#comment-15864995
]
Ruslan Dautkhanov commented on SPARK-19038:
---
Thank you [~jerryshao]
> Can't find keytab file
[
https://issues.apache.org/jira/browse/SPARK-19038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15865013#comment-15865013
]
Ruslan Dautkhanov edited comment on SPARK-19038 at 2/14/17 4:12 AM:
[
https://issues.apache.org/jira/browse/SPARK-19588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15865020#comment-15865020
]
Ruslan Dautkhanov commented on SPARK-19588:
---
Our corporate sshd's are integrated with Active
[
https://issues.apache.org/jira/browse/SPARK-19038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15865013#comment-15865013
]
Ruslan Dautkhanov commented on SPARK-19038:
---
Another possible workaround is to pass principal
[
https://issues.apache.org/jira/browse/SPARK-19588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15866839#comment-15866839
]
Ruslan Dautkhanov commented on SPARK-19588:
---
driver/yarn#client holds keytab just to distribute
[
https://issues.apache.org/jira/browse/SPARK-19588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15867000#comment-15867000
]
Ruslan Dautkhanov commented on SPARK-19588:
---
Got it. Thanks [~vanzin]
> Allow putting keytab
[
https://issues.apache.org/jira/browse/SPARK-16026?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15863243#comment-15863243
]
Ruslan Dautkhanov commented on SPARK-16026:
---
It would be great to resolve SPARK-15302 as a
[
https://issues.apache.org/jira/browse/SPARK-17076?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15665644#comment-15665644
]
Ruslan Dautkhanov edited comment on SPARK-17076 at 11/15/16 1:19 AM:
-
[
https://issues.apache.org/jira/browse/SPARK-17076?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15665644#comment-15665644
]
Ruslan Dautkhanov commented on SPARK-17076:
---
HIVE-13076 added FK constraint to Hive / HMS.
[
https://issues.apache.org/jira/browse/SPARK-5493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15815352#comment-15815352
]
Ruslan Dautkhanov commented on SPARK-5493:
--
Thanks again [~vanzin] for the feedback, please check
Ruslan Dautkhanov created SPARK-19143:
-
Summary: API in Spark for distributing new delegation tokens
(Improve delegation token handling in secure clusters)
Key: SPARK-19143
URL:
[
https://issues.apache.org/jira/browse/SPARK-8007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15718615#comment-15718615
]
Ruslan Dautkhanov commented on SPARK-8007:
--
Is spark__partition__id available in PySpark too?
[
https://issues.apache.org/jira/browse/SPARK-8007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15718615#comment-15718615
]
Ruslan Dautkhanov edited comment on SPARK-8007 at 12/3/16 7:34 PM:
---
Is
[
https://issues.apache.org/jira/browse/SPARK-5493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15802154#comment-15802154
]
Ruslan Dautkhanov commented on SPARK-5493:
--
Thank you [~vanzin]!
I guess a forwardable and/or
[
https://issues.apache.org/jira/browse/SPARK-5493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15805198#comment-15805198
]
Ruslan Dautkhanov edited comment on SPARK-5493 at 1/6/17 6:19 PM:
--
[
https://issues.apache.org/jira/browse/SPARK-5493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15805198#comment-15805198
]
Ruslan Dautkhanov commented on SPARK-5493:
--
{quote}There might be ways to hack support for that
[
https://issues.apache.org/jira/browse/SPARK-5158?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15800298#comment-15800298
]
Ruslan Dautkhanov commented on SPARK-5158:
--
I think one reason for that could be that one user
[
https://issues.apache.org/jira/browse/SPARK-5493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15800304#comment-15800304
]
Ruslan Dautkhanov commented on SPARK-5493:
--
Did you figure this out? Is this possible to use
[
https://issues.apache.org/jira/browse/SPARK-12837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15755560#comment-15755560
]
Ruslan Dautkhanov commented on SPARK-12837:
---
Yep, we continue to see this issue in Spark 2..
>
[
https://issues.apache.org/jira/browse/SPARK-12837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15963510#comment-15963510
]
Ruslan Dautkhanov commented on SPARK-12837:
---
It might be a bug in broadcast join.
Following
[
https://issues.apache.org/jira/browse/SPARK-12837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15963510#comment-15963510
]
Ruslan Dautkhanov edited comment on SPARK-12837 at 4/10/17 9:29 PM:
[
https://issues.apache.org/jira/browse/SPARK-12837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15963812#comment-15963812
]
Ruslan Dautkhanov commented on SPARK-12837:
---
[~cloud_fan] I didn't realize torrent broadcast
[
https://issues.apache.org/jira/browse/SPARK-21274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16105127#comment-16105127
]
Ruslan Dautkhanov edited comment on SPARK-21274 at 7/28/17 3:46 PM:
[
https://issues.apache.org/jira/browse/SPARK-21274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16105127#comment-16105127
]
Ruslan Dautkhanov commented on SPARK-21274:
---
[~viirya], yes it returns {noformat}[1, 2,
[
https://issues.apache.org/jira/browse/SPARK-21274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16105127#comment-16105127
]
Ruslan Dautkhanov edited comment on SPARK-21274 at 7/28/17 3:47 PM:
[
https://issues.apache.org/jira/browse/SPARK-21274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16107749#comment-16107749
]
Ruslan Dautkhanov commented on SPARK-21274:
---
[~viirya], you're right. I've checked now on both
[
https://issues.apache.org/jira/browse/SPARK-21657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16127511#comment-16127511
]
Ruslan Dautkhanov edited comment on SPARK-21657 at 8/15/17 4:59 PM:
[
https://issues.apache.org/jira/browse/SPARK-21657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16127511#comment-16127511
]
Ruslan Dautkhanov commented on SPARK-21657:
---
Thank you [~maropu] and [~viirya], that commit is
[
https://issues.apache.org/jira/browse/SPARK-21657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16121801#comment-16121801
]
Ruslan Dautkhanov commented on SPARK-21657:
---
[~bjornjons] confirms this problem pertains to
[
https://issues.apache.org/jira/browse/SPARK-21657?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ruslan Dautkhanov updated SPARK-21657:
--
Description:
It can take up to half a day to explode a modest-sized nested collection
[
https://issues.apache.org/jira/browse/SPARK-21274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ruslan Dautkhanov updated SPARK-21274:
--
Comment: was deleted
(was: [~rxin], I wish I could. We only use PySpark and SQL API to
[
https://issues.apache.org/jira/browse/SPARK-13534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16082900#comment-16082900
]
Ruslan Dautkhanov commented on SPARK-13534:
---
So Apache Arrow would currently be available only
[
https://issues.apache.org/jira/browse/SPARK-15703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16091031#comment-16091031
]
Ruslan Dautkhanov commented on SPARK-15703:
---
It breaks spark dynamic allocation too - Spark
Ruslan Dautkhanov created SPARK-21460:
-
Summary: Spark dynamic allocation breaks when ListenerBus event
queue runs full
Key: SPARK-21460
URL: https://issues.apache.org/jira/browse/SPARK-21460
[
https://issues.apache.org/jira/browse/SPARK-15703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16091821#comment-16091821
]
Ruslan Dautkhanov commented on SPARK-15703:
---
[~tgraves], filed SPARK-21460. Thanks.
> Make
[
https://issues.apache.org/jira/browse/SPARK-21460?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16091943#comment-16091943
]
Ruslan Dautkhanov commented on SPARK-21460:
---
[~zsxwing], according to [~tgraves] spark dynamic
[
https://issues.apache.org/jira/browse/SPARK-21460?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16091972#comment-16091972
]
Ruslan Dautkhanov commented on SPARK-21460:
---
[~zsxwing] can we keep this jira open?
[
https://issues.apache.org/jira/browse/SPARK-21460?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16095131#comment-16095131
]
Ruslan Dautkhanov commented on SPARK-21460:
---
[~Dhruve Ashar], I can email logs to you. Although
[
https://issues.apache.org/jira/browse/SPARK-21488?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ruslan Dautkhanov updated SPARK-21488:
--
Description:
It would be great to make saveAsTable() return dataframe of created
Ruslan Dautkhanov created SPARK-21488:
-
Summary: Make saveAsTable() return dataframe of created table
Key: SPARK-21488
URL: https://issues.apache.org/jira/browse/SPARK-21488
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-21488?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ruslan Dautkhanov updated SPARK-21488:
--
Summary: Make saveAsTable() and createOrReplaceTempView() return dataframe
of created
[
https://issues.apache.org/jira/browse/SPARK-13534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16084886#comment-16084886
]
Ruslan Dautkhanov commented on SPARK-13534:
---
[~bryanc], thanks for the feedback. We sometimes
[
https://issues.apache.org/jira/browse/SPARK-21488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16096354#comment-16096354
]
Ruslan Dautkhanov commented on SPARK-21488:
---
Makes sense [~zsxwing], thank you.
> Make
[
https://issues.apache.org/jira/browse/SPARK-21488?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ruslan Dautkhanov updated SPARK-21488:
--
Target Version/s: 3.0.0
> Make saveAsTable() and createOrReplaceTempView() return
Ruslan Dautkhanov created SPARK-21274:
-
Summary: Implement EXCEPT ALL and INTERSECT ALL
Key: SPARK-21274
URL: https://issues.apache.org/jira/browse/SPARK-21274
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-13225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16070881#comment-16070881
]
Ruslan Dautkhanov commented on SPARK-13225:
---
Please consider this approach to implement
[
https://issues.apache.org/jira/browse/SPARK-21274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16070884#comment-16070884
]
Ruslan Dautkhanov commented on SPARK-21274:
---
For INTERSECT ALL I was also experimenting with
[
https://issues.apache.org/jira/browse/SPARK-21274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16070982#comment-16070982
]
Ruslan Dautkhanov commented on SPARK-21274:
---
[~rxin], I wish I could. We only use PySpark and
[
https://issues.apache.org/jira/browse/SPARK-16803?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16075178#comment-16075178
]
Ruslan Dautkhanov commented on SPARK-16803:
---
Any chance `saveAsTable` can be reverted to use
Ruslan Dautkhanov created SPARK-21657:
-
Summary: Spark has exponential time complexity to explode(array of
structs)
Key: SPARK-21657
URL: https://issues.apache.org/jira/browse/SPARK-21657
[
https://issues.apache.org/jira/browse/SPARK-21657?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ruslan Dautkhanov updated SPARK-21657:
--
Description:
It can take up to half a day to explode a modest-sizes nested collection
[
https://issues.apache.org/jira/browse/SPARK-21657?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ruslan Dautkhanov updated SPARK-21657:
--
Attachment: ExponentialTimeGrowth.PNG
nested-data-generator-and-test.py
[
https://issues.apache.org/jira/browse/SPARK-21657?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ruslan Dautkhanov updated SPARK-21657:
--
Description:
It can take up to half a day to explode a modest-sizes nested collection
[
https://issues.apache.org/jira/browse/SPARK-21657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16117051#comment-16117051
]
Ruslan Dautkhanov commented on SPARK-21657:
---
Absolutely, this is a real use case.
We have a
[
https://issues.apache.org/jira/browse/SPARK-21657?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ruslan Dautkhanov updated SPARK-21657:
--
Labels: cache caching collections nested_types performance pyspark sparksql
sql (was:
[
https://issues.apache.org/jira/browse/SPARK-15214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16137947#comment-16137947
]
Ruslan Dautkhanov commented on SPARK-15214:
---
[~hvanhovell], please have a look at SPARK-21657
[
https://issues.apache.org/jira/browse/SPARK-15703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16013208#comment-16013208
]
Ruslan Dautkhanov commented on SPARK-15703:
---
We keep running into this issue too - would be
[
https://issues.apache.org/jira/browse/SPARK-15703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16013208#comment-16013208
]
Ruslan Dautkhanov edited comment on SPARK-15703 at 5/23/17 10:53 PM:
-
[
https://issues.apache.org/jira/browse/SPARK-20776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16016168#comment-16016168
]
Ruslan Dautkhanov commented on SPARK-20776:
---
Thank you [~joshrosen]. Would it be possible to
[
https://issues.apache.org/jira/browse/SPARK-18838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16016664#comment-16016664
]
Ruslan Dautkhanov commented on SPARK-18838:
---
my 2 cents. Would be nice to explore idea of
[
https://issues.apache.org/jira/browse/SPARK-16441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16013247#comment-16013247
]
Ruslan Dautkhanov commented on SPARK-16441:
---
We did not have
Ruslan Dautkhanov created SPARK-22081:
-
Summary: Generalized Reduced Error Logistic Regression
Key: SPARK-22081
URL: https://issues.apache.org/jira/browse/SPARK-22081
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-22081?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ruslan Dautkhanov updated SPARK-22081:
--
Attachment: RELR.GIF
> Generalized Reduced Error Logistic Regression
>
[
https://issues.apache.org/jira/browse/SPARK-22081?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ruslan Dautkhanov updated SPARK-22081:
--
Description:
Our SAS gurus are saying they would love to have "Generalized Reduced
Ruslan Dautkhanov created SPARK-21931:
-
Summary: add LNNVL function
Key: SPARK-21931
URL: https://issues.apache.org/jira/browse/SPARK-21931
Project: Spark
Issue Type: New Feature
[
https://issues.apache.org/jira/browse/SPARK-21931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ruslan Dautkhanov updated SPARK-21931:
--
Attachment: Capture1.JPG
> add LNNVL function
> --
>
>
[
https://issues.apache.org/jira/browse/SPARK-21931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ruslan Dautkhanov updated SPARK-21931:
--
Description:
Purpose
LNNVL provides a concise way to evaluate a condition when one or
[
https://issues.apache.org/jira/browse/SPARK-21931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ruslan Dautkhanov updated SPARK-21931:
--
Description:
Purpose
LNNVL provides a concise way to evaluate a condition when one or
[
https://issues.apache.org/jira/browse/SPARK-21931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16155797#comment-16155797
]
Ruslan Dautkhanov commented on SPARK-21931:
---
Example 1)
{code:sql}
select * from products
Ruslan Dautkhanov created SPARK-21978:
-
Summary: schemaInference option not to convert strings with
leading zeros to int/long
Key: SPARK-21978
URL: https://issues.apache.org/jira/browse/SPARK-21978
[
https://issues.apache.org/jira/browse/SPARK-21213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16208027#comment-16208027
]
Ruslan Dautkhanov commented on SPARK-21213:
---
Would the partition-level stats be compatible with
Ruslan Dautkhanov created SPARK-22505:
-
Summary: toDF() / createDataFrame() type inference doesn't work as
expected
Key: SPARK-22505
URL: https://issues.apache.org/jira/browse/SPARK-22505
[
https://issues.apache.org/jira/browse/SPARK-22505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ruslan Dautkhanov updated SPARK-22505:
--
Description:
{code}
df =
[
https://issues.apache.org/jira/browse/SPARK-22505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ruslan Dautkhanov updated SPARK-22505:
--
Description:
{code}
df =
[
https://issues.apache.org/jira/browse/SPARK-22505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ruslan Dautkhanov updated SPARK-22505:
--
Description:
{code}
df =
[
https://issues.apache.org/jira/browse/SPARK-22505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16263733#comment-16263733
]
Ruslan Dautkhanov commented on SPARK-22505:
---
that's great. thank you [~hyukjin.kwon]
> toDF()
1 - 100 of 235 matches
Mail list logo