[
https://issues.apache.org/jira/browse/SPARK-22570?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16260363#comment-16260363
]
Kazuaki Ishizaki commented on SPARK-22570:
--
I am working on this with SPARK-22500
> Cast may
Ujjal Satpathy created SPARK-22571:
--
Summary: How to connect to secure(Kerberos) kafka broker using
native KafkaConsumer api in Spark Streamming application
Key: SPARK-22571
URL:
Kazuaki Ishizaki created SPARK-22570:
Summary: Cast may create a lot of UTF8String.IntWrapper or
UTF8String.longWrapper instances
Key: SPARK-22570
URL: https://issues.apache.org/jira/browse/SPARK-22570
[
https://issues.apache.org/jira/browse/SPARK-22569?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-22569:
Assignee: Apache Spark (was: Xiao Li)
> Clean up caller of splitExpressions and
[
https://issues.apache.org/jira/browse/SPARK-22569?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-22569:
Assignee: Xiao Li (was: Apache Spark)
> Clean up caller of splitExpressions and
[
https://issues.apache.org/jira/browse/SPARK-22569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16260284#comment-16260284
]
Apache Spark commented on SPARK-22569:
--
User 'gatorsmile' has created a pull request for this issue:
Xiao Li created SPARK-22569:
---
Summary: Clean up caller of splitExpressions and addMutableState
Key: SPARK-22569
URL: https://issues.apache.org/jira/browse/SPARK-22569
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-22556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16260241#comment-16260241
]
Hyukjin Kwon commented on SPARK-22556:
--
So, it looks showing the results as below:
{code}
scala>
[
https://issues.apache.org/jira/browse/SPARK-22541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Liang-Chi Hsieh updated SPARK-22541:
Component/s: (was: Documentation)
> Dataframes: applying multiple filters one after
[
https://issues.apache.org/jira/browse/SPARK-22541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16260240#comment-16260240
]
Liang-Chi Hsieh commented on SPARK-22541:
-
Since this is known behavior, I will change this from
[
https://issues.apache.org/jira/browse/SPARK-22541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Liang-Chi Hsieh updated SPARK-22541:
Issue Type: Documentation (was: Bug)
> Dataframes: applying multiple filters one after
[
https://issues.apache.org/jira/browse/SPARK-22541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Liang-Chi Hsieh updated SPARK-22541:
Component/s: Documentation
> Dataframes: applying multiple filters one after another using
[
https://issues.apache.org/jira/browse/SPARK-22568?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen resolved SPARK-22568.
---
Resolution: Not A Problem
I think this is more of a usage question, so belongs on the mailing list.
[
https://issues.apache.org/jira/browse/SPARK-22568?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Éderson Cássio updated SPARK-22568:
---
Description:
Sorry for any mistakes on filling this big form... it's my first issue here :)
[
https://issues.apache.org/jira/browse/SPARK-22568?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Éderson Cássio updated SPARK-22568:
---
Description:
Sorry for any mistakes on filling this big form... it's my first issue here :)
Éderson Cássio created SPARK-22568:
--
Summary: Split pair RDDs by keys - an efficient (maybe?)
substitute to groupByKey
Key: SPARK-22568
URL: https://issues.apache.org/jira/browse/SPARK-22568
[
https://issues.apache.org/jira/browse/SPARK-21322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16258601#comment-16258601
]
Ron Hu edited comment on SPARK-21322 at 11/21/17 1:43 AM:
--
Pull request 19357
[
https://issues.apache.org/jira/browse/SPARK-22549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan reassigned SPARK-22549:
---
Assignee: Kazuaki Ishizaki
> 64KB JVM bytecode limit problem with concat_ws
>
[
https://issues.apache.org/jira/browse/SPARK-22549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-22549.
-
Resolution: Fixed
Fix Version/s: 2.3.0
2.2.2
Issue resolved by pull
[
https://issues.apache.org/jira/browse/SPARK-20133?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16260095#comment-16260095
]
Teng Peng commented on SPARK-20133:
---
I believe the documentation, including user guide and example
[
https://issues.apache.org/jira/browse/SPARK-22449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Teng Peng resolved SPARK-22449.
---
Resolution: Later
> Add BIC for GLM
> ---
>
> Key: SPARK-22449
>
[
https://issues.apache.org/jira/browse/SPARK-12748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16260023#comment-16260023
]
Jeffrey E Rodriguez commented on SPARK-12748:
--
Sorry Ajesh, how would setting a remote
Michael Moss created SPARK-22567:
Summary: spark.mesos.executor.memoryOverhead equivalent for the
Driver when running on Mesos
Key: SPARK-22567
URL: https://issues.apache.org/jira/browse/SPARK-22567
[
https://issues.apache.org/jira/browse/SPARK-21097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16259789#comment-16259789
]
Arun Suresh commented on SPARK-21097:
-
Thanks for raising this.
I would also like to call attention
[
https://issues.apache.org/jira/browse/SPARK-22564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen updated SPARK-22564:
--
Priority: Minor (was: Major)
Issue Type: Improvement (was: Bug)
I don't see it used anywhere,
[
https://issues.apache.org/jira/browse/SPARK-22566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16259679#comment-16259679
]
Guilherme Berger commented on SPARK-22566:
--
Relevant:
Guilherme Berger created SPARK-22566:
Summary: Better error message for `_merge_type` in Pandas to Spark
DF conversion
Key: SPARK-22566
URL: https://issues.apache.org/jira/browse/SPARK-22566
Richard Xin created SPARK-22565:
---
Summary: Session-based windowing
Key: SPARK-22565
URL: https://issues.apache.org/jira/browse/SPARK-22565
Project: Spark
Issue Type: Improvement
[
https://issues.apache.org/jira/browse/SPARK-22427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16259587#comment-16259587
]
yuhao yang commented on SPARK-22427:
I tried with larger scale data but did not repro the issue.
[
https://issues.apache.org/jira/browse/SPARK-22563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16259517#comment-16259517
]
Ben commented on SPARK-22563:
-
I cannot give you the actual data, but in this case it would be e.g.:
[
https://issues.apache.org/jira/browse/SPARK-22562?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-22562:
Assignee: (was: Apache Spark)
> CachedKafkaConsumer unsafe eviction from cache
>
[
https://issues.apache.org/jira/browse/SPARK-22562?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-22562:
Assignee: Apache Spark
> CachedKafkaConsumer unsafe eviction from cache
>
[
https://issues.apache.org/jira/browse/SPARK-22562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16259489#comment-16259489
]
Apache Spark commented on SPARK-22562:
--
User 'daroo' has created a pull request for this issue:
Adrian Bridgett created SPARK-22564:
---
Summary: csv reader no longer logs errors
Key: SPARK-22564
URL: https://issues.apache.org/jira/browse/SPARK-22564
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-22558?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16259472#comment-16259472
]
KhajaAsmath Mohammed commented on SPARK-22558:
--
any suggestions for this issue?
>
[
https://issues.apache.org/jira/browse/SPARK-22563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16259465#comment-16259465
]
Sean Owen commented on SPARK-22563:
---
Can you give an example of the output you see?
> Spark
[
https://issues.apache.org/jira/browse/SPARK-22563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ben updated SPARK-22563:
Description:
I have a large and complex DataFrame with nested structures in Spark 2.1.0
(pySpark) and I want to
[
https://issues.apache.org/jira/browse/SPARK-22563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16259367#comment-16259367
]
Ben edited comment on SPARK-22563 at 11/20/17 3:34 PM:
---
Hi [~srowen],
The example
[
https://issues.apache.org/jira/browse/SPARK-22563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16259367#comment-16259367
]
Ben edited comment on SPARK-22563 at 11/20/17 3:34 PM:
---
Hi [~srowen],
The example
[
https://issues.apache.org/jira/browse/SPARK-22563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16259367#comment-16259367
]
Ben commented on SPARK-22563:
-
The example is what I would logically expect, but in reality, the ID column
[
https://issues.apache.org/jira/browse/SPARK-22563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16259324#comment-16259324
]
Sean Owen commented on SPARK-22563:
---
I'm not seeing the difference you refer to. The IDs remain the
[
https://issues.apache.org/jira/browse/SPARK-22563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ben updated SPARK-22563:
Component/s: Shuffle
PySpark
> Spark row_number() deterministic generation and materialization as
Ben created SPARK-22563:
---
Summary: Spark row_number() deterministic generation and
materialization as a checkpoint
Key: SPARK-22563
URL: https://issues.apache.org/jira/browse/SPARK-22563
Project: Spark
Dariusz Szablinski created SPARK-22562:
--
Summary: CachedKafkaConsumer unsafe eviction from cache
Key: SPARK-22562
URL: https://issues.apache.org/jira/browse/SPARK-22562
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-22560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16259209#comment-16259209
]
Sean Owen commented on SPARK-22560:
---
I think you need to set these before creating the context?
> Must
[
https://issues.apache.org/jira/browse/SPARK-22516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kumaresh C R updated SPARK-22516:
-
Attachment: test_file_without_eof_char.csv
> CSV Read breaks: When "multiLine" = "true", if
[
https://issues.apache.org/jira/browse/SPARK-22516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16259157#comment-16259157
]
Kumaresh C R commented on SPARK-22516:
--
[~mgaido]: Even after I replaced all 'CR LF' to 'LF', still
[
https://issues.apache.org/jira/browse/SPARK-22533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan reassigned SPARK-22533:
---
Assignee: Marcelo Vanzin
> SparkConfigProvider does not handle deprecated config keys
>
[
https://issues.apache.org/jira/browse/SPARK-22533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-22533.
-
Resolution: Fixed
Fix Version/s: 2.3.0
Issue resolved by pull request 19760
[
https://issues.apache.org/jira/browse/SPARK-20101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-20101.
-
Resolution: Fixed
Fix Version/s: 2.3.0
Issue resolved by pull request 17436
[
https://issues.apache.org/jira/browse/SPARK-20101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan reassigned SPARK-20101:
---
Assignee: Kazuaki Ishizaki
> Use OffHeapColumnVector when
[
https://issues.apache.org/jira/browse/SPARK-20101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan updated SPARK-20101:
Summary: Use OffHeapColumnVector when
"spark.sql.columnVector.offheap.enable" is set to "true"
Arun created SPARK-22561:
Summary: Dynamically update topics list for spark kafka consumer
Key: SPARK-22561
URL: https://issues.apache.org/jira/browse/SPARK-22561
Project: Spark
Issue Type: New
[
https://issues.apache.org/jira/browse/SPARK-22560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ran Mingxuan updated SPARK-22560:
-
Description:
In a java project I have to use both JavaSparkContext and SparkSession. I find
[
https://issues.apache.org/jira/browse/SPARK-22560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ran Mingxuan updated SPARK-22560:
-
Description:
In a java project I have to use both JavaSparkContext and SparkSession. I find
[
https://issues.apache.org/jira/browse/SPARK-22560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ran Mingxuan updated SPARK-22560:
-
Description:
I have built a spark job like below:
{code:java}
// wrong code
public void
Ran Mingxuan created SPARK-22560:
Summary: Must create spark session directly to connect to hive
Key: SPARK-22560
URL: https://issues.apache.org/jira/browse/SPARK-22560
Project: Spark
Issue
57 matches
Mail list logo
