[
https://issues.apache.org/jira/browse/SPARK-15329?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15283779#comment-15283779
]
Vijay Parmar edited comment on SPARK-15329 at 5/15/16 4:50 AM:
[
https://issues.apache.org/jira/browse/SPARK-15330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-15330:
Assignee: Apache Spark
> Reset Command
> -
>
> Key: SPARK-1533
[
https://issues.apache.org/jira/browse/SPARK-15330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-15330:
Assignee: (was: Apache Spark)
> Reset Command
> -
>
> Key:
[
https://issues.apache.org/jira/browse/SPARK-15330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15283780#comment-15283780
]
Apache Spark commented on SPARK-15330:
--
User 'gatorsmile' has created a pull request
[
https://issues.apache.org/jira/browse/SPARK-15329?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15283779#comment-15283779
]
Vijay Parmar commented on SPARK-15329:
--
My pleasure!
> When start spark with yarn:
Xiao Li created SPARK-15330:
---
Summary: Reset Command
Key: SPARK-15330
URL: https://issues.apache.org/jira/browse/SPARK-15330
Project: Spark
Issue Type: Sub-task
Components: SQL
Affect
[
https://issues.apache.org/jira/browse/SPARK-14067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15283729#comment-15283729
]
Vijay Parmar commented on SPARK-14067:
--
I looked at the logs and below is what I hav
[
https://issues.apache.org/jira/browse/SPARK-15329?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15283725#comment-15283725
]
Jon commented on SPARK-15329:
-
Thanks for your help. I update with the yarn-site.xml.
> Whe
[
https://issues.apache.org/jira/browse/SPARK-15329?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15283722#comment-15283722
]
Vijay Parmar edited comment on SPARK-15329 at 5/14/16 11:35 PM:
---
[
https://issues.apache.org/jira/browse/SPARK-15329?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jon updated SPARK-15329:
Description:
Hi, Im trying to start spark with yarn-client, like this "spark-shell --master
yarn-client" but Im ge
[
https://issues.apache.org/jira/browse/SPARK-15329?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jon updated SPARK-15329:
Description:
Hi, Im trying to start spark with yarn-client, like this "spark-shell --master
yarn-client" but Im ge
[
https://issues.apache.org/jira/browse/SPARK-15329?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15283722#comment-15283722
]
Vijay Parmar commented on SPARK-15329:
--
Have you specified an appropriate directory?
[
https://issues.apache.org/jira/browse/SPARK-15329?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jon updated SPARK-15329:
Description:
Hi, Im trying to start spark with yarn-client, like this "spark-shell --master
yarn-client" but Im ge
[
https://issues.apache.org/jira/browse/SPARK-15329?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jon updated SPARK-15329:
Description:
Hi, Im trying to start spark with yarn-client, like this "spark-shell --master
yarn-client" but Im ge
[
https://issues.apache.org/jira/browse/SPARK-15329?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jon updated SPARK-15329:
Description:
Hi, Im trying to start spark with yarn-client, like this "spark-shell --master
yarn-client" but Im ge
Jon created SPARK-15329:
---
Summary: When start spark with yarn: spark.SparkContext: Error
initializing SparkContext.
Key: SPARK-15329
URL: https://issues.apache.org/jira/browse/SPARK-15329
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-15269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-15269:
Assignee: (was: Apache Spark)
> Creating external table leaves empty directory under w
[
https://issues.apache.org/jira/browse/SPARK-15269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-15269:
Assignee: Apache Spark
> Creating external table leaves empty directory under warehouse di
[
https://issues.apache.org/jira/browse/SPARK-15269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15283685#comment-15283685
]
Apache Spark commented on SPARK-15269:
--
User 'xwu0226' has created a pull request fo
[
https://issues.apache.org/jira/browse/SPARK-15328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-15328:
Assignee: Apache Spark
> Word2Vec import for original binary format
>
[
https://issues.apache.org/jira/browse/SPARK-15328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-15328:
Assignee: (was: Apache Spark)
> Word2Vec import for original binary format
> -
[
https://issues.apache.org/jira/browse/SPARK-15328?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15283645#comment-15283645
]
Apache Spark commented on SPARK-15328:
--
User 'wangyum' has created a pull request fo
Yuming Wang created SPARK-15328:
---
Summary: Word2Vec import for original binary format
Key: SPARK-15328
URL: https://issues.apache.org/jira/browse/SPARK-15328
Project: Spark
Issue Type: Sub-task
[
https://issues.apache.org/jira/browse/SPARK-15327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jurriaan Pruis updated SPARK-15327:
---
Attachment: full_exception.txt
See attached file for the full exception / generated code.
>
Jurriaan Pruis created SPARK-15327:
--
Summary: Catalyst code generation fails with complex data structure
Key: SPARK-15327
URL: https://issues.apache.org/jira/browse/SPARK-15327
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-15305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15283577#comment-15283577
]
Apache Spark commented on SPARK-15305:
--
User 'yhuai' has created a pull request for
[
https://issues.apache.org/jira/browse/SPARK-15306?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15283578#comment-15283578
]
Apache Spark commented on SPARK-15306:
--
User 'yhuai' has created a pull request for
[
https://issues.apache.org/jira/browse/SPARK-12972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15283571#comment-15283571
]
Apache Spark commented on SPARK-12972:
--
User 'srowen' has created a pull request for
[
https://issues.apache.org/jira/browse/SPARK-12972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-12972:
Assignee: Sean Owen (was: Apache Spark)
> Update org.apache.httpcomponents.httpclient
> -
[
https://issues.apache.org/jira/browse/SPARK-12972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-12972:
Assignee: Apache Spark (was: Sean Owen)
> Update org.apache.httpcomponents.httpclient
> -
[
https://issues.apache.org/jira/browse/SPARK-15324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-15324:
Assignee: Apache Spark
> Add the takeSample function to the Dataset
>
[
https://issues.apache.org/jira/browse/SPARK-15324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15283519#comment-15283519
]
Apache Spark commented on SPARK-15324:
--
User 'burness' has created a pull request fo
[
https://issues.apache.org/jira/browse/SPARK-15324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-15324:
Assignee: (was: Apache Spark)
> Add the takeSample function to the Dataset
> -
[
https://issues.apache.org/jira/browse/SPARK-12492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15283518#comment-15283518
]
Apache Spark commented on SPARK-12492:
--
User 'KaiXinXiaoLei' has created a pull requ
[
https://issues.apache.org/jira/browse/SPARK-15325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15283513#comment-15283513
]
Apache Spark commented on SPARK-15325:
--
User 'HyukjinKwon' has created a pull reques
[
https://issues.apache.org/jira/browse/SPARK-15325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-15325:
Assignee: (was: Apache Spark)
> Replace the usage of deprecated DataSet API in tests
>
[
https://issues.apache.org/jira/browse/SPARK-15325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-15325:
Assignee: Apache Spark
> Replace the usage of deprecated DataSet API in tests
> --
[
https://issues.apache.org/jira/browse/SPARK-15326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jurriaan Pruis updated SPARK-15326:
---
Summary: Doing multiple unions on a Dataframe will result in a very
inefficient query plan (
[
https://issues.apache.org/jira/browse/SPARK-15326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jurriaan Pruis updated SPARK-15326:
---
Attachment: Query Plan.pdf
Also added a PDF of the Query Plan as shown in the web interface.
[
https://issues.apache.org/jira/browse/SPARK-15326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jurriaan Pruis updated SPARK-15326:
---
Description:
While working with a very skewed dataset I noticed that repeated unions on a
da
[
https://issues.apache.org/jira/browse/SPARK-15326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jurriaan Pruis updated SPARK-15326:
---
Comment: was deleted
(was: The example code)
> Doing multiple union on a Dataframe will resu
[
https://issues.apache.org/jira/browse/SPARK-15326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jurriaan Pruis updated SPARK-15326:
---
Comment: was deleted
(was: The extended query plan generated by the example)
> Doing multipl
[
https://issues.apache.org/jira/browse/SPARK-15326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jurriaan Pruis updated SPARK-15326:
---
Attachment: skewed_join_plan.txt
The extended query plan generated by the example
> Doing mu
[
https://issues.apache.org/jira/browse/SPARK-15326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jurriaan Pruis updated SPARK-15326:
---
Description:
While working with a very skewed dataset I noticed that repeated unions on a
da
[
https://issues.apache.org/jira/browse/SPARK-15326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jurriaan Pruis updated SPARK-15326:
---
Attachment: skewed_join.py
The example code
> Doing multiple union on a Dataframe will resul
Jurriaan Pruis created SPARK-15326:
--
Summary: Doing multiple union on a Dataframe will result in a very
inefficient query plan
Key: SPARK-15326
URL: https://issues.apache.org/jira/browse/SPARK-15326
[
https://issues.apache.org/jira/browse/SPARK-15325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15283507#comment-15283507
]
Hyukjin Kwon commented on SPARK-15325:
--
I will work on this.
> Replace the usage of
Hyukjin Kwon created SPARK-15325:
Summary: Replace the usage of deprecated DataSet API in tests
Key: SPARK-15325
URL: https://issues.apache.org/jira/browse/SPARK-15325
Project: Spark
Issue Ty
[
https://issues.apache.org/jira/browse/SPARK-12972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen updated SPARK-12972:
--
Fix Version/s: (was: 2.0.0)
> Update org.apache.httpcomponents.httpclient
> ---
[
https://issues.apache.org/jira/browse/SPARK-15096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen updated SPARK-15096:
--
Assignee: Miao Wang
> LogisticRegression MultiClassSummarizer numClasses can fail if no valid
> labels
burness duan created SPARK-15324:
Summary: Add the takeSample function to the Dataset
Key: SPARK-15324
URL: https://issues.apache.org/jira/browse/SPARK-15324
Project: Spark
Issue Type: Improv
[
https://issues.apache.org/jira/browse/SPARK-15096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen resolved SPARK-15096.
---
Resolution: Fixed
Fix Version/s: 2.0.0
Issue resolved by pull request 12969
[https://github.co
[
https://issues.apache.org/jira/browse/SPARK-15197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen resolved SPARK-15197.
---
Resolution: Fixed
Fix Version/s: 2.0.0
Issue resolved by pull request 12955
[https://github.co
[
https://issues.apache.org/jira/browse/SPARK-15323?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15283481#comment-15283481
]
Apache Spark commented on SPARK-15323:
--
User 'jurriaan' has created a pull request f
[
https://issues.apache.org/jira/browse/SPARK-15323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-15323:
Assignee: (was: Apache Spark)
> read with format=text is broken for partitioned tables
[
https://issues.apache.org/jira/browse/SPARK-15323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-15323:
Assignee: Apache Spark
> read with format=text is broken for partitioned tables in Spark 2
[
https://issues.apache.org/jira/browse/SPARK-15323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jurriaan Pruis updated SPARK-15323:
---
Description:
{code}
sqlContext.read.format("text").load("...")
{code}
Is broken for partitio
Jurriaan Pruis created SPARK-15323:
--
Summary: read with format=text is broken for partitioned tables in
Spark 2.0
Key: SPARK-15323
URL: https://issues.apache.org/jira/browse/SPARK-15323
Project: Spar
58 matches
Mail list logo