Ankur Chauhan created SPARK-6707:
Summary: Mesos Scheduler should allow the user to specify
constraints based on slave attributes
Key: SPARK-6707
URL: https://issues.apache.org/jira/browse/SPARK-6707
[
https://issues.apache.org/jira/browse/SPARK-3625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14395599#comment-14395599
]
Sean Owen commented on SPARK-3625:
--
Why would this change be necessary in order to use
[
https://issues.apache.org/jira/browse/SPARK-6706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14395598#comment-14395598
]
Sean Owen commented on SPARK-6706:
--
Hey Xi, I don't think this makes for a good JIRA as
[
https://issues.apache.org/jira/browse/SPARK-6646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Reynold Xin resolved SPARK-6646.
Resolution: Later
Alright -- given the size of the task, I am not sure if I have enough cycle to
[
https://issues.apache.org/jira/browse/SPARK-6646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14395614#comment-14395614
]
Sean Owen commented on SPARK-6646:
--
I feel like people aren't taking this seriously. What
[
https://issues.apache.org/jira/browse/SPARK-3928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14395645#comment-14395645
]
Harut Martirosyan commented on SPARK-3928:
--
This stopped working after
[
https://issues.apache.org/jira/browse/SPARK-6707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ankur Chauhan updated SPARK-6707:
-
Description:
Currently, the mesos scheduler only looks at the `cpu` and `mem` resources when
[
https://issues.apache.org/jira/browse/SPARK-6707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ankur Chauhan updated SPARK-6707:
-
Description:
Currently, the mesos scheduler only looks at the 'cpu' and 'mem' resources when
[
https://issues.apache.org/jira/browse/SPARK-5242?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-5242:
---
Assignee: (was: Apache Spark)
ec2/spark_ec2.py lauch does not work with VPC if no
[
https://issues.apache.org/jira/browse/SPARK-5242?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-5242:
---
Assignee: Apache Spark
ec2/spark_ec2.py lauch does not work with VPC if no public DNS or IP
[
https://issues.apache.org/jira/browse/SPARK-6435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14395609#comment-14395609
]
Sean Owen commented on SPARK-6435:
--
I feel like it's worth fixing, cryptic or not. Try
[
https://issues.apache.org/jira/browse/SPARK-6242?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Cheng Lian resolved SPARK-6242.
---
Resolution: Duplicate
Support replace (drop) column for parquet table
[
https://issues.apache.org/jira/browse/SPARK-6706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xi Shen updated SPARK-6706:
---
Description:
When doing k-means cluster with the kmeans|| algorithm which is the default
one. The algorithm
[
https://issues.apache.org/jira/browse/SPARK-6707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ankur Chauhan updated SPARK-6707:
-
Description:
Currently, the mesos scheduler only looks at the `cpu` and `mem` resources when
[
https://issues.apache.org/jira/browse/SPARK-6706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14395622#comment-14395622
]
Xi Shen commented on SPARK-6706:
I know it is more like a user report than a technical
[
https://issues.apache.org/jira/browse/SPARK-6548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14395625#comment-14395625
]
Apache Spark commented on SPARK-6548:
-
User 'dreamquster' has created a pull request
[
https://issues.apache.org/jira/browse/SPARK-6489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14395643#comment-14395643
]
Apache Spark commented on SPARK-6489:
-
User 'dreamquster' has created a pull request
[
https://issues.apache.org/jira/browse/SPARK-3625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14395613#comment-14395613
]
Guoqiang Li commented on SPARK-3625:
Sometimes, when calling the RDD.checkpoint ,
[
https://issues.apache.org/jira/browse/SPARK-6706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14395639#comment-14395639
]
Sean Owen commented on SPARK-6706:
--
I tried your code locally vs master with k=1000 (you
[
https://issues.apache.org/jira/browse/SPARK-6706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xi Shen updated SPARK-6706:
---
Comment: was deleted
(was: Yes, the {{collect()}} jobs finished, then hangs at the driver. Your
words are
[
https://issues.apache.org/jira/browse/SPARK-6706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14395641#comment-14395641
]
Xi Shen commented on SPARK-6706:
Yes, the {{collect()}} jobs finished, then hangs at the
[
https://issues.apache.org/jira/browse/SPARK-6706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14395642#comment-14395642
]
Xi Shen commented on SPARK-6706:
Yes, the {{collect()}} jobs finished, then hangs at the
[
https://issues.apache.org/jira/browse/SPARK-4036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kai Sasaki updated SPARK-4036:
--
Attachment: CRF_design.1.pdf
Add Conditional Random Fields (CRF) algorithm to Spark MLlib
[
https://issues.apache.org/jira/browse/SPARK-6262?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14395721#comment-14395721
]
Apache Spark commented on SPARK-6262:
-
User 'Lewuathe' has created a pull request for
[
https://issues.apache.org/jira/browse/SPARK-6262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-6262:
---
Assignee: Kai Sasaki (was: Apache Spark)
Python MLlib API missing items: Statistics
[
https://issues.apache.org/jira/browse/SPARK-6262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-6262:
---
Assignee: Apache Spark (was: Kai Sasaki)
Python MLlib API missing items: Statistics
[
https://issues.apache.org/jira/browse/SPARK-6704?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen updated SPARK-6704:
-
Component/s: SparkR
(I went ahead and made a SparkR component in JIRA.)
integrate SparkR docs build
[
https://issues.apache.org/jira/browse/SPARK-5654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen updated SPARK-5654:
-
Component/s: (was: Project Infra)
SparkR
Integrate SparkR into Apache Spark
[
https://issues.apache.org/jira/browse/SPARK-4830?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen resolved SPARK-4830.
--
Resolution: Duplicate
Yes, I strongly suspect this was resolved by SPARK-4660, since it would correct
[
https://issues.apache.org/jira/browse/SPARK-2698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen updated SPARK-2698:
-
Priority: Minor (was: Major)
This might have been fixed at some point since 1.0 though I don't see an
[
https://issues.apache.org/jira/browse/SPARK-6587?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Cheng Lian updated SPARK-6587:
--
Comment: was deleted
(was: JSON needs this kind of schema inference because JSON is weakly typed.
The
[
https://issues.apache.org/jira/browse/SPARK-6587?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14395765#comment-14395765
]
Cheng Lian commented on SPARK-6587:
---
JSON needs this kind of schema inference because
[
https://issues.apache.org/jira/browse/SPARK-6695?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14395773#comment-14395773
]
Sean Owen commented on SPARK-6695:
--
The problem with this in the general case raises
[
https://issues.apache.org/jira/browse/SPARK-6569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14395763#comment-14395763
]
Sean Owen commented on SPARK-6569:
--
Let's make it info level then.
Kafka
[
https://issues.apache.org/jira/browse/SPARK-3276?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen updated SPARK-3276:
-
Summary: Provide a API to specify MIN_REMEMBER_DURATION for files to
consider as input in streaming
[
https://issues.apache.org/jira/browse/SPARK-4900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen resolved SPARK-4900.
--
Resolution: Fixed
Given lack of follow-up I think this is as resolved as we're going to make it.
[
https://issues.apache.org/jira/browse/SPARK-4900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen updated SPARK-4900:
-
Description:
java.lang.reflect.InvocationTargetException
...
Caused by:
[
https://issues.apache.org/jira/browse/SPARK-6607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Cheng Lian resolved SPARK-6607.
---
Resolution: Fixed
Fix Version/s: 1.4.0
Issue resolved by pull request 5263
[
https://issues.apache.org/jira/browse/SPARK-6399?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14395780#comment-14395780
]
Sean Owen commented on SPARK-6399:
--
Hey Marcelo where would you like to document this,
[
https://issues.apache.org/jira/browse/SPARK-6061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen resolved SPARK-6061.
--
Resolution: Duplicate
This reduces to the same underlying issue as in SPARK-3276, which is to
[
https://issues.apache.org/jira/browse/SPARK-5033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen resolved SPARK-5033.
--
Resolution: Duplicate
Spark 1.1.0/1.1.1/1.2.0 can't run well in HDP on Windows
[
https://issues.apache.org/jira/browse/SPARK-5261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen resolved SPARK-5261.
--
Resolution: Duplicate
In some cases ,The value of word's vector representation is too big
Cheng Lian created SPARK-6708:
-
Summary: Using Hive UDTF may throw ClassNotFoundException
Key: SPARK-6708
URL: https://issues.apache.org/jira/browse/SPARK-6708
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-6587?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14395766#comment-14395766
]
Cheng Lian commented on SPARK-6587:
---
JSON needs this kind of schema inference because
[
https://issues.apache.org/jira/browse/SPARK-6622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen updated SPARK-6622:
-
Component/s: (was: Spark Submit)
SQL
Spark SQL cannot communicate with Hive meta
[
https://issues.apache.org/jira/browse/SPARK-3413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen resolved SPARK-3413.
--
Resolution: Cannot Reproduce
Spark Blocked due to Executor lost in FIFO MODE
Patrick Liu created SPARK-6709:
--
Summary: SparkSQL cannot parse sql correctly when the table
contains count column.
Key: SPARK-6709
URL: https://issues.apache.org/jira/browse/SPARK-6709
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-3553?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14395793#comment-14395793
]
Sean Owen commented on SPARK-3553:
--
Checking through old issues -- I know this logic has
[
https://issues.apache.org/jira/browse/SPARK-6703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andrew Or updated SPARK-6703:
-
Affects Version/s: 1.3.0
Provide a way to discover existing SparkContext's
[
https://issues.apache.org/jira/browse/SPARK-6703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andrew Or updated SPARK-6703:
-
Target Version/s: 1.4.0
Provide a way to discover existing SparkContext's
[
https://issues.apache.org/jira/browse/SPARK-6699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14396040#comment-14396040
]
RoCm commented on SPARK-6699:
-
I dont think this is a problem caused by missing numpy module.
Chunnan Yao created SPARK-6711:
--
Summary: Support parallelized online matrix factorization for
Collaborative Filtering
Key: SPARK-6711
URL: https://issues.apache.org/jira/browse/SPARK-6711
Project:
[
https://issues.apache.org/jira/browse/SPARK-5261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Guoqiang Li reopened SPARK-5261:
[~srowen] SPARK-5261 andSPARK-4846 are not the same problem. This is a
algorithm error. The
Cheolsoo Park created SPARK-6712:
Summary: Allow lower the log level in YARN client while keeping AM
tracking URL printed
Key: SPARK-6712
URL: https://issues.apache.org/jira/browse/SPARK-6712
[
https://issues.apache.org/jira/browse/SPARK-6712?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-6712:
---
Assignee: Apache Spark
Allow lower the log level in YARN client while keeping AM tracking
[
https://issues.apache.org/jira/browse/SPARK-6712?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14396094#comment-14396094
]
Apache Spark commented on SPARK-6712:
-
User 'piaozhexiu' has created a pull request
[
https://issues.apache.org/jira/browse/SPARK-6712?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-6712:
---
Assignee: (was: Apache Spark)
Allow lower the log level in YARN client while keeping AM
Michael Malak created SPARK-6710:
Summary: Wrong initial bias in GraphX SVDPlusPlus
Key: SPARK-6710
URL: https://issues.apache.org/jira/browse/SPARK-6710
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-3580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14395888#comment-14395888
]
Harsh Gupta commented on SPARK-3580:
Hi. Can I take it up ?
Add Consistent Method To
[
https://issues.apache.org/jira/browse/SPARK-6548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14395876#comment-14395876
]
Harsh Gupta commented on SPARK-6548:
Is this available to be worked upon ? The
[
https://issues.apache.org/jira/browse/SPARK-975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-975:
--
Assignee: (was: Apache Spark)
Spark Replay Debugger
-
[
https://issues.apache.org/jira/browse/SPARK-975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-975:
--
Assignee: Apache Spark
Spark Replay Debugger
-
Key:
[
https://issues.apache.org/jira/browse/SPARK-6661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-6661:
---
Assignee: (was: Apache Spark)
Python type errors should print type, not object
[
https://issues.apache.org/jira/browse/SPARK-6661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-6661:
---
Assignee: Apache Spark
Python type errors should print type, not object
[
https://issues.apache.org/jira/browse/SPARK-6661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14395930#comment-14395930
]
Apache Spark commented on SPARK-6661:
-
User '31z4' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-6703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Patrick Wendell updated SPARK-6703:
---
Description:
Right now it is difficult to write a Spark application in a way that can be run
[
https://issues.apache.org/jira/browse/SPARK-6676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14395932#comment-14395932
]
Patrick Wendell commented on SPARK-6676:
[~srowen] This is such a common source of
[
https://issues.apache.org/jira/browse/SPARK-6676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14395948#comment-14395948
]
Sean Owen commented on SPARK-6676:
--
I'd prefer to start by just improving the
68 matches
Mail list logo