[
https://issues.apache.org/jira/browse/SPARK-1681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Patrick Wendell updated SPARK-1681:
---
Description:
When Hive support is enabled we should copy the datanucleus jars to the
package
Patrick Wendell created SPARK-1681:
--
Summary: Handle hive support correctly in ./make-distribution
Key: SPARK-1681
URL: https://issues.apache.org/jira/browse/SPARK-1681
Project: Spark
Issue
Patrick Wendell created SPARK-1680:
--
Summary: Clean up use of setExecutorEnvs in SparkConf
Key: SPARK-1680
URL: https://issues.apache.org/jira/browse/SPARK-1680
Project: Spark
Issue Type: S
[
https://issues.apache.org/jira/browse/SPARK-922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13985219#comment-13985219
]
Patrick Wendell commented on SPARK-922:
---
This is no longer a blocker now that we've d
[
https://issues.apache.org/jira/browse/SPARK-922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Patrick Wendell updated SPARK-922:
--
Priority: Major (was: Blocker)
> Update Spark AMI to Python 2.7
> -
[
https://issues.apache.org/jira/browse/SPARK-922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Patrick Wendell updated SPARK-922:
--
Fix Version/s: (was: 1.0.0)
1.1.0
> Update Spark AMI to Python 2.7
>
[
https://issues.apache.org/jira/browse/SPARK-1466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Patrick Wendell updated SPARK-1466:
---
Fix Version/s: (was: 1.0.0)
1.0.1
> Pyspark doesn't check if gateway p
[
https://issues.apache.org/jira/browse/SPARK-1626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Patrick Wendell resolved SPARK-1626.
Resolution: Duplicate
> Update Spark YARN docs to use spark-submit
> --
[
https://issues.apache.org/jira/browse/SPARK-1492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Patrick Wendell updated SPARK-1492:
---
Priority: Blocker (was: Major)
> running-on-yarn doc should use spark-submit script for exam
[
https://issues.apache.org/jira/browse/SPARK-1626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Patrick Wendell updated SPARK-1626:
---
Assignee: Sandy Ryza (was: Patrick Wendell)
> Update Spark YARN docs to use spark-submit
> -
[
https://issues.apache.org/jira/browse/SPARK-1004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Patrick Wendell resolved SPARK-1004.
Resolution: Fixed
Issue resolved by pull request 30
[https://github.com/apache/spark/pull/3
Michael Armbrust created SPARK-1679:
---
Summary: In-Memory compression needs to be configurable.
Key: SPARK-1679
URL: https://issues.apache.org/jira/browse/SPARK-1679
Project: Spark
Issue Typ
Michael Armbrust created SPARK-1678:
---
Summary: Compression loses repeated values.
Key: SPARK-1678
URL: https://issues.apache.org/jira/browse/SPARK-1678
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-1677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Patrick Wendell updated SPARK-1677:
---
Issue Type: Improvement (was: Bug)
> Allow users to avoid Hadoop output checks if desired
>
Patrick Wendell created SPARK-1677:
--
Summary: Allow users to avoid Hadoop output checks if desired
Key: SPARK-1677
URL: https://issues.apache.org/jira/browse/SPARK-1677
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-1677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Patrick Wendell updated SPARK-1677:
---
Description:
For compatibility with older versions of Spark it would be nice to have an
opti
Aaron Davidson created SPARK-1676:
-
Summary: HDFS FileSystems continually pile up in the FS cache
Key: SPARK-1676
URL: https://issues.apache.org/jira/browse/SPARK-1676
Project: Spark
Issue Ty
Sandy Ryza created SPARK-1675:
-
Summary: Make clear whether computePrincipalComponents centers data
Key: SPARK-1675
URL: https://issues.apache.org/jira/browse/SPARK-1675
Project: Spark
Issue Type
[
https://issues.apache.org/jira/browse/SPARK-1661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Michael Armbrust resolved SPARK-1661.
-
Resolution: Won't Fix
> the result of querying table created with RegexSerDe is all null
[
https://issues.apache.org/jira/browse/SPARK-1661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13985055#comment-13985055
]
Michael Armbrust commented on SPARK-1661:
-
Thanks for your report. This JIRA is f
[
https://issues.apache.org/jira/browse/SPARK-1674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiangrui Meng resolved SPARK-1674.
--
Resolution: Fixed
Fix Version/s: 1.0.0
> Interrupted system call error in pyspark's RDD.
[
https://issues.apache.org/jira/browse/SPARK-544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Matei Zaharia resolved SPARK-544.
-
Resolution: Fixed
Fix Version/s: 0.9.0
> Provide a Configuration class in addition to syste
[
https://issues.apache.org/jira/browse/SPARK-544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Matei Zaharia reassigned SPARK-544:
---
Assignee: Matei Zaharia (was: Evan Chan)
> Provide a Configuration class in addition to syste
[
https://issues.apache.org/jira/browse/SPARK-1268?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Matei Zaharia resolved SPARK-1268.
--
Resolution: Fixed
Fix Version/s: 1.0.0
> Adding XOR and AND-NOT operations to spark.util
[
https://issues.apache.org/jira/browse/SPARK-615?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Matei Zaharia resolved SPARK-615.
-
Resolution: Fixed
Fix Version/s: 1.0.0
> Add mapPartitionsWithIndex() to the Java API
> ---
[
https://issues.apache.org/jira/browse/SPARK-1394?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13985007#comment-13985007
]
Vlad Frolov commented on SPARK-1394:
[~idanzalz] unfortunately, it had helped to avoid
[
https://issues.apache.org/jira/browse/SPARK-1674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13985000#comment-13985000
]
Xiangrui Meng commented on SPARK-1674:
--
PR: https://github.com/apache/spark/pull/594
[
https://issues.apache.org/jira/browse/SPARK-1373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13984997#comment-13984997
]
Michael Armbrust commented on SPARK-1373:
-
Note that the code is in a large part a
Xiangrui Meng created SPARK-1674:
Summary: Interrupted system call error in pyspark's RDD.pipe
Key: SPARK-1674
URL: https://issues.apache.org/jira/browse/SPARK-1674
Project: Spark
Issue Type:
Sung Chung created SPARK-1673:
-
Summary: GLMNET implementation in Spark
Key: SPARK-1673
URL: https://issues.apache.org/jira/browse/SPARK-1673
Project: Spark
Issue Type: New Feature
Comp
Tor Myklebust created SPARK-1672:
Summary: Support separate partitioners (and numbers of partitions)
for users and products
Key: SPARK-1672
URL: https://issues.apache.org/jira/browse/SPARK-1672
Projec
[
https://issues.apache.org/jira/browse/SPARK-1672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tor Myklebust updated SPARK-1672:
-
Component/s: MLlib
> Support separate partitioners (and numbers of partitions) for users and
> p
Cheng Lian created SPARK-1671:
-
Summary: Cached tables should follow write-through policy
Key: SPARK-1671
URL: https://issues.apache.org/jira/browse/SPARK-1671
Project: Spark
Issue Type: Improvem
[
https://issues.apache.org/jira/browse/SPARK-1645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13984950#comment-13984950
]
Hari Shreedharan commented on SPARK-1645:
-
The first one is not exactly accurate,
[
https://issues.apache.org/jira/browse/SPARK-1670?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13984948#comment-13984948
]
Pat McDonough commented on SPARK-1670:
--
FYI [~ahirreddy] [~matei], here's the pyspark
Pat McDonough created SPARK-1670:
Summary: PySpark Fails to Create SparkContext Due To Debugging
Options in conf/java-opts
Key: SPARK-1670
URL: https://issues.apache.org/jira/browse/SPARK-1670
Project
Cheng Lian created SPARK-1669:
-
Summary: SQLContext.cacheTable() should be idempotent
Key: SPARK-1669
URL: https://issues.apache.org/jira/browse/SPARK-1669
Project: Spark
Issue Type: Improvement
[
https://issues.apache.org/jira/browse/SPARK-1645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13984927#comment-13984927
]
Tathagata Das commented on SPARK-1645:
--
Ah, I think get it now. So instead of the def
[
https://issues.apache.org/jira/browse/SPARK-1515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Michael Armbrust updated SPARK-1515:
Labels: compression (was: )
> Specialized ColumnTypes for Array, Map and Struct
>
[
https://issues.apache.org/jira/browse/SPARK-1513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Michael Armbrust updated SPARK-1513:
Labels: compression (was: )
> Specialized ColumnType for Timestamp
> -
[
https://issues.apache.org/jira/browse/SPARK-1512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Michael Armbrust resolved SPARK-1512.
-
Resolution: Fixed
> improve spark sql to support table with more than 22 fields
> ---
[
https://issues.apache.org/jira/browse/SPARK-1512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13984922#comment-13984922
]
Michael Armbrust commented on SPARK-1512:
-
Now that we have updated the docs to ta
[
https://issues.apache.org/jira/browse/SPARK-1610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Michael Armbrust resolved SPARK-1610.
-
Resolution: Fixed
Fix Version/s: 1.0.0
> Cast from BooleanType to NumericType shou
[
https://issues.apache.org/jira/browse/SPARK-1608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Michael Armbrust resolved SPARK-1608.
-
Resolution: Fixed
Fix Version/s: 1.0.0
> Cast.nullable should be true when cast fr
[
https://issues.apache.org/jira/browse/SPARK-1649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13984909#comment-13984909
]
Michael Armbrust commented on SPARK-1649:
-
Oh, I see. I forgot that we would also
[
https://issues.apache.org/jira/browse/SPARK-1649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Michael Armbrust updated SPARK-1649:
Summary: Figure out Nullability semantics for Array elements and Map values
(was: DataType
[
https://issues.apache.org/jira/browse/SPARK-1667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13984900#comment-13984900
]
Kousuke Saruta commented on SPARK-1667:
---
Now I'm trying to address this issue.
> Sh
[
https://issues.apache.org/jira/browse/SPARK-1645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13984816#comment-13984816
]
Hari Shreedharan commented on SPARK-1645:
-
No, Flume source and sink reside within
[
https://issues.apache.org/jira/browse/SPARK-1645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13984800#comment-13984800
]
Tathagata Das commented on SPARK-1645:
--
But this does not solve the scenario where th
[
https://issues.apache.org/jira/browse/SPARK-1645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13984780#comment-13984780
]
Hari Shreedharan commented on SPARK-1645:
-
No, the sink would run inside the Flume
[
https://issues.apache.org/jira/browse/SPARK-1645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13984768#comment-13984768
]
Tathagata Das commented on SPARK-1645:
--
Let me understand this. Is this sink going to
[
https://issues.apache.org/jira/browse/SPARK-1645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13984734#comment-13984734
]
Hari Shreedharan commented on SPARK-1645:
-
Yes, so I have a rough design for that
[
https://issues.apache.org/jira/browse/SPARK-1569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13984713#comment-13984713
]
Thomas Graves edited comment on SPARK-1569 at 4/29/14 8:00 PM:
-
[
https://issues.apache.org/jira/browse/SPARK-1569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13984713#comment-13984713
]
Thomas Graves commented on SPARK-1569:
--
@tgravescs ah I see, you're right. I think I
[
https://issues.apache.org/jira/browse/SPARK-1588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Patrick Wendell resolved SPARK-1588.
Resolution: Fixed
Fix Version/s: 1.0.0
> SPARK_JAVA_OPTS and SPARK_YARN_USER_ENV are
Xiangrui Meng created SPARK-1668:
Summary: Add implicit preference as an option to
examples/MovieLensALS
Key: SPARK-1668
URL: https://issues.apache.org/jira/browse/SPARK-1668
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-1645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13984654#comment-13984654
]
Tathagata Das commented on SPARK-1645:
--
Yes, we will keep you posted.
Though one th
[
https://issues.apache.org/jira/browse/SPARK-1100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Patrick Wendell updated SPARK-1100:
---
Assignee: Patrick Wendell (was: Patrick Cogan)
> saveAsTextFile shouldn't clobber by default
Kousuke Saruta created SPARK-1667:
-
Summary: Should re-fetch when intermediate data for shuffle is lost
Key: SPARK-1667
URL: https://issues.apache.org/jira/browse/SPARK-1667
Project: Spark
Is
[
https://issues.apache.org/jira/browse/SPARK-1569?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves updated SPARK-1569:
-
Issue Type: Sub-task (was: Bug)
Parent: SPARK-1652
> Spark on Yarn, authentication broke
[
https://issues.apache.org/jira/browse/SPARK-1625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves closed SPARK-1625.
Resolution: Fixed
> Ensure all legacy YARN options are supported with spark-submit
> --
[
https://issues.apache.org/jira/browse/SPARK-1625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13984519#comment-13984519
]
Thomas Graves commented on SPARK-1625:
--
I'll create a separate jira for that.
> Ensu
[
https://issues.apache.org/jira/browse/SPARK-1664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves updated SPARK-1664:
-
Issue Type: Sub-task (was: Bug)
Parent: SPARK-1652
> spark-submit --name doesn't work in
Diana Carroll created SPARK-1666:
Summary: document examples
Key: SPARK-1666
URL: https://issues.apache.org/jira/browse/SPARK-1666
Project: Spark
Issue Type: Improvement
Components:
Thomas Graves created SPARK-1665:
Summary: add a config to replace SPARK_YARN_USER_ENV
Key: SPARK-1665
URL: https://issues.apache.org/jira/browse/SPARK-1665
Project: Spark
Issue Type: Improve
[
https://issues.apache.org/jira/browse/SPARK-1664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves updated SPARK-1664:
-
Priority: Blocker (was: Major)
> spark-submit --name doesn't work in yarn-client mode
>
Thomas Graves created SPARK-1664:
Summary: spark-submit --name doesn't work in yarn-client mode
Key: SPARK-1664
URL: https://issues.apache.org/jira/browse/SPARK-1664
Project: Spark
Issue Type
[
https://issues.apache.org/jira/browse/SPARK-1663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13984466#comment-13984466
]
Sean Owen commented on SPARK-1663:
--
PR: https://github.com/apache/spark/pull/589
> Spark
Sean Owen created SPARK-1663:
Summary: Spark Streaming docs code has several small errors
Key: SPARK-1663
URL: https://issues.apache.org/jira/browse/SPARK-1663
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-1557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves resolved SPARK-1557.
--
Resolution: Fixed
Fix Version/s: 1.0.0
> Set permissions on event log files/directories
[
https://issues.apache.org/jira/browse/SPARK-1639?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13984318#comment-13984318
]
Thomas Graves commented on SPARK-1639:
--
https://github.com/apache/spark/pull/561
> S
[
https://issues.apache.org/jira/browse/SPARK-1625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves reopened SPARK-1625:
--
These aren't the only things broken. One big issue is that authentication isn't
being passed prope
Chandan Kumar created SPARK-1662:
Summary: PySpark fails if python class is used as a data container
Key: SPARK-1662
URL: https://issues.apache.org/jira/browse/SPARK-1662
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-1644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13984114#comment-13984114
]
Guoqiang Li commented on SPARK-1644:
{code}
# When Hive support is needed, Datanucleus
[
https://issues.apache.org/jira/browse/SPARK-1629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Guoqiang Li reassigned SPARK-1629:
--
Assignee: Guoqiang Li
> Spark should inline use of commons-lang `SystemUtils.IS_OS_WINDOWS`
>
[
https://issues.apache.org/jira/browse/SPARK-1644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Guoqiang Li reassigned SPARK-1644:
--
Assignee: Guoqiang Li
> hql("CREATE TABLE IF NOT EXISTS src (key INT, value STRING)") throw an
[
https://issues.apache.org/jira/browse/SPARK-1636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiangrui Meng resolved SPARK-1636.
--
Resolution: Done
Fix Version/s: 1.0.0
> Move main methods to examples
>
77 matches
Mail list logo
