[jira] [Commented] (SPARK-7299) saving Oracle-source DataFrame to Hive changes scale

2015-05-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14522962#comment-14522962 ] Apache Spark commented on SPARK-7299: - User 'viirya' has created a pull request for

[jira] [Assigned] (SPARK-7299) saving Oracle-source DataFrame to Hive changes scale

2015-05-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7299?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7299: --- Assignee: Apache Spark saving Oracle-source DataFrame to Hive changes scale

[jira] [Commented] (SPARK-7299) saving Oracle-source DataFrame to Hive changes scale

2015-05-01 Thread Liang-Chi Hsieh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14522963#comment-14522963 ] Liang-Chi Hsieh commented on SPARK-7299: [~kgeis] I submit a

[jira] [Assigned] (SPARK-7299) saving Oracle-source DataFrame to Hive changes scale

2015-05-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7299?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7299: --- Assignee: (was: Apache Spark) saving Oracle-source DataFrame to Hive changes scale

[jira] [Commented] (SPARK-7251) Perform sequential scan when iterating over entries in BytesToBytesMap

2015-05-01 Thread Chen Song (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14522977#comment-14522977 ] Chen Song commented on SPARK-7251: -- Can the key could be empty? If we allow the key could

[jira] [Updated] (SPARK-7300) The temporary generated direcotries are not cleaned while calling the insertinto api in dataframe

2015-05-01 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-7300: - Priority: Minor (was: Major) Affects Version/s: (was: 1.3.0) The temporary generated

[jira] [Updated] (SPARK-7294) Add a between function in Column

2015-05-01 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-7294: --- Labels: starter (was: ) Add a between function in Column

[jira] [Created] (SPARK-7294) Add a between function in Column

2015-05-01 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-7294: -- Summary: Add a between function in Column Key: SPARK-7294 URL: https://issues.apache.org/jira/browse/SPARK-7294 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-3468) Provide timeline view in Job UI pages

2015-05-01 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-3468: --- Summary: Provide timeline view in Job UI pages (was: Provide timeline view in Job and Stage

[jira] [Commented] (SPARK-7196) decimal precision lost when loading DataFrame from JDBC

2015-05-01 Thread Liang-Chi Hsieh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14522941#comment-14522941 ] Liang-Chi Hsieh commented on SPARK-7196: I think it is different problem to this

[jira] [Created] (SPARK-7293) Report memory used in aggregations and joins

2015-05-01 Thread Patrick Wendell (JIRA)
Patrick Wendell created SPARK-7293: -- Summary: Report memory used in aggregations and joins Key: SPARK-7293 URL: https://issues.apache.org/jira/browse/SPARK-7293 Project: Spark Issue Type:

[jira] [Commented] (SPARK-7292) Provide operator to truncate lineage without persisting RDD's

2015-05-01 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14522898#comment-14522898 ] Sean Owen commented on SPARK-7292: -- In this case, losing a partition means the whole job

[jira] [Commented] (SPARK-7292) Provide operator to truncate lineage without persisting RDD's

2015-05-01 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14522919#comment-14522919 ] Patrick Wendell commented on SPARK-7292: Yes, this would mean sacrificing fault

[jira] [Updated] (SPARK-7297) Make timeline more discoverable

2015-05-01 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-7297: --- Assignee: Patrick Wendell Make timeline more discoverable ---

[jira] [Created] (SPARK-7299) saving Oracle-source DataFrame to Hive changes scale

2015-05-01 Thread Ken Geis (JIRA)
Ken Geis created SPARK-7299: --- Summary: saving Oracle-source DataFrame to Hive changes scale Key: SPARK-7299 URL: https://issues.apache.org/jira/browse/SPARK-7299 Project: Spark Issue Type: Bug

[jira] [Comment Edited] (SPARK-3468) Provide timeline view in Job UI pages

2015-05-01 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14522946#comment-14522946 ] Patrick Wendell edited comment on SPARK-3468 at 5/1/15 8:38 AM:

[jira] [Resolved] (SPARK-3468) Provide timeline view in Job UI pages

2015-05-01 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-3468. Resolution: Fixed Fix Version/s: 1.4.0 Thanks for the contribution [~sarutak]

[jira] [Commented] (SPARK-7300) The temporary generated direcotries are not cleaned while calling the insertinto api in dataframe

2015-05-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14522976#comment-14522976 ] Apache Spark commented on SPARK-7300: - User 'hseagle' has created a pull request for

[jira] [Assigned] (SPARK-7300) The temporary generated direcotries are not cleaned while calling the insertinto api in dataframe

2015-05-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7300: --- Assignee: (was: Apache Spark) The temporary generated direcotries are not cleaned

[jira] [Assigned] (SPARK-7300) The temporary generated direcotries are not cleaned while calling the insertinto api in dataframe

2015-05-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7300: --- Assignee: Apache Spark The temporary generated direcotries are not cleaned while calling

[jira] [Assigned] (SPARK-7233) ClosureCleaner#clean blocks concurrent job submitter threads

2015-05-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7233: --- Assignee: (was: Apache Spark) ClosureCleaner#clean blocks concurrent job submitter

[jira] [Commented] (SPARK-7233) ClosureCleaner#clean blocks concurrent job submitter threads

2015-05-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14522987#comment-14522987 ] Apache Spark commented on SPARK-7233: - User 'preeze' has created a pull request for

[jira] [Assigned] (SPARK-7233) ClosureCleaner#clean blocks concurrent job submitter threads

2015-05-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7233: --- Assignee: Apache Spark ClosureCleaner#clean blocks concurrent job submitter threads

[jira] [Commented] (SPARK-7251) Perform sequential scan when iterating over entries in BytesToBytesMap

2015-05-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14523006#comment-14523006 ] Apache Spark commented on SPARK-7251: - User 'kaka1992' has created a pull request for

[jira] [Assigned] (SPARK-7251) Perform sequential scan when iterating over entries in BytesToBytesMap

2015-05-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7251: --- Assignee: Apache Spark Perform sequential scan when iterating over entries in

[jira] [Commented] (SPARK-7310) SparkSubmit does not escape for java options and ^ won't work

2015-05-01 Thread Yitong Zhou (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7310?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14523926#comment-14523926 ] Yitong Zhou commented on SPARK-7310: I tried to escape with ^ according to th

[jira] [Commented] (SPARK-7310) SparkSubmit does not escape for java options and ^ won't work

2015-05-01 Thread Yitong Zhou (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7310?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14523940#comment-14523940 ] Yitong Zhou commented on SPARK-7310: Hi Sean, thanks for the help. \ works.

[jira] [Created] (SPARK-7312) SPARK-6913 broke jdk6 build

2015-05-01 Thread Thomas Graves (JIRA)
Thomas Graves created SPARK-7312: Summary: SPARK-6913 broke jdk6 build Key: SPARK-7312 URL: https://issues.apache.org/jira/browse/SPARK-7312 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-7310) SparkSubmit does not escape for java options and ^ won't work

2015-05-01 Thread Yitong Zhou (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7310?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14523955#comment-14523955 ] Yitong Zhou commented on SPARK-7310: BTW, I don't think this is an escape for the

[jira] [Commented] (SPARK-7310) SparkSubmit does not escape for java options and ^ won't work

2015-05-01 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7310?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14523997#comment-14523997 ] Sean Owen commented on SPARK-7310: -- I see your point there. Do you know if this happens

[jira] [Resolved] (SPARK-4550) In sort-based shuffle, store map outputs in serialized form

2015-05-01 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza resolved SPARK-4550. --- Resolution: Fixed Fix Version/s: 1.4.0 In sort-based shuffle, store map outputs in serialized

[jira] [Created] (SPARK-7310) SparkSubmit does not escape for java options and ^ won't work

2015-05-01 Thread Yitong Zhou (JIRA)
Yitong Zhou created SPARK-7310: -- Summary: SparkSubmit does not escape for java options and ^ won't work Key: SPARK-7310 URL: https://issues.apache.org/jira/browse/SPARK-7310 Project: Spark

[jira] [Resolved] (SPARK-7310) SparkSubmit does not escape for java options and ^ won't work

2015-05-01 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-7310. -- Resolution: Invalid You escape in bash with \. This has nothing to do with Spark. SparkSubmit does

[jira] [Created] (SPARK-7311) Enable in-memory serialized map-side shuffle to work with SQL serializers

2015-05-01 Thread Sandy Ryza (JIRA)
Sandy Ryza created SPARK-7311: - Summary: Enable in-memory serialized map-side shuffle to work with SQL serializers Key: SPARK-7311 URL: https://issues.apache.org/jira/browse/SPARK-7311 Project: Spark

[jira] [Comment Edited] (SPARK-7310) SparkSubmit does not escape for java options and ^ won't work

2015-05-01 Thread Yitong Zhou (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7310?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14523926#comment-14523926 ] Yitong Zhou edited comment on SPARK-7310 at 5/1/15 9:00 PM: I

[jira] [Commented] (SPARK-7304) Include $@ in call to mvn in make-distribution.sh

2015-05-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14524027#comment-14524027 ] Apache Spark commented on SPARK-7304: - User 'palamau' has created a pull request for

[jira] [Assigned] (SPARK-7304) Include $@ in call to mvn in make-distribution.sh

2015-05-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7304: --- Assignee: Apache Spark Include $@ in call to mvn in make-distribution.sh

[jira] [Assigned] (SPARK-7304) Include $@ in call to mvn in make-distribution.sh

2015-05-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7304: --- Assignee: (was: Apache Spark) Include $@ in call to mvn in make-distribution.sh

[jira] [Commented] (SPARK-6288) Pyrolite calls hashCode to cache previously serialized objects

2015-05-01 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14524052#comment-14524052 ] Xiangrui Meng commented on SPARK-6288: -- irmen is testing the path bintray - jcenter -

[jira] [Assigned] (SPARK-7312) SPARK-6913 broke jdk6 build

2015-05-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7312: --- Assignee: Apache Spark SPARK-6913 broke jdk6 build ---

[jira] [Commented] (SPARK-6913) No suitable driver found loading JDBC dataframe using driver added by through SparkContext.addJar

2015-05-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14524071#comment-14524071 ] Apache Spark commented on SPARK-6913: - User 'yhuai' has created a pull request for

[jira] [Commented] (SPARK-7312) SPARK-6913 broke jdk6 build

2015-05-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14524070#comment-14524070 ] Apache Spark commented on SPARK-7312: - User 'yhuai' has created a pull request for

[jira] [Assigned] (SPARK-7312) SPARK-6913 broke jdk6 build

2015-05-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7312: --- Assignee: (was: Apache Spark) SPARK-6913 broke jdk6 build ---

[jira] [Created] (SPARK-7313) Allow for configuring max_samples in range partitioner.

2015-05-01 Thread Mridul Muralidharan (JIRA)
Mridul Muralidharan created SPARK-7313: -- Summary: Allow for configuring max_samples in range partitioner. Key: SPARK-7313 URL: https://issues.apache.org/jira/browse/SPARK-7313 Project: Spark

[jira] [Updated] (SPARK-5281) Registering table on RDD is giving MissingRequirementError

2015-05-01 Thread Marko Bonaci (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marko Bonaci updated SPARK-5281: Affects Version/s: 1.3.1 Registering table on RDD is giving MissingRequirementError

[jira] [Created] (SPARK-7301) Issue with duplicated fields in interpreted json schemas

2015-05-01 Thread David Crossland (JIRA)
David Crossland created SPARK-7301: -- Summary: Issue with duplicated fields in interpreted json schemas Key: SPARK-7301 URL: https://issues.apache.org/jira/browse/SPARK-7301 Project: Spark

[jira] [Commented] (SPARK-6846) Stage kill URL easy to accidentally trigger and possibility for security issue.

2015-05-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6846?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14523198#comment-14523198 ] Apache Spark commented on SPARK-6846: - User 'srowen' has created a pull request for

<    1   2   3