[jira] [Assigned] (SPARK-8169) Add StopWordsRemover as a transformer

2015-06-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8169: --- Assignee: Apache Spark Add StopWordsRemover as a transformer

[jira] [Commented] (SPARK-8287) Filter not push down through Subquery or View

2015-06-10 Thread Li Sheng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14580423#comment-14580423 ] Li Sheng commented on SPARK-8287: - I'm working on this in a hack way and I think is not a

[jira] [Updated] (SPARK-8287) Filter not push down through Subquery or View

2015-06-10 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-8287: -- Description: Filter not push down through Subquery or View. Assume we have two big partitioned table

[jira] [Commented] (SPARK-8048) Explicit partitionning of an RDD with 0 partition will yield empty outer join

2015-06-10 Thread Josiah Samuel Sathiadass (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8048?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14580395#comment-14580395 ] Josiah Samuel Sathiadass commented on SPARK-8048: - Often constructing a

[jira] [Comment Edited] (SPARK-8287) Filter not push down through Subquery or View

2015-06-10 Thread Li Sheng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14580403#comment-14580403 ] Li Sheng edited comment on SPARK-8287 at 6/10/15 11:16 AM: ---

[jira] [Commented] (SPARK-6797) Add support for YARN cluster mode

2015-06-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14580417#comment-14580417 ] Apache Spark commented on SPARK-6797: - User 'sun-rui' has created a pull request for

[jira] [Assigned] (SPARK-6797) Add support for YARN cluster mode

2015-06-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6797: --- Assignee: Sun Rui (was: Apache Spark) Add support for YARN cluster mode

[jira] [Assigned] (SPARK-6797) Add support for YARN cluster mode

2015-06-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6797: --- Assignee: Apache Spark (was: Sun Rui) Add support for YARN cluster mode

[jira] [Commented] (SPARK-8287) Filter not push down through Subquery or View

2015-06-10 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14580390#comment-14580390 ] Cheng Lian commented on SPARK-8287: --- [~OopsOutOfMemory] Could you please provide the

[jira] [Comment Edited] (SPARK-8287) Filter not push down through Subquery or View

2015-06-10 Thread Li Sheng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14580403#comment-14580403 ] Li Sheng edited comment on SPARK-8287 at 6/10/15 11:11 AM: ---

[jira] [Comment Edited] (SPARK-8287) Filter not push down through Subquery or View

2015-06-10 Thread Li Sheng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14580403#comment-14580403 ] Li Sheng edited comment on SPARK-8287 at 6/10/15 11:20 AM: ---

[jira] [Comment Edited] (SPARK-8287) Filter not push down through Subquery or View

2015-06-10 Thread Li Sheng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14580403#comment-14580403 ] Li Sheng edited comment on SPARK-8287 at 6/10/15 11:19 AM: ---

[jira] [Assigned] (SPARK-8169) Add StopWordsRemover as a transformer

2015-06-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8169: --- Assignee: (was: Apache Spark) Add StopWordsRemover as a transformer

[jira] [Commented] (SPARK-8169) Add StopWordsRemover as a transformer

2015-06-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14580399#comment-14580399 ] Apache Spark commented on SPARK-8169: - User 'hhbyyh' has created a pull request for

[jira] [Commented] (SPARK-8287) Filter not push down through Subquery or View

2015-06-10 Thread Li Sheng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14580403#comment-14580403 ] Li Sheng commented on SPARK-8287: - Sorry , see this: scala sql(select * from

[jira] [Comment Edited] (SPARK-8287) Filter not push down through Subquery or View

2015-06-10 Thread Li Sheng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14580403#comment-14580403 ] Li Sheng edited comment on SPARK-8287 at 6/10/15 11:17 AM: ---

[jira] [Commented] (SPARK-8287) Filter not push down through Subquery or View

2015-06-10 Thread Li Sheng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14580413#comment-14580413 ] Li Sheng commented on SPARK-8287: - I think we can not simply `EliminateSubQueries` in

[jira] [Comment Edited] (SPARK-8275) HistoryServer caches incomplete App UIs

2015-06-10 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8275?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14579273#comment-14579273 ] Steve Loughran edited comment on SPARK-8275 at 6/10/15 11:43 AM:

[jira] [Issue Comment Deleted] (SPARK-1537) Add integration with Yarn's Application Timeline Server

2015-06-10 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated SPARK-1537: -- Comment: was deleted (was: Full application log. Application hasn't actually stopped, which is

[jira] [Commented] (SPARK-7756) Ensure Spark runs clean on IBM Java implementation

2015-06-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7756?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14580237#comment-14580237 ] Apache Spark commented on SPARK-7756: - User 'a-roberts' has created a pull request for

[jira] [Created] (SPARK-8289) Provide a specific stack size with all Java implementations to prevent stack overflows with certain tests

2015-06-10 Thread Adam Roberts (JIRA)
Adam Roberts created SPARK-8289: --- Summary: Provide a specific stack size with all Java implementations to prevent stack overflows with certain tests Key: SPARK-8289 URL:

[jira] [Commented] (SPARK-8288) ScalaReflection should also try apply methods defined in companion objects when inferring schema from a Product type

2015-06-10 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14580244#comment-14580244 ] Cheng Lian commented on SPARK-8288: --- cc [~zzztimbo] ScalaReflection should also try

[jira] [Commented] (SPARK-8286) Rewrite UTF8String in Java and move it into unsafe package.

2015-06-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14580160#comment-14580160 ] Apache Spark commented on SPARK-8286: - User 'rxin' has created a pull request for this

[jira] [Assigned] (SPARK-8286) Rewrite UTF8String in Java and move it into unsafe package.

2015-06-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8286: --- Assignee: Reynold Xin (was: Apache Spark) Rewrite UTF8String in Java and move it into

[jira] [Assigned] (SPARK-8286) Rewrite UTF8String in Java and move it into unsafe package.

2015-06-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8286: --- Assignee: Apache Spark (was: Reynold Xin) Rewrite UTF8String in Java and move it into

[jira] [Updated] (SPARK-7886) Add built-in expressions to FunctionRegistry

2015-06-10 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-7886: --- Assignee: Reynold Xin Add built-in expressions to FunctionRegistry

[jira] [Commented] (SPARK-7886) Add built-in expressions to FunctionRegistry

2015-06-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7886?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14580175#comment-14580175 ] Apache Spark commented on SPARK-7886: - User 'rxin' has created a pull request for this

[jira] [Commented] (SPARK-4176) Support decimals with precision 18 in Parquet

2015-06-10 Thread Rene Treffer (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14580206#comment-14580206 ] Rene Treffer commented on SPARK-4176: - Given that SPARK-7897 loads unsigned bigint as

[jira] [Assigned] (SPARK-4127) Streaming Linear Regression- Python bindings

2015-06-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-4127: --- Assignee: Apache Spark Streaming Linear Regression- Python bindings

[jira] [Assigned] (SPARK-4127) Streaming Linear Regression- Python bindings

2015-06-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-4127: --- Assignee: (was: Apache Spark) Streaming Linear Regression- Python bindings

[jira] [Commented] (SPARK-4127) Streaming Linear Regression- Python bindings

2015-06-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14580507#comment-14580507 ] Apache Spark commented on SPARK-4127: - User 'MechCoder' has created a pull request for

[jira] [Assigned] (SPARK-8289) Provide a specific stack size with all Java implementations to prevent stack overflows with certain tests

2015-06-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8289: --- Assignee: (was: Apache Spark) Provide a specific stack size with all Java

[jira] [Assigned] (SPARK-8289) Provide a specific stack size with all Java implementations to prevent stack overflows with certain tests

2015-06-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8289: --- Assignee: Apache Spark Provide a specific stack size with all Java implementations to

[jira] [Updated] (SPARK-7815) Enable UTF8String to work against memory address directly

2015-06-10 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-7815: --- Summary: Enable UTF8String to work against memory address directly (was: Move UTF8String into Unsafe

[jira] [Created] (SPARK-8286) Rewrite UTF8String in Java and move it into unsafe package.

2015-06-10 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-8286: -- Summary: Rewrite UTF8String in Java and move it into unsafe package. Key: SPARK-8286 URL: https://issues.apache.org/jira/browse/SPARK-8286 Project: Spark Issue

[jira] [Created] (SPARK-8290) spark class command builder need read SPARK_JAVA_OPTS

2015-06-10 Thread Tao Wang (JIRA)
Tao Wang created SPARK-8290: --- Summary: spark class command builder need read SPARK_JAVA_OPTS Key: SPARK-8290 URL: https://issues.apache.org/jira/browse/SPARK-8290 Project: Spark Issue Type: Bug

[jira] [Assigned] (SPARK-8286) Rewrite UTF8String in Java and move it into unsafe package.

2015-06-10 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin reassigned SPARK-8286: -- Assignee: Reynold Xin Rewrite UTF8String in Java and move it into unsafe package.

[jira] [Created] (SPARK-8288) ScalaReflection should also try apply methods defined in companion objects when inferring schema from a Product type

2015-06-10 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-8288: - Summary: ScalaReflection should also try apply methods defined in companion objects when inferring schema from a Product type Key: SPARK-8288 URL:

[jira] [Commented] (SPARK-8287) Filter not push down through Subquery or View

2015-06-10 Thread Li Sheng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14580257#comment-14580257 ] Li Sheng commented on SPARK-8287: - [~marmbrus] [~lian cheng] Filter not push down

[jira] [Created] (SPARK-8287) Filter not push down through Subquery or View

2015-06-10 Thread Li Sheng (JIRA)
Li Sheng created SPARK-8287: --- Summary: Filter not push down through Subquery or View Key: SPARK-8287 URL: https://issues.apache.org/jira/browse/SPARK-8287 Project: Spark Issue Type: Bug

[jira] [Assigned] (SPARK-8290) spark class command builder need read SPARK_JAVA_OPTS

2015-06-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8290: --- Assignee: (was: Apache Spark) spark class command builder need read SPARK_JAVA_OPTS

[jira] [Assigned] (SPARK-8290) spark class command builder need read SPARK_JAVA_OPTS

2015-06-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8290: --- Assignee: Apache Spark spark class command builder need read SPARK_JAVA_OPTS

[jira] [Commented] (SPARK-8290) spark class command builder need read SPARK_JAVA_OPTS

2015-06-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8290?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14580290#comment-14580290 ] Apache Spark commented on SPARK-8290: - User 'WangTaoTheTonic' has created a pull

[jira] [Created] (SPARK-8291) Add parse functionality to LabeledPoint in PySpark

2015-06-10 Thread Manoj Kumar (JIRA)
Manoj Kumar created SPARK-8291: -- Summary: Add parse functionality to LabeledPoint in PySpark Key: SPARK-8291 URL: https://issues.apache.org/jira/browse/SPARK-8291 Project: Spark Issue Type:

[jira] [Created] (SPARK-8292) ShortestPaths run with error result

2015-06-10 Thread Bruce Chen (JIRA)
Bruce Chen created SPARK-8292: - Summary: ShortestPaths run with error result Key: SPARK-8292 URL: https://issues.apache.org/jira/browse/SPARK-8292 Project: Spark Issue Type: Bug

[jira] [Assigned] (SPARK-8291) Add parse functionality to LabeledPoint in PySpark

2015-06-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8291: --- Assignee: Apache Spark Add parse functionality to LabeledPoint in PySpark

[jira] [Commented] (SPARK-7179) Add pattern after show tables to filter desire tablename

2015-06-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14580527#comment-14580527 ] Apache Spark commented on SPARK-7179: - User 'baishuo' has created a pull request for

[jira] [Assigned] (SPARK-7179) Add pattern after show tables to filter desire tablename

2015-06-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7179: --- Assignee: (was: Apache Spark) Add pattern after show tables to filter desire tablename

[jira] [Assigned] (SPARK-8291) Add parse functionality to LabeledPoint in PySpark

2015-06-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8291: --- Assignee: (was: Apache Spark) Add parse functionality to LabeledPoint in PySpark

[jira] [Commented] (SPARK-8291) Add parse functionality to LabeledPoint in PySpark

2015-06-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14580546#comment-14580546 ] Apache Spark commented on SPARK-8291: - User 'MechCoder' has created a pull request for

[jira] [Updated] (SPARK-8292) ShortestPaths run with error result

2015-06-10 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-8292: - Priority: Minor (was: Major) Target Version/s: (was: 1.3.1) Fix Version/s: (was:

[jira] [Assigned] (SPARK-7179) Add pattern after show tables to filter desire tablename

2015-06-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7179: --- Assignee: Apache Spark Add pattern after show tables to filter desire tablename

[jira] [Updated] (SPARK-8292) ShortestPaths run with error result

2015-06-10 Thread Bruce Chen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bruce Chen updated SPARK-8292: -- Attachment: ShortestPaths.patch ShortestPaths run with error result

[jira] [Commented] (SPARK-8272) BigDecimal in parquet not working

2015-06-10 Thread Liang-Chi Hsieh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8272?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14580583#comment-14580583 ] Liang-Chi Hsieh commented on SPARK-8272: Can you provide more information? Such as

[jira] [Commented] (SPARK-8284) Regualarized Extreme Learning Machine for MLLib

2015-06-10 Thread Rakesh Chalasani (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8284?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14580602#comment-14580602 ] Rakesh Chalasani commented on SPARK-8284: - In my experience, the performance and

[jira] [Assigned] (SPARK-7961) Redesign SQLConf for better error message reporting

2015-06-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7961?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7961: --- Assignee: Apache Spark Redesign SQLConf for better error message reporting

[jira] [Assigned] (SPARK-7961) Redesign SQLConf for better error message reporting

2015-06-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7961?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7961: --- Assignee: (was: Apache Spark) Redesign SQLConf for better error message reporting

[jira] [Updated] (SPARK-8273) Driver hangs up when yarn shutdown in client mode

2015-06-10 Thread Guoqiang Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guoqiang Li updated SPARK-8273: --- Affects Version/s: 1.4.0 1.3.1 Driver hangs up when yarn shutdown in client

[jira] [Assigned] (SPARK-8018) KMeans should accept initial cluster centers as param

2015-06-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8018: --- Assignee: Apache Spark (was: Meethu Mathew) KMeans should accept initial cluster centers

[jira] [Commented] (SPARK-8018) KMeans should accept initial cluster centers as param

2015-06-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14580128#comment-14580128 ] Apache Spark commented on SPARK-8018: - User 'FlytxtRnD' has created a pull request for

[jira] [Assigned] (SPARK-8018) KMeans should accept initial cluster centers as param

2015-06-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8018: --- Assignee: Meethu Mathew (was: Apache Spark) KMeans should accept initial cluster centers

[jira] [Updated] (SPARK-8290) spark class command builder need read SPARK_JAVA_OPTS and SPARK_DRIVER_MEMORY properly

2015-06-10 Thread Tao Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Wang updated SPARK-8290: Description: SPARK_JAVA_OPTS was missed in reconstructing the launcher part, we should add it back so

[jira] [Resolved] (SPARK-8212) math function: e

2015-06-10 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-8212. Resolution: Fixed Fix Version/s: 1.5.0 math function: e

[jira] [Commented] (SPARK-8142) Spark Job Fails with ResultTask ClassCastException

2015-06-10 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14580695#comment-14580695 ] Marcelo Vanzin commented on SPARK-8142: --- bq. If I mark my spark core as provided

[jira] [Updated] (SPARK-8290) spark class command builder need read SPARK_JAVA_OPTS and SPARK_DRIVER_MEMORY properly

2015-06-10 Thread Tao Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Wang updated SPARK-8290: Summary: spark class command builder need read SPARK_JAVA_OPTS and SPARK_DRIVER_MEMORY properly (was:

[jira] [Updated] (SPARK-8290) spark class command builder need read SPARK_JAVA_OPTS and SPARK_DRIVER_MEMORY properly

2015-06-10 Thread Tao Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Wang updated SPARK-8290: Description: SPARK_JAVA_OPTS was missed in reconstructing the launcher part, we should add it back so

[jira] [Commented] (SPARK-8142) Spark Job Fails with ResultTask ClassCastException

2015-06-10 Thread Dev Lakhani (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14580689#comment-14580689 ] Dev Lakhani commented on SPARK-8142: To clarify [~srowen] 1) I meant the other way

[jira] [Commented] (SPARK-8142) Spark Job Fails with ResultTask ClassCastException

2015-06-10 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14580719#comment-14580719 ] Sean Owen commented on SPARK-8142: -- (FWIW CDH ships the current latest release. You can

[jira] [Commented] (SPARK-8142) Spark Job Fails with ResultTask ClassCastException

2015-06-10 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14580670#comment-14580670 ] Marcelo Vanzin commented on SPARK-8142: --- So, using {{userClassPathFirst}} is tricky

[jira] [Commented] (SPARK-5575) Artificial neural networks for MLlib deep learning

2015-06-10 Thread Janani Mukundan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14580661#comment-14580661 ] Janani Mukundan commented on SPARK-5575: Hi Alexander, I forked your latest

[jira] [Commented] (SPARK-8142) Spark Job Fails with ResultTask ClassCastException

2015-06-10 Thread Dev Lakhani (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14580730#comment-14580730 ] Dev Lakhani commented on SPARK-8142: Hi [~vanzin] bq. if you want to use the

[jira] [Updated] (SPARK-8212) math function: e

2015-06-10 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-8212: --- Labels: missing-python (was: ) math function: e Key: SPARK-8212

[jira] [Commented] (SPARK-6284) Support framework authentication and role in Mesos framework

2015-06-10 Thread DarinJ (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6284?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14580780#comment-14580780 ] DarinJ commented on SPARK-6284: --- +1 we're currently patching spark with similar code to make

[jira] [Resolved] (SPARK-8215) math function: pi

2015-06-10 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-8215. Resolution: Fixed Fix Version/s: 1.5.0 math function: pi -

[jira] [Updated] (SPARK-8215) math function: pi

2015-06-10 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-8215: --- Labels: missing-python (was: ) math function: pi - Key:

[jira] [Updated] (SPARK-8295) SparkContext shut down in Spark Project Streaming test suite

2015-06-10 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-8295: - Priority: Minor (was: Blocker) Definitely not a blocker, but worth tracking down if it can be reproduced

[jira] [Created] (SPARK-8297) Scheduler backend is not notified in case node fails in YARN

2015-06-10 Thread Mridul Muralidharan (JIRA)
Mridul Muralidharan created SPARK-8297: -- Summary: Scheduler backend is not notified in case node fails in YARN Key: SPARK-8297 URL: https://issues.apache.org/jira/browse/SPARK-8297 Project:

[jira] [Closed] (SPARK-8282) Make number of threads used in RBackend configurable

2015-06-10 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-8282. Resolution: Fixed Fix Version/s: 1.5.0 Assignee: Hossein Falaki Target

[jira] [Created] (SPARK-8296) Not able to load Dataframe using Python throws py4j.protocol.Py4JJavaError

2015-06-10 Thread ABHISHEK CHOUDHARY (JIRA)
ABHISHEK CHOUDHARY created SPARK-8296: - Summary: Not able to load Dataframe using Python throws py4j.protocol.Py4JJavaError Key: SPARK-8296 URL: https://issues.apache.org/jira/browse/SPARK-8296

[jira] [Updated] (SPARK-8297) Scheduler backend is not notified in case node fails in YARN

2015-06-10 Thread Mridul Muralidharan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan updated SPARK-8297: --- Assignee: (was: Mridul Muralidharan) Scheduler backend is not notified in case

[jira] [Commented] (SPARK-8064) Upgrade Hive to 1.2

2015-06-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8064?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14580886#comment-14580886 ] Apache Spark commented on SPARK-8064: - User 'steveloughran' has created a pull request

[jira] [Commented] (SPARK-6419) GenerateOrdering does not support BinaryType and complex types.

2015-06-10 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6419?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14580900#comment-14580900 ] Davies Liu commented on SPARK-6419: --- Fixed by SPARK-7956 GenerateOrdering does not

[jira] [Resolved] (SPARK-7996) Deprecate the developer api SparkEnv.actorSystem

2015-06-10 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-7996. Resolution: Fixed Fix Version/s: 1.5.0 Assignee: Ilya Ganelin Deprecate the

[jira] [Commented] (SPARK-7996) Deprecate the developer api SparkEnv.actorSystem

2015-06-10 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7996?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14580912#comment-14580912 ] Reynold Xin commented on SPARK-7996: [~ilganeli] that one is for later versions.

[jira] [Assigned] (SPARK-8103) DAGScheduler should not launch multiple concurrent attempts for one stage on fetch failures

2015-06-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8103: --- Assignee: Apache Spark (was: Imran Rashid) DAGScheduler should not launch multiple

[jira] [Closed] (SPARK-7261) Change default log level to WARN in the REPL

2015-06-10 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-7261. Resolution: Fixed Fix Version/s: 1.5.0 Change default log level to WARN in the REPL

[jira] [Closed] (SPARK-7527) Wrong detection of REPL mode in ClosureCleaner

2015-06-10 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-7527. Resolution: Fixed Fix Version/s: 1.5.0 Assignee: Shixiong Zhu Target Version/s:

[jira] [Closed] (SPARK-5162) Python yarn-cluster mode

2015-06-10 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5162?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-5162. Resolution: Fixed Fix Version/s: 1.4.0 Assignee: Lianhui Wang Target Version/s:

[jira] [Closed] (SPARK-5479) PySpark on yarn mode need to support non-local python files

2015-06-10 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5479?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-5479. Resolution: Fixed Fix Version/s: 1.5.0 Assignee: Marcelo Vanzin Target

[jira] [Closed] (SPARK-8290) spark class command builder need read SPARK_JAVA_OPTS and SPARK_DRIVER_MEMORY properly

2015-06-10 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-8290. Resolution: Fixed Fix Version/s: 1.5.0 Assignee: Tao Wang Target Version/s:

[jira] [Updated] (SPARK-8290) spark class command builder need read SPARK_JAVA_OPTS and SPARK_DRIVER_MEMORY properly

2015-06-10 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-8290: - Affects Version/s: 1.3.0 spark class command builder need read SPARK_JAVA_OPTS and SPARK_DRIVER_MEMORY

[jira] [Updated] (SPARK-8296) Not able to load Dataframe using Python throws py4j.protocol.Py4JJavaError

2015-06-10 Thread ABHISHEK CHOUDHARY (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8296?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ABHISHEK CHOUDHARY updated SPARK-8296: -- Description: While trying to load a json file using sqlcontext in prebuilt

[jira] [Assigned] (SPARK-7186) Decouple internal Row from external Row

2015-06-10 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu reassigned SPARK-7186: - Assignee: Davies Liu Decouple internal Row from external Row

[jira] [Commented] (SPARK-8103) DAGScheduler should not launch multiple concurrent attempts for one stage on fetch failures

2015-06-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14581019#comment-14581019 ] Apache Spark commented on SPARK-8103: - User 'squito' has created a pull request for

[jira] [Assigned] (SPARK-8103) DAGScheduler should not launch multiple concurrent attempts for one stage on fetch failures

2015-06-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8103: --- Assignee: Imran Rashid (was: Apache Spark) DAGScheduler should not launch multiple

[jira] [Commented] (SPARK-8297) Scheduler backend is not notified in case node fails in YARN

2015-06-10 Thread Mridul Muralidharan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14581038#comment-14581038 ] Mridul Muralidharan commented on SPARK-8297: Spark on mesos handles this

[jira] [Updated] (SPARK-8297) Scheduler backend is not notified in case node fails in YARN

2015-06-10 Thread Mridul Muralidharan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan updated SPARK-8297: --- Affects Version/s: 1.5.0 Scheduler backend is not notified in case node fails in

[jira] [Resolved] (SPARK-6419) GenerateOrdering does not support BinaryType and complex types.

2015-06-10 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-6419. --- Resolution: Fixed Fix Version/s: 1.5.0 GenerateOrdering does not support BinaryType and

[jira] [Created] (SPARK-8293) Add high-level java docs to important YARN classes

2015-06-10 Thread Andrew Or (JIRA)
Andrew Or created SPARK-8293: Summary: Add high-level java docs to important YARN classes Key: SPARK-8293 URL: https://issues.apache.org/jira/browse/SPARK-8293 Project: Spark Issue Type:

[jira] [Created] (SPARK-8294) Break down large methods in YARN code

2015-06-10 Thread Andrew Or (JIRA)
Andrew Or created SPARK-8294: Summary: Break down large methods in YARN code Key: SPARK-8294 URL: https://issues.apache.org/jira/browse/SPARK-8294 Project: Spark Issue Type: Sub-task

  1   2   >