[jira] [Commented] (SPARK-12239) ​SparkR - Not distributing SparkR module in YARN

[ https://issues.apache.org/jira/browse/SPARK-12239?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15081688#comment-15081688 ] Sen Fang commented on SPARK-12239: -- A quick note: I tested the specific case fix I proposed before and

[jira] [Commented] (SPARK-5159) Thrift server does not respect hive.server2.enable.doAs=true

[ https://issues.apache.org/jira/browse/SPARK-5159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15074462#comment-15074462 ] Sen Fang commented on SPARK-5159: - As of Spark 1.5.2, we have a similar issue that might be related to

[jira] [Commented] (SPARK-12239) ​SparkR - Not distributing SparkR module in YARN

[ https://issues.apache.org/jira/browse/SPARK-12239?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15073138#comment-15073138 ] Sen Fang commented on SPARK-12239: -- Thanks [~sunrui] for your suggestions. Both sound very reasonable to

[jira] [Commented] (SPARK-12239) ​SparkR - Not distributing SparkR module in YARN

[ https://issues.apache.org/jira/browse/SPARK-12239?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15072029#comment-15072029 ] Sen Fang commented on SPARK-12239: -- I recently also got hit by this issue and I would think we can make

[jira] [Created] (SPARK-12526) `ifelse`, `when`, `otherwise` unable to take Column as value

Sen Fang created SPARK-12526: Summary: `ifelse`, `when`, `otherwise` unable to take Column as value Key: SPARK-12526 URL: https://issues.apache.org/jira/browse/SPARK-12526 Project: Spark Issue

[jira] [Commented] (SPARK-2336) Approximate k-NN Models for MLLib

[ https://issues.apache.org/jira/browse/SPARK-2336?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15021527#comment-15021527 ] Sen Fang commented on SPARK-2336: - I finally took a crack on the hybrid spill tree for kNN and results so

[jira] [Created] (SPARK-11906) Speculation Tasks Cause ProgressBar UI Overflow

Sen Fang created SPARK-11906: Summary: Speculation Tasks Cause ProgressBar UI Overflow Key: SPARK-11906 URL: https://issues.apache.org/jira/browse/SPARK-11906 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-11263) lintr Throws Warnings on Commented Code in Documentation

Sen Fang created SPARK-11263: Summary: lintr Throws Warnings on Commented Code in Documentation Key: SPARK-11263 URL: https://issues.apache.org/jira/browse/SPARK-11263 Project: Spark Issue Type:

[jira] [Created] (SPARK-11244) sparkR.stop doesn't clean up .sparkRSQLsc in environment

Sen Fang created SPARK-11244: Summary: sparkR.stop doesn't clean up .sparkRSQLsc in environment Key: SPARK-11244 URL: https://issues.apache.org/jira/browse/SPARK-11244 Project: Spark Issue Type:

[jira] [Commented] (SPARK-9999) RDD-like API on top of Catalyst/DataFrame

[ https://issues.apache.org/jira/browse/SPARK-?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14936268#comment-14936268 ] Sen Fang commented on SPARK-: - Another idea is do something similar to F# TypeProvider approach:

[jira] [Commented] (SPARK-8939) YARN EC2 default setting fails with IllegalArgumentException

[ https://issues.apache.org/jira/browse/SPARK-8939?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14933233#comment-14933233 ] Sen Fang commented on SPARK-8939: - FYI, PR has been merged into branch-1.5 in spark-ec2 repo:

[jira] [Commented] (SPARK-8939) YARN EC2 default setting fails with IllegalArgumentException

[ https://issues.apache.org/jira/browse/SPARK-8939?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14744792#comment-14744792 ] Sen Fang commented on SPARK-8939: - The issue seems to lie in:

[jira] [Created] (SPARK-10543) Peak Execution Memory Quantile should be Pre-task Basis

Sen Fang created SPARK-10543: Summary: Peak Execution Memory Quantile should be Pre-task Basis Key: SPARK-10543 URL: https://issues.apache.org/jira/browse/SPARK-10543 Project: Spark Issue Type:

[jira] [Updated] (SPARK-10543) Peak Execution Memory Quantile should be Per-task Basis

[ https://issues.apache.org/jira/browse/SPARK-10543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sen Fang updated SPARK-10543: - Summary: Peak Execution Memory Quantile should be Per-task Basis (was: Peak Execution Memory Quantile

[jira] [Commented] (SPARK-3533) Add saveAsTextFileByKey() method to RDDs

[ https://issues.apache.org/jira/browse/SPARK-3533?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14703626#comment-14703626 ] Sen Fang commented on SPARK-3533: - I also have a working implementation based on Hadoop 1

[jira] [Created] (SPARK-8443) GenerateMutableProjection Exceeds JVM Code Size Limits

Sen Fang created SPARK-8443: --- Summary: GenerateMutableProjection Exceeds JVM Code Size Limits Key: SPARK-8443 URL: https://issues.apache.org/jira/browse/SPARK-8443 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-8443) GenerateMutableProjection Exceeds JVM Code Size Limits

[ https://issues.apache.org/jira/browse/SPARK-8443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sen Fang updated SPARK-8443: Description: GenerateMutableProjection put all expressions columns into a single apply function. When

[jira] [Commented] (SPARK-2336) Approximate k-NN Models for MLLib

[ https://issues.apache.org/jira/browse/SPARK-2336?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14526153#comment-14526153 ] Sen Fang commented on SPARK-2336: - Hey Longbao, great to hear from you. To my best

[jira] [Commented] (SPARK-2336) Approximate k-NN Models for MLLib

[ https://issues.apache.org/jira/browse/SPARK-2336?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14396306#comment-14396306 ] Sen Fang commented on SPARK-2336: - I'm tentatively going to give the hybrid spilltree