[jira] [Comment Edited] (SPARK-5992) Locality Sensitive Hashing (LSH) for MLlib

2016-08-22 Thread Yun Ni (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5992?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15432186#comment-15432186 ] Yun Ni edited comment on SPARK-5992 at 8/23/16 5:50 AM: Hi, We are engineers from

[jira] [Commented] (SPARK-5992) Locality Sensitive Hashing (LSH) for MLlib

2016-08-22 Thread Yun Ni (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5992?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15432186#comment-15432186 ] Yun Ni commented on SPARK-5992: --- Hi, We are engineers from Uber. Here is our design doc for LSH:

[jira] [Commented] (SPARK-11638) Run Spark on Mesos with bridge networking

2016-08-22 Thread Liam Fisk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15432163#comment-15432163 ] Liam Fisk commented on SPARK-11638: --- Just mirroring what I said on SPARK-4563 about the lack of support

[jira] [Commented] (SPARK-11638) Run Spark on Mesos with bridge networking

2016-08-22 Thread Liam Fisk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15432151#comment-15432151 ] Liam Fisk commented on SPARK-11638: --- This ticket appears to be related to SPARK-4563. > Run Spark on

[jira] [Commented] (SPARK-4563) Allow spark driver to bind to different ip then advertise ip

2016-08-22 Thread Liam Fisk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15432149#comment-15432149 ] Liam Fisk commented on SPARK-4563: -- This ticket appears to be related to SPARK-11638 > Allow spark

[jira] [Commented] (SPARK-17195) Dealing with JDBC column nullability when it is not reliable

2016-08-22 Thread Jason Moore (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15432129#comment-15432129 ] Jason Moore commented on SPARK-17195: - > I think it might be sensible to support this by implementing

[jira] [Commented] (SPARK-4563) Allow spark driver to bind to different ip then advertise ip

2016-08-22 Thread Liam Fisk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15432128#comment-15432128 ] Liam Fisk commented on SPARK-4563: -- It also makes life difficult for OSX users. Docker for Mac uses xhyve

[jira] [Commented] (SPARK-4563) Allow spark driver to bind to different ip then advertise ip

2016-08-22 Thread Reece Robinson (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15432109#comment-15432109 ] Reece Robinson commented on SPARK-4563: --- +1 I also disagree with the minor rating. This is essential

[jira] [Commented] (SPARK-17195) Dealing with JDBC column nullability when it is not reliable

2016-08-22 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15432103#comment-15432103 ] Hyukjin Kwon commented on SPARK-17195: -- I think if Teradata JDBC gives an incorrect schema (about

[jira] [Commented] (SPARK-4563) Allow spark driver to bind to different ip then advertise ip

2016-08-22 Thread Liam Fisk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15432089#comment-15432089 ] Liam Fisk commented on SPARK-4563: -- Further to my comment, I disagree with the "minor" rating of this

[jira] [Commented] (SPARK-4563) Allow spark driver to bind to different ip then advertise ip

2016-08-22 Thread Liam Fisk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15432086#comment-15432086 ] Liam Fisk commented on SPARK-4563: -- +1 for me I am running into this problem when I run `spark-submit

[jira] [Created] (SPARK-17198) ORC fixed char literal filter does not work

2016-08-22 Thread tuming (JIRA)
tuming created SPARK-17198: -- Summary: ORC fixed char literal filter does not work Key: SPARK-17198 URL: https://issues.apache.org/jira/browse/SPARK-17198 Project: Spark Issue Type: Bug

[jira] [Assigned] (SPARK-17197) PySpark LiR/LoR supports tree aggregation level configurable

2016-08-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17197: Assignee: Apache Spark > PySpark LiR/LoR supports tree aggregation level configurable >

[jira] [Commented] (SPARK-17197) PySpark LiR/LoR supports tree aggregation level configurable

2016-08-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15432072#comment-15432072 ] Apache Spark commented on SPARK-17197: -- User 'yanboliang' has created a pull request for this issue:

[jira] [Assigned] (SPARK-17197) PySpark LiR/LoR supports tree aggregation level configurable

2016-08-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17197: Assignee: (was: Apache Spark) > PySpark LiR/LoR supports tree aggregation level

[jira] [Assigned] (SPARK-15815) Hang while enable blacklistExecutor and DynamicExecutorAllocator

2016-08-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15815: Assignee: Apache Spark > Hang while enable blacklistExecutor and DynamicExecutorAllocator

[jira] [Commented] (SPARK-15815) Hang while enable blacklistExecutor and DynamicExecutorAllocator

2016-08-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15432068#comment-15432068 ] Apache Spark commented on SPARK-15815: -- User 'suyanNone' has created a pull request for this issue:

[jira] [Assigned] (SPARK-15815) Hang while enable blacklistExecutor and DynamicExecutorAllocator

2016-08-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15815: Assignee: (was: Apache Spark) > Hang while enable blacklistExecutor and

[jira] [Updated] (SPARK-17197) PySpark LiR/LoR supports tree aggregation level configurable

2016-08-22 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-17197: Priority: Minor (was: Major) > PySpark LiR/LoR supports tree aggregation level configurable >

[jira] [Created] (SPARK-17197) PySpark LiR/LoR supports tree aggregation level configurable

2016-08-22 Thread Yanbo Liang (JIRA)
Yanbo Liang created SPARK-17197: --- Summary: PySpark LiR/LoR supports tree aggregation level configurable Key: SPARK-17197 URL: https://issues.apache.org/jira/browse/SPARK-17197 Project: Spark

[jira] [Commented] (SPARK-16334) [SQL] SQL query on parquet table java.lang.ArrayIndexOutOfBoundsException

2016-08-22 Thread Egor Pahomov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15432040#comment-15432040 ] Egor Pahomov commented on SPARK-16334: -- (just reason for reopen) > [SQL] SQL query on parquet table

[jira] [Reopened] (SPARK-16334) [SQL] SQL query on parquet table java.lang.ArrayIndexOutOfBoundsException

2016-08-22 Thread Egor Pahomov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Egor Pahomov reopened SPARK-16334: -- Seems like a lot of people still have a problem even after suggested fix > [SQL] SQL query on

[jira] [Updated] (SPARK-17196) Can not initializeing SparkConent plus Kerberos env

2016-08-22 Thread sangshenghong (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sangshenghong updated SPARK-17196: -- Description: When we submit a application and get the following exception :

[jira] [Created] (SPARK-17196) Can not initializeing SparkConent plus Kerberos env

2016-08-22 Thread sangshenghong (JIRA)
sangshenghong created SPARK-17196: - Summary: Can not initializeing SparkConent plus Kerberos env Key: SPARK-17196 URL: https://issues.apache.org/jira/browse/SPARK-17196 Project: Spark Issue

[jira] [Updated] (SPARK-17157) Add multiclass logistic regression SparkR Wrapper

2016-08-22 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated SPARK-17157: --- Issue Type: Sub-task (was: New Feature) Parent: SPARK-16442 > Add multiclass logistic

[jira] [Commented] (SPARK-17174) Provide support for Timestamp type Column in add_months function to return HH:mm:ss

2016-08-22 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17174?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15431965#comment-15431965 ] Hyukjin Kwon commented on SPARK-17174: -- I just took a look for others as references. It seems Hive

[jira] [Created] (SPARK-17195) Dealing with JDBC column nullability when it is not reliable

2016-08-22 Thread Jason Moore (JIRA)
Jason Moore created SPARK-17195: --- Summary: Dealing with JDBC column nullability when it is not reliable Key: SPARK-17195 URL: https://issues.apache.org/jira/browse/SPARK-17195 Project: Spark

[jira] [Resolved] (SPARK-17182) CollectList and CollectSet should be marked as non-deterministic

2016-08-22 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17182?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-17182. - Resolution: Fixed Fix Version/s: 2.1.0 2.0.1 > CollectList and

[jira] [Commented] (SPARK-17184) Replace ByteBuf with InputStream

2016-08-22 Thread Guoqiang Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15431903#comment-15431903 ] Guoqiang Li commented on SPARK-17184: - OK, I'll post the detailed design document later. > Replace

[jira] [Assigned] (SPARK-17194) When emitting SQL for string literals Spark should use single quotes, not double

2016-08-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17194: Assignee: Apache Spark (was: Josh Rosen) > When emitting SQL for string literals Spark

[jira] [Assigned] (SPARK-17194) When emitting SQL for string literals Spark should use single quotes, not double

2016-08-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17194: Assignee: Josh Rosen (was: Apache Spark) > When emitting SQL for string literals Spark

[jira] [Commented] (SPARK-17194) When emitting SQL for string literals Spark should use single quotes, not double

2016-08-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15431873#comment-15431873 ] Apache Spark commented on SPARK-17194: -- User 'JoshRosen' has created a pull request for this issue:

[jira] [Assigned] (SPARK-17194) When emitting SQL for string literals Spark should use single quotes, not double

2016-08-22 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen reassigned SPARK-17194: -- Assignee: Josh Rosen > When emitting SQL for string literals Spark should use single quotes,

[jira] [Created] (SPARK-17194) When emitting SQL for string literals, Spark should use single quotes, not double

2016-08-22 Thread Josh Rosen (JIRA)
Josh Rosen created SPARK-17194: -- Summary: When emitting SQL for string literals, Spark should use single quotes, not double Key: SPARK-17194 URL: https://issues.apache.org/jira/browse/SPARK-17194

[jira] [Updated] (SPARK-17194) When emitting SQL for string literals Spark should use single quotes, not double

2016-08-22 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-17194: --- Summary: When emitting SQL for string literals Spark should use single quotes, not double (was:

[jira] [Resolved] (SPARK-16577) Add check-cran script to Jenkins

2016-08-22 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-16577. --- Resolution: Fixed Fix Version/s: 2.1.0 2.0.1 Issue

[jira] [Resolved] (SPARK-17144) Removal of useless CreateHiveTableAsSelectLogicalPlan

2016-08-22 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-17144. - Resolution: Fixed Fix Version/s: 2.1.0 Issue resolved by pull request 14707

[jira] [Updated] (SPARK-17144) Removal of useless CreateHiveTableAsSelectLogicalPlan

2016-08-22 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-17144: Assignee: Xiao Li > Removal of useless CreateHiveTableAsSelectLogicalPlan >

[jira] [Updated] (SPARK-15767) Decision Tree Regression wrapper in SparkR

2016-08-22 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-15767: -- Shepherd: (was: Joseph K. Bradley) > Decision Tree Regression wrapper in SparkR >

[jira] [Resolved] (SPARK-16550) Caching data with replication doesn't replicate data

2016-08-22 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-16550. - Resolution: Fixed Assignee: Eric Liang (was: Josh Rosen) Fix Version/s: 2.1.0

[jira] [Resolved] (SPARK-17042) Repl-defined classes cannot be replicated

2016-08-22 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-17042. - Resolution: Fixed Assignee: Eric Liang Fix Version/s: 2.1.0

[jira] [Closed] (SPARK-16566) Bug in SparseMatrix multiplication with SparseVector

2016-08-22 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley closed SPARK-16566. - Resolution: Duplicate Linking existing JIRA which this one is duplicating. Could you

[jira] [Commented] (SPARK-16963) Change Source API so that sources do not need to keep unbounded state

2016-08-22 Thread Frederick Reiss (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15431779#comment-15431779 ] Frederick Reiss commented on SPARK-16963: - The proposed changes in the attached PR are now ready

[jira] [Assigned] (SPARK-16962) Unsafe accesses (Platform.getLong()) not supported on unaligned boundaries in SPARC/Solaris

2016-08-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16962?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16962: Assignee: Apache Spark > Unsafe accesses (Platform.getLong()) not supported on unaligned

[jira] [Commented] (SPARK-16962) Unsafe accesses (Platform.getLong()) not supported on unaligned boundaries in SPARC/Solaris

2016-08-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16962?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15431762#comment-15431762 ] Apache Spark commented on SPARK-16962: -- User 'sumansomasundar' has created a pull request for this

[jira] [Assigned] (SPARK-16962) Unsafe accesses (Platform.getLong()) not supported on unaligned boundaries in SPARC/Solaris

2016-08-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16962?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16962: Assignee: (was: Apache Spark) > Unsafe accesses (Platform.getLong()) not supported on

[jira] [Resolved] (SPARK-17162) Range does not support SQL generation

2016-08-22 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17162?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-17162. - Resolution: Fixed Assignee: Eric Liang Fix Version/s: 2.1.0

[jira] [Updated] (SPARK-17099) Incorrect result when HAVING clause is added to group by query

2016-08-22 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-17099: --- Target Version/s: 2.0.1, 2.1.0 Fix Version/s: (was: 2.1.0) > Incorrect result when HAVING

[jira] [Commented] (SPARK-17042) Repl-defined classes cannot be replicated

2016-08-22 Thread Eric Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15431616#comment-15431616 ] Eric Liang commented on SPARK-17042: Yeah, my bad. I was trying to split this up but it turns out to

[jira] [Assigned] (SPARK-17042) Repl-defined classes cannot be replicated

2016-08-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17042: Assignee: Apache Spark > Repl-defined classes cannot be replicated >

[jira] [Assigned] (SPARK-17042) Repl-defined classes cannot be replicated

2016-08-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17042: Assignee: (was: Apache Spark) > Repl-defined classes cannot be replicated >

[jira] [Commented] (SPARK-17042) Repl-defined classes cannot be replicated

2016-08-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15431614#comment-15431614 ] Apache Spark commented on SPARK-17042: -- User 'ericl' has created a pull request for this issue:

[jira] [Assigned] (SPARK-17193) HadoopRDD NPE at DEBUG log level when getLocationInfo == null

2016-08-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17193: Assignee: Apache Spark (was: Sean Owen) > HadoopRDD NPE at DEBUG log level when

[jira] [Assigned] (SPARK-17193) HadoopRDD NPE at DEBUG log level when getLocationInfo == null

2016-08-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17193: Assignee: Sean Owen (was: Apache Spark) > HadoopRDD NPE at DEBUG log level when

[jira] [Commented] (SPARK-17193) HadoopRDD NPE at DEBUG log level when getLocationInfo == null

2016-08-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15431585#comment-15431585 ] Apache Spark commented on SPARK-17193: -- User 'srowen' has created a pull request for this issue:

[jira] [Created] (SPARK-17193) HadoopRDD NPE at DEBUG log level when getLocationInfo == null

2016-08-22 Thread Sean Owen (JIRA)
Sean Owen created SPARK-17193: - Summary: HadoopRDD NPE at DEBUG log level when getLocationInfo == null Key: SPARK-17193 URL: https://issues.apache.org/jira/browse/SPARK-17193 Project: Spark

[jira] [Assigned] (SPARK-17192) Issuing an exception when users specify the partitioning columns without a given schema

2016-08-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17192: Assignee: (was: Apache Spark) > Issuing an exception when users specify the

[jira] [Commented] (SPARK-17192) Issuing an exception when users specify the partitioning columns without a given schema

2016-08-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15431561#comment-15431561 ] Apache Spark commented on SPARK-17192: -- User 'gatorsmile' has created a pull request for this issue:

[jira] [Assigned] (SPARK-17192) Issuing an exception when users specify the partitioning columns without a given schema

2016-08-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17192: Assignee: Apache Spark > Issuing an exception when users specify the partitioning columns

[jira] [Created] (SPARK-17192) Issuing an exception when users specify the partitioning columns without a given schema

2016-08-22 Thread Xiao Li (JIRA)
Xiao Li created SPARK-17192: --- Summary: Issuing an exception when users specify the partitioning columns without a given schema Key: SPARK-17192 URL: https://issues.apache.org/jira/browse/SPARK-17192

[jira] [Updated] (SPARK-16991) Full outer join followed by inner join produces wrong results

2016-08-22 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-16991: - Target Version/s: 2.0.1, 2.1.0 > Full outer join followed by inner join produces wrong results >

[jira] [Commented] (SPARK-17191) Install e1071 R package on Jenkins machines

2016-08-22 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15431537#comment-15431537 ] Shivaram Venkataraman commented on SPARK-17191: --- Thanks Shane ! > Install e1071 R package

[jira] [Closed] (SPARK-17191) Install e1071 R package on Jenkins machines

2016-08-22 Thread shane knapp (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shane knapp closed SPARK-17191. --- > Install e1071 R package on Jenkins machines > --- > >

[jira] [Resolved] (SPARK-17191) Install e1071 R package on Jenkins machines

2016-08-22 Thread shane knapp (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shane knapp resolved SPARK-17191. - Resolution: Fixed > Install e1071 R package on Jenkins machines >

[jira] [Created] (SPARK-17191) Install e1071 R package on Jenkins machines

2016-08-22 Thread Shivaram Venkataraman (JIRA)
Shivaram Venkataraman created SPARK-17191: - Summary: Install e1071 R package on Jenkins machines Key: SPARK-17191 URL: https://issues.apache.org/jira/browse/SPARK-17191 Project: Spark

[jira] [Comment Edited] (SPARK-16962) Unsafe accesses (Platform.getLong()) not supported on unaligned boundaries in SPARC/Solaris

2016-08-22 Thread Suman Somasundar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16962?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15413970#comment-15413970 ] Suman Somasundar edited comment on SPARK-16962 at 8/22/16 8:01 PM: --- I

[jira] [Comment Edited] (SPARK-16578) Configurable hostname for RBackend

2016-08-22 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15431495#comment-15431495 ] Felix Cheung edited comment on SPARK-16578 at 8/22/16 7:52 PM: --- +1 on this.

[jira] [Commented] (SPARK-16578) Configurable hostname for RBackend

2016-08-22 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15431495#comment-15431495 ] Felix Cheung commented on SPARK-16578: -- +1 on this. Some discussions on RBackend API or connect to

[jira] [Commented] (SPARK-16581) Making JVM backend calling functions public

2016-08-22 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15431492#comment-15431492 ] Felix Cheung commented on SPARK-16581: -- Certainly - I don't think we should bite off more than we

[jira] [Commented] (SPARK-17157) Add multiclass logistic regression SparkR Wrapper

2016-08-22 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15431484#comment-15431484 ] Felix Cheung commented on SPARK-17157: -- Sounds like good to have. Please check up the latest changes

[jira] [Resolved] (SPARK-17173) Refactor R mllib for easier ml implementations

2016-08-22 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung resolved SPARK-17173. -- Resolution: Fixed Fix Version/s: 2.1.0 Target Version/s: 2.1.0 > Refactor R

[jira] [Commented] (SPARK-17172) pyspak hiveContext can not create UDF: Py4JJavaError: An error occurred while calling None.org.apache.spark.sql.hive.HiveContext.

2016-08-22 Thread Andrew Davidson (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15431409#comment-15431409 ] Andrew Davidson commented on SPARK-17172: - Hi Sean I forgot about that older jira issue. I never

[jira] [Updated] (SPARK-17174) Provide support for Timestamp type Column in add_months function to return HH:mm:ss

2016-08-22 Thread Xin Ren (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xin Ren updated SPARK-17174: Component/s: SQL > Provide support for Timestamp type Column in add_months function to return > HH:mm:ss

[jira] [Commented] (SPARK-17172) pyspak hiveContext can not create UDF: Py4JJavaError: An error occurred while calling None.org.apache.spark.sql.hive.HiveContext.

2016-08-22 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15431384#comment-15431384 ] Sean Owen commented on SPARK-17172: --- That seems in order then, though there's an error about it. I

[jira] [Commented] (SPARK-6509) MDLP discretizer

2016-08-22 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15431378#comment-15431378 ] Sean Owen commented on SPARK-6509: -- The outcome of many "add X to MLlib" proposals, where it's not clear

[jira] [Commented] (SPARK-17172) pyspak hiveContext can not create UDF: Py4JJavaError: An error occurred while calling None.org.apache.spark.sql.hive.HiveContext.

2016-08-22 Thread Andrew Davidson (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15431371#comment-15431371 ] Andrew Davidson commented on SPARK-17172: - Hi Sean the data center was created using spark-ec2

[jira] [Commented] (SPARK-16495) Add ADMM optimizer in mllib package

2016-08-22 Thread DB Tsai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15431362#comment-15431362 ] DB Tsai commented on SPARK-16495: - This is related to https://issues.apache.org/jira/browse/SPARK-17136

[jira] [Commented] (SPARK-16320) Document G1 heap region's effect on spark 2.0 vs 1.6

2016-08-22 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15431351#comment-15431351 ] Yin Huai commented on SPARK-16320: -- After investigation, this perf issue was caused by GC setting

[jira] [Resolved] (SPARK-16320) Document G1 heap region's effect on spark 2.0 vs 1.6

2016-08-22 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-16320. -- Resolution: Fixed Fix Version/s: 2.1.0 2.0.1 Issue resolved by pull request

[jira] [Assigned] (SPARK-16577) Add check-cran script to Jenkins

2016-08-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16577: Assignee: Shivaram Venkataraman (was: Apache Spark) > Add check-cran script to Jenkins >

[jira] [Commented] (SPARK-16577) Add check-cran script to Jenkins

2016-08-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15431344#comment-15431344 ] Apache Spark commented on SPARK-16577: -- User 'shivaram' has created a pull request for this issue:

[jira] [Assigned] (SPARK-16577) Add check-cran script to Jenkins

2016-08-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16577: Assignee: Apache Spark (was: Shivaram Venkataraman) > Add check-cran script to Jenkins >

[jira] [Commented] (SPARK-6509) MDLP discretizer

2016-08-22 Thread Barry Becker (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15431341#comment-15431341 ] Barry Becker commented on SPARK-6509: - I may have missed the reasoning somewhere, but why was this

[jira] [Commented] (SPARK-12394) Support writing out pre-hash-partitioned data and exploit that in join optimizations to avoid shuffle (i.e. bucketing in Hive)

2016-08-22 Thread Alexander Tronchin-James (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12394?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15431322#comment-15431322 ] Alexander Tronchin-James commented on SPARK-12394: -- Where can we read about/contribute

[jira] [Comment Edited] (SPARK-13030) Change OneHotEncoder to Estimator

2016-08-22 Thread Nick Pentreath (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13030?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15431319#comment-15431319 ] Nick Pentreath edited comment on SPARK-13030 at 8/22/16 6:08 PM: - Yes I

[jira] [Commented] (SPARK-13030) Change OneHotEncoder to Estimator

2016-08-22 Thread Nick Pentreath (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13030?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15431319#comment-15431319 ] Nick Pentreath commented on SPARK-13030: Yes I also agree OHE needs to be an {{Estimator}} in

[jira] [Commented] (SPARK-11328) Provide more informative error message when direct parquet output committer is used and there is a file already exists error.

2016-08-22 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11328?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15431275#comment-15431275 ] Yin Huai commented on SPARK-11328: -- Actually, the JIRA is meant to provide more information in the error

[jira] [Assigned] (SPARK-17190) Removal of HiveSharedState

2016-08-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17190: Assignee: Apache Spark > Removal of HiveSharedState > -- > >

[jira] [Assigned] (SPARK-17190) Removal of HiveSharedState

2016-08-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17190: Assignee: (was: Apache Spark) > Removal of HiveSharedState >

[jira] [Commented] (SPARK-17190) Removal of HiveSharedState

2016-08-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15431251#comment-15431251 ] Apache Spark commented on SPARK-17190: -- User 'gatorsmile' has created a pull request for this issue:

[jira] [Updated] (SPARK-17190) Removal of HiveSharedState

2016-08-22 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-17190: Issue Type: Improvement (was: Bug) > Removal of HiveSharedState > -- > >

[jira] [Created] (SPARK-17190) Removal of HiveSharedState

2016-08-22 Thread Xiao Li (JIRA)
Xiao Li created SPARK-17190: --- Summary: Removal of HiveSharedState Key: SPARK-17190 URL: https://issues.apache.org/jira/browse/SPARK-17190 Project: Spark Issue Type: Bug Components: SQL

[jira] [Commented] (SPARK-17189) [MINOR] Looses the interface from UnsafeRow to InternalRow in AggregationIterator if UnsafeRow specific method is not used

2016-08-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17189?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15431239#comment-15431239 ] Apache Spark commented on SPARK-17189: -- User 'clockfly' has created a pull request for this issue:

[jira] [Assigned] (SPARK-17189) [MINOR] Looses the interface from UnsafeRow to InternalRow in AggregationIterator if UnsafeRow specific method is not used

2016-08-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17189: Assignee: (was: Apache Spark) > [MINOR] Looses the interface from UnsafeRow to

[jira] [Assigned] (SPARK-17189) [MINOR] Looses the interface from UnsafeRow to InternalRow in AggregationIterator if UnsafeRow specific method is not used

2016-08-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17189: Assignee: Apache Spark > [MINOR] Looses the interface from UnsafeRow to InternalRow in >

[jira] [Updated] (SPARK-17189) [MINOR] Looses the interface from UnsafeRow to InternalRow in AggregationIterator if UnsafeRow specific method is not used

2016-08-22 Thread Sean Zhong (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Zhong updated SPARK-17189: --- Component/s: SQL > [MINOR] Looses the interface from UnsafeRow to InternalRow in >

[jira] [Created] (SPARK-17189) [MINOR] Looses the interface from UnsafeRow to InternalRow in AggregationIterator if UnsafeRow specific method is not used

2016-08-22 Thread Sean Zhong (JIRA)
Sean Zhong created SPARK-17189: -- Summary: [MINOR] Looses the interface from UnsafeRow to InternalRow in AggregationIterator if UnsafeRow specific method is not used Key: SPARK-17189 URL:

[jira] [Assigned] (SPARK-17188) Moves QuantileSummaries to project catalyst from sql so that it can be used to implement percentile_approx

2016-08-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17188: Assignee: Apache Spark > Moves QuantileSummaries to project catalyst from sql so that it

[jira] [Commented] (SPARK-17188) Moves QuantileSummaries to project catalyst from sql so that it can be used to implement percentile_approx

2016-08-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15431179#comment-15431179 ] Apache Spark commented on SPARK-17188: -- User 'clockfly' has created a pull request for this issue:

[jira] [Assigned] (SPARK-17188) Moves QuantileSummaries to project catalyst from sql so that it can be used to implement percentile_approx

2016-08-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17188: Assignee: (was: Apache Spark) > Moves QuantileSummaries to project catalyst from sql

  1   2   3   >