[jira] [Commented] (SPARK-14264) Add feature importances for GBTs in Pyspark

[ https://issues.apache.org/jira/browse/SPARK-14264?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15217386#comment-15217386 ] Apache Spark commented on SPARK-14264: -- User 'sethah' has created a pull request for this issue:

[jira] [Assigned] (SPARK-14264) Add feature importances for GBTs in Pyspark

[ https://issues.apache.org/jira/browse/SPARK-14264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14264: Assignee: Apache Spark > Add feature importances for GBTs in Pyspark >

[jira] [Assigned] (SPARK-14264) Add feature importances for GBTs in Pyspark

[ https://issues.apache.org/jira/browse/SPARK-14264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14264: Assignee: (was: Apache Spark) > Add feature importances for GBTs in Pyspark >

[jira] [Created] (SPARK-14264) Add feature importances for GBTs in Pyspark

Seth Hendrickson created SPARK-14264: Summary: Add feature importances for GBTs in Pyspark Key: SPARK-14264 URL: https://issues.apache.org/jira/browse/SPARK-14264 Project: Spark Issue

[jira] [Assigned] (SPARK-14263) Benchmark Vectorized HashMap for GroupBy Aggregates

[ https://issues.apache.org/jira/browse/SPARK-14263?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14263: Assignee: Apache Spark > Benchmark Vectorized HashMap for GroupBy Aggregates >

[jira] [Assigned] (SPARK-14263) Benchmark Vectorized HashMap for GroupBy Aggregates

[ https://issues.apache.org/jira/browse/SPARK-14263?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14263: Assignee: (was: Apache Spark) > Benchmark Vectorized HashMap for GroupBy Aggregates >

[jira] [Commented] (SPARK-14263) Benchmark Vectorized HashMap for GroupBy Aggregates

[ https://issues.apache.org/jira/browse/SPARK-14263?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15217375#comment-15217375 ] Apache Spark commented on SPARK-14263: -- User 'sameeragarwal' has created a pull request for this

[jira] [Created] (SPARK-14263) Benchmark Vectorized HashMap for GroupBy Aggregates

Sameer Agarwal created SPARK-14263: -- Summary: Benchmark Vectorized HashMap for GroupBy Aggregates Key: SPARK-14263 URL: https://issues.apache.org/jira/browse/SPARK-14263 Project: Spark

[jira] [Commented] (SPARK-13112) CoarsedExecutorBackend register to driver should wait Executor was ready

[ https://issues.apache.org/jira/browse/SPARK-13112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15217362#comment-15217362 ] meiyoula commented on SPARK-13112: -- I agree with it. When CoarseGrainedExecutorBackend receives

[jira] [Commented] (SPARK-13060) CoarsedExecutorBackend register to driver should wait Executor was ready?

[ https://issues.apache.org/jira/browse/SPARK-13060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15217359#comment-15217359 ] meiyoula commented on SPARK-13060: -- When CoarseGrainedExecutorBackend receives RegisterExecutorResponse

[jira] [Issue Comment Deleted] (SPARK-13060) CoarsedExecutorBackend register to driver should wait Executor was ready?

[ https://issues.apache.org/jira/browse/SPARK-13060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] meiyoula updated SPARK-13060: - Comment: was deleted (was: When CoarseGrainedExecutorBackend receives RegisterExecutorResponse slow

[jira] [Commented] (SPARK-13060) CoarsedExecutorBackend register to driver should wait Executor was ready?

[ https://issues.apache.org/jira/browse/SPARK-13060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15217360#comment-15217360 ] meiyoula commented on SPARK-13060: -- When CoarseGrainedExecutorBackend receives RegisterExecutorResponse

[jira] [Resolved] (SPARK-14254) Add logs to help investigate the network performance

[ https://issues.apache.org/jira/browse/SPARK-14254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu resolved SPARK-14254. -- Resolution: Fixed Assignee: Shixiong Zhu Fix Version/s: 2.0.0 > Add logs to

[jira] [Assigned] (SPARK-14262) Correct app state after master leader changed

[ https://issues.apache.org/jira/browse/SPARK-14262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14262: Assignee: Apache Spark > Correct app state after master leader changed >

[jira] [Assigned] (SPARK-14262) Correct app state after master leader changed

[ https://issues.apache.org/jira/browse/SPARK-14262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14262: Assignee: (was: Apache Spark) > Correct app state after master leader changed >

[jira] [Commented] (SPARK-14262) Correct app state after master leader changed

[ https://issues.apache.org/jira/browse/SPARK-14262?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15217348#comment-15217348 ] Apache Spark commented on SPARK-14262: -- User 'GavinGavinNo1' has created a pull request for this

[jira] [Created] (SPARK-14262) Correct app state after master leader changed

ZhengYaofeng created SPARK-14262: Summary: Correct app state after master leader changed Key: SPARK-14262 URL: https://issues.apache.org/jira/browse/SPARK-14262 Project: Spark Issue Type:

[jira] [Commented] (SPARK-14033) Merging Estimator & Model

[ https://issues.apache.org/jira/browse/SPARK-14033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15217324#comment-15217324 ] Stefan Krawczyk commented on SPARK-14033: - {quote}It actually makes it significantly easier to

[jira] [Closed] (SPARK-13703) Remove obsolete scala-2.10 source files

[ https://issues.apache.org/jira/browse/SPARK-13703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luciano Resende closed SPARK-13703. --- Resolution: Not A Problem > Remove obsolete scala-2.10 source files >

[jira] [Updated] (SPARK-14261) Memory leak in Spark Thrift Server

[ https://issues.apache.org/jira/browse/SPARK-14261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaochun Liang updated SPARK-14261: --- Attachment: MemorySnapshot.PNG This is the memory snapshot with query runs over 11 hours >

[jira] [Updated] (SPARK-14261) Memory leak in Spark Thrift Server

[ https://issues.apache.org/jira/browse/SPARK-14261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaochun Liang updated SPARK-14261: --- Description: I am running Spark Thrift server on Windows Server 2012. The Spark Thrift

[jira] [Created] (SPARK-14261) Memory leak in Spark Thrift Server

Xiaochun Liang created SPARK-14261: -- Summary: Memory leak in Spark Thrift Server Key: SPARK-14261 URL: https://issues.apache.org/jira/browse/SPARK-14261 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-14260) Increase default value for maxCharsPerColumn

[ https://issues.apache.org/jira/browse/SPARK-14260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15217262#comment-15217262 ] Hyukjin Kwon commented on SPARK-14260: -- I am currently not sure if this value does not affect

[jira] [Created] (SPARK-14260) Increase default value for maxCharsPerColumn

Hyukjin Kwon created SPARK-14260: Summary: Increase default value for maxCharsPerColumn Key: SPARK-14260 URL: https://issues.apache.org/jira/browse/SPARK-14260 Project: Spark Issue Type:

[jira] [Commented] (SPARK-14174) Accelerate KMeans via Mini-Batch EM

[ https://issues.apache.org/jira/browse/SPARK-14174?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15217235#comment-15217235 ] zhengruifeng commented on SPARK-14174: -- Faster KMeans is required in many cases: high dimensionity >

[jira] [Commented] (SPARK-14103) Python DataFrame CSV load on large file is writing to console in Ipython

[ https://issues.apache.org/jira/browse/SPARK-14103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15217212#comment-15217212 ] Hyukjin Kwon commented on SPARK-14103: -- For long messages, there is a JIRA opened already here,

[jira] [Comment Edited] (SPARK-14103) Python DataFrame CSV load on large file is writing to console in Ipython

[ https://issues.apache.org/jira/browse/SPARK-14103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15217198#comment-15217198 ] Hyukjin Kwon edited comment on SPARK-14103 at 3/30/16 1:30 AM: --- As [~sowen]

[jira] [Commented] (SPARK-14103) Python DataFrame CSV load on large file is writing to console in Ipython

[ https://issues.apache.org/jira/browse/SPARK-14103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15217198#comment-15217198 ] Hyukjin Kwon commented on SPARK-14103: -- As [~sowen] said, CRLF is dealt with in {{TextInputFormat}}

[jira] [Commented] (SPARK-14103) Python DataFrame CSV load on large file is writing to console in Ipython

[ https://issues.apache.org/jira/browse/SPARK-14103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15217200#comment-15217200 ] Hyukjin Kwon commented on SPARK-14103: -- As [~sowen] said, CRLF is dealt with in {{TextInputFormat}}

[jira] [Issue Comment Deleted] (SPARK-14103) Python DataFrame CSV load on large file is writing to console in Ipython

[ https://issues.apache.org/jira/browse/SPARK-14103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-14103: - Comment: was deleted (was: As [~sowen] said, CRLF is dealt with in {{TextInputFormat}} which

[jira] [Issue Comment Deleted] (SPARK-14103) Python DataFrame CSV load on large file is writing to console in Ipython

[ https://issues.apache.org/jira/browse/SPARK-14103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-14103: - Comment: was deleted (was: As [~sowen] said, CRLF is dealt with in {{TextInputFormat}} which

[jira] [Commented] (SPARK-14103) Python DataFrame CSV load on large file is writing to console in Ipython

[ https://issues.apache.org/jira/browse/SPARK-14103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15217199#comment-15217199 ] Hyukjin Kwon commented on SPARK-14103: -- As [~sowen] said, CRLF is dealt with in {{TextInputFormat}}

[jira] [Commented] (SPARK-14194) spark csv reader not working properly if CSV content contains CRLF character (newline) in the intermediate cell

[ https://issues.apache.org/jira/browse/SPARK-14194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15217194#comment-15217194 ] Hyukjin Kwon commented on SPARK-14194: -- Yes. CSV data source internally uses {{TextInputFormat}} and

[jira] [Assigned] (SPARK-14258) change scope of some functions in KafkaCluster

[ https://issues.apache.org/jira/browse/SPARK-14258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14258: Assignee: Apache Spark > change scope of some functions in KafkaCluster >

[jira] [Commented] (SPARK-14258) change scope of some functions in KafkaCluster

[ https://issues.apache.org/jira/browse/SPARK-14258?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15217192#comment-15217192 ] Apache Spark commented on SPARK-14258: -- User 'WangTaoTheTonic' has created a pull request for this

[jira] [Assigned] (SPARK-14258) change scope of some functions in KafkaCluster

[ https://issues.apache.org/jira/browse/SPARK-14258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14258: Assignee: (was: Apache Spark) > change scope of some functions in KafkaCluster >

[jira] [Created] (SPARK-14258) change scope of some functions in KafkaCluster

Tao Wang created SPARK-14258: Summary: change scope of some functions in KafkaCluster Key: SPARK-14258 URL: https://issues.apache.org/jira/browse/SPARK-14258 Project: Spark Issue Type:

[jira] [Created] (SPARK-14259) Add config to control maximum number of files when coalescing partitions

Nong Li created SPARK-14259: --- Summary: Add config to control maximum number of files when coalescing partitions Key: SPARK-14259 URL: https://issues.apache.org/jira/browse/SPARK-14259 Project: Spark

[jira] [Assigned] (SPARK-14127) [Table related commands] Describe table

[ https://issues.apache.org/jira/browse/SPARK-14127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or reassigned SPARK-14127: - Assignee: Andrew Or > [Table related commands] Describe table >

[jira] [Assigned] (SPARK-13703) Remove obsolete scala-2.10 source files

[ https://issues.apache.org/jira/browse/SPARK-13703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13703: Assignee: (was: Apache Spark) > Remove obsolete scala-2.10 source files >

[jira] [Assigned] (SPARK-13703) Remove obsolete scala-2.10 source files

[ https://issues.apache.org/jira/browse/SPARK-13703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13703: Assignee: Apache Spark > Remove obsolete scala-2.10 source files >

[jira] [Reopened] (SPARK-13703) Remove obsolete scala-2.10 source files

[ https://issues.apache.org/jira/browse/SPARK-13703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luciano Resende reopened SPARK-13703: - Now that it seems we are dropping Scala 2.10 for Spark 2.0, we can cleanup some Scala 2.10

[jira] [Commented] (SPARK-14209) Application failure during preemption.

[ https://issues.apache.org/jira/browse/SPARK-14209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15217170#comment-15217170 ] Miles Crawford commented on SPARK-14209: I don't think there's anything custom about our logging

[jira] [Commented] (SPARK-14209) Application failure during preemption.

[ https://issues.apache.org/jira/browse/SPARK-14209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15217150#comment-15217150 ] Marcelo Vanzin commented on SPARK-14209: Are you using a custom log configuration? I can't find

[jira] [Issue Comment Deleted] (SPARK-14125) View related commands

[ https://issues.apache.org/jira/browse/SPARK-14125?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-14125: -- Comment: was deleted (was: User 'davies' has created a pull request for this issue:

[jira] [Updated] (SPARK-14125) View related commands

[ https://issues.apache.org/jira/browse/SPARK-14125?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-14125: -- Assignee: Xiao Li > View related commands > - > > Key: SPARK-14125

[jira] [Resolved] (SPARK-14124) Database related commands

[ https://issues.apache.org/jira/browse/SPARK-14124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-14124. --- Resolution: Fixed Assignee: Xiao Li Fix Version/s: 2.0.0 > Database related commands

[jira] [Commented] (SPARK-13796) Lock release errors occur frequently in executor logs

[ https://issues.apache.org/jira/browse/SPARK-13796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15217100#comment-15217100 ] Apache Spark commented on SPARK-13796: -- User 'nishkamravi2' has created a pull request for this

[jira] [Commented] (SPARK-14209) Application failure during preemption.

[ https://issues.apache.org/jira/browse/SPARK-14209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15217089#comment-15217089 ] Miles Crawford commented on SPARK-14209: Here you go, from the same application run:

[jira] [Commented] (SPARK-14209) Application failure during preemption.

[ https://issues.apache.org/jira/browse/SPARK-14209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15217085#comment-15217085 ] Miles Crawford commented on SPARK-14209: Here you go, from the same application run:

[jira] [Issue Comment Deleted] (SPARK-14209) Application failure during preemption.

[ https://issues.apache.org/jira/browse/SPARK-14209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miles Crawford updated SPARK-14209: --- Comment: was deleted (was: Here you go, from the same application run:

[jira] [Resolved] (SPARK-14225) Cap the length of toCommentSafeString at 128 chars

[ https://issues.apache.org/jira/browse/SPARK-14225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-14225. - Resolution: Fixed Assignee: Sameer Agarwal (was: Reynold Xin) Fix Version/s:

[jira] [Commented] (SPARK-14253) Avoid registering temporary functions in Hive

[ https://issues.apache.org/jira/browse/SPARK-14253?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15217063#comment-15217063 ] Apache Spark commented on SPARK-14253: -- User 'andrewor14' has created a pull request for this issue:

[jira] [Assigned] (SPARK-14253) Avoid registering temporary functions in Hive

[ https://issues.apache.org/jira/browse/SPARK-14253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14253: Assignee: Andrew Or (was: Apache Spark) > Avoid registering temporary functions in Hive

[jira] [Assigned] (SPARK-14253) Avoid registering temporary functions in Hive

[ https://issues.apache.org/jira/browse/SPARK-14253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14253: Assignee: Apache Spark (was: Andrew Or) > Avoid registering temporary functions in Hive

[jira] [Commented] (SPARK-14209) Application failure during preemption.

[ https://issues.apache.org/jira/browse/SPARK-14209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15217055#comment-15217055 ] Marcelo Vanzin commented on SPARK-14209: Are you able to share the logs from your driver? >

[jira] [Commented] (SPARK-12382) Remove spark.mllib GBT implementation and wrap spark.ml

[ https://issues.apache.org/jira/browse/SPARK-12382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15217051#comment-15217051 ] Apache Spark commented on SPARK-12382: -- User 'sethah' has created a pull request for this issue:

[jira] [Assigned] (SPARK-12382) Remove spark.mllib GBT implementation and wrap spark.ml

[ https://issues.apache.org/jira/browse/SPARK-12382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12382: Assignee: (was: Apache Spark) > Remove spark.mllib GBT implementation and wrap

[jira] [Assigned] (SPARK-12382) Remove spark.mllib GBT implementation and wrap spark.ml

[ https://issues.apache.org/jira/browse/SPARK-12382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12382: Assignee: Apache Spark > Remove spark.mllib GBT implementation and wrap spark.ml >

[jira] [Assigned] (SPARK-14257) Allow multiple continuous queries to be started from the same DataFrame

[ https://issues.apache.org/jira/browse/SPARK-14257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14257: Assignee: Shixiong Zhu (was: Apache Spark) > Allow multiple continuous queries to be

[jira] [Commented] (SPARK-14257) Allow multiple continuous queries to be started from the same DataFrame

[ https://issues.apache.org/jira/browse/SPARK-14257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15217049#comment-15217049 ] Apache Spark commented on SPARK-14257: -- User 'zsxwing' has created a pull request for this issue:

[jira] [Assigned] (SPARK-14257) Allow multiple continuous queries to be started from the same DataFrame

[ https://issues.apache.org/jira/browse/SPARK-14257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14257: Assignee: Apache Spark (was: Shixiong Zhu) > Allow multiple continuous queries to be

[jira] [Commented] (SPARK-14253) Avoid registering temporary functions in Hive

[ https://issues.apache.org/jira/browse/SPARK-14253?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15217047#comment-15217047 ] Liang-Chi Hsieh commented on SPARK-14253: - In fact, current HiveFunctionRegistry doesn't handle

[jira] [Updated] (SPARK-14256) Remove parameter sqlContext from as.DataFrame

[ https://issues.apache.org/jira/browse/SPARK-14256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Oscar D. Lara Yejas updated SPARK-14256: Description: Currently, the user requires to pass parameter sqlContext to both

[jira] [Created] (SPARK-14257) Allow multiple continuous queries to be started from the same DataFrame

Shixiong Zhu created SPARK-14257: Summary: Allow multiple continuous queries to be started from the same DataFrame Key: SPARK-14257 URL: https://issues.apache.org/jira/browse/SPARK-14257 Project:

[jira] [Updated] (SPARK-14256) Remove parameter sqlContext from as.DataFrame

[ https://issues.apache.org/jira/browse/SPARK-14256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Oscar D. Lara Yejas updated SPARK-14256: Summary: Remove parameter sqlContext from as.DataFrame (was: Remove parameter

[jira] [Commented] (SPARK-14253) Avoid registering temporary functions in Hive

[ https://issues.apache.org/jira/browse/SPARK-14253?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15217044#comment-15217044 ] Liang-Chi Hsieh commented on SPARK-14253: - I already add this support in

[jira] [Updated] (SPARK-14256) Remove parameter sqlContext from as.DataFrame and createDataFrame

[ https://issues.apache.org/jira/browse/SPARK-14256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Oscar D. Lara Yejas updated SPARK-14256: Description: Currently, the user requires to pass parameter sqlContext to both

[jira] [Commented] (SPARK-14256) Remove parameter sqlContext from as.DataFrame and createDataFrame

[ https://issues.apache.org/jira/browse/SPARK-14256?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15217018#comment-15217018 ] Oscar D. Lara Yejas commented on SPARK-14256: - I'm working on this one > Remove parameter

[jira] [Created] (SPARK-14256) Remove parameter sqlContext from as.DataFrame and createDataFrame

Oscar D. Lara Yejas created SPARK-14256: --- Summary: Remove parameter sqlContext from as.DataFrame and createDataFrame Key: SPARK-14256 URL: https://issues.apache.org/jira/browse/SPARK-14256

[jira] [Commented] (SPARK-14255) Streaming Aggregation

[ https://issues.apache.org/jira/browse/SPARK-14255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15217002#comment-15217002 ] Apache Spark commented on SPARK-14255: -- User 'marmbrus' has created a pull request for this issue:

[jira] [Assigned] (SPARK-14255) Streaming Aggregation

[ https://issues.apache.org/jira/browse/SPARK-14255?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14255: Assignee: Michael Armbrust (was: Apache Spark) > Streaming Aggregation >

[jira] [Assigned] (SPARK-14255) Streaming Aggregation

[ https://issues.apache.org/jira/browse/SPARK-14255?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14255: Assignee: Apache Spark (was: Michael Armbrust) > Streaming Aggregation >

[jira] [Commented] (SPARK-12326) Move GBT implementation from spark.mllib to spark.ml

[ https://issues.apache.org/jira/browse/SPARK-12326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15216999#comment-15216999 ] Seth Hendrickson commented on SPARK-12326: -- [~josephkb] When moving the helper classes to ML, I

[jira] [Resolved] (SPARK-14215) Support chained Python UDF

[ https://issues.apache.org/jira/browse/SPARK-14215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-14215. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 12014

[jira] [Created] (SPARK-14255) Streaming Aggregation

Michael Armbrust created SPARK-14255: Summary: Streaming Aggregation Key: SPARK-14255 URL: https://issues.apache.org/jira/browse/SPARK-14255 Project: Spark Issue Type: Sub-task

[jira] [Assigned] (SPARK-14224) Cannot project all columns from a table with ~1,100 columns

[ https://issues.apache.org/jira/browse/SPARK-14224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14224: Assignee: (was: Apache Spark) > Cannot project all columns from a table with ~1,100

[jira] [Assigned] (SPARK-14223) Cannot project all columns from a parquet files with ~1,100 columns

[ https://issues.apache.org/jira/browse/SPARK-14223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14223: Assignee: Apache Spark > Cannot project all columns from a parquet files with ~1,100

[jira] [Commented] (SPARK-14224) Cannot project all columns from a table with ~1,100 columns

[ https://issues.apache.org/jira/browse/SPARK-14224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15216909#comment-15216909 ] Apache Spark commented on SPARK-14224: -- User 'davies' has created a pull request for this issue:

[jira] [Assigned] (SPARK-14223) Cannot project all columns from a parquet files with ~1,100 columns

[ https://issues.apache.org/jira/browse/SPARK-14223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14223: Assignee: (was: Apache Spark) > Cannot project all columns from a parquet files with

[jira] [Assigned] (SPARK-14224) Cannot project all columns from a table with ~1,100 columns

[ https://issues.apache.org/jira/browse/SPARK-14224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14224: Assignee: Apache Spark > Cannot project all columns from a table with ~1,100 columns >

[jira] [Commented] (SPARK-14223) Cannot project all columns from a parquet files with ~1,100 columns

[ https://issues.apache.org/jira/browse/SPARK-14223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15216910#comment-15216910 ] Apache Spark commented on SPARK-14223: -- User 'davies' has created a pull request for this issue:

[jira] [Commented] (SPARK-14209) Application failure during preemption.

[ https://issues.apache.org/jira/browse/SPARK-14209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15216899#comment-15216899 ] Miles Crawford commented on SPARK-14209: That's fantastic news! let me know if I can help test a

[jira] [Assigned] (SPARK-14254) Add logs to help investigate the network performance

[ https://issues.apache.org/jira/browse/SPARK-14254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14254: Assignee: Apache Spark > Add logs to help investigate the network performance >

[jira] [Assigned] (SPARK-14254) Add logs to help investigate the network performance

[ https://issues.apache.org/jira/browse/SPARK-14254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14254: Assignee: (was: Apache Spark) > Add logs to help investigate the network performance

[jira] [Commented] (SPARK-14254) Add logs to help investigate the network performance

[ https://issues.apache.org/jira/browse/SPARK-14254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15216893#comment-15216893 ] Apache Spark commented on SPARK-14254: -- User 'zsxwing' has created a pull request for this issue:

[jira] [Updated] (SPARK-14254) Add logs to help investigate the network performance

[ https://issues.apache.org/jira/browse/SPARK-14254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu updated SPARK-14254: - Description: It would be very helpful for network performance investigation if we log the time

[jira] [Updated] (SPARK-14254) Add logs to help investigate the network performance

[ https://issues.apache.org/jira/browse/SPARK-14254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu updated SPARK-14254: - Description: It would be very helpful for if we log the time spent on connecting and resolving

[jira] [Created] (SPARK-14254) Add logs to help investigate the network performance

Shixiong Zhu created SPARK-14254: Summary: Add logs to help investigate the network performance Key: SPARK-14254 URL: https://issues.apache.org/jira/browse/SPARK-14254 Project: Spark Issue

[jira] [Commented] (SPARK-14209) Application failure during preemption.

[ https://issues.apache.org/jira/browse/SPARK-14209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15216888#comment-15216888 ] Marcelo Vanzin commented on SPARK-14209: 2.0 doesn't currently suffer from this problem because,

[jira] [Commented] (SPARK-14252) Executors do not try to download remote cached blocks

[ https://issues.apache.org/jira/browse/SPARK-14252?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15216886#comment-15216886 ] Marcelo Vanzin commented on SPARK-14252: Here's a slightly updated piece of code where it's

[jira] [Created] (SPARK-14253) Avoid registering temporary functions in Hive

Andrew Or created SPARK-14253: - Summary: Avoid registering temporary functions in Hive Key: SPARK-14253 URL: https://issues.apache.org/jira/browse/SPARK-14253 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-14252) Executors do not try to download remote cached blocks

Marcelo Vanzin created SPARK-14252: -- Summary: Executors do not try to download remote cached blocks Key: SPARK-14252 URL: https://issues.apache.org/jira/browse/SPARK-14252 Project: Spark

[jira] [Resolved] (SPARK-14227) Add method for printing out generated code for debugging

[ https://issues.apache.org/jira/browse/SPARK-14227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-14227. - Resolution: Fixed Assignee: Eric Liang Fix Version/s: 2.0.0 > Add method for

[jira] [Commented] (SPARK-7146) Should ML sharedParams be a public API?

[ https://issues.apache.org/jira/browse/SPARK-7146?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15216769#comment-15216769 ] Michael Zieliński commented on SPARK-7146: -- We ended up copying significant portion of Params

[jira] [Updated] (SPARK-14229) PySpark DataFrame.rdd's can't be saved to an arbitrary Hadoop OutputFormat

[ https://issues.apache.org/jira/browse/SPARK-14229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Russell Jurney updated SPARK-14229: --- Shepherd: Matei Zaharia > PySpark DataFrame.rdd's can't be saved to an arbitrary Hadoop

[jira] [Commented] (SPARK-14229) PySpark DataFrame.rdd's can't be saved to an arbitrary Hadoop OutputFormat

[ https://issues.apache.org/jira/browse/SPARK-14229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15216759#comment-15216759 ] Russell Jurney commented on SPARK-14229: To reproduce for MongoDB: The data I am having trouble

[jira] [Commented] (SPARK-14033) Merging Estimator & Model

[ https://issues.apache.org/jira/browse/SPARK-14033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15216756#comment-15216756 ] Michael Zieliński commented on SPARK-14033: --- Re: ML vs MLLib, I also think about it in terms

[jira] [Commented] (SPARK-14248) Get the path hierarchy from root to leaf in the BisectingKMeansModel

[ https://issues.apache.org/jira/browse/SPARK-14248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15216747#comment-15216747 ] Lakesh commented on SPARK-14248: [~josephkb]. It would be a very small addition. You can assign it to me

[jira] [Commented] (SPARK-14246) vars not updated after Scala script reload

[ https://issues.apache.org/jira/browse/SPARK-14246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15216734#comment-15216734 ] Jim Powers commented on SPARK-14246: It appears that this is a Scala problem and not a spark one.

  1   2   3   >