[jira] [Commented] (SPARK-9345) Failure to cleanup on exceptions causes persistent I/O problems later on

[ https://issues.apache.org/jira/browse/SPARK-9345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14643882#comment-14643882 ] Michael Armbrust commented on SPARK-9345: - We changed the way that we instantiate

[jira] [Created] (SPARK-9397) DataFrame should provide an API to find source data files if applicable

Aaron Davidson created SPARK-9397: - Summary: DataFrame should provide an API to find source data files if applicable Key: SPARK-9397 URL: https://issues.apache.org/jira/browse/SPARK-9397 Project:

[jira] [Updated] (SPARK-9397) DataFrame should provide an API to find source data files if applicable

[ https://issues.apache.org/jira/browse/SPARK-9397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-9397: Target Version/s: 1.5.0 Priority: Critical (was: Major) DataFrame should

[jira] [Commented] (SPARK-9397) DataFrame should provide an API to find source data files if applicable

[ https://issues.apache.org/jira/browse/SPARK-9397?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14643893#comment-14643893 ] Apache Spark commented on SPARK-9397: - User 'aarondav' has created a pull request for

[jira] [Assigned] (SPARK-9397) DataFrame should provide an API to find source data files if applicable

[ https://issues.apache.org/jira/browse/SPARK-9397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9397: --- Assignee: Apache Spark (was: Aaron Davidson) DataFrame should provide an API to find

[jira] [Assigned] (SPARK-9397) DataFrame should provide an API to find source data files if applicable

[ https://issues.apache.org/jira/browse/SPARK-9397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9397: --- Assignee: Aaron Davidson (was: Apache Spark) DataFrame should provide an API to find

[jira] [Updated] (SPARK-9280) New HiveContext object unexpectedly loads configuration settings from history

[ https://issues.apache.org/jira/browse/SPARK-9280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tien-Dung LE updated SPARK-9280: Description: In a spark session, stopping a spark context and create a new spark context and hive

[jira] [Updated] (SPARK-9097) Tasks are not completed but there is no executors

[ https://issues.apache.org/jira/browse/SPARK-9097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] KaiXinXIaoLei updated SPARK-9097: - Summary: Tasks are not completed but there is no executors (was: Tasks are not completed but

[jira] [Reopened] (SPARK-8405) Show executor logs on Web UI when Yarn log aggregation is enabled

[ https://issues.apache.org/jira/browse/SPARK-8405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves reopened SPARK-8405: -- Assignee: Carson Wang Show executor logs on Web UI when Yarn log aggregation is enabled

[jira] [Updated] (SPARK-9345) Failure to cleanup on exceptions causes persistent I/O problems later on

[ https://issues.apache.org/jira/browse/SPARK-9345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-9345: - Component/s: SQL Spark Shell Failure to cleanup on exceptions causes persistent I/O

[jira] [Updated] (SPARK-9377) Shuffle tuning should discuss task size optimisation

[ https://issues.apache.org/jira/browse/SPARK-9377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-9377: - Component/s: Shuffle Documentation Shuffle tuning should discuss task size optimisation

[jira] [Updated] (SPARK-9347) spark load of existing parquet files extremely slow if large number of files

[ https://issues.apache.org/jira/browse/SPARK-9347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-9347: - Target Version/s: (was: 1.3.1) spark load of existing parquet files extremely slow if large number of

[jira] [Updated] (SPARK-9280) New HiveContext object unexpectedly loads configuration settings from history

[ https://issues.apache.org/jira/browse/SPARK-9280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tien-Dung LE updated SPARK-9280: Description: In a spark-shell session, stopping a spark context and create a new spark context and

[jira] [Assigned] (SPARK-9381) Migrate JSON data source to the new partitioning data source

[ https://issues.apache.org/jira/browse/SPARK-9381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9381: --- Assignee: (was: Apache Spark) Migrate JSON data source to the new partitioning data

[jira] [Commented] (SPARK-9381) Migrate JSON data source to the new partitioning data source

[ https://issues.apache.org/jira/browse/SPARK-9381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14642717#comment-14642717 ] Apache Spark commented on SPARK-9381: - User 'chenghao-intel' has created a pull

[jira] [Assigned] (SPARK-9381) Migrate JSON data source to the new partitioning data source

[ https://issues.apache.org/jira/browse/SPARK-9381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9381: --- Assignee: Apache Spark Migrate JSON data source to the new partitioning data source

[jira] [Created] (SPARK-9381) Migrate JSON data source to the new partitioning data source

Cheng Hao created SPARK-9381: Summary: Migrate JSON data source to the new partitioning data source Key: SPARK-9381 URL: https://issues.apache.org/jira/browse/SPARK-9381 Project: Spark Issue

[jira] [Created] (SPARK-9380) Pregel example fix in graphx-programming-guide

Alexander Ulanov created SPARK-9380: --- Summary: Pregel example fix in graphx-programming-guide Key: SPARK-9380 URL: https://issues.apache.org/jira/browse/SPARK-9380 Project: Spark Issue

[jira] [Issue Comment Deleted] (SPARK-9097) Tasks are not completed but there is no executors

[ https://issues.apache.org/jira/browse/SPARK-9097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] KaiXinXIaoLei updated SPARK-9097: - Comment: was deleted (was: [~srowen], This problem, I analysis code recently. I have a questions.

[jira] [Commented] (SPARK-9374) [Spark SQL] Throw out erorr of AnalysisException: nondeterministic expressions are only allowed in Project or Filter during the spark sql parse phase

[ https://issues.apache.org/jira/browse/SPARK-9374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14642706#comment-14642706 ] Cheng Hao commented on SPARK-9374: -- [~cloud_fan]] Can you also take look at this failure?

[jira] [Commented] (SPARK-6885) Decision trees: predict class probabilities

[ https://issues.apache.org/jira/browse/SPARK-6885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14642568#comment-14642568 ] Yanbo Liang commented on SPARK-6885: [~josephkb] I referred the old DecisionTree API

[jira] [Commented] (SPARK-9345) Failure to cleanup on exceptions causes persistent I/O problems later on

[ https://issues.apache.org/jira/browse/SPARK-9345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14642648#comment-14642648 ] Kaushal Prajapati commented on SPARK-9345: -- I think this problem is related to

[jira] [Resolved] (SPARK-8405) Show executor logs on Web UI when Yarn log aggregation is enabled

[ https://issues.apache.org/jira/browse/SPARK-8405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves resolved SPARK-8405. -- Resolution: Fixed Fix Version/s: 1.4.2 Show executor logs on Web UI when Yarn log

[jira] [Assigned] (SPARK-9149) Add an example of spark.ml KMeans

[ https://issues.apache.org/jira/browse/SPARK-9149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9149: --- Assignee: Apache Spark (was: Yu Ishikawa) Add an example of spark.ml KMeans

[jira] [Created] (SPARK-9382) Tachyon version mismatch

Daniel Darabos created SPARK-9382: - Summary: Tachyon version mismatch Key: SPARK-9382 URL: https://issues.apache.org/jira/browse/SPARK-9382 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-9149) Add an example of spark.ml KMeans

[ https://issues.apache.org/jira/browse/SPARK-9149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14642774#comment-14642774 ] Apache Spark commented on SPARK-9149: - User 'yu-iskw' has created a pull request for

[jira] [Commented] (SPARK-9280) New HiveContext object unexpectedly loads configuration settings from history

[ https://issues.apache.org/jira/browse/SPARK-9280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14642840#comment-14642840 ] Tien-Dung LE commented on SPARK-9280: - thanks [~pborck]. Detach the hive session state

[jira] [Assigned] (SPARK-9149) Add an example of spark.ml KMeans

[ https://issues.apache.org/jira/browse/SPARK-9149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9149: --- Assignee: Yu Ishikawa (was: Apache Spark) Add an example of spark.ml KMeans

[jira] [Commented] (SPARK-9382) Tachyon version mismatch

[ https://issues.apache.org/jira/browse/SPARK-9382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14642866#comment-14642866 ] Sean Owen commented on SPARK-9382: -- It's about to be Tachyon 0.7.0 even. This seems to be

[jira] [Resolved] (SPARK-4176) Support decimals with precision 18 in Parquet

[ https://issues.apache.org/jira/browse/SPARK-4176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian resolved SPARK-4176. --- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 7455

[jira] [Commented] (SPARK-8333) Spark failed to delete temp directory created by HiveContext

[ https://issues.apache.org/jira/browse/SPARK-8333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14642898#comment-14642898 ] Rémy DUBOIS commented on SPARK-8333: The same issue appears with a JavaSparkContext.

[jira] [Comment Edited] (SPARK-8333) Spark failed to delete temp directory created by HiveContext

[ https://issues.apache.org/jira/browse/SPARK-8333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14642898#comment-14642898 ] Rémy DUBOIS edited comment on SPARK-8333 at 7/27/15 3:49 PM: -

[jira] [Commented] (SPARK-9382) Tachyon version mismatch

[ https://issues.apache.org/jira/browse/SPARK-9382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14642908#comment-14642908 ] Daniel Darabos commented on SPARK-9382: --- Ah, looks like this was just an oversight

[jira] [Closed] (SPARK-9382) Tachyon version mismatch

[ https://issues.apache.org/jira/browse/SPARK-9382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Darabos closed SPARK-9382. - Resolution: Fixed Fix Version/s: 1.4.1 Tachyon version mismatch

[jira] [Commented] (SPARK-5259) Fix endless retry stage by add task equal() and hashcode() to avoid stage.pendingTasks not empty while stage map output is available

[ https://issues.apache.org/jira/browse/SPARK-5259?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14642927#comment-14642927 ] Apache Spark commented on SPARK-5259: - User 'squito' has created a pull request for

[jira] [Assigned] (SPARK-9358) Create a UnsafeRowConcat class

[ https://issues.apache.org/jira/browse/SPARK-9358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9358: --- Assignee: Apache Spark (was: Yijie Shen) Create a UnsafeRowConcat class

[jira] [Commented] (SPARK-9358) Create a UnsafeRowConcat class

[ https://issues.apache.org/jira/browse/SPARK-9358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14642926#comment-14642926 ] Apache Spark commented on SPARK-9358: - User 'yjshen' has created a pull request for

[jira] [Assigned] (SPARK-9358) Create a UnsafeRowConcat class

[ https://issues.apache.org/jira/browse/SPARK-9358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9358: --- Assignee: Yijie Shen (was: Apache Spark) Create a UnsafeRowConcat class

[jira] [Resolved] (SPARK-9371) Special chars in column names is broken in hive context

[ https://issues.apache.org/jira/browse/SPARK-9371?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-9371. Resolution: Fixed Assignee: Wenchen Fan Fix Version/s: 1.5.0

[jira] [Resolved] (SPARK-9366) TaskEnd event emitted for task has different stage attempt ID than TaskStart for same task

[ https://issues.apache.org/jira/browse/SPARK-9366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Imran Rashid resolved SPARK-9366. - Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 7681

[jira] [Commented] (SPARK-9384) Easier setting of executor and driver classpath

[ https://issues.apache.org/jira/browse/SPARK-9384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14643127#comment-14643127 ] Mark Grover commented on SPARK-9384: Personally, there are two easy ways to solve this

[jira] [Resolved] (SPARK-9376) use a seed in RandomDataGeneratorSuite

[ https://issues.apache.org/jira/browse/SPARK-9376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-9376. --- Resolution: Fixed Assignee: Wenchen Fan Fix Version/s: 1.5.0 use a seed in

[jira] [Updated] (SPARK-7423) spark.ml Classifier predict should not convert vectors to dense format

[ https://issues.apache.org/jira/browse/SPARK-7423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-7423: - Target Version/s: 1.5.0 spark.ml Classifier predict should not convert vectors to dense format

[jira] [Updated] (SPARK-7423) spark.ml Classifier predict should not convert vectors to dense format

[ https://issues.apache.org/jira/browse/SPARK-7423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-7423: - Assignee: George Dittmar spark.ml Classifier predict should not convert vectors to dense format

[jira] [Resolved] (SPARK-7423) spark.ml Classifier predict should not convert vectors to dense format

[ https://issues.apache.org/jira/browse/SPARK-7423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-7423. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 7670

[jira] [Resolved] (SPARK-9351) remove literals from grouping expressions in Aggregate

[ https://issues.apache.org/jira/browse/SPARK-9351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-9351. - Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 7583

[jira] [Updated] (SPARK-9384) Easier setting of executor and driver classpath

[ https://issues.apache.org/jira/browse/SPARK-9384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-9384: - Affects Version/s: (was: 1.5.0) 1.4.1 Target Version/s: (was: 1.5.0)

[jira] [Updated] (SPARK-9378) Test case CTAS with serde fails occasionally

[ https://issues.apache.org/jira/browse/SPARK-9378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-9378: -- Summary: Test case CTAS with serde fails occasionally (was: Remove failed and improper Hive test due

[jira] [Commented] (SPARK-9378) Remove failed and improper Hive test due to old ParquetRelation removed

[ https://issues.apache.org/jira/browse/SPARK-9378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14642996#comment-14642996 ] Apache Spark commented on SPARK-9378: - User 'liancheng' has created a pull request for

[jira] [Commented] (SPARK-9312) The multiclass logistic regression and the OneVsRest model do not provide predictive probability (confidence factor) along with the prediction

[ https://issues.apache.org/jira/browse/SPARK-9312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14642984#comment-14642984 ] Badari Madhav commented on SPARK-9312: -- 1. WRT OneVsRest I agree that the

[jira] [Updated] (SPARK-9366) TaskEnd event emitted for task has different stage attempt ID than TaskStart for same task

[ https://issues.apache.org/jira/browse/SPARK-9366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Imran Rashid updated SPARK-9366: Assignee: Ryan Williams TaskEnd event emitted for task has different stage attempt ID than

[jira] [Updated] (SPARK-9371) Special chars in column names is broken in HiveContext

[ https://issues.apache.org/jira/browse/SPARK-9371?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-9371: --- Summary: Special chars in column names is broken in HiveContext (was: Special chars in column names

[jira] [Updated] (SPARK-9378) Test case CTAS with serde fails occasionally

[ https://issues.apache.org/jira/browse/SPARK-9378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-9378: -- Description: The reason why CTAS with serde fails is that the {{MetastoreRelation}} gets converted to a

[jira] [Updated] (SPARK-9378) Test case CTAS with serde fails occasionally

[ https://issues.apache.org/jira/browse/SPARK-9378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-9378: -- Description: The reason why CTAS with serde fails is that the {{MetastoreRelation}} gets converted to

[jira] [Commented] (SPARK-9378) Test case CTAS with serde fails occasionally

[ https://issues.apache.org/jira/browse/SPARK-9378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14643044#comment-14643044 ] Cheng Lian commented on SPARK-9378: --- Updated the ticket title and description, as I

[jira] [Updated] (SPARK-6885) Decision trees: predict class probabilities

[ https://issues.apache.org/jira/browse/SPARK-6885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-6885: - Shepherd: Joseph K. Bradley Decision trees: predict class probabilities

[jira] [Resolved] (SPARK-9364) Fix array out of bounds and use-after-free bugs in UnsafeExternalSorter

[ https://issues.apache.org/jira/browse/SPARK-9364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-9364. --- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 7680

[jira] [Comment Edited] (SPARK-9312) The multiclass logistic regression and the OneVsRest model do not provide predictive probability (confidence factor) along with the prediction

[ https://issues.apache.org/jira/browse/SPARK-9312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14642984#comment-14642984 ] Badari Madhav edited comment on SPARK-9312 at 7/27/15 4:43 PM:

[jira] [Commented] (SPARK-9202) Worker should not have data structures which grow without bound

[ https://issues.apache.org/jira/browse/SPARK-9202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14643057#comment-14643057 ] Josh Rosen commented on SPARK-9202: --- I've gone ahead and promoted this to a 1.5.0

[jira] [Updated] (SPARK-9202) Worker should not have data structures which grow without bound

[ https://issues.apache.org/jira/browse/SPARK-9202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-9202: -- Priority: Blocker (was: Major) Worker should not have data structures which grow without bound

[jira] [Created] (SPARK-9383) Merge script should reset back to previous ref instead of detached commit

Josh Rosen created SPARK-9383: - Summary: Merge script should reset back to previous ref instead of detached commit Key: SPARK-9383 URL: https://issues.apache.org/jira/browse/SPARK-9383 Project: Spark

[jira] [Created] (SPARK-9384) Easier setting of executor and driver classpath

Mark Grover created SPARK-9384: -- Summary: Easier setting of executor and driver classpath Key: SPARK-9384 URL: https://issues.apache.org/jira/browse/SPARK-9384 Project: Spark Issue Type:

[jira] [Comment Edited] (SPARK-9384) Easier setting of executor and driver classpath

[ https://issues.apache.org/jira/browse/SPARK-9384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14643127#comment-14643127 ] Mark Grover edited comment on SPARK-9384 at 7/27/15 6:15 PM: -

[jira] [Updated] (SPARK-6885) Decision trees: predict class probabilities

[ https://issues.apache.org/jira/browse/SPARK-6885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-6885: - Assignee: Yanbo Liang Decision trees: predict class probabilities

[jira] [Comment Edited] (SPARK-9384) Easier setting of executor and driver classpath

[ https://issues.apache.org/jira/browse/SPARK-9384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14643248#comment-14643248 ] Mark Grover edited comment on SPARK-9384 at 7/27/15 7:26 PM: -

[jira] [Comment Edited] (SPARK-9384) Easier setting of executor and driver classpath

[ https://issues.apache.org/jira/browse/SPARK-9384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14643248#comment-14643248 ] Mark Grover edited comment on SPARK-9384 at 7/27/15 7:25 PM: -

[jira] [Resolved] (SPARK-9369) Support IntervalType in UnsafeRow

[ https://issues.apache.org/jira/browse/SPARK-9369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-9369. Resolution: Fixed Fix Version/s: 1.5.0 Support IntervalType in UnsafeRow

[jira] [Commented] (SPARK-9384) Easier setting of executor and driver classpath

[ https://issues.apache.org/jira/browse/SPARK-9384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14643248#comment-14643248 ] Mark Grover commented on SPARK-9384: Thanks Sean. {{--jars}} does something similar

[jira] [Resolved] (SPARK-9378) Test case CTAS with serde fails occasionally

[ https://issues.apache.org/jira/browse/SPARK-9378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-9378. Resolution: Fixed Assignee: Cheng Lian Fix Version/s: 1.5.0 Test case CTAS with

[jira] [Resolved] (SPARK-9355) Remove InternalRow.get generic getter call in columnar cache code

[ https://issues.apache.org/jira/browse/SPARK-9355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-9355. Resolution: Fixed Assignee: Wenchen Fan Fix Version/s: 1.5.0 Remove

[jira] [Commented] (SPARK-6691) Abstract and add a dynamic RateLimiter for Spark Streaming

[ https://issues.apache.org/jira/browse/SPARK-6691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14643411#comment-14643411 ] Adam Mollenkopf commented on SPARK-6691: I will be out of the office July 24-Aug 2

[jira] [Resolved] (SPARK-9349) UDAF cleanup for 1.5

[ https://issues.apache.org/jira/browse/SPARK-9349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-9349. Resolution: Fixed Fix Version/s: 1.5.0 UDAF cleanup for 1.5

[jira] [Commented] (SPARK-9332) CatalystTypeConverters.toScala does not work on UnsafeRows

[ https://issues.apache.org/jira/browse/SPARK-9332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14643343#comment-14643343 ] Reynold Xin commented on SPARK-9332: Fixed by SPARK-9368.

[jira] [Closed] (SPARK-9332) CatalystTypeConverters.toScala does not work on UnsafeRows

[ https://issues.apache.org/jira/browse/SPARK-9332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin closed SPARK-9332. -- Resolution: Fixed CatalystTypeConverters.toScala does not work on UnsafeRows

[jira] [Resolved] (SPARK-6691) Abstract and add a dynamic RateLimiter for Spark Streaming

[ https://issues.apache.org/jira/browse/SPARK-6691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das resolved SPARK-6691. -- Resolution: Duplicate I am closing this JIRA in favor of SPARK-7398 which gives a concrete

[jira] [Created] (SPARK-9385) Python style check fails at jenkins

Yin Huai created SPARK-9385: --- Summary: Python style check fails at jenkins Key: SPARK-9385 URL: https://issues.apache.org/jira/browse/SPARK-9385 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-9385) Python style check fails at jenkins

[ https://issues.apache.org/jira/browse/SPARK-9385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14643484#comment-14643484 ] Apache Spark commented on SPARK-9385: - User 'yhuai' has created a pull request for

[jira] [Created] (SPARK-9386) Feature flag for metastore partitioning

Michael Armbrust created SPARK-9386: --- Summary: Feature flag for metastore partitioning Key: SPARK-9386 URL: https://issues.apache.org/jira/browse/SPARK-9386 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-4352) Incorporate locality preferences in dynamic allocation requests

[ https://issues.apache.org/jira/browse/SPARK-4352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza resolved SPARK-4352. --- Resolution: Fixed Fix Version/s: 1.5.0 Target Version/s: 1.5.0 Incorporate locality

[jira] [Commented] (SPARK-9385) Python style check fails at jenkins

[ https://issues.apache.org/jira/browse/SPARK-9385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14643557#comment-14643557 ] Yin Huai commented on SPARK-9385: - Once we fixed the problem, we should enable the pylint

[jira] [Commented] (SPARK-9036) SparkListenerExecutorMetricsUpdate messages not included in JsonProtocol

[ https://issues.apache.org/jira/browse/SPARK-9036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14643601#comment-14643601 ] Ryan Williams commented on SPARK-9036: -- Heh, [guilty as

[jira] [Created] (SPARK-9388) Make log messages in ExecutorRunnable more readable

Marcelo Vanzin created SPARK-9388: - Summary: Make log messages in ExecutorRunnable more readable Key: SPARK-9388 URL: https://issues.apache.org/jira/browse/SPARK-9388 Project: Spark Issue

[jira] [Reopened] (SPARK-8385) java.lang.UnsupportedOperationException: Not implemented by the TFS FileSystem implementation

[ https://issues.apache.org/jira/browse/SPARK-8385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran reopened SPARK-8385: --- I can reproduce this too, and have actually managed to do it in the spark tests, somehow {code}

[jira] [Commented] (SPARK-9386) Feature flag for metastore partitioning

[ https://issues.apache.org/jira/browse/SPARK-9386?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14643500#comment-14643500 ] Apache Spark commented on SPARK-9386: - User 'marmbrus' has created a pull request for

[jira] [Assigned] (SPARK-9386) Feature flag for metastore partitioning

[ https://issues.apache.org/jira/browse/SPARK-9386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9386: --- Assignee: Michael Armbrust (was: Apache Spark) Feature flag for metastore partitioning

[jira] [Resolved] (SPARK-8988) Driver logs links is missing on secure cluster

[ https://issues.apache.org/jira/browse/SPARK-8988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-8988. --- Resolution: Fixed Assignee: Hari Shreedharan Fix Version/s: 1.5.0 Driver

[jira] [Commented] (SPARK-6793) Implement perplexity for LDA

[ https://issues.apache.org/jira/browse/SPARK-6793?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14643605#comment-14643605 ] Apache Spark commented on SPARK-6793: - User 'feynmanliang' has created a pull request

[jira] [Created] (SPARK-9387) Support comparing UnsafeRow and normal InternalRow

Reynold Xin created SPARK-9387: -- Summary: Support comparing UnsafeRow and normal InternalRow Key: SPARK-9387 URL: https://issues.apache.org/jira/browse/SPARK-9387 Project: Spark Issue Type:

[jira] [Updated] (SPARK-9385) Python style check fails at jenkins

[ https://issues.apache.org/jira/browse/SPARK-9385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-9385: Description:

[jira] [Assigned] (SPARK-9386) Feature flag for metastore partitioning

[ https://issues.apache.org/jira/browse/SPARK-9386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9386: --- Assignee: Apache Spark (was: Michael Armbrust) Feature flag for metastore partitioning

[jira] [Commented] (SPARK-9385) Python style check fails at jenkins

[ https://issues.apache.org/jira/browse/SPARK-9385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14643549#comment-14643549 ] Apache Spark commented on SPARK-9385: - User 'yhuai' has created a pull request for

[jira] [Issue Comment Deleted] (SPARK-4352) Incorporate locality preferences in dynamic allocation requests

[ https://issues.apache.org/jira/browse/SPARK-4352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neelesh Srinivas Salian updated SPARK-4352: --- Comment: was deleted (was: Checking to see if this been resolved? )

[jira] [Commented] (SPARK-9388) Make log messages in ExecutorRunnable more readable

[ https://issues.apache.org/jira/browse/SPARK-9388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14643621#comment-14643621 ] Apache Spark commented on SPARK-9388: - User 'vanzin' has created a pull request for

[jira] [Assigned] (SPARK-9385) Python style check fails at jenkins

[ https://issues.apache.org/jira/browse/SPARK-9385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9385: --- Assignee: (was: Apache Spark) Python style check fails at jenkins

[jira] [Assigned] (SPARK-9385) Python style check fails at jenkins

[ https://issues.apache.org/jira/browse/SPARK-9385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9385: --- Assignee: Apache Spark Python style check fails at jenkins

[jira] [Updated] (SPARK-9234) Fallback when metastore partition pruning pushdown

[ https://issues.apache.org/jira/browse/SPARK-9234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-9234: Assignee: (was: Michael Armbrust) Fallback when metastore partition pruning pushdown

[jira] [Commented] (SPARK-9385) Python style check fails at jenkins

[ https://issues.apache.org/jira/browse/SPARK-9385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14643512#comment-14643512 ] Yin Huai commented on SPARK-9385: - I merged https://github.com/apache/spark/pull/7702 to

[jira] [Commented] (SPARK-5151) Parquet Predicate Pushdown Does Not Work with Nested Structures.

[ https://issues.apache.org/jira/browse/SPARK-5151?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14643588#comment-14643588 ] Adam Borochoff commented on SPARK-5151: --- Hey guys, Does this get fixed in Spark 1.5

[jira] [Assigned] (SPARK-9388) Make log messages in ExecutorRunnable more readable

[ https://issues.apache.org/jira/browse/SPARK-9388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9388: --- Assignee: (was: Apache Spark) Make log messages in ExecutorRunnable more readable

[jira] [Assigned] (SPARK-9388) Make log messages in ExecutorRunnable more readable

[ https://issues.apache.org/jira/browse/SPARK-9388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9388: --- Assignee: Apache Spark Make log messages in ExecutorRunnable more readable

  1   2   3   >