[jira] [Commented] (SPARK-5456) Decimal Type comparison issue

[ https://issues.apache.org/jira/browse/SPARK-5456?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14383392#comment-14383392 ] Karthik G commented on SPARK-5456: -- This is a blocker when using Spark with Databases

[jira] [Updated] (SPARK-6119) better support for working with missing data

[ https://issues.apache.org/jira/browse/SPARK-6119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-6119: --- Description: Real world data can be messy. An important feature of data frames is support for

[jira] [Assigned] (SPARK-6406) Launcher backward compatibility issues

[ https://issues.apache.org/jira/browse/SPARK-6406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6406: --- Assignee: (was: Apache Spark) Launcher backward compatibility issues

[jira] [Created] (SPARK-6561) Add partition support in saveAsParquet

Jianshi Huang created SPARK-6561: Summary: Add partition support in saveAsParquet Key: SPARK-6561 URL: https://issues.apache.org/jira/browse/SPARK-6561 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-6119) better support for working with missing data

[ https://issues.apache.org/jira/browse/SPARK-6119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-6119: --- Labels: DataFrame (was: ) better support for working with missing data

[jira] [Updated] (SPARK-6119) better support for working with missing data

[ https://issues.apache.org/jira/browse/SPARK-6119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-6119: --- Summary: better support for working with missing data (was: missing data support) better support

[jira] [Updated] (SPARK-6119) better support for working with missing data

[ https://issues.apache.org/jira/browse/SPARK-6119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-6119: --- Description: Real world data can be messy. An important feature of data frames is support for

[jira] [Updated] (SPARK-6561) Add partition support in saveAsParquet

[ https://issues.apache.org/jira/browse/SPARK-6561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jianshi Huang updated SPARK-6561: - Description: Now ParquetRelation2 supports automatic partition discovery which is very nice.

[jira] [Commented] (SPARK-6561) Add partition support in saveAsParquet

[ https://issues.apache.org/jira/browse/SPARK-6561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14383413#comment-14383413 ] Patrick Wendell commented on SPARK-6561: FYI - I just removed Affects Version's

[jira] [Updated] (SPARK-6561) Add partition support in saveAsParquet

[ https://issues.apache.org/jira/browse/SPARK-6561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-6561: --- Affects Version/s: (was: 1.3.1) (was: 1.3.0) Add partition

[jira] [Updated] (SPARK-6119) better support for working with missing data

[ https://issues.apache.org/jira/browse/SPARK-6119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-6119: --- Description: Real world data can be messy. An important feature of data frames is support for

[jira] [Assigned] (SPARK-6406) Launcher backward compatibility issues

[ https://issues.apache.org/jira/browse/SPARK-6406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6406: --- Assignee: Apache Spark Launcher backward compatibility issues

[jira] [Resolved] (SPARK-6341) Upgrade breeze from 0.11.1 to 0.11.2 or later

[ https://issues.apache.org/jira/browse/SPARK-6341?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-6341. -- Resolution: Fixed Fix Version/s: 1.4.0 1.3.1 Issue resolved by pull

[jira] [Updated] (SPARK-6341) Upgrade breeze from 0.11.1 to 0.11.2 or later

[ https://issues.apache.org/jira/browse/SPARK-6341?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-6341: - Assignee: Yu Ishikawa Upgrade breeze from 0.11.1 to 0.11.2 or later

[jira] [Updated] (SPARK-6443) Could not submit app in standalone cluster mode when HA is enabled

[ https://issues.apache.org/jira/browse/SPARK-6443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Wang updated SPARK-6443: Priority: Critical (was: Major) Could not submit app in standalone cluster mode when HA is enabled

[jira] [Created] (SPARK-6567) Large linear model parallelism via a join and reduceByKey

Reza Zadeh created SPARK-6567: - Summary: Large linear model parallelism via a join and reduceByKey Key: SPARK-6567 URL: https://issues.apache.org/jira/browse/SPARK-6567 Project: Spark Issue

[jira] [Created] (SPARK-6568) spark-shell.cmd --jars option does not accept the jar that has space in its path

Masayoshi TSUZUKI created SPARK-6568: Summary: spark-shell.cmd --jars option does not accept the jar that has space in its path Key: SPARK-6568 URL: https://issues.apache.org/jira/browse/SPARK-6568

[jira] [Created] (SPARK-6569) Kafka directInputStream logs what appear to be incorrect warnings

Platon Potapov created SPARK-6569: - Summary: Kafka directInputStream logs what appear to be incorrect warnings Key: SPARK-6569 URL: https://issues.apache.org/jira/browse/SPARK-6569 Project: Spark

[jira] [Assigned] (SPARK-5111) HiveContext and Thriftserver cannot work in secure cluster beyond hadoop2.5

[ https://issues.apache.org/jira/browse/SPARK-5111?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-5111: --- Assignee: (was: Apache Spark) HiveContext and Thriftserver cannot work in secure

[jira] [Assigned] (SPARK-5111) HiveContext and Thriftserver cannot work in secure cluster beyond hadoop2.5

[ https://issues.apache.org/jira/browse/SPARK-5111?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-5111: --- Assignee: Apache Spark HiveContext and Thriftserver cannot work in secure cluster beyond

[jira] [Commented] (SPARK-6566) Update Spark to use the latest version of Parquet libraries

[ https://issues.apache.org/jira/browse/SPARK-6566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14383627#comment-14383627 ] Cheng Lian commented on SPARK-6566: --- Hi [~k.shaposhni...@gmail.com], as described in

[jira] [Updated] (SPARK-6569) Kafka directInputStream logs what appear to be incorrect warnings

[ https://issues.apache.org/jira/browse/SPARK-6569?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Platon Potapov updated SPARK-6569: -- Description: During what appears to be normal operation of streaming from a Kafka topic, the

[jira] [Updated] (SPARK-6569) Kafka directInputStream logs what appear to be incorrect warnings

[ https://issues.apache.org/jira/browse/SPARK-6569?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Platon Potapov updated SPARK-6569: -- Description: During what appears to be normal operation of streaming from a Kafka topic, the

[jira] [Assigned] (SPARK-6548) Adding stddev to DataFrame functions

[ https://issues.apache.org/jira/browse/SPARK-6548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6548: --- Assignee: (was: Apache Spark) Adding stddev to DataFrame functions

[jira] [Assigned] (SPARK-6548) Adding stddev to DataFrame functions

[ https://issues.apache.org/jira/browse/SPARK-6548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6548: --- Assignee: Apache Spark Adding stddev to DataFrame functions

[jira] [Commented] (SPARK-6548) Adding stddev to DataFrame functions

[ https://issues.apache.org/jira/browse/SPARK-6548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14383635#comment-14383635 ] Apache Spark commented on SPARK-6548: - User 'dreamquster' has created a pull request

[jira] [Commented] (SPARK-6489) Optimize lateral view with explode to not read unnecessary columns

[ https://issues.apache.org/jira/browse/SPARK-6489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14383650#comment-14383650 ] sdfox commented on SPARK-6489: -- I am interesting in this. Optimize lateral view with

[jira] [Created] (SPARK-6564) SQLContext.emptyDataFrame should contain 0 rows, not 1 row

Reynold Xin created SPARK-6564: -- Summary: SQLContext.emptyDataFrame should contain 0 rows, not 1 row Key: SPARK-6564 URL: https://issues.apache.org/jira/browse/SPARK-6564 Project: Spark Issue

[jira] [Commented] (SPARK-6435) spark-shell --jars option does not add all jars to classpath

[ https://issues.apache.org/jira/browse/SPARK-6435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14383599#comment-14383599 ] Masayoshi TSUZUKI commented on SPARK-6435: -- Release 1.3.0 works fine. But the

[jira] [Created] (SPARK-6562) DataFrame.replace value support

Reynold Xin created SPARK-6562: -- Summary: DataFrame.replace value support Key: SPARK-6562 URL: https://issues.apache.org/jira/browse/SPARK-6562 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-6119) DataFrame.dropna support

[ https://issues.apache.org/jira/browse/SPARK-6119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-6119: --- Summary: DataFrame.dropna support (was: better support for working with missing data)

[jira] [Created] (SPARK-6563) DataFrame.fillna

Reynold Xin created SPARK-6563: -- Summary: DataFrame.fillna Key: SPARK-6563 URL: https://issues.apache.org/jira/browse/SPARK-6563 Project: Spark Issue Type: Sub-task Reporter:

[jira] [Updated] (SPARK-6119) DataFrame.dropna support

[ https://issues.apache.org/jira/browse/SPARK-6119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-6119: --- Description: Support dropping rows with null values (dropna). Similar to Pandas' dropna

[jira] [Commented] (SPARK-6435) spark-shell --jars option does not add all jars to classpath

[ https://issues.apache.org/jira/browse/SPARK-6435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14383560#comment-14383560 ] Masayoshi TSUZUKI commented on SPARK-6435: -- I looked into the script of the

[jira] [Commented] (SPARK-5389) spark-shell.cmd does not run from DOS Windows 7

[ https://issues.apache.org/jira/browse/SPARK-5389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14383550#comment-14383550 ] Masayoshi TSUZUKI commented on SPARK-5389: -- Hmm... sorry it seems different case

[jira] [Commented] (SPARK-6119) DataFrame.dropna support

[ https://issues.apache.org/jira/browse/SPARK-6119?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14383491#comment-14383491 ] Apache Spark commented on SPARK-6119: - User 'rxin' has created a pull request for this

[jira] [Assigned] (SPARK-6119) DataFrame.dropna support

[ https://issues.apache.org/jira/browse/SPARK-6119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6119: --- Assignee: (was: Apache Spark) DataFrame.dropna support

[jira] [Assigned] (SPARK-6119) DataFrame.dropna support

[ https://issues.apache.org/jira/browse/SPARK-6119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6119: --- Assignee: Apache Spark DataFrame.dropna support

[jira] [Assigned] (SPARK-6564) SQLContext.emptyDataFrame should contain 0 rows, not 1 row

[ https://issues.apache.org/jira/browse/SPARK-6564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6564: --- Assignee: Apache Spark (was: Reynold Xin) SQLContext.emptyDataFrame should contain 0 rows,

[jira] [Assigned] (SPARK-6564) SQLContext.emptyDataFrame should contain 0 rows, not 1 row

[ https://issues.apache.org/jira/browse/SPARK-6564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6564: --- Assignee: Reynold Xin (was: Apache Spark) SQLContext.emptyDataFrame should contain 0 rows,

[jira] [Commented] (SPARK-6564) SQLContext.emptyDataFrame should contain 0 rows, not 1 row

[ https://issues.apache.org/jira/browse/SPARK-6564?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14383495#comment-14383495 ] Apache Spark commented on SPARK-6564: - User 'rxin' has created a pull request for this

[jira] [Created] (SPARK-6565) Deprecate jsonRDD and replace it by jsonDataFrame / jsonDF

Cheng Lian created SPARK-6565: - Summary: Deprecate jsonRDD and replace it by jsonDataFrame / jsonDF Key: SPARK-6565 URL: https://issues.apache.org/jira/browse/SPARK-6565 Project: Spark Issue

[jira] [Commented] (SPARK-6406) Launcher backward compatibility issues

[ https://issues.apache.org/jira/browse/SPARK-6406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14383519#comment-14383519 ] Sean Owen commented on SPARK-6406: -- (Might want to update the title and description to

[jira] [Commented] (SPARK-6435) spark-shell --jars option does not add all jars to classpath

[ https://issues.apache.org/jira/browse/SPARK-6435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14383601#comment-14383601 ] Apache Spark commented on SPARK-6435: - User 'tsudukim' has created a pull request for

[jira] [Assigned] (SPARK-6435) spark-shell --jars option does not add all jars to classpath

[ https://issues.apache.org/jira/browse/SPARK-6435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6435: --- Assignee: (was: Apache Spark) spark-shell --jars option does not add all jars to

[jira] [Assigned] (SPARK-6435) spark-shell --jars option does not add all jars to classpath

[ https://issues.apache.org/jira/browse/SPARK-6435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6435: --- Assignee: Apache Spark spark-shell --jars option does not add all jars to classpath

[jira] [Created] (SPARK-6566) Update Spark to use the latest version of Parquet libraries

Konstantin Shaposhnikov created SPARK-6566: -- Summary: Update Spark to use the latest version of Parquet libraries Key: SPARK-6566 URL: https://issues.apache.org/jira/browse/SPARK-6566

[jira] [Commented] (SPARK-6435) spark-shell --jars option does not add all jars to classpath

[ https://issues.apache.org/jira/browse/SPARK-6435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14383566#comment-14383566 ] vijay commented on SPARK-6435: -- Strange - when I test it with multiple jars (with the fixed

[jira] [Comment Edited] (SPARK-6435) spark-shell --jars option does not add all jars to classpath

[ https://issues.apache.org/jira/browse/SPARK-6435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14383566#comment-14383566 ] vijay edited comment on SPARK-6435 at 3/27/15 9:17 AM: --- Strange -

[jira] [Assigned] (SPARK-6255) Python MLlib API missing items: Classification

[ https://issues.apache.org/jira/browse/SPARK-6255?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6255: --- Assignee: Apache Spark (was: Yanbo Liang) Python MLlib API missing items: Classification

[jira] [Assigned] (SPARK-6255) Python MLlib API missing items: Classification

[ https://issues.apache.org/jira/browse/SPARK-6255?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6255: --- Assignee: Yanbo Liang (was: Apache Spark) Python MLlib API missing items: Classification

[jira] [Assigned] (SPARK-5563) LDA with online variational inference

[ https://issues.apache.org/jira/browse/SPARK-5563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-5563: --- Assignee: Apache Spark (was: yuhao yang) LDA with online variational inference

[jira] [Assigned] (SPARK-5563) LDA with online variational inference

[ https://issues.apache.org/jira/browse/SPARK-5563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-5563: --- Assignee: yuhao yang (was: Apache Spark) LDA with online variational inference

[jira] [Commented] (SPARK-6435) spark-shell --jars option does not add all jars to classpath

[ https://issues.apache.org/jira/browse/SPARK-6435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14383729#comment-14383729 ] Sean Owen commented on SPARK-6435: -- OK, [~vjapache] would you like to submit a PR that

[jira] [Updated] (SPARK-6556) Fix wrong parsing logic of executorTimeoutMs and checkTimeoutIntervalMs in HeartbeatReceiver

[ https://issues.apache.org/jira/browse/SPARK-6556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-6556: - Affects Version/s: 1.4.0 Fix wrong parsing logic of executorTimeoutMs and checkTimeoutIntervalMs in

[jira] [Resolved] (SPARK-6556) Fix wrong parsing logic of executorTimeoutMs and checkTimeoutIntervalMs in HeartbeatReceiver

[ https://issues.apache.org/jira/browse/SPARK-6556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-6556. -- Resolution: Fixed Fix Version/s: 1.4.0 Assignee: Shixiong Zhu Fix wrong parsing logic

[jira] [Assigned] (SPARK-5155) Python API for MQTT streaming

[ https://issues.apache.org/jira/browse/SPARK-5155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-5155: --- Assignee: Prabeesh K (was: Apache Spark) Python API for MQTT streaming

[jira] [Assigned] (SPARK-5155) Python API for MQTT streaming

[ https://issues.apache.org/jira/browse/SPARK-5155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-5155: --- Assignee: Apache Spark (was: Prabeesh K) Python API for MQTT streaming

[jira] [Resolved] (SPARK-6569) Kafka directInputStream logs what appear to be incorrect warnings

[ https://issues.apache.org/jira/browse/SPARK-6569?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-6569. -- Resolution: Duplicate Kafka directInputStream logs what appear to be incorrect warnings

[jira] [Resolved] (SPARK-6535) new RDD function that returns intermediate Future

[ https://issues.apache.org/jira/browse/SPARK-6535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-6535. -- Resolution: Not a Problem I think it's fair to say that this would not require a change to Spark to

[jira] [Assigned] (SPARK-6440) ipv6 URI for HttpServer

[ https://issues.apache.org/jira/browse/SPARK-6440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6440: --- Assignee: (was: Apache Spark) ipv6 URI for HttpServer ---

[jira] [Assigned] (SPARK-6440) ipv6 URI for HttpServer

[ https://issues.apache.org/jira/browse/SPARK-6440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6440: --- Assignee: Apache Spark ipv6 URI for HttpServer ---

[jira] [Assigned] (SPARK-6558) Utils.getCurrentUserName returns the full principal name instead of login name

[ https://issues.apache.org/jira/browse/SPARK-6558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6558: --- Assignee: Apache Spark (was: Thomas Graves) Utils.getCurrentUserName returns the full

[jira] [Updated] (SPARK-6570) Spark SQL arrays: explode() fails and cannot save array type to Parquet

[ https://issues.apache.org/jira/browse/SPARK-6570?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jon Chase updated SPARK-6570: - Summary: Spark SQL arrays: explode() fails and cannot save array type to Parquet (was: Spark SQL

[jira] [Commented] (SPARK-6570) Spark SQL explode() fails, assumes underlying SQL array is represented by Scala Seq

[ https://issues.apache.org/jira/browse/SPARK-6570?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14383794#comment-14383794 ] Jon Chase commented on SPARK-6570: -- Stack trace for saveAsParquetFile(): {code} root

[jira] [Assigned] (SPARK-1684) Merge script should standardize SPARK-XXX prefix

[ https://issues.apache.org/jira/browse/SPARK-1684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-1684: --- Assignee: Patrick Wendell (was: Apache Spark) Merge script should standardize SPARK-XXX

[jira] [Created] (SPARK-6571) MatrixFactorizationModel created by load fails on predictAll

Charles Hayden created SPARK-6571: - Summary: MatrixFactorizationModel created by load fails on predictAll Key: SPARK-6571 URL: https://issues.apache.org/jira/browse/SPARK-6571 Project: Spark

[jira] [Assigned] (SPARK-6348) Enable useFeatureScaling in SVMWithSGD

[ https://issues.apache.org/jira/browse/SPARK-6348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6348: --- Assignee: (was: Apache Spark) Enable useFeatureScaling in SVMWithSGD

[jira] [Assigned] (SPARK-6558) Utils.getCurrentUserName returns the full principal name instead of login name

[ https://issues.apache.org/jira/browse/SPARK-6558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves reassigned SPARK-6558: Assignee: Thomas Graves Utils.getCurrentUserName returns the full principal name instead

[jira] [Commented] (SPARK-5493) Support proxy users under kerberos

[ https://issues.apache.org/jira/browse/SPARK-5493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14383856#comment-14383856 ] Thomas Graves commented on SPARK-5493: -- [~vanzin] I must be missing something. Why

[jira] [Assigned] (SPARK-1684) Merge script should standardize SPARK-XXX prefix

[ https://issues.apache.org/jira/browse/SPARK-1684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-1684: --- Assignee: Apache Spark (was: Patrick Wendell) Merge script should standardize SPARK-XXX

[jira] [Assigned] (SPARK-6348) Enable useFeatureScaling in SVMWithSGD

[ https://issues.apache.org/jira/browse/SPARK-6348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6348: --- Assignee: Apache Spark Enable useFeatureScaling in SVMWithSGD

[jira] [Assigned] (SPARK-6558) Utils.getCurrentUserName returns the full principal name instead of login name

[ https://issues.apache.org/jira/browse/SPARK-6558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6558: --- Assignee: Thomas Graves (was: Apache Spark) Utils.getCurrentUserName returns the full

[jira] [Commented] (SPARK-6558) Utils.getCurrentUserName returns the full principal name instead of login name

[ https://issues.apache.org/jira/browse/SPARK-6558?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14383843#comment-14383843 ] Apache Spark commented on SPARK-6558: - User 'tgravescs' has created a pull request for

[jira] [Comment Edited] (SPARK-5493) Support proxy users under kerberos

[ https://issues.apache.org/jira/browse/SPARK-5493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14383856#comment-14383856 ] Thomas Graves edited comment on SPARK-5493 at 3/27/15 2:00 PM:

[jira] [Resolved] (SPARK-6544) Problem with Avro and Kryo Serialization

[ https://issues.apache.org/jira/browse/SPARK-6544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-6544. -- Resolution: Fixed Fix Version/s: 1.4.0 Issue resolved by pull request 5193

[jira] [Created] (SPARK-6572) When I build Spark 1.3 sbt gives me to following error : unresolved dependency: org.apache.kafka#kafka_2.11;0.8.1.1: not found org.scalamacros#quasiquotes_2.11;2.0.1:

Frank Domoney created SPARK-6572: Summary: When I build Spark 1.3 sbt gives me to following error : unresolved dependency: org.apache.kafka#kafka_2.11;0.8.1.1: not found org.scalamacros#quasiquotes_2.11;2.0.1: not found [error] Total time:

[jira] [Reopened] (SPARK-6569) Kafka directInputStream logs what appear to be incorrect warnings

[ https://issues.apache.org/jira/browse/SPARK-6569?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Platon Potapov reopened SPARK-6569: --- Sean, please explain if the condition really mandates a warning being logged. The scenario in

[jira] [Created] (SPARK-6573) expect pandas null values as numpy.nan (not only as None)

Fabian Boehnlein created SPARK-6573: --- Summary: expect pandas null values as numpy.nan (not only as None) Key: SPARK-6573 URL: https://issues.apache.org/jira/browse/SPARK-6573 Project: Spark

[jira] [Commented] (SPARK-6569) Kafka directInputStream logs what appear to be incorrect warnings

[ https://issues.apache.org/jira/browse/SPARK-6569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14383973#comment-14383973 ] Sean Owen commented on SPARK-6569: -- [~c...@koeninger.org] what do you think of the

[jira] [Updated] (SPARK-6573) expect pandas null values as numpy.nan (not only as None)

[ https://issues.apache.org/jira/browse/SPARK-6573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fabian Boehnlein updated SPARK-6573: Issue Type: Sub-task (was: Improvement) Parent: SPARK-6116 expect pandas null

[jira] [Assigned] (SPARK-6574) Python Example sql.py not working in version 1.3

[ https://issues.apache.org/jira/browse/SPARK-6574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6574: --- Assignee: Apache Spark (was: Davies Liu) Python Example sql.py not working in version 1.3

[jira] [Commented] (SPARK-5493) Support proxy users under kerberos

[ https://issues.apache.org/jira/browse/SPARK-5493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14384140#comment-14384140 ] Marcelo Vanzin commented on SPARK-5493: --- I'm not terribly familiar with how Oozie

[jira] [Commented] (SPARK-5493) Support proxy users under kerberos

[ https://issues.apache.org/jira/browse/SPARK-5493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14384145#comment-14384145 ] Marcelo Vanzin commented on SPARK-5493: --- Direct link:

[jira] [Commented] (SPARK-4660) JavaSerializer uses wrong classloader

[ https://issues.apache.org/jira/browse/SPARK-4660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14384142#comment-14384142 ] sam commented on SPARK-4660: Furthermore it seems this issue is more likely to happen when I

[jira] [Created] (SPARK-6574) Python Example sql.py not working in version 1.3

Davies Liu created SPARK-6574: - Summary: Python Example sql.py not working in version 1.3 Key: SPARK-6574 URL: https://issues.apache.org/jira/browse/SPARK-6574 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-6565) Deprecate jsonRDD and replace it by jsonDataFrame / jsonDF

[ https://issues.apache.org/jira/browse/SPARK-6565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14384161#comment-14384161 ] Michael Armbrust commented on SPARK-6565: - It is not that it returns an RDD, it is

[jira] [Assigned] (SPARK-6574) Python Example sql.py not working in version 1.3

[ https://issues.apache.org/jira/browse/SPARK-6574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6574: --- Assignee: Davies Liu (was: Apache Spark) Python Example sql.py not working in version 1.3

[jira] [Commented] (SPARK-5493) Support proxy users under kerberos

[ https://issues.apache.org/jira/browse/SPARK-5493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14384218#comment-14384218 ] Brock Noland commented on SPARK-5493: - I don't know 100% about how oozie works but I

[jira] [Commented] (SPARK-6574) Python Example sql.py not working in version 1.3

[ https://issues.apache.org/jira/browse/SPARK-6574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14384172#comment-14384172 ] Apache Spark commented on SPARK-6574: - User 'davies' has created a pull request for

[jira] [Updated] (SPARK-5493) Support proxy users under kerberos

[ https://issues.apache.org/jira/browse/SPARK-5493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves updated SPARK-5493: - Description: When using kerberos, services may want to use spark-submit to submit jobs as a

[jira] [Commented] (SPARK-6572) When I build Spark 1.3 sbt gives me to following error : unresolved dependency: org.apache.kafka#kafka_2.11;0.8.1.1: not found org.scalamacros#quasiquotes_2.11;2.0.1

[ https://issues.apache.org/jira/browse/SPARK-6572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14383999#comment-14383999 ] Cheng Lian commented on SPARK-6572: --- Would you please provide exact command line you

[jira] [Commented] (SPARK-6569) Kafka directInputStream logs what appear to be incorrect warnings

[ https://issues.apache.org/jira/browse/SPARK-6569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14384038#comment-14384038 ] Cody Koeninger commented on SPARK-6569: --- I set it as warn because an empty batch can

[jira] [Commented] (SPARK-6572) When I build Spark 1.3 sbt gives me to following error : unresolved dependency: org.apache.kafka#kafka_2.11;0.8.1.1: not found org.scalamacros#quasiquotes_2.11;2.0.1

[ https://issues.apache.org/jira/browse/SPARK-6572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14384037#comment-14384037 ] Sean Owen commented on SPARK-6572: -- It builds correctly for me in branch 1.3 with

[jira] [Commented] (SPARK-6572) When I build Spark 1.3 sbt gives me to following error : unresolved dependency: org.apache.kafka#kafka_2.11;0.8.1.1: not found org.scalamacros#quasiquotes_2.11;2.0.1

[ https://issues.apache.org/jira/browse/SPARK-6572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14384006#comment-14384006 ] Frank Domoney commented on SPARK-6572: -- the correct URL for the kafka is

[jira] [Commented] (SPARK-6576) DenseMatrix in PySpark should support indexing

[ https://issues.apache.org/jira/browse/SPARK-6576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14384432#comment-14384432 ] Apache Spark commented on SPARK-6576: - User 'MechCoder' has created a pull request for

[jira] [Assigned] (SPARK-6576) DenseMatrix in PySpark should support indexing

[ https://issues.apache.org/jira/browse/SPARK-6576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6576: --- Assignee: (was: Apache Spark) DenseMatrix in PySpark should support indexing

[jira] [Assigned] (SPARK-4069) [SPARK-YARN] ApplicationMaster should release all executors' containers before unregistering itself from Yarn RM

[ https://issues.apache.org/jira/browse/SPARK-4069?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-4069: --- Assignee: (was: Apache Spark) [SPARK-YARN] ApplicationMaster should release all

[jira] [Commented] (SPARK-6479) Create off-heap block storage API (internal)

[ https://issues.apache.org/jira/browse/SPARK-6479?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14384520#comment-14384520 ] Steve Loughran commented on SPARK-6479: --- Henry: utterly unrelated. I was merely

[jira] [Commented] (SPARK-6479) Create off-heap block storage API (internal)

[ https://issues.apache.org/jira/browse/SPARK-6479?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14384525#comment-14384525 ] Henry Saputra commented on SPARK-6479: -- @Steve: Ah cool, thanks for clarifying =)

  1   2   >