[jira] [Commented] (SPARK-18761) Uncancellable / unkillable tasks may starve jobs of resoures

2016-12-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15727896#comment-15727896 ] Apache Spark commented on SPARK-18761: -- User 'JoshRosen' has created a pull request

[jira] [Assigned] (SPARK-18761) Uncancellable / unkillable tasks may starve jobs of resoures

2016-12-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18761: Assignee: Josh Rosen (was: Apache Spark) > Uncancellable / unkillable tasks may starve jo

[jira] [Assigned] (SPARK-18761) Uncancellable / unkillable tasks may starve jobs of resoures

2016-12-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18761: Assignee: Apache Spark (was: Josh Rosen) > Uncancellable / unkillable tasks may starve jo

[jira] [Commented] (SPARK-18761) Uncancellable / unkillable tasks may starve jobs of resoures

2016-12-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15727983#comment-15727983 ] Apache Spark commented on SPARK-18761: -- User 'sarutak' has created a pull request fo

[jira] [Assigned] (SPARK-18762) Web UI should be http:4040 instead of https:4040

2016-12-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18762: Assignee: (was: Apache Spark) > Web UI should be http:4040 instead of https:4040 > ---

[jira] [Assigned] (SPARK-18762) Web UI should be http:4040 instead of https:4040

2016-12-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18762: Assignee: Apache Spark > Web UI should be http:4040 instead of https:4040 > --

[jira] [Commented] (SPARK-18762) Web UI should be http:4040 instead of https:4040

2016-12-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15727990#comment-15727990 ] Apache Spark commented on SPARK-18762: -- User 'sarutak' has created a pull request fo

[jira] [Assigned] (SPARK-18764) Add a warning log when skipping a corrupted file

2016-12-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18764: Assignee: Shixiong Zhu (was: Apache Spark) > Add a warning log when skipping a corrupted

[jira] [Commented] (SPARK-18764) Add a warning log when skipping a corrupted file

2016-12-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15728021#comment-15728021 ] Apache Spark commented on SPARK-18764: -- User 'zsxwing' has created a pull request fo

[jira] [Assigned] (SPARK-18764) Add a warning log when skipping a corrupted file

2016-12-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18764: Assignee: Apache Spark (was: Shixiong Zhu) > Add a warning log when skipping a corrupted

[jira] [Assigned] (SPARK-18766) Push Down Filter Through BatchEvalPython

2016-12-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18766: Assignee: (was: Apache Spark) > Push Down Filter Through BatchEvalPython > ---

[jira] [Assigned] (SPARK-18766) Push Down Filter Through BatchEvalPython

2016-12-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18766: Assignee: Apache Spark > Push Down Filter Through BatchEvalPython > --

[jira] [Commented] (SPARK-18766) Push Down Filter Through BatchEvalPython

2016-12-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18766?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15728101#comment-15728101 ] Apache Spark commented on SPARK-18766: -- User 'gatorsmile' has created a pull request

[jira] [Commented] (SPARK-18767) Unify Models' toString methods

2016-12-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15728148#comment-15728148 ] Apache Spark commented on SPARK-18767: -- User 'zhengruifeng' has created a pull reque

[jira] [Assigned] (SPARK-18767) Unify Models' toString methods

2016-12-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18767: Assignee: Apache Spark > Unify Models' toString methods > -- >

[jira] [Assigned] (SPARK-18767) Unify Models' toString methods

2016-12-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18767: Assignee: (was: Apache Spark) > Unify Models' toString methods > -

[jira] [Commented] (SPARK-18765) Make values for spark.yarn.{am|driver|executor}.memoryOverhead have configurable units

2016-12-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15728310#comment-15728310 ] Apache Spark commented on SPARK-18765: -- User 'daisukebe' has created a pull request

[jira] [Assigned] (SPARK-18765) Make values for spark.yarn.{am|driver|executor}.memoryOverhead have configurable units

2016-12-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18765: Assignee: (was: Apache Spark) > Make values for spark.yarn.{am|driver|executor}.memory

[jira] [Assigned] (SPARK-18765) Make values for spark.yarn.{am|driver|executor}.memoryOverhead have configurable units

2016-12-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18765: Assignee: Apache Spark > Make values for spark.yarn.{am|driver|executor}.memoryOverhead ha

[jira] [Commented] (SPARK-18231) Optimise SizeEstimator implementation

2016-12-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15728425#comment-15728425 ] Apache Spark commented on SPARK-18231: -- User 'a-roberts' has created a pull request

[jira] [Assigned] (SPARK-18231) Optimise SizeEstimator implementation

2016-12-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18231: Assignee: Apache Spark > Optimise SizeEstimator implementation > -

[jira] [Assigned] (SPARK-18231) Optimise SizeEstimator implementation

2016-12-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18231: Assignee: (was: Apache Spark) > Optimise SizeEstimator implementation > --

[jira] [Commented] (SPARK-17760) DataFrame's pivot doesn't see column created in groupBy

2016-12-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17760?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15728935#comment-15728935 ] Apache Spark commented on SPARK-17760: -- User 'aray' has created a pull request for t

[jira] [Assigned] (SPARK-18772) Parsing JSON with some NaN and Infinity values throws NumberFormatException

2016-12-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18772: Assignee: Apache Spark > Parsing JSON with some NaN and Infinity values throws NumberForma

[jira] [Commented] (SPARK-18772) Parsing JSON with some NaN and Infinity values throws NumberFormatException

2016-12-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18772?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15730323#comment-15730323 ] Apache Spark commented on SPARK-18772: -- User 'NathanHowell' has created a pull reque

[jira] [Assigned] (SPARK-18772) Parsing JSON with some NaN and Infinity values throws NumberFormatException

2016-12-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18772: Assignee: (was: Apache Spark) > Parsing JSON with some NaN and Infinity values throws

[jira] [Assigned] (SPARK-18773) Make translation of Spark configs to commons-crypto configs consistent

2016-12-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18773?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18773: Assignee: (was: Apache Spark) > Make translation of Spark configs to commons-crypto co

[jira] [Commented] (SPARK-18773) Make translation of Spark configs to commons-crypto configs consistent

2016-12-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15730348#comment-15730348 ] Apache Spark commented on SPARK-18773: -- User 'vanzin' has created a pull request for

[jira] [Assigned] (SPARK-18773) Make translation of Spark configs to commons-crypto configs consistent

2016-12-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18773?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18773: Assignee: Apache Spark > Make translation of Spark configs to commons-crypto configs consi

[jira] [Commented] (SPARK-3359) `sbt/sbt unidoc` doesn't work with Java 8

2016-12-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15730387#comment-15730387 ] Apache Spark commented on SPARK-3359: - User 'michalsenkyr' has created a pull request

[jira] [Commented] (SPARK-18662) Move cluster managers into their own sub-directory

2016-12-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18662?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15730428#comment-15730428 ] Apache Spark commented on SPARK-18662: -- User 'vanzin' has created a pull request for

[jira] [Assigned] (SPARK-18774) Ignore non-existing files when ignoreCorruptFiles is enabled

2016-12-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18774: Assignee: Shixiong Zhu (was: Apache Spark) > Ignore non-existing files when ignoreCorrupt

[jira] [Commented] (SPARK-18774) Ignore non-existing files when ignoreCorruptFiles is enabled

2016-12-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15730465#comment-15730465 ] Apache Spark commented on SPARK-18774: -- User 'zsxwing' has created a pull request fo

[jira] [Assigned] (SPARK-18774) Ignore non-existing files when ignoreCorruptFiles is enabled

2016-12-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18774: Assignee: Apache Spark (was: Shixiong Zhu) > Ignore non-existing files when ignoreCorrupt

[jira] [Assigned] (SPARK-18775) Limit the max number of records written per file

2016-12-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18775?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18775: Assignee: Apache Spark (was: Reynold Xin) > Limit the max number of records written per f

[jira] [Assigned] (SPARK-18775) Limit the max number of records written per file

2016-12-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18775?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18775: Assignee: Reynold Xin (was: Apache Spark) > Limit the max number of records written per f

[jira] [Commented] (SPARK-18775) Limit the max number of records written per file

2016-12-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18775?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15730476#comment-15730476 ] Apache Spark commented on SPARK-18775: -- User 'rxin' has created a pull request for t

[jira] [Assigned] (SPARK-18776) Offset for FileStreamSource is not json formatted

2016-12-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18776: Assignee: Apache Spark (was: Tathagata Das) > Offset for FileStreamSource is not json for

[jira] [Assigned] (SPARK-18776) Offset for FileStreamSource is not json formatted

2016-12-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18776: Assignee: Tathagata Das (was: Apache Spark) > Offset for FileStreamSource is not json for

[jira] [Commented] (SPARK-18776) Offset for FileStreamSource is not json formatted

2016-12-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15731003#comment-15731003 ] Apache Spark commented on SPARK-18776: -- User 'tdas' has created a pull request for t

[jira] [Commented] (SPARK-10849) Allow user to specify database column type for data frame fields when writing data to jdbc data sources.

2016-12-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15731326#comment-15731326 ] Apache Spark commented on SPARK-10849: -- User 'sureshthalamati' has created a pull re

[jira] [Commented] (SPARK-10849) Allow user to specify database column type for data frame fields when writing data to jdbc data sources.

2016-12-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15731347#comment-15731347 ] Apache Spark commented on SPARK-10849: -- User 'sureshthalamati' has created a pull re

[jira] [Assigned] (SPARK-18778) Fix the Scala classpath in the spark-shell

2016-12-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18778: Assignee: (was: Apache Spark) > Fix the Scala classpath in the spark-shell > -

[jira] [Commented] (SPARK-18778) Fix the Scala classpath in the spark-shell

2016-12-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15731432#comment-15731432 ] Apache Spark commented on SPARK-18778: -- User 'djvulee' has created a pull request fo

[jira] [Assigned] (SPARK-18778) Fix the Scala classpath in the spark-shell

2016-12-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18778: Assignee: Apache Spark > Fix the Scala classpath in the spark-shell >

[jira] [Assigned] (SPARK-18576) Expose basic TaskContext info in PySpark

2016-12-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18576: Assignee: (was: Apache Spark) > Expose basic TaskContext info in PySpark > ---

[jira] [Assigned] (SPARK-18576) Expose basic TaskContext info in PySpark

2016-12-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18576: Assignee: Apache Spark > Expose basic TaskContext info in PySpark > --

[jira] [Commented] (SPARK-18576) Expose basic TaskContext info in PySpark

2016-12-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15731722#comment-15731722 ] Apache Spark commented on SPARK-18576: -- User 'holdenk' has created a pull request fo

[jira] [Assigned] (SPARK-18782) Bump Hadoop 2.6 version to use Hadoop 2.6.5

2016-12-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18782: Assignee: Apache Spark > Bump Hadoop 2.6 version to use Hadoop 2.6.5 > ---

[jira] [Commented] (SPARK-18782) Bump Hadoop 2.6 version to use Hadoop 2.6.5

2016-12-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15731806#comment-15731806 ] Apache Spark commented on SPARK-18782: -- User 'a-roberts' has created a pull request

[jira] [Assigned] (SPARK-18782) Bump Hadoop 2.6 version to use Hadoop 2.6.5

2016-12-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18782: Assignee: (was: Apache Spark) > Bump Hadoop 2.6 version to use Hadoop 2.6.5 >

[jira] [Assigned] (SPARK-18020) Kinesis receiver does not snapshot when shard completes

2016-12-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18020: Assignee: Apache Spark > Kinesis receiver does not snapshot when shard completes > ---

[jira] [Assigned] (SPARK-18020) Kinesis receiver does not snapshot when shard completes

2016-12-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18020: Assignee: (was: Apache Spark) > Kinesis receiver does not snapshot when shard complete

[jira] [Commented] (SPARK-18020) Kinesis receiver does not snapshot when shard completes

2016-12-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18020?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15731884#comment-15731884 ] Apache Spark commented on SPARK-18020: -- User 'maropu' has created a pull request for

[jira] [Commented] (SPARK-18325) SparkR 2.1 QA: Check for new R APIs requiring example code

2016-12-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15732182#comment-15732182 ] Apache Spark commented on SPARK-18325: -- User 'yanboliang' has created a pull request

[jira] [Commented] (SPARK-18774) Ignore non-existing files when ignoreCorruptFiles is enabled

2016-12-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15733163#comment-15733163 ] Apache Spark commented on SPARK-18774: -- User 'zsxwing' has created a pull request fo

[jira] [Assigned] (SPARK-18790) Keep a general offset history of stream batches

2016-12-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18790: Assignee: Apache Spark > Keep a general offset history of stream batches > ---

[jira] [Commented] (SPARK-18790) Keep a general offset history of stream batches

2016-12-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18790?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15733383#comment-15733383 ] Apache Spark commented on SPARK-18790: -- User 'tcondie' has created a pull request fo

[jira] [Assigned] (SPARK-18790) Keep a general offset history of stream batches

2016-12-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18790: Assignee: (was: Apache Spark) > Keep a general offset history of stream batches >

[jira] [Commented] (SPARK-18590) R - Include package vignettes and help pages, build source package in Spark distribution

2016-12-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15733395#comment-15733395 ] Apache Spark commented on SPARK-18590: -- User 'shivaram' has created a pull request f

[jira] [Assigned] (SPARK-18796) StreamingQueryManager should not hold a lock when starting a query

2016-12-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18796: Assignee: Apache Spark > StreamingQueryManager should not hold a lock when starting a quer

[jira] [Assigned] (SPARK-18796) StreamingQueryManager should not hold a lock when starting a query

2016-12-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18796: Assignee: (was: Apache Spark) > StreamingQueryManager should not hold a lock when star

[jira] [Commented] (SPARK-18796) StreamingQueryManager should not hold a lock when starting a query

2016-12-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15733606#comment-15733606 ] Apache Spark commented on SPARK-18796: -- User 'zsxwing' has created a pull request fo

[jira] [Commented] (SPARK-18590) R - Include package vignettes and help pages, build source package in Spark distribution

2016-12-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15733687#comment-15733687 ] Apache Spark commented on SPARK-18590: -- User 'shivaram' has created a pull request f

[jira] [Commented] (SPARK-18797) Update spark.logit in sparkr-vignettes

2016-12-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15733746#comment-15733746 ] Apache Spark commented on SPARK-18797: -- User 'wangmiao1981' has created a pull reque

[jira] [Assigned] (SPARK-18797) Update spark.logit in sparkr-vignettes

2016-12-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18797: Assignee: (was: Apache Spark) > Update spark.logit in sparkr-vignettes > -

[jira] [Assigned] (SPARK-18797) Update spark.logit in sparkr-vignettes

2016-12-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18797: Assignee: Apache Spark > Update spark.logit in sparkr-vignettes >

[jira] [Commented] (SPARK-18697) Upgrade sbt plugins

2016-12-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18697?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15733760#comment-15733760 ] Apache Spark commented on SPARK-18697: -- User 'weiqingy' has created a pull request f

[jira] [Commented] (SPARK-18792) SparkR vignette update: logit

2016-12-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15734013#comment-15734013 ] Apache Spark commented on SPARK-18792: -- User 'mengxr' has created a pull request for

[jira] [Assigned] (SPARK-14932) Allow DataFrame.replace() to replace values with None

2016-12-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14932: Assignee: Apache Spark > Allow DataFrame.replace() to replace values with None > -

[jira] [Assigned] (SPARK-14932) Allow DataFrame.replace() to replace values with None

2016-12-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14932: Assignee: (was: Apache Spark) > Allow DataFrame.replace() to replace values with None

[jira] [Commented] (SPARK-14932) Allow DataFrame.replace() to replace values with None

2016-12-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14932?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15734376#comment-15734376 ] Apache Spark commented on SPARK-14932: -- User 'bravo-zhang' has created a pull reques

[jira] [Assigned] (SPARK-17076) Cardinality estimation of join operator

2016-12-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17076?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17076: Assignee: (was: Apache Spark) > Cardinality estimation of join operator >

[jira] [Commented] (SPARK-17076) Cardinality estimation of join operator

2016-12-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17076?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15734504#comment-15734504 ] Apache Spark commented on SPARK-17076: -- User 'wzhfy' has created a pull request for

[jira] [Assigned] (SPARK-17076) Cardinality estimation of join operator

2016-12-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17076?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17076: Assignee: Apache Spark > Cardinality estimation of join operator > ---

[jira] [Assigned] (SPARK-13747) Concurrent execution in SQL doesn't work with Scala ForkJoinPool

2016-12-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13747: Assignee: Shixiong Zhu (was: Apache Spark) > Concurrent execution in SQL doesn't work wit

[jira] [Assigned] (SPARK-13747) Concurrent execution in SQL doesn't work with Scala ForkJoinPool

2016-12-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13747: Assignee: Apache Spark (was: Shixiong Zhu) > Concurrent execution in SQL doesn't work wit

[jira] [Commented] (SPARK-13747) Concurrent execution in SQL doesn't work with Scala ForkJoinPool

2016-12-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13747?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15734585#comment-15734585 ] Apache Spark commented on SPARK-13747: -- User 'zsxwing' has created a pull request fo

[jira] [Assigned] (SPARK-18800) UnsafeInMemorySorter throws exception when used in UnsafeKVExternalSorter

2016-12-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18800?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18800: Assignee: Apache Spark > UnsafeInMemorySorter throws exception when used in UnsafeKVExtern

[jira] [Assigned] (SPARK-18800) UnsafeInMemorySorter throws exception when used in UnsafeKVExternalSorter

2016-12-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18800?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18800: Assignee: (was: Apache Spark) > UnsafeInMemorySorter throws exception when used in Uns

[jira] [Commented] (SPARK-18800) UnsafeInMemorySorter throws exception when used in UnsafeKVExternalSorter

2016-12-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18800?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15734680#comment-15734680 ] Apache Spark commented on SPARK-18800: -- User 'viirya' has created a pull request for

[jira] [Commented] (SPARK-18801) Add `View` operator to help resolve a view

2016-12-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18801?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15734859#comment-15734859 ] Apache Spark commented on SPARK-18801: -- User 'jiangxb1987' has created a pull reques

[jira] [Assigned] (SPARK-18801) Add `View` operator to help resolve a view

2016-12-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18801?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18801: Assignee: Apache Spark > Add `View` operator to help resolve a view >

[jira] [Assigned] (SPARK-18801) Add `View` operator to help resolve a view

2016-12-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18801?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18801: Assignee: (was: Apache Spark) > Add `View` operator to help resolve a view > -

[jira] [Commented] (SPARK-18803) Fix path-related and JarEntry-related test failures and skip some tests failed on Windows due to path length limitation

2016-12-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18803?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15734862#comment-15734862 ] Apache Spark commented on SPARK-18803: -- User 'HyukjinKwon' has created a pull reques

[jira] [Assigned] (SPARK-18803) Fix path-related and JarEntry-related test failures and skip some tests failed on Windows due to path length limitation

2016-12-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18803: Assignee: (was: Apache Spark) > Fix path-related and JarEntry-related test failures an

[jira] [Assigned] (SPARK-18803) Fix path-related and JarEntry-related test failures and skip some tests failed on Windows due to path length limitation

2016-12-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18803: Assignee: Apache Spark > Fix path-related and JarEntry-related test failures and skip some

[jira] [Assigned] (SPARK-18745) java.lang.IndexOutOfBoundsException running query 68 Spark SQL on (100TB)

2016-12-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18745: Assignee: Kazuaki Ishizaki (was: Apache Spark) > java.lang.IndexOutOfBoundsException runn

[jira] [Commented] (SPARK-18745) java.lang.IndexOutOfBoundsException running query 68 Spark SQL on (100TB)

2016-12-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18745?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15735626#comment-15735626 ] Apache Spark commented on SPARK-18745: -- User 'kiszk' has created a pull request for

[jira] [Assigned] (SPARK-18745) java.lang.IndexOutOfBoundsException running query 68 Spark SQL on (100TB)

2016-12-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18745: Assignee: Apache Spark (was: Kazuaki Ishizaki) > java.lang.IndexOutOfBoundsException runn

[jira] [Commented] (SPARK-18809) Kinesis deaggregation issue on master

2016-12-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15736126#comment-15736126 ] Apache Spark commented on SPARK-18809: -- User 'boneill42' has created a pull request

[jira] [Assigned] (SPARK-18809) Kinesis deaggregation issue on master

2016-12-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18809: Assignee: (was: Apache Spark) > Kinesis deaggregation issue on master > --

[jira] [Assigned] (SPARK-18809) Kinesis deaggregation issue on master

2016-12-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18809: Assignee: Apache Spark > Kinesis deaggregation issue on master > -

[jira] [Assigned] (SPARK-18807) Should suppress output print for calls to JVM methods with void return values

2016-12-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18807?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18807: Assignee: Apache Spark (was: Felix Cheung) > Should suppress output print for calls to JV

[jira] [Assigned] (SPARK-18807) Should suppress output print for calls to JVM methods with void return values

2016-12-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18807?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18807: Assignee: Felix Cheung (was: Apache Spark) > Should suppress output print for calls to JV

[jira] [Assigned] (SPARK-18807) Should suppress output print for calls to JVM methods with void return values

2016-12-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18807?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18807: Assignee: Apache Spark (was: Felix Cheung) > Should suppress output print for calls to JV

[jira] [Assigned] (SPARK-18807) Should suppress output print for calls to JVM methods with void return values

2016-12-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18807?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18807: Assignee: Felix Cheung (was: Apache Spark) > Should suppress output print for calls to JV

[jira] [Commented] (SPARK-18811) Stream Source resolution should happen in StreamExecution thread, not main thread

2016-12-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18811?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15736427#comment-15736427 ] Apache Spark commented on SPARK-18811: -- User 'brkyvz' has created a pull request for

[jira] [Assigned] (SPARK-18811) Stream Source resolution should happen in StreamExecution thread, not main thread

2016-12-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18811: Assignee: (was: Apache Spark) > Stream Source resolution should happen in StreamExecut

[jira] [Assigned] (SPARK-18811) Stream Source resolution should happen in StreamExecution thread, not main thread

2016-12-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18811: Assignee: Apache Spark > Stream Source resolution should happen in StreamExecution thread,

<    3   4   5   6   7   8   9   10   11   12   >