[jira] [Commented] (SPARK-3541) Improve ALS internal storage

[ https://issues.apache.org/jira/browse/SPARK-3541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14249578#comment-14249578 ] Apache Spark commented on SPARK-3541: - User 'mengxr' has created a pull request for th

[jira] [Created] (SPARK-4872) Provide sample format of training/test data in MLlib programming guide

zhang jun wei created SPARK-4872: Summary: Provide sample format of training/test data in MLlib programming guide Key: SPARK-4872 URL: https://issues.apache.org/jira/browse/SPARK-4872 Project: Spark

[jira] [Commented] (SPARK-4868) Twitter DStream.map() throws "Task not serializable"

[ https://issues.apache.org/jira/browse/SPARK-4868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14249582#comment-14249582 ] Nicholas Chammas commented on SPARK-4868: - Replacing {{noop()}} with this {code}

[jira] [Commented] (SPARK-4871) show sql statement in spark ui when run sql use spark-sql

[ https://issues.apache.org/jira/browse/SPARK-4871?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14249545#comment-14249545 ] Apache Spark commented on SPARK-4871: - User 'scwf' has created a pull request for this

[jira] [Created] (SPARK-4871) show sql statement in spark ui when run sql use spark-sql

wangfei created SPARK-4871: -- Summary: show sql statement in spark ui when run sql use spark-sql Key: SPARK-4871 URL: https://issues.apache.org/jira/browse/SPARK-4871 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-4868) Twitter DStream.map() throws "Task not serializable"

[ https://issues.apache.org/jira/browse/SPARK-4868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14249525#comment-14249525 ] Aaron Davidson commented on SPARK-4868: --- The repl has funny namespacing going on, wh

[jira] [Commented] (SPARK-4870) Add version information to driver log

[ https://issues.apache.org/jira/browse/SPARK-4870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14249519#comment-14249519 ] Apache Spark commented on SPARK-4870: - User 'liyezhang556520' has created a pull reque

[jira] [Created] (SPARK-4870) Add version information to driver log

Zhang, Liye created SPARK-4870: -- Summary: Add version information to driver log Key: SPARK-4870 URL: https://issues.apache.org/jira/browse/SPARK-4870 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-4618) Make foreign DDL commands options case-insensitive

[ https://issues.apache.org/jira/browse/SPARK-4618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-4618: Assignee: wangfei > Make foreign DDL commands options case-insensitive > ---

[jira] [Resolved] (SPARK-4618) Make foreign DDL commands options case-insensitive

[ https://issues.apache.org/jira/browse/SPARK-4618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-4618. - Resolution: Fixed > Make foreign DDL commands options case-insensitive > -

[jira] [Commented] (SPARK-4140) Document the dynamic allocation feature

[ https://issues.apache.org/jira/browse/SPARK-4140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14249499#comment-14249499 ] Tsuyoshi OZAWA commented on SPARK-4140: --- How about converting this issue into one of

[jira] [Resolved] (SPARK-4866) Support StructType as key in MapType

[ https://issues.apache.org/jira/browse/SPARK-4866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-4866. - Resolution: Fixed Fix Version/s: 1.3.0 Issue resolved by pull request 3714 [https:/

[jira] [Resolved] (SPARK-4720) Remainder should also return null if the divider is 0.

[ https://issues.apache.org/jira/browse/SPARK-4720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-4720. - Resolution: Fixed Fix Version/s: 1.3.0 Issue resolved by pull request 3581 [https:/

[jira] [Resolved] (SPARK-4744) Short Circuit evaluation for AND & OR in code gen

[ https://issues.apache.org/jira/browse/SPARK-4744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-4744. - Resolution: Fixed Fix Version/s: 1.3.0 Issue resolved by pull request 3606 [https:/

[jira] [Resolved] (SPARK-4798) Refactor Parquet test suites

[ https://issues.apache.org/jira/browse/SPARK-4798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-4798. - Resolution: Fixed Fix Version/s: 1.3.0 Issue resolved by pull request 3644 [https:/

[jira] [Updated] (SPARK-4869) The variable names in IF statement of Spark SQL doesn't resolve to its value.

[ https://issues.apache.org/jira/browse/SPARK-4869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajay updated SPARK-4869: Description: We got stuck with “IF-THEN” statement in Spark SQL. As per our usecase, we have to have nested “if” st

[jira] [Updated] (SPARK-4869) The variable names in IF statement of Spark SQL doesn't resolve to its value.

[ https://issues.apache.org/jira/browse/SPARK-4869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajay updated SPARK-4869: Summary: The variable names in IF statement of Spark SQL doesn't resolve to its value. (was: The variable names in

[jira] [Created] (SPARK-4869) The variable names in IF statement of SQL doesn't resolve to its value.

Ajay created SPARK-4869: --- Summary: The variable names in IF statement of SQL doesn't resolve to its value. Key: SPARK-4869 URL: https://issues.apache.org/jira/browse/SPARK-4869 Project: Spark Issue T

[jira] [Created] (SPARK-4868) Twitter DStream.map() throws "Task not serializable"

Nicholas Chammas created SPARK-4868: --- Summary: Twitter DStream.map() throws "Task not serializable" Key: SPARK-4868 URL: https://issues.apache.org/jira/browse/SPARK-4868 Project: Spark Issu

[jira] [Commented] (SPARK-4868) Twitter DStream.map() throws "Task not serializable"

[ https://issues.apache.org/jira/browse/SPARK-4868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14249387#comment-14249387 ] Nicholas Chammas commented on SPARK-4868: - cc [~tdas], [~adav] > Twitter DStream.

[jira] [Comment Edited] (SPARK-4105) FAILED_TO_UNCOMPRESS(5) errors when fetching shuffle data with sort-based shuffle

[ https://issues.apache.org/jira/browse/SPARK-4105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14249381#comment-14249381 ] Victor Tso edited comment on SPARK-4105 at 12/17/14 3:11 AM: -

[jira] [Commented] (SPARK-4105) FAILED_TO_UNCOMPRESS(5) errors when fetching shuffle data with sort-based shuffle

[ https://issues.apache.org/jira/browse/SPARK-4105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14249381#comment-14249381 ] Victor Tso commented on SPARK-4105: --- Similarly, I hit this in 1.1.1: Job aborted due to

[jira] [Commented] (SPARK-3955) Different versions between jackson-mapper-asl and jackson-core-asl

[ https://issues.apache.org/jira/browse/SPARK-3955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14249369#comment-14249369 ] Apache Spark commented on SPARK-3955: - User 'jongyoul' has created a pull request for

[jira] [Commented] (SPARK-3955) Different versions between jackson-mapper-asl and jackson-core-asl

[ https://issues.apache.org/jira/browse/SPARK-3955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14249337#comment-14249337 ] Jongyoul Lee commented on SPARK-3955: - [~srowen] Oops. That's my mistake. I tried to r

[jira] [Comment Edited] (SPARK-4777) Some block memory after unrollSafely not count into used memory(memoryStore.entrys or unrollMemory)

[ https://issues.apache.org/jira/browse/SPARK-4777?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14249330#comment-14249330 ] SuYan edited comment on SPARK-4777 at 12/17/14 2:26 AM: @Sean Owen

[jira] [Comment Edited] (SPARK-4777) Some block memory after unrollSafely not count into used memory(memoryStore.entrys or unrollMemory)

[ https://issues.apache.org/jira/browse/SPARK-4777?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14249330#comment-14249330 ] SuYan edited comment on SPARK-4777 at 12/17/14 2:26 AM: Sean Owen,

[jira] [Commented] (SPARK-4777) Some block memory after unrollSafely not count into used memory(memoryStore.entrys or unrollMemory)

[ https://issues.apache.org/jira/browse/SPARK-4777?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14249330#comment-14249330 ] SuYan commented on SPARK-4777: -- Sean Owen, Hi, I intended to close that patch, but after havi

[jira] [Resolved] (SPARK-4269) Make wait time in BroadcastHashJoin configurable

[ https://issues.apache.org/jira/browse/SPARK-4269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-4269. - Resolution: Fixed Fix Version/s: (was: 1.2.0) 1.3.0 Issue re

[jira] [Resolved] (SPARK-4827) Max iterations (100) reached for batch Resolution with deeply nested projects and project *s

[ https://issues.apache.org/jira/browse/SPARK-4827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-4827. - Resolution: Fixed Fix Version/s: 1.3.0 Issue resolved by pull request 3674 [https:/

[jira] [Resolved] (SPARK-4483) Optimization about reduce memory costs during the HashOuterJoin

[ https://issues.apache.org/jira/browse/SPARK-4483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-4483. - Resolution: Fixed Fix Version/s: 1.3.0 Issue resolved by pull request 3375 [https:/

[jira] [Created] (SPARK-4867) UDF clean up

Michael Armbrust created SPARK-4867: --- Summary: UDF clean up Key: SPARK-4867 URL: https://issues.apache.org/jira/browse/SPARK-4867 Project: Spark Issue Type: Bug Components: SQL

[jira] [Updated] (SPARK-4837) NettyBlockTransferService does not abide by spark.blockManager.port config option

[ https://issues.apache.org/jira/browse/SPARK-4837?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-4837: --- Target Version/s: 1.3.0, 1.2.1 (was: 1.2.1) > NettyBlockTransferService does not abide by spark.block

[jira] [Resolved] (SPARK-4527) Add BroadcastNestedLoopJoin operator selection testsuite

[ https://issues.apache.org/jira/browse/SPARK-4527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-4527. - Resolution: Fixed Fix Version/s: (was: 1.1.0) 1.3.0 Issue re

[jira] [Closed] (SPARK-4815) ThriftServer use only one SessionState to run sql using hive

[ https://issues.apache.org/jira/browse/SPARK-4815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust closed SPARK-4815. --- Resolution: Duplicate > ThriftServer use only one SessionState to run sql using hive > --

[jira] [Updated] (SPARK-4767) Add support for launching in a specified placement group to spark ec2 scripts.

[ https://issues.apache.org/jira/browse/SPARK-4767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-4767: -- Assignee: Holden Karau > Add support for launching in a specified placement group to spark ec2 scripts.

[jira] [Resolved] (SPARK-4767) Add support for launching in a specified placement group to spark ec2 scripts.

[ https://issues.apache.org/jira/browse/SPARK-4767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-4767. --- Resolution: Fixed Fix Version/s: 1.3.0 Issue resolved by pull request 3623 [https://github.com/

[jira] [Resolved] (SPARK-4812) SparkPlan.codegenEnabled may be initialized to a wrong value

[ https://issues.apache.org/jira/browse/SPARK-4812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-4812. - Resolution: Fixed Fix Version/s: 1.3.0 Issue resolved by pull request 3660 [https:/

[jira] [Resolved] (SPARK-4847) extraStrategies cannot take effect in SQLContext

[ https://issues.apache.org/jira/browse/SPARK-4847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-4847. - Resolution: Fixed Fix Version/s: 1.2.1 Issue resolved by pull request 3698 [https:/

[jira] [Resolved] (SPARK-1148) Suggestions for exception handling (avoid potential bugs)

[ https://issues.apache.org/jira/browse/SPARK-1148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-1148. -- Resolution: Duplicate > Suggestions for exception handling (avoid potential bugs) >

[jira] [Commented] (SPARK-1148) Suggestions for exception handling (avoid potential bugs)

[ https://issues.apache.org/jira/browse/SPARK-1148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14249028#comment-14249028 ] Ding Yuan commented on SPARK-1148: -- of course, please just close this one then. Thanks!

[jira] [Commented] (SPARK-4866) Support StructType as key in MapType

[ https://issues.apache.org/jira/browse/SPARK-4866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14249012#comment-14249012 ] Apache Spark commented on SPARK-4866: - User 'davies' has created a pull request for th

[jira] [Created] (SPARK-4866) Support StructType as key in MapType

Davies Liu created SPARK-4866: - Summary: Support StructType as key in MapType Key: SPARK-4866 URL: https://issues.apache.org/jira/browse/SPARK-4866 Project: Spark Issue Type: Bug Compon

[jira] [Commented] (SPARK-1148) Suggestions for exception handling (avoid potential bugs)

[ https://issues.apache.org/jira/browse/SPARK-1148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14248941#comment-14248941 ] Sean Owen commented on SPARK-1148: -- [~d.yuan] I don't know that these have been addressed

[jira] [Resolved] (SPARK-4700) Add Http support to Spark Thrift server

[ https://issues.apache.org/jira/browse/SPARK-4700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-4700. - Resolution: Fixed Fix Version/s: 1.3.0 Issue resolved by pull request 3672 [https:/

[jira] [Created] (SPARK-4865) rdds exposed to sql context via registerTempTable are not listed via thrift jdbc show tables

Misha Chernetsov created SPARK-4865: --- Summary: rdds exposed to sql context via registerTempTable are not listed via thrift jdbc show tables Key: SPARK-4865 URL: https://issues.apache.org/jira/browse/SPARK-4865

[jira] [Commented] (SPARK-2611) VPC Issue while creating an ec2 cluster

[ https://issues.apache.org/jira/browse/SPARK-2611?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14248836#comment-14248836 ] Josh Rosen commented on SPARK-2611: --- For the folks watching this issue: SPARK-3405 has n

[jira] [Resolved] (SPARK-3405) EC2 cluster creation on VPC

[ https://issues.apache.org/jira/browse/SPARK-3405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-3405. --- Resolution: Fixed Fix Version/s: 1.3.0 Issue resolved by pull request 2872 [https://github.com/

[jira] [Commented] (SPARK-4864) Add documentation to Netty-based configs

[ https://issues.apache.org/jira/browse/SPARK-4864?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14248820#comment-14248820 ] Apache Spark commented on SPARK-4864: - User 'aarondav' has created a pull request for

[jira] [Created] (SPARK-4864) Add documentation to Netty-based configs

Aaron Davidson created SPARK-4864: - Summary: Add documentation to Netty-based configs Key: SPARK-4864 URL: https://issues.apache.org/jira/browse/SPARK-4864 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-4846) When the vocabulary size is large, Word2Vec may yield "OutOfMemoryError: Requested array size exceeds VM limit"

[ https://issues.apache.org/jira/browse/SPARK-4846?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14248802#comment-14248802 ] Joseph K. Bradley commented on SPARK-4846: -- Changing vectorSize sounds too aggres

[jira] [Closed] (SPARK-4839) Adding documentations about dynamic resource allocation

[ https://issues.apache.org/jira/browse/SPARK-4839?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-4839. Resolution: Duplicate Closing this as a duplicate > Adding documentations about dynamic resource allocation

[jira] [Resolved] (SPARK-4855) Python tests for hypothesis testing

[ https://issues.apache.org/jira/browse/SPARK-4855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-4855. -- Resolution: Fixed Fix Version/s: 1.3.0 Issue resolved by pull request 3679 [https://githu

[jira] [Resolved] (SPARK-4437) Docs for difference between WholeTextFileRecordReader and WholeCombineFileRecordReader

[ https://issues.apache.org/jira/browse/SPARK-4437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-4437. --- Resolution: Fixed Fix Version/s: 1.3.0 Issue resolved by pull request 3301 [https://github.com/

[jira] [Commented] (SPARK-1148) Suggestions for exception handling (avoid potential bugs)

[ https://issues.apache.org/jira/browse/SPARK-1148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14248707#comment-14248707 ] Ding Yuan commented on SPARK-1148: -- Glad to know these cases are addressed! As for versio

[jira] [Updated] (SPARK-4863) Suspicious exception handlers

[ https://issues.apache.org/jira/browse/SPARK-4863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ding Yuan updated SPARK-4863: - Description: Following up with the discussion in https://issues.apache.org/jira/browse/SPARK-1148, I am c

[jira] [Created] (SPARK-4863) Suspicious exception handlers

Ding Yuan created SPARK-4863: Summary: Suspicious exception handlers Key: SPARK-4863 URL: https://issues.apache.org/jira/browse/SPARK-4863 Project: Spark Issue Type: Bug Components: Spa

[jira] [Created] (SPARK-4862) Streaming | Setting checkpoint as a local directory results in Checkpoint RDD has different partitions error

Aniket Bhatnagar created SPARK-4862: --- Summary: Streaming | Setting checkpoint as a local directory results in Checkpoint RDD has different partitions error Key: SPARK-4862 URL: https://issues.apache.org/jira/bro

[jira] [Commented] (SPARK-4861) Refactory command in spark sql

[ https://issues.apache.org/jira/browse/SPARK-4861?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14248380#comment-14248380 ] Apache Spark commented on SPARK-4861: - User 'scwf' has created a pull request for this

[jira] [Created] (SPARK-4861) Refactory command in spark sql

wangfei created SPARK-4861: -- Summary: Refactory command in spark sql Key: SPARK-4861 URL: https://issues.apache.org/jira/browse/SPARK-4861 Project: Spark Issue Type: Improvement Components

[jira] [Commented] (SPARK-4732) All application progress on the standalone scheduler can be halted by one systematically faulty node

[ https://issues.apache.org/jira/browse/SPARK-4732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14248367#comment-14248367 ] Harry Brundage commented on SPARK-4732: --- Seems like it would, feel free to mark as d

[jira] [Comment Edited] (SPARK-4846) When the vocabulary size is large, Word2Vec may yield "OutOfMemoryError: Requested array size exceeds VM limit"

[ https://issues.apache.org/jira/browse/SPARK-4846?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14248262#comment-14248262 ] Joseph Tang edited comment on SPARK-4846 at 12/16/14 2:13 PM: --

[jira] [Commented] (SPARK-4846) When the vocabulary size is large, Word2Vec may yield "OutOfMemoryError: Requested array size exceeds VM limit"

[ https://issues.apache.org/jira/browse/SPARK-4846?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14248262#comment-14248262 ] Joseph Tang commented on SPARK-4846: Hi Sean and Joseph. You are right. I had another

[jira] [Updated] (SPARK-4856) Null & empty string should not be considered as StringType at begining in Json schema inferring

[ https://issues.apache.org/jira/browse/SPARK-4856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Hao updated SPARK-4856: - Description: We have data like: {noformat} TestSQLContext.sparkContext.parallelize( """{"ip":"27.31.100.

[jira] [Updated] (SPARK-4856) Null & empty string should not be considered as StringType at begining in Json schema inferring

[ https://issues.apache.org/jira/browse/SPARK-4856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Hao updated SPARK-4856: - Description: We have data like: {noformat} TestSQLContext.sparkContext.parallelize( """{"ip":"27.31.100.

[jira] [Updated] (SPARK-4856) Null & empty string should not be considered as StringType at begining in Json schema inferring

[ https://issues.apache.org/jira/browse/SPARK-4856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Hao updated SPARK-4856: - Description: dWe have data like: {noformat} TestSQLContext.sparkContext.parallelize( """{"ip":"27.31.100

[jira] [Updated] (SPARK-4856) Null & empty string should not be considered as StringType at begining in Json schema inferring

[ https://issues.apache.org/jira/browse/SPARK-4856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Hao updated SPARK-4856: - Description: We have data like: {noformat} TestSQLContext.sparkContext.parallelize( """{"ip":"27.31.100.

[jira] [Updated] (SPARK-4856) Null & empty string should not be considered as StringType at begining in Json schema inferring

[ https://issues.apache.org/jira/browse/SPARK-4856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Hao updated SPARK-4856: - Description: We have data like: {panel} TestSQLContext.sparkContext.parallelize( """{"ip":"27.31.100.29"

[jira] [Updated] (SPARK-4856) Null & empty string should not be considered as StringType at begining in Json schema inferring

[ https://issues.apache.org/jira/browse/SPARK-4856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Hao updated SPARK-4856: - Description: We have data like: {quote} TestSQLContext.sparkContext.parallelize( """{"ip":"27.31.100.29"

[jira] [Updated] (SPARK-4857) Add Executor Events to SparkListener

[ https://issues.apache.org/jira/browse/SPARK-4857?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated SPARK-4857: -- Assignee: Kostas Sakellis > Add Executor Events to SparkListener >

[jira] [Commented] (SPARK-2709) Add a tool for certifying Spark API compatiblity

[ https://issues.apache.org/jira/browse/SPARK-2709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14248195#comment-14248195 ] Sean Owen commented on SPARK-2709: -- Sure, mostly just curious to see the tool, but no wor

[jira] [Commented] (SPARK-2709) Add a tool for certifying Spark API compatiblity

[ https://issues.apache.org/jira/browse/SPARK-2709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14248191#comment-14248191 ] Prashant Sharma commented on SPARK-2709: Yes, it is still private repo on github.

[jira] [Commented] (SPARK-4777) Some block memory after unrollSafely not count into used memory(memoryStore.entrys or unrollMemory)

[ https://issues.apache.org/jira/browse/SPARK-4777?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14248177#comment-14248177 ] Sean Owen commented on SPARK-4777: -- [~SuYan] Given your comment in your PR, do you intend

[jira] [Commented] (SPARK-3955) Different versions between jackson-mapper-asl and jackson-core-asl

[ https://issues.apache.org/jira/browse/SPARK-3955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14248176#comment-14248176 ] Sean Owen commented on SPARK-3955: -- [~jongyoul] That PR was never merged though: https:/

[jira] [Commented] (SPARK-2709) Add a tool for certifying Spark API compatiblity

[ https://issues.apache.org/jira/browse/SPARK-2709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14248174#comment-14248174 ] Sean Owen commented on SPARK-2709: -- Was this sort of tool implemented? > Add a tool for

[jira] [Resolved] (SPARK-1338) Create Additional Style Rules

[ https://issues.apache.org/jira/browse/SPARK-1338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Sharma resolved SPARK-1338. Resolution: Fixed This is fixed by updating the scalastyle version. Applying these styles ac

[jira] [Resolved] (SPARK-2709) Add a tool for certifying Spark API compatiblity

[ https://issues.apache.org/jira/browse/SPARK-2709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Sharma resolved SPARK-2709. Resolution: Fixed > Add a tool for certifying Spark API compatiblity > -

[jira] [Resolved] (SPARK-2987) Adjust build system to support building with scala 2.11 and fix tests.

[ https://issues.apache.org/jira/browse/SPARK-2987?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Sharma resolved SPARK-2987. Resolution: Fixed > Adjust build system to support building with scala 2.11 and fix tests. >

[jira] [Resolved] (SPARK-2988) Port repl to scala 2.11.

[ https://issues.apache.org/jira/browse/SPARK-2988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Sharma resolved SPARK-2988. Resolution: Fixed > Port repl to scala 2.11. > > >

[jira] [Updated] (SPARK-4341) Spark need to set num-executors automatically

[ https://issues.apache.org/jira/browse/SPARK-4341?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hong Shen updated SPARK-4341: - Attachment: SPARK-4341.diff > Spark need to set num-executors automatically >

[jira] [Commented] (SPARK-4857) Add Executor Events to SparkListener

[ https://issues.apache.org/jira/browse/SPARK-4857?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14247955#comment-14247955 ] Apache Spark commented on SPARK-4857: - User 'ksakellis' has created a pull request for

[jira] [Commented] (SPARK-4854) Custom UDTF with Lateral View throws ClassNotFound exception in Spark SQL CLI

[ https://issues.apache.org/jira/browse/SPARK-4854?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14247938#comment-14247938 ] Shenghua Wan commented on SPARK-4854: - I was trying to debugging Spark source code to

[jira] [Commented] (SPARK-3955) Different versions between jackson-mapper-asl and jackson-core-asl

[ https://issues.apache.org/jira/browse/SPARK-3955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14247929#comment-14247929 ] Jongyoul Lee commented on SPARK-3955: - Please mark this issue as Resolved. It's fixed