[jira] [Commented] (SPARK-15204) Nullable is not correct for Aggregator

2016-05-09 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15204?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15277592#comment-15277592 ] Reynold Xin commented on SPARK-15204: - I'm going to change the title because it is always correct to

[jira] [Updated] (SPARK-15204) Nullable is not correct for Aggregator

2016-05-09 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-15204: Issue Type: Improvement (was: Bug) > Nullable is not correct for Aggregator >

[jira] [Updated] (SPARK-15204) Improve nullability inference for Aggregator

2016-05-09 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-15204: Summary: Improve nullability inference for Aggregator (was: Nullable is not correct for

[jira] [Reopened] (SPARK-15204) Improve nullability inference for Aggregator

2016-05-09 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin reopened SPARK-15204: - > Improve nullability inference for Aggregator > > >

[jira] [Closed] (SPARK-15204) Improve nullability inference for Aggregator

2016-05-09 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin closed SPARK-15204. --- Resolution: Not A Bug > Improve nullability inference for Aggregator >

[jira] [Created] (SPARK-15243) Binarizer.explainParam(u"...") raises ValueError

2016-05-09 Thread Kazuki Yokoishi (JIRA)
Kazuki Yokoishi created SPARK-15243: --- Summary: Binarizer.explainParam(u"...") raises ValueError Key: SPARK-15243 URL: https://issues.apache.org/jira/browse/SPARK-15243 Project: Spark Issue

[jira] [Created] (SPARK-15244) Type of column name created with sqlContext.createDataFrame() is not consistent.

2016-05-09 Thread Kazuki Yokoishi (JIRA)
Kazuki Yokoishi created SPARK-15244: --- Summary: Type of column name created with sqlContext.createDataFrame() is not consistent. Key: SPARK-15244 URL: https://issues.apache.org/jira/browse/SPARK-15244

[jira] [Commented] (SPARK-15204) Improve nullability inference for Aggregator

2016-05-09 Thread Koert Kuipers (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15204?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15277600#comment-15277600 ] Koert Kuipers commented on SPARK-15204: --- Makes sense > Improve nullability inference for

[jira] [Commented] (SPARK-15218) Error: Could not find or load main class org.apache.spark.launcher.Main when run from a directory containing colon ':'

2016-05-09 Thread Adam Cecile (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15277610#comment-15277610 ] Adam Cecile commented on SPARK-15218: - Hello, Good catch, this mesos bug should fix my issue. I'm

[jira] [Updated] (SPARK-15207) Use Travis CI for Java Linter and JDK7/8 compilation test

2016-05-09 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-15207: -- Description: Currently, Java Linter is disabled in Jenkins tests.

[jira] [Updated] (SPARK-15207) Use Travis CI for Java Linter and JDK7/8 compilation test

2016-05-09 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-15207: -- Description: Currently, Java Linter is disabled in Jenkins tests.

[jira] [Created] (SPARK-15245) stream API throws an exception with an incorrect message when the path is not a direcotry

2016-05-09 Thread Hyukjin Kwon (JIRA)
Hyukjin Kwon created SPARK-15245: Summary: stream API throws an exception with an incorrect message when the path is not a direcotry Key: SPARK-15245 URL: https://issues.apache.org/jira/browse/SPARK-15245

[jira] [Commented] (SPARK-15245) stream API throws an exception with an incorrect message when the path is not a direcotry

2016-05-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15277647#comment-15277647 ] Apache Spark commented on SPARK-15245: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Assigned] (SPARK-15245) stream API throws an exception with an incorrect message when the path is not a direcotry

2016-05-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15245: Assignee: (was: Apache Spark) > stream API throws an exception with an incorrect

[jira] [Assigned] (SPARK-15245) stream API throws an exception with an incorrect message when the path is not a direcotry

2016-05-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15245: Assignee: Apache Spark > stream API throws an exception with an incorrect message when

[jira] [Commented] (SPARK-14057) sql time stamps do not respect time zones

2016-05-09 Thread Vijay Parmar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15275987#comment-15275987 ] Vijay Parmar commented on SPARK-14057: -- I have few suggestions to make here after looking into the

[jira] [Created] (SPARK-15218) Error: Could not find or load main class org.apache.spark.launcher.Main when run from a directory containing colon ':'

2016-05-09 Thread Adam Cecile (JIRA)
Adam Cecile created SPARK-15218: --- Summary: Error: Could not find or load main class org.apache.spark.launcher.Main when run from a directory containing colon ':' Key: SPARK-15218 URL:

[jira] [Updated] (SPARK-15218) Error: Could not find or load main class org.apache.spark.launcher.Main when run from a directory containing colon ':'

2016-05-09 Thread Adam Cecile (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Cecile updated SPARK-15218: Description: {noformat} mkdir /tmp/qwe:rtz cd /tmp/qwe:rtz wget

[jira] [Created] (SPARK-15219) [Spark SQL] it don't support to detect runtime temporary table for enabling broadcast hash join optimization

2016-05-09 Thread Yi Zhou (JIRA)
Yi Zhou created SPARK-15219: --- Summary: [Spark SQL] it don't support to detect runtime temporary table for enabling broadcast hash join optimization Key: SPARK-15219 URL:

[jira] [Updated] (SPARK-15219) [Spark SQL] it don't support to detect runtime temporary table for enabling broadcast hash join optimization

2016-05-09 Thread Yi Zhou (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Zhou updated SPARK-15219: Description: We observed an interesting thing about broadcast Hash join( similar to Map Join in Hive)

[jira] [Created] (SPARK-15220) Add hyperlink to "running application" and "completed application"

2016-05-09 Thread Mao, Wei (JIRA)
Mao, Wei created SPARK-15220: Summary: Add hyperlink to "running application" and "completed application" Key: SPARK-15220 URL: https://issues.apache.org/jira/browse/SPARK-15220 Project: Spark

[jira] [Comment Edited] (SPARK-928) Add support for Unsafe-based serializer in Kryo 2.22

2016-05-09 Thread Sandeep Singh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15265805#comment-15265805 ] Sandeep Singh edited comment on SPARK-928 at 5/9/16 7:02 AM: - [~joshrosen] I

[jira] [Resolved] (SPARK-15211) Select features column from LibSVMRelation causes failure

2016-05-09 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian resolved SPARK-15211. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 12986

[jira] [Updated] (SPARK-15211) Select features column from LibSVMRelation causes failure

2016-05-09 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-15211: --- Assignee: Liang-Chi Hsieh > Select features column from LibSVMRelation causes failure >

[jira] [Updated] (SPARK-15211) Select features column from LibSVMRelation causes failure

2016-05-09 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-15211: --- Affects Version/s: 2.0.0 Target Version/s: 2.0.0 Description: It will cause failure

[jira] [Commented] (SPARK-15219) [Spark SQL] it don't support to detect runtime temporary table for enabling broadcast hash join optimization

2016-05-09 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15276042#comment-15276042 ] Herman van Hovell commented on SPARK-15219: --- [~jameszhouyi] Could you also post the query plan?

[jira] [Updated] (SPARK-15219) [Spark SQL] it don't support to detect runtime temporary table for enabling broadcast hash join optimization

2016-05-09 Thread Yi Zhou (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Zhou updated SPARK-15219: Description: We observed an interesting thing about broadcast Hash join( similar to Map Join in Hive)

[jira] [Commented] (SPARK-15219) [Spark SQL] it don't support to detect runtime temporary table for enabling broadcast hash join optimization

2016-05-09 Thread Yi Zhou (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15276055#comment-15276055 ] Yi Zhou commented on SPARK-15219: - Posted the core physical plan > [Spark SQL] it don't support to

[jira] [Created] (SPARK-15221) error: not found: value sqlContext when starting Spark 1.6.1

2016-05-09 Thread Vijay Parmar (JIRA)
Vijay Parmar created SPARK-15221: Summary: error: not found: value sqlContext when starting Spark 1.6.1 Key: SPARK-15221 URL: https://issues.apache.org/jira/browse/SPARK-15221 Project: Spark

[jira] [Updated] (SPARK-15221) error: not found: value sqlContext when starting Spark 1.6.1

2016-05-09 Thread Vijay Parmar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vijay Parmar updated SPARK-15221: - Description: When I start Spark (version 1.6.1), at the very end I am getting the following

[jira] [Updated] (SPARK-15221) error: not found: value sqlContext when starting Spark 1.6.1

2016-05-09 Thread Vijay Parmar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vijay Parmar updated SPARK-15221: - Description: When I start Spark (version 1.6.1), at the very end I am getting the following

[jira] [Commented] (SPARK-15221) error: not found: value sqlContext when starting Spark 1.6.1

2016-05-09 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15276064#comment-15276064 ] Sean Owen commented on SPARK-15221: --- This virtually always happens when an earlier error occurred.

[jira] [Updated] (SPARK-15221) error: not found: value sqlContext when starting Spark 1.6.1

2016-05-09 Thread Vijay Parmar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vijay Parmar updated SPARK-15221: - Priority: Blocker (was: Minor) > error: not found: value sqlContext when starting Spark 1.6.1 >

[jira] [Commented] (SPARK-15221) error: not found: value sqlContext when starting Spark 1.6.1

2016-05-09 Thread Vijay Parmar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15276071#comment-15276071 ] Vijay Parmar commented on SPARK-15221: -- Well it's a whole lot that gets generated before the one I

[jira] [Resolved] (SPARK-13064) api/v1/application/jobs/attempt lacks "attempId" field for spark-shell

2016-05-09 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-13064. --- Resolution: Won't Fix > api/v1/application/jobs/attempt lacks "attempId" field for spark-shell >

[jira] [Resolved] (SPARK-15221) error: not found: value sqlContext when starting Spark 1.6.1

2016-05-09 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-15221. --- Resolution: Not A Problem Target Version/s: (was: 1.6.1) Exactly, this is the problem:

[jira] [Updated] (SPARK-15136) Linkify ML PyDoc

2016-05-09 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-15136: -- Assignee: holdenk > Linkify ML PyDoc > > > Key: SPARK-15136 >

[jira] [Resolved] (SPARK-15136) Linkify ML PyDoc

2016-05-09 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-15136. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 12918

[jira] [Commented] (SPARK-14898) MultivariateGaussian could use Cholesky in calculateCovarianceConstants

2016-05-09 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15276090#comment-15276090 ] Sean Owen commented on SPARK-14898: --- I don't think the comment means that the SVD is used. It's noting

[jira] [Commented] (SPARK-15159) Remove usage of HiveContext in SparkR.

2016-05-09 Thread Vijay Parmar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15276100#comment-15276100 ] Vijay Parmar commented on SPARK-15159: -- 1. I looked at the source code on

[jira] [Created] (SPARK-15222) SparkR ML examples update in 2.0

2016-05-09 Thread Yanbo Liang (JIRA)
Yanbo Liang created SPARK-15222: --- Summary: SparkR ML examples update in 2.0 Key: SPARK-15222 URL: https://issues.apache.org/jira/browse/SPARK-15222 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-4452) Shuffle data structures can starve others on the same thread for memory

2016-05-09 Thread Xin Hao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15276109#comment-15276109 ] Xin Hao commented on SPARK-4452: Since this is an old issue which impact Spark since 1.1.0, can the patch

[jira] [Comment Edited] (SPARK-4452) Shuffle data structures can starve others on the same thread for memory

2016-05-09 Thread Xin Hao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15276109#comment-15276109 ] Xin Hao edited comment on SPARK-4452 at 5/9/16 8:36 AM: Since this is an old issue

[jira] [Assigned] (SPARK-15222) SparkR ML examples update in 2.0

2016-05-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15222?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15222: Assignee: Apache Spark > SparkR ML examples update in 2.0 >

[jira] [Commented] (SPARK-15222) SparkR ML examples update in 2.0

2016-05-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15276114#comment-15276114 ] Apache Spark commented on SPARK-15222: -- User 'yanboliang' has created a pull request for this issue:

[jira] [Assigned] (SPARK-15222) SparkR ML examples update in 2.0

2016-05-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15222?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15222: Assignee: (was: Apache Spark) > SparkR ML examples update in 2.0 >

[jira] [Resolved] (SPARK-15172) Warning message should explicitly tell user initial coefficients is ignored if its size doesn't match expected size in LogisticRegression

2016-05-09 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-15172. --- Resolution: Fixed Fix Version/s: 2.1.0 Issue resolved by pull request 12948

[jira] [Commented] (SPARK-15218) Error: Could not find or load main class org.apache.spark.launcher.Main when run from a directory containing colon ':'

2016-05-09 Thread Viacheslav Saevskiy (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15276129#comment-15276129 ] Viacheslav Saevskiy commented on SPARK-15218: - it's a java specific issue and I didn't find a

[jira] [Resolved] (SPARK-14459) SQL partitioning must match existing tables, but is not checked.

2016-05-09 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14459?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian resolved SPARK-14459. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 12239

[jira] [Updated] (SPARK-14459) SQL partitioning must match existing tables, but is not checked.

2016-05-09 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14459?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-14459: --- Affects Version/s: 2.0.0 Target Version/s: 2.0.0 > SQL partitioning must match existing tables,

[jira] [Updated] (SPARK-14459) SQL partitioning must match existing tables, but is not checked.

2016-05-09 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14459?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-14459: --- Assignee: Ryan Blue > SQL partitioning must match existing tables, but is not checked. >

[jira] [Updated] (SPARK-15192) RowEncoder needs to verify nullability in a more explicit way

2016-05-09 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-15192: --- Description: When we create a Dataset from an RDD of rows with a specific schema, if the

[jira] [Created] (SPARK-15224) Can not delete jar and list jar in spark Thrift server

2016-05-09 Thread poseidon (JIRA)
poseidon created SPARK-15224: Summary: Can not delete jar and list jar in spark Thrift server Key: SPARK-15224 URL: https://issues.apache.org/jira/browse/SPARK-15224 Project: Spark Issue Type:

[jira] [Created] (SPARK-15223) spark.executor.logs.rolling.maxSize wrongly referred to as spark.executor.logs.rolling.size.maxBytes

2016-05-09 Thread Philipp Hoffmann (JIRA)
Philipp Hoffmann created SPARK-15223: Summary: spark.executor.logs.rolling.maxSize wrongly referred to as spark.executor.logs.rolling.size.maxBytes Key: SPARK-15223 URL:

[jira] [Updated] (SPARK-15224) Can not delete jar and list jar in spark Thrift server

2016-05-09 Thread poseidon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] poseidon updated SPARK-15224: - Description: when you try to delete jar , and exec delete jar or list jar in you beeline client.

[jira] [Created] (SPARK-15225) Replace SQLContext with SparkSession in Encoder documentation

2016-05-09 Thread Liang-Chi Hsieh (JIRA)
Liang-Chi Hsieh created SPARK-15225: --- Summary: Replace SQLContext with SparkSession in Encoder documentation Key: SPARK-15225 URL: https://issues.apache.org/jira/browse/SPARK-15225 Project: Spark

[jira] [Assigned] (SPARK-15223) spark.executor.logs.rolling.maxSize wrongly referred to as spark.executor.logs.rolling.size.maxBytes

2016-05-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15223: Assignee: (was: Apache Spark) > spark.executor.logs.rolling.maxSize wrongly referred

[jira] [Commented] (SPARK-15223) spark.executor.logs.rolling.maxSize wrongly referred to as spark.executor.logs.rolling.size.maxBytes

2016-05-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15276156#comment-15276156 ] Apache Spark commented on SPARK-15223: -- User 'philipphoffmann' has created a pull request for this

[jira] [Assigned] (SPARK-15223) spark.executor.logs.rolling.maxSize wrongly referred to as spark.executor.logs.rolling.size.maxBytes

2016-05-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15223: Assignee: Apache Spark > spark.executor.logs.rolling.maxSize wrongly referred to as >

[jira] [Assigned] (SPARK-15225) Replace SQLContext with SparkSession in Encoder documentation

2016-05-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15225: Assignee: Apache Spark > Replace SQLContext with SparkSession in Encoder documentation >

[jira] [Commented] (SPARK-15225) Replace SQLContext with SparkSession in Encoder documentation

2016-05-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15276159#comment-15276159 ] Apache Spark commented on SPARK-15225: -- User 'viirya' has created a pull request for this issue:

[jira] [Assigned] (SPARK-15225) Replace SQLContext with SparkSession in Encoder documentation

2016-05-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15225: Assignee: (was: Apache Spark) > Replace SQLContext with SparkSession in Encoder

[jira] [Updated] (SPARK-15223) spark.executor.logs.rolling.maxSize wrongly referred to as spark.executor.logs.rolling.size.maxBytes

2016-05-09 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-15223: -- Priority: Trivial (was: Major) Not Major, and too Trivial even for a JIRA >

[jira] [Commented] (SPARK-15223) spark.executor.logs.rolling.maxSize wrongly referred to as spark.executor.logs.rolling.size.maxBytes

2016-05-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15276190#comment-15276190 ] Apache Spark commented on SPARK-15223: -- User 'ashishawasthi' has created a pull request for this

[jira] [Commented] (SPARK-15212) CSV file reader when read file with first line schema do not filter blank in schema column name

2016-05-09 Thread Weichen Xu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15276275#comment-15276275 ] Weichen Xu commented on SPARK-15212: en...but still may cause problem, for example, the csv file

[jira] [Updated] (SPARK-15188) PySpark NaiveBayes is missing Thresholds param

2016-05-09 Thread Nick Pentreath (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nick Pentreath updated SPARK-15188: --- Summary: PySpark NaiveBayes is missing Thresholds param (was: NaiveBayes is missing

[jira] [Updated] (SPARK-15188) PySpark NaiveBayes is missing Thresholds param

2016-05-09 Thread Nick Pentreath (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nick Pentreath updated SPARK-15188: --- Assignee: holdenk > PySpark NaiveBayes is missing Thresholds param >

[jira] [Created] (SPARK-15226) CSV file data-line with newline at first line load error

2016-05-09 Thread Weichen Xu (JIRA)
Weichen Xu created SPARK-15226: -- Summary: CSV file data-line with newline at first line load error Key: SPARK-15226 URL: https://issues.apache.org/jira/browse/SPARK-15226 Project: Spark Issue

[jira] [Commented] (SPARK-15226) CSV file data-line with newline at first line load error

2016-05-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15276390#comment-15276390 ] Apache Spark commented on SPARK-15226: -- User 'WeichenXu123' has created a pull request for this

[jira] [Assigned] (SPARK-15226) CSV file data-line with newline at first line load error

2016-05-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15226: Assignee: (was: Apache Spark) > CSV file data-line with newline at first line load

[jira] [Assigned] (SPARK-15226) CSV file data-line with newline at first line load error

2016-05-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15226: Assignee: Apache Spark > CSV file data-line with newline at first line load error >

[jira] [Assigned] (SPARK-15192) RowEncoder needs to verify nullability in a more explicit way

2016-05-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15192: Assignee: Apache Spark > RowEncoder needs to verify nullability in a more explicit way >

[jira] [Assigned] (SPARK-15192) RowEncoder needs to verify nullability in a more explicit way

2016-05-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15192: Assignee: (was: Apache Spark) > RowEncoder needs to verify nullability in a more

[jira] [Commented] (SPARK-15192) RowEncoder needs to verify nullability in a more explicit way

2016-05-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15276478#comment-15276478 ] Apache Spark commented on SPARK-15192: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Commented] (SPARK-14459) SQL partitioning must match existing tables, but is not checked.

2016-05-09 Thread Ryan Blue (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14459?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15276493#comment-15276493 ] Ryan Blue commented on SPARK-14459: --- Thank you [~lian cheng]! > SQL partitioning must match existing

[jira] [Commented] (SPARK-14813) ML 2.0 QA: API: Python API coverage

2016-05-09 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15276497#comment-15276497 ] Yanbo Liang commented on SPARK-14813: - [~holdenk] I'm not working on regression, please go ahead. I

[jira] [Commented] (SPARK-15154) LongHashedRelation fails on Big Endian platform

2016-05-09 Thread Pete Robbins (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15276543#comment-15276543 ] Pete Robbins commented on SPARK-15154: -- I'm convinced the test is invalid. The creation of

[jira] [Assigned] (SPARK-15154) LongHashedRelation fails on Big Endian platform

2016-05-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15154: Assignee: Apache Spark > LongHashedRelation fails on Big Endian platform >

[jira] [Assigned] (SPARK-15154) LongHashedRelation fails on Big Endian platform

2016-05-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15154: Assignee: (was: Apache Spark) > LongHashedRelation fails on Big Endian platform >

[jira] [Commented] (SPARK-15154) LongHashedRelation fails on Big Endian platform

2016-05-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15276552#comment-15276552 ] Apache Spark commented on SPARK-15154: -- User 'robbinspg' has created a pull request for this issue:

[jira] [Updated] (SPARK-15154) LongHashedRelation test fails on Big Endian platform

2016-05-09 Thread Pete Robbins (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pete Robbins updated SPARK-15154: - Priority: Minor (was: Major) Summary: LongHashedRelation test fails on Big Endian platform

[jira] [Commented] (SPARK-15122) TPC-DS Qury 41 fails with The correlated scalar subquery can only contain equality predicates

2016-05-09 Thread JESSE CHEN (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15276600#comment-15276600 ] JESSE CHEN commented on SPARK-15122: works great! now all 99 queries pass! nicely done! > TPC-DS

[jira] [Closed] (SPARK-15122) TPC-DS Qury 41 fails with The correlated scalar subquery can only contain equality predicates

2016-05-09 Thread JESSE CHEN (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JESSE CHEN closed SPARK-15122. -- Verified successfully in 0508 build. Thanks! > TPC-DS Qury 41 fails with The correlated scalar subquery

[jira] [Commented] (SPARK-14898) MultivariateGaussian could use Cholesky in calculateCovarianceConstants

2016-05-09 Thread Miao Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15276632#comment-15276632 ] Miao Wang commented on SPARK-14898: --- I agree. I tried to understand what I should do in this JIRA. It

[jira] [Created] (SPARK-15227) InputStream stop-start semantics + empty implementations

2016-05-09 Thread Stas Levin (JIRA)
Stas Levin created SPARK-15227: -- Summary: InputStream stop-start semantics + empty implementations Key: SPARK-15227 URL: https://issues.apache.org/jira/browse/SPARK-15227 Project: Spark Issue

[jira] [Commented] (SPARK-15220) Add hyperlink to "running application" and "completed application"

2016-05-09 Thread Alex Bozarth (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15276687#comment-15276687 ] Alex Bozarth commented on SPARK-15220: -- I'll take a look at this in my free moments today, seems

[jira] [Commented] (SPARK-15221) error: not found: value sqlContext when starting Spark 1.6.1

2016-05-09 Thread Vijay Parmar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15276693#comment-15276693 ] Vijay Parmar commented on SPARK-15221: -- Thank you, Sean! I am new to Spark and learning the things.

[jira] [Resolved] (SPARK-15093) create/delete/rename directory for InMemoryCatalog operations if needed

2016-05-09 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-15093. --- Resolution: Fixed Fix Version/s: 2.0.0 > create/delete/rename directory for InMemoryCatalog

[jira] [Commented] (SPARK-11293) Spillable collections leak shuffle memory

2016-05-09 Thread Miles Crawford (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15276723#comment-15276723 ] Miles Crawford commented on SPARK-11293: Also biting us in 1.6.1 - we have to repartition our

[jira] [Resolved] (SPARK-15223) spark.executor.logs.rolling.maxSize wrongly referred to as spark.executor.logs.rolling.size.maxBytes

2016-05-09 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-15223. --- Resolution: Fixed Fix Version/s: 2.0.0 Target Version/s: 2.0.0 >

[jira] [Updated] (SPARK-15223) spark.executor.logs.rolling.maxSize wrongly referred to as spark.executor.logs.rolling.size.maxBytes

2016-05-09 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-15223: -- Priority: Minor (was: Trivial) > spark.executor.logs.rolling.maxSize wrongly referred to as >

[jira] [Updated] (SPARK-15223) spark.executor.logs.rolling.maxSize wrongly referred to as spark.executor.logs.rolling.size.maxBytes

2016-05-09 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-15223: -- Fix Version/s: 1.6.2 > spark.executor.logs.rolling.maxSize wrongly referred to as >

[jira] [Updated] (SPARK-15223) spark.executor.logs.rolling.maxSize wrongly referred to as spark.executor.logs.rolling.size.maxBytes

2016-05-09 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-15223: -- Target Version/s: 1.6.2, 2.0.0 (was: 2.0.0) > spark.executor.logs.rolling.maxSize wrongly referred to

[jira] [Updated] (SPARK-15223) spark.executor.logs.rolling.maxSize wrongly referred to as spark.executor.logs.rolling.size.maxBytes

2016-05-09 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-15223: -- Assignee: Philipp Hoffmann > spark.executor.logs.rolling.maxSize wrongly referred to as >

[jira] [Resolved] (SPARK-15225) Replace SQLContext with SparkSession in Encoder documentation

2016-05-09 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-15225. --- Resolution: Fixed Assignee: Liang-Chi Hsieh Fix Version/s: 2.0.0 Target

[jira] [Resolved] (SPARK-15067) YARN executors are launched with fixed perm gen size

2016-05-09 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-15067. --- Resolution: Fixed Assignee: Sean Owen Fix Version/s: 2.0.0 Target

[jira] [Resolved] (SPARK-15220) Add hyperlink to "running application" and "completed application"

2016-05-09 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-15220. --- Resolution: Fixed Fix Version/s: 2.0.0 Target Version/s: 2.0.0 > Add hyperlink to

[jira] [Commented] (SPARK-14946) Spark 2.0 vs 1.6.1 Query Time(out)

2016-05-09 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15276743#comment-15276743 ] Davies Liu commented on SPARK-14946: [~raymond.honderd...@sizmek.com] It seems that the second job

[jira] [Updated] (SPARK-15210) Add missing @DeveloperApi annotation in sql.types

2016-05-09 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-15210: -- Assignee: zhengruifeng > Add missing @DeveloperApi annotation in sql.types >

[jira] [Resolved] (SPARK-15199) Disallow Dropping Build-in Functions

2016-05-09 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-15199. - Resolution: Resolved Fix Version/s: 2.0.0 > Disallow Dropping Build-in Functions >

  1   2   >