[jira] [Resolved] (SPARK-26557) The configuration of maven-checkstyle-plugin is error for mvn install

2019-01-07 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-26557. -- Resolution: Not A Problem > The configuration of maven-checkstyle-plugin is error for mvn i

[jira] [Resolved] (SPARK-26552) Extract a map from a string identified by java regex

2019-01-07 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-26552. -- Resolution: Won't Fix > Extract a map from a string identified by java regex > ---

[jira] [Updated] (SPARK-26558) java.util.NoSuchElementException while saving data into HDFS using Spark

2019-01-07 Thread Sidhartha (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sidhartha updated SPARK-26558: -- Description: h1. How to fix java.util.NoSuchElementException while saving data into HDFS using Spark

[jira] [Created] (SPARK-26558) java.util.NoSuchElementException while saving data into HDFS using Spark

2019-01-07 Thread Sidhartha (JIRA)
Sidhartha created SPARK-26558: - Summary: java.util.NoSuchElementException while saving data into HDFS using Spark Key: SPARK-26558 URL: https://issues.apache.org/jira/browse/SPARK-26558 Project: Spark

[jira] [Commented] (SPARK-26558) java.util.NoSuchElementException while saving data into HDFS using Spark

2019-01-07 Thread Liang-Chi Hsieh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26558?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16735605#comment-16735605 ] Liang-Chi Hsieh commented on SPARK-26558: - This looks like an issue at spark-gre

[jira] [Commented] (SPARK-13928) Move org.apache.spark.Logging into org.apache.spark.internal.Logging

2019-01-07 Thread abhinav (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16735604#comment-16735604 ] abhinav commented on SPARK-13928: - I am using HBASE 1.2 and Spark 2.3 and scala 2.11.11.

[jira] [Created] (SPARK-26559) ML image can't work with numpy versions prior to 1.9

2019-01-07 Thread Liang-Chi Hsieh (JIRA)
Liang-Chi Hsieh created SPARK-26559: --- Summary: ML image can't work with numpy versions prior to 1.9 Key: SPARK-26559 URL: https://issues.apache.org/jira/browse/SPARK-26559 Project: Spark Is

[jira] [Updated] (SPARK-26558) java.util.NoSuchElementException while saving data into HDFS using Spark

2019-01-07 Thread Sidhartha (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sidhartha updated SPARK-26558: -- Description: h1. !OKVMg.png!!k5EWv.png! How to fix java.util.NoSuchElementException while saving data

[jira] [Updated] (SPARK-26558) java.util.NoSuchElementException while saving data into HDFS using Spark

2019-01-07 Thread Sidhartha (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sidhartha updated SPARK-26558: -- Attachment: k5EWv.png > java.util.NoSuchElementException while saving data into HDFS using Spark > ---

[jira] [Updated] (SPARK-26558) java.util.NoSuchElementException while saving data into HDFS using Spark

2019-01-07 Thread Sidhartha (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sidhartha updated SPARK-26558: -- Attachment: OKVMg.png > java.util.NoSuchElementException while saving data into HDFS using Spark > ---

[jira] [Updated] (SPARK-26558) java.util.NoSuchElementException while saving data into HDFS using Spark

2019-01-07 Thread Sidhartha (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sidhartha updated SPARK-26558: -- Shepherd: pankaj arora > java.util.NoSuchElementException while saving data into HDFS using Spark > --

[jira] [Commented] (SPARK-13928) Move org.apache.spark.Logging into org.apache.spark.internal.Logging

2019-01-07 Thread abhinav (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16735616#comment-16735616 ] abhinav commented on SPARK-13928: - could you please clarify this. I mean location > Mov

[jira] [Issue Comment Deleted] (SPARK-13928) Move org.apache.spark.Logging into org.apache.spark.internal.Logging

2019-01-07 Thread abhinav (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] abhinav updated SPARK-13928: Comment: was deleted (was: could you please clarify this. I mean location) > Move org.apache.spark.Loggin

[jira] [Commented] (SPARK-26022) PySpark Comparison with Pandas

2019-01-07 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16735618#comment-16735618 ] Hyukjin Kwon commented on SPARK-26022: -- I'm working on this. > PySpark Comparison

[jira] [Assigned] (SPARK-26559) ML image can't work with numpy versions prior to 1.9

2019-01-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26559: Assignee: (was: Apache Spark) > ML image can't work with numpy versions prior to 1.9 >

[jira] [Reopened] (SPARK-26334) NullPointerException in CallMethodViaReflection when we apply reflect function for empty field

2019-01-07 Thread chenliang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chenliang reopened SPARK-26334: --- I have create a PR for this. > NullPointerException in CallMethodViaReflection when we apply reflect

[jira] [Assigned] (SPARK-26334) NullPointerException in CallMethodViaReflection when we apply reflect function for empty field

2019-01-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26334: Assignee: Apache Spark > NullPointerException in CallMethodViaReflection when we apply r

[jira] [Assigned] (SPARK-26334) NullPointerException in CallMethodViaReflection when we apply reflect function for empty field

2019-01-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26334: Assignee: (was: Apache Spark) > NullPointerException in CallMethodViaReflection when

[jira] [Assigned] (SPARK-26559) ML image can't work with numpy versions prior to 1.9

2019-01-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26559: Assignee: Apache Spark > ML image can't work with numpy versions prior to 1.9 > --

[jira] [Commented] (SPARK-26558) java.util.NoSuchElementException while saving data into HDFS using Spark

2019-01-07 Thread Sidhartha (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26558?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16735619#comment-16735619 ] Sidhartha commented on SPARK-26558: --- Ok. I applied all the parameters as per the offic

[jira] [Updated] (SPARK-26334) NullPointerException in CallMethodViaReflection when we apply reflect function for empty field

2019-01-07 Thread chenliang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chenliang updated SPARK-26334: -- Attachment: (was: SPARK-26334.patch) > NullPointerException in CallMethodViaReflection when we ap

[jira] [Comment Edited] (SPARK-26558) java.util.NoSuchElementException while saving data into HDFS using Spark

2019-01-07 Thread Sidhartha (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26558?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16735619#comment-16735619 ] Sidhartha edited comment on SPARK-26558 at 1/7/19 10:13 AM:

[jira] [Created] (SPARK-26560) Repeating select on udf function throws analysis exception - function not registered

2019-01-07 Thread Haripriya (JIRA)
Haripriya created SPARK-26560: - Summary: Repeating select on udf function throws analysis exception - function not registered Key: SPARK-26560 URL: https://issues.apache.org/jira/browse/SPARK-26560 Projec

[jira] [Updated] (SPARK-26560) Repeating select on udf function throws analysis exception - function not registered

2019-01-07 Thread Haripriya (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haripriya updated SPARK-26560: -- Description: In spark-shell, 1. Create the new function sql("CREATE FUNCTION last_day_test AS 'org.

[jira] [Commented] (SPARK-26560) Repeating select on udf function throws analysis exception - function not registered

2019-01-07 Thread nivedita singh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16735647#comment-16735647 ] nivedita singh commented on SPARK-26560: I will be working on this issue. > Rep

[jira] [Resolved] (SPARK-26559) ML image can't work with numpy versions prior to 1.9

2019-01-07 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-26559. -- Resolution: Fixed Assignee: Liang-Chi Hsieh Fixed in https://github.com/apache/spark/pull

[jira] [Updated] (SPARK-26559) ML image can't work with numpy versions prior to 1.9

2019-01-07 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-26559: - Fix Version/s: 3.0.0 2.4.1 > ML image can't work with numpy versions prior to

[jira] [Created] (SPARK-26561) Symbol 'type org.apache.spark.Logging' is missing from the classpath. This symbol is required by 'class org.apache.hadoop.hbase.spark.HBaseContext'

2019-01-07 Thread abhinav (JIRA)
abhinav created SPARK-26561: --- Summary: Symbol 'type org.apache.spark.Logging' is missing from the classpath. This symbol is required by 'class org.apache.hadoop.hbase.spark.HBaseContext' Key: SPARK-26561 URL: https://i

[jira] [Commented] (SPARK-13928) Move org.apache.spark.Logging into org.apache.spark.internal.Logging

2019-01-07 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16735665#comment-16735665 ] Wenchen Fan commented on SPARK-13928: - what version of HBase connector you are using

[jira] [Commented] (SPARK-13928) Move org.apache.spark.Logging into org.apache.spark.internal.Logging

2019-01-07 Thread abhinav (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16735691#comment-16735691 ] abhinav commented on SPARK-13928: - Hi, I am using HBase 1.2.0. is that fine? Can you te

[jira] [Commented] (SPARK-26534) Closure Cleaner Bug

2019-01-07 Thread sam (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16735699#comment-16735699 ] sam commented on SPARK-26534: - [~viirya] If I change to RDD I cannot reproduce either.  Thi

[jira] [Updated] (SPARK-26534) Closure Cleaner Bug

2019-01-07 Thread sam (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sam updated SPARK-26534: Description: I've found a strange combination of closures where the closure cleaner doesn't seem to be smart enou

[jira] [Commented] (SPARK-26457) Show hadoop configurations in HistoryServer environment tab

2019-01-07 Thread deshanxiao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16735707#comment-16735707 ] deshanxiao commented on SPARK-26457: [~planga82] Hi, thanks for your reply! I know t

[jira] [Commented] (SPARK-13928) Move org.apache.spark.Logging into org.apache.spark.internal.Logging

2019-01-07 Thread abhinav (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16735744#comment-16735744 ] abhinav commented on SPARK-13928: - Wen, I have already included the "org.apache.spark.Lo

[jira] [Assigned] (SPARK-26457) Show hadoop configurations in HistoryServer environment tab

2019-01-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26457: Assignee: (was: Apache Spark) > Show hadoop configurations in HistoryServer environme

[jira] [Resolved] (SPARK-23636) [SPARK 2.2] | Kafka Consumer | KafkaUtils.createRDD throws Exception - java.util.ConcurrentModificationException: KafkaConsumer is not safe for multi-threaded access

2019-01-07 Thread Gabor Somogyi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Somogyi resolved SPARK-23636. --- Resolution: Fixed Fix Version/s: 2.4.0 Please reopen if problem re-appears. > [SPARK

[jira] [Assigned] (SPARK-26457) Show hadoop configurations in HistoryServer environment tab

2019-01-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26457: Assignee: Apache Spark > Show hadoop configurations in HistoryServer environment tab > --

[jira] [Updated] (SPARK-26549) PySpark worker reuse take no effect for parallelize xrange

2019-01-07 Thread Yuanjian Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuanjian Li updated SPARK-26549: Summary: PySpark worker reuse take no effect for parallelize xrange (was: PySpark worker reuse ta

[jira] [Updated] (SPARK-26549) PySpark worker reuse take no effect for parallelize xrange

2019-01-07 Thread Yuanjian Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuanjian Li updated SPARK-26549: Description: During [the follow-up work|https://github.com/apache/spark/pull/23435#issuecomment-4

[jira] [Created] (SPARK-26562) countDistinct and user-defined function cannot be used in SELECT

2019-01-07 Thread Ravi Kaushik (JIRA)
Ravi Kaushik created SPARK-26562: Summary: countDistinct and user-defined function cannot be used in SELECT Key: SPARK-26562 URL: https://issues.apache.org/jira/browse/SPARK-26562 Project: Spark

[jira] [Updated] (SPARK-26549) PySpark worker reuse take no effect for parallelize xrange

2019-01-07 Thread Yuanjian Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuanjian Li updated SPARK-26549: Description: During [the follow-up work|https://github.com/apache/spark/pull/23435#issuecomment-4

[jira] [Updated] (SPARK-26549) PySpark worker reuse take no effect for parallelize xrange

2019-01-07 Thread Yuanjian Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuanjian Li updated SPARK-26549: Description: During [the follow-up work|https://github.com/apache/spark/pull/23435#issuecomment-4

[jira] [Updated] (SPARK-26549) PySpark worker reuse take no effect for parallelize xrange

2019-01-07 Thread Yuanjian Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuanjian Li updated SPARK-26549: Description: During [the follow-up work|https://github.com/apache/spark/pull/23435#issuecomment-4

[jira] [Commented] (SPARK-24725) Discuss necessary info and access in barrier mode + Mesos

2019-01-07 Thread Angel Conde (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16735836#comment-16735836 ] Angel Conde commented on SPARK-24725: -- Mesos has already the possibility via MPI f

[jira] [Commented] (SPARK-13928) Move org.apache.spark.Logging into org.apache.spark.internal.Logging

2019-01-07 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16735862#comment-16735862 ] Wenchen Fan commented on SPARK-13928: - You need to check the HBase document and see

[jira] [Updated] (SPARK-26549) PySpark worker reuse take no effect for parallelize xrange

2019-01-07 Thread Yuanjian Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuanjian Li updated SPARK-26549: Description: During [the follow-up work|https://github.com/apache/spark/pull/23435#issuecomment-4

[jira] [Resolved] (SPARK-26383) NPE when use DataFrameReader.jdbc with wrong URL

2019-01-07 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-26383. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 23464 [https://github.c

[jira] [Resolved] (SPARK-26513) Trigger GC on executor node idle

2019-01-07 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-26513. --- Resolution: Won't Fix > Trigger GC on executor node idle > > >

[jira] [Assigned] (SPARK-26383) NPE when use DataFrameReader.jdbc with wrong URL

2019-01-07 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-26383: - Assignee: clouds > NPE when use DataFrameReader.jdbc with wrong URL > -

[jira] [Commented] (SPARK-13928) Move org.apache.spark.Logging into org.apache.spark.internal.Logging

2019-01-07 Thread abhinav (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16735942#comment-16735942 ] abhinav commented on SPARK-13928: - Thanks a lot Wen > Move org.apache.spark.Logging

[jira] [Commented] (SPARK-26225) Scan: track decoding time for row-based data sources

2019-01-07 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16735954#comment-16735954 ] Wenchen Fan commented on SPARK-26225: - I think it's hard to define the decoding time

[jira] [Commented] (SPARK-26457) Show hadoop configurations in HistoryServer environment tab

2019-01-07 Thread Pablo Langa Blanco (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16736024#comment-16736024 ] Pablo Langa Blanco commented on SPARK-26457: Ok, I don't know that you are w

[jira] [Assigned] (SPARK-24489) No check for invalid input type of weight data in ml.PowerIterationClustering

2019-01-07 Thread holdenk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] holdenk reassigned SPARK-24489: --- Assignee: shahid > No check for invalid input type of weight data in ml.PowerIterationClustering >

[jira] [Resolved] (SPARK-24489) No check for invalid input type of weight data in ml.PowerIterationClustering

2019-01-07 Thread holdenk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] holdenk resolved SPARK-24489. - Resolution: Fixed Fix Version/s: 3.0.0 Thank's for working on this, I've merged the fix into mast

[jira] [Commented] (SPARK-26518) UI Application Info Race Condition Can Throw NoSuchElement

2019-01-07 Thread Pablo Langa Blanco (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16736087#comment-16736087 ] Pablo Langa Blanco commented on SPARK-26518: i was trying to find and easy s

[jira] [Resolved] (SPARK-26561) Symbol 'type org.apache.spark.Logging' is missing from the classpath. This symbol is required by 'class org.apache.hadoop.hbase.spark.HBaseContext'

2019-01-07 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-26561. Resolution: Not A Bug External libraries should not use internal Spark classes like {{Logg

[jira] [Commented] (SPARK-26518) UI Application Info Race Condition Can Throw NoSuchElement

2019-01-07 Thread Russell Spitzer (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16736091#comment-16736091 ] Russell Spitzer commented on SPARK-26518: - Yeah I basically came to the same con

[jira] [Updated] (SPARK-26551) Selecting one complex field and having is null predicate on another complex field can cause error

2019-01-07 Thread DB Tsai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai updated SPARK-26551: Affects Version/s: 2.4.0 > Selecting one complex field and having is null predicate on another complex >

[jira] [Assigned] (SPARK-26551) Selecting one complex field and having is null predicate on another complex field can cause error

2019-01-07 Thread DB Tsai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai reassigned SPARK-26551: --- Assignee: Liang-Chi Hsieh > Selecting one complex field and having is null predicate on another com

[jira] [Assigned] (SPARK-25689) Move token renewal logic to driver in yarn-client mode

2019-01-07 Thread Imran Rashid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Imran Rashid reassigned SPARK-25689: Assignee: Marcelo Vanzin > Move token renewal logic to driver in yarn-client mode > -

[jira] [Resolved] (SPARK-25689) Move token renewal logic to driver in yarn-client mode

2019-01-07 Thread Imran Rashid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Imran Rashid resolved SPARK-25689. -- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 23338 [https://gi

[jira] [Commented] (SPARK-26563) Quick Start documentation provides example that doesn't work (Java)

2019-01-07 Thread Leonardo Colman Lopes (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16736358#comment-16736358 ] Leonardo Colman Lopes commented on SPARK-26563: --- Pull request ready https

[jira] [Assigned] (SPARK-26563) Quick Start documentation provides example that doesn't work (Java)

2019-01-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26563: Assignee: Apache Spark > Quick Start documentation provides example that doesn't work (Ja

[jira] [Commented] (SPARK-26563) Quick Start documentation provides example that doesn't work (Java)

2019-01-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16736363#comment-16736363 ] Apache Spark commented on SPARK-26563: -- User 'Kerooker' has created a pull request

[jira] [Assigned] (SPARK-26563) Quick Start documentation provides example that doesn't work (Java)

2019-01-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26563: Assignee: (was: Apache Spark) > Quick Start documentation provides example that doesn

[jira] [Created] (SPARK-26563) Quick Start documentation provides example that doesn't work (Java)

2019-01-07 Thread Leonardo Colman Lopes (JIRA)
Leonardo Colman Lopes created SPARK-26563: - Summary: Quick Start documentation provides example that doesn't work (Java) Key: SPARK-26563 URL: https://issues.apache.org/jira/browse/SPARK-26563

[jira] [Commented] (SPARK-24701) SparkMaster WebUI allow all appids to be shown in detail on port 4040 rather than different ports per app

2019-01-07 Thread Pablo Langa Blanco (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24701?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16736366#comment-16736366 ] Pablo Langa Blanco commented on SPARK-24701: Hi [~toopt4] i think you have

[jira] [Resolved] (SPARK-26065) Change query hint from a `LogicalPlan` to a field

2019-01-07 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-26065. - Resolution: Fixed Assignee: Maryann Xue Fix Version/s: 3.0.0 > Change query hint from a

[jira] [Closed] (SPARK-26537) update the release scripts to point to gitbox

2019-01-07 Thread shane knapp (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shane knapp closed SPARK-26537. --- > update the release scripts to point to gitbox > - > >

[jira] [Created] (SPARK-26564) Fix misleading error message about spark.network.timeout and spark.executor.heartbeatInterval

2019-01-07 Thread Kengo Seki (JIRA)
Kengo Seki created SPARK-26564: -- Summary: Fix misleading error message about spark.network.timeout and spark.executor.heartbeatInterval Key: SPARK-26564 URL: https://issues.apache.org/jira/browse/SPARK-26564

[jira] [Commented] (SPARK-25823) map_filter can generate incorrect data

2019-01-07 Thread Thincrs (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16736446#comment-16736446 ] Thincrs commented on SPARK-25823: - A user of thincrs has selected this issue. Deadline:

[jira] [Assigned] (SPARK-26564) Fix misleading error message about spark.network.timeout and spark.executor.heartbeatInterval

2019-01-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26564: Assignee: Apache Spark > Fix misleading error message about spark.network.timeout and >

[jira] [Assigned] (SPARK-26564) Fix misleading error message about spark.network.timeout and spark.executor.heartbeatInterval

2019-01-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26564: Assignee: (was: Apache Spark) > Fix misleading error message about spark.network.time

[jira] [Updated] (SPARK-26269) YarnAllocator should have same blacklist behaviour with YARN to maxmize use of cluster resource

2019-01-07 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves updated SPARK-26269: -- Fix Version/s: 2.4.1 > YarnAllocator should have same blacklist behaviour with YARN to maxmize

[jira] [Updated] (SPARK-26565) modify dev/create-release/release-build.sh to let jenkins build packages w/o publishing

2019-01-07 Thread shane knapp (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shane knapp updated SPARK-26565: Attachment: fine.png > modify dev/create-release/release-build.sh to let jenkins build packages w/

[jira] [Created] (SPARK-26565) modify dev/create-release/release-build.sh to let jenkins build packages w/o publishing

2019-01-07 Thread shane knapp (JIRA)
shane knapp created SPARK-26565: --- Summary: modify dev/create-release/release-build.sh to let jenkins build packages w/o publishing Key: SPARK-26565 URL: https://issues.apache.org/jira/browse/SPARK-26565

[jira] [Updated] (SPARK-26565) modify dev/create-release/release-build.sh to let jenkins build packages w/o publishing

2019-01-07 Thread shane knapp (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shane knapp updated SPARK-26565: Description: about a year+ ago, we stopped publishing releases directly from jenkins... this mean

[jira] [Assigned] (SPARK-26565) modify dev/create-release/release-build.sh to let jenkins build packages w/o publishing

2019-01-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26565: Assignee: Apache Spark (was: shane knapp) > modify dev/create-release/release-build.sh t

[jira] [Assigned] (SPARK-26565) modify dev/create-release/release-build.sh to let jenkins build packages w/o publishing

2019-01-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26565: Assignee: shane knapp (was: Apache Spark) > modify dev/create-release/release-build.sh t

[jira] [Commented] (SPARK-26565) modify dev/create-release/release-build.sh to let jenkins build packages w/o publishing

2019-01-07 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16736465#comment-16736465 ] Sean Owen commented on SPARK-26565: --- Sure, if we're not making releases with it, no ne

[jira] [Updated] (SPARK-26565) modify dev/create-release/release-build.sh to let jenkins build packages w/o publishing

2019-01-07 Thread shane knapp (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shane knapp updated SPARK-26565: Description: about a year+ ago, we stopped publishing releases directly from jenkins... this mean

[jira] [Commented] (SPARK-26565) modify dev/create-release/release-build.sh to let jenkins build packages w/o publishing

2019-01-07 Thread shane knapp (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16736472#comment-16736472 ] shane knapp commented on SPARK-26565: - [~srowen] – herein lies my confusion...  afte

[jira] [Updated] (SPARK-26565) modify dev/create-release/release-build.sh to let jenkins build packages w/o publishing

2019-01-07 Thread shane knapp (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shane knapp updated SPARK-26565: Attachment: no-idea.jpg > modify dev/create-release/release-build.sh to let jenkins build packages

[jira] [Comment Edited] (SPARK-26565) modify dev/create-release/release-build.sh to let jenkins build packages w/o publishing

2019-01-07 Thread shane knapp (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16736472#comment-16736472 ] shane knapp edited comment on SPARK-26565 at 1/7/19 11:26 PM:

[jira] [Commented] (SPARK-26565) modify dev/create-release/release-build.sh to let jenkins build packages w/o publishing

2019-01-07 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16736485#comment-16736485 ] Sean Owen commented on SPARK-26565: --- I've never done a release myself ... [~cloud_fan]

[jira] [Resolved] (SPARK-26491) Use ConfigEntry for hardcoded configs for test categories.

2019-01-07 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26491?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-26491. Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 23413 [https:

[jira] [Assigned] (SPARK-26491) Use ConfigEntry for hardcoded configs for test categories.

2019-01-07 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26491?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reassigned SPARK-26491: -- Assignee: Marco Gaido > Use ConfigEntry for hardcoded configs for test categories. >

[jira] [Commented] (SPARK-26565) modify dev/create-release/release-build.sh to let jenkins build packages w/o publishing

2019-01-07 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16736493#comment-16736493 ] Marcelo Vanzin commented on SPARK-26565: Stepping back a little, what is the pur

[jira] [Commented] (SPARK-26565) modify dev/create-release/release-build.sh to let jenkins build packages w/o publishing

2019-01-07 Thread shane knapp (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16736500#comment-16736500 ] shane knapp commented on SPARK-26565: - [~vanzin] – good to have confirmed that `do-r

[jira] [Comment Edited] (SPARK-26565) modify dev/create-release/release-build.sh to let jenkins build packages w/o publishing

2019-01-07 Thread shane knapp (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16736500#comment-16736500 ] shane knapp edited comment on SPARK-26565 at 1/7/19 11:57 PM:

[jira] [Issue Comment Deleted] (SPARK-25823) map_filter can generate incorrect data

2019-01-07 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-25823: -- Comment: was deleted (was: A user of thincrs has selected this issue. Deadline: Mon, Jan 14, 2

[jira] [Resolved] (SPARK-25272) Show some kind of test output to indicate pyarrow tests were run

2019-01-07 Thread Bryan Cutler (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25272?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bryan Cutler resolved SPARK-25272. -- Resolution: Won't Fix > Show some kind of test output to indicate pyarrow tests were run > ---

[jira] [Created] (SPARK-26566) Upgrade apache/arrow to 0.12.0

2019-01-07 Thread Bryan Cutler (JIRA)
Bryan Cutler created SPARK-26566: Summary: Upgrade apache/arrow to 0.12.0 Key: SPARK-26566 URL: https://issues.apache.org/jira/browse/SPARK-26566 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-26566) Upgrade apache/arrow to 0.12.0

2019-01-07 Thread Bryan Cutler (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bryan Cutler updated SPARK-26566: - Target Version/s: (was: 2.4.0) > Upgrade apache/arrow to 0.12.0 >

[jira] [Assigned] (SPARK-26566) Upgrade apache/arrow to 0.12.0

2019-01-07 Thread Bryan Cutler (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bryan Cutler reassigned SPARK-26566: Assignee: (was: Bryan Cutler) > Upgrade apache/arrow to 0.12.0 >

[jira] [Updated] (SPARK-26566) Upgrade apache/arrow to 0.12.0

2019-01-07 Thread Bryan Cutler (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bryan Cutler updated SPARK-26566: - Fix Version/s: (was: 2.4.0) > Upgrade apache/arrow to 0.12.0 > -

[jira] [Updated] (SPARK-26566) Upgrade apache/arrow to 0.12.0

2019-01-07 Thread Bryan Cutler (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bryan Cutler updated SPARK-26566: - Affects Version/s: (was: 2.3.0) 2.4.0 > Upgrade apache/arrow to 0.12.

[jira] [Resolved] (SPARK-26267) Kafka source may reprocess data

2019-01-07 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu resolved SPARK-26267. -- Resolution: Fixed Fix Version/s: 2.4.1 > Kafka source may reprocess data >

[jira] [Updated] (SPARK-26566) Upgrade apache/arrow to 0.12.0

2019-01-07 Thread Bryan Cutler (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bryan Cutler updated SPARK-26566: - Description: _This is just a placeholder for now to collect what needs to be fixed when we upgr

[jira] [Resolved] (SPARK-23386) Enable direct application links before replay

2019-01-07 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-23386. Resolution: Won't Fix I'm closing this for now as I believe SPARK-6951 handles a lot of th

  1   2   >