[jira] [Assigned] (SPARK-23486) LookupFunctions should not check the same function name more than once

2018-03-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23486: Assignee: (was: Apache Spark) > LookupFunctions should not check the same function

[jira] [Assigned] (SPARK-23486) LookupFunctions should not check the same function name more than once

2018-03-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23486: Assignee: Apache Spark > LookupFunctions should not check the same function name more

[jira] [Commented] (SPARK-23486) LookupFunctions should not check the same function name more than once

2018-03-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16394422#comment-16394422 ] Apache Spark commented on SPARK-23486: -- User 'kevinyu98' has created a pull request for this issue:

[jira] [Commented] (SPARK-23618) docker-image-tool.sh Fails While Building Image

2018-03-10 Thread Jooseong Kim (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16394399#comment-16394399 ] Jooseong Kim commented on SPARK-23618: -- In function build, "local BUILD_ARGS" effectively creates an

[jira] [Commented] (SPARK-23646) pyspark DataFrameWriter ignores customized settings?

2018-03-10 Thread Chuan-Heng Hsiao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16394397#comment-16394397 ] Chuan-Heng Hsiao commented on SPARK-23646: -- Thanks. I'll post to dev mailing list as well～    

[jira] [Commented] (SPARK-23645) pandas_udf can not be called with keyword arguments

2018-03-10 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16394395#comment-16394395 ] Hyukjin Kwon commented on SPARK-23645: -- Hm .. I think named arguments in Scala side do not work too

[jira] [Commented] (SPARK-23646) pyspark DataFrameWriter ignores customized settings?

2018-03-10 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16394392#comment-16394392 ] Hyukjin Kwon commented on SPARK-23646: -- It sounds rather a question. I would recommend to ask it to

[jira] [Created] (SPARK-23646) pyspark DataFrameWriter ignores customized settings?

2018-03-10 Thread Chuan-Heng Hsiao (JIRA)
Chuan-Heng Hsiao created SPARK-23646: Summary: pyspark DataFrameWriter ignores customized settings? Key: SPARK-23646 URL: https://issues.apache.org/jira/browse/SPARK-23646 Project: Spark

[jira] [Commented] (SPARK-23560) A joinWith followed by groupBy requires extra shuffle

2018-03-10 Thread Bruce Robbins (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16394369#comment-16394369 ] Bruce Robbins commented on SPARK-23560: --- A simpler example that seems to reproduce this issue

[jira] [Updated] (SPARK-23645) pandas_udf can not be called with keyword arguments

2018-03-10 Thread Stu (Michael Stewart) (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stu (Michael Stewart) updated SPARK-23645: -- Description: pandas_udf (all python udfs(?)) do not accept keyword arguments

[jira] [Updated] (SPARK-23645) pandas_udf can not be called with keyword arguments

2018-03-10 Thread Stu (Michael Stewart) (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stu (Michael Stewart) updated SPARK-23645: -- Description: pandas_udf (all python udfs(?)) do not accept keyword arguments

[jira] [Updated] (SPARK-23645) pandas_udf can not be called with keyword arguments

2018-03-10 Thread Stu (Michael Stewart) (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stu (Michael Stewart) updated SPARK-23645: -- Description: pandas_udf (all python udfs(?)) do not accept keyword arguments

[jira] [Created] (SPARK-23645) pandas_udf can not be called with keyword arguments

2018-03-10 Thread Stu (Michael Stewart) (JIRA)
Stu (Michael Stewart) created SPARK-23645: - Summary: pandas_udf can not be called with keyword arguments Key: SPARK-23645 URL: https://issues.apache.org/jira/browse/SPARK-23645 Project: Spark

[jira] [Commented] (SPARK-23644) SHS with proxy doesn't show applications

2018-03-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16394243#comment-16394243 ] Apache Spark commented on SPARK-23644: -- User 'mgaido91' has created a pull request for this issue:

[jira] [Assigned] (SPARK-23644) SHS with proxy doesn't show applications

2018-03-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23644: Assignee: (was: Apache Spark) > SHS with proxy doesn't show applications >

[jira] [Assigned] (SPARK-23644) SHS with proxy doesn't show applications

2018-03-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23644: Assignee: Apache Spark > SHS with proxy doesn't show applications >

[jira] [Created] (SPARK-23644) SHS with proxy doesn't show applications

2018-03-10 Thread Marco Gaido (JIRA)
Marco Gaido created SPARK-23644: --- Summary: SHS with proxy doesn't show applications Key: SPARK-23644 URL: https://issues.apache.org/jira/browse/SPARK-23644 Project: Spark Issue Type:

[jira] [Updated] (SPARK-23643) XORShiftRandom.hashSeed allocates unnecessary memory

2018-03-10 Thread Maxim Gekk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-23643: --- Description: The hashSeed method allocates 64 bytes buffer and puts only 8 bytes of the seed

[jira] [Commented] (SPARK-23643) XORShiftRandom.hashSeed allocates unnecessary memory

2018-03-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16394205#comment-16394205 ] Apache Spark commented on SPARK-23643: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Assigned] (SPARK-23643) XORShiftRandom.hashSeed allocates unnecessary memory

2018-03-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23643: Assignee: Apache Spark > XORShiftRandom.hashSeed allocates unnecessary memory >

[jira] [Assigned] (SPARK-23643) XORShiftRandom.hashSeed allocates unnecessary memory

2018-03-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23643: Assignee: (was: Apache Spark) > XORShiftRandom.hashSeed allocates unnecessary memory

[jira] [Updated] (SPARK-23643) XORShiftRandom.hashSeed allocates unnecessary memory

2018-03-10 Thread Maxim Gekk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-23643: --- Summary: XORShiftRandom.hashSeed allocates unnecessary memory (was: XORShiftRandom.setSeed

[jira] [Created] (SPARK-23643) XORShiftRandom.setSeed allocates unnecessary memory

2018-03-10 Thread Maxim Gekk (JIRA)
Maxim Gekk created SPARK-23643: -- Summary: XORShiftRandom.setSeed allocates unnecessary memory Key: SPARK-23643 URL: https://issues.apache.org/jira/browse/SPARK-23643 Project: Spark Issue Type:

[jira] [Closed] (SPARK-23605) Conflicting dependencies for janino in 2.3.0

2018-03-10 Thread Tao Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23605?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Liu closed SPARK-23605. --- > Conflicting dependencies for janino in 2.3.0 > > >

[jira] [Commented] (SPARK-23605) Conflicting dependencies for janino in 2.3.0

2018-03-10 Thread Tao Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16394197#comment-16394197 ] Tao Liu commented on SPARK-23605: - Thanks [~kiszk], It was the spring-boot-dependencies/pom.xml that was

[jira] [Resolved] (SPARK-23605) Conflicting dependencies for janino in 2.3.0

2018-03-10 Thread Tao Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23605?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Liu resolved SPARK-23605. - Resolution: Not A Bug > Conflicting dependencies for janino in 2.3.0 >

[jira] [Resolved] (SPARK-23173) from_json can produce nulls for fields which are marked as non-nullable

2018-03-10 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-23173. -- Resolution: Fixed Assignee: Michał Świtakowski Fix Version/s: 2.4.0

[jira] [Resolved] (SPARK-15473) CSV fails to write and read back empty dataframe

2018-03-10 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-15473. -- Resolution: Cannot Reproduce Yup, I just double checked in the master too. Let me leave this

[jira] [Commented] (SPARK-23510) Support read data from Hive 2.2 and Hive 2.3 metastore

2018-03-10 Thread R (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23510?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16394117#comment-16394117 ] R commented on SPARK-23510: --- [~q79969786] - can you add fix version of 2.3.1 to this? Would like this in next