[jira] [Commented] (SPARK-28910) Prevent schema verification when connecting to in memory derby

2019-09-06 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16924722#comment-16924722 ] Yuming Wang commented on SPARK-28910: - Thank you [~hyukjin.kwon] It works. > Prevent schema

[jira] [Commented] (SPARK-28910) Prevent schema verification when connecting to in memory derby

2019-09-06 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16924723#comment-16924723 ] Yuming Wang commented on SPARK-28910: - Issue resolved by pull request 25663

[jira] [Resolved] (SPARK-28910) Prevent schema verification when connecting to in memory derby

2019-09-06 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-28910. - Resolution: Fixed > Prevent schema verification when connecting to in memory derby >

[jira] [Assigned] (SPARK-28910) Prevent schema verification when connecting to in memory derby

2019-09-06 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang reassigned SPARK-28910: --- Assignee: Bogdan Ghit > Prevent schema verification when connecting to in memory derby >

[jira] [Updated] (SPARK-28910) Prevent schema verification when connecting to in memory derby

2019-09-06 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-28910: Fix Version/s: 3.0.0 > Prevent schema verification when connecting to in memory derby >

[jira] [Commented] (SPARK-28910) Prevent schema verification when connecting to in memory derby

2019-09-06 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16924721#comment-16924721 ] Hyukjin Kwon commented on SPARK-28910: -- Are you unable to assign someone to a JIRA ticket? >

[jira] [Commented] (SPARK-28910) Prevent schema verification when connecting to in memory derby

2019-09-06 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16924715#comment-16924715 ] Yuming Wang commented on SPARK-28910: - [~hyukjin.kwon] Could you assignee this ticket to

[jira] [Assigned] (SPARK-28910) Prevent schema verification when connecting to in memory derby

2019-09-06 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang reassigned SPARK-28910: --- Assignee: (was: Yuming Wang) > Prevent schema verification when connecting to in

[jira] [Assigned] (SPARK-28910) Prevent schema verification when connecting to in memory derby

2019-09-06 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang reassigned SPARK-28910: --- Assignee: Yuming Wang > Prevent schema verification when connecting to in memory derby >

[jira] [Assigned] (SPARK-28912) MatchError exception in CheckpointWriteHandler

2019-09-06 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-28912: - Assignee: Aleksandr Kashkirov > MatchError exception in CheckpointWriteHandler >

[jira] [Resolved] (SPARK-28912) MatchError exception in CheckpointWriteHandler

2019-09-06 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-28912. --- Fix Version/s: 3.0.0 2.4.5 Resolution: Fixed Issue resolved by

[jira] [Assigned] (SPARK-29011) Upgrade netty-all to 4.1.39-Final

2019-09-06 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-29011: - Assignee: Nicholas Marion > Upgrade netty-all to 4.1.39-Final >

[jira] [Resolved] (SPARK-29011) Upgrade netty-all to 4.1.39-Final

2019-09-06 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-29011. --- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 25712

[jira] [Commented] (SPARK-28970) implement USE CATALOG/NAMESPACE for Data Source V2

2019-09-06 Thread Terry Kim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28970?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16924686#comment-16924686 ] Terry Kim commented on SPARK-28970: --- OK. Are the following statements from the above comment still

[jira] [Commented] (SPARK-28970) implement USE CATALOG/NAMESPACE for Data Source V2

2019-09-06 Thread Ryan Blue (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28970?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16924681#comment-16924681 ] Ryan Blue commented on SPARK-28970: --- I think we should, yes. > implement USE CATALOG/NAMESPACE for

[jira] [Commented] (SPARK-28970) implement USE CATALOG/NAMESPACE for Data Source V2

2019-09-06 Thread Terry Kim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28970?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16924680#comment-16924680 ] Terry Kim commented on SPARK-28970: --- [~cloud_fan] [~rdblue] Do we plan to support the following as

[jira] [Resolved] (SPARK-28935) Document SQL metrics for Details for Query Plan

2019-09-06 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-28935. - Fix Version/s: 3.0.0 Assignee: Liang-Chi Hsieh Resolution: Fixed > Document SQL metrics

[jira] [Created] (SPARK-29014) DataSourceV2: Clean up current, default, and session catalog uses

2019-09-06 Thread Ryan Blue (Jira)
Ryan Blue created SPARK-29014: - Summary: DataSourceV2: Clean up current, default, and session catalog uses Key: SPARK-29014 URL: https://issues.apache.org/jira/browse/SPARK-29014 Project: Spark

[jira] [Updated] (SPARK-29011) Upgrade netty-all to 4.1.39-Final

2019-09-06 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-29011: -- Affects Version/s: (was: 2.4.4) 3.0.0 > Upgrade netty-all to

[jira] [Updated] (SPARK-29011) Upgrade netty-all to 4.1.39-Final

2019-09-06 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-29011: -- Affects Version/s: (was: 2.3.3) > Upgrade netty-all to 4.1.39-Final >

[jira] [Comment Edited] (SPARK-29003) Spark history server startup hang due to deadlock

2019-09-06 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16924581#comment-16924581 ] Jungtaek Lim edited comment on SPARK-29003 at 9/6/19 8:39 PM: -- Thanks for

[jira] [Comment Edited] (SPARK-29003) Spark history server startup hang due to deadlock

2019-09-06 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16924581#comment-16924581 ] Jungtaek Lim edited comment on SPARK-29003 at 9/6/19 8:39 PM: -- Thanks for

[jira] [Commented] (SPARK-29003) Spark history server startup hang due to deadlock

2019-09-06 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16924581#comment-16924581 ] Jungtaek Lim commented on SPARK-29003: -- Thanks for providing jstack. Looks like it's known JDK

[jira] [Updated] (SPARK-26989) Flaky test:DAGSchedulerSuite.Barrier task failures from the same stage attempt don't trigger multiple stage retries

2019-09-06 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-26989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-26989: -- Component/s: Tests > Flaky test:DAGSchedulerSuite.Barrier task failures from the same stage

[jira] [Commented] (SPARK-29003) Spark history server startup hang due to deadlock

2019-09-06 Thread shanyu zhao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16924567#comment-16924567 ] shanyu zhao commented on SPARK-29003: - Please see the full jstack attached. > Spark history server

[jira] [Updated] (SPARK-29003) Spark history server startup hang due to deadlock

2019-09-06 Thread shanyu zhao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shanyu zhao updated SPARK-29003: Attachment: sparkhistory-jstack.log > Spark history server startup hang due to deadlock >

[jira] [Commented] (SPARK-23829) spark-sql-kafka source in spark 2.3 causes reading stream failure frequently

2019-09-06 Thread Gabor Somogyi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-23829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16924561#comment-16924561 ] Gabor Somogyi commented on SPARK-23829: --- [~leo.zhi] Just seen your comment. From the stack you've

[jira] [Updated] (SPARK-28912) MatchError exception in CheckpointWriteHandler

2019-09-06 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-28912: -- Affects Version/s: 2.4.0 2.4.1 2.4.2

[jira] [Comment Edited] (SPARK-23829) spark-sql-kafka source in spark 2.3 causes reading stream failure frequently

2019-09-06 Thread Gabor Somogyi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-23829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16924561#comment-16924561 ] Gabor Somogyi edited comment on SPARK-23829 at 9/6/19 7:53 PM: --- [~leo.zhi]

[jira] [Resolved] (SPARK-29002) Avoid changing SMJ to BHJ if the build side has a high ratio of empty partitions

2019-09-06 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-29002. - Fix Version/s: 3.0.0 Assignee: Maryann Xue Resolution: Fixed > Avoid changing SMJ to

[jira] [Created] (SPARK-29013) Structurally equivalent subexpression elimination

2019-09-06 Thread Liang-Chi Hsieh (Jira)
Liang-Chi Hsieh created SPARK-29013: --- Summary: Structurally equivalent subexpression elimination Key: SPARK-29013 URL: https://issues.apache.org/jira/browse/SPARK-29013 Project: Spark

[jira] [Commented] (SPARK-25299) Use remote storage for persisting shuffle data

2019-09-06 Thread jay vyas (Jira)
[ https://issues.apache.org/jira/browse/SPARK-25299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16924474#comment-16924474 ] jay vyas commented on SPARK-25299: -- I think architecturally this is a huge step forward , in that it 

[jira] [Updated] (SPARK-28141) Date type can not accept special values

2019-09-06 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-28141: --- Description: ||Input String||Valid Types||Description|| |{{epoch}}|{{date}}|1970-01-01 00:00:00+00

[jira] [Updated] (SPARK-28141) Date type can not accept special values

2019-09-06 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-28141: --- Summary: Date type can not accept special values (was: Timestamp/Date type can not accept special

[jira] [Updated] (SPARK-29012) Timestamp type can not accept special values

2019-09-06 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-29012: --- Description: ||Input String||Valid Types||Description|| |{{epoch}}|{{timestamp}}|1970-01-01

[jira] [Created] (SPARK-29012) Timestamp type can not accept special values

2019-09-06 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-29012: -- Summary: Timestamp type can not accept special values Key: SPARK-29012 URL: https://issues.apache.org/jira/browse/SPARK-29012 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-29010) [SQL] Cast Decimal to double may lost precision

2019-09-06 Thread feiwang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] feiwang resolved SPARK-29010. - Resolution: Not A Bug > [SQL] Cast Decimal to double may lost precision >

[jira] [Commented] (SPARK-28921) Spark jobs failing on latest versions of Kubernetes (1.15.3, 1.14.6, 1,13.10, 1.12.10, 1.11.10)

2019-09-06 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16924364#comment-16924364 ] Dongjoon Hyun commented on SPARK-28921: --- Hi, thank you for sharing. Of course, we know that. ;) >

[jira] [Resolved] (SPARK-28690) Date/Time Functions: date_part for timestamps

2019-09-06 Thread Takeshi Yamamuro (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-28690. -- Fix Version/s: 3.0.0 Assignee: Maxim Gekk Resolution: Fixed Resolved

[jira] [Resolved] (SPARK-28967) ConcurrentModificationException is thrown from EventLoggingListener

2019-09-06 Thread Sean Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-28967. --- Fix Version/s: 3.0.0 Assignee: Jungtaek Lim Resolution: Fixed Resolved by

[jira] [Created] (SPARK-29011) Upgrade netty-all to 4.1.39-Final

2019-09-06 Thread Nicholas Marion (Jira)
Nicholas Marion created SPARK-29011: --- Summary: Upgrade netty-all to 4.1.39-Final Key: SPARK-29011 URL: https://issues.apache.org/jira/browse/SPARK-29011 Project: Spark Issue Type:

[jira] [Updated] (SPARK-29010) [SQL] Cast Decimal to double may lost precision

2019-09-06 Thread feiwang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] feiwang updated SPARK-29010: Attachment: screenshot-1.png > [SQL] Cast Decimal to double may lost precision >

[jira] [Updated] (SPARK-29010) [SQL] Cast Decimal to double may lost precision

2019-09-06 Thread feiwang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] feiwang updated SPARK-29010: Description: Even I set spark.sql.decimalOperations.allowPrecisionLoss=false. It will still lost

[jira] [Created] (SPARK-29010) [SQL] Cast Decimal to double may lost precision

2019-09-06 Thread feiwang (Jira)
feiwang created SPARK-29010: --- Summary: [SQL] Cast Decimal to double may lost precision Key: SPARK-29010 URL: https://issues.apache.org/jira/browse/SPARK-29010 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-28173) Add Kafka delegation token proxy user support

2019-09-06 Thread Gabor Somogyi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16924246#comment-16924246 ] Gabor Somogyi commented on SPARK-28173: --- [~viktorsomogyi] thanks for your efforts! The feature is

[jira] [Created] (SPARK-29009) Returning pojo from udf not working

2019-09-06 Thread Tomasz Belina (Jira)
Tomasz Belina created SPARK-29009: - Summary: Returning pojo from udf not working Key: SPARK-29009 URL: https://issues.apache.org/jira/browse/SPARK-29009 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-29008) Define an individual method for each common subexpression in HashAggregateExec

2019-09-06 Thread Takeshi Yamamuro (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-29008: - Description: In the current master, the common subexpr elimination code in

[jira] [Updated] (SPARK-29008) Define an individual method for each common subexpression in HashAggregateExec

2019-09-06 Thread Takeshi Yamamuro (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-29008: - Environment: (was: In the current master, the common subexpr elimination code in

[jira] [Created] (SPARK-29008) Define an individual method for each common subexpression in HashAggregateExec

2019-09-06 Thread Takeshi Yamamuro (Jira)
Takeshi Yamamuro created SPARK-29008: Summary: Define an individual method for each common subexpression in HashAggregateExec Key: SPARK-29008 URL: https://issues.apache.org/jira/browse/SPARK-29008

[jira] [Updated] (SPARK-29007) Possible leak of SparkContext in tests / test suites initializing StreamingContext

2019-09-06 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim updated SPARK-29007: - Summary: Possible leak of SparkContext in tests / test suites initializing StreamingContext

[jira] [Created] (SPARK-29007) Possible leak of SparkContext in tests initializing StreamingContext

2019-09-06 Thread Jungtaek Lim (Jira)
Jungtaek Lim created SPARK-29007: Summary: Possible leak of SparkContext in tests initializing StreamingContext Key: SPARK-29007 URL: https://issues.apache.org/jira/browse/SPARK-29007 Project: Spark

[jira] [Commented] (SPARK-9612) Add instance weight support for GBTs

2019-09-06 Thread zhengruifeng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-9612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16924090#comment-16924090 ] zhengruifeng commented on SPARK-9612: - https://issues.apache.org/jira/browse/SPARK-19591 is now

[jira] [Reopened] (SPARK-28732) org.apache.spark.sql.catalyst.expressions.codegen.CodeGenerator - failed to compile: org.codehaus.commons.compiler.CompileException: File 'generated.java' when storing

2019-09-06 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-28732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alix Métivier reopened SPARK-28732: --- > org.apache.spark.sql.catalyst.expressions.codegen.CodeGenerator - failed to > compile:

[jira] [Updated] (SPARK-28999) Exception in thread "main" org.apache.spark.sql.AnalysisException: Multiple mapGroupsWithStates are not supported on a streaming DataFrames/Datasets;;

2019-09-06 Thread ruiliang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ruiliang updated SPARK-28999: - Description: Exception in thread "main" org.apache.spark.sql.AnalysisException: Multiple

[jira] [Updated] (SPARK-28999) Exception in thread "main" org.apache.spark.sql.AnalysisException: Multiple mapGroupsWithStates are not supported on a streaming DataFrames/Datasets;;

2019-09-06 Thread ruiliang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ruiliang updated SPARK-28999: - Description: Exception in thread "main" org.apache.spark.sql.AnalysisException: Multiple

[jira] [Updated] (SPARK-28999) Exception in thread "main" org.apache.spark.sql.AnalysisException: Multiple mapGroupsWithStates are not supported on a streaming DataFrames/Datasets;;

2019-09-06 Thread ruiliang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ruiliang updated SPARK-28999: - Description: Exception in thread "main" org.apache.spark.sql.AnalysisException: Multiple

[jira] [Updated] (SPARK-28999) Exception in thread "main" org.apache.spark.sql.AnalysisException: Multiple mapGroupsWithStates are not supported on a streaming DataFrames/Datasets;;

2019-09-06 Thread ruiliang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ruiliang updated SPARK-28999: - Attachment: 微信图片_20190906170459.png > Exception in thread "main"

[jira] [Resolved] (SPARK-28968) Add HasNumFeatures in the scala side

2019-09-06 Thread zhengruifeng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhengruifeng resolved SPARK-28968. -- Resolution: Resolved > Add HasNumFeatures in the scala side >

[jira] [Commented] (SPARK-21827) Task fail due to executor exception when enable Sasl Encryption

2019-09-06 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-21827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16924045#comment-16924045 ] Sébastien BARNOUD commented on SPARK-21827: --- Didn't you have in your logs: {code:java} INFO

[jira] [Updated] (SPARK-28141) Timestamp/Date type can not accept special values

2019-09-06 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-28141: --- Description: ||Input String||Valid Types||Description|| |{{epoch}}|{{date}}, 

[jira] [Updated] (SPARK-28141) Timestamp/Date type can not accept special values

2019-09-06 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-28141: --- Description: ||Input String||Valid Types||Description|| |{{epoch}}|{{date}}, 

[jira] [Updated] (SPARK-29006) Support special date/timestamp values `infinity`/`-infinity`

2019-09-06 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29006?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-29006: --- Description: ||Input String||Valid Types||Description|| |{{infinity}}|{{date}}, {{timestamp}}|later

[jira] [Created] (SPARK-29006) Support special date/timestamp values `infinity`/`-infinity`

2019-09-06 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-29006: -- Summary: Support special date/timestamp values `infinity`/`-infinity` Key: SPARK-29006 URL: https://issues.apache.org/jira/browse/SPARK-29006 Project: Spark

[jira] [Commented] (SPARK-21827) Task fail due to executor exception when enable Sasl Encryption

2019-09-06 Thread Anatoly Vinogradov (Jira)
[ https://issues.apache.org/jira/browse/SPARK-21827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16923990#comment-16923990 ] Anatoly Vinogradov commented on SPARK-21827: I've got the same exception when run AWS EMR

[jira] [Comment Edited] (SPARK-28999) Exception in thread "main" org.apache.spark.sql.AnalysisException: Multiple mapGroupsWithStates are not supported on a streaming DataFrames/Datasets;;

2019-09-06 Thread ruiliang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16923957#comment-16923957 ] ruiliang edited comment on SPARK-28999 at 9/6/19 6:23 AM: -- State: GroupState

[jira] [Commented] (SPARK-28999) Exception in thread "main" org.apache.spark.sql.AnalysisException: Multiple mapGroupsWithStates are not supported on a streaming DataFrames/Datasets;;

2019-09-06 Thread ruiliang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16923957#comment-16923957 ] ruiliang commented on SPARK-28999: -- state: GroupState[?] 或者有没有方法取得这个state里面的数据集各,用sql去统计这个里面的所有数据?谢谢 >