[jira] [Updated] (SPARK-28527) Build a Test Framework for Thriftserver

[ https://issues.apache.org/jira/browse/SPARK-28527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-28527: Attachment: image-2019-08-03-13-58-06-106.png > Build a Test Framework for Thriftserver >

[jira] [Updated] (SPARK-28527) Build a Test Framework for Thriftserver

[ https://issues.apache.org/jira/browse/SPARK-28527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-28527: Attachment: (was: image-2019-08-03-13-56-59-090.png) > Build a Test Framework for

[jira] [Updated] (SPARK-28527) Build a Test Framework for Thriftserver

[ https://issues.apache.org/jira/browse/SPARK-28527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-28527: Attachment: image-2019-08-03-13-56-59-090.png > Build a Test Framework for Thriftserver >

[jira] [Created] (SPARK-28609) Fix broken styles/links and make up-to-date

Dongjoon Hyun created SPARK-28609: - Summary: Fix broken styles/links and make up-to-date Key: SPARK-28609 URL: https://issues.apache.org/jira/browse/SPARK-28609 Project: Spark Issue Type:

[jira] [Commented] (SPARK-28123) String Functions: Add support btrim

[ https://issues.apache.org/jira/browse/SPARK-28123?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16899349#comment-16899349 ] EdisonWang commented on SPARK-28123: seems it is the same with trim() on both sides? > String

[jira] [Updated] (SPARK-28058) Reading csv with DROPMALFORMED sometimes doesn't drop malformed records

[ https://issues.apache.org/jira/browse/SPARK-28058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-28058: -- Labels: (was: CSV csv csvparser) > Reading csv with DROPMALFORMED sometimes doesn't drop

[jira] [Updated] (SPARK-28093) Built-in function trim/ltrim/rtrim has bug when using trimStr

[ https://issues.apache.org/jira/browse/SPARK-28093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-28093: -- Fix Version/s: (was: 2.4.4) > Built-in function trim/ltrim/rtrim has bug when using

[jira] [Commented] (SPARK-28093) Built-in function trim/ltrim/rtrim has bug when using trimStr

[ https://issues.apache.org/jira/browse/SPARK-28093?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16899333#comment-16899333 ] Dongjoon Hyun commented on SPARK-28093: --- I removed `2.4.4` from the fixed version since this is

[jira] [Comment Edited] (SPARK-28093) Built-in function trim/ltrim/rtrim has bug when using trimStr

[ https://issues.apache.org/jira/browse/SPARK-28093?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16899333#comment-16899333 ] Dongjoon Hyun edited comment on SPARK-28093 at 8/3/19 2:43 AM: --- I removed

[jira] [Updated] (SPARK-28527) Build a Test Framework for Thriftserver

[ https://issues.apache.org/jira/browse/SPARK-28527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-28527: Issue Type: Sub-task (was: Improvement) Parent: SPARK-28608 > Build a Test Framework for

[jira] [Updated] (SPARK-28608) Improve test coverage of ThriftServer

[ https://issues.apache.org/jira/browse/SPARK-28608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-28608: Component/s: Tests > Improve test coverage of ThriftServer > - > >

[jira] [Updated] (SPARK-28472) Add a test for testing different protocol versions

[ https://issues.apache.org/jira/browse/SPARK-28472?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-28472: Issue Type: Sub-task (was: Test) Parent: SPARK-28608 > Add a test for testing different protocol

[jira] [Updated] (SPARK-28608) Improve test coverage of ThriftServer

[ https://issues.apache.org/jira/browse/SPARK-28608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-28608: Description: The Spark Thrift server provides the access to Spark engine via JDBC or ODBC. We need to

[jira] [Created] (SPARK-28608) Improve test coverage of ThriftServer

Xiao Li created SPARK-28608: --- Summary: Improve test coverage of ThriftServer Key: SPARK-28608 URL: https://issues.apache.org/jira/browse/SPARK-28608 Project: Spark Issue Type: Umbrella

[jira] [Commented] (SPARK-28151) [JDBC Connector] ByteType is not correctly mapped for read/write of SQLServer tables

[ https://issues.apache.org/jira/browse/SPARK-28151?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16899323#comment-16899323 ] Shiv Prashant Sood commented on SPARK-28151: Created Work In Progress PR for this JIRA here.

[jira] [Resolved] (SPARK-28582) Pyspark daemon exit failed when receive SIGTERM on py3.7

[ https://issues.apache.org/jira/browse/SPARK-28582?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-28582. -- Resolution: Fixed Fix Version/s: 2.4.4 2.3.4

[jira] [Assigned] (SPARK-28582) Pyspark daemon exit failed when receive SIGTERM on py3.7

[ https://issues.apache.org/jira/browse/SPARK-28582?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-28582: Assignee: Weichen Xu > Pyspark daemon exit failed when receive SIGTERM on py3.7 >

[jira] [Commented] (SPARK-28587) JDBC data source's partition whereClause should support jdbc dialect

[ https://issues.apache.org/jira/browse/SPARK-28587?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16899289#comment-16899289 ] Xiao Li commented on SPARK-28587: - cc [~maropu]  > JDBC data source's partition whereClause should

[jira] [Updated] (SPARK-28607) Don't hold a reference to two partitionLengths arrays

[ https://issues.apache.org/jira/browse/SPARK-28607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt Cheah updated SPARK-28607: --- Description: SPARK-28209 introduced the new shuffle writer API and its usage in

[jira] [Created] (SPARK-28607) Don't hold a reference to two partitionLengths arrays

Matt Cheah created SPARK-28607: -- Summary: Don't hold a reference to two partitionLengths arrays Key: SPARK-28607 URL: https://issues.apache.org/jira/browse/SPARK-28607 Project: Spark Issue

[jira] [Resolved] (SPARK-28606) Update CRAN key to recover docker image generation

[ https://issues.apache.org/jira/browse/SPARK-28606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai resolved SPARK-28606. - Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 25339

[jira] [Commented] (SPARK-28606) Update CRAN key to recover docker image generation

[ https://issues.apache.org/jira/browse/SPARK-28606?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16899260#comment-16899260 ] Dongjoon Hyun commented on SPARK-28606: --- This is a release blocker for 2.4.4 and 3.0.0 since we

[jira] [Assigned] (SPARK-28606) Update CRAN key to recover docker image generation

[ https://issues.apache.org/jira/browse/SPARK-28606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-28606: - Assignee: Dongjoon Hyun > Update CRAN key to recover docker image generation >

[jira] [Updated] (SPARK-28606) Update CRAN key to recover docker image generation

[ https://issues.apache.org/jira/browse/SPARK-28606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-28606: -- Priority: Blocker (was: Major) > Update CRAN key to recover docker image generation >

[jira] [Created] (SPARK-28606) Update CRAN key to recover docker image generation

Dongjoon Hyun created SPARK-28606: - Summary: Update CRAN key to recover docker image generation Key: SPARK-28606 URL: https://issues.apache.org/jira/browse/SPARK-28606 Project: Spark Issue

[jira] [Resolved] (SPARK-28574) Allow to config different sizes for event queues

[ https://issues.apache.org/jira/browse/SPARK-28574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu resolved SPARK-28574. -- Resolution: Fixed > Allow to config different sizes for event queues >

[jira] [Assigned] (SPARK-28574) Allow to config different sizes for event queues

[ https://issues.apache.org/jira/browse/SPARK-28574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu reassigned SPARK-28574: Assignee: Yun Zou > Allow to config different sizes for event queues >

[jira] [Updated] (SPARK-28605) Performance regression in SS's foreach

[ https://issues.apache.org/jira/browse/SPARK-28605?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu updated SPARK-28605: - Labels: regresssion (was: ) > Performance regression in SS's foreach >

[jira] [Created] (SPARK-28605) Performance regression in SS's foreach

Shixiong Zhu created SPARK-28605: Summary: Performance regression in SS's foreach Key: SPARK-28605 URL: https://issues.apache.org/jira/browse/SPARK-28605 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-28584) Flaky test: org.apache.spark.scheduler.TaskSchedulerImplSuite

[ https://issues.apache.org/jira/browse/SPARK-28584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16899031#comment-16899031 ] Dongjoon Hyun commented on SPARK-28584: --- Oh, got it. Thank you for fixing that, [~vanzin]. >

[jira] [Created] (SPARK-28604) Use log1p(x) instead of log(1+x) and expm1(x) instead of exp(x)-1

Sean Owen created SPARK-28604: - Summary: Use log1p(x) instead of log(1+x) and expm1(x) instead of exp(x)-1 Key: SPARK-28604 URL: https://issues.apache.org/jira/browse/SPARK-28604 Project: Spark

[jira] [Assigned] (SPARK-20604) Allow Imputer to handle all numeric types

[ https://issues.apache.org/jira/browse/SPARK-20604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-20604: - Assignee: Wayne Zhang > Allow Imputer to handle all numeric types >

[jira] [Resolved] (SPARK-20604) Allow Imputer to handle all numeric types

[ https://issues.apache.org/jira/browse/SPARK-20604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-20604. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 17864

[jira] [Resolved] (SPARK-28519) Tests failed on aarch64 due the value of math.log and power function is different

[ https://issues.apache.org/jira/browse/SPARK-28519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-28519. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 25279

[jira] [Updated] (SPARK-20604) Allow Imputer to handle all numeric types

[ https://issues.apache.org/jira/browse/SPARK-20604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-20604: -- Priority: Minor (was: Major) > Allow Imputer to handle all numeric types >

[jira] [Assigned] (SPARK-28519) Tests failed on aarch64 due the value of math.log and power function is different

[ https://issues.apache.org/jira/browse/SPARK-28519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-28519: - Assignee: Sean Owen > Tests failed on aarch64 due the value of math.log and power function is

[jira] [Resolved] (SPARK-23469) HashingTF should use corrected MurmurHash3 implementation

[ https://issues.apache.org/jira/browse/SPARK-23469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-23469. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 25303

[jira] [Assigned] (SPARK-23469) HashingTF should use corrected MurmurHash3 implementation

[ https://issues.apache.org/jira/browse/SPARK-23469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-23469: - Assignee: Huaxin Gao > HashingTF should use corrected MurmurHash3 implementation >

[jira] [Updated] (SPARK-28426) Metadata Handling in Thrift Server

[ https://issues.apache.org/jira/browse/SPARK-28426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-28426: Target Version/s: 3.0.0 > Metadata Handling in Thrift Server > -- > >

[jira] [Updated] (SPARK-23469) HashingTF should use corrected MurmurHash3 implementation

[ https://issues.apache.org/jira/browse/SPARK-23469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-23469: -- Docs Text: In Spark 3.0, the HashingTF Transformer uses a corrected implementation of the murmur3

[jira] [Resolved] (SPARK-28510) Implement Spark's own GetFunctionsOperation

[ https://issues.apache.org/jira/browse/SPARK-28510?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-28510. - Resolution: Fixed Fix Version/s: 3.0.0 > Implement Spark's own GetFunctionsOperation >

[jira] [Assigned] (SPARK-28510) Implement Spark's own GetFunctionsOperation

[ https://issues.apache.org/jira/browse/SPARK-28510?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reassigned SPARK-28510: --- Assignee: Yuming Wang > Implement Spark's own GetFunctionsOperation >

[jira] [Resolved] (SPARK-28579) MaxAbsScaler avoids conversion to breeze.vector

[ https://issues.apache.org/jira/browse/SPARK-28579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-28579. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 25311

[jira] [Assigned] (SPARK-28579) MaxAbsScaler avoids conversion to breeze.vector

[ https://issues.apache.org/jira/browse/SPARK-28579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-28579: - Assignee: zhengruifeng > MaxAbsScaler avoids conversion to breeze.vector >

[jira] [Updated] (SPARK-28603) Spark Streaming application receives inconsistent input events per batch interval

[ https://issues.apache.org/jira/browse/SPARK-28603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raja updated SPARK-28603: - Attachment: Batch_Inconsistencies.JPG > Spark Streaming application receives inconsistent input events per

[jira] [Created] (SPARK-28603) Spark Streaming application receives inconsistent input events per batch interval

Raja created SPARK-28603: Summary: Spark Streaming application receives inconsistent input events per batch interval Key: SPARK-28603 URL: https://issues.apache.org/jira/browse/SPARK-28603 Project: Spark

[jira] [Created] (SPARK-28602) Recognize interval as a numeric type

Dylan Guedes created SPARK-28602: Summary: Recognize interval as a numeric type Key: SPARK-28602 URL: https://issues.apache.org/jira/browse/SPARK-28602 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-28393) Convert and port 'pgSQL/join.sql' into UDF test base

[ https://issues.apache.org/jira/browse/SPARK-28393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16898795#comment-16898795 ] Hyukjin Kwon commented on SPARK-28393: -- [~huaxingao], SPARK-28326 is resolved. Can you take a look

[jira] [Resolved] (SPARK-28445) Inconsistency between Scala and Python/Panda udfs when groupby with udf() is used

[ https://issues.apache.org/jira/browse/SPARK-28445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-28445. -- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 25215

[jira] [Assigned] (SPARK-28445) Inconsistency between Scala and Python/Panda udfs when groupby with udf() is used

[ https://issues.apache.org/jira/browse/SPARK-28445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-28445: Assignee: Hyukjin Kwon > Inconsistency between Scala and Python/Panda udfs when groupby

[jira] [Assigned] (SPARK-28445) Inconsistency between Scala and Python/Panda udfs when groupby with udf() is used

[ https://issues.apache.org/jira/browse/SPARK-28445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-28445: Assignee: Liang-Chi Hsieh (was: Hyukjin Kwon) > Inconsistency between Scala and

[jira] [Commented] (SPARK-28017) Enhance EXTRACT/DATE_TRUNC

[ https://issues.apache.org/jira/browse/SPARK-28017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16898780#comment-16898780 ] Maxim Gekk commented on SPARK-28017: I am working on DATE_TRUNC now. > Enhance EXTRACT/DATE_TRUNC >

[jira] [Resolved] (SPARK-28600) the method agg of KeyValueGroupedDataset has 4 TypedColumn limits

[ https://issues.apache.org/jira/browse/SPARK-28600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-28600. -- Resolution: Duplicate > the method agg of KeyValueGroupedDataset has 4 TypedColumn limits >

[jira] [Assigned] (SPARK-28475) Add regex MetricFilter to GraphiteSink

[ https://issues.apache.org/jira/browse/SPARK-28475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saisai Shao reassigned SPARK-28475: --- Assignee: Nick Karpov > Add regex MetricFilter to GraphiteSink >

[jira] [Updated] (SPARK-28475) Add regex MetricFilter to GraphiteSink

[ https://issues.apache.org/jira/browse/SPARK-28475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saisai Shao updated SPARK-28475: Priority: Minor (was: Major) > Add regex MetricFilter to GraphiteSink >

[jira] [Resolved] (SPARK-28475) Add regex MetricFilter to GraphiteSink

[ https://issues.apache.org/jira/browse/SPARK-28475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saisai Shao resolved SPARK-28475. - Resolution: Resolved Fix Version/s: 3.0.0 > Add regex MetricFilter to GraphiteSink >

[jira] [Commented] (SPARK-28475) Add regex MetricFilter to GraphiteSink

[ https://issues.apache.org/jira/browse/SPARK-28475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16898749#comment-16898749 ] Saisai Shao commented on SPARK-28475: - This is resolved via

[jira] [Commented] (SPARK-28599) Support pagination and sorting for ThriftServerPage

[ https://issues.apache.org/jira/browse/SPARK-28599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16898614#comment-16898614 ] shahid commented on SPARK-28599: Thanks [~yumwang]. I will analyze this. In SQL tab, we supported

[jira] [Created] (SPARK-28601) Use StandardCharsets.UTF_8 instead of "UTF-8" string representation

Jungtaek Lim created SPARK-28601: Summary: Use StandardCharsets.UTF_8 instead of "UTF-8" string representation Key: SPARK-28601 URL: https://issues.apache.org/jira/browse/SPARK-28601 Project: Spark