[jira] [Created] (SPARK-30356) Codegen support for the function str_to_map

2019-12-25 Thread Kent Yao (Jira)
Kent Yao created SPARK-30356: Summary: Codegen support for the function str_to_map Key: SPARK-30356 URL: https://issues.apache.org/jira/browse/SPARK-30356 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-30356) Codegen support for the function str_to_map

2019-12-25 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-30356: - Issue Type: Improvement (was: Bug) > Codegen support for the function str_to_map >

[jira] [Created] (SPARK-30355) Unify isExecutorActive between CoarseGrainedSchedulerBackend and DriverEndpoint

2019-12-25 Thread wuyi (Jira)
wuyi created SPARK-30355: Summary: Unify isExecutorActive between CoarseGrainedSchedulerBackend and DriverEndpoint Key: SPARK-30355 URL: https://issues.apache.org/jira/browse/SPARK-30355 Project: Spark

[jira] [Created] (SPARK-30354) GBT reuse DecisionTreeMetadata among iterations

2019-12-25 Thread zhengruifeng (Jira)
zhengruifeng created SPARK-30354: Summary: GBT reuse DecisionTreeMetadata among iterations Key: SPARK-30354 URL: https://issues.apache.org/jira/browse/SPARK-30354 Project: Spark Issue Type:

[jira] [Commented] (SPARK-30313) Flaky test: MasterSuite.master/worker web ui available with reverseProxy

2019-12-25 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17003470#comment-17003470 ] Jungtaek Lim commented on SPARK-30313: -- Similar test failure: 

[jira] [Commented] (SPARK-28382) Array Functions: unnest

2019-12-25 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17003457#comment-17003457 ] Kent Yao commented on SPARK-28382: -- Ping [~hyukjin.kwon] I closed my pull PR, but I'm not the creator

[jira] [Comment Edited] (SPARK-28382) Array Functions: unnest

2019-12-25 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17003457#comment-17003457 ] Kent Yao edited comment on SPARK-28382 at 12/26/19 3:54 AM: Ping

[jira] [Resolved] (SPARK-29896) Extend typed literals support for all spark native types

2019-12-25 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-29896. -- Resolution: Won't Fix > Extend typed literals support for all spark native types >

[jira] [Resolved] (SPARK-28382) Array Functions: unnest

2019-12-25 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-28382. -- Resolution: Won't Fix > Array Functions: unnest > --- > > Key:

[jira] [Resolved] (SPARK-30203) store assignable if there exists an appropriate user-defined cast function

2019-12-25 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30203?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-30203. -- Resolution: Not A Problem There is no UDCF in Spark > store assignable if there exists an

[jira] [Commented] (SPARK-27764) Feature Parity between PostgreSQL and Spark

2019-12-25 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17003448#comment-17003448 ] Hyukjin Kwon commented on SPARK-27764: -- [~Qin Yao] I saw you closed a bunch of PRs as discussed in

[jira] [Resolved] (SPARK-29514) String function: string_to_array

2019-12-25 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-29514. -- Resolution: Won't Fix > String function: string_to_array > >

[jira] [Commented] (SPARK-29514) String function: string_to_array

2019-12-25 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29514?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17003446#comment-17003446 ] Hyukjin Kwon commented on SPARK-29514: -- Seems it's PostgreSQL only. Resolving - see the PR. >

[jira] [Updated] (SPARK-30330) Support single quotes json parsing for get_json_object and json_tuple

2019-12-25 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-30330: - Labels: (was: release-notes) > Support single quotes json parsing for get_json_object and

[jira] [Resolved] (SPARK-30330) Support single quotes json parsing for get_json_object and json_tuple

2019-12-25 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-30330. -- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 26965

[jira] [Assigned] (SPARK-30330) Support single quotes json parsing for get_json_object and json_tuple

2019-12-25 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-30330: Assignee: Fang Wen > Support single quotes json parsing for get_json_object and

[jira] [Resolved] (SPARK-27429) [SQL] to_timestamp function with additional argument flag that will allow exception if value could not be cast

2019-12-25 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-27429. -- Resolution: Won't Fix Then you should introduce {{try}} function, not the flag. That's a

[jira] [Assigned] (SPARK-30347) LibSVMDataSource attach AttributeGroup

2019-12-25 Thread zhengruifeng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhengruifeng reassigned SPARK-30347: Assignee: zhengruifeng > LibSVMDataSource attach AttributeGroup >

[jira] [Resolved] (SPARK-30347) LibSVMDataSource attach AttributeGroup

2019-12-25 Thread zhengruifeng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhengruifeng resolved SPARK-30347. -- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 27003

[jira] [Updated] (SPARK-30353) Use constraints in SimplifyBinaryComparison optimization

2019-12-25 Thread ulysses you (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ulysses you updated SPARK-30353: Description: Now Spark can propagate constraint during sql optimization when

[jira] [Updated] (SPARK-29702) Resolve group-by columns with integrity constraints

2019-12-25 Thread Takeshi Yamamuro (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-29702: - Description: In PgSQL, integrity constraints affect grouping column resolution in an

[jira] [Updated] (SPARK-29702) Resolve group-by columns with integrity constraints

2019-12-25 Thread Takeshi Yamamuro (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-29702: - Summary: Resolve group-by columns with integrity constraints (was: Resolve group-by

[jira] [Reopened] (SPARK-27429) [SQL] to_timestamp function with additional argument flag that will allow exception if value could not be cast

2019-12-25 Thread t oo (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] t oo reopened SPARK-27429: -- presto has both functionality, https://prestosql.io/docs/current/functions/conditional.html by default they fail

[jira] [Commented] (SPARK-27491) SPARK REST API - "org.apache.spark.deploy.SparkSubmit --status" returns empty response! therefore Airflow won't integrate with Spark 2.3.x

2019-12-25 Thread t oo (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27491?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17003393#comment-17003393 ] t oo commented on SPARK-27491: -- [~skonto] curl works curl 

[jira] [Updated] (SPARK-27491) SPARK REST API - "org.apache.spark.deploy.SparkSubmit --status" returns empty response! therefore Airflow won't integrate with Spark 2.3.x

2019-12-25 Thread t oo (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27491?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] t oo updated SPARK-27491: - Affects Version/s: 2.4.4 > SPARK REST API - "org.apache.spark.deploy.SparkSubmit --status" returns empty >

[jira] [Updated] (SPARK-30353) Use constraints in SimplifyBinaryComparison optimization

2019-12-25 Thread ulysses you (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ulysses you updated SPARK-30353: Description: Now Spark can propagate constraint during sql optimization when

[jira] [Updated] (SPARK-30353) Use constraints in SimplifyBinaryComparison optimization

2019-12-25 Thread ulysses you (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ulysses you updated SPARK-30353: Description: Now Spark can propagate constraint during sql optimization when

[jira] [Updated] (SPARK-30353) Use constraints in SimplifyBinaryComparison optimization

2019-12-25 Thread ulysses you (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ulysses you updated SPARK-30353: Description: Now Spark can propagate constraint during sql optimization when

[jira] [Created] (SPARK-30353) Use constraints in SimplifyBinaryComparison optimization

2019-12-25 Thread ulysses you (Jira)
ulysses you created SPARK-30353: --- Summary: Use constraints in SimplifyBinaryComparison optimization Key: SPARK-30353 URL: https://issues.apache.org/jira/browse/SPARK-30353 Project: Spark Issue

[jira] [Updated] (SPARK-30325) markPartitionCompleted cause task status inconsistent

2019-12-25 Thread haiyangyu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] haiyangyu updated SPARK-30325: -- Summary: markPartitionCompleted cause task status inconsistent (was: Stage retry and executor

[jira] [Resolved] (SPARK-30266) Int overflow and MatchError in ApproximatePercentile

2019-12-25 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30266?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-30266. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 26905

[jira] [Assigned] (SPARK-30266) Int overflow and MatchError in ApproximatePercentile

2019-12-25 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30266?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-30266: --- Assignee: Kent Yao > Int overflow and MatchError in ApproximatePercentile >

[jira] [Resolved] (SPARK-30349) The result is wrong when joining tables with selecting the same columns

2019-12-25 Thread cen yuhai (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] cen yuhai resolved SPARK-30349. --- Resolution: Fixed > The result is wrong when joining tables with selecting the same columns >

[jira] [Resolved] (SPARK-30331) The final AdaptiveSparkPlan event is not marked with `isFinalPlan=true`

2019-12-25 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-30331. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 26983

[jira] [Assigned] (SPARK-30331) The final AdaptiveSparkPlan event is not marked with `isFinalPlan=true`

2019-12-25 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-30331: --- Assignee: Manu Zhang > The final AdaptiveSparkPlan event is not marked with

[jira] [Commented] (SPARK-30349) The result is wrong when joining tables with selecting the same columns

2019-12-25 Thread cen yuhai (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17003217#comment-17003217 ] cen yuhai commented on SPARK-30349: --- 3.0 preview rc2 is ok > The result is wrong when joining tables

[jira] [Resolved] (SPARK-30290) Count for merged block when fetch continuous blocks in batch

2019-12-25 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-30290. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 26930

[jira] [Updated] (SPARK-30349) The result is wrong when joining tables with selecting the same columns

2019-12-25 Thread cen yuhai (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] cen yuhai updated SPARK-30349: -- Description: {code:sql} // code placeholder with tmp as( select log_date, buvid, manga_id,

[jira] [Created] (SPARK-30352) DataSourceV2: Add CURRENT_CATALOG function

2019-12-25 Thread Kent Yao (Jira)
Kent Yao created SPARK-30352: Summary: DataSourceV2: Add CURRENT_CATALOG function Key: SPARK-30352 URL: https://issues.apache.org/jira/browse/SPARK-30352 Project: Spark Issue Type: Sub-task