[incubator-dolphinscheduler] branch dev updated: [Feature]Add Python task "task variable / result transfer" implementation (#3659)

This is an automated email from the ASF dual-hosted git repository. gaojun2048 pushed a commit to branch dev in repository https://gitbox.apache.org/repos/asf/incubator-dolphinscheduler.git The following commit(s) were added to refs/heads/dev by this push: new 3b58145 [Feature]Add Python

[incubator-dolphinscheduler] branch dev updated: [Feature]Add Python task "task variable / result transfer" implementation (#3659)

This is an automated email from the ASF dual-hosted git repository. gaojun2048 pushed a commit to branch dev in repository https://gitbox.apache.org/repos/asf/incubator-dolphinscheduler.git The following commit(s) were added to refs/heads/dev by this push: new 3b58145 [Feature]Add Python

[GitHub] [incubator-dolphinscheduler] gaojun2048 merged pull request #3659: [Feature]Add Python task "task variable / result transfer" implementation

gaojun2048 merged pull request #3659: URL: https://github.com/apache/incubator-dolphinscheduler/pull/3659 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

[GitHub] [incubator-dolphinscheduler] shiliquan opened a new issue #3819: 为啥执行sql语句结果是成功的但是却没有显示执行结果

shiliquan opened a new issue #3819: URL: https://github.com/apache/incubator-dolphinscheduler/issues/3819 [INFO] 2020-09-25 12:04:32.853 - [taskAppId=TASK-9-38-46]:[104] - Full sql parameters: SqlParameters{type='MYSQL', datasource=1, sql='show databases;', sqlType=1, udfs='',

[GitHub] [incubator-dolphinscheduler] guyinyou commented on a change in pull request #3659: [Feature]Add Python task "task variable / result transfer" implementation

guyinyou commented on a change in pull request #3659: URL: https://github.com/apache/incubator-dolphinscheduler/pull/3659#discussion_r494741689 ## File path: dolphinscheduler-server/src/main/java/org/apache/dolphinscheduler/server/master/runner/MasterExecThread.java ## @@

[GitHub] [incubator-dolphinscheduler] 939598604 opened a new issue #3818: 为啥sql查询的邮件必填，服务器是在内网，根本就没有邮件服务器，总提示邮件发送失败。

939598604 opened a new issue #3818: URL: https://github.com/apache/incubator-dolphinscheduler/issues/3818 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

[GitHub] [incubator-dolphinscheduler] CalvinKirs commented on issue #3789: [Bug][remote] channel time out

CalvinKirs commented on issue #3789: URL: https://github.com/apache/incubator-dolphinscheduler/issues/3789#issuecomment-698694329 Thank you so much for your feedback, I will finish it as soon as possible email discussion link：

[GitHub] [incubator-dolphinscheduler] 13476806803 commented on issue #3816: The work node cannot create a task instance

13476806803 commented on issue #3816: URL: https://github.com/apache/incubator-dolphinscheduler/issues/3816#issuecomment-698694515 Local and default are in different network segments, and the master is in the default network end

[GitHub] [incubator-dolphinscheduler] 13476806803 commented on issue #3816: The work node cannot create a task instance

13476806803 commented on issue #3816: URL: https://github.com/apache/incubator-dolphinscheduler/issues/3816#issuecomment-698694008 yes 

[GitHub] [incubator-dolphinscheduler] shiliquan commented on issue #3813: why execute hive sql task failure？

shiliquan commented on issue #3813: URL: https://github.com/apache/incubator-dolphinscheduler/issues/3813#issuecomment-698691569 

[GitHub] [incubator-dolphinscheduler] xingchun-chen commented on issue #3816: The work node cannot create a task instance

xingchun-chen commented on issue #3816: URL: https://github.com/apache/incubator-dolphinscheduler/issues/3816#issuecomment-698691151 please check the worker group in the workflow task settings that matches the worker service

[GitHub] [incubator-dolphinscheduler] 13476806803 opened a new issue #3816: The work node cannot create a task instance

13476806803 opened a new issue #3816: URL: https://github.com/apache/incubator-dolphinscheduler/issues/3816 master log  There is no master node Log here UI show

[GitHub] [incubator-dolphinscheduler] qiaozhanwei commented on issue #3813: why execute hive sql task failure？

qiaozhanwei commented on issue #3813: URL: https://github.com/apache/incubator-dolphinscheduler/issues/3813#issuecomment-698678257 1，Whether the service has enabled kerberos ？ 2，If it is enabled, check principal is it valid Thx

[GitHub] [incubator-dolphinscheduler] break60 commented on issue #3807: 定时器模块-定时调度时每7秒|每7分钟|每2天这种定时，不能够跨分钟，跨小时，跨月

break60 commented on issue #3807: URL: https://github.com/apache/incubator-dolphinscheduler/issues/3807#issuecomment-698676021 > > > > 定时器模块-定时调度时每7秒|每7分钟|每2天这种定时，不能够跨分钟，跨小时，跨月 > > > > 定时调度中 > > > > 0/59 * * * * ? * > > > > 接下来五次执行时间 > > > > 2020-09-24 03:58:59 > > > >

[GitHub] [incubator-dolphinscheduler] when520 commented on issue #3807: 定时器模块-定时调度时每7秒|每7分钟|每2天这种定时，不能够跨分钟，跨小时，跨月

when520 commented on issue #3807: URL: https://github.com/apache/incubator-dolphinscheduler/issues/3807#issuecomment-698674956 > > > 定时器模块-定时调度时每7秒|每7分钟|每2天这种定时，不能够跨分钟，跨小时，跨月 > > > 定时调度中 > > > 0/59 * * * * ? * > > > 接下来五次执行时间 > > > 2020-09-24 03:58:59 > > > 2020-09-24

[GitHub] [incubator-dolphinscheduler] break60 commented on issue #3807: 定时器模块-定时调度时每7秒|每7分钟|每2天这种定时，不能够跨分钟，跨小时，跨月

break60 commented on issue #3807: URL: https://github.com/apache/incubator-dolphinscheduler/issues/3807#issuecomment-698670510 > > 定时器模块-定时调度时每7秒|每7分钟|每2天这种定时，不能够跨分钟，跨小时，跨月 > > 定时调度中 > > 0/59 * * * * ? * > > 接下来五次执行时间 > > 2020-09-24 03:58:59 > > 2020-09-24 03:59:00 > >

[GitHub] [incubator-dolphinscheduler] nightxing commented on issue #3789: [Bug][remote] channel time out

nightxing commented on issue #3789: URL: https://github.com/apache/incubator-dolphinscheduler/issues/3789#issuecomment-698670220 在ds中添加了一个20分钟运行一次的调度任务维持master到worker的通信，平稳运行一晚上了，不会再超时，感觉加个心跳机制完全可以解决。另外要说一下，worker节点执行完任务没有删除工作目录，删除目录的方法在master？这也是一个大问题！

[GitHub] [incubator-dolphinscheduler] gaojun2048 commented on a change in pull request #3659: [Feature]Add Python task "task variable / result transfer" implementation

gaojun2048 commented on a change in pull request #3659: URL: https://github.com/apache/incubator-dolphinscheduler/pull/3659#discussion_r494677145 ## File path: dolphinscheduler-server/src/main/java/org/apache/dolphinscheduler/server/master/runner/MasterExecThread.java ## @@

[GitHub] [incubator-dolphinscheduler] guyinyou commented on a change in pull request #3659: [Feature]Add Python task "task variable / result transfer" implementation

guyinyou commented on a change in pull request #3659: URL: https://github.com/apache/incubator-dolphinscheduler/pull/3659#discussion_r494374529 ## File path: dolphinscheduler-server/src/main/java/org/apache/dolphinscheduler/server/master/runner/MasterExecThread.java ## @@

[GitHub] [incubator-dolphinscheduler] shiliquan commented on issue #3793: Api-server could not be started

shiliquan commented on issue #3793: URL: https://github.com/apache/incubator-dolphinscheduler/issues/3793#issuecomment-698373057 部分 This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [incubator-dolphinscheduler] dailidong commented on issue #3793: Api-server could not be started

dailidong commented on issue #3793: URL: https://github.com/apache/incubator-dolphinscheduler/issues/3793#issuecomment-698371891 is this entire log for api server ？ This is an automated message from the Apache Git Service.

[GitHub] [incubator-dolphinscheduler] acongfly opened a new issue #3814: [Feature][Module Name] 全局参数可以支持基于项目添加配置&期望支持ip切换，负载均衡（HTTP调度）

acongfly opened a new issue #3814: URL: https://github.com/apache/incubator-dolphinscheduler/issues/3814 现在的全局参数只在DAG任务中可以添加，如果我一个项目有多个DAG序列，这样都需要配置。 举个例子：现在咱们这个系统好像也不知道HTTP的负载均衡。如果我有多台生产机器，我任务也蛮多的，我不想把所有的任务都集中到一个ip上。

[GitHub] [incubator-dolphinscheduler] when520 commented on issue #3806: 使用dolphinscheduler1.3.1调度spark任务使用cluster模式，任务是正常执行成功的，但是dolphinscheduler现实任务执行失败。

when520 commented on issue #3806: URL: https://github.com/apache/incubator-dolphinscheduler/issues/3806#issuecomment-698295911 > please update the title in English Please pay attention to the question instead of the language.

[GitHub] [incubator-dolphinscheduler] when520 commented on issue #3807: 定时器模块-定时调度时每7秒|每7分钟|每2天这种定时，不能够跨分钟，跨小时，跨月

when520 commented on issue #3807: URL: https://github.com/apache/incubator-dolphinscheduler/issues/3807#issuecomment-698295131 > > 定时器模块-定时调度时每7秒|每7分钟|每2天这种定时，不能够跨分钟，跨小时，跨月 > > 定时调度中 > > 0/59 * * * * ? * > > 接下来五次执行时间 > > 2020-09-24 03:58:59 > > 2020-09-24 03:59:00 > >

[GitHub] [incubator-dolphinscheduler] qiaozhanwei commented on issue #3789: [Bug][remote] channel time out

qiaozhanwei commented on issue #3789: URL: https://github.com/apache/incubator-dolphinscheduler/issues/3789#issuecomment-698233149 I think this should be a network jitter problem . but from NettyRemotingClient.createChannel . I thik can modify

[GitHub] [incubator-dolphinscheduler] shiliquan opened a new issue #3813: shell脚本执行hive sql为什么失败？

shiliquan opened a new issue #3813: URL: https://github.com/apache/incubator-dolphinscheduler/issues/3813 [INFO] 2020-09-24 17:17:54.245 - [taskAppId=TASK-6-21-23]:[121] - -> Connecting to

[GitHub] [incubator-dolphinscheduler] AhahaGe edited a comment on issue #3808: [Improvement][API]导出工作流定义支持描述字段Export workflow definition support description

AhahaGe edited a comment on issue #3808: URL: https://github.com/apache/incubator-dolphinscheduler/issues/3808#issuecomment-698216503 [ { "processDefinitionConnects":"[]",

[GitHub] [incubator-dolphinscheduler] AhahaGe commented on issue #3808: [Improvement][API]导出工作流定义支持描述字段Export workflow definition support description

AhahaGe commented on issue #3808: URL: https://github.com/apache/incubator-dolphinscheduler/issues/3808#issuecomment-698216503 [ { "processDefinitionConnects":"[]",

[GitHub] [incubator-dolphinscheduler] AhahaGe commented on issue #3808: [Improvement][API]导出工作流定义支持描述字段Export workflow definition support description

AhahaGe commented on issue #3808: URL: https://github.com/apache/incubator-dolphinscheduler/issues/3808#issuecomment-698216190 I think it's possible, and I will add this feature. This is an automated message from the Apache

[GitHub] [incubator-dolphinscheduler] sonarcloud[bot] commented on pull request #3812: [Fix-#3487][api、dao] Cherry pick from dev to fix that create folder duplicate name under multithreading

sonarcloud[bot] commented on pull request #3812: URL: https://github.com/apache/incubator-dolphinscheduler/pull/3812#issuecomment-698203850 Kudos, SonarCloud Quality Gate passed! [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3812=false=BUG)

[GitHub] [incubator-dolphinscheduler] sonarcloud[bot] removed a comment on pull request #3812: [Fix-#3487][api、dao] Cherry pick from dev to fix that create folder duplicate name under multithreading

sonarcloud[bot] removed a comment on pull request #3812: URL: https://github.com/apache/incubator-dolphinscheduler/pull/3812#issuecomment-698199849 Kudos, SonarCloud Quality Gate passed! [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3812=false=BUG)

[GitHub] [incubator-dolphinscheduler] sonarcloud[bot] commented on pull request #3812: [Fix-#3487][api、dao] Cherry pick from dev to fix that create folder duplicate name under multithreading

sonarcloud[bot] commented on pull request #3812: URL: https://github.com/apache/incubator-dolphinscheduler/pull/3812#issuecomment-698199849 Kudos, SonarCloud Quality Gate passed! [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3812=false=BUG)

[GitHub] [incubator-dolphinscheduler] lgcareer opened a new pull request #3812: [Fix-#3487][api、dao] Cherry pick from dev to fix that create folder duplicate name under multithreading

lgcareer opened a new pull request #3812: URL: https://github.com/apache/incubator-dolphinscheduler/pull/3812 ## What is the purpose of the pull request *Cherry pick from dev to fix that create folder duplicate name under multithreading* ## Brief change log *Cherry

[GitHub] [incubator-dolphinscheduler] lavesin closed issue #3809: DS创建datax任务抽取oracle表提示插件加载失败

lavesin closed issue #3809: URL: https://github.com/apache/incubator-dolphinscheduler/issues/3809 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [incubator-dolphinscheduler] zhuangchong commented on issue #3809: DS创建datax任务抽取oracle表提示插件加载失败

zhuangchong commented on issue #3809: URL: https://github.com/apache/incubator-dolphinscheduler/issues/3809#issuecomment-698175585 > 最后搞定了，原因是一个很弱智的错误，datax解压出错，导致datax包不完整，还是感谢一路提点 ok, the problem has been solved, please close this issue, thx.

[GitHub] [incubator-dolphinscheduler] lavesin commented on issue #3809: DS创建datax任务抽取oracle表提示插件加载失败

lavesin commented on issue #3809: URL: https://github.com/apache/incubator-dolphinscheduler/issues/3809#issuecomment-698173733 最后搞定了，原因是一个很弱智的错误，datax解压出错，导致datax包不完整，还是感谢一路提点 This is an automated message from the Apache

[GitHub] [incubator-dolphinscheduler] CalvinKirs commented on issue #3789: [Bug][remote] channel time out

CalvinKirs commented on issue #3789: URL: https://github.com/apache/incubator-dolphinscheduler/issues/3789#issuecomment-698171929 > 今天监测过网络，两台服务器之间网络没有断开，时不时就会timeout，很奇怪没有人报告这个问题。netty通信中存在心跳监测吗？能否通过心跳机制增加稳定性！ Thank you very much for your feedback. We will send an email today to

[GitHub] [incubator-dolphinscheduler] qiaozhanwei merged pull request #3810: [Fix-#3713][common]Fix that catfile method Stream not closed

qiaozhanwei merged pull request #3810: URL: https://github.com/apache/incubator-dolphinscheduler/pull/3810 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

[incubator-dolphinscheduler] branch 1.3.3-release updated: [Fix-#3713][common]Fix that catfile method Stream not closed (#3810)

This is an automated email from the ASF dual-hosted git repository. journey pushed a commit to branch 1.3.3-release in repository https://gitbox.apache.org/repos/asf/incubator-dolphinscheduler.git The following commit(s) were added to refs/heads/1.3.3-release by this push: new 2e4f9f1

[GitHub] [incubator-dolphinscheduler] break60 commented on issue #3807: 定时器模块-定时调度时每7秒|每7分钟|每2天这种定时，不能够跨分钟，跨小时，跨月

break60 commented on issue #3807: URL: https://github.com/apache/incubator-dolphinscheduler/issues/3807#issuecomment-698160817 > 定时器模块-定时调度时每7秒|每7分钟|每2天这种定时，不能够跨分钟，跨小时，跨月 > > 定时调度中 > 0/59 * * * * ? * > 接下来五次执行时间 > 2020-09-24 03:58:59 > 2020-09-24 03:59:00 > 2020-09-24

[GitHub] [incubator-dolphinscheduler] jon-qj opened a new issue #3811: [Feature][Module Name] 任务管理添加任务分层管理功能

jon-qj opened a new issue #3811: URL: https://github.com/apache/incubator-dolphinscheduler/issues/3811 *For better global communication, please give priority to using English description, thx! * *Please review https://dolphinscheduler.apache.org/en-us/docs/development/issue.html

[GitHub] [incubator-dolphinscheduler] nightxing commented on issue #3789: [Bug][remote] channel time out

nightxing commented on issue #3789: URL: https://github.com/apache/incubator-dolphinscheduler/issues/3789#issuecomment-698153528 今天监测过网络，两台服务器之间网络没有断开，时不时就会timeout，很奇怪没有人报告这个问题。netty通信中存在心跳监测吗？能否通过心跳机制增加稳定性！ This is an

[GitHub] [incubator-dolphinscheduler] zhuangchong commented on issue #3809: DS创建datax任务抽取oracle表提示插件加载失败

zhuangchong commented on issue #3809: URL: https://github.com/apache/incubator-dolphinscheduler/issues/3809#issuecomment-698153057 The current error is thrown by datax, there is no [oraclereader, oraclewriter] plug-in in datax --- 目前报错是datax抛出来的，datax 里面没有 [oraclereader,

[GitHub] [incubator-dolphinscheduler] sonarcloud[bot] commented on pull request #3810: [Fix-#3713][common]Fix that catfile method Stream not closed

sonarcloud[bot] commented on pull request #3810: URL: https://github.com/apache/incubator-dolphinscheduler/pull/3810#issuecomment-698152668 Kudos, SonarCloud Quality Gate passed! [](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler=3810=false=BUG)

[GitHub] [incubator-dolphinscheduler] lgcareer commented on pull request #3810: [Fix-#3713][common]Fix that catfile method Stream not closed

lgcareer commented on pull request #3810: URL: https://github.com/apache/incubator-dolphinscheduler/pull/3810#issuecomment-698151620 linked issue #3713 This is an automated message from the Apache Git Service. To respond to

[GitHub] [incubator-dolphinscheduler] lgcareer opened a new pull request #3810: [Fix-#3713][common]Fix that catfile method Stream not closed

lgcareer opened a new pull request #3810: URL: https://github.com/apache/incubator-dolphinscheduler/pull/3810 ## What is the purpose of the pull request *(For example: This pull request adds checkstyle plugin.)* ## Brief change log *[Fix-#3713][common]Fix that catfile

[GitHub] [incubator-dolphinscheduler] lavesin commented on issue #3809: DS创建datax任务抽取oracle表提示插件加载失败

lavesin commented on issue #3809: URL: https://github.com/apache/incubator-dolphinscheduler/issues/3809#issuecomment-698149208 /opt/datax/log/2020-09-24目录下没有日志信息 This is an automated message from the Apache Git Service. To

[GitHub] [incubator-dolphinscheduler] dengc367 commented on issue #3710: [Question] support multi-queries in single sql transformation task

dengc367 commented on issue #3710: URL: https://github.com/apache/incubator-dolphinscheduler/issues/3710#issuecomment-698148767 support multi-queries like [redash#5100](https://github.com/getredash/redash/pull/5100) This

[GitHub] [incubator-dolphinscheduler] lavesin commented on issue #3809: DS创建datax任务抽取oracle表提示插件加载失败

lavesin commented on issue #3809: URL: https://github.com/apache/incubator-dolphinscheduler/issues/3809#issuecomment-698147884 [INFO] 2020-09-24 06:33:14.716 - [taskAppId=TASK-1-7-9]:[87] - tenantCode user:bczuhu, task dir:1_7_9 [INFO] 2020-09-24 06:33:14.728 -

[GitHub] [incubator-dolphinscheduler] felix-thinkingdata commented on issue #3809: DS创建datax任务抽取oracle表提示插件加载失败

felix-thinkingdata commented on issue #3809: URL: https://github.com/apache/incubator-dolphinscheduler/issues/3809#issuecomment-698145907 You post the datax run log 你把datax 的运行日志贴出来 This is an automated message from

[GitHub] [incubator-dolphinscheduler] lavesin opened a new issue #3809: DS创建datax任务抽取oracle表提示插件加载失败

lavesin opened a new issue #3809: URL: https://github.com/apache/incubator-dolphinscheduler/issues/3809 DS创建datax任务抽取oracle表数据提示插件加载失败，不知道是哪里配置错误，以下是通过ds配置的datax任务信息和报错信息： ---

[GitHub] [incubator-dolphinscheduler] glxfeng opened a new issue #3808: [Improvement][API]导出工作流定义支持描述字段Export workflow definition support description

glxfeng opened a new issue #3808: URL: https://github.com/apache/incubator-dolphinscheduler/issues/3808 希望导出工作流定义时，能把描述字段一起导出 when export the workflow definition, I hope export the description of the workflow together **Which version of DolphinScheduler:** -[1.3.2]