dailai opened a new issue, #7519:
URL: https://github.com/apache/seatunnel/issues/7519

   ### Search before asking
   
   - [X] I had searched in the 
[issues](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22bug%22)
 and found no similar issues.
   
   
   ### What happened
   
   When I add the transform operator the metrics are not correct
   
   ### SeaTunnel Version
   
   dev
   
   ### SeaTunnel Config
   
   ```conf
   {
     "env": {
       "job.mode": "STREAMING",
       "parallelism": "4"
     },
     "source": [
       {
         "plugin_name": "MySQL-CDC",
         "base-url": 
"jdbc:mysql://IP:3306/ctyk_bmdp_time?useUnicode=true&characterEncoding=UTF-8&serverTimezone=Asia/Shanghai",
         "username": "******",
         "password": "******",
         "table-names": [
           "ctyk_bmdp_time.mysql_benchmark1"
         ],
         "result_table_name": "mysql_benchmark1"
       }
     ],
     "sink": [
       {
         "plugin_name": "Console",
         "log.print.data": false,
         "source_table_name": "mysql_benchmark"
       }
     ]
   }
   
   
   {
     "env": {
       "job.mode": "STREAMING",
       "parallelism": "4"
     },
     "source": [
       {
         "plugin_name": "MySQL-CDC",
         "base-url": 
"jdbc:mysql://IP:3306/ctyk_bmdp_time?useUnicode=true&characterEncoding=UTF-8&serverTimezone=Asia/Shanghai",
         "username": "******",
         "password": "******",
         "table-names": [
           "ctyk_bmdp_time.mysql_benchmark1"
         ],
         "result_table_name": "mysql_benchmark1"
       }
     ],
     "transform": [
       {
         "plugin_name": "Sql",
         "source_table_name": "mysql_benchmark1",
         "result_table_name": "mysql_benchmark1",
         "query": "SELECT id ,user_id ,name ,email ,address ,age ,last_active 
,property0 ,property1 ,property2 ,property3 ,property4 ,property5 ,property6 
,property7 ,property8 ,property9 ,property10 ,property11 ,property12 
,property13 ,property14 ,property15 ,property16 ,property17 ,property18 
,property19 ,property20 ,property21 ,property22 ,property23 ,property24 
,property25 ,property26 ,property27 ,property28 ,property29 ,property30 
,property31 ,property32 ,property33 ,property34 ,property35 ,property36 
,property37 ,property38 ,property39 ,property40 ,property41 ,property42 
,property43 ,property44 ,property45 ,property46 ,property47 ,property48 
,property49 ,property50 ,property51 ,property52 ,property53 ,property54 
,property55 ,property56 ,property57 ,property58 ,property59 ,property60 
,property61 ,property62 ,property63 ,property64 ,property65 ,property66 
,property67 ,property68 ,property69 ,property70 ,property71 ,property72 
,property73 ,property74 ,property75 ,property76 ,prope
 rty77 ,property78 ,property79 ,property80 ,property81 ,property82 ,property83 
,property84 ,property85 ,property86 ,property87 ,property88 ,property89 
,property90 ,property91 ,property92 ,property93 ,property94 ,property95 
,property96 ,property97 ,property98 ,property99 ,property100 ,property101 
,property102 ,property103 ,property104 ,property105 ,property106 ,property107 
,property108 ,property109 ,property110 ,property111 ,property112 ,property113 
,property114 ,property115 ,property116 ,property117 ,property118 ,property119 
,property120 ,property121 ,property122 ,property123 ,property124 ,property125 
,property126 ,property127 ,property128 ,property129 ,property130 ,property131 
,property132 ,property133 ,property134 ,property135 ,property136 ,property137 
,property138 ,property139 ,property140 ,property141 ,property142 ,property143 
,property144 ,property145 ,property146 ,property147 ,property148 ,property149 
,property150 ,property151 ,property152 ,property153 ,property154 ,property155
  ,property156 ,property157 ,property158 ,property159 ,property160 ,property161 
,property162 ,property163 ,property164 ,property165 ,property166 ,property167 
,property168 ,property169 ,property170 ,property171 ,property172 ,property173 
,property174 ,property175 ,property176 ,property177 ,property178 ,property179 
,property180 ,property181 ,property182 ,property183 ,property184 ,property185 
,property186 ,property187 ,property188 ,property189 ,property190 ,property191 
,property192 ,property193 ,property194 ,property195 ,property196 ,property197 
,property198 ,property199 FROM mysql_benchmark1 where age>0"
       }
     ],
     "sink": [
       {
         "plugin_name": "Console",
         "log.print.data": false,
         "source_table_name": "mysql_benchmark"
       }
     ]
   }
   ```
   
   
   ### Running Command
   
   ```shell
   ./bin/seatunnel.sh --config ./config/4.json
   ```
   
   
   ### Error Exception
   
   ```log
   When I used the first job configuration file, the monitoring information was 
correct. Like this:
   ***********************************************
   Job Id                    :  881371401787801601
   Read Count So Far         :             1100000
   Write Count So Far        :             1100000
   Average Read Count        :                 0/s
   Average Write Count       :                 0/s
   Last Statistic Time       : 2024-08-29 10:57:20
   Current Statistic Time    : 2024-08-29 10:58:20
   ***********************************************
   
   But when I used the second job configuration file, I only added a transform 
operator on top of the original one, and the monitoring information was not 
correct. Like this:
   
   ***********************************************
              Job Progress Information
   ***********************************************
   Job Id                    :  881367634963070977
   Read Count So Far         :             1100000
   Write Count So Far        :              548299
   Average Read Count        :                 0/s
   Average Write Count       :                 0/s
   Last Statistic Time       : 2024-08-29 10:53:22
   Current Statistic Time    : 2024-08-29 10:54:22
   ***********************************************
   ```
   
   
   ### Zeta or Flink or Spark Version
   
   _No response_
   
   ### Java or Scala Version
   
   _No response_
   
   ### Screenshots
   
   _No response_
   
   ### Are you willing to submit PR?
   
   - [ ] Yes I am willing to submit a PR!
   
   ### Code of Conduct
   
   - [X] I agree to follow this project's [Code of 
Conduct](https://www.apache.org/foundation/policies/conduct)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to