GitHub user sivaguru-rajasekaran added a comment to the discussion: Oracle
Table Input with variables (${LAST_RUN_TS}, ${LAST_RUN_ID}) failing in Apache
Hop
2025/12/23 11:20:01 - Hop - Starting workflow
2025/12/23 11:20:01 - oracle_to_mysql_workflow - Start of workflow execution
2025/12/23 11:20:01 - oracle_to_mysql_workflow - Starting action [Workflow]
2025/12/23 11:20:01 - oracle_to_mysql_workflow - Finished action [Workflow]
(result=[true])
2025/12/23 11:20:01 - oracle_to_mysql_workflow - Starting action
[Get_Table_MetaData]
2025/12/23 11:20:01 - Get_Table_MetaData - Using run configuration [local]
2025/12/23 11:20:01 - get_table_metadata - Executing this pipeline using the
Local Pipeline Engine with run configuration 'local'
2025/12/23 11:20:01 - get_table_metadata - Execution started for pipeline
[get_table_metadata]
2025/12/23 11:20:02 - Table MetaData.0 - Finished reading query, closing
connection.
2025/12/23 11:20:02 - Set variables.0 - Setting project variables...
2025/12/23 11:20:02 - Set variables.0 - Set variable SOURCE_SCHEMA to value
[APPS]
2025/12/23 11:20:02 - Set variables.0 - Set variable SOURCE_TABLE to value
[XXSIFY_CPQ_ORDER_DETAILS_UDM]
2025/12/23 11:20:02 - Set variables.0 - Set variable SOURCE_DATE_COL to value
[CREATED_ON]
2025/12/23 11:20:02 - Set variables.0 - Set variable TARGET_SCHEMA to value
[sify]
2025/12/23 11:20:02 - Set variables.0 - Set variable TARGET_TABLE to value
[xxsify_cpq_order_details_udm]
2025/12/23 11:20:02 - Set variables.0 - Finished after 1 rows.
2025/12/23 11:20:02 - Set variables.0 - Finished processing (I=0, O=0, R=1,
W=1, U=0, E=0)
2025/12/23 11:20:02 - Table MetaData.0 - Finished processing (I=1, O=0, R=0,
W=1, U=0, E=0)
2025/12/23 11:20:02 - get_table_metadata - Pipeline duration : 0.371 seconds [
0.371" ]
2025/12/23 11:20:02 - get_table_metadata - Execution finished on a local
pipeline engine with run configuration 'local'
2025/12/23 11:20:02 - oracle_to_mysql_workflow - Finished action
[Get_Table_MetaData] (result=[true])
2025/12/23 11:20:02 - oracle_to_mysql_workflow - Starting action
[get_last_run_ts]
2025/12/23 11:20:02 - get_last_run_ts - Using run configuration [local]
2025/12/23 11:20:02 - get_last_run_ts - Executing this pipeline using the Local
Pipeline Engine with run configuration 'local'
2025/12/23 11:20:02 - get_last_run_ts - Execution started for pipeline
[get_last_run_ts]
2025/12/23 11:20:02 - Table input.0 - Finished reading query, closing
connection.
2025/12/23 11:20:02 - Set variables.0 - We didn't receive a row while setting
the default values.
2025/12/23 11:20:02 - Set variables.0 - Set variable LAST_RUN_TS to value
[1970-01-01 00:00:00.000000]
2025/12/23 11:20:02 - Set variables.0 - Set variable LAST_RUN_ID to value [0]
2025/12/23 11:20:02 - Set variables.0 - Finished after 0 rows.
2025/12/23 11:20:02 - get_last_run_ts - Pipeline duration : 0.383 seconds [
0.383" ]
2025/12/23 11:20:02 - get_last_run_ts - Execution finished on a local pipeline
engine with run configuration 'local'
2025/12/23 11:20:02 - oracle_to_mysql_workflow - Finished action
[get_last_run_ts] (result=[true])
2025/12/23 11:20:02 - oracle_to_mysql_workflow - Starting action
[oracle_to_mysql_datamigration]
2025/12/23 11:20:02 - oracle_to_mysql_datamigration - Using run configuration
[local]
2025/12/23 11:20:02 - oracle_to_mysql_generic - Executing this pipeline using
the Local Pipeline Engine with run configuration 'local'
2025/12/23 11:20:02 - oracle_to_mysql_generic - Execution started for pipeline
[oracle_to_mysql_generic]
2025/12/23 11:20:02 - MYSQL_TABLE_OUTPUT .0 - Connected to database
[Mysql_local] (commit=2000000)
2025/12/23 11:20:03 - Generate rows.0 - Finished processing (I=0, O=0, R=0,
W=10, U=0, E=0)
2025/12/23 11:20:03 - JavaScript.0 - Optimization level set to 9.
2025/12/23 11:20:03 - Write to log.0 -
2025/12/23 11:20:03 - Write to log.0 - ------------> Linenr
1------------------------------
2025/12/23 11:20:03 - Write to log.0 - X = null
2025/12/23 11:20:03 - Write to log.0 - SQL_QUERY = SELECT * FROM
APPS.XXSIFY_CPQ_ORDER_DETAILS_UDM WHERE ( CREATED_ON >
TO_TIMESTAMP('1970-01-01 00:00:00.000000', 'YYYY-MM-DD HH24:MI:SS.FF') ) OR (
CREATED_ON = TO_TIMESTAMP('1970-01-01 00:00:00.000000', 'YYYY-MM-DD
HH24:MI:SS.FF') AND ID > 0) ORDER BY CREATED_ON, ID
2025/12/23 11:20:03 - Write to log.0 -
2025/12/23 11:20:03 - Write to log.0 - ====================
2025/12/23 11:20:03 - Write to log.0 -
2025/12/23 11:20:03 - Write to log.0 - ------------> Linenr
2------------------------------
2025/12/23 11:20:03 - Write to log.0 - X = null
2025/12/23 11:20:03 - Write to log.0 - SQL_QUERY = SELECT * FROM
APPS.XXSIFY_CPQ_ORDER_DETAILS_UDM WHERE ( CREATED_ON >
TO_TIMESTAMP('1970-01-01 00:00:00.000000', 'YYYY-MM-DD HH24:MI:SS.FF') ) OR (
CREATED_ON = TO_TIMESTAMP('1970-01-01 00:00:00.000000', 'YYYY-MM-DD
HH24:MI:SS.FF') AND ID > 0) ORDER BY CREATED_ON, ID
2025/12/23 11:20:03 - Write to log.0 -
2025/12/23 11:20:03 - Write to log.0 - ====================
2025/12/23 11:20:03 - JavaScript.0 - Finished processing (I=0, O=0, R=10, W=10,
U=0, E=0)
2025/12/23 11:20:03 - Write to log.0 -
2025/12/23 11:20:03 - Write to log.0 - ------------> Linenr
3------------------------------
2025/12/23 11:20:03 - Write to log.0 - X = null
2025/12/23 11:20:03 - Write to log.0 - SQL_QUERY = SELECT * FROM
APPS.XXSIFY_CPQ_ORDER_DETAILS_UDM WHERE ( CREATED_ON >
TO_TIMESTAMP('1970-01-01 00:00:00.000000', 'YYYY-MM-DD HH24:MI:SS.FF') ) OR (
CREATED_ON = TO_TIMESTAMP('1970-01-01 00:00:00.000000', 'YYYY-MM-DD
HH24:MI:SS.FF') AND ID > 0) ORDER BY CREATED_ON, ID
2025/12/23 11:20:03 - Write to log.0 -
2025/12/23 11:20:03 - Write to log.0 - ====================
2025/12/23 11:20:03 - Write to log.0 -
2025/12/23 11:20:03 - Write to log.0 - ------------> Linenr
4------------------------------
2025/12/23 11:20:03 - Write to log.0 - X = null
2025/12/23 11:20:03 - Write to log.0 - SQL_QUERY = SELECT * FROM
APPS.XXSIFY_CPQ_ORDER_DETAILS_UDM WHERE ( CREATED_ON >
TO_TIMESTAMP('1970-01-01 00:00:00.000000', 'YYYY-MM-DD HH24:MI:SS.FF') ) OR (
CREATED_ON = TO_TIMESTAMP('1970-01-01 00:00:00.000000', 'YYYY-MM-DD
HH24:MI:SS.FF') AND ID > 0) ORDER BY CREATED_ON, ID
2025/12/23 11:20:03 - Write to log.0 -
2025/12/23 11:20:03 - Write to log.0 - ====================
2025/12/23 11:20:03 - Write to log.0 -
2025/12/23 11:20:03 - Write to log.0 - ------------> Linenr
5------------------------------
2025/12/23 11:20:03 - Write to log.0 - X = null
2025/12/23 11:20:03 - Write to log.0 - SQL_QUERY = SELECT * FROM
APPS.XXSIFY_CPQ_ORDER_DETAILS_UDM WHERE ( CREATED_ON >
TO_TIMESTAMP('1970-01-01 00:00:00.000000', 'YYYY-MM-DD HH24:MI:SS.FF') ) OR (
CREATED_ON = TO_TIMESTAMP('1970-01-01 00:00:00.000000', 'YYYY-MM-DD
HH24:MI:SS.FF') AND ID > 0) ORDER BY CREATED_ON, ID
2025/12/23 11:20:03 - Write to log.0 -
2025/12/23 11:20:03 - Write to log.0 - ====================
2025/12/23 11:20:03 - Write to log.0 -
2025/12/23 11:20:03 - Write to log.0 - ------------> Linenr
6------------------------------
2025/12/23 11:20:03 - Write to log.0 - X = null
2025/12/23 11:20:03 - Write to log.0 - SQL_QUERY = SELECT * FROM
APPS.XXSIFY_CPQ_ORDER_DETAILS_UDM WHERE ( CREATED_ON >
TO_TIMESTAMP('1970-01-01 00:00:00.000000', 'YYYY-MM-DD HH24:MI:SS.FF') ) OR (
CREATED_ON = TO_TIMESTAMP('1970-01-01 00:00:00.000000', 'YYYY-MM-DD
HH24:MI:SS.FF') AND ID > 0) ORDER BY CREATED_ON, ID
2025/12/23 11:20:03 - Write to log.0 -
2025/12/23 11:20:03 - Write to log.0 - ====================
2025/12/23 11:20:03 - Write to log.0 -
2025/12/23 11:20:03 - Write to log.0 - ------------> Linenr
7------------------------------
2025/12/23 11:20:03 - Write to log.0 - X = null
2025/12/23 11:20:03 - Write to log.0 - SQL_QUERY = SELECT * FROM
APPS.XXSIFY_CPQ_ORDER_DETAILS_UDM WHERE ( CREATED_ON >
TO_TIMESTAMP('1970-01-01 00:00:00.000000', 'YYYY-MM-DD HH24:MI:SS.FF') ) OR (
CREATED_ON = TO_TIMESTAMP('1970-01-01 00:00:00.000000', 'YYYY-MM-DD
HH24:MI:SS.FF') AND ID > 0) ORDER BY CREATED_ON, ID
2025/12/23 11:20:03 - Write to log.0 -
2025/12/23 11:20:03 - Write to log.0 - ====================
2025/12/23 11:20:03 - Write to log.0 -
2025/12/23 11:20:03 - Write to log.0 - ------------> Linenr
8------------------------------
2025/12/23 11:20:03 - Write to log.0 - X = null
2025/12/23 11:20:03 - Write to log.0 - SQL_QUERY = SELECT * FROM
APPS.XXSIFY_CPQ_ORDER_DETAILS_UDM WHERE ( CREATED_ON >
TO_TIMESTAMP('1970-01-01 00:00:00.000000', 'YYYY-MM-DD HH24:MI:SS.FF') ) OR (
CREATED_ON = TO_TIMESTAMP('1970-01-01 00:00:00.000000', 'YYYY-MM-DD
HH24:MI:SS.FF') AND ID > 0) ORDER BY CREATED_ON, ID
2025/12/23 11:20:03 - Write to log.0 -
2025/12/23 11:20:03 - Write to log.0 - ====================
2025/12/23 11:20:03 - Write to log.0 -
2025/12/23 11:20:03 - Write to log.0 - ------------> Linenr
9------------------------------
2025/12/23 11:20:03 - Write to log.0 - X = null
2025/12/23 11:20:03 - Write to log.0 - SQL_QUERY = SELECT * FROM
APPS.XXSIFY_CPQ_ORDER_DETAILS_UDM WHERE ( CREATED_ON >
TO_TIMESTAMP('1970-01-01 00:00:00.000000', 'YYYY-MM-DD HH24:MI:SS.FF') ) OR (
CREATED_ON = TO_TIMESTAMP('1970-01-01 00:00:00.000000', 'YYYY-MM-DD
HH24:MI:SS.FF') AND ID > 0) ORDER BY CREATED_ON, ID
2025/12/23 11:20:03 - Write to log.0 -
2025/12/23 11:20:03 - Write to log.0 - ====================
2025/12/23 11:20:03 - Write to log.0 -
2025/12/23 11:20:03 - Write to log.0 - ------------> Linenr
10------------------------------
2025/12/23 11:20:03 - Write to log.0 - X = null
2025/12/23 11:20:03 - Write to log.0 - SQL_QUERY = SELECT * FROM
APPS.XXSIFY_CPQ_ORDER_DETAILS_UDM WHERE ( CREATED_ON >
TO_TIMESTAMP('1970-01-01 00:00:00.000000', 'YYYY-MM-DD HH24:MI:SS.FF') ) OR (
CREATED_ON = TO_TIMESTAMP('1970-01-01 00:00:00.000000', 'YYYY-MM-DD
HH24:MI:SS.FF') AND ID > 0) ORDER BY CREATED_ON, ID
2025/12/23 11:20:03 - Write to log.0 -
2025/12/23 11:20:03 - Write to log.0 - ====================
2025/12/23 11:20:03 - Write to log.0 - Finished processing (I=0, O=0, R=10,
W=10, U=0, E=0)
2025/12/23 11:20:03 - ORACLE_TABLE_INPUT.0 - Finished reading query, closing
connection.
2025/12/23 11:20:03 - MYSQL_TABLE_OUTPUT .0 - ERROR: Unexpected batch update
error committing the database connection.
2025/12/23 11:20:03 - MYSQL_TABLE_OUTPUT .0 - ERROR:
org.apache.hop.core.exception.HopDatabaseBatchException:
2025/12/23 11:20:03 - MYSQL_TABLE_OUTPUT .0 - Error updating batch
2025/12/23 11:20:03 - MYSQL_TABLE_OUTPUT .0 - You have an error in your SQL
syntax; check the manual that corresponds to your MySQL server version for the
right syntax to use near '1) VALUES ( 1)' at line 1
2025/12/23 11:20:03 - MYSQL_TABLE_OUTPUT .0 -
2025/12/23 11:20:03 - MYSQL_TABLE_OUTPUT .0 - at
org.apache.hop.core.database.Database.createHopDatabaseBatchException(Database.java:1302)
2025/12/23 11:20:03 - MYSQL_TABLE_OUTPUT .0 - at
org.apache.hop.core.database.Database.emptyAndCommit(Database.java:1290)
2025/12/23 11:20:03 - MYSQL_TABLE_OUTPUT .0 - at
org.apache.hop.pipeline.transforms.tableoutput.TableOutput.emptyAndCommitBatchBuffers(TableOutput.java:1101)
2025/12/23 11:20:03 - MYSQL_TABLE_OUTPUT .0 - at
org.apache.hop.pipeline.transforms.tableoutput.TableOutput.dispose(TableOutput.java:1057)
2025/12/23 11:20:03 - MYSQL_TABLE_OUTPUT .0 - at
org.apache.hop.pipeline.transform.RunThread.run(RunThread.java:96)
2025/12/23 11:20:03 - MYSQL_TABLE_OUTPUT .0 - at
java.base/java.lang.Thread.run(Thread.java:840)
2025/12/23 11:20:03 - MYSQL_TABLE_OUTPUT .0 - Caused by:
java.sql.BatchUpdateException: You have an error in your SQL syntax; check the
manual that corresponds to your MySQL server version for the right syntax to
use near '1) VALUES ( 1)' at line 1
2025/12/23 11:20:03 - MYSQL_TABLE_OUTPUT .0 - at
com.mysql.cj.jdbc.exceptions.SQLError.createBatchUpdateException(SQLError.java:214)
2025/12/23 11:20:03 - MYSQL_TABLE_OUTPUT .0 - at
com.mysql.cj.jdbc.ClientPreparedStatement.executeBatchSerially(ClientPreparedStatement.java:883)
2025/12/23 11:20:03 - MYSQL_TABLE_OUTPUT .0 - at
com.mysql.cj.jdbc.ClientPreparedStatement.executeBatchInternal(ClientPreparedStatement.java:465)
2025/12/23 11:20:03 - MYSQL_TABLE_OUTPUT .0 - at
com.mysql.cj.jdbc.StatementImpl.executeBatch(StatementImpl.java:858)
2025/12/23 11:20:03 - MYSQL_TABLE_OUTPUT .0 - at
org.apache.hop.core.database.Database.emptyAndCommit(Database.java:1277)
2025/12/23 11:20:03 - MYSQL_TABLE_OUTPUT .0 - ... 4 more
2025/12/23 11:20:03 - MYSQL_TABLE_OUTPUT .0 - Caused by:
java.sql.SQLSyntaxErrorException: You have an error in your SQL syntax; check
the manual that corresponds to your MySQL server version for the right syntax
to use near '1) VALUES ( 1)' at line 1
2025/12/23 11:20:03 - MYSQL_TABLE_OUTPUT .0 - at
com.mysql.cj.jdbc.exceptions.SQLError.createSQLException(SQLError.java:112)
2025/12/23 11:20:03 - MYSQL_TABLE_OUTPUT .0 - at
com.mysql.cj.jdbc.exceptions.SQLExceptionsMapping.translateException(SQLExceptionsMapping.java:114)
2025/12/23 11:20:03 - MYSQL_TABLE_OUTPUT .0 - at
com.mysql.cj.jdbc.ClientPreparedStatement.executeInternal(ClientPreparedStatement.java:988)
2025/12/23 11:20:03 - MYSQL_TABLE_OUTPUT .0 - at
com.mysql.cj.jdbc.ClientPreparedStatement.executeUpdateInternal(ClientPreparedStatement.java:1166)
2025/12/23 11:20:03 - MYSQL_TABLE_OUTPUT .0 - at
com.mysql.cj.jdbc.ClientPreparedStatement.executeBatchSerially(ClientPreparedStatement.java:862)
2025/12/23 11:20:03 - MYSQL_TABLE_OUTPUT .0 - ... 7 more
2025/12/23 11:20:03 - MYSQL_TABLE_OUTPUT .0 - Finished processing (I=0, O=0,
R=1, W=0, U=0, E=1)
2025/12/23 11:20:03 - oracle_to_mysql_generic - Pipeline detected one or more
transforms with errors.
2025/12/23 11:20:03 - oracle_to_mysql_generic - Pipeline is killing the other
transforms!
2025/12/23 11:20:03 - ORACLE_TABLE_INPUT.0 - Finished processing (I=1, O=0,
R=0, W=1, U=0, E=0)
2025/12/23 11:20:03 - oracle_to_mysql_generic - Pipeline duration : 0.38
seconds [ 0.380" ]
2025/12/23 11:20:03 - oracle_to_mysql_generic - Execution finished on a local
pipeline engine with run configuration 'local'
2025/12/23 11:20:03 - oracle_to_mysql_workflow - Finished action
[oracle_to_mysql_datamigration] (result=[false])
2025/12/23 11:20:03 - oracle_to_mysql_workflow - Starting action
[update_last_run_ts]
2025/12/23 11:20:03 - update_last_run_ts - Using run configuration [local]
2025/12/23 11:20:03 - LAST_RUN_TS - Executing this pipeline using the Local
Pipeline Engine with run configuration 'local'
2025/12/23 11:20:03 - LAST_RUN_TS - Execution started for pipeline [LAST_RUN_TS]
2025/12/23 11:20:03 - Execute SQL script.0 - Finished reading query, closing
connection.
2025/12/23 11:20:03 - LAST_RUN_TS - Pipeline duration : 0.288 seconds [ 0.288"
]
2025/12/23 11:20:03 - LAST_RUN_TS - Execution finished on a local pipeline
engine with run configuration 'local'
2025/12/23 11:20:03 - oracle_to_mysql_workflow - Finished action
[update_last_run_ts] (result=[true])
2025/12/23 11:20:03 - oracle_to_mysql_workflow - Workflow execution finished
2025/12/23 11:20:03 - Hop - Workflow execution has ended
2025/12/23 11:20:03 - oracle_to_mysql_workflow - Workflow duration : 1.647
seconds [ 1.647" ]
GitHub link:
https://github.com/apache/hop/discussions/6250#discussioncomment-15324802
----
This is an automatically sent email for [email protected].
To unsubscribe, please send an email to: [email protected]
