https://github.com/apache/seatunnel-web/blob/30ed42fdac21a0edc6a9cb06ed00f81967b64717/seatunnel-server/seatunnel-app/src/main/java/org/apache/seatunnel/app/thirdparty/datasource/impl/BaseJdbcDataSourceConfigSwitcher.java#L217 Above generateSql method generates the query for all JDBC data sources. It does not support adding a WHERE clause because through UI there is not enough information collected to generate WHERE clause. Then, How does seatunnel-web support the WHERE clause for JDBC data sources?
Thanks & Regards Mohammad Arshad From: Jia Fan <[email protected]> Date: Friday, 30 August 2024 at 8:00 AM To: [email protected] <[email protected]> Subject: Re: How to create a seatunnel job in seatunnel-web with conditional query Hi Mohammad: We can support default value in SeaTunnel Web just like we did in https://nam10.safelinks.protection.outlook.com/?url=https%3A%2F%2Fseatunnel.apache.org%2Fdocs%2Fconcept%2Fsink-options-placeholders%23placeholder&data=05%7C02%7Cmohammad.arshad%40visa.com%7C8d6c1c18066943c7320e08dcc89bb6eb%7C38305e12e15d4ee888b9c4db1c477d76%7C0%7C0%7C638605818343670075%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C0%7C%7C%7C&sdata=B932PqEdwNObTnpy%2FufQS2Ao9Xkh%2BjuCzFktG6K4qko%3D&reserved=0<https://seatunnel.apache.org/docs/concept/sink-options-placeholders#placeholder> eg: SELECT name, age FROM test.test_table WHERE age > ${ageParam:25}. Users should define the default value when creating a source. WDYT? Mohammad Arshad <[email protected]> 于2024年8月30日周五 00:22写道： > Thank you Jia Fan for your reply > > Yes, the variable substitution feature is available in SeaTunnel Engine. If > the job were created manually, there would be no issues. However, the > problem arises when a job is created through SeaTunnel Web. > > In SeaTunnel Web, how can I create a source step with a query like "SELECT > name, age FROM test.test_table WHERE age > ${ageParam}"? Do you think this > is possible through the SeaTunnel Web? > > Thanks & Regards > Mohammad Arshad > > > > On Thu, Aug 29, 2024 at 7:32 AM Jia Fan <[email protected]> wrote: > > > One way is to use our config variable feature in > > > > > https://nam10.safelinks.protection.outlook.com/?url=https%3A%2F%2Fseatunnel.apache.org%2Fdocs%2F2.3.7%2Fconcept%2Fconfig%23config-variable-substitution&data=05%7C02%7Cmohammad.arshad%40visa.com%7C8d6c1c18066943c7320e08dcc89bb6eb%7C38305e12e15d4ee888b9c4db1c477d76%7C0%7C0%7C638605818343681883%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C0%7C%7C%7C&sdata=uJsdtWVHs9MpBqANn85ogfg1Yiw6QtGMz1c8Z4qj2Xw%3D&reserved=0<https://seatunnel.apache.org/docs/2.3.7/concept/config#config-variable-substitution> > > . > > > > Arshad, Mohammad <[email protected]> 于2024年8月28日周三 > 19:27写道： > > > > > Hi All, > > > I'm interested in creating a job that includes a conditional query, yet > > it > > > appears that this option is currently unavailable in SeaTunnel-Web. > > > To illustrate, suppose we have a test_table with fields name and age. > My > > > objective is to transfer all records from test_table to another table, > > but > > > only for those entries where age is greater than 25. > > > > > > At present, SeaTunnel-Web enables the creation of jobs with queries > such > > > as “SELECT `name`, `age` FROM `test`.`test_table`”. However, it does > not > > > provide an option for creating queries like > > > “SELECT `name`, `age` FROM `test`.`test_table` where `age` > 25” or > > > “SELECT `name`, `age` FROM `test`.`test_table` where `age` >$ > > {ageParam}” > > > > > > Could there be something I'm overlooking? Are there any alternative > > > methods to accomplish this? > > > > > > An attempt is made to add support for this feature at execution time as > > > part of the pull request at > > > https://nam10.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fapache%2Fseatunnel-web%2Fpull%2F193&data=05%7C02%7Cmohammad.arshad%40visa.com%7C8d6c1c18066943c7320e08dcc89bb6eb%7C38305e12e15d4ee888b9c4db1c477d76%7C0%7C0%7C638605818343689686%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C0%7C%7C%7C&sdata=7PJFUDmyXQ6ob1ZW0FTWRMhe4huget2RHiGE5GwCmyw%3D&reserved=0<https://github.com/apache/seatunnel-web/pull/193>. > > > However, it might be more efficient if the conditional query could be > > > supported directly at the job creation stage. Only some parameters to > be > > > changed at execution time, not the whole query. > > > > > > Does anyone have any ideas or suggestions on how to implement this > > feature? > > > > > > Thanks & Regards > > > Mohammad Arshad > > > > > > > > >
