bykhovets opened a new issue, #4346:
URL: https://github.com/apache/hop/issues/4346

   ### What needs to happen?
   
   
![ApachHOP_01](https://github.com/user-attachments/assets/80e56a96-a590-4086-8ace-695259dcd86d)
   Hi,
   
   In the example on the screenshot, the insertion into the database is 
performed one insert per row.
   
   INSERT INTO "BI2_ACCRUAL_CUBE_6860" ("ITEM_ID", "ETOF_ID", "ISD_ID", 
"CARRIER_ID", ... "COST_USD") 
   VALUES ( '111111111111'::Integer, '111111111111'::Integer, 
'111111111111'::Integer, .... '1.11111111111111111111')
   ...........
   INSERT INTO "BI2_ACCRUAL_CUBE_6860" ("ITEM_ID", "ETOF_ID", "ISD_ID", 
"CARRIER_ID", ... "COST_USD") 
   VALUES ( '2222222222222'::Integer, '2222222222222'::Integer, 
'2222222222222222'::Integer, .... '2.222222222222222')      
   and so on 35 thousand times in our example.
   
   The transaction pipeline ignores batch insertion. And this is correct, since 
there should be one commit at the end.
   But for the Vertika DB, inserting each row as a separate insert leads to the 
creation of a huge number of files and an error: "to many ROS containers". What 
makes it impossible to use transaction pipeline with Vertica DB. 
   Can you suggest any solution that will allow transaction pipelines to work 
normally with the Vertica database?
   
   ### Issue Priority
   
   Priority: 3
   
   ### Issue Component
   
   Component: Database, Component: Pipelines


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@hop.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

Reply via email to