Knut Olav Loite created BEAM-3506:
-------------------------------------

             Summary: JdbcIO: Support writing iterables (i.e. collections) of 
rows instead of only single rows
                 Key: BEAM-3506
                 URL: https://issues.apache.org/jira/browse/BEAM-3506
             Project: Beam
          Issue Type: Improvement
          Components: sdk-java-extensions
    Affects Versions: 2.3.0
            Reporter: Knut Olav Loite
            Assignee: Reuven Lax


The current JdbcIO write interface expects a PCollection<T> where T is the row 
to be written. Each instance of T is then added to a batch and written to the 
database. The user has little control over how many rows will be added to one 
batch. If JdbcIO would also support writing a PCollection<Iterable<T>> the userĀ 
would have more control over the number of rows in one batch. Especially when 
writing to cloud databases, such as Google Cloud Spanner, the batching of 
multiple rows together is important for performance.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Reply via email to