[akka-user] akka-streams example for accessing a database or similar?

2015-08-12 Thread algermissen1971
Hi all, I am looking for an akka-streams example that shows how one would approach talking to databases (or an FTP server in my case). Besides the basic question of how to create a Source or Sink on top of a database driver (or SFTP connection for that matter) I am looking for best practices o

Re: [akka-user] akka-streams example for accessing a database or similar?

2015-08-14 Thread Akka Team
Hi Jan, stream-compatible data sources are starting to appear, see for example Slick 3.0 with its DBIO model that can either return a Future[] or a Publisher[] of the query result. The former would be incorporated using mapAsync and the latter can be wrapped in a Source and (with some care, usuall

Re: [akka-user] akka-streams example for accessing a database or similar?

2015-08-14 Thread algermissen1971
Thanks, Roland. That is exactly the kind of input I needed to proceed. Jan On 14 Aug 2015, at 12:21, Akka Team wrote: > Hi Jan, > > stream-compatible data sources are starting to appear, see for example Slick > 3.0 with its DBIO model that can either return a Future[] or a Publisher[] of >

Re: [akka-user] akka-streams example for accessing a database or similar?

2015-08-14 Thread Filippo De Luca
Hi Jan, I have implemented one for DynamoDb. I have used a PublisherActor that use an internal buffer, so it fetches x elements for each batch. And publish them one by one, I am not sure if it a great example, but maybe you can work form there. It is not OOS but I can give you a small snippet. cl

Re: [akka-user] akka-streams example for accessing a database or similar?

2015-08-15 Thread algermissen1971
Hi Roland, On 14 Aug 2015, at 12:21, Akka Team wrote: > Hi Jan, > > stream-compatible data sources are starting to appear, see for example Slick > 3.0 with its DBIO model that can either return a Future[] or a Publisher[] of > the query result. Maybe you can help me wrap my head around a fol