[akka-user] Re: Using akka streams to read from streamed source, format and send multi-part file to S3

2016-10-26 Thread Jason Martens
I've created one based on the AWS Java SDK here: https://github.com/3drobotics/cloud-s3-wrapper There is another one that is more "pure" in that it uses Akka-HTTP to interact with S3, thus does not require the AWS Java SDK here: https://github.com/bluelabsio/s3-stream There has been some discu

[akka-user] Re: Structuring a akka-http project

2015-08-27 Thread Jason Martens
We based our project on the akka-http-rest example you linked, and it's been working pretty well for us. We aren't super far along yet, and we switched out the backend for Couchbase, but so far so good. I like having routes, services (controller?) and backend (data) layers, it seems to be prov

[akka-user] Different response codes in complete?

2015-07-16 Thread Jason Martens
Using akka-http, say I have a route like this: path('login") { post { entity(as[Credentials]) { credentials => complete(authenticateCredentials(credentials)) } } } Is there a way to complete the request with a Unauthorized response if the credentials fail? F

[akka-user] Re: SprayJsonSupport implicits in scope for routes if defined in Main, but not if defined elsewhere

2015-07-11 Thread Jason Martens
Hello, I too had this problem, and I solved it by switching to objects with an apply method that takes an implicit parameter. My Main object extends App and Service: trait Service { implicit val system: ActorSystem implicit def executor: ExecutionContextExecutor implicit val materialize

[akka-user] Re: Akka and Mesos: Will it blend?

2015-06-18 Thread Jason Martens
I have heard from another co-worker that Akka remoting is very difficult on Mesos using Docker, because of the random ports that it uses to connect. Docker expects you to specify which ports are going to be used by your container, and if you don't know ahead of time it can be difficult to suppo

[akka-user] Re: Messages get lost in ActorPublisher

2015-06-16 Thread Jason Martens
r Would love to hear any feedback or suggestions that you are willing to give. Thanks, Jason On Monday, June 15, 2015 at 1:51:49 PM UTC-7, Jason Martens wrote: > > After some more debugging, it appears that I'm getting a Cancel message > before the entire file contents is download

[akka-user] Re: Messages get lost in ActorPublisher

2015-06-15 Thread Jason Martens
After some more debugging, it appears that I'm getting a Cancel message before the entire file contents is downloaded. However, I'm not sure why that is. What would cause the stream to be cancelled in this example? Thanks, Jason On Monday, June 15, 2015 at 9:11:38 AM UTC-7, Jason Mar

[akka-user] Messages get lost in ActorPublisher

2015-06-15 Thread Jason Martens
Hello, I'm continuing my attempts to write a robust chunked large file downloader. I experience frequent timeouts when reading chunks (*cough* S3 *cough*), so my original attempts just using stream elements were failing due to a single chunk timing out. I now have an ActorPublisher that track

Re: [akka-user] Akka streams with multiple sources?

2015-06-09 Thread Jason Martens
> On Jun 7, 2015, at 3:19 AM, Akka Team wrote: > > Hi Jason, > > On Mon, Jun 1, 2015 at 8:24 PM, Jason Martens <mailto:m...@jasonmartens.com>> wrote: > Hello All, >I deal with a lot of large files on Amazon S3 and disk, which have been > indexed into chu

[akka-user] Akka streams with multiple sources?

2015-06-01 Thread Jason Martens
Hello All, I deal with a lot of large files on Amazon S3 and disk, which have been indexed into chunks that can be used individually. What I would like to do is have a Source of offsets and sizes which can be filtered to then pass into another stream element which could read that particular

[akka-user] Need help getting custom flow graph to work

2015-03-30 Thread Jason Martens
Hello Akka users, I've been trying out akka-streams, and I have a sample project partially working but can't get this particular flow graph to work correctly. I'm writing a wrapper around a slow backend service that will cache objects in another cache backend. When a request comes in, I wan