[
https://issues.apache.org/jira/browse/SAMZA-448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14221544#comment-14221544
]
Chris Riccomini commented on SAMZA-448:
---------------------------------------
bq. One question I have now is that, how will we support the job configuration
when the users do not have Kafka system setup?
Here are my thoughts:
# We should update FileReaderSystemAdmin to support coordinator streams. This
should be pretty trivial to do (it's just a no-op). This will allow us to have
unit tests that just use the file reader system.
# Users will either have to run Kafka, or have a SystemAdmin implementation
that supports coordinator streams (HBase, ZooKeeper, etc).
Out of the box (2) means you'll have to run Kafka with Samza to run even
trivial jobs.
> Pass config from JobRunner to JobCoordinator via ConfigStream
> -------------------------------------------------------------
>
> Key: SAMZA-448
> URL: https://issues.apache.org/jira/browse/SAMZA-448
> Project: Samza
> Issue Type: Sub-task
> Components: container
> Affects Versions: 0.9.0
> Reporter: Chris Riccomini
> Assignee: Chris Riccomini
> Fix For: 0.9.0
>
> Attachments: SAMZA-448-0.patch, SAMZA-448-1.patch, SAMZA-448-2.patch,
> SAMZA-448-3.patch
>
>
> SAMZA-438 modified the AM/local job factories (job coordinator) to pass
> configuration to SamzaContainer via an HTTP server. This ticket is to modify
> the other half of the pipeline: the config passing from the JobRunner to the
> job coordinator to be done via a ConfigStream, rather than an environment
> variable.
> The goal of this ticket is to make the change as transparent as possible.
> {{control-job.sh}} won't be introduced in this ticket. Instead, we'll
> continue using the ConfigFactories that we have, but pass the resolved config
> to the coordinator using the ConfigStream rather than the environment
> variable.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
