Yup I’ve got a fork of that (I skip re-uploading the input data files since conference WiFi) and store to gcs so I can see the output.
Didn’t finish everything in today’s stream because the WiFi was a bit flakey during the first container build and stalled apt, but I’ll do a follow up to finish it up. On Tue, Jul 17, 2018 at 2:34 PM Ankur Goenka <goe...@google.com> wrote: > +1 > For reference here is a sample job > https://github.com/axelmagn/model-analysis/blob/axelmagn-hacks/examples/chicago_taxi/preprocess_flink.sh > > Also 1 quick heads up, output file will be created in docker container if > you use local file system. > > > > > On Tue, Jul 17, 2018 at 2:27 PM Holden Karau <hol...@pigscanfly.ca> wrote: > >> And I've got an hour to kill @ SFO today so at some of the suggestions >> from folks I'm going to do a more user focused one trying getting the TFT >> demo to work with the portable flink runner (hopefully) - >> https://www.youtube.com/watch?v=wL9mvQeN36E >> >> On Fri, Jul 13, 2018 at 11:54 AM, Holden Karau <hol...@pigscanfly.ca> >> wrote: >> >>> Hi folks! I've been doing some live coding in my other projects and I >>> figured I'd do some with Apache Beam as well. >>> >>> Today @ 3pm pacific I'm going be doing some impromptu exploration better >>> review tooling possibilities (looking at forking spark-pr-dashboard for >>> other projects like beam and setting up mentionbot to work with ASF infra) >>> - https://www.youtube.com/watch?v=ff8_jbzC8JI >>> >>> Next week (Thursday the 19th at 2pm pacific) I'm going to be working on >>> trying to get easier dependency management for the Python portable runner >>> in place - https://www.youtube.com/watch?v=Sv0XhS2pYqA >>> >>> If your interested in seeing more of the development process I hope you >>> will join me :) >>> >>> P.S. >>> >>> You can also follow on twitch which does a better job of notifications >>> https://www.twitch.tv/holdenkarau >>> >>> Also one of the other thing I do is "live reviews" of PRs but they are >>> generally opt-in and I don't have enough opt-ins from the Beam community to >>> do live reviews in Beam, if you work on Beam and would be OK with me doing >>> a live streamed review of your PRs let me know (if your curious to what >>> they look like you can see some of them here in Spark land >>> <https://www.youtube.com/watch?v=keDa4NPoUj0&index=15&list=PLRLebp9QyZtYF46jlSnIu2x1NDBkKa2uw> >>> ). >>> >>> -- >>> Twitter: https://twitter.com/holdenkarau >>> >> >> >> >> -- >> Twitter: https://twitter.com/holdenkarau >> > -- Twitter: https://twitter.com/holdenkarau
