Excellent and welcome!
[image: Big Data Institute] Jesse Anderson
Managing Director
Big Data Institute
(775) 393 9122 | je...@bigdatainstitute.io
bigdatainstitute.io <https://www.bigdatainstitute.io/>
On Tue, Oct 1, 2019 at 10:46 AM Łukasz Gajowy wrote:
> Welcome! :)
>
> wt.,
Interesting
On Wed, Oct 10, 2018, 3:49 PM Kenneth Knowles wrote:
> Welcome, Hai!
>
> On Wed, Oct 10, 2018 at 3:46 PM Hai Lu wrote:
>
>> Hi, all
>>
>> This is Hai from LinkedIn. As Xinyu mentioned, I have been working on
>> portable API for Samza runner and made some solid progress. It's been a
The examples have to be separate from the main beam repository. This way,
they serve as an example of how to use them in your code instead of how to
do it as part of Beam. It would also you to show the dependencies in sbt or
Maven.
On Wed, Aug 1, 2018, 3:16 PM Charles Chen wrote:
> The examples
Thanks for all your work!
On Mon, Jul 16, 2018, 9:17 PM Eugene Kirpichov wrote:
> Hi beamers,
>
> After 5.5 years working on data processing systems at Google, several of
> these years working on Dataflow and Beam, I am moving on to do something
> new (also at Google) in the area of programming
Welcome!
On Fri, Jun 1, 2018, 2:02 AM Etienne Chauchot wrote:
> Congrats to all !
> Le jeudi 31 mai 2018 à 19:08 -0700, Davor Bonaci a écrit :
>
> Please join me and the rest of Beam PMC in welcoming the following
> contributors as our newest committers. They have significantly contributed
> to
Congrats!
On Thu, May 17, 2018, 6:44 PM Robert Burke wrote:
> Congrats & welcome back!
>
> On Thu, May 17, 2018, 5:44 PM Huygaa Batsaikhan wrote:
>
>> Welcome back, Gris! Congratulations!
>>
>> On Thu, May 17, 2018 at 4:24 PM Robert Bradshaw
>> wrote:
>>
>>> Congratulations, Gris! And welcome
This -> "I'd like that each time you think that you ask yourself "does it
need?"."
On Wed, May 16, 2018 at 4:53 PM Robert Bradshaw wrote:
> Thanks for your email, Romain. It helps understand your goals and where
> you're coming from. I'd also like to see a thinner core, and agree it's
> benefici
Excellent!
On Fri, Jan 26, 2018, 5:37 AM Kenneth Knowles wrote:
> Hi all,
>
> In case you haven't noticed or followed, there's a new runner in PR: Samza!
>
> https://github.com/apache/beam/pull/4340
>
> It has been under review and revision for some time. In local mode it
> passes a solid su
+1 to BoF. I don't know if any Beam talks will be on the schedule.
> We could do an informal BoF at the Philz nearby or similar?
her open source adoption at enterprises, it starts
with architects and works its way around the organization from there.
Thanks,
Jesse
On Mon, Jan 15, 2018 at 8:14 AM Ted Yu wrote:
> bq. are hard to detect in our unit-test framework
>
> Looks like more integration tests would help
Happy New Year!
On Sun, Dec 31, 2017, 11:09 PM Jean-Baptiste Onofré wrote:
> Hi beamers,
>
> I wish you a great and happy new year !
>
> Regards
> JB
> --
> Jean-Baptiste Onofré
> jbono...@apache.org
> http://blog.nanthrax.net
> Talend - http://www.talend.com
>
Congrats!
On Wed, Dec 13, 2017, 5:54 AM Jean-Baptiste Onofré wrote:
> Hi Davor,
>
> welcome back !!
>
> It's really great to see you back active in the Beam community. We really
> need you !
>
> I'm so happy !
>
> Regards
> JB
>
> On 12/13/2017 05:51 AM, Davor Bonaci wrote:
> > My dear friends,
That's great!
On Wed, Nov 29, 2017, 4:00 AM Etienne Chauchot wrote:
> Very nice Griselda!
>
> Looking forward to get feedback !
>
> Thanks
>
> Etienne
>
>
> Le 29/11/2017 à 09:11, Jean-Baptiste Onofré a écrit :
> > Hi Gris,
> >
> > That's really great ! Thanks for sharing.
> >
> > By the way, ne
oping to make myself useful in particular around
> portability>
> > efforts and the open source engine runners.>
> >
> > Best,>
> > Axel>
> >
> > -- >
> > Axel Magnuson | Software Engineer | axelm...@google.com | 1 (425)
> 893-4624>
> >
>
--
Thanks,
Jesse
s that the
> > > progess is very slow.
> > > Thanks.
> > >
> >
>
>
>
> --
> Twitter: https://twitter.com/holdenkarau
>
--
Thanks,
Jesse
A big +1
on guide and I'm excited to start
> making contributions soon!
>
> Thank you,
> Daniel Oliveira
>
--
Thanks,
Jesse
Drop rows that are not informative, like Composite transforms, or not
> designed
> 5. Reorganize the windowing section to be just support for merging /
> non-merging windowing.
> 6. Switch to a more distinct color scheme than the solid vs faded colors
> currently used.
> 7. Find a web design to get short descriptions into the foreground to make
> it easier to grok.
>
> These are just a few thoughts, and not necessarily compatible with each
> other. What do you think?
>
> Kenn
>
--
Thanks,
Jesse
p this sort of
> contributions shared and available? Perhaps keep a list with links in our
> readme, or the beam site, or something else?
>
> Best
> -P.
>
> 1 -
>
> https://stackoverflow.com/questions/45603814/any-contrib-package-for-apache-beam-where-i-can-commit-a-dataflow-pipeline
>
--
Thanks,
Jesse
oject-wide, driving releases, improving processes and
> testing,
> > and growing the community.
> >
> > * Aviem Zur
> > Beyond significant work in the Spark runner, Aviem has worked to improve
> > how the project operates, leading discussions on inclusiveness and
> > openness.
> >
> > Congratulations to both! Welcome!
> >
> > Davor
> >
>
--
Thanks,
Jesse
the Join functionality. Additionally, he's consistently shown
> > > > himself to be an insightful code reviewer, significantly impacting
> the
> > > > project’s code quality and ensuring the success of the new major
> > > component.
> > > >
> > > > * Manu Zhang
> > > > Manu initiated and developed a runner for the Apache Gearpump
> > > (incubating)
> > > > engine, and has driven it to the point of merging to the master
> branch.
> > > In
> > > > this effort, he accumulated 65 commits (7,812 ++ / 4,882 --) and
> > extended
> > > > the project to the new user community.
> > > >
> > > > Congratulations to all five! Welcome!
> > > >
> > > > Davor
> > > >
> > >
> >
>
>
>
> --
> ---
> Jason Kuster
> Apache Beam / Google Cloud Dataflow
>
--
Thanks,
Jesse
).
>
> I would like to start the discussion, and get people's attention of
> supporting MapReduce in Beam.
>
> Feel free to make comments and suggestions on that doc.
>
> Thanks
> --
> Pei
>
--
Thanks,
Jesse
> > >> > > client.
> > >> > >
> > >> > > *Checklist for merge:*
> > >> > > 1. functionality
> > >> > >1.1. SQL grammer:
> > >> > > 1.1.1. basic query with SELECT/FILTER/PROJECT;
> > >> > > 1.1.2. AGGREGATION with global window;
> > >> > > 1.1.3. AGGREGATION with FIX_TIME/SLIDING_TIME/SESSION window;
> > >> > > 1.1.4. JOIN
> > >> > >1.2. UDF/UDAF support;
> > >> > >1.3. support predefined String/Math/Date functions, see[2];
> > >> > >
> > >> > > 2. DSL interface to convert SQL as PTransform;
> > >> > >
> > >> > > 3. junit test;
> > >> > >
> > >> > > 4. Java document;
> > >> > >
> > >> > > 5. Document of SQL feature in website;
> > >> > >
> > >> > > Any comments/suggestions are very welcomed.
> > >> > >
> > >> > > Note:
> > >> > > [1].
> > >> > >
> > >> > https://issues.apache.org/jira/browse/BEAM-2436?jql=labels%
> > >> 20%3D%20dsl_sql_merge
> > >> > >
> > >> > > [2]. https://calcite.apache.org/docs/reference.html
> > >> > >
> > >> >
> > >> > --
> > >> > Jean-Baptiste Onofré
> > >> > jbono...@apache.org
> > >> > http://blog.nanthrax.net
> > >> > Talend - http://www.talend.com
> > >> >
> > >>
> > >
> > >
> >
>
>
>
> --
>
> Mingmin
>
--
Thanks,
Jesse
h & stream processing.
>
> How do you guys think? which do you prefer? What's your reasoning?
>
> Looking forward to your opinions, thanks in advance.
>
--
Thanks,
Jesse
I've published the Q and A. You can find it here
<http://www.jesse-anderson.com/2017/06/beam-2-0-q-and-a/>.
Thanks,
Jesse
On Wed, Jun 7, 2017 at 7:52 AM Jesse Anderson
wrote:
> One last call to fill out the Q and A. I'm going to publish it on
> Wednesday June 14. Ple
s decide to use Beam.
Here the document again
https://docs.google.com/document/d/1vyel3XRfdeGyqLvXiy1C3mrw9QBbveoKjjVLuRxMw4k/edit#heading=h.o2a3kt7gof9g
.
On Mon, May 22, 2017 at 2:26 AM Jesse Anderson
wrote:
> Gentle reminder to fill out the Q and A
> https://docs.
Gentle reminder to fill out the Q and A
https://docs.google.com/document/d/1vyel3XRfdeGyqLvXiy1C3mrw9QBbveoKjjVLuRxMw4k/edit#.
As James said, this is very helpful to new Beam users.
On Thu, May 18, 2017 at 3:12 AM James wrote:
> Thanks a lot Jesse! Learned a lot from your previous Q &
Could I get a pair of eyeballs (or more) to look over the 2.0 updates I
made to the Beam example? This is the commit
<https://github.com/eljefe6a/beamexample/commit/b0a5988263cec451efdc060326ccc2bd622066b3>
.
Thanks,
Jesse
--
Thanks,
Jesse
as many questions as you'd
like.
Once we're done, I'll publish the responses to a new blog post and send out
the URL.
Thanks,
Jesse
--
Thanks,
Jesse
> project, and I'm proud to be a part of this great community.
> > > > >
> > > > > Davor
> > > > >
> > > >
> > > > --
> > > > Jean-Baptiste Onofré
> > > > jbono...@apache.org
> > > > http://blog.nanthrax.net
> > > > Talend - http://www.talend.com
> > > >
> > > --
> > > Thanks,
> > > Andrew
> > >
> > > Subscribe to my book: Streaming Data <http://manning.com/psaltis>
> > > <https://www.linkedin.com/pub/andrew-psaltis/1/17b/306>
> > > twiiter: @itmdata <http://twitter.com/intent/user?screen_name=itmdata>
> > >
> >
>
--
Thanks,
Jesse
s, as well as
> >> update
> >> the code toggles, and simplify a bit of the navigational structure.
> >>
> >> Sending this PR [1] out now as an FYI and to solicit feedback. We'll
> make
> >> a
> >> few more improvements based on suggestions, as well as a few tweaks to
> >> TODOs in the header and footer. Feedback is welcome - thanks everyone!
> >>
> >> [1] https://github.com/apache/beam-site/pull/244 +
> >> http://apache-beam-website-pull-requests.storage.googleapis.
> >> com/244/index.html
> >>
> >>
> > --
> > Jean-Baptiste Onofré
> > jbono...@apache.org
> > http://blog.nanthrax.net
> > Talend - http://www.talend.com
> >
>
--
Thanks,
Jesse
ngine. We'll have to make sure we're clear on how
Beam's SQL works in the docs.
Thanks,
Jesse
On Mon, May 8, 2017 at 3:34 PM Tyler Akidau
wrote:
> Any thoughts here Fabian? I'm planning to start sending out some more
> emails towards the end of the week.
>
> -Tyle
Is possible to change how Slack invites are handled? This might encourage
our community contributions.
Right now, people have to email in (causing extra dev@/user@ emails). I did
a quick search and found this <https://github.com/rauchg/slackin> so people
can invite themselves.
Thanks,
nd the ASF at large. Well deserved.
> >>>>>
> >>>>> Best,
> >>>>>
> >>>>> Jason
> >>>>>
> >>>>> [1] https://blogs.apache.org/foundation/entry/the-apache-sof
> >>>>> tware-foundation-welcomes
> >>>>>
> >>>>> P.S. I dug through the list to make sure I wasn't missing any other
> >>> Beam
> >>>>> community members; if I have, my sincerest apologies and please
> >>> recognize
> >>>>> them on this or a new thread.
> >>>>>
> >>>>
> >>>> --
> >>>> Jean-Baptiste Onofré
> >>>> jbono...@apache.org
> >>>> http://blog.nanthrax.net
> >>>> Talend - http://www.talend.com
> >>>>
> >>>
> >>
>
> --
Thanks,
Jesse
ew). It'd actually be a good test case of the
> ease
> > of use of the API.
> >
> > On Sat, Apr 29, 2017 at 12:50 PM Shen Li wrote:
> >
> > > It seems that Create.of(Iterable) can only create a BoundedSource. Is
> > there
> > > a convenient way to read from an unbounded Iterable object without
> > writing
> > > application code to wrap it into an UnboundedSource object?
> > >
> > >
> > > Thanks,
> > >
> > > Shen
> > >
> >
>
--
Thanks,
Jesse
k to create a Pipeline; (Semi-SQL mode)
>
> As we see many folks are interested in this feature, would like to create a
> feature branch to have more involvement.
> Looking for comments and feedback.
>
> Thanks!
>
> Mingmin
>
--
Thanks,
Jesse
; 2016-02-01&to=2017-03-17&type=c
> > [2]
> > https://github.com/apache/beam/blob/v0.6.0/sdks/python/
> > apache_beam/io/iobase.py#L70
> > [3]
> > https://github.com/apache/beam/blob/v0.6.0/sdks/python/
> > apache_beam/io/iobase.py#L561
> > [4] https://s.apache.org/splittable-do-fn
> >
>
--
Thanks,
Jesse
é
> > * Robert Bradshaw
> > * Ted Yu
> > * Tibor Kiss
> >
> > There are no disapproving votes.
> >
> > Thanks everyone!
> >
> > Ahmet
> >
>
> --
> Jean-Baptiste Onofré
> jbono...@apache.org
> http://blog.nanthrax.net
> Talend - http://www.talend.com
>
--
Thanks,
Jesse
I don't have a particularly strong opinion either way.
I think 1.0 makes the most sense.
On Wed, Mar 1, 2017, 10:57 AM Davor Bonaci wrote:
> The first stable release is our next major project-wide goal; see
> discussion in [1]. I've been referring to it as "the first stable release"
> for a long time, not "1.0.0" or "2.0.0" or "2017" or something el
Sounds good.
On Tue, Feb 21, 2017, 7:19 PM Davor Bonaci wrote:
> In the early days of the project, we have held a few meetings for the
> initial community to get to know each other. Since then, the community has
> grown a huge amount, but we haven't organized any get-togethers.
>
> I wanted to g
elements, kvs and
> iterables (potentially more in the future), so the naming should be
> consistent between the different versions and future-proof.
>
> On Fri, Feb 10, 2017 at 10:16 AM Jesse Anderson
> wrote:
>
> The ToString.of() violates the new transform rules and we need
e everyone's thoughts? I'm thinking going back to elements or make,
strings.
Thanks,
Jesse
I'm not. There was a decent amount of time between the first 0.8 and 0.9
release.
On Wed, Feb 8, 2017, 12:08 PM Raghu Angadi
wrote:
> True.
>
> I was commenting on Kafka developers. I am surprised the api breakages
> didn't have any deprecation period at all.
>
> On Wed, Feb 8, 2017 at 12:02 PM,
Excellent! On the redefinition of #2, people are used to it. With Hadoop
MapReduce, you had to define types in 1-3 different places.
While you're there, we also need also need a lambda that has access to the
Context object.
On Fri, Feb 3, 2017 at 11:03 AM Kenneth Knowles
wrote:
> Hi all,
>
> Ri
Thanks for putting that together. Does this mean you've volunteered to
referee bikeshedding?
On Mon, Jan 30, 2017 at 5:21 PM Eugene Kirpichov
wrote:
> The initial PR has been merged and the style guide is live
> https://beam.apache.org/contribute/ptransform-style-guide/ - let us
> continue discu
@dan I thought you were talking about the transform class definition:
public static class GroupedValues
extends PTransform
>>,
PCollection>> {
On Fri, Jan 27, 2017 at 11:30 AM Dan Halperin
wrote:
> Hi Jesse, can you s
One con to making transform classes be private would be that it is a
breaking change. If anyone uses that class directly or extends that class,
we'd be breaking that.
On Fri, Jan 27, 2017 at 9:37 AM Jesse Anderson
wrote:
> Continuing a discussion <https://github.com/apache/beam/pul
7;s where people are looking when
using these methods.
I think we need to do a general pass to make these consistent after we
decide on how they should be done.
Thanks,
Jesse
Welcome!
On Thu, Jan 26, 2017, 7:27 PM Davor Bonaci wrote:
> Please join me and the rest of Beam PMC in welcoming the following
> contributors as our newest committers. They have significantly contributed
> to the project in different ways, and we look forward to many more
> contributions in the
Thanks for all your hard work.
On Sun, Jan 15, 2017, 10:16 AM Jean-Baptiste Onofré wrote:
> Hi Max,
>
> thanks for your commitment and your work on the project.
>
> Enjoy your time off.
>
> Regards
> JB
>
> On 01/14/2017 09:04 AM, Maximilian Michels wrote:
> > Dear Beamers,
> >
> > Thank you for
Excellent!
On Tue, Jan 10, 2017, 7:12 AM Jacky Li wrote:
> Great work! Congratulations!
>
> Regards,
> Jacky
>
> > 在 2017年1月10日，下午7:11，Sergio Fernández 写道：
> >
> > Congrats, guys!
> >
> > On Tue, Jan 10, 2017 at 12:07 PM, Davor Bonaci wrote:
> >
> >> The ASF has publicly announced our graduati
e in with opinions.
>
> Dan
>
> On Wed, Jan 4, 2017 at 1:34 PM, Jesse Anderson
> wrote:
>
> > @Eugene, yes that failed on the checkstyle.
> >
> > On Wed, Jan 4, 2017 at 1:27 PM Eugene Kirpichov
> > wrote:
> >
> > > Try just -Prelease.
> &
@Eugene, yes that failed on the checkstyle.
On Wed, Jan 4, 2017 at 1:27 PM Eugene Kirpichov
wrote:
> Try just -Prelease.
> On Wed, Jan 4, 2017 at 1:21 PM Jesse Anderson
> wrote:
>
> > Fails because I don't have a secret key.
> >
> > On Wed, Jan 4, 2
Fails because I don't have a secret key.
On Wed, Jan 4, 2017 at 1:03 PM Jean-Baptiste Onofré wrote:
> Hi Jesse,
>
> Could you try the same with:
>
> mvn verify -Prelease,apache-release
>
> ?
>
> Regards
> JB
>
> On 01/04/2017 09:53 PM, Jesse Anderson
d them. From the output, it doesn't look
like they're being run at all.
Thanks,
Jesse
I just found out that running:
mvn verify -pl org.apache.beam:beam-sdks-java-core
Doesn't run the checkstyle for some reason. I'm not sure why and I had a
bunch of checkstyle errors.
On Wed, Jan 4, 2017 at 8:18 AM Jesse Anderson wrote:
> The blog post <http://www.jesse-ande
pends on directly
> (sdk-core and runners-core) that have this pain.
>
> Now for tests that should work on *any* runner, there is similar
> customization -- @RunnableOnService (today, some better name tomorrow) and
> runnable-on-service-tests, etc. etc.
>
> Dan
>
> On Thu, D
Congrats JB!
On Fri, Dec 30, 2016, 9:23 PM Davor Bonaci wrote:
> I stumbled across Apache News Round-up for this week [1], and our own
> Jean-Baptiste Onofré is noted as one of the top five committers in 2016
> with 1,825 commits across all Apache projects.
>
> Congratulations JB -- this is awes
sform, wrapping MapElements).
On Thu, Dec 29, 2016 at 4:00 PM Ben Chambers
wrote:
> Dan's proposal to move forward with a simple (future-proofed) version of
> the ToString transform and Javadoc, and add specific features via follow-up
> PRs.
>
> On Thu, Dec 29, 2016 at 3:53 P
ot; and using "create" for it seems
> moderately non-future proof.
>
> On Thu, Dec 29, 2016 at 3:17 PM Dan Halperin
> wrote:
>
> > On Thu, Dec 29, 2016 at 2:10 PM, Jesse Anderson
> > wrote:
> >
> > > I agree MapElements isn't hard to use. I think
a programmer and they'll need classes like this to be productive.
On Thu, Dec 29, 2016 at 1:46 PM Dan Halperin
wrote:
On Thu, Dec 29, 2016 at 1:36 PM, Jesse Anderson
wrote:
> I prefer JB's take. I think there should be three overloaded methods on
the
> class. I like Vikas'
eam. What does
everyone think of the class name, methods name, and method operations so we
can have Vikas finish up?
Thanks,
Jesse
On Wed, Dec 28, 2016 at 12:28 PM Jean-Baptiste Onofré
wrote:
> Hi Vikas,
>
> did you take a look on:
>
>
> https://github.com/jbonofre/beam/tree/DATA
=org.apache.beam:beam-sdks-java-core -pl
> > > runners/direct-java"
> > >
> > > On Thu, Dec 29, 2016 at 8:50 PM Stas Levin
> wrote:
> > >
> > > > Once you "cd" into "runners/direct-java" you can use:
> > > >
> > > >
I tried that one already. It gives a no tests run error. If you bypass that
error with -DfailIfNoTests=false, no tests get run at all.
On Thu, Dec 29, 2016 at 10:20 AM Jean-Baptiste Onofré
wrote:
> Hi Jesse
>
> Mvn test -Dtest=RegexTest
>
> Should work
>
> Don't fo
un. Does anyone know what I'm missing?
Thanks,
Jesse
66 matches
Mail list logo
