Intellij Issue in Imports

[Zohaib Baig]

Hi,

According to the documentation, I have setup Beam project from scratch in
IntelliJ. Seems like some files have issues in imports and were not able to
build, eventually, I wasn't able to test it through IDE (Working On
Windows).

Is there any other configuration that I am missing?

Thank you.

[image: image.png]



-- 

*Muhammad Zohaib Baig*
Senior Software Engineer
Mobile: +92 3443060266
Skype: mzobii.baig

Re: [BEAM-9015] Adding pyXX-cloud instead of pyXX-gcp and pyXX-aws

[Udi Meiri]

+1

On Mon, Dec 23, 2019, 17:28 Robert Bradshaw  wrote:

> Makes sense to me.
>
> On Mon, Dec 23, 2019 at 3:33 PM Pablo Estrada  wrote:
> >
> > Hi all,
> > a couple of contributors [1][2] have been kind enough to add support for
> s3 filesystem[3] for the Python SDK. Part of this involved adding a tox
> task called py37-aws, to install the relevant dependencies and run unit
> tests for it (in a mocked-out environment).
> >
> > To avoid running a full extra test suite, I thought we could add the new
> aws-related dependencies to the current pyXX-gcp suites, and perhaps rename
> to pyXX-cloud, to include all unit tests that require cloud-specific
> dependencies. What do others think?
> >
> > This is tracked here: https://jira.apache.org/jira/browse/BEAM-9015
> >
> > [1] https://github.com/tamera-lanham
> > [2] https://github.com/MattMorgis
> > [3] https://github.com/apache/beam/pull/9955
>


smime.p7s
Description: S/MIME Cryptographic Signature

Re: [DISCUSS] Bump the version of GRPC from 1.21.0 to 1.22.0+ (May be the latest 1.26.0?)

[Udi Meiri]

Probably best to take one of these existing update bugs:
https://issues.apache.org/jira/browse/BEAM-4938
There's no discussion on these bugs, so I'd go with 1.26.0 unless someone
else has an objection.

On Mon, Dec 23, 2019 at 10:04 PM jincheng sun 
wrote:

> Hi folks,
>
> When submitting a Python word count job to a Flink session/standalone
> cluster repeatedly, the meta space usage of the task manager of the Flink
> cluster will continuously increase (about 40MB each time). The reason is
> that the Beam classes are loaded with the user class loader(child-first by
> default) in Flink and there is a minor problem with the implementation of
> `ProcessManager`(from Beam) and `ThreadPoolCache`(from Netty) which may
> cause the user class loader could not be garbage collected even after the
> job finished which causes the meta space memory leak eventually. You can
> refer to FLINK-15338[1] for more information.
>
> Regarding to `ProcessManager`, I have created a JIRA BEAM-9006[2] to track
> it. Regarding to `ThreadPoolCache`, it is a Netty problem and has been
> fixed in NETTY#8955[3]. Netty 4.1.35 Final has already included this fix
> and GRPC 1.22.0 has already dependents on Netty 4.1.35 Final. So we need to
> bump the version of GRPC to 1.22.0+ (currently 1.21.0).
>
> My proposal is to upgrade the GRPC version to the 1.22.0+ (May be the
> latest 1.26.0?)
>
> I've created JIRA [4], but I'm not sure if there will be any other
> problems with the bump the version of GRPC up. So, I'd like to bring up
> this discussion and welcome your feedback !
>
> [1] https://issues.apache.org/jira/browse/FLINK-15338
> [2] https://issues.apache.org/jira/browse/BEAM-9006
> [3] https://github.com/netty/netty/pull/8955
> [4] https://issues.apache.org/jira/browse/BEAM-9030
>
> Best,
> Jincheng
>


smime.p7s
Description: S/MIME Cryptographic Signature

Re: [ANNOUNCE] New committer: Kasia Kucharczyk

[Cyrus Maden]

Congrats Kasai!

On Tue, Dec 24, 2019 at 7:07 PM Thomas Weise  wrote:

> Congratulations!
>
>
> On Mon, Dec 23, 2019 at 1:39 PM Udi Meiri  wrote:
>
>> Congrats Kasia!
>>
>> On Mon, Dec 23, 2019 at 1:23 PM Kyle Weaver  wrote:
>>
>>> Congrats Kasia! And thanks for sharing, Pablo.
>>>
>>> On Mon, Dec 23, 2019 at 4:16 PM Pablo Estrada 
>>> wrote:
>>>
 Hi everyone,

 Please join me and the rest of the Beam PMC in welcoming a new
 committer: Kasia Kucharczyk

 Kasia has contributed to Beam in many ways, including the performance
 testing infrastructure, and has even spoken at events about Beam.

 In consideration of Kasia's contributions, the Beam PMC trusts her with
 the responsibilities of a Beam committer[1].

 Thanks for your contributions Kasia!

 Pablo, on behalf of the Apache Beam PMC.

 [1] https://beam.apache.org/contribute/become-a-committer
 /#an-apache-beam-committer

>>>