Re: Intellij Issue in Imports

[Zohaib Baig]

Thank you Kirill and Maximilan for your reply. Solved the issue using
"./gradlew clean" and then refresh the Gradle.

Zohaib

On Sun, Dec 29, 2019 at 6:07 PM Maximilian Michels  wrote:

> I have this issue from time to time when pulling in the latest master.
> I've found that the only way to resolve this is to run "./gradlew clean",
> then refresh the Gradle project inside IntelliJ and run "compileTestJava"
> for the project which had the issues.
>
> Cheers,
> Max
>
> On December 27, 2019 8:20:05 AM GMT+01:00, Zohaib Baig <
> zohaib.b...@venturedive.com> wrote:
>>
>> Hi,
>>
>> According to the documentation, I have setup Beam project from scratch
>> in  IntelliJ. Seems like some files have issues in imports and were not
>> able to build, eventually, I wasn't able to test it through IDE (Working On
>> Windows).
>>
>> Is there any other configuration that I am missing?
>>
>> Thank you.
>>
>> [image: image.png]
>>
>>
>>

-- 

*Muhammad Zohaib Baig*
Senior Software Engineer
Mobile: +92 3443060266
Skype: mzobii.baig

<http://venturedive.com/>

Intellij Issue in Imports

[Zohaib Baig]

Hi,

According to the documentation, I have setup Beam project from scratch in
IntelliJ. Seems like some files have issues in imports and were not able to
build, eventually, I wasn't able to test it through IDE (Working On
Windows).

Is there any other configuration that I am missing?

Thank you.

[image: image.png]



-- 

*Muhammad Zohaib Baig*
Senior Software Engineer
Mobile: +92 3443060266
Skype: mzobii.baig

<http://venturedive.com/>

Re: Exception at testing DataFlow with preCommitLegacyWorker

[Zohaib Baig]

+Rehman Murad Ali 

On Thu, Nov 28, 2019 at 2:58 AM Brian Hulette  wrote:

> It looks like you passed an argument like
> -DbeamTestPipelineOptions 
> "[--project=apache-beam-testing,--tempRoot=gs://venturedive-beamers-shoaib-mszb/rehman-java,--runner=TestDataflowRunner,--dataflowWorkerJar=D:\\Workspace\\apache\\beam\\runners\\google-cloud-dataflow-java\\worker\\legacy-worker\\build\\libs\\beam-runners-google-cloud-dataflow-java-legacy-worker-2.18.0-SNAPSHOT.jar,]",
> but the string inside the quotes needs to be a valid JSON array of strings.
> If you change it to something like -DbeamTestPipelineOptions
> '["--project=apache-beam-testing",...]' you should get past that error.
>
> Agree with Michał though that we could help best if you share your full
> command line.
>
> Brian
>
> On Wed, Nov 27, 2019 at 8:20 AM Michał Walenia 
> wrote:
>
>> Hi,
>> can you please post the command you used in the terminal? It seems you
>> used a wrong combination of quotes, but I'd need to see it to be sure.
>> Cheers,
>> Michal
>>
>> On Wed, Nov 27, 2019 at 5:11 PM Rehman Murad Ali <
>> rehman.murad...@venturedive.com> wrote:
>>
>>> Hi Community,
>>>
>>> I have been recently trying to test data flow jobs with the beam. I have
>>> set up Gcloud account and tried to copy a file from the local system to the
>>> Gcloud storage (which works fine).
>>>
>>> Now I am trying to run preCommitLegacyWorker task on local and I am
>>> getting the following error:
>>>
>>> Unable to instantiate test options from system property
>>> beamTestPipelineOptions
>>>
>>>
>>> Caused by: com.fasterxml.jackson.core.JsonParseException: Unexpected
>>> character ('-' (code 45)) in numeric value: expected digit (0-9) to follow
>>> minus sign, for valid numeric value
>>>  at [Source:
>>> (String)"[--project=apache-beam-testing,--tempRoot=gs://venturedive-beamers-shoaib-mszb/rehman-java,--runner=TestDataflowRunner,--dataflowWorkerJar=D:\\Workspace\\apache\\beam\\runners\\google-cloud-dataflow-java\\worker\\legacy-worker\\build\\libs\\beam-runners-google-cloud-dataflow-java-legacy-worker-2.18.0-SNAPSHOT.jar,]";
>>> line: 1, column: 4]
>>> at
>>> com.fasterxml.jackson.core.JsonParser._constructError(JsonParser.java:1804)
>>> at
>>> com.fasterxml.jackson.core.base.ParserMinimalBase._reportError(ParserMinimalBase.java:693)
>>> at
>>> com.fasterxml.jackson.core.base.ParserMinimalBase.reportUnexpectedNumberChar(ParserMinimalBase.java:541)
>>> at
>>> com.fasterxml.jackson.core.json.ReaderBasedJsonParser._handleInvalidNumberStart(ReaderBasedJsonParser.java:1637)
>>> at
>>> com.fasterxml.jackson.core.json.ReaderBasedJsonParser._parseNegNumber(ReaderBasedJsonParser.java:1391)
>>> at
>>> com.fasterxml.jackson.core.json.ReaderBasedJsonParser.nextToken(ReaderBasedJsonParser.java:742)
>>> at
>>> com.fasterxml.jackson.core.json.ReaderBasedJsonParser.nextTextValue(ReaderBasedJsonParser.java:1160)
>>> at
>>> com.fasterxml.jackson.databind.deser.std.StringArrayDeserializer.deserialize(StringArrayDeserializer.java:145)
>>>
>>>
>>>
>>> Any help would be appreciable.
>>>
>>>
>>>
>>> *Thanks & Regards*
>>>
>>>
>>> *Rehman Murad Ali*
>>>
>>> Software Engineer
>>> Mobile: +92 3452076766 <+92%20345%202076766>
>>> Skype: rehman,muradali
>>>
>>> <http://venturedive.com/>
>>>
>>
>>
>> --
>>
>> Michał Walenia
>> Polidea <https://www.polidea.com/> | Software Engineer
>>
>> M: +48 791 432 002 <+48791432002>
>> E: michal.wale...@polidea.com
>>
>> Unique Tech
>> Check out our projects! <https://www.polidea.com/our-work>
>>
>

-- 

*Muhammad Zohaib Baig*
Senior Software Engineer
Mobile: +92 3443060266
Skype: mzobii.baig

<http://venturedive.com/>

Beam-2535 - Test Cases Failing

[Zohaib Baig]

Hello,

We have been working on this jira
https://issues.apache.org/jira/browse/BEAM-2535.

It has already a staled PR https://github.com/apache/beam/pull/470.
<https://github.com/apache/beam/pull/4700> which was closed because of
inactivity. I have done some initial work with this ticket and try to make
it compatible with current master branch of the beam. Seems like java pre
commits test cases are failing.

Here is the link of our PR https://github.com/apache/beam/pull/9677.
<https://github.com/apache/beam/pull/9677>

Right now we are blocked and need some guidance to proceed on this ticket.
Any help would be appreciated.



Thank you.

-- 

*Muhammad Zohaib Baig*
Senior Software Engineer
Mobile: +92 3443060266
Skype: mzobii.baig

<http://venturedive.com/>