Hi Owen,

Yes, I created a jira about removing the hadoop lzo lib:
https://issues.apache.org/jira/browse/GOBBLIN-1312

There my initial idea was to bump the parquet lib to a version which is not
depending anymore on the maven twitter but it turned it is not that easy as
we use a very old version of hive in Gobblin.
https://github.com/apache/incubator-gobblin/pull/3150

Now, I think first I will try to remove it from the default build to
unblock the build and after that, we can discuss how to remove completly.

What do you think?

Tamas

On Thu, 12 Nov 2020 at 00:34, Owen O'Malley <[email protected]> wrote:

> Tamas,
>    Is there already a jira to replace the dependency on the twitter repo?
> Actually, I'd go further than that and say that we should remove the lzo
> dependency altogether. (If there is actually a compile-time dependence, it
> should be behind a non-default profile.)
>
> .. Owen
>
> On Wed, Nov 11, 2020 at 10:37 AM Tamás Németh <[email protected]> wrote:
>
> > My vote: -1
> >
> > Sorry, from my location, I can't build as the Twitter maven repo is
> > unavailable for more than a week and it seems like it is not only
> Hungary.
> > :( :
> > FAILURE: Build failed with an exception.
> >
> > * What went wrong:
> > Could not resolve all files for configuration
> > ':gobblin-modules:gobblin-parquet-apache:compileClasspath'.
> > > Could not resolve com.hadoop.gplcompression:hadoop-lzo:0.4.16.
> >   Required by:
> >       project :gobblin-modules:gobblin-parquet-apache >
> > org.apache.parquet:parquet-protobuf:1.10.1 >
> > com.twitter.elephantbird:elephant-bird-core:4.4
> >    > Could not resolve com.hadoop.gplcompression:hadoop-lzo:0.4.16.
> >       > Could not get resource '
> >
> https://maven.twttr.com/com/hadoop/gplcompression/hadoop-lzo/0.4.16/hadoop-lzo-0.4.16.pom
> > '.
> >          > Could not GET '
> >
> https://maven.twttr.com/com/hadoop/gplcompression/hadoop-lzo/0.4.16/hadoop-lzo-0.4.16.pom
> '.
> > Received status code 503 from server: Service Temporarily Unavailable
> >
> > Tamas
> >
> > On Wed, 11 Nov 2020 at 08:24, Shirshanka Das <[email protected]>
> > wrote:
> >
> >> My vote: +1
> >>
> >> Steps:
> >>
> >> - Incubating in name
> >> - Checked hashes and signatures
> >> - Checked DISCLAIMER file
> >> - Checked LICENSE file
> >> - Checked NOTICE file, valid year
> >> - Checked CHANGELOG
> >> - Validated gradle rat report is good (license, binary files)
> >> - Validated ./gradlew build succeeds
> >>
> >> Shirshanka
> >>
> >>
> >> On Mon, Nov 9, 2020 at 10:20 AM Sudarshan Vasudevan
> >> <[email protected]> wrote:
> >>
> >> > Re-sending this - since some committers do not seem to have received
> the
> >> > original email.
> >> >
> >> > Thanks,
> >> > Sudarshan
> >> > ________________________________
> >> > From: Sudarshan Vasudevan
> >> > Sent: Friday, November 6, 2020 9:52 AM
> >> > To: [email protected] <
> [email protected]>
> >> > Subject: [VOTE] Apache Gobblin 0.15.0 release RC1
> >> >
> >> >
> >> > Hi all,
> >> >
> >> > I'd like to call a vote to release Apache Gobblin 0.15.0 (Incubating).
> >> >
> >> > The source release candidate RC1 can be downloaded here:
> >> >
> >> >
> >> >
> >>
> https://dist.apache.org/repos/dist/dev/incubator/gobblin/apache-gobblin-incubating-0.15.0-rc1/
> >> >
> >> >
> >> > The artifacts (i.e. JARs) corresponding to this release candidate can
> be
> >> > found here:
> >> >
> >>
> https://repository.apache.org/content/repositories/orgapachegobblin-1012
> >> >
> >> > This has been signed with PGP key 7F4FC4D0, corresponding to
> >> > [email protected], which is included in the repository's KEYS file.
> >> > This
> >> > key can be found on keyservers, such as:
> >> >
> >> >
> >> >
> >> >
> >>
> https://keyserver.ubuntu.com/pks/lookup?search=suvasude%40apache.org&fingerprint=on&op=index
> >> >
> >> >
> >> >
> >> > It is also listed here:
> >> > https://people.apache.org/keys/committer/suvasude.asc
> >> >
> >> > The release candidate has been tagged with release-0.15.0-rc1.
> >> > I've also created a branch 0.15.0-rc1.
> >> >
> >> > For reference, here is a list of all closed JIRAs tagged with 0.15.0:
> >> >
> >> >
> >> >
> >>
> https://issues.apache.org/jira/browse/GOBBLIN-1288?jql=project%20%3D%20Gobblin%20AND%20fixVersion%20%3D%200.15.0%20AND%20status%20in%20(Closed%2CResolved)
> >> >
> >> >
> >> > For a summary of the changes in this release, see:
> >> > https://github.com/apache/incubator-gobblin/blob/0.15.0/CHANGELOG.md
> >> >
> >> > Please review and vote.  The vote will be open for 72 hours (ends on
> >> > Monday, 9 November 2020, 5 PM PST).
> >> >
> >> > [ ] +1 approve
> >> > [ ] +0 no opinion
> >> > [ ] -1 disapprove (and reason why)
> >> >
> >> > My vote: +1
> >> >
> >> > Thanks,
> >> > Sudarshan
> >> >
> >> >
> >> >
> >> >
> >>
> >
>

Reply via email to