Hi Keng,
when requesting <http://repos.bigtop.apache.org/> you get a result from
the S3 bucket s3://repos.bigtop.apache.org/ - because so many objects are stored
in this bucket, the result is truncated and lists only the artifacts of
the first two releases.
By adding a prefix parameter
http://repos.bigtop.apache.org/?prefix=releases/
you should be able to see the 3.2.0 packages for Ubuntu 22.04.
See [1] for more parameters.
Alternatively, you can install the AWS CLI [2,3] to get the listings:
aws --no-sign-request s3 ls s3://repos.bigtop.apache.org/releases/3.2.0/ubuntu/
Or, even better: configure the apt source and list the packages from Ubuntu:
# install the Bigtop signing keys
mkdir -p /usr/local/share/keyrings/
curl https://downloads.apache.org/bigtop/bigtop-3.2.0/repos/GPG-KEY-bigtop \
| gpg --dearmor | dd of=/usr/local/share/keyrings/bigtop-keyring.gpg
# add the following to /etc/apt/sources.list.d/bigtop-3.2.0.list (a single line)
deb [signed-by=/usr/local/share/keyrings/bigtop-dev-keyring.gpg]
http://repos.bigtop.apache.org/releases/3.2.0/ubuntu/22.04/$(ARCH) bigtop contrib
Call
apt update
and then
apt search hadoop-yarn
which should show among other packages:
hadoop-yarn/stable 3.3.4-1 amd64
The Hadoop NextGen MapReduce (YARN)
Best,
Sebastian
[1] https://docs.aws.amazon.com/AmazonS3/latest/API/API_ListObjects.html
[2] https://docs.aws.amazon.com/cli/index.html
[3] https://github.com/aws/aws-cli
On 6/8/23 07:11, bigtapp_root_aws quek wrote:
Hi all,
Sorry to be so chatty. When I accessed repos.bigtop.apache.org
<http://repos.bigtop.apache.org/>, it only showed /releases/1.0.0 and
release/1.1.0. <http://1.1.0.> Am I missing something?
Keng
On Thu, Jun 8, 2023 at 1:07 PM bigtapp_root_aws quek <[email protected]
<mailto:[email protected]>> wrote:
Hi all,
To elaborate, when I tried to use wget -nv
http://repos.bigtop.apache.org/releases/3.2.0/ubuntu/22.04/AMD64
<http://repos.bigtop.apache.org/releases/3.2.0/ubuntu/22.04/AMD64> it gave
me a 404 error same if the ${ARCH} is amd64.
Keng
On Thu, Jun 8, 2023 at 12:58 PM bigtapp_root_aws quek
<[email protected] <mailto:[email protected]>> wrote:
Hi Sebastian,
So far we have no issue to compile 3.2.0 but we still have issues with
the repo. We basically cannot seem to access it. Adding it as a repo
to the apt-get in the box also doesn't work.
Any urgent help is greatly appreciated.
Keng
On Wed, Jun 7, 2023 at 4:02 PM bigtapp_root_aws quek
<[email protected] <mailto:[email protected]>> wrote:
Hi Sebastian,
Appreciate it! I had read that the way to resolve BIGTOP-3898 was
to edit the script to install Python v2.7. I will confirm this.
Also does anyone know when BigTop 3.2.1 is coming out? I need to
install a new site with Ubuntu 22.04 and hope that Hadoop is updated
to 3.3.4 or 3.3.5 as well. Thanks.
Keng
On Wed, Jun 7, 2023 at 3:48 PM Sebastian Nagel <[email protected]
<mailto:[email protected]>> wrote:
Hi Keng,
the URL to add to add to the apt source listing is
http://repos.bigtop.apache.org/releases/3.2.0/ubuntu/22.04/$(ARCH)
<http://repos.bigtop.apache.org/releases/3.2.0/ubuntu/22.04/$(ARCH)>
However, you should check whether BIGTOP-3898 [1] is a blocker.
It causes the
installation of a few packages (hive, spark-python, zeppelin,
...) to fail.
Best,
Sebastian
[1] https://issues.apache.org/jira/browse/BIGTOP-3898
<https://issues.apache.org/jira/browse/BIGTOP-3898>
On 6/6/23 20:06, bigtapp_root_aws quek wrote:
> Hi
> Can any one provide me with the URL for the repo for Bigtop
3.2.0 with Ubuntu
> 22.04? Thanks!
>
> Keng
