Re: [oi-dev] couchdb-31 is broken

2024-03-19 Thread Marcel Telka
On Tue, Feb 20, 2024 at 09:58:02AM +0100, Marcel Telka wrote:
> the couchdb-31 package is broken at the ips server:
> 
> Errors were encountered while attempting to retrieve package or file data for
> the requested operation.
> Details follow:
> 
> pkg://openindiana.org/database/couchdb-31@3.1.2,5.11-2023.0.0.0:20230609T222502Z
>   Invalid content: manifest hash failure: fmri: 
> pkg://openindiana.org/database/couchdb-31@3.1.2,5.11-2023.0.0.0:20230609T222502Z
>  
> expected: 28185b5f27c3c0ce9ea1d8f129e0e5763f53e8ae computed: 
> b371cc90d6fd42c5bafa55f85afb183b59c23960. (happened 4 times)

The package is okay since 2024-03-14.

-- 
+---+
| Marcel Telka   e-mail:   mar...@telka.sk  |
|homepage: http://telka.sk/ |
+---+

___
oi-dev mailing list
oi-dev@openindiana.org
https://openindiana.org/mailman/listinfo/oi-dev


Re: [oi-dev] couchdb-31 is broken

2024-02-23 Thread Marcel Telka
On Fri, Feb 23, 2024 at 01:02:52AM +0100, Marcel Telka wrote:
> On Tue, Feb 20, 2024 at 09:58:02AM +0100, Marcel Telka wrote:
> > the couchdb-31 package is broken at the ips server:
> > 
> > Errors were encountered while attempting to retrieve package or file data 
> > for
> > the requested operation.
> > Details follow:
> > 
> > pkg://openindiana.org/database/couchdb-31@3.1.2,5.11-2023.0.0.0:20230609T222502Z
> >   Invalid content: manifest hash failure: fmri: 
> > pkg://openindiana.org/database/couchdb-31@3.1.2,5.11-2023.0.0.0:20230609T222502Z
> >  
> > expected: 28185b5f27c3c0ce9ea1d8f129e0e5763f53e8ae computed: 
> > b371cc90d6fd42c5bafa55f85afb183b59c23960. (happened 4 times)
> 
> The problem is in the publisher/openindiana.org/catalog/catalog.base.C
> file.  However I do not know what is the proper way to fix it.
> Maybe simple sed would be enough?
> 
> sed -i -e \
>   
> 's/28185b5f27c3c0ce9ea1d8f129e0e5763f53e8ae/b371cc90d6fd42c5bafa55f85afb183b59c23960/'
>  \
>   publisher/openindiana.org/catalog/catalog.base.C

No, sed it not the proper way to fix this, because the file seems to
contain a signature (see below).

I ran `pkgrepo rebuild -s REPO -p openindiana.org --no-index` and I
found that it:

* removed the publisher/openindiana.org/index directory (a bit
  unexpected)
* removed all publisher/openindiana.org/catalog/update.* files
* modified publisher/openindiana.org/catalog/catalog.summary.C - with
  mostly not very importand changes
* updated publisher/openindiana.org/catalog/catalog.attrs - because
  other files in catalog changed/removed
* updated publisher/openindiana.org/catalog/catalog.base.C

and this revealed that there are six corrupted packages in the repo (the
list is below) and the corruption happened after 2023-10-11 21:22:16+.
Please note that luckily most corruptions are hidden because we do have
newer correct version of affecter packages in the repo, except
database/couchdb-31.


Here are differences between the old catalog.base.C and the new one:

$ diff -u <(jq < catalog.base.C-old) <(jq < catalog.base.C)
--- /dev/fd/63  2024-02-23 12:57:39.795696894 +0100
+++ /dev/fd/62  2024-02-23 12:57:39.795705684 +0100
@@ -66832,7 +66832,7 @@
 ],
 "database/couchdb-31": [
   {
-"signature-sha-1": "28185b5f27c3c0ce9ea1d8f129e0e5763f53e8ae",
+"signature-sha-1": "b371cc90d6fd42c5bafa55f85afb183b59c23960",
 "version": "3.1.2,5.11-2023.0.0.0:20230609T222502Z"
   }
 ],
@@ -121060,7 +121060,7 @@
 ],
 "developer/golang-119": [
   {
-"signature-sha-1": "a22c9e5526b28eeb356a019a170848dd9cff0028",
+"signature-sha-1": "84d0f3564243569662206ff01060c1d85a19060e",
 "version": "1.19.13,5.11-2023.0.0.0:20230907T190550Z"
   },
   {
@@ -121070,7 +121070,7 @@
 ],
 "developer/golang-120": [
   {
-"signature-sha-1": "cefb854835a501b27a457630019ebc73cb3c099d",
+"signature-sha-1": "e3d9c336f4cb17b3e0a8ea59c8a2003c4eae6db1",
 "version": "1.20.10,5.11-2023.0.0.0:20231011T212216Z"
   },
   {
@@ -121092,7 +121092,7 @@
 ],
 "developer/golang-121": [
   {
-"signature-sha-1": "08961188c8156f97513be69282778fce0dea5ecd",
+"signature-sha-1": "a19e750d1baa659c68c26e98ab65dcdad8990a15",
 "version": "1.21.3,5.11-2023.0.0.0:20231011T212236Z"
   },
   {
@@ -212320,7 +212320,7 @@
 ],
 "editor/codeblocks": [
   {
-"signature-sha-1": "6ec033933597a8540df2a2948648736769fbf62a",
+"signature-sha-1": "292dbc04410f76a4722345133e6a71c5a5e77423",
 "version": "20.3,5.11-2023.0.0.3:20230511T194351Z"
   },
   {
@@ -441060,7 +441060,7 @@
 ],
 "library/readline": [
   {
-"signature-sha-1": "cb02cbdaa6cda8a1ed1915185fe38015a6dce552",
+"signature-sha-1": "a159de951797140d09295c42401e58092f2c8fd9",
 "version": "6.3,5.11-2023.0.0.5:20230906T050309Z"
   },
   {
@@ -747074,6 +747074,6 @@
 ]
   },
   "_SIGNATURE": {
-"sha-1": "d7273c3ee40be8cd541f8993658d7f0412648005"
+"sha-1": "5007481277faa15f0386f02ad58a7b3511ee50a9"
   }
 }
$


-- 
+---+
| Marcel Telka   e-mail:   mar...@telka.sk  |
|homepage: http://telka.sk/ |
+---+

___
oi-dev mailing list
oi-dev@openindiana.org
https://openindiana.org/mailman/listinfo/oi-dev


Re: [oi-dev] couchdb-31 is broken

2024-02-22 Thread Marcel Telka
On Tue, Feb 20, 2024 at 09:58:02AM +0100, Marcel Telka wrote:
> the couchdb-31 package is broken at the ips server:
> 
> Errors were encountered while attempting to retrieve package or file data for
> the requested operation.
> Details follow:
> 
> pkg://openindiana.org/database/couchdb-31@3.1.2,5.11-2023.0.0.0:20230609T222502Z
>   Invalid content: manifest hash failure: fmri: 
> pkg://openindiana.org/database/couchdb-31@3.1.2,5.11-2023.0.0.0:20230609T222502Z
>  
> expected: 28185b5f27c3c0ce9ea1d8f129e0e5763f53e8ae computed: 
> b371cc90d6fd42c5bafa55f85afb183b59c23960. (happened 4 times)

The problem is in the publisher/openindiana.org/catalog/catalog.base.C
file.  However I do not know what is the proper way to fix it.
Maybe simple sed would be enough?

sed -i -e \

's/28185b5f27c3c0ce9ea1d8f129e0e5763f53e8ae/b371cc90d6fd42c5bafa55f85afb183b59c23960/'
 \
publisher/openindiana.org/catalog/catalog.base.C

-- 
+---+
| Marcel Telka   e-mail:   mar...@telka.sk  |
|homepage: http://telka.sk/ |
+---+

___
oi-dev mailing list
oi-dev@openindiana.org
https://openindiana.org/mailman/listinfo/oi-dev


Re: [oi-dev] couchdb-31 is broken

2024-02-21 Thread Marcel Telka
On Thu, Feb 22, 2024 at 12:04:51AM +0100, Marcel Telka wrote:
> It means that all files above are okay and the problem seems to be somewhere
> else.

It is a `pkgrepo verify` bug: https://www.illumos.org/issues/16317

-- 
+---+
| Marcel Telka   e-mail:   mar...@telka.sk  |
|homepage: http://telka.sk/ |
+---+

___
oi-dev mailing list
oi-dev@openindiana.org
https://openindiana.org/mailman/listinfo/oi-dev


Re: [oi-dev] couchdb-31 is broken

2024-02-21 Thread Marcel Telka
On Wed, Feb 21, 2024 at 08:27:20PM +0100, Marcel Telka wrote:
> On Tue, Feb 20, 2024 at 09:54:27PM +0100, Marcel Telka wrote:
> > The proper command is `pkgrepo verify -s $PATHTOREPO` (i.e. without
> > ending publisher/openindiana.org).
> 
> I'm running the `pkgrepo verify` on my local copy of the (official) ips repo
> and so far I found this:
> 
>ERROR: Invalid file hash: 
> cf6524e84f049ec7cb31c4c92a7fa26ca75c96be8e157fbfc974bc7bfa2f99a1
>  Package: 
> pkg://openindiana.org/library/mozjs-60@60.8.0,5.11-2022.0.0.0:20220201T120214Z
>  Repository path: 
> /data/openindiana-hipster/publisher/openindiana.org/file/07/07ef492f49d4c8c1bea8b3e0866fee55f55577f6
>Computed hash: 
> 7d5235341152834147cf4f1ab9faff37ea87a69b073fbc05fda67cc3b8cd0510
> Path: usr/lib/amd64/libjs_static.ajs
> 
> 
> pkg://openindiana.org/library/mozjs-60
> 61864/177684 -
>ERROR: Invalid file hash: 
> fbad1dc5c42245c1b5f2e98f245d71e805e4831433fd9e67328f95ef5ee05b57
>  Package: 
> pkg://openindiana.org/library/mozjs-60@60.8.0,5.11-2024.0.0.2:20240214T134119Z
>  Repository path: 
> /data/openindiana-hipster/publisher/openindiana.org/file/70/705f771bc438735598ad0fe6392de3eda4e1154a
>Computed hash: 
> bde010709020fe01decf06ca9603bf18e6cbae7b4a814f34fa16d4e24fe56e91
> Path: usr/lib/amd64/libjs_static.ajs
> 
> 
> pkg://openindiana.org/library/mozjs-60
> 61865/177684 \
>ERROR: Invalid file hash: 
> bfb4acb866f48aefe6c93a3ebe4f9ae97637a5e740693f31fe5904c1e2b64583
>  Package: 
> pkg://openindiana.org/library/mozjs-60@60.8.0,5.11-2023.0.0.1:20231103T152741Z
>  Repository path: 
> /data/openindiana-hipster/publisher/openindiana.org/file/b2/b2f40c59259c4ad119f4d01af675d5c63bf2fea6
>Computed hash: 
> f59c371196e96a5c9b69e483a521068f7165d1bc2cd72c530c1789988ab02b04
> Path: usr/lib/amd64/libjs_static.ajs
> 
> 
> pkg://openindiana.org/library/mozjs-60
> 61866/177684 |
>ERROR: Invalid file hash: 
> bfb4acb866f48aefe6c93a3ebe4f9ae97637a5e740693f31fe5904c1e2b64583
>  Package: 
> pkg://openindiana.org/library/mozjs-60@60.8.0,5.11-2023.0.0.1:20231103T151901Z
>  Repository path: 
> /data/openindiana-hipster/publisher/openindiana.org/file/b2/b2f40c59259c4ad119f4d01af675d5c63bf2fea6
>Computed hash: 
> f59c371196e96a5c9b69e483a521068f7165d1bc2cd72c530c1789988ab02b04
> Path: usr/lib/amd64/libjs_static.ajs
> 
> 
> And yes, those files seems to be corrupted in the repo, for example:
> 
> $ sha1sum 
> /data/openindiana-hipster/publisher/openindiana.org/file/70/705f771bc438735598ad0fe6392de3eda4e1154a
> 33471d5fa1a25ab740a84c720f5875147ee1c42d  
> /data/openindiana-hipster/publisher/openindiana.org/file/70/705f771bc438735598ad0fe6392de3eda4e1154a
> $
> 
> While the installed file is correct:
> 
> $ sha1sum /usr/lib/amd64/libjs_static.ajs
> 705f771bc438735598ad0fe6392de3eda4e1154a  /usr/lib/amd64/libjs_static.ajs
> $

I need to correct myself.  Those files are stored gzipped, so they
should be checked like this:

$ gzcat 
/data/openindiana-hipster/publisher/openindiana.org/file/70/7a6b63ecd35872b258d8a0852aede43d94e3
 | sha1sum
7a6b63ecd35872b258d8a0852aede43d94e3  -
$

It means that all files above are okay and the problem seems to be somewhere
else.

-- 
+---+
| Marcel Telka   e-mail:   mar...@telka.sk  |
|homepage: http://telka.sk/ |
+---+

___
oi-dev mailing list
oi-dev@openindiana.org
https://openindiana.org/mailman/listinfo/oi-dev


Re: [oi-dev] couchdb-31 is broken

2024-02-21 Thread Marcel Telka
On Tue, Feb 20, 2024 at 09:54:27PM +0100, Marcel Telka wrote:
> The proper command is `pkgrepo verify -s $PATHTOREPO` (i.e. without
> ending publisher/openindiana.org).

I'm running the `pkgrepo verify` on my local copy of the (official) ips repo
and so far I found this:

   ERROR: Invalid file hash: 
cf6524e84f049ec7cb31c4c92a7fa26ca75c96be8e157fbfc974bc7bfa2f99a1
 Package: 
pkg://openindiana.org/library/mozjs-60@60.8.0,5.11-2022.0.0.0:20220201T120214Z
 Repository path: 
/data/openindiana-hipster/publisher/openindiana.org/file/07/07ef492f49d4c8c1bea8b3e0866fee55f55577f6
   Computed hash: 
7d5235341152834147cf4f1ab9faff37ea87a69b073fbc05fda67cc3b8cd0510
Path: usr/lib/amd64/libjs_static.ajs


pkg://openindiana.org/library/mozjs-6061864/177684 -
   ERROR: Invalid file hash: 
fbad1dc5c42245c1b5f2e98f245d71e805e4831433fd9e67328f95ef5ee05b57
 Package: 
pkg://openindiana.org/library/mozjs-60@60.8.0,5.11-2024.0.0.2:20240214T134119Z
 Repository path: 
/data/openindiana-hipster/publisher/openindiana.org/file/70/705f771bc438735598ad0fe6392de3eda4e1154a
   Computed hash: 
bde010709020fe01decf06ca9603bf18e6cbae7b4a814f34fa16d4e24fe56e91
Path: usr/lib/amd64/libjs_static.ajs


pkg://openindiana.org/library/mozjs-6061865/177684 \
   ERROR: Invalid file hash: 
bfb4acb866f48aefe6c93a3ebe4f9ae97637a5e740693f31fe5904c1e2b64583
 Package: 
pkg://openindiana.org/library/mozjs-60@60.8.0,5.11-2023.0.0.1:20231103T152741Z
 Repository path: 
/data/openindiana-hipster/publisher/openindiana.org/file/b2/b2f40c59259c4ad119f4d01af675d5c63bf2fea6
   Computed hash: 
f59c371196e96a5c9b69e483a521068f7165d1bc2cd72c530c1789988ab02b04
Path: usr/lib/amd64/libjs_static.ajs


pkg://openindiana.org/library/mozjs-6061866/177684 |
   ERROR: Invalid file hash: 
bfb4acb866f48aefe6c93a3ebe4f9ae97637a5e740693f31fe5904c1e2b64583
 Package: 
pkg://openindiana.org/library/mozjs-60@60.8.0,5.11-2023.0.0.1:20231103T151901Z
 Repository path: 
/data/openindiana-hipster/publisher/openindiana.org/file/b2/b2f40c59259c4ad119f4d01af675d5c63bf2fea6
   Computed hash: 
f59c371196e96a5c9b69e483a521068f7165d1bc2cd72c530c1789988ab02b04
Path: usr/lib/amd64/libjs_static.ajs


And yes, those files seems to be corrupted in the repo, for example:

$ sha1sum 
/data/openindiana-hipster/publisher/openindiana.org/file/70/705f771bc438735598ad0fe6392de3eda4e1154a
33471d5fa1a25ab740a84c720f5875147ee1c42d  
/data/openindiana-hipster/publisher/openindiana.org/file/70/705f771bc438735598ad0fe6392de3eda4e1154a
$

While the installed file is correct:

$ sha1sum /usr/lib/amd64/libjs_static.ajs
705f771bc438735598ad0fe6392de3eda4e1154a  /usr/lib/amd64/libjs_static.ajs
$

Andreas please recover above three corrupted files from backup.

Thank you.


PS: Please note the verify progress is very slow here.

-- 
+---+
| Marcel Telka   e-mail:   mar...@telka.sk  |
|homepage: http://telka.sk/ |
+---+

___
oi-dev mailing list
oi-dev@openindiana.org
https://openindiana.org/mailman/listinfo/oi-dev


Re: [oi-dev] couchdb-31 is broken

2024-02-20 Thread Alan Coopersmith

On 2/20/24 12:28, Marcel Telka wrote:

Unfortunately, the verify will likely fail with the following error :-(:

# pkgrepo verify -s $PATHTOREPO/publisher/openindiana.org/
Initiating repository verification.
pkgrepo: The repository at '$PATHTOREPO/publisher/openindiana.org' is version 
'3'; only version 4 repositories are supported.
#


A version 4 repo is a container for multiple version 3 repos - that error
really means "you specified a version 3 repo that's inside a version 4
repo by going too far down the hierarchy" - just use $PATHTOREPO, not any
publisher subdirectory inside of it.

--
-Alan Coopersmith- alan.coopersm...@oracle.com
 Oracle Solaris Engineering - https://blogs.oracle.com/solaris


___
oi-dev mailing list
oi-dev@openindiana.org
https://openindiana.org/mailman/listinfo/oi-dev


Re: [oi-dev] couchdb-31 is broken

2024-02-20 Thread Marcel Telka
On Tue, Feb 20, 2024 at 09:28:50PM +0100, Marcel Telka wrote:
> On Tue, Feb 20, 2024 at 09:19:24PM +0100, Marcel Telka wrote:
> > On Tue, Feb 20, 2024 at 09:06:53PM +0100, Andreas Wacknitz via oi-dev wrote:
> > > Am 20.02.24 um 20:52 schrieb Bill Sommerfeld via oi-dev:
> > > > On 2/20/24 11:27, Andreas Wacknitz via oi-dev wrote:
> > > > > Am 20.02.24 um 18:49 schrieb Marcel Telka:
> > > > > > BTW, the issue above should be fixable by replacing a file (or two, 
> > > > > > or
> > > > > > so) from the backup.
> > > > > > 
> > > > > I have tried pkgrecv but it skipped the couchdb-31 package because 
> > > > > it's
> > > > > already there.
> > > > > How can I find the necessary files to copy over?
> > > > 
> > > > Start with the manifest file itself - that's what I believe it's
> > > > failing the checksum for.
> > > > 
> > > > Look inside the repo directory, in:
> > > > 
> > > > publisher/openindiana.org/pkg/database%2Fcouchdb-31
> > > > 
> > > > For
> > > > pkg://openindiana.org/database/couchdb-31@3.1.2,5.11-2023.0.0.0:20230609T222502Z
> > > > 
> > > > there should be a file in that directory named
> > > > 
> > > > 3.1.2%2C5.11-2023.0.0.0%3A20230609T222502Z
> > > > 
> > > > that contains the package manifest.
> > > > 
> > > > Once a manifest file is in place that has the right checksum it may or
> > > > may not complain about other missing files.
> > > I have checked both manfests (actual and old repo). They don't differ
> > > and seem to be complete and thus should be correct.
> > 
> > Then some suggestions:
> > pkgrepo verify
> 
> Unfortunately, the verify will likely fail with the following error :-(:
> 
> # pkgrepo verify -s $PATHTOREPO/publisher/openindiana.org/
> Initiating repository verification.
> pkgrepo: The repository at '$PATHTOREPO/publisher/openindiana.org' is version 
> '3'; only version 4 repositories are supported.
> #
> 
> But maybe there is older pkgrepo command on the server supporting ver 3?

The proper command is `pkgrepo verify -s $PATHTOREPO` (i.e. without
ending publisher/openindiana.org).

-- 
+---+
| Marcel Telka   e-mail:   mar...@telka.sk  |
|homepage: http://telka.sk/ |
+---+

___
oi-dev mailing list
oi-dev@openindiana.org
https://openindiana.org/mailman/listinfo/oi-dev


Re: [oi-dev] couchdb-31 is broken

2024-02-20 Thread Marcel Telka
On Tue, Feb 20, 2024 at 09:29:09PM +0100, Andreas Wacknitz via oi-dev wrote:
> Am 20.02.24 um 21:21 schrieb Bill Sommerfeld via oi-dev:
> > On 2/20/24 12:06, Andreas Wacknitz via oi-dev wrote:
> > > Am 20.02.24 um 20:52 schrieb Bill Sommerfeld via oi-dev:
> > > > On 2/20/24 11:27, Andreas Wacknitz via oi-dev wrote:
> > > > > Am 20.02.24 um 18:49 schrieb Marcel Telka:
> > > > > > BTW, the issue above should be fixable by replacing a file (or
> > > > > > two, or
> > > > > > so) from the backup.
> > > > > > 
> > > > > I have tried pkgrecv but it skipped the couchdb-31 package because
> > > > > it's
> > > > > already there.
> > > > > How can I find the necessary files to copy over?
> > > > 
> > > > Start with the manifest file itself - that's what I believe it's
> > > > failing the checksum for.
> > > > 
> > > > Look inside the repo directory, in:
> > > > 
> > > > publisher/openindiana.org/pkg/database%2Fcouchdb-31
> > > > 
> > > > For
> > > > pkg://openindiana.org/database/couchdb-31@3.1.2,5.11-2023.0.0.0:20230609T222502Z
> > > > 
> > > > 
> > > > there should be a file in that directory named
> > > > 
> > > > 3.1.2%2C5.11-2023.0.0.0%3A20230609T222502Z
> > > > 
> > > > that contains the package manifest.
> > > > 
> > > > Once a manifest file is in place that has the right checksum it may or
> > > > may not complain about other missing files.
> > > I have checked both manfests (actual and old repo). They don't differ
> > > and seem to be complete and thus should be correct.
> > 
> > Then maybe the hash for the manifest file in the repo's catalog is
> > wrong.  Not sure what the best way to correct it is, though.
> > 
> > Perhaps removing the broken package from the repo with pkgrepo remove
> > and then using pkgrecv to restore it it in from the old repo?
> Removing packages from the repo is a little bit tedious as the repo is
> served on an old zone and remove is not supported by its pkgrepo.
> So I have to copy several GB to another system, remove the package
> there, and copy everything back.

I suspect this operation corrupts the repo.  It is not the first time.
Similar corruptions happens regularly :-(.

-- 
+---+
| Marcel Telka   e-mail:   mar...@telka.sk  |
|homepage: http://telka.sk/ |
+---+

___
oi-dev mailing list
oi-dev@openindiana.org
https://openindiana.org/mailman/listinfo/oi-dev


Re: [oi-dev] couchdb-31 is broken

2024-02-20 Thread Andreas Wacknitz via oi-dev

Am 20.02.24 um 21:21 schrieb Bill Sommerfeld via oi-dev:

On 2/20/24 12:06, Andreas Wacknitz via oi-dev wrote:

Am 20.02.24 um 20:52 schrieb Bill Sommerfeld via oi-dev:

On 2/20/24 11:27, Andreas Wacknitz via oi-dev wrote:

Am 20.02.24 um 18:49 schrieb Marcel Telka:

BTW, the issue above should be fixable by replacing a file (or
two, or
so) from the backup.


I have tried pkgrecv but it skipped the couchdb-31 package because
it's
already there.
How can I find the necessary files to copy over?


Start with the manifest file itself - that's what I believe it's
failing the checksum for.

Look inside the repo directory, in:

publisher/openindiana.org/pkg/database%2Fcouchdb-31

For
pkg://openindiana.org/database/couchdb-31@3.1.2,5.11-2023.0.0.0:20230609T222502Z


there should be a file in that directory named

3.1.2%2C5.11-2023.0.0.0%3A20230609T222502Z

that contains the package manifest.

Once a manifest file is in place that has the right checksum it may or
may not complain about other missing files.

I have checked both manfests (actual and old repo). They don't differ
and seem to be complete and thus should be correct.


Then maybe the hash for the manifest file in the repo's catalog is
wrong.  Not sure what the best way to correct it is, though.

Perhaps removing the broken package from the repo with pkgrepo remove
and then using pkgrecv to restore it it in from the old repo?

Removing packages from the repo is a little bit tedious as the repo is
served on an old zone and remove is not supported by its pkgrepo.
So I have to copy several GB to another system, remove the package
there, and copy everything back.
Maybe I find the time for it at the weekend.

Andreas


    - Bill


___
oi-dev mailing list
oi-dev@openindiana.org
https://openindiana.org/mailman/listinfo/oi-dev



___
oi-dev mailing list
oi-dev@openindiana.org
https://openindiana.org/mailman/listinfo/oi-dev


Re: [oi-dev] couchdb-31 is broken

2024-02-20 Thread Marcel Telka
On Tue, Feb 20, 2024 at 09:19:24PM +0100, Marcel Telka wrote:
> On Tue, Feb 20, 2024 at 09:06:53PM +0100, Andreas Wacknitz via oi-dev wrote:
> > Am 20.02.24 um 20:52 schrieb Bill Sommerfeld via oi-dev:
> > > On 2/20/24 11:27, Andreas Wacknitz via oi-dev wrote:
> > > > Am 20.02.24 um 18:49 schrieb Marcel Telka:
> > > > > BTW, the issue above should be fixable by replacing a file (or two, or
> > > > > so) from the backup.
> > > > > 
> > > > I have tried pkgrecv but it skipped the couchdb-31 package because it's
> > > > already there.
> > > > How can I find the necessary files to copy over?
> > > 
> > > Start with the manifest file itself - that's what I believe it's
> > > failing the checksum for.
> > > 
> > > Look inside the repo directory, in:
> > > 
> > > publisher/openindiana.org/pkg/database%2Fcouchdb-31
> > > 
> > > For
> > > pkg://openindiana.org/database/couchdb-31@3.1.2,5.11-2023.0.0.0:20230609T222502Z
> > > 
> > > there should be a file in that directory named
> > > 
> > > 3.1.2%2C5.11-2023.0.0.0%3A20230609T222502Z
> > > 
> > > that contains the package manifest.
> > > 
> > > Once a manifest file is in place that has the right checksum it may or
> > > may not complain about other missing files.
> > I have checked both manfests (actual and old repo). They don't differ
> > and seem to be complete and thus should be correct.
> 
> Then some suggestions:
> pkgrepo verify

Unfortunately, the verify will likely fail with the following error :-(:

# pkgrepo verify -s $PATHTOREPO/publisher/openindiana.org/
Initiating repository verification.
pkgrepo: The repository at '$PATHTOREPO/publisher/openindiana.org' is version 
'3'; only version 4 repositories are supported.
#

But maybe there is older pkgrepo command on the server supporting ver 3?

-- 
+---+
| Marcel Telka   e-mail:   mar...@telka.sk  |
|homepage: http://telka.sk/ |
+---+

___
oi-dev mailing list
oi-dev@openindiana.org
https://openindiana.org/mailman/listinfo/oi-dev


Re: [oi-dev] couchdb-31 is broken

2024-02-20 Thread Bill Sommerfeld via oi-dev

On 2/20/24 12:06, Andreas Wacknitz via oi-dev wrote:

Am 20.02.24 um 20:52 schrieb Bill Sommerfeld via oi-dev:

On 2/20/24 11:27, Andreas Wacknitz via oi-dev wrote:

Am 20.02.24 um 18:49 schrieb Marcel Telka:

BTW, the issue above should be fixable by replacing a file (or two, or
so) from the backup.


I have tried pkgrecv but it skipped the couchdb-31 package because it's
already there.
How can I find the necessary files to copy over?


Start with the manifest file itself - that's what I believe it's
failing the checksum for.

Look inside the repo directory, in:

publisher/openindiana.org/pkg/database%2Fcouchdb-31

For
pkg://openindiana.org/database/couchdb-31@3.1.2,5.11-2023.0.0.0:20230609T222502Z

there should be a file in that directory named

3.1.2%2C5.11-2023.0.0.0%3A20230609T222502Z

that contains the package manifest.

Once a manifest file is in place that has the right checksum it may or
may not complain about other missing files.

I have checked both manfests (actual and old repo). They don't differ
and seem to be complete and thus should be correct.


Then maybe the hash for the manifest file in the repo's catalog is 
wrong.  Not sure what the best way to correct it is, though.


Perhaps removing the broken package from the repo with pkgrepo remove 
and then using pkgrecv to restore it it in from the old repo?


- Bill


___
oi-dev mailing list
oi-dev@openindiana.org
https://openindiana.org/mailman/listinfo/oi-dev


Re: [oi-dev] couchdb-31 is broken

2024-02-20 Thread Marcel Telka
On Tue, Feb 20, 2024 at 09:06:53PM +0100, Andreas Wacknitz via oi-dev wrote:
> Am 20.02.24 um 20:52 schrieb Bill Sommerfeld via oi-dev:
> > On 2/20/24 11:27, Andreas Wacknitz via oi-dev wrote:
> > > Am 20.02.24 um 18:49 schrieb Marcel Telka:
> > > > BTW, the issue above should be fixable by replacing a file (or two, or
> > > > so) from the backup.
> > > > 
> > > I have tried pkgrecv but it skipped the couchdb-31 package because it's
> > > already there.
> > > How can I find the necessary files to copy over?
> > 
> > Start with the manifest file itself - that's what I believe it's
> > failing the checksum for.
> > 
> > Look inside the repo directory, in:
> > 
> > publisher/openindiana.org/pkg/database%2Fcouchdb-31
> > 
> > For
> > pkg://openindiana.org/database/couchdb-31@3.1.2,5.11-2023.0.0.0:20230609T222502Z
> > 
> > there should be a file in that directory named
> > 
> > 3.1.2%2C5.11-2023.0.0.0%3A20230609T222502Z
> > 
> > that contains the package manifest.
> > 
> > Once a manifest file is in place that has the right checksum it may or
> > may not complain about other missing files.
> I have checked both manfests (actual and old repo). They don't differ
> and seem to be complete and thus should be correct.

Then some suggestions:
pkgrepo verify
pkgrepo fix
pkgrepo rebuild

-- 
+---+
| Marcel Telka   e-mail:   mar...@telka.sk  |
|homepage: http://telka.sk/ |
+---+

___
oi-dev mailing list
oi-dev@openindiana.org
https://openindiana.org/mailman/listinfo/oi-dev


Re: [oi-dev] couchdb-31 is broken

2024-02-20 Thread Andreas Wacknitz via oi-dev

Am 20.02.24 um 20:52 schrieb Bill Sommerfeld via oi-dev:

On 2/20/24 11:27, Andreas Wacknitz via oi-dev wrote:

Am 20.02.24 um 18:49 schrieb Marcel Telka:

BTW, the issue above should be fixable by replacing a file (or two, or
so) from the backup.


I have tried pkgrecv but it skipped the couchdb-31 package because it's
already there.
How can I find the necessary files to copy over?


Start with the manifest file itself - that's what I believe it's
failing the checksum for.

Look inside the repo directory, in:

publisher/openindiana.org/pkg/database%2Fcouchdb-31

For
pkg://openindiana.org/database/couchdb-31@3.1.2,5.11-2023.0.0.0:20230609T222502Z

there should be a file in that directory named

3.1.2%2C5.11-2023.0.0.0%3A20230609T222502Z

that contains the package manifest.

Once a manifest file is in place that has the right checksum it may or
may not complain about other missing files.

I have checked both manfests (actual and old repo). They don't differ
and seem to be complete and thus should be correct.


___
oi-dev mailing list
oi-dev@openindiana.org
https://openindiana.org/mailman/listinfo/oi-dev


Re: [oi-dev] couchdb-31 is broken

2024-02-20 Thread Bill Sommerfeld via oi-dev

On 2/20/24 11:27, Andreas Wacknitz via oi-dev wrote:

Am 20.02.24 um 18:49 schrieb Marcel Telka:

BTW, the issue above should be fixable by replacing a file (or two, or
so) from the backup.


I have tried pkgrecv but it skipped the couchdb-31 package because it's
already there.
How can I find the necessary files to copy over?


Start with the manifest file itself - that's what I believe it's failing the 
checksum for.

Look inside the repo directory, in:

publisher/openindiana.org/pkg/database%2Fcouchdb-31

For 
pkg://openindiana.org/database/couchdb-31@3.1.2,5.11-2023.0.0.0:20230609T222502Z

there should be a file in that directory named

3.1.2%2C5.11-2023.0.0.0%3A20230609T222502Z

that contains the package manifest.

Once a manifest file is in place that has the right checksum it may or may not 
complain about other missing files.



___
oi-dev mailing list
oi-dev@openindiana.org
https://openindiana.org/mailman/listinfo/oi-dev


Re: [oi-dev] couchdb-31 is broken

2024-02-20 Thread Andreas Wacknitz via oi-dev

Am 20.02.24 um 18:49 schrieb Marcel Telka:

On Tue, Feb 20, 2024 at 09:31:03AM -0800, Bill Sommerfeld via oi-dev wrote:

On 2/20/24 00:58, Marcel Telka wrote:

the couchdb-31 package is broken at the ips server:

Errors were encountered while attempting to retrieve package or file data for
the requested operation.
Details follow:

pkg://openindiana.org/database/couchdb-31@3.1.2,5.11-2023.0.0.0:20230609T222502Z
Invalid content: manifest hash failure: fmri: 
pkg://openindiana.org/database/couchdb-31@3.1.2,5.11-2023.0.0.0:20230609T222502Z
expected: 28185b5f27c3c0ce9ea1d8f129e0e5763f53e8ae computed: 
b371cc90d6fd42c5bafa55f85afb183b59c23960. (happened 4 times)


I tried rebuilding but it fails because our Erlang is too new:

==> config (compile)
ERROR: OTP release 24 does not match required regex 19|20|21|22
ERROR: compile failed while processing
/z/ws/oi-userland-alt/components/database/couchdb-31/build/amd64/src/config:
rebar_abort
make: *** [Makefile:125: couch] Error 1
gmake: *** [/z/ws/oi-userland-alt/make-rules/justmake.mk:62:
/z/ws/oi-userland-alt/components/database/couchdb-31/build/amd64/.built]
Error 2

We apparently need newer couchdb, since couchdb 3.1 is no longer
supported.  OTOH, we do not have any consumer for couchdb-31 in OI so we
could simply just obsolete it and do not bother packaging newer one.

BTW, the issue above should be fixable by replacing a file (or two, or
so) from the backup.


I have tried pkgrecv but it skipped the couchdb-31 package because it's
already there.
How can I find the necessary files to copy over?

___
oi-dev mailing list
oi-dev@openindiana.org
https://openindiana.org/mailman/listinfo/oi-dev


Re: [oi-dev] couchdb-31 is broken

2024-02-20 Thread Marcel Telka
On Tue, Feb 20, 2024 at 09:31:03AM -0800, Bill Sommerfeld via oi-dev wrote:
> On 2/20/24 00:58, Marcel Telka wrote:
> > the couchdb-31 package is broken at the ips server:
> > 
> > Errors were encountered while attempting to retrieve package or file data 
> > for
> > the requested operation.
> > Details follow:
> > 
> > pkg://openindiana.org/database/couchdb-31@3.1.2,5.11-2023.0.0.0:20230609T222502Z
> >Invalid content: manifest hash failure: fmri: 
> > pkg://openindiana.org/database/couchdb-31@3.1.2,5.11-2023.0.0.0:20230609T222502Z
> > expected: 28185b5f27c3c0ce9ea1d8f129e0e5763f53e8ae computed: 
> > b371cc90d6fd42c5bafa55f85afb183b59c23960. (happened 4 times)
> > 
> 
> I tried rebuilding but it fails because our Erlang is too new:
> 
> ==> config (compile)
> ERROR: OTP release 24 does not match required regex 19|20|21|22
> ERROR: compile failed while processing
> /z/ws/oi-userland-alt/components/database/couchdb-31/build/amd64/src/config:
> rebar_abort
> make: *** [Makefile:125: couch] Error 1
> gmake: *** [/z/ws/oi-userland-alt/make-rules/justmake.mk:62:
> /z/ws/oi-userland-alt/components/database/couchdb-31/build/amd64/.built]
> Error 2

We apparently need newer couchdb, since couchdb 3.1 is no longer
supported.  OTOH, we do not have any consumer for couchdb-31 in OI so we
could simply just obsolete it and do not bother packaging newer one.

BTW, the issue above should be fixable by replacing a file (or two, or
so) from the backup.

-- 
+---+
| Marcel Telka   e-mail:   mar...@telka.sk  |
|homepage: http://telka.sk/ |
+---+

___
oi-dev mailing list
oi-dev@openindiana.org
https://openindiana.org/mailman/listinfo/oi-dev


Re: [oi-dev] couchdb-31 is broken

2024-02-20 Thread Bill Sommerfeld via oi-dev

On 2/20/24 00:58, Marcel Telka wrote:

the couchdb-31 package is broken at the ips server:

Errors were encountered while attempting to retrieve package or file data for
the requested operation.
Details follow:

pkg://openindiana.org/database/couchdb-31@3.1.2,5.11-2023.0.0.0:20230609T222502Z
   Invalid content: manifest hash failure: fmri: 
pkg://openindiana.org/database/couchdb-31@3.1.2,5.11-2023.0.0.0:20230609T222502Z
expected: 28185b5f27c3c0ce9ea1d8f129e0e5763f53e8ae computed: 
b371cc90d6fd42c5bafa55f85afb183b59c23960. (happened 4 times)



I tried rebuilding but it fails because our Erlang is too new:

==> config (compile)
ERROR: OTP release 24 does not match required regex 19|20|21|22
ERROR: compile failed while processing 
/z/ws/oi-userland-alt/components/database/couchdb-31/build/amd64/src/config: 
rebar_abort

make: *** [Makefile:125: couch] Error 1
gmake: *** [/z/ws/oi-userland-alt/make-rules/justmake.mk:62: 
/z/ws/oi-userland-alt/components/database/couchdb-31/build/amd64/.built] 
Error 2


- Bill


___
oi-dev mailing list
oi-dev@openindiana.org
https://openindiana.org/mailman/listinfo/oi-dev


[oi-dev] couchdb-31 is broken

2024-02-20 Thread Marcel Telka
Hi,

the couchdb-31 package is broken at the ips server:

Errors were encountered while attempting to retrieve package or file data for
the requested operation.
Details follow:

pkg://openindiana.org/database/couchdb-31@3.1.2,5.11-2023.0.0.0:20230609T222502Z
  Invalid content: manifest hash failure: fmri: 
pkg://openindiana.org/database/couchdb-31@3.1.2,5.11-2023.0.0.0:20230609T222502Z
 
expected: 28185b5f27c3c0ce9ea1d8f129e0e5763f53e8ae computed: 
b371cc90d6fd42c5bafa55f85afb183b59c23960. (happened 4 times)

-- 
+---+
| Marcel Telka   e-mail:   mar...@telka.sk  |
|homepage: http://telka.sk/ |
+---+

___
oi-dev mailing list
oi-dev@openindiana.org
https://openindiana.org/mailman/listinfo/oi-dev