Re: Rollback to 1.9.3

2022-11-04 Thread Christopher
I don't know what could go wrong, so it's hard to say that it would be obvious. For what it's worth, if we can identify a performance bug, we can release a fix in a 1.10.3, so you can upgrade instead of downgrade. On Fri, Nov 4, 2022, 16:26 Logan Jones wrote: > Thanks all, > > We have a test

Re: Rollback to 1.9.3

2022-11-04 Thread Logan Jones
Thanks all, We have a test system that we could try rolling back. If something does break, will it be obvious? Dave, the ingest rates are slightly more spikey, but I think it's mostly because tservers are bouncing and the cluster is working to catch up. Nothing major jumps out as an increase in

Re: Rollback to 1.9.3

2022-11-04 Thread Christopher
I don't think it has any changes that would prevent rollback, but it's not a scenario that has been tested to my knowledge. On Fri, Nov 4, 2022, 16:15 Dave Marion wrote: > It's going to take some time to review the changes[1], but I don't see > changes in the default JVM sizes. I was wondering

Re: Rollback to 1.9.3

2022-11-04 Thread Dave Marion
It's going to take some time to review the changes[1], but I don't see changes in the default JVM sizes. I was wondering if maybe the issue is that it's running faster. You are loading the same amount of data, but is it going faster by chance? If so, you could be creating more garbage per unit

Re: Rollback to 1.9.3

2022-11-04 Thread Logan Jones
Yeah, our memory usage is drastically different since the upgrade. We are seeing spikes in heap utilization on tablet servers that weren't happening before the upgrade despite our ingest load being roughly the same. This increase in heap utilization seems to be causing long GC times. Those GC

Re: Rollback to 1.9.3

2022-11-04 Thread Dave Marion
Are you running into an error or some other issue that is making you think that you have to rollback? I don't know that rolling back has been tested. On Fri, Nov 4, 2022 at 3:40 PM Logan Jones wrote: > Hello: > > We recently upgraded from Accumulo 1.9.3 to 1.10.2. Is it safe to roll back > to

Rollback to 1.9.3

2022-11-04 Thread Logan Jones
Hello: We recently upgraded from Accumulo 1.9.3 to 1.10.2. Is it safe to roll back to Accumulo 1.9.3? Thanks in advance, - Logan