Re: accumulo upgrade from 2.0.1 to 2.1.1

2023-10-14 Thread Vincent Russell
initial startup if the > monitor starts faster than the manager, but refreshing the page should > make it work eventually if the manager is actually running. If that > doesn't happen eventually, I'm not sure what could be happening > without further troubleshooting. > &g

Re: accumulo upgrade from 2.0.1 to 2.1.1

2023-10-12 Thread Vincent Russell
ng to run more than one (I could see an argument for both). It > would be weird if one incorrectly reported "Master[now Manager] is > down" because another monitor was running, though. I would expect the > 2.1 behavior you described over that 2.0 behavior. > > On Mon, Sep

Re: accumulo upgrade from 2.0.1 to 2.1.1

2023-09-25 Thread Vincent Russell
to start. > > To troubleshoot, I would compare your log4j config with what we ship > in the 2.1 tarball and also check to see if you've done any log4j > config overrides in the system properties or environment variables > that control log4j. > > On Tue, Sep 12, 2023 at 8:10 PM

Re: accumulo upgrade from 2.0.1 to 2.1.1

2023-09-12 Thread Vincent Russell
test instance first, just to practice. > If you run into a specific problem doing that, we could probably offer > more specific insight, having probably seen it before. > > > On Wed, Aug 30, 2023 at 4:50 PM Vincent Russell > wrote: > > > > Thank you Christopher. > >

Re: accumulo upgrade from 2.0.1 to 2.1.1

2023-08-30 Thread Vincent Russell
same code. > > On Thu, Aug 24, 2023 at 11:04 AM Vincent Russell > wrote: > > > > Also the link to: > > > > https://accumulo.apache.org/docs/2.x/troubleshooting/ZooKeeper#ACLs > > > > is not resolving. > > > > What needs to be done at this st

Re: accumulo upgrade from 2.0.1 to 2.1.1

2023-08-24 Thread Vincent Russell
Also the link to: https://accumulo.apache.org/docs/2.x/troubleshooting/ZooKeeper#ACLs is not resolving. What needs to be done at this step? Thanks, Vincent On Thu, Aug 24, 2023 at 10:36 AM Vincent Russell wrote: > Hello, > > I'm practicing going to the upgrade instructions

accumulo upgrade from 2.0.1 to 2.1.1

2023-08-24 Thread Vincent Russell
Hello, I'm practicing going to the upgrade instructions from 2.0.1 to 2.1.1 and I wanted to confirm that the zoo-dump command is run via the accumulo-util command and not via accumulo. The instructions say: $ACCUMULO_HOME/bin/accumulo dump-zoo --xml --root /accumulo | tee PATH_TO_SNAPSHOT Thank

Re: jdk 17 and accumulo testing

2023-05-02 Thread Vincent Russell
Christopher, I was able to verify that tests that previously failed related to this issue now pass.Other tests are failing due to api changes, but I think that's another issue. Thanks, Vincent On Fri, Apr 28, 2023 at 9:27 AM Vincent Russell wrote: > Thank you for the response Chr

Re: jdk 17 and accumulo testing

2023-04-28 Thread Vincent Russell
https://github.com/apache/accumulo/pull/3134 actually fixes your > issue. Have you tried a recent snapshot version to see if the problem > is fixed for you? I looked for, but didn't see, any comment from you > about that. > > On Fri, Apr 28, 2023 at 7:07 AM Vincent Russell >

Re: jdk 17 and accumulo testing

2023-04-28 Thread Vincent Russell
Hello, Just checking in on if there is a timeframe for 2.1.1. This has been delaying our upgrade to jdk 17 for almost 5 month now. Thanks, Vincent On Fri, Dec 30, 2022, 12:57 PM Vincent Russell wrote: > Ok.. Thank you for the update. > > On Fri, Dec 30, 2022 at 11:55 AM Christoph

Re: slow ingest speeds

2023-03-21 Thread Vincent Russell
I just noticed that swappiness is set to 60 at the slow site and 1 at the other site. I am going to work with the system administrators to change this as soon as possible. Thanks, On Thu, Mar 16, 2023 at 9:34 AM Vincent Russell wrote: > Thank you Dave. I didn't take look at the s

Re: slow ingest speeds

2023-03-16 Thread Vincent Russell
re collocated instead of spread out? > > On Wed, Mar 15, 2023 at 7:01 PM Vincent Russell > > wrote: > > > I stopped the two data nodes and it had no effect. > > > > Thanks, > > > > On Wed, Mar 15, 2023 at 6:53 PM Vincent Russell < > vincent.ru

Re: slow ingest speeds

2023-03-15 Thread Vincent Russell
I stopped the two data nodes and it had no effect. Thanks, On Wed, Mar 15, 2023 at 6:53 PM Vincent Russell wrote: > Yes. We have the hdfs rack-aware set up to divide the blocks equally. > And according to the name node http page it doesn't look like those nodes > have a much hi

Re: slow ingest speeds

2023-03-15 Thread Vincent Russell
across the hosts? > > On Wed, Mar 15, 2023 at 5:52 PM Vincent Russell > > wrote: > > > Hello, > > > > I am using accumulo 2.0.1 with hadoop 3.3.1. > > > > I have two identical clusters with 28 tservers. > > > > I have writers on both cluster

slow ingest speeds

2023-03-15 Thread Vincent Russell
Hello, I am using accumulo 2.0.1 with hadoop 3.3.1. I have two identical clusters with 28 tservers. I have writers on both clusters which are set with 10 batch writers with a max memory of 50m. However, one server is ingesting 10x faster than the other. Is there anything I should check for? I

Re: jdk 17 and accumulo testing

2022-12-30 Thread Vincent Russell
> > Version 2.1.1 will be released with bug fixes and this fix (when finished > > and merged) is planned to be included as part of that release. I don't > know > > the exact time frame yet though. > > > > On Fri, Dec 30, 2022 at 11:04 AM Vincent Russell < >

Re: jdk 17 and accumulo testing

2022-12-30 Thread Vincent Russell
Hello, Are there any plans to release an accumulo 2.1 patch to fix this issue? Thanks, On Sat, Dec 17, 2022 at 7:36 PM Vincent Russell wrote: > No worries. I'm glad I was able to help in some small way. > > Thank you for fixing the issue. > > On Sat, Dec 17, 2022 at

Re: jdk 17 and accumulo testing

2022-12-17 Thread Vincent Russell
opher wrote: > > > >> I don't think it's intentional. This might be the source of the problem. > >> > >> On Thu, Dec 15, 2022 at 3:39 PM Vincent Russell > >> wrote: > >> > > >> > Also in TserverUtils:270, when the TNonblo

Re: jdk 17 and accumulo testing

2022-12-15 Thread Vincent Russell
Also in TserverUtils:270, when the TNonblockingServerSocket is created it looks like it ends up using the default frame size. I am not sure if this is intentional or not. On Thu, Dec 15, 2022 at 3:26 PM Vincent Russell wrote: > Christopher, > > I am not sure if this issue is related t

Re: jdk 17 and accumulo testing

2022-12-15 Thread Vincent Russell
should be using 1G: 2022-09-01 16:59:41 INFO [org.apache.accumulo.tserver.TabletServer] ServerUtil:124 - general.server.message.size.max = 1G Thanks, Vincent On Thu, Dec 15, 2022 at 12:26 PM Vincent Russell wrote: > > > I had to make a stack trace with hacking together a remote debug

Re: jdk 17 and accumulo testing

2022-12-15 Thread Vincent Russell
mostly in > libthrift itself, that does that. It's a bit tricky to track down the > one causing this particular issue. If you have a full stack trace, it > could help. > > Also, this might be the same issue seen reported in > https://github.com/apache/accumulo/issues/3042 >

Re: jdk 17 and accumulo testing

2022-12-14 Thread Vincent Russell
appear to work fine. Any idea what the issue might be? Thank you, Vincent On Tue, Dec 13, 2022 at 4:43 PM Vincent Russell wrote: > Thank you both for your responses. > > We are using an event store library from a sister project that was written > for accumulo 1.10., which I have alre

Re: jdk 17 and accumulo testing

2022-12-13 Thread Vincent Russell
in the future > (except > > during major versions). We can try and find where things might have > moved, > > but a class may have been split into multiple pieces. If you could > provide > > class and method, that would be easier. > > > > On Tue, Dec 13, 2022 a

Re: jdk 17 and accumulo testing

2022-12-13 Thread Vincent Russell
others. Thanks, Vincent On Fri, Dec 9, 2022 at 9:02 AM Vincent Russell wrote: > I mean Christopher. > > Thanks again. > > On Fri, Dec 9, 2022 at 9:01 AM Vincent Russell > wrote: > >> Thank you Chris. >> >> Will will upgrade to Accumulo 2.1 and ZooKeeper 3.

Re: jdk 17 and accumulo testing

2022-12-09 Thread Vincent Russell
I mean Christopher. Thanks again. On Fri, Dec 9, 2022 at 9:01 AM Vincent Russell wrote: > Thank you Chris. > > Will will upgrade to Accumulo 2.1 and ZooKeeper 3.7 or later as soon as > possible. > > On Thu, Dec 8, 2022 at 8:44 PM Christopher wrote: > >> Hi Vincent,

Re: jdk 17 and accumulo testing

2022-12-09 Thread Vincent Russell
d JDK 17 support yet. So, > MiniAccumuloCluster seems to work with JDK 17, as does Accumulo and ZK > 3.8, but I don't think a full Hadoop cluster would (yet). > > On Thu, Dec 8, 2022 at 12:28 PM Vincent Russell > wrote: > > > > Hello, > > > > We are curr

jdk 17 and accumulo testing

2022-12-08 Thread Vincent Russell
Hello, We are currently using accumulo 2.0.1. We are in the process of upgrading our source code to use jdk 17 however we are running into some problems with our tests and the MiniAccumuloCluster. One of our developer encountered the following issues: 1. The MiniAccumumluoClusterImpl._exec i

forceably failable master node

2022-10-11 Thread Vincent Russell
Hello, We are running accumulo 2.0.1 with high availability? Is there a way to force failover of the accumulo master to the standby node? Thanks, Vincent

Re: Data-local map tasks

2022-05-05 Thread Vincent Russell
> < > https://hadoop.apache.org/docs/r2.6.3/api/src-html/org/apache/hadoop/mapreduce/lib/output/MultipleOutputs.html#line.175 > > > > > On Thu, May 5, 2022 at 9:46 AM Vincent Russell > wrote: > > > Thank you for the reply mike. > > > > These are the counters t

Re: Data-local map tasks

2022-05-05 Thread Vincent Russell
ing in the Job? > > On Wed, May 4, 2022 at 8:44 PM Vincent Russell > wrote: > > > Hello, > > > > I am using map reduce with accumulo 2.0.1 and hadoop 3.3.1. After our > map > > reduce jobs complete we take a look at the counters and the > Data-local-ma

Data-local map tasks

2022-05-04 Thread Vincent Russell
Hello, I am using map reduce with accumulo 2.0.1 and hadoop 3.3.1. After our map reduce jobs complete we take a look at the counters and the Data-local-map tasks and rack-local map tasks are both equal to 0. Do we probably have something misconfigured or is this expected? Or can this count not

Re: Major compactions during map reduce

2022-04-19 Thread Vincent Russell
> but otherwise, I wouldn't expect them to. > > Are you seeing any error messages anywhere? > > On Mon, Apr 18, 2022, 15:23 Vincent Russell > wrote: > > > Hi Dave, > > > > Yes we are using the new MapReduce API, but we are not setting any > > settings

Re: Major compactions during map reduce

2022-04-18 Thread Vincent Russell
lit > could. Are you using the new MapReduce API introduced in 2.0? Are you > setting it to use an isolated scan? > > On Mon, Apr 18, 2022 at 3:01 PM Vincent Russell > > wrote: > > > Hello All, > > > > Could major compactions that occur while a map reduce job is runn

Major compactions during map reduce

2022-04-18 Thread Vincent Russell
Hello All, Could major compactions that occur while a map reduce job is running cause the map reduce job to miss records because rows have been moved to a different tablet? How does this work? I'm using accumulo 2.0.1 Thank you, Vincent

Re: specifiy hostname to bind to for accumulo servers

2022-01-25 Thread Vincent Russell
; you should ensure that whatever name service you use (typically DNS/rDNS) > is configured so that any address resolved locally is consistent with how > that server's address resolves elsewhere on the same cluster. > > > On Mon, Jan 24, 2022 at 10:09 AM Vincent Russell < > v

specifiy hostname to bind to for accumulo servers

2022-01-24 Thread Vincent Russell
Hello, Is there any way to specify what hostname an accumulo server should bind to when it starts up? For instance with hadoop you can specify: dfs.namenode.rpc-address or dfs.datanode.http.address? We have some servers with multiple interfaces and this is causing issues. Thank you, Vincent

Re: Accumulo 2.0.1 init with hdfs running with SSL

2021-12-15 Thread Vincent Russell
figuration properly passed to it. That interface is not in the > public API and should avoid being used. > > On Wed, Dec 15, 2021 at 10:45 AM Dave Marion wrote: > > > Is that datanode configured correctly? I wonder why it's excluded. > > > > On Wed, De

Re: Accumulo 2.0.1 init with hdfs running with SSL

2021-12-15 Thread Vincent Russell
eatly appreciated. Thanks, On Tue, Dec 14, 2021 at 2:23 PM Vincent Russell wrote: > Thanks Chris. > > Yes I do get an error (I can't remember now because it's on a separate > computer) during the init and I get a MagicNumber exception on the datanode > during this pro

Re: Accumulo 2.0.1 init with hdfs running with SSL

2021-12-14 Thread Vincent Russell
n the class path. So, it looks like it should work. > Have you tried it? Did you get an error? > > > On Tue, Dec 14, 2021 at 1:54 PM Vincent Russell > wrote: > > > > Thank you Mike, > > > > but it appears that accumulo uses those settings to connect acc

Re: Accumulo 2.0.1 init with hdfs running with SSL

2021-12-14 Thread Vincent Russell
efix. > https://accumulo.apache.org/docs/2.x/configuration/client-properties > This blog post from a few years ago may help: > > https://accumulo.apache.org/blog/2014/09/02/generating-keystores-for-configuring-accumulo-with-ssl.html > > On Tue, Dec 14, 2021 at 9:58 AM Vincent Russell > > wr

Accumulo 2.0.1 init with hdfs running with SSL

2021-12-14 Thread Vincent Russell
Hello, I am trying to init a test accumulo instance with an hdfs running with SSL.Is this possible? I am looking at the code and it doesn't look like this is possible. The Initialize class just instantiates a Hadoop config and passes that into the VolumeManager without sending over any hadoo

Accumulo 2.0.1 and zookeeper 3.5+

2021-10-29 Thread Vincent Russell
Hello, I'm interested in setting up an accumulo cluster with ssl set up with zookeeper, hadoop and accumulo. It looks like accumulo 2.0.1 is set up to work with zookeeper 3.4.14, but it looks like I would need zookeeper 3.5+ in order to get this to work with zookeeper at least. Is that so or am

1.10 <-> 2.0 shim

2021-10-18 Thread Vincent Russell
Hello, I am interested in using an accumulo query and storage library that was written against accumulo version 1.10 and I am interested in using it with accumulo 2.0. Is there a shim that exists that would allow the library to be used for both versions that could be activated at compile time via

Re: accumulo-docker

2020-04-20 Thread Vincent Russell
Most projects, that I've seen anyway, keep their Dockerfile in the same repository as their source code so that it's versioned with the software that its loading. Please consider doing this for accumulo. Thanks, Vincent On Mon, Apr 20, 2020 at 8:05 AM karthick rn wrote: > Hi Christopher, > >

Re: MockAccumulo with MiniMRCluster

2015-04-06 Thread Vincent Russell
; > On Mon, Apr 6, 2015 at 5:59 AM, Vincent Russell > > wrote: > > > Does anyone have any suggestions or maybe a solution for getting > MapReduce > > to work with the MiniMRCluster and MockAccumulo (Maybe some type of > > client/server solution with thrift and zooke

MockAccumulo with MiniMRCluster

2015-04-06 Thread Vincent Russell
Does anyone have any suggestions or maybe a solution for getting MapReduce to work with the MiniMRCluster and MockAccumulo (Maybe some type of client/server solution with thrift and zookeeper?). I am already using the MiniDFSCluster and MiniMRCluster and I just don't want to add the MiniAccumuloCl

Re: svn commit: r1484644 - in /accumulo/branches/1.5: ./ mini/ mini/src/ mini/src/main/ mini/src/main/java/ mini/src/main/java/org/ mini/src/main/java/org/apache/ mini/src/main/java/org/apache/accumul

2013-05-21 Thread Vincent Russell
Corey, You should try git-svn. That should give you an interface that you are used to. On Tue, May 21, 2013 at 10:53 AM, Corey Nolet wrote: > Ill revert this and redo. Still getting used to svn. > Corey, > > It seems these move were not done is such a way that history was preserved. > 'svn mo

Re: New committer!

2013-05-12 Thread Vincent Russell
Corey has been an accumulo user for several years now. He's a great addition to the committer team. Congrats Corey! On Sun, May 12, 2013 at 10:57 AM, John Vines wrote: > Welcome aboard good sir! > > Sent from my phone, please pardon the typos and brevity. > On May 12, 2013 8:52 AM, "Drew Farris

Re: Command-Line Options to 'accumulo init'?

2012-08-27 Thread Vincent Russell
You can also write an expect script to achieve this. On Mon, Aug 27, 2012 at 9:55 PM, Josh Elser wrote: > AFAIK, there are no CLI options for this currently. You might be able to > pipe in your instance name and passwd (two times) to get around it. > > e.g. `echo accumulo secret secret | accumul