sorry for the noise... this is just a test to java-dev. I'm unable to post to java-user, and trying to re-subscribe didn't help. Full text of the bounce email below, in case anyone else is seeing this.
-Yonik Delivered-To: [EMAIL PROTECTED] Received: by 10.114.75.13 with SMTP id x13cs2248waa; Wed, 9 Jul 2008 08:52:57 -0700 (PDT) Received: by 10.143.168.4 with SMTP id v4mr2332544wfo.39.1215618777288; Wed, 09 Jul 2008 08:52:57 -0700 (PDT) Return-Path: <> Received: from spwiki.spsoftware.com ([61.17.14.87]) by mx.google.com with ESMTP id 28si10149607wfd.4.2008.07.09.08.52.51; Wed, 09 Jul 2008 08:52:57 -0700 (PDT) Received-SPF: neutral (google.com: 61.17.14.87 is neither permitted nor denied by best guess record for domain of spwiki.spsoftware.com) client-ip=61.17.14.87; Authentication-Results: mx.google.com; spf=neutral (google.com: 61.17.14.87 is neither permitted nor denied by best guess record for domain of spwiki.spsoftware.com) smtp.mail= Received: from localhost (localhost) by spwiki.spsoftware.com (8.14.2/8.14.2) id m69Fni50017713; Wed, 9 Jul 2008 21:19:44 +0530 Date: Wed, 9 Jul 2008 21:19:44 +0530 From: Mail Delivery Subsystem <[EMAIL PROTECTED]> Message-Id: <[EMAIL PROTECTED]> To: <[EMAIL PROTECTED]> MIME-Version: 1.0 Content-Type: multipart/report; report-type=delivery-status; boundary="m69Fni50017713.1215618584/spwiki.spsoftware.com" Subject: Returned mail: see transcript for details Auto-Submitted: auto-generated (failure) This is a MIME-encapsulated message --m69Fni50017713.1215618584/spwiki.spsoftware.com The original message was received at Wed, 9 Jul 2008 21:19:38 +0530 from localhost.localdomain [127.0.0.1] ----- The following addresses had permanent fatal errors ----- spsoft (reason: 550 5.1.1 User unknown) (expanded from: root) ----- Transcript of session follows ----- 550 5.1.1 spsoft... User unknown --m69Fni50017713.1215618584/spwiki.spsoftware.com Content-Type: message/delivery-status Reporting-MTA: dns; spwiki.spsoftware.com Received-From-MTA: DNS; localhost.localdomain Arrival-Date: Wed, 9 Jul 2008 21:19:38 +0530 Final-Recipient: RFC822; [EMAIL PROTECTED] X-Actual-Recipient: RFC822; [EMAIL PROTECTED] Action: failed Status: 5.1.1 Diagnostic-Code: X-Unix; 550 5.1.1 User unknown Last-Attempt-Date: Wed, 9 Jul 2008 21:19:44 +0530 --m69Fni50017713.1215618584/spwiki.spsoftware.com Content-Type: message/rfc822 Return-Path: <[EMAIL PROTECTED]> Received: from spwiki.spsoftware.com (localhost.localdomain [127.0.0.1]) by spwiki.spsoftware.com (8.14.2/8.14.2) with ESMTP id m69FnP51017710 for <[EMAIL PROTECTED]>; Wed, 9 Jul 2008 21:19:38 +0530 Received: from pop.spsoftindia.com by spwiki.spsoftware.com with POP3 (fetchmail-6.3.8) for <[EMAIL PROTECTED]> (multi-drop); Wed, 09 Jul 2008 21:19:38 +0530 (IST) Received: from mx05.mfg.onr.siteprotect.com (unknown [192.168.33.227]) by mf20.mfg.onr.chicago.hostway (Postfix) with ESMTP id 14DF224302C9 for <[EMAIL PROTECTED]>; Wed, 9 Jul 2008 10:51:24 -0500 (CDT) Received: from mail.apache.org (hermes.apache.org [140.211.11.2]) by mx05.mfg.onr.siteprotect.com (Postfix) with SMTP id A72CA55C08F for <[EMAIL PROTECTED]>; Wed, 9 Jul 2008 10:51:23 -0500 (CDT) Received: (qmail 12837 invoked by uid 500); 9 Jul 2008 15:51:16 -0000 Mailing-List: contact [EMAIL PROTECTED]; run by ezmlm Precedence: bulk List-Help: <mailto:[EMAIL PROTECTED]> List-Unsubscribe: <mailto:[EMAIL PROTECTED]> List-Post: <mailto:[EMAIL PROTECTED]> List-Id: <java-user.lucene.apache.org> Reply-To: [EMAIL PROTECTED] Delivered-To: mailing list [EMAIL PROTECTED] Received: (qmail 12826 invoked by uid 99); 9 Jul 2008 15:51:16 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 09 Jul 2008 08:51:16 -0700 X-ASF-Spam-Status: No, hits=-0.0 required=10.0 tests=SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of [EMAIL PROTECTED] designates 209.85.146.176 as permitted sender) Received: from [209.85.146.176] (HELO wa-out-1112.google.com) (209.85.146.176) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 09 Jul 2008 15:50:25 +0000 Received: by wa-out-1112.google.com with SMTP id l24so1896286waf.11 for <[EMAIL PROTECTED]>; Wed, 09 Jul 2008 08:50:47 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:message-id:date:from:sender :to:subject:in-reply-to:mime-version:content-type :content-transfer-encoding:content-disposition:references :x-google-sender-auth; bh=yHUDkAhyxx3RzkPEXm+GhBALbeHht91V/66plEV8gO8=; b=NH6ujX2hhaQvCqg7KCwR373EjikxQyKEzlXwkt5lz+j62yTknBLsCwT9IgJwnFpamn hGXFK603oY07kz7R6v+7aU3xDjQhHqSXgAPE9TuIgXjEeUI8Fsx5BGzGGBje7GcqjfRQ tFIbj0adZEirwETLEb9ZJrBklVUT0TGHlRI5c= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=message-id:date:from:sender:to:subject:in-reply-to:mime-version :content-type:content-transfer-encoding:content-disposition :references:x-google-sender-auth; b=HV/ayVpqHLaVUcEAqEREGNC585TvdCfPOnkxOyLWCFx4GkIaSxYa6wI2rPjxFz3ytp WCxeOpjGRJqhiEDXOUAoQUljIu/DCtZFMHvKeaJemhNc9fWqARg/I7ZSWpgJmxykC0Lz 71KtcK+tRFjKfT+bMVixuNFtrwPGcTm37hIpA= Received: by 10.115.92.2 with SMTP id u2mr9590818wal.33.1215618647304; Wed, 09 Jul 2008 08:50:47 -0700 (PDT) Received: by 10.114.75.13 with HTTP; Wed, 9 Jul 2008 08:50:47 -0700 (PDT) Message-ID: <[EMAIL PROTECTED]> Date: Wed, 9 Jul 2008 11:50:47 -0400 From: "Yonik Seeley" <[EMAIL PROTECTED]> Sender: [EMAIL PROTECTED] To: [EMAIL PROTECTED] Subject: Re: performance feedback In-Reply-To: <[EMAIL PROTECTED]> MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Content-Disposition: inline References: <[EMAIL PROTECTED]> X-Google-Sender-Auth: 997289174ea68835 X-Virus-Checked: Checked by ClamAV on apache.org Mail-Filter-Gateway: Found to be Virus Free X-Mail-Filter-Gateway-SpamDetectionEngine: NOT SPAM, MailFilterGateway Engine (Not Cached, Score=0, Score Required 5, autolearn=disabled) X-Mail-Filter-Gateway-From: [EMAIL PROTECTED] X-Mail-Filter-Gateway-To: [EMAIL PROTECTED] X-Spam-Status: No X-Fetchmail-Warning: recipient address [EMAIL PROTECTED] didn't match any local name X-Scanned-By: MIMEDefang 2.64 on 192.168.10.9 On Wed, Jul 9, 2008 at 11:35 AM, Beard, Brian <[EMAIL PROTECTED]> wrote: > I will try tweaking RAM, and check about autoCommit=false. It's on the > future agenda to multi-thread through the index writer. The indexing > time I quoted includes the document creation time which would definitely > improve with multi-threading. > > I'm doing batch updates of up to 1000 a pop, and closing and re-opening > the IndexWriter in between. autoCommit=false will definitely help, and there is normally no reason not to use it. Bigger batches (or a single batch) will also help indexing speed. A single IndexWriter session can now avoid copying stored fields on segment merges. -Yonik --------------------------------------------------------------------- To unsubscribe, e-mail: [EMAIL PROTECTED] For additional commands, e-mail: [EMAIL PROTECTED] --m69Fni50017713.1215618584/spwiki.spsoftware.com-- --------------------------------------------------------------------- To unsubscribe, e-mail: [EMAIL PROTECTED] For additional commands, e-mail: [EMAIL PROTECTED]