zero-day exploit security issue

2017-10-13 Thread Xie, Sean
Is there a tracking to address this issue for SOLR 6.6.x and 7.x? https://lucene.apache.org/solr/news.html#12-october-2017-please-secure-your-apache-solr-servers-since-a-zero-day-exploit-has-been-reported-on-a-public-mailing-list Sean Confidentiality Notice:: This email, including attachments,

HTTP HEAD method is gone?

2017-10-09 Thread Xie, Sean
After upgrading from 6.5.1 to 6.6.1, the http HEAD method requesting /favicon.ico returns the 404. Http GET method is still working as it returns 200 OK. Before the upgrading, both HEAD and GET give http 200 OK response. Any settings to adjust? Thanks Sean Confidentiality Notice:: This

Re: DocValues error when upgrading to 6.6.1 from 6.5

2017-10-03 Thread Xie, Sean
t "true" in the new schema. At least that's my guess Best, Erick On Thu, Sep 21, 2017 at 11:56 AM, Xie, Sean <sean@finra.org> wrote: > Hi, > > When I upgrade the existing SOLR from 6.5.1 to 6.6.1, I’m getting: > cannot cha

DocValues error when upgrading to 6.6.1 from 6.5

2017-09-21 Thread Xie, Sean
Hi, When I upgrade the existing SOLR from 6.5.1 to 6.6.1, I’m getting: cannot change DocValues type from SORTED to SORTED_SET for field “…..” During the upgrades, there is no change on schema and schema version (we are using schema version 1.5 so seDocValuesAsStored defaults are not taking into

Re: solr in memory testing

2017-08-08 Thread Xie, Sean
There is MiniSolrCloudCluster that you can use for testing. This is from solr-test-framework: https://github.com/apache/lucene-solr/tree/master/solr/test-framework. On 8/8/17, 7:54 AM, "Thaer Sammar" wrote: Hi, We are using solr 6.6, and we are looking for

RE: CDCR - how to deal with the transaction log files

2017-07-28 Thread Xie, Sean
You don't need to start cdcr on target cluster. Other steps are exactly what I did. After disable buffer on both target and source, the tlog files are purged according to the specs. -- Thank you Sean From: Patrick Hoeffel

Re: CDCR - how to deal with the transaction log files

2017-07-12 Thread Xie, Sean
Try run second data import or any other indexing jobs after the replication of the first data import is completed. My observation is during the replication period (when there is docs in queue), tlog clean up will not triggered. So when queue is 0, and submit second batch and monitor the queue

Re: Tlogs not being deleted/truncated

2017-07-11 Thread Xie, Sean
Please see my previous thread. I have to disable buffer on source cluster and a scheduled hard commit with scheduled logscheduler to make it work. -- Thank you Sean From: jmyatt > Date: Tuesday, Jul 11, 2017, 1:56 PM To: solr-user@lucene.apache.org

Re: CDCR - how to deal with the transaction log files

2017-07-10 Thread Xie, Sean
t's working for you proves otherwise . What version of Solr are you running? I'll try reproducing this problem at my end and see if it's a documentation gap or a bug. On Mon, Jul 10, 2017 at 7:15 PM, Xie, Sean <sean@finra.org> wrote: > Yes. Documents a

RE: ZooKeeper transaction logs

2017-07-10 Thread Xie, Sean
. Sean On 7/10/17, 6:43 AM, "Avi Steiner" <astei...@varonis.com> wrote: I did use this class using batch file (from Windows server), but it still does not remove anything. I sent number of snapshots to keep as 3, but I have more in my folder. -Original Message---

Re: CDCR - how to deal with the transaction log files

2017-07-10 Thread Xie, Sean
, the CdcrUpdateLogSynchroizer does not continue to do the clean if this value is -1. Sean On 7/10/17, 5:18 PM, "Varun Thacker" <va...@vthacker.in> wrote: After disabling the buffer are you still seeing documents being replicated to the target cluster(s) ? On Mon, Jul 10, 2017 at 1:

RE: CDCR - how to deal with the transaction log files

2017-07-10 Thread Xie, Sean
this same issue for months now, with version 6.2. No solution to date. -Original Message----- From: Xie, Sean [mailto:sean@finra.org] Sent: Sunday, July 09, 2017 9:41 PM To: solr-user@lucene.apache.org Subject: [EXTERNAL] Re: CDCR - how to deal with the trans

RE: CDCR - how to deal with the transaction log files

2017-07-10 Thread Xie, Sean
, 9:08 AM, "Michael McCarthy" <michael.mccar...@gm.com> wrote: We have been experiencing this same issue for months now, with version 6.2. No solution to date. -Original Message----- From: Xie, Sean [mailto:sean@finra.org] Sent: Sunday, July

Re: CDCR - how to deal with the transaction log files

2017-07-09 Thread Xie, Sean
. The updateLogSynchronizer already set at run at every 10 seconds, but seems it didn’t help. Any help? Thanks Sean On 7/8/17, 1:14 PM, "Xie, Sean" <sean@finra.org> wrote: I have monitored the CDCR process for a while, the updates are actively sent to the target without a problem. Howev

Re: ZooKeeper transaction logs

2017-07-09 Thread Xie, Sean
You can try run purge manually see if it is working: org.apache.zookeeper.server.PurgeTxnLog. And use a cron job to do clean up. On 7/9/17, 11:07 AM, "Avi Steiner" wrote: Hello I'm using Zookeeper 3.4.6 The ZK log data folder keeps growing with

Re: CDCR - how to deal with the transaction log files

2017-07-08 Thread Xie, Sean
luster will have a chance to catch up. If you don't have the remote DC online and do not intend to bring it online soon, you should turn CDCR off. Best, Erick On Fri, Jul 7, 2017 at 9:35 PM, Xie, Sean <sean@finra.org> wrote: > Once enable

CDCR - how to deal with the transaction log files

2017-07-07 Thread Xie, Sean
Once enabled CDCR, update log stores an unlimited number of entries. This is causing the tlog folder getting bigger and bigger, as well as the open files are growing. How can one reduce the number of open files and also to reduce the tlog files? If it’s not taken care properly, sooner or later

Re: Live update the zookeeper for SOLR

2017-06-29 Thread Xie, Sean
is pointing to the new IP. Any suggestion? Thanks Sean On 6/16/17, 3:34 PM, "Xie, Sean" <sean@finra.org> wrote: Solr is configured with the zookeeper ensemble as mentioned below. I will provide logs in a later time. From: Shawn Heisey <apa...@elyo

Re: Live update the zookeeper for SOLR

2017-06-16 Thread Xie, Sean
t;mailto:solr-user@lucene.apache.org>> Subject: [EXTERNAL] Re: Live update the zookeeper for SOLR On 6/16/2017 9:05 AM, Xie, Sean wrote: > Is there a way to keep SOLR alive when zookeeper instances (3 instance > ensemble) are rolling updated one at a time? It seems SOLR cluster use > one o

Live update the zookeeper for SOLR

2017-06-16 Thread Xie, Sean
Is there a way to keep SOLR alive when zookeeper instances (3 instance ensemble) are rolling updated one at a time? It seems SOLR cluster use one of the zookeeper instance and when the communication is broken in between, it won’t be able to reconnect to another zookeeper instance and keep

Re: How to do CDCR with basic auth?

2017-05-14 Thread Xie, Sean
? Thanks Sean On 5/14/17, 3:09 PM, "Xie, Sean" <sean@finra.org> wrote: So I have configured two clusters (source and target) with basic auth with solr:SolrRocks, but when starting the source node, log is showing it couldn’t read the authentication info.

How to do CDCR with basic auth?

2017-05-14 Thread Xie, Sean
So I have configured two clusters (source and target) with basic auth with solr:SolrRocks, but when starting the source node, log is showing it couldn’t read the authentication info. I already added the –Dbasicauth=solr:SolrRocks to the JVM of the solr instance. Not sure where else I can

Re: CDCR with SSL enabled

2017-05-02 Thread Xie, Sean
From the QUEUE action, the output is: 0 0 34741356 2 stopped On 5/2/17, 1:43 AM, "Xie, Sean" <sean@finra.org> wrote: Does CDCR support SSL encrypted SolrCloud? I have two clusters started with SSL, and CDCR setup instruction is followed on source and

CDCR with SSL enabled

2017-05-01 Thread Xie, Sean
Does CDCR support SSL encrypted SolrCloud? I have two clusters started with SSL, and CDCR setup instruction is followed on source and target. However, from the solr.log, I’m not able to see CDCR is occurring. Not sure what has been setup incorrectly. From the solr.log, I can’t find useful info

clusterstate.json not updated in zookeeper after creating the collection using API

2017-04-06 Thread Xie, Sean
Hi I created collection in a SolrCloud cluster (6.3.0), but found the clusterstate.json is not updated in zookeeper. It’s empty. I’m able to query cluster state using API: admin/collections?action=CLUSTERSTATUS=json Any reason why clusterstate.json is not updated? Thanks Sean

solr lost connection to zookeeper

2017-03-23 Thread Xie, Sean
When Solr lost the connection to Zookeeper, is there any way to have Solr reconnect to it after zookeeper is back online? Does Solr must be restarted to re-initiate the connection? Thanks Sean Confidentiality Notice:: This email, including attachments, may include non-public, proprietary,

Re: creating collection using collection API with SSL enabled SolrCloud

2017-02-09 Thread Xie, Sean
Have you configured the "urlScheme" cluster property (i.e. urlScheme=https) ? https://cwiki.apache.org/confluence/display/solr/Collections+API#CollectionsAPI-CLUSTERPROP:ClusterProperties Thanks Hrishikesh On Thu, Feb 9, 2017 at 8:23 AM, Xie

creating collection using collection API with SSL enabled SolrCloud

2017-02-09 Thread Xie, Sean
Hi All, When trying to create the collection using the API when there are a few replicas, I’m getting error because the call seems to trying to use HTTP for the replicas. https://IP_1:8983/solr/admin/collections?action=CREATE=My_COLLECTION=1=1=my_collection_conf Here is the error:

Re: CharacterUtils is removed from lucene-analyzers-common >6.1

2016-12-15 Thread Xie, Sean
Thanks for pointing out the java.lang.Character. I did find the existence of org.apache.lucene.analysis.CharacterUtils, but I was not able to find the needed methods in it. Sean On 12/15/16, 8:58 PM, "Shawn Heisey" <apa...@elyograg.org> wrote: On 12/15/2016 6:20 PM,

CharacterUtils is removed from lucene-analyzers-common >6.1

2016-12-15 Thread Xie, Sean
Dear user group, We have implemented some customized filter/tokenizer, that is using org.apache.lucene.analysis.util.CharacterUtils. After upgrading to Solr 6.3, the class is no longer available. Is there any reason the utility class is removed? What I had to do is copy the class