Re: SolrCloud create_collection not uploading configs to zookeeper

2016-07-27 Thread Nirav Patel
Got it. That make sense.

Thanks

On Wed, Jul 27, 2016 at 9:08 AM, Shawn Heisey <apa...@elyograg.org> wrote:

> On 7/26/2016 5:30 PM, Nirav Patel wrote:
> > OK, I can see '/configs' directory in Solr UI and under that I can see
> > configuration fo my 'test' collection. BUt this all seemed to be
> > disjointed information. Doc is definitely not clear. And what that
> > Tree represent anyway where;s information for that. I would ideally
> > put link to that document.
>
> You won't find a literal directory named "/configs" anywhere.
>
> This is a path within the zookeeper *database*.  Zookeeper presents the
> database as something that looks like a filesystem, so it's easier for
> programmers to conceptualize when they are writing programs that use
> zookeeper ... but it is still a database, not a literal filesystem.
>
> Thanks,
> Shawn
>
>

-- 


[image: What's New with Xactly] <http://www.xactlycorp.com/email-click/>

<https://www.nyse.com/quote/XNYS:XTLY>  [image: LinkedIn] 
<https://www.linkedin.com/company/xactly-corporation>  [image: Twitter] 
<https://twitter.com/Xactly>  [image: Facebook] 
<https://www.facebook.com/XactlyCorp>  [image: YouTube] 
<http://www.youtube.com/xactlycorporation>


Uploading all files under directory with no extension

2016-07-27 Thread Nirav Patel
I tried using post tool with following parameters. Looks like its not
uploading files if it doesn't have known extension.


./bin/post -c mycol1  -params "separator=%09" -type text/tsv -filetypes tsv
 /dev/datascience/pod1/population/baseline/

/usr/java/jdk1.8.0_102//bin/java -classpath
/home/xactly/solr-6.1.0/dist/solr-core-6.1.0.jar -Dauto=yes -Dc=bonusOrder
-Ddata=files -Drecursive=yes org.apache.solr.util.SimplePostTool
/mapr/insights/datascience/rulec/prdx/bonusOrderType/baseline/
SimplePostTool version 5.0.0
Posting files to [base] url http://localhost:8983/solr/mycol1/update...
Entering auto mode. File endings considered are
xml,json,jsonl,csv,pdf,doc,docx,ppt,pptx,xls,xlsx,odt,odp,ods,ott,otp,ots,rtf,htm,html,txt,log
Entering recursive mode, max depth=999, delay=0s
Indexing directory /dev/datascience/pod1/population/baseline/ (0 files,
depth=0)
0 files indexed.
COMMITting Solr index changes to http://localhost:8983/solr/mycol1/update...
Time spent: 0:00:00.056


All the files I have under  /dev/datascience/pod1/population/baseline/
having same structure and they all are tsvs. Only thing is they don't have
any extension.

Is there a way to upload them using cli.

Thanks

-- 


[image: What's New with Xactly] 

  [image: LinkedIn] 
  [image: Twitter] 
  [image: Facebook] 
  [image: YouTube] 



Re: SolrCloud create_collection not uploading configs to zookeeper

2016-07-26 Thread Nirav Patel
OK, I can see '/configs' directory in Solr UI and under that I can see
configuration fo my 'test' collection. BUt this all seemed to be disjointed
information. Doc is definitely not clear.
And what that Tree represent anyway where;s information for that. I would
ideally put link to that document.

Also where are those configs file on filesystem anyway?

On Tue, Jul 26, 2016 at 4:24 PM, Nirav Patel <npa...@xactlycorp.com> wrote:

> Hi Erick,
>
> I did read that paragraph. It says: First, if you don't provide the -d or
> -n options, then the default configuration
> ($SOLR_HOME/server/solr/configsets/data_driven_schema_configs/conf) is
> uploaded to ZooKeeper using the same name as the collection. For example,
> the following command will result in the data_driven_schema_configs
> configuration being uploaded to /configs/contacts in ZooKeeper:  bin/solr
> create -c contacts.
>
> Here's what I did :
>
> /bin/solr create_collection -c test
> INFO  - 2016-07-26 15:59:15.408;
> org.apache.solr.client.solrj.impl.CloudSolrClient; Final constructed zkHost
> string: 10.250.72.130:2181
>
> Connecting to ZooKeeper at 10.250.72.130:2181 ...
> Uploading
> /home/np/solr-6.1.0/server/solr/configsets/data_driven_schema_configs/conf
> for config test to ZooKeeper at 10.250.72.130:2181
>
> Creating new collection 'test' using command:
>
> http://localhost:8983/solr/admin/collections?action=CREATE=test=1=1=1=test
>
> {
>   "responseHeader":{
> "status":0,
> "QTime":5006},
>   "success":{"10.250.70.120:8983_solr":{
>   "responseHeader":{
> "status":0,
> "QTime":3667},
>   "core":"test_shard1_replica1"}}}
>
>
> So according to doc I should see data_driven_schema_configs being uploaded
> to  ZooKeeper under "/configs/test" directory. It seems like doc is
> mentioning a literal "configs" directory. BUt I can't find that under my
> zookeeper installation.
>
>
> On Tue, Jul 26, 2016 at 4:18 PM, Erick Erickson <erickerick...@gmail.com>
> wrote:
>
>> From the doc you referenced where it outlines the parameters for the
>> create command:
>>
>> -d  : The configuration directory. This defaults to
>> data_driven_schema_configs.
>>
>> You should also review the linked section about what configuration
>> directories are all about:
>>
>> https://cwiki.apache.org/confluence/display/solr/Solr+Start+Script+Reference#SolrStartScriptReference-ConfigurationDirectoriesandSolrCloud
>>
>> Best,
>> Erick
>>
>>
>> On Tue, Jul 26, 2016 at 4:11 PM, Nirav Patel <npa...@xactlycorp.com>
>> wrote:
>> > Hi,
>> >
>> > I have 2 nodes solr cluster with 1 node standalone zookeeper.
>> >
>> > I tried following from following doc to create collection:
>> >
>> > bin/solr create -c contacts.
>> >
>> > According to doc should upload config date into /configs/contacts in
>> > ZooKeeper. But I can't find any configs directory under zookeeper.
>> >
>> >
>> https://cwiki.apache.org/confluence/display/solr/Solr+Start+Script+Reference#SolrStartScriptReference-Create
>> >
>> > Where did config files go? I want to modify them using vi and then
>> upload
>> > it again. But first I want to locate them on filesystem. According to
>> doc
>> > on "Configuration Directories and SolrCloud" it should be under zookeepr
>> > but it's not!
>> >
>> > Thanks
>> >
>> > --
>> >
>> >
>> > [image: What's New with Xactly] <http://www.xactlycorp.com/email-click/
>> >
>> >
>> > <https://www.nyse.com/quote/XNYS:XTLY>  [image: LinkedIn]
>> > <https://www.linkedin.com/company/xactly-corporation>  [image: Twitter]
>> > <https://twitter.com/Xactly>  [image: Facebook]
>> > <https://www.facebook.com/XactlyCorp>  [image: YouTube]
>> > <http://www.youtube.com/xactlycorporation>
>>
>
>

-- 


[image: What's New with Xactly] <http://www.xactlycorp.com/email-click/>

<https://www.nyse.com/quote/XNYS:XTLY>  [image: LinkedIn] 
<https://www.linkedin.com/company/xactly-corporation>  [image: Twitter] 
<https://twitter.com/Xactly>  [image: Facebook] 
<https://www.facebook.com/XactlyCorp>  [image: YouTube] 
<http://www.youtube.com/xactlycorporation>


Re: SolrCloud create_collection not uploading configs to zookeeper

2016-07-26 Thread Nirav Patel
Hi Erick,

I did read that paragraph. It says: First, if you don't provide the -d or
-n options, then the default configuration
($SOLR_HOME/server/solr/configsets/data_driven_schema_configs/conf) is
uploaded to ZooKeeper using the same name as the collection. For example,
the following command will result in the data_driven_schema_configs
configuration being uploaded to /configs/contacts in ZooKeeper:  bin/solr
create -c contacts.

Here's what I did :

/bin/solr create_collection -c test
INFO  - 2016-07-26 15:59:15.408;
org.apache.solr.client.solrj.impl.CloudSolrClient; Final constructed zkHost
string: 10.250.72.130:2181

Connecting to ZooKeeper at 10.250.72.130:2181 ...
Uploading
/home/np/solr-6.1.0/server/solr/configsets/data_driven_schema_configs/conf
for config test to ZooKeeper at 10.250.72.130:2181

Creating new collection 'test' using command:
http://localhost:8983/solr/admin/collections?action=CREATE=test=1=1=1=test

{
  "responseHeader":{
"status":0,
"QTime":5006},
  "success":{"10.250.70.120:8983_solr":{
  "responseHeader":{
"status":0,
"QTime":3667},
  "core":"test_shard1_replica1"}}}


So according to doc I should see data_driven_schema_configs being uploaded
to  ZooKeeper under "/configs/test" directory. It seems like doc is
mentioning a literal "configs" directory. BUt I can't find that under my
zookeeper installation.


On Tue, Jul 26, 2016 at 4:18 PM, Erick Erickson <erickerick...@gmail.com>
wrote:

> From the doc you referenced where it outlines the parameters for the
> create command:
>
> -d  : The configuration directory. This defaults to
> data_driven_schema_configs.
>
> You should also review the linked section about what configuration
> directories are all about:
>
> https://cwiki.apache.org/confluence/display/solr/Solr+Start+Script+Reference#SolrStartScriptReference-ConfigurationDirectoriesandSolrCloud
>
> Best,
> Erick
>
>
> On Tue, Jul 26, 2016 at 4:11 PM, Nirav Patel <npa...@xactlycorp.com>
> wrote:
> > Hi,
> >
> > I have 2 nodes solr cluster with 1 node standalone zookeeper.
> >
> > I tried following from following doc to create collection:
> >
> > bin/solr create -c contacts.
> >
> > According to doc should upload config date into /configs/contacts in
> > ZooKeeper. But I can't find any configs directory under zookeeper.
> >
> >
> https://cwiki.apache.org/confluence/display/solr/Solr+Start+Script+Reference#SolrStartScriptReference-Create
> >
> > Where did config files go? I want to modify them using vi and then upload
> > it again. But first I want to locate them on filesystem. According to doc
> > on "Configuration Directories and SolrCloud" it should be under zookeepr
> > but it's not!
> >
> > Thanks
> >
> > --
> >
> >
> > [image: What's New with Xactly] <http://www.xactlycorp.com/email-click/>
> >
> > <https://www.nyse.com/quote/XNYS:XTLY>  [image: LinkedIn]
> > <https://www.linkedin.com/company/xactly-corporation>  [image: Twitter]
> > <https://twitter.com/Xactly>  [image: Facebook]
> > <https://www.facebook.com/XactlyCorp>  [image: YouTube]
> > <http://www.youtube.com/xactlycorporation>
>

-- 


[image: What's New with Xactly] <http://www.xactlycorp.com/email-click/>

<https://www.nyse.com/quote/XNYS:XTLY>  [image: LinkedIn] 
<https://www.linkedin.com/company/xactly-corporation>  [image: Twitter] 
<https://twitter.com/Xactly>  [image: Facebook] 
<https://www.facebook.com/XactlyCorp>  [image: YouTube] 
<http://www.youtube.com/xactlycorporation>


SolrCloud create_collection not uploading configs to zookeeper

2016-07-26 Thread Nirav Patel
Hi,

I have 2 nodes solr cluster with 1 node standalone zookeeper.

I tried following from following doc to create collection:

bin/solr create -c contacts.

According to doc should upload config date into /configs/contacts in
ZooKeeper. But I can't find any configs directory under zookeeper.

https://cwiki.apache.org/confluence/display/solr/Solr+Start+Script+Reference#SolrStartScriptReference-Create

Where did config files go? I want to modify them using vi and then upload
it again. But first I want to locate them on filesystem. According to doc
on "Configuration Directories and SolrCloud" it should be under zookeepr
but it's not!

Thanks

-- 


[image: What's New with Xactly] 

  [image: LinkedIn] 
  [image: Twitter] 
  [image: Facebook] 
  [image: YouTube]