Hi Pat,
Woops, my bad. Here's a link to a gist after I
rebuilt: https://gist.github.com/9a6e0127491b48173416
Let me make sure I'm getting this right. So I did the migration, added
"set_property :delta => true" into my index block and rebuilt.
What I do is delete all the records from our database - rebuild so the
index is empty and we have no results - and start redownloading the
products into the database - what I would expect without typing rake
ts:index (or giving ANY additional command) is for the products to be
immediately available. Is this the correct workflow?
I did just go through this again (on a new laptop) and it hasn't worked
again, and the delta value is marked as 1 for all the products.
Arghh! Its driving me mad. Would appreciate any pointers...!
Thanks,
Geoff
On Thursday, January 3, 2013 8:26:21 AM UTC, Pat Allan wrote:
>
> Hi Geoff
>
> This is different in the Sphinx output - but I guess you may have disabled
> deltas at some point in the meantime?
> > WARNING: no such index 'product_delta', skipping.
>
> Run ts:rebuild and give it another spin, just to confirm.
>
> --
> Pat
>
> On 03/01/2013, at 1:23 AM, geoffw8 wrote:
>
> > Hi Pat
> >
> > (Can't believe I didn't see this, I was just writing a new post!!)
> >
> > Yes, the delta flag for the product was set to true (1 in the db).
> >
> > I am using version 2.0.13 of TS and Sphinx 2.0.6-release (r3473)
> >
> > Here is the full output:
> >
> > Product Load (0.8ms) SELECT `products`.* FROM `products` WHERE (guid
> = '1411077050' AND feed_id = 2) LIMIT 1
> > Brand Load (0.6ms) SELECT `brands`.* FROM `brands` WHERE
> `brands`.`name` = 'Schuh' LIMIT 1
> > (0.1ms) BEGIN
> > SQL (2.5ms) INSERT INTO `products` (`additional_data_1`,
> `additional_data_2`, `additional_data_3`, `brand`, `category_id`,
> `colour_id`, `cost_id`, `created_at`, `dead`, `deeplink`, `delta`,
> `description`, `feed_id`, `feed_log_id`, `gender_id`, `get_photo_status`,
> `guid`, `image`, `image_attempts`, `is_duplicate`, `last_checked`,
> `merchant_link`, `name`, `old_prices`, `parent_id`, `pattern_id`,
> `permalink`, `photo_content_type`, `photo_file_name`, `photo_file_sze`,
> `photo_updated_at`, `photograph_id`, `price`, `processed`, `rank`, `sale`,
> `sale_on`, `subcategory_id`, `tags`, `updated_at`) VALUES ('Womens
> Footwear', 'Women\'s Footwear', NULL, 'Schuh', NULL, NULL, NULL,
> '2013-01-02 14:17:08', 0, '
> http://www.awin1.com/pclick.php?p=696651025&a=93579&m=2044', 1, 'Youll
> get more attention showing these off than sticking your thumb out! The
> Hitch Hike is one of our own and features a black suede upper and two
> functional buckles. This tough little ankle boot sits on a 6cm heel and a
> cleated sole.', 2, 13125, NULL, NULL, '1411077050', '
> http://www.schuh.co.uk/images/product/141107/1411077050_exlg.jpg', NULL,
> NULL, NULL, '
> http://www.schuh.co.uk/womens-black-schuh-hitch-hike/1411077050/', 'Schuh
> Hitch Hike', NULL, NULL, NULL, NULL, NULL, NULL, NULL, NULL, NULL, '85.00',
> NULL, NULL, 0, NULL, NULL, NULL, '2013-01-02 14:17:08')
> > Feed Load (1.0ms) SELECT `feeds`.* FROM `feeds` WHERE `feeds`.`id` =
> 2 LIMIT 1
> > Category Load (0.5ms) SELECT `categories`.* FROM `categories` WHERE
> `categories`.`id` IS NULL LIMIT 1
> > Subcategory Load (0.5ms) SELECT `subcategories`.* FROM
> `subcategories` WHERE `subcategories`.`id` IS NULL LIMIT 1
> > (2.4ms) COMMIT
> > Sphinx 2.0.6-release (r3473)
> > Copyright (c) 2001-2012, Andrew Aksyonoff
> > Copyright (c) 2008-2012, Sphinx Technologies Inc (
> http://sphinxsearch.com)
> >
> > using config file
> '/Users/geoffmwright/Documents/rails/WTL2/config/development.sphinx.conf'...
> > WARNING: no such index 'product_delta', skipping.
> > total 0 reads, 0.000 sec, 0.0 kb/call avg, 0.0 msec/call avg
> > total 0 writes, 0.000 sec, 0.0 kb/call avg, 0.0 msec/call avg
> > Sphinx Query (3.9ms)
> > Sphinx Found 0 results
> >
> > And I just checked in the db, and this product does have delta set to 1
> >
> > Any ideas on where to look first? Its not working on my local, or prod
> environments.
> >
> > Thanks for your help all, its much appreciated
> >
> > Kind regards,
> >
> > Geoff
> >
> > On Sunday, December 23, 2012 1:13:34 AM UTC, Pat Allan wrote:
> > Hi Geoff
> > You omitted the data for the new product - can you confirm that the
> delta flag was set to true there? Also, what version of Thinking Sphinx are
> you using?
> >
> > Cheers
> >
> > --
> > Pat
> >
> > On 16/12/2012, at 1:04 PM, geoffw8 wrote:
> >
> > > Hey, so I am having this EXACT issue and when I run the shell command
> I get:
> > >
> > > gw:WTL2 gwt$ search --config config/development.sphinx.conf -i
> product_delta top
> > > Sphinx 2.0.4-release (r3135)
> > > Copyright (c) 2001-2012, Andrew Aksyonoff
> > > Copyright (c) 2008-2012, Sphinx Technologies Inc (
> http://sphinxsearch.com)
> > >
> > > using config file 'config/development.sphinx.conf'...
> > > index 'product_delta': search error: .
> > >
> > > All seems to be well coming in:
> > >
> > > Product Load (1.3ms) SELECT `products`.* FROM `products` WHERE (guid
> = 'BLFA1176M1851' AND feed_id = 1) LIMIT 1
> > > Brand Load (0.4ms) SELECT `brands`.* FROM `brands` WHERE
> `brands`.`name` = 'Bench' LIMIT 1
> > > (0.1ms) BEGIN
> > > SQL (0.6ms) INSERT INTO `products` (`data omitted')
> > > Feed Load (0.5ms) SELECT `feeds`.* FROM `feeds` WHERE `feeds`.`id`
> = 1 LIMIT 1
> > > Category Load (0.2ms) SELECT `categories`.* FROM `categories` WHERE
> `categories`.`id` IS NULL LIMIT 1
> > > Subcategory Load (0.2ms) SELECT `subcategories`.* FROM
> `subcategories` WHERE `subcategories`.`id` IS NULL LIMIT 1
> > > (0.4ms) COMMIT
> > > Sphinx 2.0.4-release (r3135)
> > > Copyright (c) 2001-2012, Andrew Aksyonoff
> > > Copyright (c) 2008-2012, Sphinx Technologies Inc (
> http://sphinxsearch.com)
> > >
> > > using config file
> '/Users/geoffwright/Documents/rails/WTL2/config/development.sphinx.conf'...
> > > indexing index 'product_delta'...
> > > collected 0 docs, 0.0 MB
> > > collected 0 attr values
> > > sorted 0.0 Mvalues, 100.0% done
> > > total 0 docs, 0 bytes
> > > total 0.014 sec, 0 bytes/sec, 0.00 docs/sec
> > > total 5 reads, 0.000 sec, 25.5 kb/call avg, 0.0 msec/call avg
> > > total 5 writes, 0.000 sec, 0.2 kb/call avg, 0.0 msec/call avg
> > > rotating indices: succesfully sent SIGHUP to searchd (pid=1488).
> > > Sphinx Query (2.1ms)
> > > Sphinx Found 0 results
> > >
> > >
> > > Any ideas what I might be doing wrong? I'd have thought collected
> should be > 0
> > >
> > > Cheers
> > >
> > > Geoff
> > >
> > > On Thursday, November 17, 2011 3:55:22 AM UTC, Strafe wrote:
> > > Ooohh, okay.
> > >
> > > On Wed, Nov 16, 2011 at 10:39 PM, Pat Allan <[email protected]>
> wrote:
> > > We have a confusion of terms here…
> > >
> > > On a *nix box the shell I'm talking about would be bash, zsh, etc. On
> Windows, I guess it's cmd.exe?
> > >
> > > On 17/11/2011, at 10:37 AM, Benjamin Zumhagen wrote:
> > >
> > > > I ran that command in the IRB shell
> > > >
> > > > On Wed, Nov 16, 2011 at 9:08 PM, Pat Allan <
> [email protected]> wrote:
> > > > You need to run this command in your shell, not in script/console.
> > > >
> > > > --
> > > > Pat
> > > >
> > > > On 16/11/2011, at 8:37 PM, Benjamin Zumhagen wrote:
> > > >
> > > > > This is what I get when I run that command.
> > > > >
> > > > > irb(main):006:0> search --config config/development.sphinx.conf -i
> hardware_delta dell
> > > > > SyntaxError: (irb):6: syntax error, unexpected tIDENTIFIER,
> expecting keyword_do or '{' or '('
> > > > > search --config config/development.sphinx.conf -i hardware_delta
> dell
> > > > > ^
> > > > > (irb):6: syntax error, unexpected tUMINUS, expecting $end
> > > > > search --config config/development.sphinx.conf -i hardware_delta
> dell
> > > > > ^
> > > > > from
> C:/ruby192/lib/ruby/gems/1.9.1/gems/railties-3.0.9/lib/rails/commands/console.rb:44:in
>
> `start'
> > > > > from
> C:/ruby192/lib/ruby/gems/1.9.1/gems/railties-3.0.9/lib/rails/commands/console.rb:8:in
>
> `start'
> > > > > from
> C:/ruby192/lib/ruby/gems/1.9.1/gems/railties-3.0.9/lib/rails/commands.rb:23:in
>
> `<top (required)>'
> > > > > from script/rails:6:in `require'
> > > > > from script/rails:6:in `<main>'
> > > > >
> > > > > On Wed, Nov 16, 2011 at 5:36 AM, Pat Allan <
> [email protected]> wrote:
> > > > > I'm afraid I don't know what the cause of the problem is here… it
> looks like you don't even have 20 records, so it's not a matter of
> pagination getting in the way… the delta processing happens, the new record
> seems to be recorded in it.
> > > > >
> > > > > What happens if you run - from the command line - a manual search:
> > > > > search --config config/development.sphinx.conf -i hardware_delta
> dell
> > > > >
> > > > > Does it get returned?
> > > > >
> > > > > --
> > > > > Pat
> > > > >
> > > > > On 14/11/2011, at 8:34 PM, Strafe wrote:
> > > > >
> > > > > > Creating Record
> > > > > >
> > > > > > irb(main):003:0> Hardware.create(:equipment_manufacturer =>
> > > > > > "Dell", :equipment_model => "1337", :serial_number => "12345678")
> > > > > > Sphinx 2.0.1-beta (r2792)
> > > > > > Copyright (c) 2001-2011, Andrew Aksyonoff
> > > > > > Copyright (c) 2008-2011, Sphinx Technologies Inc (http://
> > > > > > sphinxsearch.com)
> > > > > >
> > > > > > using config file 'C:/ruby192/project/config/
> > > > > > development.sphinx.conf'...
> > > > > > indexing index 'hardware_delta'...
> > > > > > WARNING: collect_hits: mem_limit=0 kb too low, increasing to
> 14592 kb
> > > > > > collected 1 docs, 0.0 MB
> > > > > > sorted 0.0 Mhits, 100.0% done
> > > > > > total 1 docs, 16 bytes
> > > > > > total 0.029 sec, 551 bytes/sec, 34.46 docs/sec
> > > > > > total 2 reads, 0.000 sec, 0.0 kb/call avg, 0.0 msec/call avg
> > > > > > total 9 writes, 0.000 sec, 0.1 kb/call avg, 0.0 msec/call avg
> > > > > > rotating indices: succesfully sent SIGHUP to searchd (pid=7588).
> > > > > > => #<Hardware id: 11, equipment_model: "1337", serial_number:
> > > > > > "12345678", equipment_building: nil, equipment_loca
> > > > > > tion: nil, delta: true, created_at: "2011-11-14 13:20:37",
> updated_at:
> > > > > > "2011-11-14 13:20:37", equipment_manufacturer: "Dell">
> > > > > >
> > > > > > Then I run a Hardware.search with no parameters and it doesnt
> show up.
> > > > > >
> > > > > >
> > > > > >
> > > > > > On Nov 11, 7:11 am, Pat Allan <[email protected]> wrote:
> > > > > >> If you have deltas defined, then the indexing should happen
> already - you don't need to run define_indexes or index_delta.
> > > > > >>
> > > > > >> Can you show us what data you're using in the new record, and
> what your test search query is?
> > > > > >>
> > > > > >> --
> > > > > >> Pat
> > > > > >>
> > > > > >> On 11/11/2011, at 12:43 AM, Strafe wrote:
> > > > > >>
> > > > > >>
> > > > > >>
> > > > > >>
> > > > > >>
> > > > > >>
> > > > > >>
> > > > > >>> Step 1. I have premade records which are indexed initially.
> > > > > >>
> > > > > >>> irb(main):001:0> Hardware.last
> > > > > >>> => #<Hardware id: 3, [...] delta: false >
> > > > > >>
> > > > > >>> Step 2. I create a new record
> > > > > >>
> > > > > >>> irb(main):001:0> Hardware.last
> > > > > >>> => #<Hardware id: 4, [...] delta: true >
> > > > > >>
> > > > > >>> Step 3. I checked for defined indexes
> > > > > >>
> > > > > >>> irb(main):003:0> Hardware.define_indexes
> > > > > >>> => true
> > > > > >>
> > > > > >>> Step 4. I check out delta index
> > > > > >>
> > > > > >>> irb(main):004:0> Hardware.index_delta
> > > > > >>> Sphinx 2.0.1-beta (r2792)
> > > > > >>> Copyright (c) 2001-2011, Andrew Aksyonoff
> > > > > >>> Copyright (c) 2008-2011, Sphinx Technologies Inc (http://
> > > > > >>> sphinxsearch.com)
> > > > > >>
> > > > > >>> using config file 'C:/ruby192/cec_inventory/config/
> > > > > >>> development.sphinx.conf'...
> > > > > >>> indexing index 'hardware_delta'...
> > > > > >>> WARNING: collect_hits: mem_limit=0 kb too low, increasing to
> 14592 kb
> > > > > >>> collected 1 docs, 0.0 MB
> > > > > >>> sorted 0.0 Mhits, 100.0% done
> > > > > >>> total 1 docs, 18 bytes
> > > > > >>> total 0.060 sec, 295 bytes/sec, 16.44 docs/sec
> > > > > >>> total 2 reads, 0.000 sec, 0.0 kb/call avg, 0.0 msec/call avg
> > > > > >>> total 9 writes, 0.000 sec, 0.1 kb/call avg, 0.0 msec/call avg
> > > > > >>> rotating indices: succesfully sent SIGHUP to searchd
> (pid=1824).
> > > > > >>> => [#<ThinkingSphinx::Deltas::DefaultDelta:0x414b910
> [........] ]
> > > > > >>
> > > > > >>> Here is my define index block
> > > > > >>
> > > > > >>> define_index do
> > > > > >>> # fields
> > > > > >>> indexes equipment_manufacturer, :sortable =>
> true
> > > > > >>> indexes equipment_model, :sortable => true
> > > > > >>> indexes serial_number
> > > > > >>> indexes equipment_building
> > > > > >>> indexes equipment_location
> > > > > >>
> > > > > >>> set_property :delta => true
> > > > > >>> has created_at, updated_at
> > > > > >>> end
> > > > > >>
> > > > > >>> Let me know if you need anything else.
> > > > > >>
> > > > > >>> On Nov 9, 9:58 pm, Pat Allan <[email protected]>
> wrote:
> > > > > >>>> Hi
> > > > > >>
> > > > > >>>> Could you run us through how you're testing the deltas in the
> command line? It's worth noting that Sphinx takes a second to load the new
> data, so don't run a search *straight* after creating a new object - I
> usually use `sleep 0.5` in my tests to account for this.
> > > > > >>
> > > > > >>>> Also, can you provide the full define_index block?
> > > > > >>
> > > > > >>>> Cheers
> > > > > >>
> > > > > >>>> --
> > > > > >>>> Pat
> > > > > >>
> > > > > >>>> On 10/11/2011, at 4:22 AM, Strafe wrote:
> > > > > >>
> > > > > >>>>> I know this has been covered before, but I couldn't find
> something in
> > > > > >>>>> the other documents which helped me, so I thought i'd make a
> thread
> > > > > >>>>> here.
> > > > > >>
> > > > > >>>>> So im running Rails 3.0.9 on Ruby 1.9.2.
> > > > > >>
> > > > > >>>>> Thinking Sphinx worked great, then I decided I wanted to
> implement
> > > > > >>>>> Delta Indexes.
> > > > > >>
> > > > > >>>>> So I added the column to my model
> > > > > >>
> > > > > >>>>> :delta, :boolean, :default => true, :null => false
> > > > > >>
> > > > > >>>>> Then I added the property to my model
> > > > > >>
> > > > > >>>>> define_index do
> > > > > >>>>> set_property :delta => true
> > > > > >>>>> end
> > > > > >>
> > > > > >>>>> Then I ran my migrations
> > > > > >>
> > > > > >>>>> Then I ran a rake ts:rebuild
> > > > > >>
> > > > > >>>>> Started my rails server, and everything seemed to be working.
> > > > > >>
> > > > > >>>>> However, when I create or destroy objects they do not appear
> in the
> > > > > >>>>> search.
> > > > > >>
> > > > > >>>>> It would seem that everything is working fine, the delta
> index is in
> > > > > >>>>> the model, it's set to true when I create a record. I see
> the Sphinx
> > > > > >>>>> stuff in the console without errors when I create a record.
> > > > > >>
> > > > > >>>>> And when I run the index_delta command in the IRB it seems
> to find all
> > > > > >>>>> the new records.
> > > > > >>
> > > > > >>>>>> Hardware.index_delta
> > > > > >>>>> Sphinx 2.0.1-beta (r2792)
> > > > > >>>>> Copyright (c) 2001-2011, Andrew Aksyonoff
> > > > > >>>>> Copyright (c) 2008-2011, Sphinx Technologies Inc (http://
> > > > > >>>>> sphinxsearch.com)
> > > > > >>
> > > > > >>>>> using config file 'C:/ruby192/cec_inventory/config/
> > > > > >>>>> development.sphinx.conf'...
> > > > > >>>>> indexing index 'hardware_delta'...
> > > > > >>>>> WARNING: collect_hits: mem_limit=0 kb too low, increasing to
> 14592 kb
> > > > > >>>>> collected 2 docs, 0.0 MB
> > > > > >>>>> sorted 0.0 Mhits, 100.0% done
> > > > > >>>>> total 2 docs, 31 bytes
> > > > > >>>>> total 0.038 sec, 803 bytes/sec, 51.86 docs/sec
> > > > > >>>>> total 2 reads, 0.000 sec, 0.0 kb/call avg, 0.0 msec/call avg
> > > > > >>>>> total 9 writes, 0.000 sec, 0.1 kb/call avg, 0.0 msec/call avg
> > > > > >>>>> rotating indices: succesfully sent SIGHUP to searchd
> (pid=7772).
> > > > > >>>>> [delta index stuff here]
> > > > > >>
> > > > > >>>>> Even if i run a ts:reindex when the searchd is running, it
> doesnt find
> > > > > >>>>> the new records, it only set's their delta to false. They
> don't show
> > > > > >>>>> up. The only way I can get them to show is if I run a
> ts:rebuild.
> > > > > >>
> > > > > >>>>> Can you guys help me? Sorry If i accidentally left out some
> details.
> > > > > >>
> > > > > >>>>> --
> > > > > >>>>> You received this message because you are subscribed to the
> Google Groups "Thinking Sphinx" group.
> > > > > >>>>> To post to this group, send email to
> [email protected].
> > > > > >>>>> To unsubscribe from this group, send email to
> [email protected].
> > > > > >>>>> For more options, visit this group athttp://
> groups.google.com/group/thinking-sphinx?hl=en.
> > > > > >>
> > > > > >>> --
> > > > > >>> You received this message because you are subscribed to the
> Google Groups "Thinking Sphinx" group.
> > > > > >>> To post to this group, send email to
> [email protected].
> > > > > >>> To unsubscribe from this group, send email to
> [email protected].
> > > > > >>> For more options, visit this group athttp://
> groups.google.com/group/thinking-sphinx?hl=en.
> > > > > >
> > > > > > --
> > > > > > You received this message because you are subscribed to the
> Google Groups "Thinking Sphinx" group.
> > > > > > To post to this group, send email to [email protected]
> .
> > > > > > To unsubscribe from this group, send email to
> [email protected].
> > > > > > For more options, visit this group at
> http://groups.google.com/group/thinking-sphinx?hl=en.
> > > > > >
> > > > >
> > > > > --
> > > > > You received this message because you are subscribed to the Google
> Groups "Thinking Sphinx" group.
> > > > > To post to this group, send email to [email protected].
> > > > > To unsubscribe from this group, send email to
> [email protected].
> > > > > For more options, visit this group at
> http://groups.google.com/group/thinking-sphinx?hl=en.
> > > > >
> > > > >
> > > > >
> > > > > --
> > > > > You received this message because you are subscribed to the Google
> Groups "Thinking Sphinx" group.
> > > > > To post to this group, send email to [email protected].
> > > > > To unsubscribe from this group, send email to
> [email protected].
> > > > > For more options, visit this group at
> http://groups.google.com/group/thinking-sphinx?hl=en.
> > > >
> > > > --
> > > > You received this message because you are subscribed to the Google
> Groups "Thinking Sphinx" group.
> > > > To post to this group, send email to [email protected].
> > > > To unsubscribe from this group, send email to
> [email protected].
> > > > For more options, visit this group at
> http://groups.google.com/group/thinking-sphinx?hl=en.
> > > >
> > > >
> > > >
> > > > --
> > > > You received this message because you are subscribed to the Google
> Groups "Thinking Sphinx" group.
> > > > To post to this group, send email to [email protected].
> > > > To unsubscribe from this group, send email to
> [email protected].
> > > > For more options, visit this group at
> http://groups.google.com/group/thinking-sphinx?hl=en.
> > >
> > > --
> > > You received this message because you are subscribed to the Google
> Groups "Thinking Sphinx" group.
> > > To post to this group, send email to [email protected].
> > > To unsubscribe from this group, send email to
> [email protected].
> > > For more options, visit this group at
> http://groups.google.com/group/thinking-sphinx?hl=en.
> > >
> > >
> > >
> > > --
> > > You received this message because you are subscribed to the Google
> Groups "Thinking Sphinx" group.
> > > To view this discussion on the web visit
> https://groups.google.com/d/msg/thinking-sphinx/-/yQzDyqDPR3cJ.
> > > To post to this group, send email to [email protected].
> > > To unsubscribe from this group, send email to
> [email protected].
> > > For more options, visit this group at
> http://groups.google.com/group/thinking-sphinx?hl=en.
> >
> >
> >
> >
> >
> >
> >
> >
> > --
> > You received this message because you are subscribed to the Google
> Groups "Thinking Sphinx" group.
> > To view this discussion on the web visit
> https://groups.google.com/d/msg/thinking-sphinx/-/eGZsYthFdacJ.
> > To post to this group, send email to
> > [email protected]<javascript:>
> .
> > To unsubscribe from this group, send email to
> [email protected] <javascript:>.
> > For more options, visit this group at
> http://groups.google.com/group/thinking-sphinx?hl=en.
>
>
>
--
You received this message because you are subscribed to the Google Groups
"Thinking Sphinx" group.
To view this discussion on the web visit
https://groups.google.com/d/msg/thinking-sphinx/-/IVzzLxsn6aYJ.
To post to this group, send email to [email protected].
To unsubscribe from this group, send email to
[email protected].
For more options, visit this group at
http://groups.google.com/group/thinking-sphinx?hl=en.
