Re: [racket-dev] full tree text search

2010-12-09 Thread Jakub Piotr Cłapa

On 09.12.10 07:19, Jon Rafkind wrote:

On 12/08/2010 10:12 PM, Eli Barzilay wrote:

Is this different from a recursive grep?

(See also `git grep' -- and there's a web interface for that,
http://git.racket-lang.org//plt?a=search&h=HEAD&st=grep&s=foo )



Oh I had no idea git grep existed. Well that looks good enough for now.

(BTW, recursive grep on the command line is not so trivial..
$ find . -name "*.rkt" | xargs grep foo
)


You may also try ack:
http://betterthangrep.com/

It automaticaly does recursive search and ommits repository directories 
and other useless files.


It needs a config file entry for Racket though (.ackrc):
--type-set
racket=.rkt,.scrbl,.ss,.scm

Usage:
ack foo

--
regards,
Jakub Piotr Cłapa
_
 For list-related administrative tasks:
 http://lists.racket-lang.org/listinfo/dev

Re: [racket-dev] full tree text search

2010-12-08 Thread Eli Barzilay
40 minutes ago, Jon Rafkind wrote:
> On 12/08/2010 10:12 PM, Eli Barzilay wrote:
> > Is this different from a recursive grep?
> >
> > (See also `git grep' -- and there's a web interface for that,
> > http://git.racket-lang.org//plt?a=search&h=HEAD&st=grep&s=foo )
> 
> Oh I had no idea git grep existed. Well that looks good enough for now.

It's a little more useful than a plain grep because it searches only
the repository contents.


> (BTW, recursive grep on the command line is not so trivial..
> $ find . -name "*.rkt" | xargs grep foo
> )

1. Get http://barzilay.org/misc/sgrep,
   and then: sgrep foo .rkt

2. Use zsh, and: grep foo **/*.rkt

3. Or just use grep: grep -r foo --include="*.rkt" .


15 minutes ago, Noel Welsh wrote:
> Depending on how it is setup, it could be. There should be some
> processing to find words with similar meanings, for example. I
> expect your wife knows more :-)

Yeah, but all of that stuff is useful for searching the documentation
search, and IIUC Jon wants a code searching tool.

(And with documentation searches I think that Google will be hard to
beat.)


> BTW,I think this is a really interesting and possibly useful thing to
> experiment with. Just storing the search logs on docs.racket-lang.org
> would provide a mine of useful information. Mining it is, of course,
> the issue.

(It's a plain apache setup...)

-- 
  ((lambda (x) (x x)) (lambda (x) (x x)))  Eli Barzilay:
http://barzilay.org/   Maze is Life!
_
  For list-related administrative tasks:
  http://lists.racket-lang.org/listinfo/dev


Re: [racket-dev] full tree text search

2010-12-08 Thread Jon Rafkind
On 12/08/2010 11:46 PM, Noel Welsh wrote:
> Depending on how it is setup, it could be. There should be some
> processing to find words with similar meanings, for example. I expect
> your wife knows more :-)
>
> BTW,I think this is a really interesting and possibly useful thing to
> experiment with. Just storing the search logs on docs.racket-lang.org
> would provide a mine of useful information. Mining it is, of course,
> the issue.
>
> BTW BTW, Solr might provide a better user experience than straight
> Lucene. (Solr is the Lucene prepackaged.)
>

I attempted to set up solr a while ago but I couldn't figure it out.
Solr seems to suffer from having too many configuration files that all
need to be set up perfectly before you get any results. And so I had to
stick with plain Lucene.
_
  For list-related administrative tasks:
  http://lists.racket-lang.org/listinfo/dev


Re: [racket-dev] full tree text search

2010-12-08 Thread Noel Welsh
Depending on how it is setup, it could be. There should be some
processing to find words with similar meanings, for example. I expect
your wife knows more :-)

BTW,I think this is a really interesting and possibly useful thing to
experiment with. Just storing the search logs on docs.racket-lang.org
would provide a mine of useful information. Mining it is, of course,
the issue.

BTW BTW, Solr might provide a better user experience than straight
Lucene. (Solr is the Lucene prepackaged.)

N.

On Thu, Dec 9, 2010 at 5:12 AM, Eli Barzilay  wrote:
> Is this different from a recursive grep?
>
> (See also `git grep' -- and there's a web interface for that,
> http://git.racket-lang.org//plt?a=search&h=HEAD&st=grep&s=foo )
_
  For list-related administrative tasks:
  http://lists.racket-lang.org/listinfo/dev


Re: [racket-dev] full tree text search

2010-12-08 Thread Jon Rafkind
On 12/08/2010 10:12 PM, Eli Barzilay wrote:
> Is this different from a recursive grep?
>
> (See also `git grep' -- and there's a web interface for that,
> http://git.racket-lang.org//plt?a=search&h=HEAD&st=grep&s=foo )
>

Oh I had no idea git grep existed. Well that looks good enough for now.

(BTW, recursive grep on the command line is not so trivial..
$ find . -name "*.rkt" | xargs grep foo
)
_
  For list-related administrative tasks:
  http://lists.racket-lang.org/listinfo/dev


Re: [racket-dev] full tree text search

2010-12-08 Thread Eli Barzilay
Is this different from a recursive grep?

(See also `git grep' -- and there's a web interface for that,
http://git.racket-lang.org//plt?a=search&h=HEAD&st=grep&s=foo )


Four hours ago, Jon Rafkind wrote:
> I whipped up a webservice that provides full text search on the
> racket tree. Its written in java using lucene+jetty. It doesn't have
> a lot of bells and whistles right now but if people find it useful I
> can add things to it.
> 
> ​http://crystalis.cs.utah.edu:8080/search/
> 
> I'll try to leave the server up most of the time for a few days. If
> its down and you want to try the server just let me know.
> 
> --
> Why not use google search? Well its nice to have a little more control
> over how the results are shown. Sites like http://koders.com show a
> little bit of whats possible.
> 
> Also its easy to set up the text search on your local box. Rebuilding a
> full index takes less than 2 minutes.

-- 
  ((lambda (x) (x x)) (lambda (x) (x x)))  Eli Barzilay:
http://barzilay.org/   Maze is Life!
_
  For list-related administrative tasks:
  http://lists.racket-lang.org/listinfo/dev

Re: [racket-dev] full tree text search

2010-12-08 Thread Matthias Felleisen

So how do you use it? I entered 

 code: 

and I got a huge stack trace. 


On Dec 8, 2010, at 8:26 PM, Jon Rafkind wrote:

> I whipped up a webservice that provides full text search on the racket
> tree. Its written in java using lucene+jetty. It doesn't have a lot of
> bells and whistles right now but if people find it useful I can add
> things to it.
> 
> ​http://crystalis.cs.utah.edu:8080/search/
> 
> I'll try to leave the server up most of the time for a few days. If its
> down and you want to try the server just let me know.
> 
> --
> Why not use google search? Well its nice to have a little more control
> over how the results are shown. Sites like http://koders.com show a
> little bit of whats possible.
> 
> Also its easy to set up the text search on your local box. Rebuilding a
> full index takes less than 2 minutes.
> _
>  For list-related administrative tasks:
>  http://lists.racket-lang.org/listinfo/dev

_
  For list-related administrative tasks:
  http://lists.racket-lang.org/listinfo/dev

[racket-dev] full tree text search

2010-12-08 Thread Jon Rafkind
I whipped up a webservice that provides full text search on the racket
tree. Its written in java using lucene+jetty. It doesn't have a lot of
bells and whistles right now but if people find it useful I can add
things to it.

​http://crystalis.cs.utah.edu:8080/search/

I'll try to leave the server up most of the time for a few days. If its
down and you want to try the server just let me know.

--
Why not use google search? Well its nice to have a little more control
over how the results are shown. Sites like http://koders.com show a
little bit of whats possible.

Also its easy to set up the text search on your local box. Rebuilding a
full index takes less than 2 minutes.
_
  For list-related administrative tasks:
  http://lists.racket-lang.org/listinfo/dev