How to crawl every URL of website

[Sherjeel Niazi]

Hello there,

I would like to know that if I have to crawl every URL of a web site (I
myself do not know how many URL's are there).
Website structure is like:
   www.domain.com/record/1
   www.domain.com/record/2
   www.domain.com/record/3
   ......................
   so on



Thanks,
Sherjeel