You might get better results if you at a www to the beginning of the hostname.
curl https://www.indeed.co.in/browsejobs/Engineering does download a page whereas curl https://indeed.co.in/browsejobs/Engineering does give a connection refused error. On Saturday, 7 March 2020 04:36:04 UTC, Kurtis Rader wrote: > > On Fri, Mar 6, 2020 at 8:21 PM Kuldeep Avsar <kuldee...@gmail.com > <javascript:>> wrote: > >> I am trying to Scrape the Job Titles one by one from the Indeed.co.in >> <http://www.google.com/url?q=http%3A%2F%2FIndeed.co.in&sa=D&sntz=1&usg=AFQjCNGE83MsDRYF7MeJjhs23pGJHFaewQ> >> website >> >> but it through me connection refused problem while I am visiting to the >> particular jobs Title >> >> categories page and trying to take response back from the page but It's >> shows error on that time. >> >> please help me out to solve this problem i am tried to solve this but this >> not solved. Please help. >> >> 2020/03/07 09:08:41 Error to Connect with Indeed Jobs Category Page.Get >> https://indeed.co.in/browsejobs/Engineering: dial tcp 169.44.165.69:443: >> connect: connection refuse >> >> > The web site you are accessing thinks you are executing a DDOS attack or > are otherwise violating their terms of service. This has nothing to do with > the Go language. You need to rate limit your requests of that site. > > -- > Kurtis Rader > Caretaker of the exceptional canines Junior and Hank > -- You received this message because you are subscribed to the Google Groups "golang-nuts" group. To unsubscribe from this group and stop receiving emails from it, send an email to golang-nuts+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/golang-nuts/bf5ebe6c-7a92-4d34-8530-ebdead009b78%40googlegroups.com.
