Hi previous one prints nothing and this is another way but getting nothing
import requests from bs4 import BeautifulSoup base_url="https://www.adidas.com.my/en/men-shoes/" headers = { 'User-Agent': 'Mozilla/5.0 (Windows NT 10.0; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/72.0.3626.121 Safari/537.36' } for x in range(0,18): x=x*(12*4) r = requests.get(f'https://www.adidas.com.my/en/men-shoes?start={x}') soup = BeautifulSoup(r.content,'lxml') productlist = soup.find_all('div', class_='grid-item___3rAkS') productlinks=[] for item in productlist: for link in item.find_all('a',href=True): productlinks.append(base_url+ link['href']) print(productlinks) thanks On Tue, Jun 22, 2021 at 9:52 AM Lalit Suthar <[email protected]> wrote: > print(links) outside for loop. Even then if nothing prints means your > `listings` is empty > > On Tue, 22 Jun 2021 at 08:51, ram manoj Vuyyuru <[email protected]> > wrote: > >> HI >> help me for getting urls for each product >> import pandas as pd >> import requests >> from bs4 import BeautifulSoup as bs >> >> >> url = "https://www.adidas.com.my/en/men-shoes?start=0" >> page = requests.get(url) >> soup = bs(page.text,"html.parser") >> >> links=[] >> listings = soup.find_all('div',{'class':'grid-item___3rAkS'}) >> for listing in listings: >> shoes_link= listing.find_all("a").a.get("href") >> base_url="https://www.adidas.com.my/en/men-shoes/" >> cmplt_lnk=base_url+shoes_link >> links.append(cmplt_lnk) >> print(links) >> >> >> my code : >> when i run this i am not getting any result >> >> -- >> You received this message because you are subscribed to the Google Groups >> "Django users" group. >> To unsubscribe from this group and stop receiving emails from it, send an >> email to [email protected]. >> To view this discussion on the web visit >> https://groups.google.com/d/msgid/django-users/CALJzFip9tmQTxygmWpqpc%3DqKHipNNf4HXhofGFXOPy3pp4bMCw%40mail.gmail.com >> <https://groups.google.com/d/msgid/django-users/CALJzFip9tmQTxygmWpqpc%3DqKHipNNf4HXhofGFXOPy3pp4bMCw%40mail.gmail.com?utm_medium=email&utm_source=footer> >> . >> > -- > You received this message because you are subscribed to the Google Groups > "Django users" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to [email protected]. > To view this discussion on the web visit > https://groups.google.com/d/msgid/django-users/CAGp2JVH%2BioS8doxM77s8BPjZjkc-hh7YrXecVO4fztwgFSPjWw%40mail.gmail.com > <https://groups.google.com/d/msgid/django-users/CAGp2JVH%2BioS8doxM77s8BPjZjkc-hh7YrXecVO4fztwgFSPjWw%40mail.gmail.com?utm_medium=email&utm_source=footer> > . > -- You received this message because you are subscribed to the Google Groups "Django users" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To view this discussion on the web visit https://groups.google.com/d/msgid/django-users/CALJzFioVAbjZyaacEyc%2BjhbdRa1V7GmFTdd8eBC%3Dp-oN0sWpfg%40mail.gmail.com.

