Learning WebScraping

[snippsat]

Like this:

from bs4 import BeautifulSoup
from urllib.request import urlopen

page_url = "http://econpy.pythonanywhere.com/ex/001.html"
new_file = "Mynew.csv"
f = open(new_file, "w")
Headers = "Header1,Header2\n"
f.write(Headers)

html = urlopen(page_url)
soup = BeautifulSoup(html, "html.parser")
buyer_info = soup.find_all("div", {"title":"buyer-info"})
for i in buyer_info:
    Header1 = i.find("div", {"title":"buyer-name"})
    Header2 = i.find("span", {"class":"item-price"})
    f.write('{},{}\n'.format(Header1.text, Header2.text))
f.close()

Output:
Header1,Header2
Carson Busses,$29.95
Earl E. Byrd,$8.37
Patty Cakes,$15.26
Derri Anne Connecticut,$19.25
Moe Dess,$19.25
.......

[Prince_Bhatia]

oh yes..oh Yes...Like this only....like this only...oh yes. like this only...., now last thing...how to scrape in this code for next pages also....i mean how to create loop for multiple pages also?

[snippsat]

i mean how to create loop for multiple pages also?

I did show you before in post.
It would look like this put together.

from bs4 import BeautifulSoup
from urllib.request import urlopen

new_file = "Mynew.csv"
f = open(new_file, "w")
Headers = "Header1,Header2\n"
f.write(Headers)
for page in range(1, 5):
    page_url = "http://econpy.pythonanywhere.com/ex/00{}.html".format(page)
    html = urlopen(page_url)
    soup = BeautifulSoup(html, "html.parser")
    buyer_info = soup.find_all("div", {"title": "buyer-info"})
    for i in buyer_info:
        Header1 = i.find("div", {"title": "buyer-name"})
        Header2 = i.find("span", {"class": "item-price"})
        f.write('{},{}\n'.format(Header1.text, Header2.text))
f.close()

[Prince_Bhatia]

Thank you so much. this is wonderful experience here. Thank you all for your help.