Python Forum
the next_page command using Scrapy Splash is not working - Printable Version

+- Python Forum (https://python-forum.io)
+-- Forum: Python Coding (https://python-forum.io/forum-7.html)
+--- Forum: Web Scraping & Web Development (https://python-forum.io/forum-13.html)
+--- Thread: the next_page command using Scrapy Splash is not working (/thread-22527.html)



the next_page command using Scrapy Splash is not working - nazmulfinance - Nov-16-2019

Dear Everyone,

I am trying to extract all quotes with author and tags from 'http://quotes.toscrape.com/js'. The page uses Javascript for web content. Therefore I am using Splash with scrapy. The spider codes extract the information on the very first page but do not extract information from other pages. Could you please give me guidelines to fix the next_page command? I appreciate your help.
engine] INFO: Spider closed (finished)