Home Ask Login Register

Developers Planet

Your answer is one click away!

Amer February 2016

"scrapy list" command in my project directory starts a spider

I created a scrapy project form the command line and added two spiders, myspider1 and myspider2. Whenever I run "scrapy crawl myspider1" or ""scrapy crawl myspider2" it starts "myspider1".

When I run "scrapy list" it also starts myspider1

I am running this under a vertualenv in python but I can't understand why it does this. It seems that whenever I run a command with scrapy it always executes the first spider in my spiders folder.

Any idea on why this is happening?


Amer February 2016

The code was printing some print statements that made it delay the response which made me think it was crawling.

Post Status

Asked in February 2016
Viewed 1,419 times
Voted 14
Answered 1 times


Leave an answer

Quote of the day: live life