30c3360f6fd1b4ce83e45db805d08dc3709986aa
xsscrapy
From within the main folder run:
scrapy crawl xsscrapy -a url='http://something.com'
If you wish to login then crawl:
scrapy crawl xsscrapy -a url='http://something.com/login_page' -a login=username -a pw=secret_password
Output is stored in formatted-urls.txt.
Description
Languages
Python
98.5%
PHP
1.5%