I hope all of you are well.
Few issues that I want to highlight, while you are just starting with web scraping or Scrapy.
- Yes, you have enrolled to the intro course for web scraping in Python’s Scrapy (a free course for everyone). -Web Scraping with Python 101: Build Scrapy Essential Skills- This is step one. Next step is to find the time to go through the lessons. It is one hour yes, but still it takes effort. And I know it is not easy to schedule a time to sit in front of the computer and learn some. For tight schedulers, I would recommend to watch the videos through your mobile first, wherever you are. So you don’t have to sit in front of your computer to start things. Just watch it and feel it. This will ease the process when you just have the time to sit in front of the screen and apply what you have seen. It will also motivate you to actually find the time.
- Don’t let issues demotivate you, whether it is a code that you can`t figure out or get working. Or, a piece of software that does not work as you wish. Nothing is perfect, and that applies especially to Scrapy in Windows environment. There is nobody in any field of science who did not fail, so you will get it eventually and more interestingly, you will have learned more from your mistakes. No kidding, it is in fact the failures that will make you genuinely progress. No wonder that the best programmer turns out to be the best debugger and vice versa.
- On the other side of the coin,.. when you get the things rolling. One is tempted to scale up or deviate from the course. It is not uncommon to go to 75-90% of the course with a pace and than suddenly loose the motivation,, or get over motivated to apply the basic skills to an off-scenario case. The latter one is actually a positive thing.
My recommendation is to make use of this urge but in a controlled way.
First find ways to apply your basic skills in projects, and than as you get comfortable with basic concepts, you will be able to dig deeper to solve state-of-the-art web scraping problems (such as in Web Scraping in Python: Create Your Own Middleware in Scrapy)
- And yes, I will not go too far for the perfect follow-on.
As you finish this fundamentals course, you will be in a perfect position to go for a real life challenge… Have a look at it: Follow this link: Python Real World Data Science Mega Project: Car Buyer App
Visit My Udemy Courses for more details and access to the best price promotions.
Take Care of Yourself!