...

Web Monkey

scrapy-course-python-web-scraping-for-beginners

Scrapy Course – Python Web Scraping for Beginners

The Scrapy Beginners Course will teach you everything you need to learn to start scraping websites at scale using Python Scrapy. The course covers: – Creating your first Scrapy spider – Crawling through websites & scraping data from each page – Cleaning data with Items & Item Pipelines – Saving data to CSV files, MySQL & Postgres databases – Using fake user-agents & headers to avoid getting blocked – Using proxies to scale up your web scraping without getting banned – Deploying your scraper to the cloud & scheduling it to run periodically ??…
Read More
Test your Drupal website with Cypress

Test your Drupal website with Cypress

If you don’t include tests in your Drupal development, chances are it’s because you think it adds complexity and expense without benefit. Cypress is an open source tool with many benefits: Reliably tests anything that runs in a web browser Works on any web platform (it’s great for testing projects using front-end technologies like React) Highly extensible Increasingly popular Easy to learn and implement Protects against regression as your projects become more complex Can make your development process more efficient This article covers three topics to help you start testing your Drupal project using Cypress: Installing Cypress Writing and running basic tests using Cypress Customizing Cypress for Drupal Install Cypress For the purposes of this tutorial I’m assuming that you have built a local dev environment for your Drupal project using the `drupal/recommended-project` project.…
Read More