Explore

Web Scraping with JavaScript & Node.js

8.5 hours on-demand video

$ 12.99

Save Course

Go to Course

Brief Introduction

Build your own web scraper. Fetch and process data from whatever website you want!

Description

[ NEW RE-RECORDED VERSION! ]

Have you heard about Mark Zuckerberg? He has invented Facebook. But before that, he created site called FaceMash. The goal of that project was to compare 2 girls and choose which one is hotter. They weren't just random girls. They were college students. People knew them and that was the point.

But how Mark got all those girl's photos? It's simple. He fetched them from public search of colleges.

He wrote some script to do that for him, because downloading manually all those pictures would've taken a lot of time.

And this is similar to what we are going to do in this course.

We are going to fetch people's profiles from website called Badoo and filter them by names.

Basically this idea stands even for Google search.

Google is parsing pages from the internet and then filter collected data.

This is exactly what we you're going to learn in this course.

You'll learn how to use JavaScript and Node.js to fetch HTML code from every website you want!

You'll create a project with following features:

Getting HTML code from any URL you want with Node.js
Parsing HTML code to the DOM with JSDOM library
Filtering parsed DOM by user names
Passing form values with query strings to Node.js
noUiSlider library for nicely looking age range slider
Express framework

It's worth mentioning that every lecture has it's own source code files. So if you will somehow stuck you can always compare your code with code from particular lecture.

Now here's the question:

Do you want to effectively learn Node.js with modern JavaScript by creating your own web scraper?

If so, just enroll in this course now.

Requirements

Requirements
Modern browser and code editor
Basic knowledge of JavaScript

Knowledge

Using Nodejs
Creating and running scripts from packagejson file
Using Nodemon for auto refreshing changes in Nodejs code
Declaring port number for Nodejs server as environment variable
Setting up Nodejs server with Express framework
Serving static files with Express framework
Fetching and parsing HTML code from urls with JSDOM library
Filtering parsed DOM by user names
Creating recursive functions
Fetching data from URL in front-end JavaScript code with fetch API
Inserting custom HTML code into a DOM
Creating range sliders with noUiSlider library
Passing data from front-end to back-end code with query string
Using ES6 syntax
Refactoring code

Recommended for you

NodeJS - The Complete Guide (MVC, REST APIs, GraphQL, Deno)

Master Node JS & Deno. js, build REST APIs with Node. js, GraphQL APIs, add Authentication, use MongoDB, SQL & much more!...

Save Course

Git a Web Developer Job: Mastering the Modern Workflow

Learn Git, GitHub, Node. js, NPM, Object-oriented JavaScript, ES6, webpack, Netlify, BEM and Job Interview Tips In this course we’ll bridge that gap by building a mobile-first responsive website, together, step-by-step....

Save Course

Let's develop a message-driven microservices application

Learn how to build scalable applications using multiple frameworks and languages in one knowledge-packed crash course Dive into modern application development while you build a web scraping service from scratch....

Save Course