VBA Selenium Web Scraping

In Part 1, you shall learn below things written. Please go through them.

• We are going to learn Web Scraping using Google Chrome, and it will be done using the Selenium library.

• Learn how to download Selenium and browser drivers to initially do the setup.

• How to work with attributes like name, id, using findElement methods.

• How to work with tags like an A tag and its attribute href to click on the links.

• How to use the class attribute, and is it a good approach to use the class attribute?

• how to work with Xpath to insert the data into textboxes and click on search buttons. Not just use but understand the structure of Xpath as well.

• Learn how we can change the xpath elements by their indexes.

• How to work with header tags like h1 or h2, or h3, using the normal way and using xpath.

• How to run the collection loops and why we need it, and when we can avoid using collection loops.

• What is the difference between Web-element and Webelements, and why do we use the set word for collection elements and not for a single object?

• How to click on links on a webpage using link-text and partial link-text property. Based on this knowledge, one mini project -how to load the website by default on the current date.

• How to scrape tables and their rows and rows of data values and table headers.

• Collection loops design and execution from the very start while working with tables.

• Do you like to export all tables in a website, or do you want to scrape one specific table only? How to reach out to a specific index of a table, then?

• How to scrape specific rows inside one specific table. Know your "tr' tags.

• How to scrape all data inside the rows or just one specific data value using the td tag. It's awesome when you have so much control.

• How to export tables without running collection loops, and what is the difference between direct export and export using loops? You must know.

• How to work with li tags inside unordered and ordered lists.

• Know how to insert a value in drop-down or combo-boxes.

• How to select items in a list box with a single select property or multi multi-select property.

• Learn to select or deselect listbox options using collection loops or without the loops.

• How to alter the collection elements by referring to one object and second inside the first one and so on.
• First and foremost, this is a Part 2. Students must have seen Part 1 before.

• Students will learn how to download the files

• How to add or manage Cookies of a website and how to use them in a practical situation.

• How to take screenshots and save those on the desktop or export them in Excel.

• How to launch new website pages in a new window tab.

• Move from the first window to the second and so on. Challenges and more robust solutions to handle the window tabs.

• You will see one of the real data-based projects, which is super duper awesome for learning and getting confidence in webscraping.

• We will see how to log in to the website and how to sort out captcha issues by simply letting the code wait for some time till the user enters the captcha.

• We will revise our learning in part 1 as to how to practically use links using elementbyid, name or class attributes. Also, the best use of Xpath.

• If the page refreshes for a long time or is uncertain, how to put a wait time.

• You will see the use of magnificent loops and IF Conditions on this project. How smartly we have used the loops and IF Conditions, and clicking on elements.

• In this project, you shall see how to fully control the website elements like drop-downs or a tags from Excel lists, which are written on sheets.

• So far work done is going to be noted in an Excel sheet, marking the status as Done, so next time when the code runs, it avoids previously already done codes.

Who this course is for:

• If you are a Business analyst and want to learn how to scrape websites using Chrome or other major browsers.
• If you like to export website tables into Excel. If you like to click on website links or fill up a form, or download files, etc.