Web Scraping and Mapping Dam Levels in Python and Linux

Welcome to the Web Scraping and Mapping Dam Levels in Python and Leaflet Linux Version course. We'll be building a python GIS application from scratch using a variety of open source technologies. The purpose of this course and many more to follow, is to learn to create geospatial analytics and convert it into a functional application.

In our use case we will be working with dam storage levels data and we will be web scraping and data processing techniques to extract transform and load the data into our spatial database. Once we have processed and cleaned the data, we will use it as a data source for building our GeoDjango Web Map Application.

We will be powering our application with a PostgreSQL and PostGIS database. In the Front-End we'll use Bootstrap, JavaScript, Leaflet and Ajax. On the server side we'll be using Python and Django combined with use of scientific libraries like pandas, for our data transformation and conversion operations. The operating system that we will be working on is Ubuntu Linux LTS.

Some skills that you can expect to derive after completing the course are the following:

• You will learn how to apply web scraping to collect dam level data from a website.

• You will learn how to use the Django Template Engine instead of Ajax, to pass data from the back-end to the front-end.

• You will learn how to build a Spatial Database using Postgresql and PostGIS.

• You will learn how to create charts with Chart.js.

• You will learn to build Web Maps with Leaflet.js.

• You will learn how to build REST API Endpoints.

• You will learn some JavaScript programming.

• You will learn how to build Web Applications using the Django MVC framework.

• You will also learn how to build a small dashboard that floats over your map, which will contain graphs that will visualize your model.