Coursework Description

Task Name: Data Engineering and Pre-processing

Data pre-processing and engineering is a very important step in statistical
data mining. This step might look straightforward, but it can easily be a
nightmare. This could be due to any number of difficulties, including:  1) the
nature of the problem, 2) the number of variables and their types (i.e.
numerical, categorical etc), and 3) Selecting the correct transformation if a
transformation is required.

In this task, you will implement several data pre-processing and engineering
steps that are common in data science and machine learning. These steps
involve several key topics in statistics.

You are expected to learn some simple techniques that are required to finish
this task (this is if you do not already know them). There will be a video
explaining the task further in order to assist you.

Data description, the dataset you will use for this task contains data about
house sale prices. The file ‘data_description.txt’ contains a detailed description of all the variables, what they represent, their values and so on.
The target variable is ‘SalePrice’, which is the house’s sale price in US
dollars.