Starting from:
$30
CS4375-Homework 1 Data Exploration with R and C++ Solved
• Learn how to use R for data exploration and become familiar with the R environment.
• Write a C++ program to perform some basic data exploration.
Part 1: Rstudio Data Exploration
For each step below, place your code in the grey {r} boxes, and place comments and answers to questions in the white space above the code which you will label with a step number comment like this: # Step 1, which makes ‘Step 1’ into a large heading.
1. Create a new .Rmd file. Load library MASS. The first time you use a library you will have to install it, but do that at the console, not in your R code. After you load the library, look at the Environment pane in the upper right corner of RStudio. Notice that Boston is listed as <Promise. When you load the package, R will be aware of the datasets in the package but won’t waste memory loading them until you use the data. We want to use the Boston data set, so load that into memory with data(Boston). Use the str() function to get an overview of the data. Type ?Boston at the console (not in your code) and you will see a description of the data set in the lower right hand corner of Rstudio. Write a brief 2-3 sentence description of the data set in the white text portion of your answer for #1.
2. Use R commands to:
a. display the first few rows
b. display the last 2 rows
c. display row 5
d. display the first few rows of column 1 by combining head() and indexing
e. display the variable names
3. Use R statistical functions to find the mean, median, range of the crime column.
4. Create a histogram of the crime column, with an appropriate main heading. What does the histogram tell you about this variable?
5. Use the cor() function to see if there is a correlation between crime and the median house value. Comment on what this value might mean. How useful might the crime column be for predicting median value?
6. Create a plot showing the median value on the y axis and number of rooms on the x axis. Create appropriate main, x and y labels, change the point color and style. Reference:
http://www.statmethods.net/advgraphs/parameters.html Use the cor() function to quantify
the correlation between these two variables. Write a sentence summarizing what the graph and correlation tell you about these 2 variables.
7. Use R functions to determine if variable chas is a factor. Plot median value on the y axis and chas on the x axis. Make chas a factor and plot again. Comment on the difference in meaning of the two graphs. Look back the description of the Boston data set you got with the ?Boston command to interpret the meaning of 0 and 1.
8. Explore the rad variable. What kind of variable is rad? What information do you get about this variable with the summary() function? Does the unique() function give you additional information? Use the sum() function to determine how many neighborhoods have rad equal to 24. Use R code to determine what percentage this is of the neighborhoods.
9. Create a new variable called “far” using the ifelse() function that is TRUE if rad is 24 and false otherwise. Make the variable a factor. Plot far and medv. What does the graph tell you?
10. Create a summary of Boston just for columns 1, 6, 13 and 14 (crim, rm, lstat, medv). Use the which.max() function to find the neighborhood with the highest median value. Display that row from the data set, but only columns 1, 6, 13 and 14. Write a few sentences comparing this neighborhood and the city as a whole in terms of: crime, number of rooms, lower economic percent, median value.
Part 2: C++ Program
In this course we will get some experience writing machine learning algorithms from scratch in C++, and comparing performance to R. Part 2 of Homework 1 is designed to lay the foundation for writing custom machine learning algorithms in C++.
To complete Part 2, first you will need to export the Boston data frame from within R with a function like write.csv(), and then copy the csv file to your C++ folder. You can just export the rm and medv columns to make reading the file easier in C++.
1. Read the csv file (now reduced to 2 columns) into 2 vectors of the appropriate type.
2. Write the following functions:
a. a function to find the sum of a numeric vector
b. a function to find the mean of a numeric vector
c. a function to find the median of a numeric vector.
d. a function to find the range of a numeric vector
e. a function to compute covariance between rm and medv (see formula below)
f. a function to compute correlation between rm and medv (see formula below); Hint:
sigma of a vector can be calculated as the square root of variance(v, v)
3. Call the functions described in a-d for rm and for medv. Call the covariance and correlation functions. Print results for each function.
Element
Points
Program run correctly (R and C++)
20 points: 10 pts each program (R, C++)
Appropriate comments and white space
20 points: 10 pts each program (R, C++)
Part 1: Steps 1-10
30 points
Part 2: Steps 1-3
30 points
Formulas:
• Write a C++ program to perform some basic data exploration.
Part 1: Rstudio Data Exploration
For each step below, place your code in the grey {r} boxes, and place comments and answers to questions in the white space above the code which you will label with a step number comment like this: # Step 1, which makes ‘Step 1’ into a large heading.
1. Create a new .Rmd file. Load library MASS. The first time you use a library you will have to install it, but do that at the console, not in your R code. After you load the library, look at the Environment pane in the upper right corner of RStudio. Notice that Boston is listed as <Promise. When you load the package, R will be aware of the datasets in the package but won’t waste memory loading them until you use the data. We want to use the Boston data set, so load that into memory with data(Boston). Use the str() function to get an overview of the data. Type ?Boston at the console (not in your code) and you will see a description of the data set in the lower right hand corner of Rstudio. Write a brief 2-3 sentence description of the data set in the white text portion of your answer for #1.
2. Use R commands to:
a. display the first few rows
b. display the last 2 rows
c. display row 5
d. display the first few rows of column 1 by combining head() and indexing
e. display the variable names
3. Use R statistical functions to find the mean, median, range of the crime column.
4. Create a histogram of the crime column, with an appropriate main heading. What does the histogram tell you about this variable?
5. Use the cor() function to see if there is a correlation between crime and the median house value. Comment on what this value might mean. How useful might the crime column be for predicting median value?
6. Create a plot showing the median value on the y axis and number of rooms on the x axis. Create appropriate main, x and y labels, change the point color and style. Reference:
http://www.statmethods.net/advgraphs/parameters.html Use the cor() function to quantify
the correlation between these two variables. Write a sentence summarizing what the graph and correlation tell you about these 2 variables.
7. Use R functions to determine if variable chas is a factor. Plot median value on the y axis and chas on the x axis. Make chas a factor and plot again. Comment on the difference in meaning of the two graphs. Look back the description of the Boston data set you got with the ?Boston command to interpret the meaning of 0 and 1.
8. Explore the rad variable. What kind of variable is rad? What information do you get about this variable with the summary() function? Does the unique() function give you additional information? Use the sum() function to determine how many neighborhoods have rad equal to 24. Use R code to determine what percentage this is of the neighborhoods.
9. Create a new variable called “far” using the ifelse() function that is TRUE if rad is 24 and false otherwise. Make the variable a factor. Plot far and medv. What does the graph tell you?
10. Create a summary of Boston just for columns 1, 6, 13 and 14 (crim, rm, lstat, medv). Use the which.max() function to find the neighborhood with the highest median value. Display that row from the data set, but only columns 1, 6, 13 and 14. Write a few sentences comparing this neighborhood and the city as a whole in terms of: crime, number of rooms, lower economic percent, median value.
Part 2: C++ Program
In this course we will get some experience writing machine learning algorithms from scratch in C++, and comparing performance to R. Part 2 of Homework 1 is designed to lay the foundation for writing custom machine learning algorithms in C++.
To complete Part 2, first you will need to export the Boston data frame from within R with a function like write.csv(), and then copy the csv file to your C++ folder. You can just export the rm and medv columns to make reading the file easier in C++.
1. Read the csv file (now reduced to 2 columns) into 2 vectors of the appropriate type.
2. Write the following functions:
a. a function to find the sum of a numeric vector
b. a function to find the mean of a numeric vector
c. a function to find the median of a numeric vector.
d. a function to find the range of a numeric vector
e. a function to compute covariance between rm and medv (see formula below)
f. a function to compute correlation between rm and medv (see formula below); Hint:
sigma of a vector can be calculated as the square root of variance(v, v)
3. Call the functions described in a-d for rm and for medv. Call the covariance and correlation functions. Print results for each function.
Element
Points
Program run correctly (R and C++)
20 points: 10 pts each program (R, C++)
Appropriate comments and white space
20 points: 10 pts each program (R, C++)
Part 1: Steps 1-10
30 points
Part 2: Steps 1-3
30 points
Formulas:
1 file (15.2KB)
