CIS2250-Lab 4 Solved

Retrieve a copy of your findFirstNames.pl Perl script from last week’s lab. Decide
with your new partner which of your implementations to use. If you did not get the
previous assignment working, you can download working code from the CourseLink
site for but you will lose 10% of your grade for this lab. You will see this available
as “Emergency Kit: Solution for Lab 3.”
We will now change gears slightly to create code that will track a name’s popularity
across a number of years. This will require changes to the number of files that will
be read in so let us start there.
Copy findFirstName.pl to another file named firstNamesByTime.pl.
Change your code so that instead of reading in one SS name year file you will read
in any number of input files. Your command line will look like the following:
$ p e r l firstNamesByTime . pl 1900 2000 20 querynames . t x t
Here, the first two parameters (1900, 2000) denote the start and end years that
you want to cover in the SS name files, i.e.; yob1900.txt and yob2000.txt.
The next parameter is increment in years for the files in between the start and end
years. So in our example we would be considering all of these files: yob1900.txt,
yob1920.txt, yob1940.txt, yob1960.txt, yob1980.txt, and yob2000.txt.
The last parameter is the file containing the names that you want to examine for
their popularity in the years described in the first three parameters.
The querynames.txt file will have the following format:
name,sex
where sex = F or M (female or male)
For example, see the file listing shown to the right:
Andrew ,M
Kassandra , F
Davis ,M
J u l i a , F
For each name and sex in the querynames.txt file, we want to print out the ranking
from each of the indicated SS files in the format of a new .csv file. This file should
have a header line consisting of the field names “Name,Year,Ranking” and the remaining lines should consist of the data values for one of the names for a given year.
All the data for a given name should appear together, and the years should be in
ascending order.
For example, if we run the following command using the above querynames.txt file,
we should see this output:
$ p e r l firstNamesByTime . pl 1990 2000 3 queryNames . t x t
Name, Year , Ranking
Andrew,1990 ,7
Andrew,1993,10
Andrew,1996,10
Andrew,1999 ,7
Kassandra ,1990,312
Kassandra ,1993,120
Kassandra ,1996,203
Kassandra ,1999,264
Davis ,1990,598
Davis ,1993,461
Davis ,1996,409
Davis ,1999,371
J u l i a ,1990 ,83
J u l i a ,1993 ,72
J u l i a ,1996 ,48
J u l i a ,1999 ,30

Overview
Learning objectives: # Strategies for
processing many files H# Generating
output for use in another program
Programatically processing general
input data G# Introduction to
visualization using ggplot2

Task 2 Description
We will now explore using the Statistics::R package to use the powerful ggplot2
library to produce plots of our data.
You will need to download all of the YoB (Year of Birth) files from CourseLink. You
will find the file, names.zip in the Labs section on CourseLink. This contains all the
YoB files.
Now you can download the Perl script named createNameRankPlot.pl and test it
out with your new output.
Run your code and redirect the output into a file (note that here we are using every
year’s data, not skipping 3 as in the last run):
$ p e r l firstNamesByTime . pl 1990 2000 1 queryNames . t x t plo t1 . t x t
To run the plotting programs (even in the THRN labs) you must do the following
before running createNameRankPlot.pl:
1. Go to the Applications Folder on the machine and double click on R (this is a
statistics program)
2. In R type the following command to load the plotting library (the is the R
prompt):
install.packages("ggplot2")
3. Now you can continue on with your perl programming and createNameRankPlot.pl
will produce lovely PDFs of your plots.
Then run the plotting script:
$ p e r l createNameRankPlot . pl plo t1 . t x t plo t1 . pd f
Then open the PDF file to see what you have created:
$ open plo t1 . pd f
You should see a plot likt this:
● ● ● ● ● ● ● ● ● ● ●
● ●
●
●
●
●
●
●
●
●
●
● ●
●
●
●
● ●
● ● ●
●
●
● ● ● ●
●
●
● ● ● ●
0
200
400
600
1990.0 1992.5 1995.0 1997.5 2000.0
Year
Ranking
Name
●
●
●
●
Andrew
Davis
Julia
Kassandra

Overview
Learning objectives: # Strategies for
processing many files H# Generating
output for use in another program
Programatically processing general
input data G# Introduction to
visualization using ggplot2

Task 3 Description
We can calculate di?erent presentations of data. Examine
the script convertRankingToRankCategory.pl. This script
reads a .csv file and will convert the values in a “Ranking”
column according to the conversion shown to the right.
Run this script to convert the plot1.txt file to a new
plot2.txt file:
Ranking Category
0 0
2000 1
1000–2000 2
500–999 3
200–499 4
100–199 5
50–99 6
10–49 7
1–10 8
$ p e r l convertRankingToRankCategory . pl plo t1 . t x t plo t2 . t x t
The file open plot2.txt will contain the following:
Name, Year , RankCategory
Andrew,1990 ,8
Andrew,1993 ,8
Andrew,1996 ,8
Andrew,1999 ,8
Kassandra ,1990 ,4
Kassandra ,1993 ,5
Kassandra ,1996 ,4
Kassandra ,1999 ,4
Davis ,1990 ,3
Davis ,1993 ,4
Davis ,1996 ,4
Davis ,1999 ,4
J u l i a ,1990 ,6
J u l i a ,1993 ,6
J u l i a ,1996 ,7
J u l i a ,1999 ,7
Creating a plot and then viewing it with produce the plot below:
$ p e r l createNameRankCategoryPlot . pl plo t2 . t x t plo t2 . pd f
● ● ● ● ●
●
● ● ● ● ●
● ● ●
● ● ●
● ● ● ● ●
● ● ●
● ● ● ● ● ● ● ●
● ● ● ● ● ●
● ● ● ● ●
500−999
200−499
100−199
50−99
11−49
1−10
1990.0 1992.5 1995.0 1997.5 2000.0
Year
RankCategory
Name
●
●
●
●
Andrew
Davis
Julia
Kassandra

Overview
Learning objectives: # Strategies for
processing many files H# Generating
output for use in another program
Programatically processing general
input data G# Introduction to
visualization using ggplot2

Image description
A pair of glasses. Image source
Wikipedia CC BY-SA 4.0
Task 4 Description
As a final lab task, consider what the di?erences are between createNameRankPlot.pl
and createNameRankCategoryPlot.pl.
Why does createNameRankPlot.pl not work (it gives an error) when it is run on the
data in plot2.txt?
Complete the Quiz in Courselink that is part of Lab 4 to provide your answer, and
be sure to upload your firstNameByTime.pl file, along with the plot1.pdf and
plot2.pdf visualization files that you created