The goal of this lab is to introduce you to R and RStudio, which
you’ll be using throughout the course both to learn the statistical
concepts discussed in the course and to analyze real data and come to
informed conclusions. To clarify which is which: R is the
name of the programming language itself and RStudio is a convenient
interface for working with R . Think of it like this:
This means that you will be working directly in the RStudio environment: all the menu points, typing and coding runs in RStudio. But the engine that performs the calculations is R, which will remain most of the time outside of view.
We will be using a cloud version of RStudio, to do this, follow the steps below:
You should see a window that looks more or less like the image shown below.
Panel (1) on the left is where the action happens. This panel is called the console* or sometomes the command window. Every time you launch RStudio, it will have the same text at the top of the console telling you the version of R that you’re running.
> symbol. As its name suggests, this prompt is really a
request for a command. Initially, interacting with R is all
about typing commands and interpreting the output. In a sense, this is
the most important window, because this is where R actually does
stuff.File 👉
New R script. Just typing a command in the
editor window does not run it. The command must get into the command
window before R executes the command. If you want to run a line from the
script window (or the whole script), you can click Run or press
CTRL+ENTER to send it to the command window.Panel (2) in the upper right contains your environment as well as a history of the commands that you’ve previously entered.
Panel (3) in the lower right contains tabs for
browse the files in your project folder, access help
files for R functions, install and manage R
packages, and inspecting visualizations. By default, all data
visualizations you make will appear directly below the code you used to
create them.
Before starting, we recommend that you configure your RStudio
environment with the follwoing global options First, go to the menu
point Tools 👉 Global Options. Then make sure
the following checkboxes are left unchecked.
General panel, the three restore
options are unchecked,History
section are unchecked, and the
Save workspace to .RData on exit is set to
Never.R Markdown panel, check that the
Show output inline is also unchecked.Code 👉 Display 👉
Syntax check Use rainbow parantheses.R is an open-source programming language, meaning that
users can contribute packages that make our lives easier, and we can use
them for free. For this lab we will use the tidyverse
an “umbrella” package which houses a suite of many different
R packages: for data wrangling and data visualization
In the lower right hand corner click on the Packages tab. Type the name of each of these packages (tidyverse, openintro) into the search box to see if they have been installed.
If your package does not appear when you type its name, you will need to install the missing package by typing the following line of code into the console of your RStudio session. Be sure to press enter/return after each line of code.
You only need to install packages once, but you need to
load them each time you relaunch RStudio. We load packages with
the library function. Type the the following line in your
console to load the tidyverse package into your working environment.
We are choosing to use the tidyverse package because it will help us with loading data, wrangling, visualizing and analyzing it. You can find more about the packages in the tidyverse at tidyverse.org.
We will be using R Markdown to create reproducible lab reports. The
file that we use to create the report has the extension
*.rmd, and consists of three different parts:
R code appears in a gray box, which we call “code chunks.”
The R Markdown file knows that the gray box contains R code
because it begins with three tick marks (```), followed by two curly
braces that contain a lowercase letter r ({r}).One of the features of R Markdown files is that they allow for us to
embed our R code within a written report.
Instead of typing our R code into the console, we
encourage you to type any code you want to save in the R
code chunk associated with each problem. You can execute the
R code you type in these code chunks similar to how you
typed code into the console and pressed enter/return. Within the code
chunk there are a few ways to execute lines of R code:
Ctrl-Enter or Cmd-Enter at the same time,
orR code in a given code
chunk, you can click on the “Play” button in the upper right hand corner
of the code chunk (green sideways triangle).If at any point you need to start over and run all of the code chunks
before a specific code chunk, you click on the “Fastforward” button in
the upper right hand corner of that code chunk (gray upside down
triangle with a bar below). This will run every code chunk that occurred
before that code chunk, but will not execute the
R code included in that code chunk.
The Arbuthnot data set can be loaded into your environment and then
explored, manipulated and visualized using the read_csv
function. The data is stored in an object we call
arputhnot. We store the data in our new object by using an
⬅️.
Again, you can run the code above by:
Ctrl-Enter
or Cmd-EnterThe single line of code included in this code chunk instructs
R to load some data: the Arbuthnot baptism counts for boys
and girls. You should see that the Environment tab in the upper
right hand corner of the RStudio window now lists a data set called
arbuthnot that has 82 observations on 3 variables.
The Arbuthnot data set refers to the work of Dr. John Arbuthnot, an 18th century physician, writer, and mathematician. He was interested in the ratio of newborn boys to newborn girls, so he gathered the baptism records for children born in London for every year from 1629 to 1710.
We can view the data by running the code below or by typing the name
of the dataset into the console. Be careful the spelling and
capitalization you use! R is case sensitive, so if you
accidentally type Arbuthnot R will tell you
that object cannot be found.
This command displays the data for us, however, printing it in the console is not always useful. One advantage of RStudio is that it comes with a built-in data viewer. The Environment tab (in the upper right pane) lists the objects in your environment.
Clicking on the name arbuthnot will open up a Data
Viewer tab next to your R Markdown file, which provides an
alternative display of the data set. Once you are done viewing the data,
You can close this tab by clicking on the x in the upper
left hand corner.
When inspecting the data, you should see four columns of numbers and 82 rows. Each row represents a different year that Arbuthnot collected data. The first entry in each row is the row number, the second is the year, and the third and fourth are the numbers of boys and girls baptized that year, respectively. Use the scrollbar on the right side of the console window to examine the complete data set.
You can see the dimensions of this data frame (number of rows and
columns) as well as the names of the variables and the first few
observations by inserting the name of the dataset into the
glimpse() function, as seen below:
Although we previously said that it is best practice to type all of
your R code into the code chunk, it is better practice to
type this command into your console. Generally, you should type all of
the code that is necessary for your solution into the code chunk.
Because this command is used to explore the data, it is not necessary
for your solution code and should not be included in
your solution file.
This command should output the following:
## Rows: 82
## Columns: 3
## $ year <dbl> 1629, 1630, 1631, 1632, 1633, 1634, 1635, 1636, 1637, 1638, 1639…
## $ boys <dbl> 5218, 4858, 4422, 4994, 5158, 5035, 5106, 4917, 4703, 5359, 5366…
## $ girls <dbl> 4683, 4457, 4102, 4590, 4839, 4820, 4928, 4605, 4457, 4952, 4784…
We can see that there are 82 observations and 3 variables in this
dataset. The variable names are year, boys,
and girls. At this point, you might notice that many of the
commands in R look a lot like functions from math class;
that is, invoking R commands means supplying a function
with some number of inputs (what are called arguments) which the
function uses to produce an output. The glimpse() command,
for example, took a single argument, the name of a data frame and
produced a display of the dataset as an output.
tidyverse library into your environment, and
then load the arbuthnot dataset. Now use the
glimpse function to display its content, and the
dim function to display its dimensions. Write down the
variables associated with the dataset and the number of observations in
your dataset.Let’s start to examine the data a little more closely. We can access
the data in a single column of a data frame by extracting the column
with a $. For example, the code below extracts the
boys column from the arbuthnot data frame.
This command will only show the number of boys baptized each year.
R interprets the $ as saying “go to the data
frame that comes before me, and find the variable that comes after
me.”
Notice that the way R has printed these data is
different. When we looked at the complete data frame, we saw 82 rows,
one on each line of the display. These data have been extracted from the
data frame, so they are no longer structured in a table with other
variables. Instead, these data are displayed one right after another.
Objects that print out in this way are called vectors; similar
to the vectors you have seen in mathematics courses, vectors represent a
list of numbers. R has added numbers displayed in
[brackets] along the left side of the printout to indicate each entry’s
location within the vector. For example, 5218 follows [1],
indicating that 5218 is the first entry in the vector. If
[43] was displayed at the beginning of a line, that
indicate that the first number displayed on that line would correspond
to the 43rd entry in that vector.
R has some powerful functions for making graphics. We
can create a simple plot of the number of girls baptized per year with
the following code:
In this code, we use the ggplot() function to build a
plot. If you run this code chunk, a plot will appear below the code
chunk. The R Markdown document displays the plot below the code that was
used to generate it, to give you an idea of what the plot would look
like in a final report.
The command above also looks like a mathematical function. This time, however, the function requires multiple inputs (arguments), which are separated by commas.
With ggplot():
aesthetic elements of the plot, such as the x and
the y axes.These commands will build a blank plot, with the variables you
assigned to the x and y axes. Next, you need to tell
ggplot() what type of visualization you would like to add
to the blank template. You add another layer to the
ggplot() by:
+ at the end of the line, to indicate that you
are adding a layergeometric object to be used to create
the plot.Since we want to scatterplot, we use geom_point(). This
tells ggplot() that each data point should be represented
by one point on the plot. If you wanted to visualize the above plot
using a line graph instead of a scatterplot, you would replace
geom_point() with geom_line(). This tells
ggplot() to draw a line from each observation with the next
observation (sequentially).
Use the plot to address the following question:
You might wonder how you are supposed to know the syntax for the
ggplot() function. Thankfully, R documents all
of its functions extensively. To learn what a function does and how to
use it (e.g. the function’s arguments), just type in a question mark
followed by the name of the function that you’re interested in into the
console. Type the following in your console:
Notice that the help file comes to the forefront, replacing the plot in the lower right panel. You can toggle between the tabs by clicking on their names.
Now, suppose we want to plot the total number of baptisms. To compute
this, we could use the fact that we can use R as a big
calculator. To do this, we can type in mathematical expressions such as
the below calculation into the console.
This calculation would provide us with the total number of baptisms
in 1629. We could then repeat this calculation once for each year. This
would probably take us a while, but luckily there is a faster way! If we
add the vector for baptisms for boys to that of girls, R
can compute each of these sums simultaneously.
What you will see is a list of 82 numbers. These numbers appear as a
list, because we are working with vectors rather than a data frame. Each
number represents the sum of how many boys and girls were baptized that
year. You can take a look at the first few rows of the boys
and girls columns to see if the calculation is right.
We are interested in using this new vector of the total number of baptisms to generate some plots, so we’ll want to save it as a permanent column in our data frame. We can do this using the following code:
This code has a lot of new pieces to it, so let’s break it down. In
the first line we are doing two things, (1) adding a new
total column to this updated data frame, and (2)
overwriting the existing arbutnot data frame with an
updated data frame that includes the new total column.
We are able to chain these two processes together using the
piping (%>%) operator. The piping
operator takes the output of the previous expression and “pipes it” into
the first argument of the next expression.
To continue our analogy with mathematical functions,
x %>% f(y) is equivalent to f(x, y).
Connecting arbuthnot and
mutate(total = boys + girls) with the pipe operator is the
same as typing mutate(arbuthnot, total = boys + girls),
where arbuthnot becomes the first argument included in the
mutate() function.
A note on piping: Note that we can read these two lines of code as the following:
“Take the arbuthnot dataset and
pipe it into the mutate function. Mutate
the arbuthnot data set by creating a new variable called
total that is the sum of the variables called
boys and girls. Then assign the resulting
dataset to the object called arbuthnot, i.e. overwrite the
old arbuthnot dataset with the new one containing the new
variable.”
This is equivalent to going through each row and adding up the
boys and girls counts for that year and
recording that value in a new column called total.
Where is the new variable? When you make changes to variables in your dataset, click on the name of the dataset again to update it in the data viewer.
You’ll see that there is now a new column called total
that has been tacked onto the data frame. The special symbol
<- performs an assignment, taking the output of
the piping operations and saving it into an object in your environment.
In this case, you already have an object called arbuthnot
in your environment, so this command updates that data set with the new
mutated column.
You can make a line plot of the total number of baptisms per year with the following code:
In an similar fashion, once you know the total number of baptisms for boys and girls in 1629, you can compute the ratio of the number of boys to the number of girls baptized with the following code:
Alternatively, you could calculate this ratio for every year by
acting on the complete boys and girls columns,
and then save those calculations into a new variable named
boy_to_girl_ratio:
You can also compute the proportion of newborns that are boys in 1629 with the following code:
Or you can compute this for all years simultaneously and add it as a
new variable named boy_ratio to the dataset:
Notice that rather than dividing by boys + girls we are
using the total variable we created earlier in our
calculations!
Tip: If you use the up and down arrow keys in the console, you can scroll through your previous commands, your so-called command history. You can also access your command history by clicking on the history tab in the upper right panel. This can save you a lot of typing in the future.
Finally, in addition to simple mathematical operators like
subtraction and division, you can ask R to make comparisons like greater
than, >, less than, <, and equality,
==. For example, we can create a new variable called
more_boys that tells us whether the number of births of
boys outnumbered that of girls in each year with the following code:
This command adds a new variable to the arbuthnot data
frame containing the values of either TRUE if that year had
more boys than girls, or FALSE if that year did not (the
answer may surprise you). This variable contains a different kind of
data than we have encountered so far. All other columns in the
arbuthnot data frame have values that are numerical (the
year, the number of boys and girls). Here, we’ve asked R to create
logical data, data where the values are either
TRUE or FALSE. In general, data analysis will
involve many different kinds of data types, and one reason for using
R is that it is able to represent and compute with many of
them.
In the previous few pages, you recreated some of the displays and
preliminary analysis of Arbuthnot’s baptism data. Your assignment
involves repeating these steps, but for present day birth records in the
United States. The data are stored in a csv file within the
data directory. Load the data frame in a similar way to the
way we’ve loaded the arbuthnot dataset.
# Here is the way we loaded the arbuthnot dataset
arbuthnot <- read_csv("data/arbuthnot.csv")
# Can you now load the `present` dataset?To find the minimum and maximum values of columns, you can use the
functions min() and max() within a
summarize() call, which you will learn more about in the
following lab.
Here’s an example of how to find the minimum and maximum amount of boy births in a year:
Answer the following questions with the present
dataset:
What years are included in this data set? What are the dimensions of the data frame? What are the variable names? How many observations are in your data?
How do these counts compare to Arbuthnot’s? Are they of a similar magnitude?
Make a plot that displays the proportion of boys born over time. What do you see? Does Arbuthnot’s observation about boys being born in greater proportion than girls hold up in the U.S.? What explains the differences you observe? Include a plot in your response. Hint: You should be able to reuse your code from Exercise 3 above, just replace the name of the data frame.
In what year did we see the largest total number of births in the
U.S.? Hint: First calculate the totals and save it as a new
variable. Then, sort your dataset in descending order based on the
total column. You can do this interactively in the data
viewer by clicking on the arrows next to the variable names. To include
the sorted result in your report you will need to use two new functions.
First we use arrange() to sorting the variable. Then we can
arrange the data in a descending order with another function,
desc(), for descending order. The sample code is provided
below.
These data come from reports by the Centers for Disease Control. You
can learn more about them by bringing up the help file using the command
?present.
That was a short introduction to R and RStudio, but you can find more resources for learning R and RStudio on the web. Throughout the course we will be using the suite of R packages from the tidyverse. The book R For Data Science by Grolemund and Wickham is a fantastic resource for data analysis in R with the tidyverse. If you are searching for R code, make sure to also include these package names in your search query. For example, instead of searching “scatterplot in R”, Goggle “scatterplot in R with the tidyverse”.
These may come in handy throughout the semester:
Note that some of the code on these cheatsheets may be too advanced for this course. However the majority of it will become useful throughout the semester.
This lab was forked and adapted from the OpenIntro labs for R and tidyverse.
This
work is licensed under a
Creative
Commons Attribution-ShareAlike 4.0 International License.