Slides 📊

Open the Chapter 1 slides in a new tab

The original PowerPoint slides remain available as a legacy download:

Download Chapter 1 slides (PPTX)

1.1. What Is Statistics?

Welcome to the fascinating world of statistics! Statistics surrounds us daily—from weather forecasts and medical studies to economic reports and political polls. As we begin our journey together this semester, let’s explore some fundamental questions: what exactly is statistics, and what powers its universal presence?

Statistics is a framework for making sense of the real world through data and drawing meaningful conclusions in the face of uncertainty. The American Statistical Association defines statistics as

“the science of learning from data and of measuring, controlling, and communicating uncertainty.”

In the remainder of this section, we will learn how this definition correctly entails the field of statistics by examining its major branches and understanding the role of a statistician in making statistics available for broad audience.

Road Map 🧭

  • Define the four branches of statistics, and understand how they interact.

  • Understand the role of a statistician.

  • Understand what it means to achieve the three stages of statistical competence. Understand where we are now and where we will be at the end of this course.

1.1.1. Primary Branches of Statistics

Statistics is a diverse ecosystem of interconnected components. One way to view statistics is to divide it into four branches: data management, exploratory data analysis, inferential statistics, and predictive analytics.

A. Data Management: Collection, Cleaning, and Storage

Data Collection

A data-collecting process begins with careful planning. This entails

  • defining clear objectives for what you want to achieve with the data,

  • determining the specific questions that need to be answered through the data,

  • developing a detailed plan including timelines, resources needed, roles and responsibilities, and the data types to be recorded.

  • planning for potential challenges and how to address them, and

  • continuously reviewing the data collection process.

Ethical considerations must also be factored in, especially when the procedure involves human participants. It is important to comply with relevant laws and regulations (e.g., FERPA, HIPAA, GDPR), obtain informed consent from all participants, and ensure privacy and confidentiality.

Some widely used collection methods include surveys and questionnaires, interviews, observations, experiments, web scraping, sensor-based and electronic data collection, and document and record reviews.

Data Cleaning

This stage consists of an overall inspection and organization of collected datasets. Some possible issues addressed during this stage are:

  • Correction of errors such as duplicate entries

  • Consolidating data from various sources

  • Resolving conflicts in data types, values, and formats

  • Handling missing data. Different strategy may be chosen depending on the nature of the missing entry. Some possibilities are deletion, imputation (making an educated guess), and flagging (not taking an immediate action other than making a note).

Data cleaning is often a repeated process, especially when new data is collected periodically. It is advisable to maintain comprehensive documentation of the data cleaning steps.

Data Storage

Digital data is generated through everyday activities: sending messages, making purchases, using navigation services, recording scientific measurements, and monitoring equipment. These activities produce data in many forms, including tables, text, images, audio, and video.

Raconteur's historical A Day in Data infographic, showing examples of daily digital activity and a glossary of data units. It includes a forecast of 463 exabytes of data created per day by 2025.

Fig. 1.1 A Day in Data, Raconteur. This historical infographic includes forecasts for 2020, 2021, and 2025; its figures should be read in their original time context.

Describe this figure in detail

Infographic titled “A DAY IN DATA” by Raconteur (logo at the bottom right). It is made of large numbers with short captions, placed among tinted photographs of people using phones, a laptop, a smartwatch, and an aerial view of a car on a forest road. The subtitle reads: “The exponential growth of data is undisputed, but the numbers behind this explosion – fuelled by internet of things and the use of connected devices – are hard to comprehend, particularly when looked at in the context of one day.” Most numbers have a small source name beneath them, given here in parentheses.

Left and center of the poster: 500m tweets are sent every day (Twitter). 4PB of data created by Facebook, including 350m photos and 100m hours of video watch time (Facebook Research). 294bn, captioned “billion emails are sent” (Radicati Group), linked to two forecasts: 306bn emails to be sent each day by 2020 and 320bn emails to be sent each day by 2021. 3.9bn people use emails. 4TB of data produced by a connected car (Intel). 65bn messages sent over WhatsApp and two billion minutes of voice and video calls made (Facebook). A small bar chart compares searches made a day, 5bn (hatched bar), with searches made a day from Google, 3.5bn (shorter solid bar) (Smart insights). A timeline headed “Accumulated digital universe of data” shows a small circle for 4.4ZB in 2013 and a much larger circle for 44ZB in 2020 (PwC).

Right side of the poster: 463EB of data will be created every day by 2025 (IDC), printed in the largest numerals on the poster. 95m photos and videos are shared on Instagram (Instagram Business). 28PB to be generated from wearable devices by 2020 (Statista).

A table headed “Demystifying data units”, with the note “From the more familiar ‘bit’ or ‘megabyte’, larger units of measurement are more frequently being used to explain the masses of data”, lists each unit with its value and size. b, bit: 0 or 1, 1/8 of a byte. B, byte: 8 bits, 1 byte. KB, kilobyte: 1,000 bytes. MB, megabyte: 1,000² bytes, 1,000,000 bytes. GB, gigabyte: 1,000³ bytes, 1,000,000,000 bytes. TB, terabyte: 1,000⁴ bytes. PB, petabyte: 1,000⁵ bytes. EB, exabyte: 1,000⁶ bytes. ZB, zettabyte: 1,000⁷ bytes. YB, yottabyte: 1,000⁸ bytes. The size column writes each number out in full, adding one group of three zeros per row, and ends with 1 followed by 24 zeros for the yottabyte. A footnote reads: “A lowercase ‘b’ is used as an abbreviation for bits, while an uppercase ‘B’ represents bytes.”

The infographic projected that approximately 463 exabytes of data would be created worldwide each day by 2025. This is a daily volume of data creation, not the total amount of data stored worldwide. One exabyte equals one billion gigabytes.

Reading a numerical claim

Always identify what is being counted, the units, the time period, and whether the number is an observation, an estimate, or a forecast. A forecast does not become an observation simply because its target year has passed. Evaluating its accuracy requires a comparable outcome measured or estimated afterward.

An additional source of data is interaction with artificial intelligence systems. People supply prompts, documents, images, and other inputs, while the systems generate responses, code, images, audio, and video. These interactions create records of both human activity and machine-generated content. For statistical analysis, knowing how the data was produced is essential: generated content is not automatically a reliable observation of the real world.

Managing data requires more than providing enough storage space. Data must be organized so that it can be located, interpreted, and used correctly. This includes documenting variable definitions and units, recording sources, maintaining consistent formats, and preserving relationships between different parts of a dataset.

Storage options include files, relational databases, data warehouses, and data lakes, hosted locally or through cloud services. The appropriate choice depends on the data’s size, structure, intended use, and access requirements. Retrieving and protecting stored data may involve database queries, APIs, access controls, encryption, and backups.

In this course, we will work primarily with structured data in manageable volumes, typically arranged as rows of observations and columns of variables. Our focus will be on organizing, summarizing, and analyzing these data. The same principles of clear definitions, careful documentation, and appropriate interpretation remain important at larger scales. .. admonition:: Connection to future chapters

class:

note

Good practices in data collection will be discussed in Chapter 8. Most Computer Assignments will require various steps of data cleaning to suit the questions being addressed.

B. Exploratory Data Analysis

diagram of exploratory data analysis

Fig. 1.2 Exploratory data analysis

Describe this figure in detail

Diagram of a data table turning into summaries. On the left is an empty spreadsheet grid with a shaded header row and four columns. A large arrow points right to three summaries stacked on the right: a histogram of gray bars, a scatterplot of gray dots, and a small table whose header cells read “Center”, “Spread” and “…” above one empty row.

Once we have collected and prepared our data, our first task is to perform Exploratory Data Analysis (EDA). During EDA, key features of the data are visually and numerically summarized through descriptive statistics. Descriptive statistics reveal patterns and detect peculiarities in the dataset.

EDA is typically an iterative process—we examine the data, formulate questions, explore further, refine our understanding, and repeat. This cycle helps us develop hypotheses and determine which inferential methods might be most appropriate for deeper analysis.

Connection to future chapters

Descriptive statistics are introduced in Chapters 2 and 3. The techniques learned here will serve as assisting tools in Chapters 7-13.

C. Inferential Statistics

Perhaps the most powerful branch of statistics, inferential statistics allows us to extend what we learn from samples to conclusions about entire populations. Two major branches of statistical inference are:

Parameter Estimation

diagram of parameter estimation

Fig. 1.3 Parameter estimation

Describe this figure in detail

Diagram in three steps joined by right-pointing arrows. The first step is an empty spreadsheet grid with a shaded header row. The second step is a smaller copy of the summaries from the exploratory data analysis diagram: a histogram, a scatterplot, and a small table with the headers “Center”, “Spread” and “…”. The third step is a face emoji wearing a monocle, with one eyebrow raised, and a speech bubble that asks: “Where is the true mean?” The word “Where” is in bold.

Parameter estimation involves making informed guesses about a key value of the population, such as the mean, median, or variance. This can be done through

  • Point estimation: finding a single “best guess” for the unknown value

  • Interval estimation: constructing a range to which the unknown value is expected to belong

Hypothesis Testing

Hypothesis tests evaluate specific claims against evidence from data. Hypothesis testing can be split into four stages.

  1. Making a claim - usually a “yes or no” question asking if something has changed from a previous belief (status quo)

  2. Gathering evidence through experiment

  3. Assessing the likelihood - does the evidence support the claim?

  4. Making a conclusion

diagram of hypothesis test

Fig. 1.4 Hypothesis testing

Describe this figure in detail

Diagram in three steps joined by right-pointing arrows, with the same first two steps as the parameter estimation diagram: an empty spreadsheet grid, then a histogram, a scatterplot and a small table headed “Center”, “Spread” and “…”. The third step is the same face emoji with a monocle and a raised eyebrow, with a speech bubble that reads: “I suspect the true mean is larger than 3. Is this true, or no?” The words “true, or no” are in bold.

Regardless of the branch, statistical inference always involves the following key elements.

  • Assumption validation: Most inference methods are constructed under a set of assumptions about the data-generating population. They must be verified for each dataset to ensure reliability of the inference results.

  • Uncertainty quantification: The core of statistical inference is the ability to draw conclusions in the face of uncertainty and to numerically express the degree of confidence in the result.

Connection to future chapters

Foundations of parameter estimation and hypothesis testing will be covered in Chapters 9 and 10, respectively. Both will remain relevant for various inference scenarios in Chapters 11-13.

D. Predictive Analytics

Rather than understanding current data, predictive analytics focuses on what might happen next. Predictive analytics often requires large datasets as it relies on patterns and relationships identified in historical data to predict future events. Key elements of predictive analytics are:

  • Modeling of variable relationships: Structuralize the relationship between two or more variables. Use this structure as a tool for making predictions. This model can be as simple as a linear pattern, or as complex as a deep neural network.

  • Prediction: Make educated guesses on unobserved values based on the identified model and the individual’s observed characteristics.

Connection to future chapters

We’ll touch on predictive methods primarily through linear regression, in Chapter 13.

1.1.2. Course Goals: Growing as a Competent Statistician

Having explored what statistics is, let’s consider who practices it. The American Statistical Association defines a statistician as

“a person who applies statistical thinking and methods to a wide variety of scientific, social, and business endeavors.”

This broad definition encompasses professionals working across diverse fields—astronomy, biology, education, economics, engineering, genetics, and many others. This course aims to develop your statistical abilities across three progressively sophisticated levels:

Statistical Literacy

At the most fundamental level, statistical literacy includes:

  • Understanding basic data management principles

  • Exploring data effectively through visual and numerical methods

  • Comprehending the vocabulary and notation statisticians use

  • Grasping how probability serves as the framework for measuring uncertainty

  • Recognizing when particular statistical methods are appropriate

Statistical literacy allows you to read and understand statistical information—the minimum required to be an informed consumer of research and data-based claims.

diagram of three stages of statistical competence
Describe this figure in detail

Three rounded bars of increasing height, left to right, forming a staircase. The shortest bar, on the left, is labeled “Statistical Literacy”; the middle bar is labeled “Statistical Reasoning”; the tallest bar, on the right, is labeled “Statistical Thinking”. The bars get darker blue from left to right.

Statistical Reasoning

Moving beyond literacy, statistical reasoning involves:

  • Applying statistical tools effectively to answer specific questions

  • Interpreting results correctly within their proper context

  • Communicating findings clearly to various stakeholders

With statistical reasoning skills, you can actively engage with data analysis rather than simply consuming others’ conclusions.

Statistical Thinking

The most sophisticated level, statistical thinking encompasses:

  • Understanding how statistical models represent and simulate real-world phenomena

  • Selecting appropriate inferential tools for specific analytical situations

  • Seeing the entire pipeline from data collection through analysis to interpretation

  • Being able to design studies and experiments.

Statistical thinking represents the mindset of a practitioner who can navigate the entire statistical process independently.

While developing complete statistical thinking extends beyond a single course, by semester’s end, you should achieve statistical literacy and begin developing reasoning skills. These capabilities will serve you well regardless of your career path, enhancing your ability to make decisions in our data-rich world.