What Data Actually Matters (And What to Let Go)

We collect data all day long. But when it comes time to make decisions…things get a lot less clear. This article is all about fixing that: what data actually matters, and what we can finally let go of.

Samantha Scaturro

3/30/20262 min read

In the last article, we named the problem:

Not all data is useful. And some data...

just creates noise.

If that’s the case, we need to decide:

What data actually matters?

Starting With the End in Mind

Most teams start in the wrong place.

They ask: 👉 What data should we collect?

But that question skips the most important step.

Instead, start here:

👉 What decision are we trying to make?

Because data only becomes valuable when it helps you do something differently.

The Shift: From Collection to Clarity

Not all data serves the same purpose.

Some data:

  • Helps you understand where a student is

  • Helps you track if progress is happening

  • Helps you decide what to do next

And some data…does none of those things.

It just fills a binder or spreadsheet.

A Simple Filter for What Actually Matters

Before collecting (or continuing) any data point, ask:

  1. What decision will this data inform? If there’s no clear decision, the data won’t drive action.

  2. How often will we review it? If it’s not reviewed consistently, it won’t impact instruction.

  3. What will we do differently if the data changes? If nothing changes, the data isn’t necessary.

If you can’t clearly answer all three, it’s not essential.

What This Looks Like in Practice

Take a student working on a reading comprehension goal.

It’s easy to start collecting:

  • Weekly comprehension scores

  • Running records

  • Exit tickets

  • Summative scores

  • Multiple progress monitoring tools

But then we have piles and piles of data sheets that need to be translated into spreadsheets or graphs- IF we even have the time to do so!)

Instead, start with the end in mind:

  • Is the student's comprehension improving at a rate that will help them achieve their goal and close their achievement gap?

Then simplify:

  • One consistent measure of comprehension

  • A set review point (i.e., every two weeks)

  • A clear plan for what changes if progress isn't there

Same goal. Less noise.

More clarity.

Why This Works

When data is aligned to decision:

  • Patterns become easier to see

  • Teams focus on what matters

  • Decisions happen faster

  • Instruction becomes more responsive

  • Parents better understand their child's learning

  • Meetings become more efficient

And most importantly-

Students benefit from faster, clearer instructional adjustments.

What to Let Go Of

This is the harder part and as educators, we often avoid this.

Some data sticks around not because it’s useful, but because it’s always been there. It’s familiar.

So the question becomes:

  • Are we using this data to make a decision?

  • Or are we collecting it out of habit?

Because if it’s not informing instruction it’s not essential. It’s noise and it’s overwhelming teachers, students, and their families.

The Bottom Line

Better data systems don’t start with more tools.

They start with better questions.

When data is aligned to decisions, it stops being overwhelming...

And starts being useful.