The Data That Actually Matters: Data Collection vs. Data Use

We don’t have a data problem in education.

We have a data use problem.

If you were to walk into almost any classroom in America, you will find data everywhere. Clipboards, tracking sheets, behavior logs, running records, exit tickets, progress monitoring tools, and more. Teachers are collecting data...

All. Day. Long.

BUT...if you were to pause and ask a simple question: What does this data tell us to do next?

The answer can often be much less clear.

We Are Data Rich...But Information Poor

Researchers have often described schools today as “data rich, but information poor.” We collect more data than ever, but struggle to translate it into meaningful instructional decisions.

Teachers collect:

• Academic data

• Behavioral data

• IEP progress data

• Screening and benchmark data

After chairing hundreds (if not thousands) of meetings, I can tell you that I have seen data sit in a binder, spreadsheet or progress report; documented but not actively used...and certainly not for a lack of trying.

The Real Disconnect

Here is the issue.

Data collection has become a task and data use, an underutilized skill. In many cases, we have trained for the first but overlooked the second.

Teachers are constantly told: “Take data,” “monitor progress,” “track goals,” but too often, we haven’t built the systems or time for teams to analyze that data collaboratively and ask the questions that actually drive instruction, such as:

How should this data change our instruction tomorrow?

What decision is this data helping us make?

What Research Has Been Telling Us All Along

This isn’t a new problem.

Dr. Paul Black and Dr. Dylan Wiliam made it clear decades ago: Data doesn’t improve outcomes on its own. It only works when it’s used to adjust teaching.

“For assessment to function formatively, the results have to be used to adjust teaching and learning…”

Dr. John Hattie pushes this even further in his book, Visible Learning for Teachers when he says:

"The most powerful way of thinking about a teacher's role is for teachers to see themselves as evaluators of their effects on students."

But this is where teams often get stuck and not because educators aren’t capable, but because the systems around them don’t always make that work possible.

Using data well requires time to think, space to collaborate, and structures that support real instructional decision-making.

Without that, data doesn’t drive learning— it just documents it.

Finally, Dr. John Sweller's Cognitive Load Theory reminds us that working memory is limited.

When we overload teachers with data systems, tracking tools, and competing demands, we don’t improve instruction, we make decision-making harder.

More data doesn’t just fail to help. It can actively get in the way.

The Cost of Getting This Wrong

When data is collected but not used:

• Instruction stays the same, even when students aren’t progressing

• Interventions are delayed

• Progress reports become vague or reactive

• Teams miss opportunities to adjust in real time

• Parents lose trust in the system

And perhaps most importantly, students lose time we can’t get back.

A Simple but Powerful Shift

Before asking a teacher to collect a single data point, ask:

What decision will this data help us make?

If you don’t have an answer, the data likely won’t serve you...or your students.

Because the goal was never more data...it was better decisions.

What Data Should Actually Do

At its best, data should help you answer three things:

1. Is the student learning?

2. Is the progress sufficient?

3. What should I do next?

If your data can’t answer those questions, it’s not actionable... YET.

The Bottom Line

We don’t need more systems for collecting data

We need better systems for:

• Thinking about it

• Interpreting it

• Acting on it

Because if your data isn’t driving a decision…

it’s just documentation.