+ - 0:00:00
Notes for current slide
Notes for next slide

Basic Course Items and Foundational Concepts

EDP 611

1 / 22

Welcome!

my caption
2 / 22

Your Teachers

Dr. Abhik Roy

Dr. Abhik Roy

Professor
Carrina Ferguson

Ms. Carinna Ferguson

Graduate Teaching Assistant
3 / 22

Overview

You can measure many things Measurement is a principle trait and whether it is hard wired, learned, or some combination of both, its absence makes quantitative data impossible to classify. Even in cases where measures are available, how can we know if they are consistent and accurate? Without these checks, instruments such as surveys could never be constructed, much less yield results that could be generalized.

When assessing existing programs, having an ability to test a hypothesis is key in understanding its goals. While evaluation tells us whether a program is producing results or having an effect/impact, (performance) measurement tells us what a program did and how well it did it. In particular, the latter is a necessity and involves collecting and reporting data that can be used to compartmentalize the way a program is being implemented.

4 / 22

Course Objectives

5 / 22

Course Objectives

Assess the credibility and ethics of measurement practices

5 / 22

Course Objectives

Assess the credibility and ethics of measurement practices

Confidently determining valid and reliable measures

5 / 22

Course Objectives

Assess the credibility and ethics of measurement practices

Confidently determining valid and reliable measures

Interpret and report psychometric properties of tests

5 / 22

Course Objectives

Assess the credibility and ethics of measurement practices

Confidently determining valid and reliable measures

Interpret and report psychometric properties of tests

Recognize measurement in the evaluative process

5 / 22

Course Objectives

Assess the credibility and ethics of measurement practices

Confidently determining valid and reliable measures

Interpret and report psychometric properties of tests

Recognize measurement in the evaluative process

Understand the methods and techniques for establishing and evaluating reliability and validity

5 / 22

Hope

6 / 22

Hope

By the end of this course, you will hopefully become

6 / 22

Hope

By the end of this course, you will hopefully become

  1. literate in the connection between data and measurement principles
6 / 22

Hope

By the end of this course, you will hopefully become

  1. literate in the connection between data and measurement principles

  2. a skeptic of every research question or purpose that you come across

6 / 22

Course Materials

  • eCampus access: for submissions and grades only
7 / 22

Course Materials

7 / 22

Helpful References

To help minimize costs, there is no formal text. We'll rely on the text below which is available through the WVU library in an online capacity barring the APA 7th edition handbook.

8 / 22

Helpful References

To help minimize costs, there is no formal text. We'll rely on the text below which is available through the WVU library in an online capacity barring the APA 7th edition handbook.



Balkin, R. S., & Kleist, D. M. (2016). Counseling Research: A Practitioner-Scholar Approach. American Counseling Association.

Counseling Text
8 / 22

Albano, T. (2020). Introduction to Educational and Psychological Measurement Using R.

Counseling Text
9 / 22

Albano, T. (2020). Introduction to Educational and Psychological Measurement Using R.

Counseling Text



American Psychological Association. (2020). Publication manual of the American Psychological Association (7th ed.).

Counseling Text
9 / 22

Wickham, H., Navarro, D. & Pedersen, T.L. (2021). ggplot2: Elegant Graphics for Data Analysis (2nd and 3rd eds.). Springer.

Counseling Text
10 / 22

Wickham, H., Navarro, D. & Pedersen, T.L. (2021). ggplot2: Elegant Graphics for Data Analysis (2nd and 3rd eds.). Springer.

Counseling Text



Wickham, H. (2021). R for Data Science (1st ed.). O’Reilly Media.

Counseling Text
10 / 22

There will also occasionally be additional articles and videos to read and watch. When this happens, links to these other resources will be included on the content page for that session.

11 / 22

Class Focus on



Content

  • Readings
  • Psychometrics
  • No exams
12 / 22

Class Focus on



Content

  • Readings
  • Psychometrics
  • No exams

Practice

  • R Modules
  • R Walkthroughs
  • Proposal
12 / 22

What I expect

13 / 22

What I expect

  • Keeping an open line of communication
13 / 22

What I expect

  • Keeping an open line of communication

  • Asking questions

13 / 22

What I expect

  • Keeping an open line of communication

  • Asking questions

  • Participating like crazy

13 / 22

What I expect

  • Keeping an open line of communication

  • Asking questions

  • Participating like crazy

  • Meeting with me on Zoom

13 / 22

Assignments and Grades

You can find descriptions for all the assignments on the tasks page.


Percent Task Location
15 R Training Data Camp
15 Reflections Slack
15 R Measurement EDA eCampus/Slack
15 Check-ins Zoom
30 Proposal eCampus/Slack
10 Elevator Pitch eCampus/Slack
14 / 22

The Proposal is scored from a combination of six weekly tasks. The Elevator Pitch and Proposal together is considered to be your final task.

15 / 22

Grading

Grade Range
A 90% – 100%
B 80% - 89%
C 70% – 79%
D 60% – 69%
F < 60%
16 / 22

Things We Cover About Measurement

17 / 22

Things We Cover About Measurement

  • controversies in testing
17 / 22

Things We Cover About Measurement

  • controversies in testing

  • interpretation of test scores norms

17 / 22

Things We Cover About Measurement

  • controversies in testing

  • interpretation of test scores norms

  • test construction and scales

17 / 22

Things We Cover About Measurement

  • controversies in testing

  • interpretation of test scores norms

  • test construction and scales

  • writing and using educational objectives

17 / 22

Keep These in Mind

18 / 22

Keep These in Mind

Measurement

18 / 22

Keep These in Mind

Measurement

  • is the determination of attributes or dimensions of an object, skill or knowledge
18 / 22

Keep These in Mind

Measurement

  • is the determination of attributes or dimensions of an object, skill or knowledge

  • does not care about your feelings or views

18 / 22

Keep These in Mind

Measurement

  • is the determination of attributes or dimensions of an object, skill or knowledge

  • does not care about your feelings or views

  • demands ethics and trust

18 / 22

Common Sense v. Science!

19 / 22

Common Sense v. Science!



Common Sense - Grounded in how we come to know the world

  • Subjective

  • Objective

19 / 22

Common Sense v. Science!



Common Sense - Grounded in how we come to know the world

  • Subjective

  • Objective

Science - Grounded in prominent theoretical constructs

  • Epistemology

  • Methodology

19 / 22

How do we know things?

20 / 22

How do we know things?

  • Beliefs
20 / 22

How do we know things?

  • Beliefs

  • Intuitions

20 / 22

How do we know things?

  • Beliefs

  • Intuitions

  • Logic

20 / 22

How do we know things?

  • Beliefs

  • Intuitions

  • Logic

  • Opinions of others

20 / 22

How do we know things?

  • Beliefs

  • Intuitions

  • Logic

  • Opinions of others

  • Personal experiences

20 / 22

How do we know things?

  • Beliefs

  • Intuitions

  • Logic

  • Opinions of others

  • Personal experiences

  • Scientific method

20 / 22

How do we know things?

  • Beliefs

  • Intuitions

  • Logic

  • Opinions of others

  • Personal experiences

  • Scientific method

  • Sensory experiences

20 / 22

How do we know things?

  • Beliefs

  • Intuitions

  • Logic

  • Opinions of others

  • Personal experiences

  • Scientific method

  • Sensory experiences

  • Traditions

20 / 22

How do we know things?

  • Beliefs

  • Intuitions

  • Logic

  • Opinions of others

  • Personal experiences

  • Scientific method

  • Sensory experiences

  • Traditions

  • Failures!

20 / 22

Human Nature v. Science!

Human Nature

21 / 22

Human Nature v. Science!

Human Nature

Science

21 / 22

Human Nature v. Science!

Human Nature

Science

  • usually observations are inaccurate
21 / 22

Human Nature v. Science!

Human Nature

Science

  • usually observations are inaccurate
  • ensure observations are accurate
21 / 22

Human Nature v. Science!

Human Nature

Science

  • usually observations are inaccurate
  • ensure observations are accurate
  • generalize from a few cases
21 / 22

Human Nature v. Science!

Human Nature

Science

  • usually observations are inaccurate
  • ensure observations are accurate
  • generalize from a few cases
  • explicitly sample for generalizing
21 / 22

Human Nature v. Science!

Human Nature

Science

  • usually observations are inaccurate
  • ensure observations are accurate
  • generalize from a few cases
  • explicitly sample for generalizing
  • observe selectively to see what we’re looking for
21 / 22

Human Nature v. Science!

Human Nature

Science

  • usually observations are inaccurate
  • ensure observations are accurate
  • generalize from a few cases
  • explicitly sample for generalizing
  • observe selectively to see what we’re looking for
  • consciously decide what and how to observe
21 / 22

Human Nature v. Science!

Human Nature

Science

  • usually observations are inaccurate
  • ensure observations are accurate
  • generalize from a few cases
  • explicitly sample for generalizing
  • observe selectively to see what we’re looking for
  • consciously decide what and how to observe
  • make things up to fulfill gaps
21 / 22

Human Nature v. Science!

Human Nature

Science

  • usually observations are inaccurate
  • ensure observations are accurate
  • generalize from a few cases
  • explicitly sample for generalizing
  • observe selectively to see what we’re looking for
  • consciously decide what and how to observe
  • make things up to fulfill gaps
  • base conclusions on evidence alone
21 / 22

Human Nature v. Science!

Human Nature

Science

  • usually observations are inaccurate
  • ensure observations are accurate
  • generalize from a few cases
  • explicitly sample for generalizing
  • observe selectively to see what we’re looking for
  • consciously decide what and how to observe
  • make things up to fulfill gaps
  • base conclusions on evidence alone
  • get personally and emotionally involved
21 / 22

Human Nature v. Science!

Human Nature

Science

  • usually observations are inaccurate
  • ensure observations are accurate
  • generalize from a few cases
  • explicitly sample for generalizing
  • observe selectively to see what we’re looking for
  • consciously decide what and how to observe
  • make things up to fulfill gaps
  • base conclusions on evidence alone
  • get personally and emotionally involved
  • respect scientific norms regardless of opinions
21 / 22

Human Nature v. Science!

Human Nature

Science

  • usually observations are inaccurate
  • ensure observations are accurate
  • generalize from a few cases
  • explicitly sample for generalizing
  • observe selectively to see what we’re looking for
  • consciously decide what and how to observe
  • make things up to fulfill gaps
  • base conclusions on evidence alone
  • get personally and emotionally involved
  • respect scientific norms regardless of opinions
  • form views with little or no revisions and stick with them
21 / 22

Human Nature v. Science!

Human Nature

Science

  • usually observations are inaccurate
  • ensure observations are accurate
  • generalize from a few cases
  • explicitly sample for generalizing
  • observe selectively to see what we’re looking for
  • consciously decide what and how to observe
  • make things up to fulfill gaps
  • base conclusions on evidence alone
  • get personally and emotionally involved
  • respect scientific norms regardless of opinions
  • form views with little or no revisions and stick with them
  • constantly revise views
21 / 22

Human Nature v. Science!

Human Nature

Science

  • usually observations are inaccurate
  • ensure observations are accurate
  • generalize from a few cases
  • explicitly sample for generalizing
  • observe selectively to see what we’re looking for
  • consciously decide what and how to observe
  • make things up to fulfill gaps
  • base conclusions on evidence alone
  • get personally and emotionally involved
  • respect scientific norms regardless of opinions
  • form views with little or no revisions and stick with them
  • constantly revise views
  • think we can figure out everything
21 / 22

Human Nature v. Science!

Human Nature

Science

  • usually observations are inaccurate
  • ensure observations are accurate
  • generalize from a few cases
  • explicitly sample for generalizing
  • observe selectively to see what we’re looking for
  • consciously decide what and how to observe
  • make things up to fulfill gaps
  • base conclusions on evidence alone
  • get personally and emotionally involved
  • respect scientific norms regardless of opinions
  • form views with little or no revisions and stick with them
  • constantly revise views
  • think we can figure out everything
  • accept that not everything is knowable
21 / 22

That's it. If you have questions, please send them along!

22 / 22

Welcome!

my caption
2 / 22
Paused

Help

Keyboard shortcuts

, , Pg Up, k Go to previous slide
, , Pg Dn, Space, j Go to next slide
Home Go to first slide
End Go to last slide
Number + Return Go to specific slide
b / m / f Toggle blackout / mirrored / fullscreen mode
c Clone slideshow
p Toggle presenter mode
t Restart the presentation timer
?, h Toggle this help
oTile View: Overview of Slides
Esc Back to slideshow