From the course: How to Measure Anything in AI: Quantitative Techniques for Decision-Making
Unlock this course with a free trial
Join today to access over 24,900 courses taught by industry experts.
AI measurement methods
From the course: How to Measure Anything in AI: Quantitative Techniques for Decision-Making
AI measurement methods
- We've discussed the concept of measurement, recognizing that measurement is actually a reduction in uncertainty based on observation and not an exact point. We also discussed the object of measurement, precisely defining what it is we're trying to measure. Now, we will review misconceptions about the methods of measurement. Later, after we've addressed the misconception, we can get into more specific details about how to conduct such measurements. There has been a lot of research into common misconceptions related to measurement and statistics in general. Two researchers, Daniel Kahneman, who won the Nobel Prize in economics in 2002 and Amos Tversky conducted surveys on the understanding of random sampling. Their surveys showed that many people, including some trained scientists, had what they called strong intuitions about random sampling, which were wrong in fundamental respects. Our observations with clients agree with what these researchers found. Here's a list of things we've…