The Statistics You Need

The Statistics You Need: The Middle and the Spread, How Two Columns Move Together.

Updated

  1. The Middle and the Spread (Apprentice): A column of numbers is summed up by its middle, the mean (the average) or the median (the middle value, which one extreme value can't drag), and by its spread, the standard deviation (how far values typically sit from the mean), the percentiles and the range, which statistics and describe() work out and a histogram shows.
  2. How Two Columns Move Together (Apprentice): A scatter plot shows whether two columns move together, and Pearson's correlation, read "r", puts it in one number from -1 to 1 (statistics.correlation for two lists, df.corr() for a whole table), but r only measures straight-line patterns, a weak r can hide a real effect, and moving together isn't causing.