How to calcualte pearson correlation

424 Shares

Posted by: admin 1 year, 11 months ago

Analysis of correlation and significance of parameters

Correlation

The study of the significance of the impact of input parameters on output parameters should begin with the analysis of the correlation of individual parameters. Three basic dependencies can be checked:

monotonic linear
monotonic non-linear
square

Pearson's correlation coefficient (monotonic linear relationship)

The most basic measure determining whether there is a linear correlation between parameters $x_{i}$ i $y_{i}$ is the Pearson correlation coefficient:

r_{p} = \frac{\sum_{i = 1}^{n} (x_{i} - \bar{x}) (y_{i} - \bar{y})}{\sqrt{\sum_{i = 1}^{n} (x_{i} - \bar{x})^{2}} \sqrt{\sum_{i = 1}^{n} (y_{i} - \bar{y})^{2}}}

where $\bar{x}$ and $\bar{y}$ mean the mean values of the relevant parameters.

This formula can be simplified to

r_{p} = \frac{c o v (x, y)}{\sqrt{v a r (x) v a r (y)}}

where $x = [x_{1}, x_{2}, . . .], y = [y_{1}, y_{2}, . . .]$

Spearman's correlation coefficient (monotonic non-linear relationship)

Spearman's rank correlation coefficient is more universal because it allows to determine the strength of monotonic correlation, which may be non-linear and is expressed by the relation:

r_{s} = \frac{\sum_{i = 1}^{n} (R_{i} - \bar{R}) (S_{i} - \bar{S})}{\sqrt{\sum_{i = 1}^{n} (R_{i} - \bar{R})^{2}} \sqrt{\sum_{i = 1}^{n} (S_{i} - \bar{S})^{2}}}

where $R_{i}$ is the rank of the observation $x_{i}$ , $S_{i}$ is the rank of the observation $y_{i}$ and $\bar{R}$ i $\bar{S}$ are the mean values of the respective ranks $R_{i}$ and $S_{i}$ .

Interpretation of the correlation coefficient value

Correlation type:

$r_{s}$ > 0 positive correlation – when the value of X increases, so does Y
$r_{s}$ = 0 no correlation – when X increases, Y sometimes increases and sometimes decreases
$r_{s}$ < 0 negative correlation – when X increases, Y decreases

Correlation strength:

$| r_{s} | < 0.2$ – no linear relationship
$0.2 \leq | r_{s} | < 0.4$ - weak dependence
$0.4 \leq | r_{s} | < 0.7$ – moderate dependency
$0.7 \leq | r_{s} | < 0.9$ - quite a strong relationship
$| r_{s} | \geq 0.9$ - very strong dependence

Quadratic correlation coefficient

The quadratic correlation coefficient is determined on the basis of regression analysis.

Error sum of squares $S S E$ is designated as

S S E = \sum_{i = 1}^{n} (y_{i} - {\hat{y}}_{i})^{2}

After performing the approximation with a polynomial of the second degree (i.e. determining the coefficients $a_{2}, a_{1}, a_{0}$ ) ${\hat{y}}_{i}$ is determined by substitution $x_{i}$ to the formula of the approximating function

{\hat{y}}_{i} = a_{2} {x_{i}}^{2} + a_{1} x_{i} + a_{0}

total sum of squares $S S T$ to

S S T = \sum_{i = 1}^{n} (y_{i} - \bar{y})^{2}

The correlation coefficient is determined from the relationship

r_{q} = \sqrt{1 - \frac{S S E}{S S T}}

Statistical testing of the significance of the correlation coefficient

To determine whether the determined correlation coefficient is statistically significant, it is necessary to make a null hypothesis

H_{0} : δ = 0

meaning that there is no correlation between the parameters. The alternative hypothesis has the form

H_{1} : δ \neq 0

It is assumed that the statistic takes the Student's t-distribution o $k = n - 2$ degrees of freedom and hence, for example, for the Pearson correlation coefficient, the value of the statistics is

t = r_{p} \sqrt{\frac{n - 2}{1 - r_{p}^{2}}}

The value of the test statistic cannot be determined when $r_{p} = 1$ the $r_{p} = - 1$ or when $n < 3$ .

In other cases, the value determined on its basis $p$ (read from the Student's t-distribution) is compared with the assumed significance level $α$

if $p \leq α$ we reject it $H_{0}$ accepting $H_{1}$
if $p > α$ there is no reason to reject it $H_{0}$

Typically, a significance level is selected $α = 0.05$ , agreeing that in 5% of situations we will reject the null hypothesis when it is true.

The same is done for the other correlation coefficients instead $r_{p}$ substituting $r_{s}$ the $r_{q}$ .

Comments

Tech Transport Mobile Gadgets

424 Shares 4 Comments

Latest posts

Fixing the issue in assumption of OLS step by step or one by one

Recent news

Hi, I want to raise the issue related to know whether your OLS is ok or not.

Meaning of 45 degree in economics chart

Recent news

The **45-degree line** in economics and geometry refers to a line where the values on the x-axis and y-axis are equal at every point. It typically has a slope of 1, meaning that for every unit increase along the horizontal axis (x), there is an equal unit increase along the vertical axis (y). Here are a couple of contexts where the 45-degree line is significant:

hyperinflation in hungary

Recent news

The **hyperinflation in Hungary** in the aftermath of World War II (1945–1946) is considered the worst case of hyperinflation in recorded history. The reasons behind this extreme economic event are numerous, involving a combination of war-related devastation, political instability, massive fiscal imbalances, and mismanagement of monetary policy. Here's an in-depth look at the primary causes:

what is neutrailty of money

Recent news

**Neutrality of money** is a concept in economics that suggests changes in the **money supply** only affect **nominal variables** (like prices, wages, and exchange rates) and have **no effect on real variables** (like real GDP, employment, or real consumption) in the **long run**.

Japan deflationary phenomenon

Recent news

Deflation in Japan, which has persisted over several decades since the early 1990s, is a complex economic phenomenon. It has been influenced by a combination of structural, demographic, monetary, and fiscal factors. Here are the key reasons why deflation occurred and persisted in Japan:

What the tips against inflation

Recent news

Hedging against inflation involves taking financial or investment actions designed to protect the purchasing power of money in the face of rising prices. Inflation erodes the value of currency over time, so investors seek assets or strategies that tend to increase in value or generate returns that outpace inflation. Below are several ways to hedge against inflation:

Long and short run philip curve

Recent news

The **Phillips Curve** illustrates the relationship between inflation and unemployment, and how this relationship differs in the **short run** and the **long run**. Over time, economists have modified the original Phillips Curve framework to reflect more nuanced understandings of inflation and unemployment dynamics.

How the government deal with inflation (monetary and fiscal) policies

Recent news

Dealing with inflation requires a combination of **fiscal and monetary policy** tools. Policymakers adjust these tools depending on the nature of inflation—whether it's **demand-pull** (inflation caused by excessive demand in the economy) or **cost-push** (inflation caused by rising production costs). Below are key approaches to controlling inflation through fiscal and monetary policy.

1 month, 1 week ago

More News »

How to calcualte pearson correlation

Posted by: admin 1 year, 11 months ago

Analysis of correlation and significance of parameters

Correlation

Pearson's correlation coefficient (monotonic linear relationship)

Spearman's correlation coefficient (monotonic non-linear relationship)

Interpretation of the correlation coefficient value

Quadratic correlation coefficient

Statistical testing of the significance of the correlation coefficient

Comments

Riddles

Knows deeper about Cyclical Risk

Latest posts

Fixing the issue in assumption of OLS step by step or one by one

2 days ago

Meaning of 45 degree in economics chart

1 month ago

hyperinflation in hungary

1 month, 1 week ago

what is neutrailty of money

1 month, 1 week ago

Japan deflationary phenomenon

1 month, 1 week ago

What the tips against inflation

1 month, 1 week ago

Long and short run philip curve

1 month, 1 week ago

How the government deal with inflation (monetary and fiscal) policies

1 month, 1 week ago

Latest comments

Editor Corner