Misplaced Pages

Rademacher distribution: Difference between revisions

Article snapshot taken from Wikipedia with creative commons attribution-sharealike license. Give it a read and then ask your questions in the chat. We can research this topic together.
Browse history interactively← Previous editNext edit →Content deleted Content addedVisualWikitext
Revision as of 16:22, 14 May 2013 editDrMicro (talk | contribs)19,885 edits Bounds on sums← Previous edit Revision as of 16:26, 14 May 2013 edit undoDrMicro (talk | contribs)19,885 editsm Bounds on sumsNext edit →
Line 54: Line 54:


where || ||<sub>2</sub> is the quadratic norm.<ref name=Montgomery-Smith1990>Montgomery-Smith SJ (1990) The distribution of Rademacher sums. Proc Amer Math Soc 109: 517-522</ref> where || ||<sub>2</sub> is the quadratic norm.<ref name=Montgomery-Smith1990>Montgomery-Smith SJ (1990) The distribution of Rademacher sums. Proc Amer Math Soc 109: 517-522</ref>


If ||''y''<sub>i</sub>||<sub>1</sub> is finite then

<math> P( \sum ( x y_i ) > t || x ||_1 ) = 0 </math>


==Applications== ==Applications==

Revision as of 16:26, 14 May 2013


Rademacher
Support k { 1 , 1 } {\displaystyle k\in \{-1,1\}\,}
PMF f ( k ) = { 1 / 2 , k = 1 1 / 2 , k = 1 {\displaystyle f(k)={\begin{cases}1/2,&k=-1\\1/2,&k=1\end{cases}}}
CDF F ( k ) = { 0 , k < 1 1 / 2 , 1 k < 1 1 , k 1 {\displaystyle F(k)={\begin{cases}0,&k<-1\\1/2,&-1\leq k<1\\1,&k\geq 1\end{cases}}}
Mean 0 {\displaystyle 0\,}
Median 0 {\displaystyle 0\,}
Mode N/A
Variance 1 {\displaystyle 1\,}
Skewness 0 {\displaystyle 0\,}
Excess kurtosis 2 {\displaystyle -2\,}
Entropy ln ( 2 ) {\displaystyle \ln(2)\,}
MGF cosh ( t ) {\displaystyle \cosh(t)\,}
CF cos ( t ) {\displaystyle \cos(t)\,}

In probability theory and statistics, the Rademacher distribution (named after Hans Rademacher) is a discrete probability distribution which has a 50% chance for either 1 or -1.

Mathematical formulation

The probability mass function of this distribution is

f ( k ) = { 1 / 2 if  k = 1 , 1 / 2 if  k = + 1 , 0 otherwise. {\displaystyle f(k)=\left\{{\begin{matrix}1/2&{\mbox{if }}k=-1,\\1/2&{\mbox{if }}k=+1,\\0&{\mbox{otherwise.}}\end{matrix}}\right.}

It can be also written as a probability density function, in terms of the Dirac delta function, as

f ( k ) = 1 2 ( δ ( k 1 ) + δ ( k + 1 ) ) . {\displaystyle f(k)={\frac {1}{2}}\left(\delta \left(k-1\right)+\delta \left(k+1\right)\right).}

Bounds on sums

Let x be a random variable with a Rademacher distribution. Let yi be a sequence of real numbers. Then

P ( ( x y i ) > t | | x | | 2 ) e t 2 2 {\displaystyle P(\sum (xy_{i})>t||x||_{2})\leq e^{\frac {t^{2}}{2}}}


where || ||2 is the quadratic norm.


If ||yi||1 is finite then

P ( ( x y i ) > t | | x | | 1 ) = 0 {\displaystyle P(\sum (xy_{i})>t||x||_{1})=0}

Applications

The Rademacher distribution has been used in bootstrapping.

The Rademacher distribution can be used to show that normally distributed and uncorrelated does not imply independent.

Related distributions

  • Bernoulli distribution: If X has a Rademacher distribution then X + 1 2 {\displaystyle {\frac {X+1}{2}}} has a Bernoulli(1/2) distribution.

References

  1. Hitczenko P, Kwapień S (1994) On the Rademacher series. Progress in probability 35: 31-36
  2. Montgomery-Smith SJ (1990) The distribution of Rademacher sums. Proc Amer Math Soc 109: 517-522
Probability distributions (list)
Discrete
univariate
with finite
support
with infinite
support
Continuous
univariate
supported on a
bounded interval
supported on a
semi-infinite
interval
supported
on the whole
real line
with support
whose type varies
Mixed
univariate
continuous-
discrete
Multivariate
(joint)
Directional
Univariate (circular) directional
Circular uniform
Univariate von Mises
Wrapped normal
Wrapped Cauchy
Wrapped exponential
Wrapped asymmetric Laplace
Wrapped Lévy
Bivariate (spherical)
Kent
Bivariate (toroidal)
Bivariate von Mises
Multivariate
von Mises–Fisher
Bingham
Degenerate
and singular
Degenerate
Dirac delta function
Singular
Cantor
Families
Category:
Rademacher distribution: Difference between revisions Add topic