distribution #6
In this lesson

Wide tables, equations, and code scroll sideways. Swipe, or Tab to focus them and use the left and right arrow keys.

Cauchy distribution

You will learn: Explain why finite samples do not establish a population mean or variance.

Start with: Normal distribution · Expectation and variance

The Cauchy distribution looks like a Normal from the centre but has radically heavier tails. Its mean is undefined and its second moment is infinite. The usual finite-mean Law of Large Numbers cannot be applied to its sample average.

f(x;x0,γ)=1πγ ⁣[1+(x−x0γ) ⁣2]f(x;x_0,\gamma) = \frac{1}{\pi\gamma\!\left[1+\left(\frac{x-x_0}{\gamma}\right)^{\!2}\right]}
PDF comparison
density by x 00.10.20.30.4−8−6−4−202468xdensity
Normal(0,1), solid Cauchy(0,1), dashed
Running sample mean
Normal — converges to 0
mean by samples−202100200300400500samplesmean
Cauchy — averages do not concentrate at zero
mean by samples−4−2024100200300400500samplesmean

The running-mean windows are fixed: 0 normal values exceed ±3 and 102 Cauchy values exceed ±5. The values are retained in calculations. The Cauchy density plot omits 7.917% of its probability outside ±8.

Repeat the mean and median estimators

estimate by independent experiment−4−202420406080100independent experimentestimate
Each experiment uses 500 independent standard Cauchy draws
StatisticWithin [−1,1]Outside plot [−5,5]
Sample mean (circles)47 / 10015
Sample median (squares)100 / 1000

The exact probability that a sample mean lies in [−1,1] is 0.5 for every n here. An even-size sample median averages the two central ordered observations. Points beyond the plot are counted above, not moved onto its edges.

Read every repeated estimate, including off-chart values
RunMeanMedianSmallest drawLargest draw
16.79450.0049277-356.302695.0
2-2.7041-0.066547-606.41202.47
3-7.1329-0.089407-3074.472.831
4-0.416520.080172-226.6071.837
50.0120320.051795-74.01654.548
60.242230.12135-132.55165.37
7-4.1158-0.049060-1533.6384.78
8-6.50850.068683-3483.9135.17
9-0.686130.0080067-264.4332.307
101.4350-0.10271-65.199341.26
11-1.8312-0.13934-501.7742.209
121.11430.063411-82.494716.50
131.66030.029061-89.083703.41
141.0149-0.0084347-112.52746.25
15-0.281460.056145-135.74256.05
16-0.277720.035710-247.07175.14
174.0436-0.021321-45.9381795.3
18-0.78372-0.12290-161.6486.451
19-3.39480.039809-691.57489.76
200.29360-0.16715-73.764116.82
211.01480.099113-366.23516.16
22-0.639240.048207-242.7192.863
230.694280.016386-31.492271.48
242.61480.12374-103.94799.62
25-3.6331-0.015172-1758.8153.91
26572.900.034320-484.912.8667e+5
27-0.26798-0.090083-129.11128.17
28-0.142040.011750-92.78150.469
290.33988-0.048022-54.59389.686
300.385600.046102-87.468133.08
310.956310.069364-85.964154.28
32-0.022967-0.020904-1185.11429.5
332.37260.11380-68.647495.87
340.602360.012844-148.54195.27
356.28350.085607-326.962694.9
36-2.5312-0.00087643-1757.0488.20
370.36429-0.00090045-451.81715.04
38-1.31150.027519-475.23194.99
39-4.4610-0.086742-1651.4145.97
40-1.3507-0.065762-619.69109.20
41-0.557540.073214-293.1466.320
42-0.667340.037174-169.6764.391
431.45130.052924-313.151217.4
44-3.93210.063689-2124.5105.52
451.19340.061178-136.02334.39
460.856120.12135-78.148333.86
47-0.47839-0.018952-575.62182.46
481.10870.018142-174.41342.14
49-0.923600.036381-319.5549.614
503.47560.046980-34.1261479.4
517.3711-0.031799-132.373560.9
520.648510.042267-135.82230.59
53-1.06180.078819-333.6751.130
54-3.1514-0.058238-1480.7209.28
55-0.787820.057949-469.60122.16
5654.887-0.0095635-428.9227576
570.760420.065793-255.28255.87
58-1.1822-0.090075-267.69202.12
591.90150.0077646-139.721462.4
6010.976-0.092354-187.442915.3
61-0.0868320.031177-63.44545.269
621.41240.0086438-61.673548.04
630.60902-0.090806-114.46203.52
64-4.5820-0.031612-1929.182.144
65-3.43300.095950-932.8040.937
66-0.45982-0.066405-964.42611.04
673.6932-0.040937-80.5121313.1
680.103730.0038274-331.81226.97
69-1.4289-0.031562-314.4467.698
70-4.65160.053917-1750.6372.24
719.10710.051853-114.504151.6
720.723480.068963-108.62211.97
730.773290.0065520-112.59332.87
740.477220.064595-105.6784.510
7514.002-0.034961-1669.18727.5
76-0.014837-0.0098131-31.98651.018
773.5853-0.063827-56.7411695.0
78-3.4497-0.023466-2529.3501.53
790.663790.0075807-181.59363.30
80-6.2941-0.10746-2390.1232.96
810.051403-0.015750-61.68991.464
820.60416-0.0090384-200.71535.68
830.17525-0.044416-461.49241.84
84-0.396660.033809-269.47115.22
850.915980.0040195-46.571489.52
86-2.2272-0.0036251-1188.9111.24
87-0.986170.020964-167.43151.10
885.4673-0.051714-65.7472530.6
890.137170.10071-153.42247.64
90-1.37840.14320-640.15131.86
91-1.22060.033564-515.17247.87
92-0.29519-0.031236-206.24115.18
93-5.5808-0.13772-2142.7718.51
9435.858-0.040439-915.3119083
95-0.0745220.029509-255.82343.16
961.85450.099737-91.969756.78
97-0.26435-0.067576-131.14120.55
980.144270.035540-93.90363.433
99-0.493830.018070-589.83173.15
1005.2358-0.017006-94.8711874.1
Standard Cauchy averages have the same distribution at every sample size. Standard normal averages have standard deviation 1/√n and converge almost surely to zero. A finite path can look calm or erratic; the repeated experiments separate that appearance from the theorem.

What to notice

  • PDFs look similar near the peak. Both distributions are symmetric and bell-shaped. The difference is in the tails: Cauchy’s tails decay as 1/x21/x^2, while Normal’s decay exponentially.
  • Running means behave differently. The normal running mean approaches zero as sampling continues, without a fixed finishing point. The Cauchy mean wanders indefinitely, with occasional violent jumps driven by extreme outliers.
  • Resample to see how different Cauchy runs can look. The wandering is not a quirk of one bad draw — it is intrinsic to the distribution.

Why no mean?

The Cauchy mean integral diverges:

E[X]=∫−∞∞x⋅1π(1+x2) dxE[X] = \int_{-\infty}^{\infty} x \cdot \frac{1}{\pi(1+x^2)}\,dx

The positive and negative tails are equally heavy, so the integral does not converge absolutely. The usual i.i.d. Law of Large Numbers assumes a finite absolute first moment. For the Cauchy specifically, the averaging identity below shows why its averages do not concentrate at a constant.

The ratio connection

If X ~ Normal(0,1) and Y ~ Normal(0,1) independently, then X/Y ~ Cauchy(0,1). Dividing by a near-zero normal draw can give an arbitrarily large result, which is why heavy tails appear in ratios.

Symmetry gives a median, not a mean

The standard Cauchy CDF is F(x)=1/2+arctan(x)/π. Therefore F(0)=1/2 and its quartiles are −1 and 1. Those statements remain meaningful even though the expected value does not exist. Integrating x/(π(1+x²)) from zero to R gives log(1+R²)/(2π), which grows without bound. The negative side diverges in the opposite direction; choosing equal cutoffs to make them cancel is a principal value, not an expectation.

The experiment computes an ordinary finite-sample mean and median. Both numbers exist for the displayed draws. That does not supply the missing population mean. The median estimates the distribution’s center using ranks, so an extremely large observation has much less influence on it than on the average.

What averaging preserves

For independent standard Cauchy variables, the characteristic function of their average is [exp(−|t|/n)]ⁿ=exp(−|t|). Thus the average has exactly the original Cauchy law for every positive integer n. In particular, P(−1≤average≤1)=1/2, even at n=2,000. A sequence converging in probability to zero would instead have that probability tend to one.

At the default n=500, repeat the experiment and compare the fraction of means and medians inside [−1,1]. The exact one-half reference applies to means; the median uses a different sampling distribution. Each point represents a separate sample, not another observation appended to the running trajectory above. A quiet stretch of one trajectory is not evidence for concentration.

Keep extreme values visible in the accounting

The density window [−8,8] omits about 7.917% of standard Cauchy probability. The repeated-estimate plot clips at ±5, but the table retains those estimates and their extreme observations. Removing large observations would change the estimator and its distribution, so the experiment does not trim them.

Make a prediction

A simulation of Cauchy averages has a finite histogram and a sample mean near zero. Have you estimated the population expectation?

Explore the answer

No. The Cauchy expectation is undefined regardless of the finite simulation result. You can estimate a median or a tail probability, but must name that different target and retain the extreme values when checking the proposed model.

Reference

Random Services: Cauchy distribution derives the CDF, divergent moments, and stable sum identity. Compare the finite-variance normal averages and the Student t family, which includes Cauchy at one degree of freedom.

The symmetric stable family places the Cauchy average beside models whose averages narrow or widen.

Reset all settings