Basic Probability#

These course notes provide and introduction to probability and statistics at the introductory level for a mathematics major. Many of the examples in these notes are real poker problems from No Limit Texas Holdem (NLHE).

With probability theory mathematicians predict the future. Statistics help mathematicians analyze the past. With an understanding of both areas of mathematics, successful professional poker players manufacture dozens of small edges over their competition to earn money.

A roulette ball falling into its slot and a card drawn from a well-shuffled deck are two additional examples of probability experiments.

Probability Experiments#

A probability experiment is any event whose outcomes are perfectly \textbf{random} and exactly predicted by probabilities. The probability space (or sample space) is the collection of all possible outcomes of the experiment. A simple random sample (SRS) is a collection of outcomes drawn at random from the probability space \(S\).

An event is a set of outcomes. We use set notation: an event \(A\) is a subset of \(S\). Determining probabilities is all about counting the number of outcomes in event \(A\) and in \(S\). To simplify our work, we will use the \textbf{cardinality} operator \(n(A)\) to indicate “the number of elements (outcomes) in set (event) \(A\).” This leads us to the main formula in discrete probability theory:

\[ P(A)=\frac{n(A)}{n(S)} \]

These ideas will be helpful in reformulating basic probability questions into a set theoretic framework.

Example 1

Suppose we draw a single card at random from a well-shuffled standard deck of 52 cards. What is the probability of drawing a \(\heartsuit\)?

Solution. Let’s define \(H\) to be the event set described by “drawing a heart.” We count the hearts in a standard deck and find the cardinality of the event set to \(|H|=13\). The sample space \(S\) is the set of all possible cards that could be drawn, so

\[ |S|=52 \]

Thus, we have the following probability calculation:

\[ P(H)=\frac{|H|}{|S|}=\frac{13}{52}=\frac{1}{4} \]

Tip

The solution path demonstrated in Example 1 will be of use to us quite often in this course. Count the outcomes in the event set, and divide by the total number of outcomes possible.

Set Complements#

It is often far easier to count the outcomes in the complement of event \(A\), e.g. the probability that event A does not occur. This requires an understanding of the set complement which we denote as \(\overline A\). The formula is:

\[P(\overline A)=\frac{|\overline A|}{|S|}=\frac{|S|-|A|}{|S|}=1-\frac{|A|}{|S|}=1-P(A)\]

In probability calculations, “throwing away” the overlap between two sets can be useful because it creates disjoint sets. Given two events \(A\) and \(B\) such that \(A\cap B\neq \emptyset\), we need notation for the event “\(A\) but not \(B\).” The idea of a “\(A\) but not \(B\)” is denoted as \(A\cap \overline B\), and more formally we have:

\[A\setminus B = A\cap \overline B\]

We will sometimes use the quite popular subtraction notation to indicate the same idea:

\[A - B = A\cap \overline B\]

Let’s craft a poker example that will extend our understanding of how set complements are used in probability theory along with increasing our understanding of why probability calculations are of interest to poker players.

Example 2

Hero holds a pocket pair:

\[7\textcolor{red}{\heartsuit} \hspace{3mm} 7\textcolor{red}{\diamondsuit}\]

Villain open-raises from early position (EP) where players tend to have a very narrow range of hands that they play, typically pretty strong. For this example, assume Villain holds a hand like

\[A\spadesuit \hspace{3mm} Q\textcolor{red}{\diamondsuit}\]

Hero calls on the button. Hero feels he can usually win by bluffing whenever Villain misses the flop, especially on flops like

\[K\heartsuit \hspace{3mm} 8\clubsuit \hspace{3mm} 3\clubsuit\]

with only one big card in them. If Villain has two unpaired cards both of which are \(8\) or better, what is the probability flop with only one big card misses Villain’s hand?

Solution. Poker players say they “hit the flop” when the flop – the first three board cards in Texas Holdem – match one or more of Hero’s hold cards. For Villain’s \(AQ\) hand above, hitting the flop would mean the flop contains an Ace or a Queen to make a pair or both which would make two pair. If the flop contained both a \(K\) and a \(J\), Villain would have a straight draw which indicates that Villain has 4 cards of the 5-card sequence needed for a straight. Draws are incomplete hands which need the “luck of the draw” to be valuable. Thus, we will not consider straight draws or flush draws in this example, only

  • 1 Pair

  • 2 Pair

  • Full House (e.g. A A Q Q Q)

Let the set \(X=\{0,1,2,3\}\) represent the number of cards that Villain hits on the flop. How often does he hit or miss the flop? Assuming Hero doesn’t hold any of the cards Villain wants, then there are six cards in the deck (Aces and Queens) that improve Villain’s hand to a pair that beats Hero’s hand. The probability of Villain getting exactly one of those cards on the flop is:

\[P(X=1)=\frac{\binom{6}{1}\binom{42}{2}}{\binom{48}{3}}\approx.29868\]

We just used some counting techniques we haven’t discussed, yet (shown at right). But don’t worry. You’ll know how to do these soon enough. Binomial coefficients like \(\binom{42}{2}\) are read as “forty-two choose two” and count all possible ways we can choose two cards from forty-two cards if order doesn’t matter.

Note that Villain could also have two or three of the flop cards hit his hand, and have a 2-pair hand or a straight. These hands are much less likely, but they change the probability somewhat if we include the probability of more than one flop card hitting Villain’s hand. We must add the probabilities of hitting 2 and 3 cards on the flop, which gives:

\[P(X\geq1)=\frac{\binom{6}{1}\binom{42}{2}+\binom{6}{2}\binom{42}{1}+\binom{6}{3}\binom{42}{0}}{\binom{48}{3}}\approx.33597\]

The upshot is that any poker player hits the flop about \(1/3\) of the time. Of course, hands like \(AA\), \(KK\) and \(QQ\) don’t need to hit the flop, so we expect a fit-or-fold player to continue on with the hand about 40% of the time. Since Villain will miss the flop for more often than he hits it, our aggressive Hero can use the high likelihood of “unimproved” cards in villain’s hand to bluff on the flop. This happens so often in poker that it has a name: a continuation bet, or cbet.