Menu iconMenu iconData Analysis Foundations with Python
Data Analysis Foundations with Python

Chapter 11: Probability Theory

11.1 Basic Concepts

Greetings, esteemed reader! Congratulations on your impressive foray into the fascinating realm of data manipulation and exploration. You've even completed a comprehensive project on customer reviews - well done! But now, it's time to take your data science journey to the next level with Probability Theory. This essential mathematical framework enables us to comprehend and quantify uncertainty, essentially serving as the secret sauce that flavors the world of data. 

You may be curious as to why Probability Theory is such a crucial component of data science. To put it simply, it forms the fundamental basis upon which predictive modeling, machine learning, and statistical inference are built. It is the tool we use to make sense of randomness, to predict future events, and even to select the most compelling Netflix series to binge-watch next! In short, Probability Theory is an indispensable part of any data scientist's toolkit.

So, without further ado, let us delve into the intricacies of Probability Theory and explore its many uses in the exciting world of data science. By the end of this journey, you'll be well-equipped to apply these concepts to your own projects and analyses, and you'll have a deeper appreciation for the essential role Probability Theory plays in the field of data science.

When we first begin to explore the concept of probability, we may find ourselves wondering just what it means. Essentially, probability is a way to quantify the chances of a particular outcome occurring in a situation where there is some degree of uncertainty. By assigning a numerical value to the likelihood of a given event, we can equip ourselves with a powerful tool for making informed decisions, analyzing data, and making projections about the future.

This can be especially useful in a variety of contexts, such as in business, finance, or even in our personal lives when we are faced with difficult choices or complex situations. By understanding probability, we can better equip ourselves to navigate the world around us and to make informed choices based on the best available knowledge and evidence.

In order to gain a better understanding of these concepts, it is important to dive deeper into each of them. Let's explore each key term in more detail:

  1. Experiment: An experiment is any procedure that has the ability to produce a set of well-defined outcomes. This can include a wide variety of activities, such as rolling a dice, flipping a coin, or conducting a scientific study. By performing an experiment, we can gain valuable insights into the world around us and learn more about the underlying processes that govern our experiences.
  2. Sample Space: The sample space is the set of all possible outcomes that can result from an experiment. For example, if we roll a dice, the sample space would be {1, 2, 3, 4, 5, 6}. Understanding the sample space is crucial for analyzing the results of any experiment, as it provides a framework for categorizing and evaluating the different possible outcomes.
  3. Event: An event is any subset of outcomes that can occur within the sample space. For example, if we roll a dice, an event could be rolling an odd number, which corresponds to the subset {1, 3, 5}. By identifying different events within the sample space, we can gain a more nuanced understanding of the probability of different outcomes occurring.

11.1.1 Probability of an Event

The probability of an event A happening is defined as the ratio of the number of favorable outcomes to the total number of outcomes in the sample space:

P(A)=Total number of outcomes ÷ Number of favorable outcomes

11.1.2 Python Example: Dice Roll

Let's simulate a simple dice roll in Python to gain a better understanding of probability. In this simulation, we will roll a standard six-sided die 1,000 times and check the probability of rolling an odd number.

To begin, we'll create a function that will generate a random number between one and six, mimicking the roll of a die. We'll then use a loop to roll the die 1,000 times and keep track of the number of odd rolls.

Once we have our results, we can calculate the probability of rolling an odd number by dividing the number of odd rolls by the total number of rolls. This will give us an estimate of the likelihood of rolling an odd number.

Simulating dice rolls in Python can be a useful tool for understanding probability and can be applied to many different situations. By tweaking the code and using different types of dice, we can explore different probability scenarios and gain a deeper understanding of this important concept.

Example:

import random

# Simulate 1000 dice rolls
n_rolls = 1000
odd_rolls = 0

for _ in range(n_rolls):
    roll = random.choice([1, 2, 3, 4, 5, 6])
    if roll % 2 != 0:
        odd_rolls += 1

probability_odd = odd_rolls / n_rolls
print(f"The experimental probability of rolling an odd number is {probability_odd}")

When you run this code, you might find the experimental probability close to the theoretical probability of 1/2 or 0.5, which is what you'd expect over a large number of trials.

We hope that you enjoyed learning about probability in a practical and exciting way! As you continue on your journey to explore this fascinating subject, the following sections will build on these basics and delve into more advanced topics.

It's important to make sure that you have a solid understanding of these foundational concepts before moving on, so take the time to review and practice as needed. By doing so, you'll be well-prepared to tackle the challenges ahead and deepen your understanding of probability in even more meaningful ways. So keep exploring, keep learning, and most importantly, have fun!

11.1.3 Complementary Events

These are events that cannot happen at the same time. In probability theory, two events are mutually exclusive if they cannot occur at the same time. For instance, if Event A is rolling an odd number on a die, the complementary event A' would be rolling an even number. It is important to note that the sum of the probabilities of mutually exclusive events is equal to 1. Therefore, the probability of A' can be calculated as P(A') = 1 - P(A).

Moreover, it is worth mentioning that mutually exclusive events are not the same as independent events. Two events are independent if the occurrence of one does not affect the probability of the other. For example, the event of flipping a coin and getting heads is independent of the event of rolling a die and getting an even number. However, the event of rolling a die and getting an odd number is not independent of the event of rolling a die and getting a number greater than 2, because if the die shows an odd number, it cannot show a number greater than 2.

11.1.4 Independent and Dependent Events

Two events A and B are said to be independent if the occurrence of one does not affect the occurrence of another. This means that if event A occurs, it does not change the probability of event B occurring, and vice versa. On the other hand, dependent events are those which affect each other's probabilities.

In other words, the occurrence of one event affects the probability of the other event occurring. This means that if event A occurs, it changes the probability of event B occurring, and vice versa. It's important to understand the difference between independent and dependent events because it can have a significant impact on how you approach probability problems and make decisions based on them.

11.1.5 Conditional Probability

Conditional probability is a fundamental concept in probability theory and statistics that describes the probability of an event occurring given that another event has already occurred. In other words, it is the probability of one event happening under the condition that another event has already happened.

This type of probability is denoted as P(A|B), which is read as "the probability of event A given event B has already occurred". It is important to note that conditional probability is a useful tool in many areas of study, including finance, biology, and engineering, among others.

11.1.6 Python Example: Complementary Events

Here's a simple Python example to illustrate the concept of complementary events with a dice roll.

import random

# Simulate 1000 dice rolls
n_rolls = 1000
even_rolls = 0

for _ in range(n_rolls):
    roll = random.choice([1, 2, 3, 4, 5, 6])
    if roll % 2 == 0:
        even_rolls += 1

probability_even = even_rolls / n_rolls
probability_odd_complement = 1 - probability_even

print(f"The experimental probability of rolling an even number is {probability_even}")
print(f"The experimental probability of NOT rolling an even number (i.e., rolling an odd number) is {probability_odd_complement}")

This will help you verify that P(A) + P(A') = 1, where A is rolling an odd number, and A' is the complementary event of rolling an even number.

11.1 Basic Concepts

Greetings, esteemed reader! Congratulations on your impressive foray into the fascinating realm of data manipulation and exploration. You've even completed a comprehensive project on customer reviews - well done! But now, it's time to take your data science journey to the next level with Probability Theory. This essential mathematical framework enables us to comprehend and quantify uncertainty, essentially serving as the secret sauce that flavors the world of data. 

You may be curious as to why Probability Theory is such a crucial component of data science. To put it simply, it forms the fundamental basis upon which predictive modeling, machine learning, and statistical inference are built. It is the tool we use to make sense of randomness, to predict future events, and even to select the most compelling Netflix series to binge-watch next! In short, Probability Theory is an indispensable part of any data scientist's toolkit.

So, without further ado, let us delve into the intricacies of Probability Theory and explore its many uses in the exciting world of data science. By the end of this journey, you'll be well-equipped to apply these concepts to your own projects and analyses, and you'll have a deeper appreciation for the essential role Probability Theory plays in the field of data science.

When we first begin to explore the concept of probability, we may find ourselves wondering just what it means. Essentially, probability is a way to quantify the chances of a particular outcome occurring in a situation where there is some degree of uncertainty. By assigning a numerical value to the likelihood of a given event, we can equip ourselves with a powerful tool for making informed decisions, analyzing data, and making projections about the future.

This can be especially useful in a variety of contexts, such as in business, finance, or even in our personal lives when we are faced with difficult choices or complex situations. By understanding probability, we can better equip ourselves to navigate the world around us and to make informed choices based on the best available knowledge and evidence.

In order to gain a better understanding of these concepts, it is important to dive deeper into each of them. Let's explore each key term in more detail:

  1. Experiment: An experiment is any procedure that has the ability to produce a set of well-defined outcomes. This can include a wide variety of activities, such as rolling a dice, flipping a coin, or conducting a scientific study. By performing an experiment, we can gain valuable insights into the world around us and learn more about the underlying processes that govern our experiences.
  2. Sample Space: The sample space is the set of all possible outcomes that can result from an experiment. For example, if we roll a dice, the sample space would be {1, 2, 3, 4, 5, 6}. Understanding the sample space is crucial for analyzing the results of any experiment, as it provides a framework for categorizing and evaluating the different possible outcomes.
  3. Event: An event is any subset of outcomes that can occur within the sample space. For example, if we roll a dice, an event could be rolling an odd number, which corresponds to the subset {1, 3, 5}. By identifying different events within the sample space, we can gain a more nuanced understanding of the probability of different outcomes occurring.

11.1.1 Probability of an Event

The probability of an event A happening is defined as the ratio of the number of favorable outcomes to the total number of outcomes in the sample space:

P(A)=Total number of outcomes ÷ Number of favorable outcomes

11.1.2 Python Example: Dice Roll

Let's simulate a simple dice roll in Python to gain a better understanding of probability. In this simulation, we will roll a standard six-sided die 1,000 times and check the probability of rolling an odd number.

To begin, we'll create a function that will generate a random number between one and six, mimicking the roll of a die. We'll then use a loop to roll the die 1,000 times and keep track of the number of odd rolls.

Once we have our results, we can calculate the probability of rolling an odd number by dividing the number of odd rolls by the total number of rolls. This will give us an estimate of the likelihood of rolling an odd number.

Simulating dice rolls in Python can be a useful tool for understanding probability and can be applied to many different situations. By tweaking the code and using different types of dice, we can explore different probability scenarios and gain a deeper understanding of this important concept.

Example:

import random

# Simulate 1000 dice rolls
n_rolls = 1000
odd_rolls = 0

for _ in range(n_rolls):
    roll = random.choice([1, 2, 3, 4, 5, 6])
    if roll % 2 != 0:
        odd_rolls += 1

probability_odd = odd_rolls / n_rolls
print(f"The experimental probability of rolling an odd number is {probability_odd}")

When you run this code, you might find the experimental probability close to the theoretical probability of 1/2 or 0.5, which is what you'd expect over a large number of trials.

We hope that you enjoyed learning about probability in a practical and exciting way! As you continue on your journey to explore this fascinating subject, the following sections will build on these basics and delve into more advanced topics.

It's important to make sure that you have a solid understanding of these foundational concepts before moving on, so take the time to review and practice as needed. By doing so, you'll be well-prepared to tackle the challenges ahead and deepen your understanding of probability in even more meaningful ways. So keep exploring, keep learning, and most importantly, have fun!

11.1.3 Complementary Events

These are events that cannot happen at the same time. In probability theory, two events are mutually exclusive if they cannot occur at the same time. For instance, if Event A is rolling an odd number on a die, the complementary event A' would be rolling an even number. It is important to note that the sum of the probabilities of mutually exclusive events is equal to 1. Therefore, the probability of A' can be calculated as P(A') = 1 - P(A).

Moreover, it is worth mentioning that mutually exclusive events are not the same as independent events. Two events are independent if the occurrence of one does not affect the probability of the other. For example, the event of flipping a coin and getting heads is independent of the event of rolling a die and getting an even number. However, the event of rolling a die and getting an odd number is not independent of the event of rolling a die and getting a number greater than 2, because if the die shows an odd number, it cannot show a number greater than 2.

11.1.4 Independent and Dependent Events

Two events A and B are said to be independent if the occurrence of one does not affect the occurrence of another. This means that if event A occurs, it does not change the probability of event B occurring, and vice versa. On the other hand, dependent events are those which affect each other's probabilities.

In other words, the occurrence of one event affects the probability of the other event occurring. This means that if event A occurs, it changes the probability of event B occurring, and vice versa. It's important to understand the difference between independent and dependent events because it can have a significant impact on how you approach probability problems and make decisions based on them.

11.1.5 Conditional Probability

Conditional probability is a fundamental concept in probability theory and statistics that describes the probability of an event occurring given that another event has already occurred. In other words, it is the probability of one event happening under the condition that another event has already happened.

This type of probability is denoted as P(A|B), which is read as "the probability of event A given event B has already occurred". It is important to note that conditional probability is a useful tool in many areas of study, including finance, biology, and engineering, among others.

11.1.6 Python Example: Complementary Events

Here's a simple Python example to illustrate the concept of complementary events with a dice roll.

import random

# Simulate 1000 dice rolls
n_rolls = 1000
even_rolls = 0

for _ in range(n_rolls):
    roll = random.choice([1, 2, 3, 4, 5, 6])
    if roll % 2 == 0:
        even_rolls += 1

probability_even = even_rolls / n_rolls
probability_odd_complement = 1 - probability_even

print(f"The experimental probability of rolling an even number is {probability_even}")
print(f"The experimental probability of NOT rolling an even number (i.e., rolling an odd number) is {probability_odd_complement}")

This will help you verify that P(A) + P(A') = 1, where A is rolling an odd number, and A' is the complementary event of rolling an even number.

11.1 Basic Concepts

Greetings, esteemed reader! Congratulations on your impressive foray into the fascinating realm of data manipulation and exploration. You've even completed a comprehensive project on customer reviews - well done! But now, it's time to take your data science journey to the next level with Probability Theory. This essential mathematical framework enables us to comprehend and quantify uncertainty, essentially serving as the secret sauce that flavors the world of data. 

You may be curious as to why Probability Theory is such a crucial component of data science. To put it simply, it forms the fundamental basis upon which predictive modeling, machine learning, and statistical inference are built. It is the tool we use to make sense of randomness, to predict future events, and even to select the most compelling Netflix series to binge-watch next! In short, Probability Theory is an indispensable part of any data scientist's toolkit.

So, without further ado, let us delve into the intricacies of Probability Theory and explore its many uses in the exciting world of data science. By the end of this journey, you'll be well-equipped to apply these concepts to your own projects and analyses, and you'll have a deeper appreciation for the essential role Probability Theory plays in the field of data science.

When we first begin to explore the concept of probability, we may find ourselves wondering just what it means. Essentially, probability is a way to quantify the chances of a particular outcome occurring in a situation where there is some degree of uncertainty. By assigning a numerical value to the likelihood of a given event, we can equip ourselves with a powerful tool for making informed decisions, analyzing data, and making projections about the future.

This can be especially useful in a variety of contexts, such as in business, finance, or even in our personal lives when we are faced with difficult choices or complex situations. By understanding probability, we can better equip ourselves to navigate the world around us and to make informed choices based on the best available knowledge and evidence.

In order to gain a better understanding of these concepts, it is important to dive deeper into each of them. Let's explore each key term in more detail:

  1. Experiment: An experiment is any procedure that has the ability to produce a set of well-defined outcomes. This can include a wide variety of activities, such as rolling a dice, flipping a coin, or conducting a scientific study. By performing an experiment, we can gain valuable insights into the world around us and learn more about the underlying processes that govern our experiences.
  2. Sample Space: The sample space is the set of all possible outcomes that can result from an experiment. For example, if we roll a dice, the sample space would be {1, 2, 3, 4, 5, 6}. Understanding the sample space is crucial for analyzing the results of any experiment, as it provides a framework for categorizing and evaluating the different possible outcomes.
  3. Event: An event is any subset of outcomes that can occur within the sample space. For example, if we roll a dice, an event could be rolling an odd number, which corresponds to the subset {1, 3, 5}. By identifying different events within the sample space, we can gain a more nuanced understanding of the probability of different outcomes occurring.

11.1.1 Probability of an Event

The probability of an event A happening is defined as the ratio of the number of favorable outcomes to the total number of outcomes in the sample space:

P(A)=Total number of outcomes ÷ Number of favorable outcomes

11.1.2 Python Example: Dice Roll

Let's simulate a simple dice roll in Python to gain a better understanding of probability. In this simulation, we will roll a standard six-sided die 1,000 times and check the probability of rolling an odd number.

To begin, we'll create a function that will generate a random number between one and six, mimicking the roll of a die. We'll then use a loop to roll the die 1,000 times and keep track of the number of odd rolls.

Once we have our results, we can calculate the probability of rolling an odd number by dividing the number of odd rolls by the total number of rolls. This will give us an estimate of the likelihood of rolling an odd number.

Simulating dice rolls in Python can be a useful tool for understanding probability and can be applied to many different situations. By tweaking the code and using different types of dice, we can explore different probability scenarios and gain a deeper understanding of this important concept.

Example:

import random

# Simulate 1000 dice rolls
n_rolls = 1000
odd_rolls = 0

for _ in range(n_rolls):
    roll = random.choice([1, 2, 3, 4, 5, 6])
    if roll % 2 != 0:
        odd_rolls += 1

probability_odd = odd_rolls / n_rolls
print(f"The experimental probability of rolling an odd number is {probability_odd}")

When you run this code, you might find the experimental probability close to the theoretical probability of 1/2 or 0.5, which is what you'd expect over a large number of trials.

We hope that you enjoyed learning about probability in a practical and exciting way! As you continue on your journey to explore this fascinating subject, the following sections will build on these basics and delve into more advanced topics.

It's important to make sure that you have a solid understanding of these foundational concepts before moving on, so take the time to review and practice as needed. By doing so, you'll be well-prepared to tackle the challenges ahead and deepen your understanding of probability in even more meaningful ways. So keep exploring, keep learning, and most importantly, have fun!

11.1.3 Complementary Events

These are events that cannot happen at the same time. In probability theory, two events are mutually exclusive if they cannot occur at the same time. For instance, if Event A is rolling an odd number on a die, the complementary event A' would be rolling an even number. It is important to note that the sum of the probabilities of mutually exclusive events is equal to 1. Therefore, the probability of A' can be calculated as P(A') = 1 - P(A).

Moreover, it is worth mentioning that mutually exclusive events are not the same as independent events. Two events are independent if the occurrence of one does not affect the probability of the other. For example, the event of flipping a coin and getting heads is independent of the event of rolling a die and getting an even number. However, the event of rolling a die and getting an odd number is not independent of the event of rolling a die and getting a number greater than 2, because if the die shows an odd number, it cannot show a number greater than 2.

11.1.4 Independent and Dependent Events

Two events A and B are said to be independent if the occurrence of one does not affect the occurrence of another. This means that if event A occurs, it does not change the probability of event B occurring, and vice versa. On the other hand, dependent events are those which affect each other's probabilities.

In other words, the occurrence of one event affects the probability of the other event occurring. This means that if event A occurs, it changes the probability of event B occurring, and vice versa. It's important to understand the difference between independent and dependent events because it can have a significant impact on how you approach probability problems and make decisions based on them.

11.1.5 Conditional Probability

Conditional probability is a fundamental concept in probability theory and statistics that describes the probability of an event occurring given that another event has already occurred. In other words, it is the probability of one event happening under the condition that another event has already happened.

This type of probability is denoted as P(A|B), which is read as "the probability of event A given event B has already occurred". It is important to note that conditional probability is a useful tool in many areas of study, including finance, biology, and engineering, among others.

11.1.6 Python Example: Complementary Events

Here's a simple Python example to illustrate the concept of complementary events with a dice roll.

import random

# Simulate 1000 dice rolls
n_rolls = 1000
even_rolls = 0

for _ in range(n_rolls):
    roll = random.choice([1, 2, 3, 4, 5, 6])
    if roll % 2 == 0:
        even_rolls += 1

probability_even = even_rolls / n_rolls
probability_odd_complement = 1 - probability_even

print(f"The experimental probability of rolling an even number is {probability_even}")
print(f"The experimental probability of NOT rolling an even number (i.e., rolling an odd number) is {probability_odd_complement}")

This will help you verify that P(A) + P(A') = 1, where A is rolling an odd number, and A' is the complementary event of rolling an even number.

11.1 Basic Concepts

Greetings, esteemed reader! Congratulations on your impressive foray into the fascinating realm of data manipulation and exploration. You've even completed a comprehensive project on customer reviews - well done! But now, it's time to take your data science journey to the next level with Probability Theory. This essential mathematical framework enables us to comprehend and quantify uncertainty, essentially serving as the secret sauce that flavors the world of data. 

You may be curious as to why Probability Theory is such a crucial component of data science. To put it simply, it forms the fundamental basis upon which predictive modeling, machine learning, and statistical inference are built. It is the tool we use to make sense of randomness, to predict future events, and even to select the most compelling Netflix series to binge-watch next! In short, Probability Theory is an indispensable part of any data scientist's toolkit.

So, without further ado, let us delve into the intricacies of Probability Theory and explore its many uses in the exciting world of data science. By the end of this journey, you'll be well-equipped to apply these concepts to your own projects and analyses, and you'll have a deeper appreciation for the essential role Probability Theory plays in the field of data science.

When we first begin to explore the concept of probability, we may find ourselves wondering just what it means. Essentially, probability is a way to quantify the chances of a particular outcome occurring in a situation where there is some degree of uncertainty. By assigning a numerical value to the likelihood of a given event, we can equip ourselves with a powerful tool for making informed decisions, analyzing data, and making projections about the future.

This can be especially useful in a variety of contexts, such as in business, finance, or even in our personal lives when we are faced with difficult choices or complex situations. By understanding probability, we can better equip ourselves to navigate the world around us and to make informed choices based on the best available knowledge and evidence.

In order to gain a better understanding of these concepts, it is important to dive deeper into each of them. Let's explore each key term in more detail:

  1. Experiment: An experiment is any procedure that has the ability to produce a set of well-defined outcomes. This can include a wide variety of activities, such as rolling a dice, flipping a coin, or conducting a scientific study. By performing an experiment, we can gain valuable insights into the world around us and learn more about the underlying processes that govern our experiences.
  2. Sample Space: The sample space is the set of all possible outcomes that can result from an experiment. For example, if we roll a dice, the sample space would be {1, 2, 3, 4, 5, 6}. Understanding the sample space is crucial for analyzing the results of any experiment, as it provides a framework for categorizing and evaluating the different possible outcomes.
  3. Event: An event is any subset of outcomes that can occur within the sample space. For example, if we roll a dice, an event could be rolling an odd number, which corresponds to the subset {1, 3, 5}. By identifying different events within the sample space, we can gain a more nuanced understanding of the probability of different outcomes occurring.

11.1.1 Probability of an Event

The probability of an event A happening is defined as the ratio of the number of favorable outcomes to the total number of outcomes in the sample space:

P(A)=Total number of outcomes ÷ Number of favorable outcomes

11.1.2 Python Example: Dice Roll

Let's simulate a simple dice roll in Python to gain a better understanding of probability. In this simulation, we will roll a standard six-sided die 1,000 times and check the probability of rolling an odd number.

To begin, we'll create a function that will generate a random number between one and six, mimicking the roll of a die. We'll then use a loop to roll the die 1,000 times and keep track of the number of odd rolls.

Once we have our results, we can calculate the probability of rolling an odd number by dividing the number of odd rolls by the total number of rolls. This will give us an estimate of the likelihood of rolling an odd number.

Simulating dice rolls in Python can be a useful tool for understanding probability and can be applied to many different situations. By tweaking the code and using different types of dice, we can explore different probability scenarios and gain a deeper understanding of this important concept.

Example:

import random

# Simulate 1000 dice rolls
n_rolls = 1000
odd_rolls = 0

for _ in range(n_rolls):
    roll = random.choice([1, 2, 3, 4, 5, 6])
    if roll % 2 != 0:
        odd_rolls += 1

probability_odd = odd_rolls / n_rolls
print(f"The experimental probability of rolling an odd number is {probability_odd}")

When you run this code, you might find the experimental probability close to the theoretical probability of 1/2 or 0.5, which is what you'd expect over a large number of trials.

We hope that you enjoyed learning about probability in a practical and exciting way! As you continue on your journey to explore this fascinating subject, the following sections will build on these basics and delve into more advanced topics.

It's important to make sure that you have a solid understanding of these foundational concepts before moving on, so take the time to review and practice as needed. By doing so, you'll be well-prepared to tackle the challenges ahead and deepen your understanding of probability in even more meaningful ways. So keep exploring, keep learning, and most importantly, have fun!

11.1.3 Complementary Events

These are events that cannot happen at the same time. In probability theory, two events are mutually exclusive if they cannot occur at the same time. For instance, if Event A is rolling an odd number on a die, the complementary event A' would be rolling an even number. It is important to note that the sum of the probabilities of mutually exclusive events is equal to 1. Therefore, the probability of A' can be calculated as P(A') = 1 - P(A).

Moreover, it is worth mentioning that mutually exclusive events are not the same as independent events. Two events are independent if the occurrence of one does not affect the probability of the other. For example, the event of flipping a coin and getting heads is independent of the event of rolling a die and getting an even number. However, the event of rolling a die and getting an odd number is not independent of the event of rolling a die and getting a number greater than 2, because if the die shows an odd number, it cannot show a number greater than 2.

11.1.4 Independent and Dependent Events

Two events A and B are said to be independent if the occurrence of one does not affect the occurrence of another. This means that if event A occurs, it does not change the probability of event B occurring, and vice versa. On the other hand, dependent events are those which affect each other's probabilities.

In other words, the occurrence of one event affects the probability of the other event occurring. This means that if event A occurs, it changes the probability of event B occurring, and vice versa. It's important to understand the difference between independent and dependent events because it can have a significant impact on how you approach probability problems and make decisions based on them.

11.1.5 Conditional Probability

Conditional probability is a fundamental concept in probability theory and statistics that describes the probability of an event occurring given that another event has already occurred. In other words, it is the probability of one event happening under the condition that another event has already happened.

This type of probability is denoted as P(A|B), which is read as "the probability of event A given event B has already occurred". It is important to note that conditional probability is a useful tool in many areas of study, including finance, biology, and engineering, among others.

11.1.6 Python Example: Complementary Events

Here's a simple Python example to illustrate the concept of complementary events with a dice roll.

import random

# Simulate 1000 dice rolls
n_rolls = 1000
even_rolls = 0

for _ in range(n_rolls):
    roll = random.choice([1, 2, 3, 4, 5, 6])
    if roll % 2 == 0:
        even_rolls += 1

probability_even = even_rolls / n_rolls
probability_odd_complement = 1 - probability_even

print(f"The experimental probability of rolling an even number is {probability_even}")
print(f"The experimental probability of NOT rolling an even number (i.e., rolling an odd number) is {probability_odd_complement}")

This will help you verify that P(A) + P(A') = 1, where A is rolling an odd number, and A' is the complementary event of rolling an even number.