Back to Search

Deep Reinforcement Learning with Python: Rlhf for Chatbots and Large Language Models

AUTHOR Sanghi, Nimish
PUBLISHER Apress (07/15/2024)
PRODUCT TYPE Paperback (Paperback)

Description

Gain a theoretical understanding to the most popular libraries in deep reinforcement learning (deep RL). This new edition focuses on the latest advances in deep RL using a learn-by-coding approach, allowing readers to assimilate and replicate the latest research in this field.

New agent environments ranging from games, and robotics to finance are explained to help you try different ways to apply reinforcement learning. A chapter on multi-agent reinforcement learning covers how multiple agents compete, while another chapter focuses on the widely used deep RL algorithm, proximal policy optimization (PPO). You'll see how reinforcement learning with human feedback (RLHF) has been used by chatbots, built using Large Language Models, e.g. ChatGPT to improve conversational capabilities.

You'll also review the steps for using the code on multiple cloud systems and deploying models on platforms such as Hugging Face Hub. The code is in Jupyter Notebook, which canbe run on Google Colab, and other similar deep learning cloud platforms, allowing you to tailor the code to your own needs.

Whether it's for applications in gaming, robotics, or Generative AI, Deep Reinforcement Learning with Python will help keep you ahead of the curve.


What You'll Learn

  • Explore Python-based RL libraries, including StableBaselines3 and CleanRL
  • Work with diverse RL environments like Gymnasium, Pybullet, and Unity ML
  • Understand instruction finetuning of Large Language Models using RLHF and PPO
  • Study training and optimization techniques using HuggingFace, Weights and Biases, and Optuna

Who This Book Is For

Software engineers and machine learning developers eager to sharpen their understanding of deep RL and acquire practical skills in implementing RL algorithms fromscratch.


Show More
Product Format
Product Details
ISBN-13: 9798868802720
Binding: Paperback or Softback (Trade Paperback (Us))
Content Language: English
Edition Number: 0002
More Product Details
Page Count: 634
Carton Quantity: 6
Product Dimensions: 7.00 x 1.33 x 10.00 inches
Weight: 2.49 pound(s)
Feature Codes: Illustrated
Country of Origin: NL
Subject Information
BISAC Categories
Computers | Artificial Intelligence - General
Computers | Languages - Python
Computers | Probability & Statistics - General
Descriptions, Reviews, Etc.
jacket back

Gain a theoretical understanding of the most popular libraries in deep reinforcement learning (deep RL). This new edition focuses on the latest advances in deep RL using a learn-by-coding approach, allowing readers to assimilate and replicate the latest research in this field.

New agent environments ranging from games, and robotics to finance are explained to help you try different ways to apply reinforcement learning. A chapter on multi-agent reinforcement learning (MARL) covers how multiple agents can be trained, while another chapter focuses on the widely used deep RL algorithm, proximal policy optimization (PPO). You'll see how reinforcement learning with human feedback (RLHF) has been used to fine-tune Large Language Models (LLMs) to chat and follow instructions. An example of this is the OpenAI ChatGPT offering human like conversational capabilities.

You'll also review the steps for using the code on multiple cloud systems and deploying models on platforms such as Hugging Face Hub. The code is in Jupyter Notebook, which can be run on Google Colab, and other similar deep learning cloud platforms, allowing you to tailor the code to your own needs.

Whether it's for applications in gaming, robotics, or Generative AI, Deep Reinforcement Learning with Python will help keep you ahead of the curve.

Show More
publisher marketing

Gain a theoretical understanding to the most popular libraries in deep reinforcement learning (deep RL). This new edition focuses on the latest advances in deep RL using a learn-by-coding approach, allowing readers to assimilate and replicate the latest research in this field.

New agent environments ranging from games, and robotics to finance are explained to help you try different ways to apply reinforcement learning. A chapter on multi-agent reinforcement learning covers how multiple agents compete, while another chapter focuses on the widely used deep RL algorithm, proximal policy optimization (PPO). You'll see how reinforcement learning with human feedback (RLHF) has been used by chatbots, built using Large Language Models, e.g. ChatGPT to improve conversational capabilities.

You'll also review the steps for using the code on multiple cloud systems and deploying models on platforms such as Hugging Face Hub. The code is in Jupyter Notebook, which canbe run on Google Colab, and other similar deep learning cloud platforms, allowing you to tailor the code to your own needs.

Whether it's for applications in gaming, robotics, or Generative AI, Deep Reinforcement Learning with Python will help keep you ahead of the curve.


What You'll Learn

  • Explore Python-based RL libraries, including StableBaselines3 and CleanRL
  • Work with diverse RL environments like Gymnasium, Pybullet, and Unity ML
  • Understand instruction finetuning of Large Language Models using RLHF and PPO
  • Study training and optimization techniques using HuggingFace, Weights and Biases, and Optuna

Who This Book Is For

Software engineers and machine learning developers eager to sharpen their understanding of deep RL and acquire practical skills in implementing RL algorithms fromscratch.


Show More
List Price $59.99
Your Price  $59.39
Paperback