quatalog-site/courses/CSCI-4160.html
2024-09-13 01:49:00 +00:00

410 lines
16 KiB
HTML
Raw Blame History

This file contains ambiguous Unicode characters

This file contains Unicode characters that might be confused with other characters. If you think that this is intentional, you can safely ignore this warning. Use the Escape button to reveal them.

<!DOCTYPE html>
<html>
<head>
<title>
CSCI-4160: Reinforcement Learning
</title>
<meta property="og:title" content="CSCI-4160: Reinforcement Learning">
<meta property="og:description" content="This is an introductory course on the theory and practice of reinforcement learning (RL). We will derive the full RL framework, starting from Markov chains and Markov reward processes and building up to Markov decision processes. We will then cover classic RL approaches such as dynamic programming, Monte Carlo methods and Q-learning. Furthermore, we will cover more advanced topics such as deep learning, deep RL, as well as policy-gradient and actor-critic methods. Course activities include programming assignments as well as written homework testing students understanding of the material.">
<link rel="stylesheet" href="../css/common.css">
<link rel="stylesheet" href="../css/coursedisplay.css">
<link rel="stylesheet" href="../css/themes.css">
<link rel="shortcut icon" href="../favicon/quatalogIcon.png">
<link rel="icon" href="../favicon/favicon.ico">
<link rel="apple-touch-icon" sizes="180x180" href="../favicon/apple-touch-icon.png">
<link rel="icon" type="image/png" sizes="32x32" href="../favicon/favicon-32x32.png">
<link rel="icon" type="image/png" sizes="16x16" href="../favicon/favicon-16x16.png">
<link rel="manifest" href="../favicon/site.webmanifest">
<script src="../js/fuse.js"></script>
<script src="../js/search_helper.js"></script>
</head>
<body class="search_plugin_added">
<div id="qlog-header">
<a id="qlog-wordmark" href="../"><svg><use href="../images/quatalogHWordmark.svg#QuatalogHWordmark"></use></svg></a>
<form onsubmit="search_helper(event)">
<input type="text" id="search" class="header-search" placeholder="Search...">
</form>
</div>
<div id="cd-flex">
<div id="course-info-container">
<h1 id="name">
Reinforcement Learning
</h1>
<h2 id="code">
CSCI-4160
</h2>
<p>
This is an introductory course on the theory and practice of reinforcement learning (RL). We will derive the full RL framework, starting from Markov chains and Markov reward processes and building up to Markov decision processes. We will then cover classic RL approaches such as dynamic programming, Monte Carlo methods and Q-learning. Furthermore, we will cover more advanced topics such as deep learning, deep RL, as well as policy-gradient and actor-critic methods. Course activities include programming assignments as well as written homework testing students understanding of the material.
</p>
<div id="cattrs-container">
<span id="credits-pill" class="attr-pill">
4 credits
</span>
</div>
<div id="crosslist-container">
<div id="crosslist-title" class="rel-info-title">
Cross-listed with:
</div>
<div id=crosslist-classes" class="rel-info-courses">
<a class="course-pill" href="CSCI-6963">CSCI-6963 Topics in CSCI</a>
<a class="course-pill" href="ECSE-4965">ECSE-4965 Topics in ECSE</a>
<a class="course-pill" href="ECSE-6965">ECSE-6965 Topics in ECSE</a>
</div>
</div>
<div id="prereq-container" class="rel-info-container">
<div id="prereq-title" class="rel-info-title">
Prereqs:
</div>
<div id="prereq-classes" class="rel-info-courses">
<a class="course-pill" href="CSCI-2300">CSCI-2300 Introduction To Algorithms</a>
<div class="pr-and">and</div>
<a class="course-pill" href="CSCI-4100">CSCI-4100 Machine Learning From Data</a>
<div class="pr-and">and</div>
<div class="pr-or-con">
<div class="pr-or-title">
one of:
</div>
<div class="pr-or">
<a class="course-pill" href="CSCI-2210">CSCI-2210 Math Fndtns Of Machine Lrning</a>
<a class="course-pill" href="MATH-4100">MATH-4100 Linear Algebra</a>
</div>
</div>
</div>
</div>
</div>
<div id="past-container">
<h1 id="past-title">
Past Term Data
</h2>
<input type="radio" id="simple-view-input" name="view-select" value="simple" checked="checked">
<input type="radio" id="detail-view-input" name="view-select" value="detailed">
<div id="opt-container">
<div id="key-panel">
<div id="yes-code" class="key-code">
<span class="code-icon" id="yes-code-icon">
<svg><use href="../icons.svg#circle-check"></use></svg>
</span>
Offered
</div>
<div id="no-code" class="key-code">
<span class="code-icon" id="no-code-icon">
<svg><use href="../icons.svg#circle-no"></use></svg>
</span>
Not Offered
</div>
<div id="diff-code" class="key-code">
<span class="code-icon" id="diff-code-icon">
<svg><use href="../icons.svg#circle-question"></use></svg>
</span>
Offered as Cross-Listing Only
</div>
<div id="nil-code" class="key-code">
<span class="code-icon" id="nil-code-icon">
<svg><use href="../icons.svg#circle-empty"></use></svg>
</span>
No Term Data
</div>
</div>
<div id="control-panel">
<label for="simple-view-input" id="simple-view-label" class="view-option-label">
<span class="view-icon" id="simple-view-icon">
<span class="view-icon-selected"><svg><use href="../icons.svg#circle-dot"></use></svg></span>
<span class="view-icon-unselected"><svg><use href="../icons.svg#circle-empty"></use></svg></span>
</span>
Simple View
</label>
<label for="detail-view-input" id="detail-view-label" class="view-option-label">
<span class="view-icon" id="detail-view-icon">
<span class="view-icon-selected"><svg><use href="../icons.svg#circle-dot"></use></svg></span>
<span class="view-icon-unselected"><svg><use href="../icons.svg#circle-empty"></use></svg></span>
</span>
Detailed View
</label>
</div>
</div>
<table id="years-table">
<thead>
<tr>
<th></th>
<th class="spring season-label">Spring</th>
<th class="summer season-label" colspan="2">Summer</th>
<th class="fall season-label">Fall</th>
</tr>
<tr>
<th colspan="2"></th>
<th class="summer2 midsum-label">(Session 1)</th>
<th class="summer3 midsum-label">(Session 2)</th>
<th></th>
</tr>
</thead>
<tbody>
<tr>
<th class="year">2025</th>
<td class="term spring offered-diff-code">
</td>
<td colspan="2" class="term summer unscheduled">
</td>
<td class="term fall unscheduled">
</td>
</tr>
<tr>
<th class="year">2024</th>
<td class="term spring offered-diff-code">
</td>
<td colspan="2" class="term summer not-offered">
</td>
<td class="term fall offered">
<div class="view-container detail-view-container">
<span class="term-course-info">
<a href="https://sis.rpi.edu/rss/bwckctlg.p_disp_listcrse?term_in=202409&subj_in=CSCI&crse_in=4160&schd_in=">Reinforcement Learning (4c)</a>
</span>
<ul class="prof-list">
<li>Radoslav Svetlozarov Ivanov</li>
</ul>
<span class="course-capacity">
Seats Taken: 25/50
</span>
</div>
</td>
</tr>
<tr>
<th class="year">2023</th>
<td class="term spring not-offered">
</td>
<td colspan="2" class="term summer not-offered">
</td>
<td class="term fall offered-diff-code">
</td>
</tr>
<tr>
<th class="year">2022</th>
<td class="term spring offered-diff-code">
</td>
<td colspan="2" class="term summer not-offered">
</td>
<td class="term fall offered-diff-code">
</td>
</tr>
<tr>
<th class="year">2021</th>
<td class="term spring offered-diff-code">
</td>
<td colspan="2" class="term summer not-offered">
</td>
<td class="term fall offered-diff-code">
</td>
</tr>
<tr>
<th class="year">2020</th>
<td class="term spring not-offered">
</td>
<td colspan="2" class="term summer not-offered">
</td>
<td class="term fall offered-diff-code">
</td>
</tr>
<tr>
<th class="year">2019</th>
<td class="term spring not-offered">
</td>
<td colspan="2" class="term summer not-offered">
</td>
<td class="term fall offered-diff-code">
</td>
</tr>
<tr>
<th class="year">2018</th>
<td class="term spring offered-diff-code">
</td>
<td colspan="2" class="term summer not-offered">
</td>
<td class="term fall offered-diff-code">
</td>
</tr>
<tr>
<th class="year">2017</th>
<td class="term spring offered-diff-code">
</td>
<td colspan="2" class="term summer not-offered">
</td>
<td class="term fall offered-diff-code">
</td>
</tr>
<tr>
<th class="year">2016</th>
<td class="term spring offered-diff-code">
</td>
<td colspan="2" class="term summer not-offered">
</td>
<td class="term fall offered-diff-code">
</td>
</tr>
<tr>
<th class="year">2015</th>
<td class="term spring offered-diff-code">
</td>
<td colspan="2" class="term summer not-offered">
</td>
<td class="term fall offered-diff-code">
</td>
</tr>
<tr>
<th class="year">2014</th>
<td class="term spring offered-diff-code">
</td>
<td colspan="2" class="term summer not-offered">
</td>
<td class="term fall offered-diff-code">
</td>
</tr>
<tr>
<th class="year">2013</th>
<td class="term spring offered-diff-code">
</td>
<td colspan="2" class="term summer not-offered">
</td>
<td class="term fall offered-diff-code">
</td>
</tr>
<tr>
<th class="year">2012</th>
<td class="term spring offered-diff-code">
</td>
<td colspan="2" class="term summer not-offered">
</td>
<td class="term fall offered-diff-code">
</td>
</tr>
<tr>
<th class="year">2011</th>
<td class="term spring offered-diff-code">
</td>
<td colspan="2" class="term summer not-offered">
</td>
<td class="term fall offered-diff-code">
</td>
</tr>
<tr>
<th class="year">2010</th>
<td class="term spring offered-diff-code">
</td>
<td colspan="2" class="term summer not-offered">
</td>
<td class="term fall offered-diff-code">
</td>
</tr>
<tr>
<th class="year">2009</th>
<td class="term spring offered-diff-code">
</td>
<td colspan="2" class="term summer not-offered">
</td>
<td class="term fall offered-diff-code">
</td>
</tr>
<tr>
<th class="year">2008</th>
<td class="term spring offered-diff-code">
</td>
<td colspan="2" class="term summer not-offered">
</td>
<td class="term fall offered-diff-code">
</td>
</tr>
<tr>
<th class="year">2007</th>
<td class="term spring offered-diff-code">
</td>
<td colspan="2" class="term summer not-offered">
</td>
<td class="term fall offered-diff-code">
</td>
</tr>
<tr>
<th class="year">2006</th>
<td class="term spring not-offered">
</td>
<td colspan="2" class="term summer not-offered">
</td>
<td class="term fall offered-diff-code">
</td>
</tr>
<tr>
<th class="year">2005</th>
<td class="term spring offered-diff-code">
</td>
<td colspan="2" class="term summer not-offered">
</td>
<td class="term fall offered-diff-code">
</td>
</tr>
<tr>
<th class="year">2004</th>
<td class="term spring offered-diff-code">
</td>
<td colspan="2" class="term summer not-offered">
</td>
<td class="term fall offered-diff-code">
</td>
</tr>
<tr>
<th class="year">2003</th>
<td class="term spring offered-diff-code">
</td>
<td colspan="2" class="term summer not-offered">
</td>
<td class="term fall offered-diff-code">
</td>
</tr>
<tr>
<th class="year">2002</th>
<td class="term spring offered-diff-code">
</td>
<td colspan="2" class="term summer not-offered">
</td>
<td class="term fall offered-diff-code">
</td>
</tr>
<tr>
<th class="year">2001</th>
<td class="term spring offered-diff-code">
</td>
<td colspan="2" class="term summer not-offered">
</td>
<td class="term fall offered-diff-code">
</td>
</tr>
<tr>
<th class="year">2000</th>
<td class="term spring offered-diff-code">
</td>
<td colspan="2" class="term summer not-offered">
</td>
<td class="term fall not-offered">
</td>
</tr>
<tr>
<th class="year">1999</th>
<td class="term spring offered-diff-code">
</td>
<td colspan="2" class="term summer not-offered">
</td>
<td class="term fall offered-diff-code">
</td>
</tr>
<tr>
<th class="year">1998</th>
<td class="term spring unscheduled">
</td>
<td colspan="2" class="term summer not-offered">
</td>
<td class="term fall not-offered">
</td>
</tr>
</tbody>
</table>
</div>
</div>
</body>
</html>