| Name | inf581 JSON |
| Version |
1.0.3
JSON |
| download |
| home_page | http://www.jdhp.org/ |
| Summary | Tool functions for INF581. |
| upload_time | 2023-02-08 12:42:49 |
| maintainer | Jeremie DECOCK |
| docs_url | None |
| author | Jeremie DECOCK |
| requires_python | |
| license | |
| keywords |
inf581
|
| VCS |
|
| bugtrack_url |
|
| requirements |
No requirements were recorded.
|
| Travis-CI |
No Travis.
|
| coveralls test coverage |
No coveralls.
|
====================
Polytechnique INF581
====================
Copyright (c) 2019-2021 Jérémie Decock
.. image:: logo.jpg
:width: 100
:alt: Alternative text
Github repository: https://github.com/jeremiedecock/polytechnique-inf581-2021
Moodle
======
https://moodle.polytechnique.fr/course/view.php?id=9352
Welcome to INF581!
==================
Driven by recent breakthroughs, rapidly growing collections of data, and a plethora of exciting applications, artificial intelligence is experiencing massive interest and investment from both the academic and industrial scene.
This course selects a number of advanced topics to explore in machine learning and autonomous agents, in particular:
- Probabilistic graphical models (Bayesian networks, ...)
- Multi-output and structured-output prediction problems
- Deep-learning architectures
- Methods of search and optimization (Beam search, epsilon-approximate search, stochastic optimization, Monte Carlo methods, ...)
- Sequential prediction and decision making (HMMs, Sequential Monte Carlo, Bayesian Filtering, MDPs, ...)
- Reinforcement learning (Q-Learning, Deep Q-Learning, ...)
Although these topics are diverse and extensive, this course is developed around a common thread connecting them all, such that each topic builds off the others.
Lectures will cover the relevant theory, and labs will familiarize the students with these topics from a practical point of view. Several of the lab assignments will be graded,
and a team project on reinforcement learning will form a major component of the grade - where the goal is to developing and deploy an agent in an environment and write a report analyzing the results.
Course Outline
--------------
A working outline can be found as topics below. This is subject to minor changes as the course progresses.
Some recommended literature
---------------------------
TODO...
Lab sessions
------------
Jupyter Notebooks can either be executed on Google Colab (works nicely with Google Drive), MyBinder (don't forget to regularly save your work) or locally,
in which case Anaconda (2019.10 or above ; Python 3.7 or above) is strongly recommended.
If the conda command does not work, it's that conda is not in the PATH environment variable. You may add it with the command::
export PATH="/usr/local/Anaconda3-2019.10/bin:$PATH"
conda init
If you choose the "Local" version of the lab sessions, right click on the link > Save Link as...
If you wish to execute the notebooks on the machines of the Salle d'Informatique, download [this conda_environment.yml](conda_environment.yml) file open a terminal prompt and enter::
conda env create -f conda_environment.yml
python -m ipykernel install --user --name inf581 --display-name "Python (inf581)"
This will install all dependencies in a new conda environment named inf581. Once on the Notebook, don't forget to use Kernel > Change Kernel to use the Python (inf581) environment.
If the conda environment inf581 already exists, you may delete it with the following command::
conda remove --name inf581 --all
To launch Jupyter, use::
jupyter-notebook --ip=0.0.0.0 --port=8080
Dependencies
============
C.f. requirements.txt
.. _install:
Installation
============
Posix (Linux, MacOSX, WSL, ...)
-------------------------------
From the source code::
conda deactivate # Only if you use Anaconda...
python3 -m venv env
source env/bin/activate
python3 -m pip install --upgrade pip
python3 -m pip install -r requirements-jupyter.txt
python3 setup.py develop
Windows
-------
From the source code::
conda deactivate # Only if you use Anaconda...
python3 -m venv env
env\Scripts\activate.bat
python3 -m pip install --upgrade pip
python3 -m pip install -r requirements-jupyter.txt
python3 setup.py develop
Lab sessions
============
Lab session 4: Dynamic Programming
----------------------------------
Subject:
- Open in Google Colab: https://colab.research.google.com/github/jeremiedecock/polytechnique-inf581-2021/blob/master/lab4_rl1_dynamic_programming.ipynb
- Open in MyBinder: https://mybinder.org/v2/gh/jeremiedecock/polytechnique-inf581-2021/master?filepath=lab4_rl1_dynamic_programming.ipynb
- Open in NbViewer: https://nbviewer.jupyter.org/github/jeremiedecock/polytechnique-inf581-2021/blob/master/lab4_rl1_dynamic_programming.ipynb
- Download the notebook file: https://github.com/jeremiedecock/polytechnique-inf581-2021/raw/master/lab4_rl1_dynamic_programming.ipynb
Solution:
- Open in Google Colab: https://colab.research.google.com/github/jeremiedecock/polytechnique-inf581-2021/blob/master/lab4_rl1_dynamic_programming_answers.ipynb
- Open in MyBinder: https://mybinder.org/v2/gh/jeremiedecock/polytechnique-inf581-2021/master?filepath=lab4_rl1_dynamic_programming_answers.ipynb
- Open in NbViewer: https://nbviewer.jupyter.org/github/jeremiedecock/polytechnique-inf581-2021/blob/master/lab4_rl1_dynamic_programming_answers.ipynb
- Download the notebook file: https://github.com/jeremiedecock/polytechnique-inf581-2021/raw/master/lab4_rl1_dynamic_programming_answers.ipynb
Lab session 6
-------------
Subject:
- Open in Google Colab: https://colab.research.google.com/github/jeremiedecock/polytechnique-inf581-2021/blob/master/lab6_rl2_tdlearning_qlearning_sarsa.ipynb
- Open in MyBinder: https://mybinder.org/v2/gh/jeremiedecock/polytechnique-inf581-2021/master?filepath=lab6_rl2_tdlearning_qlearning_sarsa.ipynb
- Open in NbViewer: https://nbviewer.jupyter.org/github/jeremiedecock/polytechnique-inf581-2021/blob/master/lab6_rl2_tdlearning_qlearning_sarsa.ipynb
- Download the notebook file: https://raw.githubusercontent.com/jeremiedecock/polytechnique-inf581-2021/master/lab6_rl2_tdlearning_qlearning_sarsa.ipynb
Solution:
- Open in Google Colab: https://colab.research.google.com/github/jeremiedecock/polytechnique-inf581-2021/blob/master/lab6_rl2_tdlearning_qlearning_sarsa_answers.ipynb
- Open in MyBinder: https://mybinder.org/v2/gh/jeremiedecock/polytechnique-inf581-2021/master?filepath=lab6_rl2_tdlearning_qlearning_sarsa_answers.ipynb
- Open in NbViewer: https://nbviewer.jupyter.org/github/jeremiedecock/polytechnique-inf581-2021/blob/master/lab6_rl2_tdlearning_qlearning_sarsa_answers.ipynb
- Download the notebook file: https://github.com/jeremiedecock/polytechnique-inf581-2021/raw/master/lab6_rl2_tdlearning_qlearning_sarsa_answers.ipynb
Lab session 7
-------------
Subject:
- Open in Google Colab: https://colab.research.google.com/github/jeremiedecock/polytechnique-inf581-2021/blob/master/lab7_rl3_reinforce.ipynb
- Open in MyBinder: https://mybinder.org/v2/gh/jeremiedecock/polytechnique-inf581-2021/master?filepath=lab7_rl3_reinforce.ipynb
- Open in NbViewer: https://nbviewer.jupyter.org/github/jeremiedecock/polytechnique-inf581-2021/blob/master/lab7_rl3_reinforce.ipynb
- Download the notebook file: https://github.com/jeremiedecock/polytechnique-inf581-2021/raw/master/lab7_rl3_reinforce.ipynb
Solution:
- Open in Google Colab: https://colab.research.google.com/github/jeremiedecock/polytechnique-inf581-2021/blob/master/lab7_rl3_reinforce_answers.ipynb
- Open in MyBinder: https://mybinder.org/v2/gh/jeremiedecock/polytechnique-inf581-2021/master?filepath=lab7_rl3_reinforce_answers.ipynb
- Open in NbViewer: https://nbviewer.jupyter.org/github/jeremiedecock/polytechnique-inf581-2021/blob/master/lab7_rl3_reinforce_answers.ipynb
- Download the notebook file: https://github.com/jeremiedecock/polytechnique-inf581-2021/raw/master/lab7_rl3_reinforce_answers.ipynb
Bonus:
- Open in Google Colab: https://colab.research.google.com/github/jeremiedecock/polytechnique-inf581-2021/blob/master/lab7_rl3_reinforce_baselines.ipynb
- Open in MyBinder: https://mybinder.org/v2/gh/jeremiedecock/polytechnique-inf581-2021/master?filepath=lab7_rl3_reinforce_baselines.ipynb
- Open in NbViewer: https://nbviewer.jupyter.org/github/jeremiedecock/polytechnique-inf581-2021/blob/master/lab7_rl3_reinforce_baselines.ipynb
- Download the notebook file: https://raw.githubusercontent.com/jeremiedecock/polytechnique-inf581-2021/master/lab7_rl3_reinforce_baselines.ipynb
Lab session 8
-------------
Subject:
- Open in Google Colab: https://colab.research.google.com/github/jeremiedecock/polytechnique-inf581-2021/blob/master/lab8_optim_cem.ipynb
- Open in MyBinder: https://mybinder.org/v2/gh/jeremiedecock/polytechnique-inf581-2021/master?filepath=lab8_optim_cem.ipynb
- Open in NbViewer: https://nbviewer.jupyter.org/github/jeremiedecock/polytechnique-inf581-2021/blob/master/lab8_optim_cem.ipynb
- Download the notebook file: https://github.com/jeremiedecock/polytechnique-inf581-2021/raw/master/lab8_optim_cem.ipynb
Solution:
- Open in Google Colab: https://colab.research.google.com/github/jeremiedecock/polytechnique-inf581-2021/blob/master/lab8_optim_cem_answers.ipynb
- Open in MyBinder: https://mybinder.org/v2/gh/jeremiedecock/polytechnique-inf581-2021/master?filepath=lab8_optim_cem_answers.ipynb
- Open in NbViewer: https://nbviewer.jupyter.org/github/jeremiedecock/polytechnique-inf581-2021/blob/master/lab8_optim_cem_answers.ipynb
- Download the notebook file: https://github.com/jeremiedecock/polytechnique-inf581-2021/raw/master/lab8_optim_cem_answers.ipynb
Raw data
{
"_id": null,
"home_page": "http://www.jdhp.org/",
"name": "inf581",
"maintainer": "Jeremie DECOCK",
"docs_url": null,
"requires_python": "",
"maintainer_email": "jd.jdhp@gmail.com",
"keywords": "INF581",
"author": "Jeremie DECOCK",
"author_email": "jd.jdhp@gmail.com",
"download_url": "https://files.pythonhosted.org/packages/95/d4/49ed180e6884e600421dacc45fcb6187665359e2c1604b97a5e9a5b4bc9d/inf581-1.0.3.tar.gz",
"platform": null,
"description": "====================\nPolytechnique INF581\n====================\n\nCopyright (c) 2019-2021 J\u00e9r\u00e9mie Decock\n\n.. image:: logo.jpg\n :width: 100\n :alt: Alternative text\n\n\nGithub repository: https://github.com/jeremiedecock/polytechnique-inf581-2021\n\n\nMoodle\n======\n\n https://moodle.polytechnique.fr/course/view.php?id=9352\n\n\nWelcome to INF581!\n==================\n\nDriven by recent breakthroughs, rapidly growing collections of data, and a plethora of exciting applications, artificial intelligence is experiencing massive interest and investment from both the academic and industrial scene.\n\nThis course selects a number of advanced topics to explore in machine learning and autonomous agents, in particular:\n\n- Probabilistic graphical models (Bayesian networks, ...)\n- Multi-output and structured-output prediction problems\n- Deep-learning architectures\n- Methods of search and optimization (Beam search, epsilon-approximate search, stochastic optimization, Monte Carlo methods, ...)\n- Sequential prediction and decision making (HMMs, Sequential Monte Carlo, Bayesian Filtering, MDPs, ...)\n- Reinforcement learning (Q-Learning, Deep Q-Learning, ...)\n\nAlthough these topics are diverse and extensive, this course is developed around a common thread connecting them all, such that each topic builds off the others.\n\nLectures will cover the relevant theory, and labs will familiarize the students with these topics from a practical point of view. Several of the lab assignments will be graded,\nand a team project on reinforcement learning will form a major component of the grade - where the goal is to developing and deploy an agent in an environment and write a report analyzing the results.\n\nCourse Outline\n--------------\n\nA working outline can be found as topics below. This is subject to minor changes as the course progresses. \n\n\nSome recommended literature\n---------------------------\n\nTODO...\n\n\nLab sessions\n------------\n\nJupyter Notebooks can either be executed on Google Colab (works nicely with Google Drive), MyBinder (don't forget to regularly save your work) or locally,\nin which case Anaconda (2019.10 or above ; Python 3.7 or above) is strongly recommended.\nIf the conda command does not work, it's that conda is not in the PATH environment variable. You may add it with the command::\n\n export PATH=\"/usr/local/Anaconda3-2019.10/bin:$PATH\"\n conda init\n\nIf you choose the \"Local\" version of the lab sessions, right click on the link > Save Link as...\nIf you wish to execute the notebooks on the machines of the Salle d'Informatique, download [this conda_environment.yml](conda_environment.yml) file open a terminal prompt and enter::\n\n conda env create -f conda_environment.yml\n python -m ipykernel install --user --name inf581 --display-name \"Python (inf581)\"\n\nThis will install all dependencies in a new conda environment named inf581. Once on the Notebook, don't forget to use Kernel > Change Kernel to use the Python (inf581) environment.\nIf the conda environment inf581 already exists, you may delete it with the following command::\n\n conda remove --name inf581 --all\n\n\nTo launch Jupyter, use::\n\n jupyter-notebook --ip=0.0.0.0 --port=8080\n\n\nDependencies\n============\n\nC.f. requirements.txt\n\n.. _install:\n\nInstallation\n============\n\nPosix (Linux, MacOSX, WSL, ...)\n-------------------------------\n\nFrom the source code::\n\n conda deactivate # Only if you use Anaconda...\n python3 -m venv env\n source env/bin/activate\n python3 -m pip install --upgrade pip\n python3 -m pip install -r requirements-jupyter.txt\n python3 setup.py develop\n\n\nWindows\n-------\n\nFrom the source code::\n\n conda deactivate # Only if you use Anaconda...\n python3 -m venv env\n env\\Scripts\\activate.bat\n python3 -m pip install --upgrade pip\n python3 -m pip install -r requirements-jupyter.txt\n python3 setup.py develop\n\n\nLab sessions\n============\n\nLab session 4: Dynamic Programming\n----------------------------------\n\nSubject:\n\n- Open in Google Colab: https://colab.research.google.com/github/jeremiedecock/polytechnique-inf581-2021/blob/master/lab4_rl1_dynamic_programming.ipynb\n- Open in MyBinder: https://mybinder.org/v2/gh/jeremiedecock/polytechnique-inf581-2021/master?filepath=lab4_rl1_dynamic_programming.ipynb\n- Open in NbViewer: https://nbviewer.jupyter.org/github/jeremiedecock/polytechnique-inf581-2021/blob/master/lab4_rl1_dynamic_programming.ipynb\n- Download the notebook file: https://github.com/jeremiedecock/polytechnique-inf581-2021/raw/master/lab4_rl1_dynamic_programming.ipynb\n\nSolution:\n\n- Open in Google Colab: https://colab.research.google.com/github/jeremiedecock/polytechnique-inf581-2021/blob/master/lab4_rl1_dynamic_programming_answers.ipynb\n- Open in MyBinder: https://mybinder.org/v2/gh/jeremiedecock/polytechnique-inf581-2021/master?filepath=lab4_rl1_dynamic_programming_answers.ipynb\n- Open in NbViewer: https://nbviewer.jupyter.org/github/jeremiedecock/polytechnique-inf581-2021/blob/master/lab4_rl1_dynamic_programming_answers.ipynb\n- Download the notebook file: https://github.com/jeremiedecock/polytechnique-inf581-2021/raw/master/lab4_rl1_dynamic_programming_answers.ipynb\n\n\nLab session 6\n-------------\n\nSubject:\n\n- Open in Google Colab: https://colab.research.google.com/github/jeremiedecock/polytechnique-inf581-2021/blob/master/lab6_rl2_tdlearning_qlearning_sarsa.ipynb\n- Open in MyBinder: https://mybinder.org/v2/gh/jeremiedecock/polytechnique-inf581-2021/master?filepath=lab6_rl2_tdlearning_qlearning_sarsa.ipynb\n- Open in NbViewer: https://nbviewer.jupyter.org/github/jeremiedecock/polytechnique-inf581-2021/blob/master/lab6_rl2_tdlearning_qlearning_sarsa.ipynb\n- Download the notebook file: https://raw.githubusercontent.com/jeremiedecock/polytechnique-inf581-2021/master/lab6_rl2_tdlearning_qlearning_sarsa.ipynb\n\nSolution:\n\n- Open in Google Colab: https://colab.research.google.com/github/jeremiedecock/polytechnique-inf581-2021/blob/master/lab6_rl2_tdlearning_qlearning_sarsa_answers.ipynb\n- Open in MyBinder: https://mybinder.org/v2/gh/jeremiedecock/polytechnique-inf581-2021/master?filepath=lab6_rl2_tdlearning_qlearning_sarsa_answers.ipynb\n- Open in NbViewer: https://nbviewer.jupyter.org/github/jeremiedecock/polytechnique-inf581-2021/blob/master/lab6_rl2_tdlearning_qlearning_sarsa_answers.ipynb\n- Download the notebook file: https://github.com/jeremiedecock/polytechnique-inf581-2021/raw/master/lab6_rl2_tdlearning_qlearning_sarsa_answers.ipynb\n\nLab session 7\n-------------\n\nSubject:\n\n- Open in Google Colab: https://colab.research.google.com/github/jeremiedecock/polytechnique-inf581-2021/blob/master/lab7_rl3_reinforce.ipynb\n- Open in MyBinder: https://mybinder.org/v2/gh/jeremiedecock/polytechnique-inf581-2021/master?filepath=lab7_rl3_reinforce.ipynb\n- Open in NbViewer: https://nbviewer.jupyter.org/github/jeremiedecock/polytechnique-inf581-2021/blob/master/lab7_rl3_reinforce.ipynb\n- Download the notebook file: https://github.com/jeremiedecock/polytechnique-inf581-2021/raw/master/lab7_rl3_reinforce.ipynb\n\nSolution:\n\n- Open in Google Colab: https://colab.research.google.com/github/jeremiedecock/polytechnique-inf581-2021/blob/master/lab7_rl3_reinforce_answers.ipynb\n- Open in MyBinder: https://mybinder.org/v2/gh/jeremiedecock/polytechnique-inf581-2021/master?filepath=lab7_rl3_reinforce_answers.ipynb\n- Open in NbViewer: https://nbviewer.jupyter.org/github/jeremiedecock/polytechnique-inf581-2021/blob/master/lab7_rl3_reinforce_answers.ipynb\n- Download the notebook file: https://github.com/jeremiedecock/polytechnique-inf581-2021/raw/master/lab7_rl3_reinforce_answers.ipynb\n\nBonus:\n\n- Open in Google Colab: https://colab.research.google.com/github/jeremiedecock/polytechnique-inf581-2021/blob/master/lab7_rl3_reinforce_baselines.ipynb\n- Open in MyBinder: https://mybinder.org/v2/gh/jeremiedecock/polytechnique-inf581-2021/master?filepath=lab7_rl3_reinforce_baselines.ipynb\n- Open in NbViewer: https://nbviewer.jupyter.org/github/jeremiedecock/polytechnique-inf581-2021/blob/master/lab7_rl3_reinforce_baselines.ipynb\n- Download the notebook file: https://raw.githubusercontent.com/jeremiedecock/polytechnique-inf581-2021/master/lab7_rl3_reinforce_baselines.ipynb\n\nLab session 8\n-------------\n\nSubject:\n\n- Open in Google Colab: https://colab.research.google.com/github/jeremiedecock/polytechnique-inf581-2021/blob/master/lab8_optim_cem.ipynb\n- Open in MyBinder: https://mybinder.org/v2/gh/jeremiedecock/polytechnique-inf581-2021/master?filepath=lab8_optim_cem.ipynb\n- Open in NbViewer: https://nbviewer.jupyter.org/github/jeremiedecock/polytechnique-inf581-2021/blob/master/lab8_optim_cem.ipynb\n- Download the notebook file: https://github.com/jeremiedecock/polytechnique-inf581-2021/raw/master/lab8_optim_cem.ipynb\n\nSolution:\n\n- Open in Google Colab: https://colab.research.google.com/github/jeremiedecock/polytechnique-inf581-2021/blob/master/lab8_optim_cem_answers.ipynb\n- Open in MyBinder: https://mybinder.org/v2/gh/jeremiedecock/polytechnique-inf581-2021/master?filepath=lab8_optim_cem_answers.ipynb\n- Open in NbViewer: https://nbviewer.jupyter.org/github/jeremiedecock/polytechnique-inf581-2021/blob/master/lab8_optim_cem_answers.ipynb\n- Download the notebook file: https://github.com/jeremiedecock/polytechnique-inf581-2021/raw/master/lab8_optim_cem_answers.ipynb\n",
"bugtrack_url": null,
"license": "",
"summary": "Tool functions for INF581.",
"version": "1.0.3",
"split_keywords": [
"inf581"
],
"urls": [
{
"comment_text": "",
"digests": {
"blake2b_256": "c32cec1806bef8cfd927b1c5eb602bc0ea8ea75542abcf5b68f55280867b0f87",
"md5": "5122c0aa08896d17da61cd3ab6b4ec64",
"sha256": "21a0a579d8c3e9735088192b72f2de54e8e07749cc77f20adfeb783855906d40"
},
"downloads": -1,
"filename": "inf581-1.0.3-py3-none-any.whl",
"has_sig": false,
"md5_digest": "5122c0aa08896d17da61cd3ab6b4ec64",
"packagetype": "bdist_wheel",
"python_version": "py3",
"requires_python": null,
"size": 5790,
"upload_time": "2023-02-08T12:42:47",
"upload_time_iso_8601": "2023-02-08T12:42:47.400749Z",
"url": "https://files.pythonhosted.org/packages/c3/2c/ec1806bef8cfd927b1c5eb602bc0ea8ea75542abcf5b68f55280867b0f87/inf581-1.0.3-py3-none-any.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "95d449ed180e6884e600421dacc45fcb6187665359e2c1604b97a5e9a5b4bc9d",
"md5": "a5384ce3a243da38846302bcd9a9ebe7",
"sha256": "608e9d777fb6c1b4e7ae90de4f570345842f05c35391aa1bdbb85303331b85cd"
},
"downloads": -1,
"filename": "inf581-1.0.3.tar.gz",
"has_sig": false,
"md5_digest": "a5384ce3a243da38846302bcd9a9ebe7",
"packagetype": "sdist",
"python_version": "source",
"requires_python": null,
"size": 7517,
"upload_time": "2023-02-08T12:42:49",
"upload_time_iso_8601": "2023-02-08T12:42:49.305773Z",
"url": "https://files.pythonhosted.org/packages/95/d4/49ed180e6884e600421dacc45fcb6187665359e2c1604b97a5e9a5b4bc9d/inf581-1.0.3.tar.gz",
"yanked": false,
"yanked_reason": null
}
],
"upload_time": "2023-02-08 12:42:49",
"github": false,
"gitlab": false,
"bitbucket": false,
"lcname": "inf581"
}
