Connectionists: 6 months Master Internship - ReservoirGPT - Inria, Bordeaux, France

[Xavier Hinaut]

Please find below an offer for an intership from February/March to July/August 2024 in Mnemosyne team at Inria, Bordeaux, France

# Title
ReservoirGPT
Large Language Model to help development with ReservoirPy

# Keywords
Machine Learning, Large Language Model, Recurrent Neural Network (RNN), Reservoir Computing,

# Supervisors
Xavier Hinaut, Researcher at Inria (Bordeaux, France)
xavier.hinaut at inria.fr

# Research team & internship location
Mnémosyne Team: Inria Bordeaux Sud-Ouest, LABRI & Institut des Maladies Neurodégénératives (Centre Broca Aquitaine, Carreire campus)
https://team.inria.fr/mnemosyne

# Introduction and scientific context
ReservoirPy is a library developed in the Mnemosyne Inria team in Bordeaux, France. ReservoirPy is a simple user-friendly library based on Python scientific modules. It provides a flexible interface to implement efficient Reservoir Computing (RC) architectures with a particular focus on Echo State Networks (ESN). Advanced features of ReservoirPy allow to improve computation time efficiency on a simple laptop compared to basic Python implementation, with datasets of any size.
Some of its features are: offline and online training, parallel implementation, sparse matrix computation, fast spectral initialization, advanced learning rules (e.g. Intrinsic Plasticity) etc. It also makes possible to easily create complex architectures with multiple reservoirs (e.g. deep reservoirs), readouts, and complex feedback loops. Moreover, graphical tools are included to easily explore hyperparameters with the help of the hyperopt library. It includes several tutorials exploring exotic architectures and examples of scientific papers reproduction. Moreover, graphical tools are included to easily explore hyperparameters with the help of the hyperopt library. ReservoirPy is available on GitHub:
https://github.com/reservoirpy/reservoirpy
with the open source MIT license, it includes a detailed documentation https://reservoirpy.readthedocs.io
and a pypi package for easy installation.


# Objectives
This six-month Master’s spring 2024 internship is centered on the ambitious goal of developing a cutting-edge Large Language Model (LLM) based service, specifically tailored to assist in programming with the ReservoirPy library. The primary objective is to create an AI-powered tool that simplifies and enhances the coding experience for users working with reservoir computing. This involves not only integrating the LLM with ReservoirPy to provide real-time coding assistance and error correction, but also customizing the model to understand and effectively respond to industry-specific terminologies and queries. Through this project, the intern will contribute to a pioneering effort in AI-assisted coding, bridging the gap between advanced AI language capabilities and practical, domain-specific programming needs.

# Required skills
- Expertise in Python
- Knowledge in software project management

- Experience with ChatGPT and Large Language Model
- General knowledge in machine learning (training procedure, evaluation, metrics, visualizations, Python tools...) is a plus
- General knowledge about artificial neural networks

# Applications
Deadline: as soon as possible; as soon as a good application is received it will be considered. Please contact Xavier Hinaut for any questions, and send your application (CV + cover letter) (Email at the top of the internship proposal).
References

[1] Trouvain, N., & Hinaut, X. (2022). reservoirpy: A Simple and Flexible Reservoir Computing Tool in Python.

[2] « ReservoirPy » https://github.com/reservoirpy/reservoirpy





Xavier Hinaut
Inria Research Scientist
www.xavierhinaut.com -- +33 5 33 51 48 01
Mnemosyne team, Inria, Bordeaux, France -- https://team.inria.fr/mnemosyne
& LaBRI, Bordeaux University --  https://www4.labri.fr/en/formal-methods-and-models
& IMN (Neurodegeneratives Diseases Institute) -- http://www.imn-bordeaux.org/en
---
Our Reservoir Computing library: https://github.com/reservoirpy/reservoirpy

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mailman.srv.cs.cmu.edu/pipermail/connectionists/attachments/20231117/4cbbd051/attachment.html>