Transformer Reinforcement Learning
Leandro von Werra, GitHub : https://github.com/lvwerra/trl
#ProximalPolicyOptimization #Transformer #ReinforcementLearning
Leandro von Werra, GitHub : https://github.com/lvwerra/trl
#ProximalPolicyOptimization #Transformer #ReinforcementLearning
GitHub
GitHub - huggingface/trl: Train transformer language models with reinforcement learning.
Train transformer language models with reinforcement learning. - huggingface/trl
The Sparse Future of Deep Learning
Could this be the next quantum leap in AI research?
https://towardsdatascience.com/the-sparse-future-of-deep-learning-bce05e8e094a
Could this be the next quantum leap in AI research?
https://towardsdatascience.com/the-sparse-future-of-deep-learning-bce05e8e094a
Medium
The Sparse Future of Deep Learning
Could this be the next quantum leap in AI research?
Can Single Neurons Solve MNIST? The Computational Power of Biological Dendritic Trees
Ilenna Simone Jones, Konrad Paul Kording : https://arxiv.org/abs/2009.01269
#Neurons #DeepLearning #Cognition
Ilenna Simone Jones, Konrad Paul Kording : https://arxiv.org/abs/2009.01269
#Neurons #DeepLearning #Cognition
ConvNets helping the visually impaired.
Wearable AI devices are going to become ubiquitous over the next decade.
I met the OrCam folks when they were just starting.
They've made a lot of progress in low-power ConvNet chips.
OrCam was founded by Amnon Shashua who also founded MobilEye (now part of Intel).
https://m.youtube.com/watch?feature=youtu.be&v=82oAUwwwG2Q
Post by yan lecun
Wearable AI devices are going to become ubiquitous over the next decade.
I met the OrCam folks when they were just starting.
They've made a lot of progress in low-power ConvNet chips.
OrCam was founded by Amnon Shashua who also founded MobilEye (now part of Intel).
https://m.youtube.com/watch?feature=youtu.be&v=82oAUwwwG2Q
Post by yan lecun
YouTube
OrCam and Messi are Empowering the Blind Community
Watch the magical moments when Leo Messi met exceptional individuals from the blind community and gave them the gift of independence, OrCam MyEye.
OrCam MyEye is the world's most advanced assistive wearable device that reads text, recognizes faces, identifies…
OrCam MyEye is the world's most advanced assistive wearable device that reads text, recognizes faces, identifies…
Microsoft releases a new version of DeepSpeed tool to enable the creation of deep learning models with a trillion parameters
Github: https://github.com/microsoft/DeepSpeed
Source: https://www.microsoft.com/en-us/research/project/deepspeed/
Paper: https://arxiv.org/abs/1910.02054
Github: https://github.com/microsoft/DeepSpeed
Source: https://www.microsoft.com/en-us/research/project/deepspeed/
Paper: https://arxiv.org/abs/1910.02054
GitHub
GitHub - deepspeedai/DeepSpeed: DeepSpeed is a deep learning optimization library that makes distributed training and inference…
DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective. - deepspeedai/DeepSpeed
tsBNgen, a Python Library to Generate Synthetic Data From an Arbitrary Bayesian Network.
Paper Summary: https://www.marktechpost.com/2020/09/15/tsbngen-a-python-library-to-generate-synthetic-data-from-an-arbitrary-bayesian-network/
Paper: https://arxiv.org/pdf/2009.04595.pdf
Github: https://github.com/manitadayon/tsBNgen/blob/master/tsbngen.pdf
Paper Summary: https://www.marktechpost.com/2020/09/15/tsbngen-a-python-library-to-generate-synthetic-data-from-an-arbitrary-bayesian-network/
Paper: https://arxiv.org/pdf/2009.04595.pdf
Github: https://github.com/manitadayon/tsBNgen/blob/master/tsbngen.pdf
MarkTechPost
tsBNgen, a Python Library to Generate Synthetic Data From an Arbitrary Bayesian Network.
tsBNgen, a Python Library to Generate Time Series and Sequential Data Based on an Arbitrary Dynamic Bayesian Network.
MiniTorch
Sasha Rush and Ge Gao : https://minitorch.github.io/index.html
#DeepLearning #PyTorch #Python
Sasha Rush and Ge Gao : https://minitorch.github.io/index.html
#DeepLearning #PyTorch #Python
Very nice article by M. Aminian in SIAM News ennoscriptd "The Connection Between Applied Mathematics and Deep Learning".
The article dissects and explains in very clear terms the gist of my plenary talk at the recent SIAM Mathematics of Data Science conference ennoscriptd "The Deep Learning - Applied Mathematics Connection".
It discusses the specifics of optimization as it pertains to DL (stochastic optimization in high-dimensional spaces), the surprising fact that widely overparamterized DL models work well, the use of DL in traditional applications of scientific computing: PDE solving, lattice quantum computation, graph convolutional nets and the connection with Fourier transform, and the rising topic of self-supervised learning.
The methods of Applied Mathematics could help explain some of the mysteries of deep learning
SIAM News paper: https://sinews.siam.org/Details-Page/the-connection-between-applied-mathematics-and-deep-learning
Video of my talk: https://youtu.be/9sqoe_krQ1E
The article dissects and explains in very clear terms the gist of my plenary talk at the recent SIAM Mathematics of Data Science conference ennoscriptd "The Deep Learning - Applied Mathematics Connection".
It discusses the specifics of optimization as it pertains to DL (stochastic optimization in high-dimensional spaces), the surprising fact that widely overparamterized DL models work well, the use of DL in traditional applications of scientific computing: PDE solving, lattice quantum computation, graph convolutional nets and the connection with Fourier transform, and the rising topic of self-supervised learning.
The methods of Applied Mathematics could help explain some of the mysteries of deep learning
SIAM News paper: https://sinews.siam.org/Details-Page/the-connection-between-applied-mathematics-and-deep-learning
Video of my talk: https://youtu.be/9sqoe_krQ1E
SIAM News
The Connection Between Applied Mathematics and Deep Learning
By Manuchehr Aminian
In recent years, deep learning (DL) has inspired a myriad of advances within the scientific computing community. This subset of artificial intelligence relies on multiple components of applied mathematics, but what type of relationship…
In recent years, deep learning (DL) has inspired a myriad of advances within the scientific computing community. This subset of artificial intelligence relies on multiple components of applied mathematics, but what type of relationship…
Papers with Code partners with arXiv
Robert Stojnic : https://medium.com/paperswithcode/papers-with-code-partners-with-arxiv-ecc362883167
@ArtificialIntelligenceArticles
#MachineLearning #arXiv #Code
Robert Stojnic : https://medium.com/paperswithcode/papers-with-code-partners-with-arxiv-ecc362883167
@ArtificialIntelligenceArticles
#MachineLearning #arXiv #Code
Deep Reinforcement Learning
CS 285 at UC Berkeley, Fall 2020
Levine et al.: https://www.youtube.com/playlist?list=PL_iWQOsE6TfURIIhCrlt-wj9ByIVpbfGc
#ArtificialIntelligence #DeepLearning #ReinforcementLearning
CS 285 at UC Berkeley, Fall 2020
Levine et al.: https://www.youtube.com/playlist?list=PL_iWQOsE6TfURIIhCrlt-wj9ByIVpbfGc
#ArtificialIntelligence #DeepLearning #ReinforcementLearning
YouTube
Deep Reinforcement Learning: CS 285 Fall 2020
Lectures for UC Berkeley CS 285: Deep Reinforcement Learning.