📜 دو مقاله بسیار جالب در زمینه شناسایی اشیاء سه بعدی با استفاده از شبکه عصبی کانولوشن سه یعدی
👇👇👇👇👇👇👇👇👇👇
👇👇👇👇👇👇👇👇👇👇
🔴اساس کار شبکه های یادگیری ژرف مبتنی بر دو عمل می باشد. ارائه یک ساختار سلسله مراتبی که در این ساختار در هر لایه یک سطح از abstraction ایجاد می گردد بطوری که مفاهیم سطح بالا در لایه آخر ایجاد می گردد. همچنین به نوعی عمل یادگیری ویژگی است. در مقاله زیر عمل یادگیری ویژگی بصورت سلسله مراتبی عمل یادگیری ویژگی را انجام می دهد.
👇👇👇👇👇👇👇👇👇
👇👇👇👇👇👇👇👇👇
مهمترین ابزارها و زبان های برنامه نویسی برای بادگیری عمیق:
🔴تورچ (TORCH)
🔵تنسورفلو و کراس(Tensorflow)
⚫️ کافی (Caffe)
🌿🌿🌿🌿🌿🌿
🔴تورچ (TORCH)
🔵تنسورفلو و کراس(Tensorflow)
⚫️ کافی (Caffe)
🌿🌿🌿🌿🌿🌿
🌎ابزار Caffe2 فریمورکی اپنسورس از فیسبوک برای Deep Learning در پلتفرم موبایل
—----------------------------------------------------------------------------------------------
ابزار Caffe2 لایبرری یادگیری ژرف (Deep Learning) اپنسورس فیسبوک است؛ بر خلاف لایبرری قبلی فیسبوک تحت عنوان PyTorchh، این لایبرری به منظور افزودن قابلیت یادگیری ژرف به اپلیکیشنهای موبایلی ساخته شده است.
🍇🍇🍇🍇🍇🍇🍇🍇🍇🍇
—----------------------------------------------------------------------------------------------
ابزار Caffe2 لایبرری یادگیری ژرف (Deep Learning) اپنسورس فیسبوک است؛ بر خلاف لایبرری قبلی فیسبوک تحت عنوان PyTorchh، این لایبرری به منظور افزودن قابلیت یادگیری ژرف به اپلیکیشنهای موبایلی ساخته شده است.
🍇🍇🍇🍇🍇🍇🍇🍇🍇🍇
🌍 امروزه آزمایشگاههای متعددی در سرتاسر دنیا در تلاشند تا فریمورکهای کارا و سریعی را ایجاد نمایند تا بتوانند مدلهای یادگیری ژرف را برای همگان ملموستر کنند. چه در حال حاضر و چه در آینده، لایبرریهای کارآمد، لایبرریهایی هستند که همزمان قادر به رفع نیازهای متعددی باشند که بهنظر میرسد Caffe2 یکی از آنها است.
☘️☘️☘️☘️☘️☘️☘️☘️☘️☘️☘️☘️
☘️☘️☘️☘️☘️☘️☘️☘️☘️☘️☘️☘️
🌏ابزار Caffe2 یک فریمورک ماژولار یادگیری ژرف است که توسط شرکت فیسبوک و بهمنظور استفاده در Mobile Computing رایانش موبایلی به بازار عرضه شده است. فیسبوک و NVIDIA دستدردست هم دادهاند تا پتانسیل GPUهای NVIDIA را به شکوفایی کامل برسانند. همچنین این شرکت لایبرریهای مخصوصی را برای CPUهای ARM ،Raspberry Pi و انواع دیوایسهای loT طراحی نموده است.
🎄🎄🎄🎄🎄🎄🎄🎄🎄🎄
🎄🎄🎄🎄🎄🎄🎄🎄🎄🎄
☘️☘️☘️☘️☘️☘️☘️☘️☘️☘️☘️☘️☘️☘️☘️
🔵 اگر دنبال یادگیری شبکه عصبی کانولوشن هستید، سایت زیر مقالات و مطالب خیلی مفیدی داره که از ابتدا می توانید یادگیری را شروع کنید.
https://adeshpande3.github.io/adeshpande3.github.io/A-Beginner's-Guide-To-Understanding-Convolutional-Neural-Networks/
https://adeshpande3.github.io/adeshpande3.github.io/A-Beginner's-Guide-To-Understanding-Convolutional-Neural-Networks-Part-2/
👆🏿👆🏿👆🏿👆🏿👆🏿👆🏿👆🏿👆🏿👆🏿👆🏿
🔵 اگر دنبال یادگیری شبکه عصبی کانولوشن هستید، سایت زیر مقالات و مطالب خیلی مفیدی داره که از ابتدا می توانید یادگیری را شروع کنید.
https://adeshpande3.github.io/adeshpande3.github.io/A-Beginner's-Guide-To-Understanding-Convolutional-Neural-Networks/
https://adeshpande3.github.io/adeshpande3.github.io/A-Beginner's-Guide-To-Understanding-Convolutional-Neural-Networks-Part-2/
👆🏿👆🏿👆🏿👆🏿👆🏿👆🏿👆🏿👆🏿👆🏿👆🏿
adeshpande3.github.io
Adit Deshpande – Engineering at Forward | UCLA CS '19
☘️☘️☘️☘️☘️☘️☘️☘️☘️☘️☘️☘️☘️☘️☘️
🔵 نه مقاله ای که برای یادگیری ژرف بدون نظارت حتما باید مطالعه کنید
https://adeshpande3.github.io/adeshpande3.github.io/The-9-Deep-Learning-Papers-You-Need-To-Know-About.html
👆🏿👆🏿👆🏿👆🏿👆🏿👆🏿👆🏿👆🏿👆🏿👆🏿
🔵 نه مقاله ای که برای یادگیری ژرف بدون نظارت حتما باید مطالعه کنید
https://adeshpande3.github.io/adeshpande3.github.io/The-9-Deep-Learning-Papers-You-Need-To-Know-About.html
👆🏿👆🏿👆🏿👆🏿👆🏿👆🏿👆🏿👆🏿👆🏿👆🏿
adeshpande3.github.io
Adit Deshpande – Engineering at Forward | UCLA CS '19
🌿🌿🌿🌿🌿🌿🌿🌿🌿🌿🌿🌿🌿
🔵معرفی چهل و پنج ابزار یادگیری ژرف
1. Theano – CPU/GPU symbolic expression compiler in python (from MILA lab at University of Montreal)
2. Torch – provides a Matlab-like environment for state-of-the-art machine learning algorithms in lua (from Ronan Collobert, Clement Farabet and Koray Kavukcuoglu)
3. Pylearn2 – Pylearn2 is a library designed to make machine learning research easy.
4. Blocks – A Theano framework for training neural networks
5. Tensorflow – TensorFlow™ is an open source software library for numerical computation using data flow graphs.
6. MXNet – MXNet is a deep learning framework designed for both efficiency and flexibility.
7. Caffe -Caffe is a deep learning framework made with expression, speed, and modularity in mind.Caffe is a deep learning framework made with expression, speed, and modularity in mind.
8. Lasagne – Lasagne is a lightweight library to build and train neural networks in Theano.
9. Keras– A theano based deep learning library.
10. Deep Learning Tutorials – examples of how to do Deep Learning with Theano (from LISA lab at University of Montreal)
11. Chainer – A GPU based Neural Network Framework
12. Matlab Deep Learning – Matlab Deep Learning Tools
13. CNTK – Computational Network Toolkit – is a unified deep-learning toolkit by Microsoft Research.
14. MatConvNet – A MATLAB toolbox implementing Convolutional Neural Networks (CNNs) for computer vision applications. It is simple, efficient, and can run and learn state-of-the-art CNNs.
15. DeepLearnToolbox – A Matlab toolbox for Deep Learning (from Rasmus Berg Palm)
16. BigDL. A distributed open-source Apache Spark deep learning library designed for efficient scale-out to multiple nodes. CPU-optimized via MKL. Scala and Python support. (Developed and supported by Intel Corp). https://software.intel.com/bigdl. https://github.com/intel-analytics/BigDL
17. Cuda-Convnet – A fast C++/CUDA implementation of convolutional (or more generally, feed-forward) neural networks. It can model arbitrary layer connectivity and network depth. Any directed acyclic graph of layers will do. Training is done using the back-propagation algorithm.
18. Deep Belief Networks. Matlab code for learning Deep Belief Networks (from Ruslan Salakhutdinov).
19. RNNLM– Tomas Mikolov’s Recurrent Neural Network based Language models Toolkit.
20. RNNLIB-RNNLIB is a recurrent neural network library for sequence learning problems. Applicable to most types of spatiotemporal data, it has proven particularly effective for speech and handwriting recognition.
21. matrbm. Simplified version of Ruslan Salakhutdinov’s code, by Andrej Karpathy (Matlab).
22. deeplearning4j– Deeplearning4J is an Apache 2.0-licensed, open-source, distributed neural net library written in Java and Scala.
23. Estimating Partition Functions of RBM’s. Matlab code for estimating partition functions of Restricted Boltzmann Machines using Annealed Importance Sampling (from Ruslan Salakhutdinov).
24. Learning Deep Boltzmann Machines Matlab code for training and fine-tuning Deep Boltzmann Machines (from Ruslan Salakhutdinov).
25. The LUSH programming language and development environment, which is used @ NYU for deep convolutional networks
26. Eblearn.lsh is a LUSH-based machine learning library for doing Energy-Based Learning. It includes code for “Predictive Sparse Decomposition” and other sparse auto-encoder methods for unsupervised learning. Koray Kavukcuoglu provides Eblearn code for several deep learning papers on this page.
27. deepmat– Deepmat, Matlab based deep learning algorithms.
28. MShadow – MShadow is a lightweight CPU/GPU Matrix/Tensor Template Library in C++/CUDA. The goal of mshadow is to support efficient, device invariant and simple tensor library for machine learning project that aims for both simplicity and performance. Supports CPU/GPU/Multi-GPU and distributed system.
🔵معرفی چهل و پنج ابزار یادگیری ژرف
1. Theano – CPU/GPU symbolic expression compiler in python (from MILA lab at University of Montreal)
2. Torch – provides a Matlab-like environment for state-of-the-art machine learning algorithms in lua (from Ronan Collobert, Clement Farabet and Koray Kavukcuoglu)
3. Pylearn2 – Pylearn2 is a library designed to make machine learning research easy.
4. Blocks – A Theano framework for training neural networks
5. Tensorflow – TensorFlow™ is an open source software library for numerical computation using data flow graphs.
6. MXNet – MXNet is a deep learning framework designed for both efficiency and flexibility.
7. Caffe -Caffe is a deep learning framework made with expression, speed, and modularity in mind.Caffe is a deep learning framework made with expression, speed, and modularity in mind.
8. Lasagne – Lasagne is a lightweight library to build and train neural networks in Theano.
9. Keras– A theano based deep learning library.
10. Deep Learning Tutorials – examples of how to do Deep Learning with Theano (from LISA lab at University of Montreal)
11. Chainer – A GPU based Neural Network Framework
12. Matlab Deep Learning – Matlab Deep Learning Tools
13. CNTK – Computational Network Toolkit – is a unified deep-learning toolkit by Microsoft Research.
14. MatConvNet – A MATLAB toolbox implementing Convolutional Neural Networks (CNNs) for computer vision applications. It is simple, efficient, and can run and learn state-of-the-art CNNs.
15. DeepLearnToolbox – A Matlab toolbox for Deep Learning (from Rasmus Berg Palm)
16. BigDL. A distributed open-source Apache Spark deep learning library designed for efficient scale-out to multiple nodes. CPU-optimized via MKL. Scala and Python support. (Developed and supported by Intel Corp). https://software.intel.com/bigdl. https://github.com/intel-analytics/BigDL
17. Cuda-Convnet – A fast C++/CUDA implementation of convolutional (or more generally, feed-forward) neural networks. It can model arbitrary layer connectivity and network depth. Any directed acyclic graph of layers will do. Training is done using the back-propagation algorithm.
18. Deep Belief Networks. Matlab code for learning Deep Belief Networks (from Ruslan Salakhutdinov).
19. RNNLM– Tomas Mikolov’s Recurrent Neural Network based Language models Toolkit.
20. RNNLIB-RNNLIB is a recurrent neural network library for sequence learning problems. Applicable to most types of spatiotemporal data, it has proven particularly effective for speech and handwriting recognition.
21. matrbm. Simplified version of Ruslan Salakhutdinov’s code, by Andrej Karpathy (Matlab).
22. deeplearning4j– Deeplearning4J is an Apache 2.0-licensed, open-source, distributed neural net library written in Java and Scala.
23. Estimating Partition Functions of RBM’s. Matlab code for estimating partition functions of Restricted Boltzmann Machines using Annealed Importance Sampling (from Ruslan Salakhutdinov).
24. Learning Deep Boltzmann Machines Matlab code for training and fine-tuning Deep Boltzmann Machines (from Ruslan Salakhutdinov).
25. The LUSH programming language and development environment, which is used @ NYU for deep convolutional networks
26. Eblearn.lsh is a LUSH-based machine learning library for doing Energy-Based Learning. It includes code for “Predictive Sparse Decomposition” and other sparse auto-encoder methods for unsupervised learning. Koray Kavukcuoglu provides Eblearn code for several deep learning papers on this page.
27. deepmat– Deepmat, Matlab based deep learning algorithms.
28. MShadow – MShadow is a lightweight CPU/GPU Matrix/Tensor Template Library in C++/CUDA. The goal of mshadow is to support efficient, device invariant and simple tensor library for machine learning project that aims for both simplicity and performance. Supports CPU/GPU/Multi-GPU and distributed system.
29. CXXNET – CXXNET is fast, concise, distributed deep learning framework based on MShadow. It is a lightweight and easy extensible C++/CUDA neural network toolkit with friendly Python/Matlab interface for training and prediction.
30. Nengo-Nengo is a graphical and noscripting based software package for simulating large-scale neural systems.
31. Eblearn is a C++ machine learning library with a BSD license for energy-based learning, convolutional networks, vision/recognition applications, etc. EBLearn is primarily maintained by Pierre Sermanet at NYU.
32. cudamat is a GPU-based matrix library for Python. Example code for training Neural Networks and Restricted Boltzmann Machines is included.
33. Gnumpy is a Python module that interfaces in a way almost identical to numpy, but does its computations on your computer’s GPU. It runs on top of cudamat.
34. The CUV Library (github link) is a C++ framework with python bindings for easy use of Nvidia CUDA functions on matrices. It contains an RBM implementation, as well as annealed importance sampling code and code to calculate the partition function exactly (from AIS lab at University of Bonn).
35. 3-way factored RBM and mcRBM is python code calling CUDAMat to train models of natural images (from Marc’Aurelio Ranzato).
36. Matlab code for training conditional RBMs/DBNs and factored conditional RBMs (from Graham Taylor).
37. mPoT is python code using CUDAMat and gnumpy to train models of natural images (from Marc’Aurelio Ranzato).
38. neuralnetworks is a java based gpu library for deep learning algorithms.
39. ConvNet is a matlab based convolutional neural network toolbox.
40. Elektronn is a deep learning toolkit that makes powerful neural networks accessible to scientists outside the machine learning community.
41. OpenNN is an open source class library written in C++ programming language which implements neural networks, a main area of deep learning research.
42. NeuralDesigner is an innovative deep learning tool for predictive analytics.
43. Theano Generalized Hebbian Learning.
44. Apache Singa is an open source deep learning library that provides a flexible architecture for scalable distributed training. It is extensible to run over a wide range of hardware, and has a focus on health-care applications.
45. Lightnet is a lightweight, versatile and purely Matlab-based deep learning framework. The aim of the design is to provide an easy-to-understand, easy-to-use and efficient computational platform for deep learning research.
👆🏿👆🏿👆🏿👆🏿👆🏿👆🏿👆🏿👆🏿👆🏿👆🏿
30. Nengo-Nengo is a graphical and noscripting based software package for simulating large-scale neural systems.
31. Eblearn is a C++ machine learning library with a BSD license for energy-based learning, convolutional networks, vision/recognition applications, etc. EBLearn is primarily maintained by Pierre Sermanet at NYU.
32. cudamat is a GPU-based matrix library for Python. Example code for training Neural Networks and Restricted Boltzmann Machines is included.
33. Gnumpy is a Python module that interfaces in a way almost identical to numpy, but does its computations on your computer’s GPU. It runs on top of cudamat.
34. The CUV Library (github link) is a C++ framework with python bindings for easy use of Nvidia CUDA functions on matrices. It contains an RBM implementation, as well as annealed importance sampling code and code to calculate the partition function exactly (from AIS lab at University of Bonn).
35. 3-way factored RBM and mcRBM is python code calling CUDAMat to train models of natural images (from Marc’Aurelio Ranzato).
36. Matlab code for training conditional RBMs/DBNs and factored conditional RBMs (from Graham Taylor).
37. mPoT is python code using CUDAMat and gnumpy to train models of natural images (from Marc’Aurelio Ranzato).
38. neuralnetworks is a java based gpu library for deep learning algorithms.
39. ConvNet is a matlab based convolutional neural network toolbox.
40. Elektronn is a deep learning toolkit that makes powerful neural networks accessible to scientists outside the machine learning community.
41. OpenNN is an open source class library written in C++ programming language which implements neural networks, a main area of deep learning research.
42. NeuralDesigner is an innovative deep learning tool for predictive analytics.
43. Theano Generalized Hebbian Learning.
44. Apache Singa is an open source deep learning library that provides a flexible architecture for scalable distributed training. It is extensible to run over a wide range of hardware, and has a focus on health-care applications.
45. Lightnet is a lightweight, versatile and purely Matlab-based deep learning framework. The aim of the design is to provide an easy-to-understand, easy-to-use and efficient computational platform for deep learning research.
👆🏿👆🏿👆🏿👆🏿👆🏿👆🏿👆🏿👆🏿👆🏿👆🏿
🔵یادگیری ژرف نیازمند داده های زیادی برای آموزش است. این یکی از دلایل اصلی موفقیت یادگیری ژرف است. زمانی که داده های موجود برای آموزش شبکه کم باشد الگوریتم به خوبی آموزش نمی بیند. بنابراین سه راه حل برای مواجه با تعداد داده های کم وجود دارد:
1- استفاده از روش های غیر ژرف
2- جمع آوری داده که برخی موارد شاید سخت یا غیر ممکن باشد
3- استفاده از روش هایی برای تولید داده با استفاده از داده های موجود
🌿🌿🌿🌿🌿🌿🌿🌿🌿🌿
در زیر تعداد مجموعه داده در کاربردهای مختلف که در مقالات با استفاده از یادگیری ژرف به جواب های خوبی رسیده اند خدمت شما معرفی می گردد. بهتر است در کارهای تحقیقاتی خود از این داده های استاندارد استفاده شود.
👎👎👎👎👎👎👎👎👎👎
1- استفاده از روش های غیر ژرف
2- جمع آوری داده که برخی موارد شاید سخت یا غیر ممکن باشد
3- استفاده از روش هایی برای تولید داده با استفاده از داده های موجود
🌿🌿🌿🌿🌿🌿🌿🌿🌿🌿
در زیر تعداد مجموعه داده در کاربردهای مختلف که در مقالات با استفاده از یادگیری ژرف به جواب های خوبی رسیده اند خدمت شما معرفی می گردد. بهتر است در کارهای تحقیقاتی خود از این داده های استاندارد استفاده شود.
👎👎👎👎👎👎👎👎👎👎
🔵Music Datasets
Piano-midi.de: classical piano pieces (http://www.piano-midi.de/)
Nottingham : over 1000 folk tunes (http://abc.sourceforge.net/NMD/)
MuseData: electronic library of classical music scores (http://musedata.stanford.edu/)
JSB Chorales: set of four-part harmonized chorales (http://www.jsbchorales.net/index.shtml)
FMA: A Dataset For Music Analysis (https://github.com/mdeff/fma)
👎👎👎👎👎👎👎👎👎👎👎
https://news.1rj.ru/str/MachineLearningDeep
Piano-midi.de: classical piano pieces (http://www.piano-midi.de/)
Nottingham : over 1000 folk tunes (http://abc.sourceforge.net/NMD/)
MuseData: electronic library of classical music scores (http://musedata.stanford.edu/)
JSB Chorales: set of four-part harmonized chorales (http://www.jsbchorales.net/index.shtml)
FMA: A Dataset For Music Analysis (https://github.com/mdeff/fma)
👎👎👎👎👎👎👎👎👎👎👎
https://news.1rj.ru/str/MachineLearningDeep
🔵Natural Images
MNIST: handwritten digits (http://yann.lecun.com/exdb/mnist/)
NIST: similar to MNIST, but larger
Perturbed NIST: a dataset developed in Yoshua’s class (NIST with tons of deformations)
CIFAR10 / CIFAR100: 32×32 natural image dataset with 10/100 categories ( http://www.cs.utoronto.ca/~kriz/cifar.html)
Caltech 101: pictures of objects belonging to 101 categories (http://www.vision.caltech.edu/Image_Datasets/Caltech101/)
Caltech 256: pictures of objects belonging to 256 categories (http://www.vision.caltech.edu/Image_Datasets/Caltech256/)
Caltech Silhouettes: 28×28 binary images contains silhouettes of the Caltech 101 dataset
STL-10 dataset is an image recognition dataset for developing unsupervised feature learning, deep learning, self-taught learning algorithms. It is inspired by the CIFAR-10 dataset but with some modifications. http://www.stanford.edu/~acoates//stl10/
The Street View House Numbers (SVHN) Dataset – http://ufldl.stanford.edu/housenumbers/
NORB: binocular images of toy figurines under various illumination and pose (http://www.cs.nyu.edu/~ylclab/data/norb-v1.0/)
Imagenet: image database organized according to the WordNethierarchy (http://www.image-net.org/)
Pascal VOC: various object recognition challenges (http://pascallin.ecs.soton.ac.uk/challenges/VOC/)
Labelme: A large dataset of annotated images, http://labelme.csail.mit.edu/Release3.0/browserTools/php/dataset.php
COIL 20: different objects imaged at every angle in a 360 rotation(http://www.cs.columbia.edu/CAVE/software/softlib/coil-20.php)
COIL100: different objects imaged at every angle in a 360 rotation (http://www1.cs.columbia.edu/CAVE/software/softlib/coil-100.php)
👎👎👎👎👎👎👎👎👎👎👎
https://news.1rj.ru/str/MachineLearningDeep
MNIST: handwritten digits (http://yann.lecun.com/exdb/mnist/)
NIST: similar to MNIST, but larger
Perturbed NIST: a dataset developed in Yoshua’s class (NIST with tons of deformations)
CIFAR10 / CIFAR100: 32×32 natural image dataset with 10/100 categories ( http://www.cs.utoronto.ca/~kriz/cifar.html)
Caltech 101: pictures of objects belonging to 101 categories (http://www.vision.caltech.edu/Image_Datasets/Caltech101/)
Caltech 256: pictures of objects belonging to 256 categories (http://www.vision.caltech.edu/Image_Datasets/Caltech256/)
Caltech Silhouettes: 28×28 binary images contains silhouettes of the Caltech 101 dataset
STL-10 dataset is an image recognition dataset for developing unsupervised feature learning, deep learning, self-taught learning algorithms. It is inspired by the CIFAR-10 dataset but with some modifications. http://www.stanford.edu/~acoates//stl10/
The Street View House Numbers (SVHN) Dataset – http://ufldl.stanford.edu/housenumbers/
NORB: binocular images of toy figurines under various illumination and pose (http://www.cs.nyu.edu/~ylclab/data/norb-v1.0/)
Imagenet: image database organized according to the WordNethierarchy (http://www.image-net.org/)
Pascal VOC: various object recognition challenges (http://pascallin.ecs.soton.ac.uk/challenges/VOC/)
Labelme: A large dataset of annotated images, http://labelme.csail.mit.edu/Release3.0/browserTools/php/dataset.php
COIL 20: different objects imaged at every angle in a 360 rotation(http://www.cs.columbia.edu/CAVE/software/softlib/coil-20.php)
COIL100: different objects imaged at every angle in a 360 rotation (http://www1.cs.columbia.edu/CAVE/software/softlib/coil-100.php)
👎👎👎👎👎👎👎👎👎👎👎
https://news.1rj.ru/str/MachineLearningDeep