New AWS Deep Learning AMIs for Machine Learning Practitioners
We’re excited to announce the availability of two new versions of the AWS Deep Learning AMI. The first is a Conda-based AMI with separate Python environments for deep learning frameworks created using Conda—a popular open source package and environment management tool. The second is a Base AMI with GPU drivers and libraries to deploy your own customized deep learning models.
Deep learning technology is evolving at a rapid pace—everything from frameworks and algorithms to new methods and theories from academia and industry. All of this causes complexity for developers who need tools for quickly and securely testing algorithms, optimizing for specific versions of frameworks, running tests and benchmarks, or collaborating on projects starting with a blank canvas. Virtual environments provide the freedom and flexibility to do all this, which is why we’re adding it to the AWS Deep Learning AMIs today. We’ve also set up new
New Conda-based Deep Learning AMI
The Conda-based AMI comes pre-installed with Python environments for deep learning created using Conda. Each Conda-based Python environment is configured to include the official pip package of a popular deep learning framework, and its dependencies. Think of it as a fully baked virtual environment ready to run your deep learning code, for example, to train a neural network model. Our
But the benefits of the AMI don’t stop there. The environments on the AMI operate as mutually-isolated, self-contained sandboxes. This means when you run your deep learning code inside the sandbox, you get full visibility and control of its run-time environment. You can install a new software package, upgrade an existing package or change an environment variable—all without worrying about interrupting other deep learning environments on the AMI. This level of flexibility and fine-grained control over your execution environment also means you can now run tests, and benchmark the performance of your deep learning models in a manner that is consistent and reproducible over time.
Finally, the AMI provides a visual interface that plugs straight into your Jupyter notebooks so you can switch in and out of environments, launch a notebook in an environment of your choice, and even reconfigure your environment—all with a single click, right from your Jupyter notebook browser. Our step-by-step guide walks you through these integrations and other Jupyter notebooks and tutorials.
The new Conda-based Deep Learning AMI comes packaged with the latest official releases of the following deep learning frameworks:
- Apache MXNet 0.12 with Gluon
- TensorFlow 1.4
- Caffe2 0.8.1
- PyTorch 0.2
- CNTK 2.2
- Theano 0.9
- Keras 1.2.2 and Keras 2.0.9
This AMI also includes the following libraries and drivers for GPU acceleration on the cloud:
- CUDA 8 and 9
- cuDNN 6 and 7
- NCCL 2.0.5 libraries
- NVidia Driver 384.81
New Deep Learning Base AMI
The Base AMI comes pre-installed with the foundational building blocks for deep learning. This includes NVIDIA CUDA libraries, GPU drivers, and system libraries to speed up and scale machine learning on Amazon Elastic Compute Cloud (EC2) instances. Think of the Base AMI as a clean slate to deploy your customized deep learning set up.
For example, for developers contributing to open source deep learning framework enhancements or even building a new deep learning engine, the Base AMI provides the foundation to install your own custom configurations and code repositories to test out new framework features. The Base AMI comes with the CUDA 9 environment installed by default, however you can also switch to a CUDA 8 environment using simple one-line commands given in our step-by-step user guide.
The Base AMI provides the following GPU drivers and libraries:
- CUDA 8 and 9
- CuBLAS 8 and 9
- CuDNN 6 and 7
- glibc 2.18
- OpenCV 3.2.0
- NVIDIA driver 384.81
- NCCL 2.0.5
- Python 2 and 3
Deep Learning AMIs with source code
In addition to the two new AMIs available today, we continue to support the AMIs that install all the popular deep learning frameworks from source in a unified Python environment, and include their source code on the AMI. This AMI is great if you want to try out and compare multiple frameworks in a shared base environment or you need quick access to source code on the AMI itself to recompile a framework with your custom set of build options.
The AMI comes in CUDA 8 and CUDA 9 versions to meet your specific needs of the AWS EC2 instance you want to use for deep learning.
Deep Learning AMIs cheat sheet
We now have three types of AWS Deep Learning AMIs available in the AWS Marketplace to support the various needs of machine learning practitioners. Don’t forget to check out our AMI selection guide, simple tutorials, and more deep learning resources in our developer guide!
| Base AMI | AMIs with source code | |
| For developers who want pre-installed pip packages of deep learning frameworks in separate virtual environments | For developers who want a clean slate to set up private deep learning engine repositories or custom builds of deep learning engines | For developers who want pre-installed deep learning frameworks and their source code in a shared python environment |
About the Author
Cynthya Peranandam is a Principal Marketing Manager f
or AWS artificial intelligence solutions, helping customers use deep learning to provide business value. In her spare time she likes to run and listen to music.
相關推薦
New AWS Deep Learning AMIs for Machine Learning Practitioners
We’re excited to announce the availability of two new versions of the AWS Deep Learning AMI. The first is a Conda-based AMI with separate Python e
NXP's New Development Platform for Machine Learning in the IoT
NXP Semiconductors has launched a new machine learning toolkit. Called "eIQ", it's a software development platform that supports popular neural network fra
斯坦福大學公開課機器學習：machine learning system design | data for machine learning（數據量很大時，學習算法表現比較好的原理）
ali 很多 好的 info 可能 斯坦福大學公開課 數據 div http 下圖為四種不同算法應用在不同大小數據量時的表現，可以看出，隨著數據量的增大，算法的表現趨於接近。即不管多麽糟糕的算法，數據量非常大的時候，算法表現也可以很好。 數據量很大時，學習算法表現比
Statistical Methods for Machine Learning
AS n-2 cal 元素 n) pan size AC 情況 機器學習中的統計學方法。 統計學是機器學習的一個支柱。 原始觀察僅僅是數據, 但它們不是信息或知識。數據引發問題, 例如: 什麽是最常見的或預期的觀察？ 觀察的限制是什麽？ 數據是什麽樣子的？
U25%(1,16) and U25%(1,168)on《C4.5:programs for machine learning》
when calculating U C
《C4.5: Programs for Machine Learning》chaper4實驗結果重現
使用自帶的ｖｏｔｅ資料集： 實驗結果如下： 剪枝前： physician fee freeze = n: | adoption of the budget resolution = y: democrat (151.0) | adoption of the budget resolution
the resource for machine learning
Questions and Answers What's matrix dot product in Deep Learning? Deep Neural Network with Matrices https://matrices.io/deep-neural-network-from-scrat
[Infographic] The Best Tools for Machine Learning Gengo AI
Machine learning projects can range from small datasets and standard algorithms, to much larger projects that use neural networks engines with massive data
The 50 Best Public Datasets for Machine Learning
The 50 Best Public Datasets for Machine LearningWhat are some open datasets for machine learning? After scrapping the web for hours after hours, we have cr
Facebook's PyTorch plans to light the way to speedy workflows for Machine Learning • DEVCLASS
Facebook's development department has finished a first release candidate for v1 of its PyTorch project – just in time for the first conference dedicated to
Essential libraries for Machine Learning in Python
Python is often the language of choice for developers who need to apply statistical techniques or data analysis in their work. It is also used by data scie
Top 10 Open Image Datasets for Machine Learning Research
This article would succinctly describe the best ten image datasets used for certain fundamental computer vision problems such as classification, detecti
Why Data Normalization is necessary for Machine Learning models
Why Data Normalization is necessary for Machine Learning modelsNormalization is a technique often applied as part of data preparation for machine learning.
NXP Owns the Stage for Machine Learning in Edge Devices
SAN JOSE, Calif. and BARCELONA, Spain, Oct. 16, 2018 (GLOBE NEWSWIRE) -- (ARMTECHCON and IoT World Congress Barcelona) - Mathematical advances that are dri
Free Online Course: Neural Networks for Machine Learning from Coursera Class Central
I honestly can't understand the multiple 5 star reviews presented on this site about the course. I'm giving it a 1 star which is a bit harsh I know but I'm
Marginally Interesting: Slides for Machine Learning on Streams
Tweet Yesterday I gave a talk at the Big Data Beers meetup in Berlin on
Using Amazon’s Mechanical Turk for Machine Learning Data
How to build a model from Mechanical Turk resultsAmazon Mechanical Turk will notify you when your results are ready and you will finally have a labelled da
Abdul Latif Jameel Clinic for Machine Learning in Health at MIT aims to revolutionize disease prevention, detection, and treatme
Today, MIT and Community Jameel, the social enterprise organization founded and chaired by Mohammed Abdul Latif Jameel ’78, launched the Abdul Latif Jameel
Assessing Annotator Disagreements in Python to Build a Robust Dataset for Machine Learning
Assessing Annotator Disagreements in Python to Build a Robust Dataset for Machine LearningTea vs. Coffee: the perfect example of decisions and disagreement
Setting Up Python for Machine Learning on Windows
Python has been largely used for numerical and scientific applications in the last years. However, to perform numerical computations in an efficient man