Kubernetes Load Testing

This post is authored by Daniel Grecoe, Senior Software Engineer at Microsoft. Today many platforms are moving towards hosting artificial intelligence models in self-managed container services such as Kubernetes. At Microsoft this is a substantial change from Azure Machine Learning Studio which provided all the model management and operationalization services for the user automatically. To… Read more

Deploying Deep Learning Models on Kubernetes with GPUs

This post is authored by Mathew Salvaris and Fidan Boylu Uz, Senior Data Scientists at Microsoft. One of the major challenges that data scientists often face is closing the gap between training a deep learning model and deploying it at production scale. Training of these models is a resource intensive task that requires a lot… Read more

Scaling Azure Container Service Clusters

This post is authored by Daniel Grecoe, Senior Software Engineer at Microsoft. Replica sets and pods and nodes…oh my! Microsoft has created very powerful and customizable tools for the professional data scientist with the Azure Machine Learning Workbench. The tool is used to create container images for Machine Learning or Artificial Intelligence models and exposing… Read more

Free: Microsoft AI Bootcamp Materials for Emerging & Pro Developers

This post is authored by Chris Testa-O’Neill, Applied Data Scientist in the Microsoft Cloud AI team. Artificial Intelligence (AI) is proving to be a massively disruptive force, one that is leading to the digital transformation of businesses at a faster pace than most of us would have imagined. At Microsoft, our mission is to bring… Read more

How to Train & Serve Deep Learning Models at Scale, Using Cognitive Toolkit with Kubernetes on Azure

This post is authored by Wee Hyong Tok, Principal Data Science Manager at Microsoft. Deep Learning has fueled the emergence of many practical applications and experiences. It has played a central role in making many recent breakthroughs possible, ranging from speech recognition that’s reached human parity in word recognition during conversations, to neural networks that… Read more

Deployment of Pre-Trained Models on Azure Container Services

This post is authored by Mathew Salvaris, Ilia Karmanov and Jaya Mathew. Data scientists and engineers routinely encounter issues when moving their final functional software and code from their development environment (laptop, desktop) to a test environment, or from a staging environment to production. These difficulties primarily stem from differences between the underlying software environments… Read more