“Serving AI with Data” – Recap of the Microsoft AI Immersion Workshop

Artificial Intelligence is enjoying its day in the sun. AI-related articles are now routinely featured as front page news and the technology is being used in an ever growing variety of applications, including in conversational bots, autonomous vehicles, connected machines, in medical diagnosis and much more. AI is therefore of growing interest to millions of… Read more

Now Serving: More AI with Your Big Data

Re-posted from the Microsoft SQL Server blog. Earlier today, at Build 2017, we made a string of announcements to further help developers and customers around the planet create breakthrough experiences through the power of artificial intelligence and big data. There were 3 major themes to these announcements: 1. AI at the Heart of the Microsoft… Read more

Monitoring Petabyte-Scale AI Data Lakes in Azure

This post by Reed Umbrasas, Software Engineer at Microsoft. Azure Data Lake Analytics lets customers run massively parallel jobs over petabytes of raw data stored in Azure Data Lake Store. During the recent Microsoft Data Amp event, we demonstrated how this massive processing power can be used to build a petabyte scale AI data lake… Read more

Embarrassingly Parallel Image Classification, Using Cognitive Toolkit and TensorFlow on Azure HDInsight Spark

This post is by Mary Wahl, Data Scientist, T.J. Hazen, Principal Data Scientist Manager, Miruna Oprescu, Software Engineer, and Sudarshan Raghunathan, Principal Software Engineering Manager, at Microsoft. Summary Deep neural networks (DNNs) are extraordinarily versatile and increasingly popular machine learning models that require significantly more time and computational resources for execution than traditional approaches. By… Read more

Load Data Directly from Azure Data Lake into Azure SQL Data Warehouse Using Polybase

Re-posted from the Azure blog. NOTE: This post was updated on Tuesday February 14th 2017, including an update to the title. Azure SQL Data Warehouse (Azure SQL DW, or just SQL DW for short) is a SQL-based fully managed, petabyte-scale data warehousing solution in the cloud. It is highly elastic, enabling you to provision in minutes and scale… Read more

Overview Video of Azure Data Lake (Now Generally Available!)

One of the most exciting announcements we made at Connect(); in New York City yesterday is the general availability of Azure Data Lake (ADL), a key component of Cortana Intelligence, our fully managed suite of big data and advanced analytics services. ADL offers a hyper-scale data repository for storing data of any type, and is… Read more

The Next Generation Database & Data Lake from Microsoft

Re-posted from the SQL Server blog. Earlier today, at the Connect() event, which is livestreaming globally from New York City, we announced the next generation of Microsoft SQL Server and Azure Data Lake, as well as many other exciting new capabilities to help developers build intelligent applications. Here’s a quick recap of the key announcements:… Read more

Reddit ‘Ask Me Anything’ Session on Big Data & Analytics

We’re excited to host a special Reddit Ask Me Anything (AMA) session next week, focused on big data & analytics. Join us in an interactive conversation with Microsoft engineers who are pushing the state-of-the-art in this space. The session will take place on /r/Azure on Thursday next week, November 17th, between 10AM and 2PM Pacific… Read more

Applying Deep Learning at Cloud Scale, with Microsoft R Server & Azure Data Lake

This post is by Max Kaznady, Data Scientist, Miguel Fierro, Data Scientist, Richin Jain, Solution Architect, T. J. Hazen, Principal Data Scientist Manager, and Tao Wu, Principal Data Scientist Manager, all at Microsoft. Today’s businesses collect vast volumes of images, video, text and other types of data – data which can provide tremendous business value… Read more

Riding the Big Data Tiger

This post is authored by Omid Afnan, Principal Group Program Manager at Microsoft. Omid’s talk, “Go Big (with Data Lake Architecture) or Go Home!” will be featured at the Microsoft Machine Learning & Data Science Summit on September 26-27 in Atlanta. I’ve had the pleasure (and pains) of working in big data for years, first… Read more