Load Data Directly from Azure Data Lake into Azure SQL Data Warehouse Using Polybase

Re-posted from the Azure blog. NOTE: This post was updated on Tuesday February 14th 2017, including an update to the title. Azure SQL Data Warehouse (Azure SQL DW, or just SQL DW for short) is a SQL-based fully managed, petabyte-scale data warehousing solution in the cloud. It is highly elastic, enabling you to provision in minutes and scale… Read more

Overview Video of Azure Data Lake (Now Generally Available!)

One of the most exciting announcements we made at Connect(); in New York City yesterday is the general availability of Azure Data Lake (ADL), a key component of Cortana Intelligence, our fully managed suite of big data and advanced analytics services. ADL offers a hyper-scale data repository for storing data of any type, and is… Read more

The Next Generation Database & Data Lake from Microsoft

Re-posted from the SQL Server blog. Earlier today, at the Connect() event, which is livestreaming globally from New York City, we announced the next generation of Microsoft SQL Server and Azure Data Lake, as well as many other exciting new capabilities to help developers build intelligent applications. Here’s a quick recap of the key announcements:… Read more

Reddit ‘Ask Me Anything’ Session on Big Data & Analytics

We’re excited to host a special Reddit Ask Me Anything (AMA) session next week, focused on big data & analytics. Join us in an interactive conversation with Microsoft engineers who are pushing the state-of-the-art in this space. The session will take place on /r/Azure on Thursday next week, November 17th, between 10AM and 2PM Pacific… Read more

Applying Deep Learning at Cloud Scale, with Microsoft R Server & Azure Data Lake

This post is by Max Kaznady, Data Scientist, Miguel Fierro, Data Scientist, Richin Jain, Solution Architect, T. J. Hazen, Principal Data Scientist Manager, and Tao Wu, Principal Data Scientist Manager, all at Microsoft. Today’s businesses collect vast volumes of images, video, text and other types of data – data which can provide tremendous business value… Read more

Riding the Big Data Tiger

This post is authored by Omid Afnan, Principal Group Program Manager at Microsoft. Omid’s talk, “Go Big (with Data Lake Architecture) or Go Home!” will be featured at the Microsoft Machine Learning & Data Science Summit on September 26-27 in Atlanta. I’ve had the pleasure (and pains) of working in big data for years, first… Read more

5 Cloud AI Innovations at the Microsoft Machine Learning & Data Science Summit

This post is by Joseph Sirosh, Corporate Vice President of the Data Group at Microsoft. I’m excited to invite you to our first Microsoft Machine Learning & Data Science Summit, which kicks off next Monday, September 26th, in Atlanta. The Summit is a unique event for machine learning developers, data scientists and big data engineers,… Read more

Recent Updates to the Microsoft Data Science Virtual Machine

Posted by Gopi Kumar, Principal Program Manager in the Microsoft Data Group. It’s been over 9 months since we first released the Data Science Virtual Machine (DSVM), a custom virtual machine image we published in the Azure Marketplace with a host of popular data science tools pre-installed and pre-configured. We’ve made a few updates since… Read more

Predictive Analysis for Telecom – Integrating Azure Data Lake and Azure ML

This post is authored by Daisy Deng, Software Engineer at Microsoft. Big data is not just a buzz word; it’s a reality. As data volumes have exploded in recent past, so have solutions to store and process the data, along with the number of formats to describe the data. Data formats are not just limited… Read more

Free Webinar: Azure Data Lake – The Scalable & Secure Big Data Store

The Azure Data Lake Store is a hyper scale repository for enterprises to securely build cloud-based data lakes. In this session, we will show you how the HDFS compatibility of the Azure Data Lake Store seamlessly enables analytics workloads and provides great agility and security. From ingesting large volumes of data to storing them in… Read more