Share this article
Latest news
With KB5043178 to Release Preview Channel, Microsoft advises Windows 11 users to plug in when the battery is low
Copilot in Outlook will generate personalized themes for you to customize the app
Microsoft will raise the price of its 365 Suite to include AI capabilities
Death Stranding Director’s Cut is now Xbox X|S at a huge discount
Outlook will let users create custom account icons so they can tell their accounts apart easier
Microsoft Research uses Azure Log Analytics to manage deep neural networks
2 min. read
Published onSeptember 21, 2016
published onSeptember 21, 2016
Share this article
Read our disclosure page to find out how can you help Windows Report sustain the editorial teamRead more
Microsoft’s Research division typically aims to solve far-off problems that include smart roads that help guide driverless cars,cures for cancer using machine learning, or improving DNA data storage, to list a few. At the center of Microsoft’s Research work sitsMachine Learning and Deep Neural Networks (DNN)that help generate next generation server infrastructures that support Windows and Linux cluster environments for large scale data processing of test results and sensory content.
Microsoft service engineer Kris Zenter explains in more detail how the research team makes use of Azure Log Analytics, Linux Server System Resource monitoring, and custom Python applications in attempting to solve and tackle cutting-edge problems.
Enter Azure Log Analytics
Azure Log Analytics, a component of Microsoft Operations Management Suite, natively supports log search through billions of records, real-time metric collection, and rich custom visualizations across numerous sources. These out of the box features paired with the flexibility of available data sources made Log Analytics a great option to produce visibility & insights by correlating across DNN clusters & components.
Linux Server System Resource Monitoring
Deep Neural Networks traditionally run on Linux, and Log Analytics supports major Linux distributions as first class citizens. The OMS Agent for Linux was also recently made generally available, built on the open source log collector FluentD. By leveraging the Linux agent, we were able to easily collect system metrics at 10-second interval and all of our Linux logs without any customization effort.
NVIDIA GPU Information
The Log Analytics platform is also extremely flexible, allowing users to send data via a recently released HTTP POST API. We were able to write a custom Python application to retrieve data from their NVIDIA GPUs and unlock the ability to alert based off of metrics such as GPU Temperature. Additionally, these metrics can be visualized with Custom Views to create rich performance graphs for the team to further monitor.
For more on Azure Log Analytics, the projects Microsoft’s Research division are currently tackling, or on the application of machine learning in science, visit Microsoft’s Azure bloghere. Anyone attempting to take advantage of Azure Log Analytics can also get a walkthrough with Python codes atthe MSOMS blog.
Kareem Anderson
Networking & Security Specialist
Kareem is a journalist from the bay area, now living in Florida. His passion for technology and content creation drives are unmatched, driving him to create well-researched articles and incredible YouTube videos.
He is always on the lookout for everything new about Microsoft, focusing on making easy-to-understand content and breaking down complex topics related to networking, Azure, cloud computing, and security.
User forum
0 messages
Sort by:LatestOldestMost Votes
Comment*
Name*
Email*
Commenting as.Not you?
Save information for future comments
Comment
Δ
Kareem Anderson
Networking & Security Specialist
He is a journalist from the bay area, now living in Florida. He breaks down complex topics related to networking, Azure, cloud computing, and security
