Microsoft R on Apache Spark coming to Hadoop Summit

2 min. read

Published onJune 28, 2016

published onJune 28, 2016

Share this article

Read our disclosure page to find out how can you help Windows Report sustain the editorial teamRead more

Microsoft has just publisheda new poston the company’s TechNet blog to announce support for open source cluster computing framework Apache Spark in Microsoft R Server for Hadoop, as part of the company’s participation in theHadoop Summit.

Specifically, users can now run R functions over Spark nodes to train models on data “1000 times larger than before”, at 125 times the speed of running open source R with CRAN algorithms, due to R Server and Spark’s combined power of parallelized algorithms and Spark’s in-memory architecture. Additionally, Microsoft R Client has also been announced, providing a free R client for data scientists to use R functions to analyze data, both on local workstations and throughout Microsoft R Server. The news follow Microsoft’sstatement of “extensive commitment” to Apache Spark, as well as the company’s renewed vigor in open-source.

Microsoft also announces major architecture overhauls to DeployR – part of Microsoft R Server that provides analytics as web services – with improvements including more choices of supported repository databases, more Web and installation security features, and improved Security Policy Management. Previously, Microsoft alsoannounced R Server for HDInsight, bringing the ability to do predictive modeling and machine learning on Spark to Azure. For more information, head to Microsoft’s booth at Hadoop Summit in San Jose today, and tune in to the keynote by Joseph Sirosh, corporate vice president at Microsoft.

Radu Tyrsina

Radu Tyrsina has been a Windows fan ever since he got his first PC, a Pentium III (a monster at that time).

For most of the kids of his age, the Internet was an amazing way to play and communicate with others, but he was deeply impressed by the flow of information and how easily you can find anything on the web.

Prior to founding Windows Report, this particular curiosity about digital content enabled him to grow a number of sites that helped hundreds of millions reach faster the answer they’re looking for.

User forum

0 messages

Sort by:LatestOldestMost Votes

Comment*

Name*

Email*

Commenting as.Not you?

Save information for future comments

Comment

Radu Tyrsina

With KB5043178 to Release Preview Channel, Microsoft advises Windows 11 users to plug in when the battery is low#

Copilot in Outlook will generate personalized themes for you to customize the app#

Microsoft will raise the price of its 365 Suite to include AI capabilities#

Death Stranding Director’s Cut is now Xbox X|S at a huge discount#

Outlook will let users create custom account icons so they can tell their accounts apart easier#

Microsoft R on Apache Spark coming to Hadoop Summit#

With KB5043178 to Release Preview Channel, Microsoft advises Windows 11 users to plug in when the battery is low

Copilot in Outlook will generate personalized themes for you to customize the app

Microsoft will raise the price of its 365 Suite to include AI capabilities

Death Stranding Director’s Cut is now Xbox X|S at a huge discount

Outlook will let users create custom account icons so they can tell their accounts apart easier

Microsoft R on Apache Spark coming to Hadoop Summit