Jay Clemens
Microsoft has developed a big data framework that the company wants to open source within a month with the goal of helping to run machine learning tasks, GigaOM reported Monday.
Derrick Harris writes the company designed the Retainable Evaluator Execution Framework to complement Yet Another Resource Negotiator, an Apache Hadoop resource manager.
Raghu Ramakrishnan, Microsoft technical fellow and CTO of information services, told a conference in Chicago REEF is intended to meet requirements for data migration, work monitoring and iteration on previous results, according to the report
YARN also works to help organizations operate various tasks on the same set of machines, integrate systems and analyze data using a unified platform, GigaOM reports.
Ramakrishnan told the conference the big data framework consists of two parts, namely the Evaluators containing REEF services and Activities acting as the user code inside Evaluators, according to the report.
