* You are viewing the archive for the ‘Software’ Category

Data management support

Extra support for data management has been added during the last weeks to EMOTIVE Cloud. It now supports FTP, SFTP, S3 and whatever storage system that Hadoop FileSystem supports.

Thanks to the new data management support, the system allows submitting a task to a VM with some data associated. In addition, the output files can be automatically stored in a remote storage when the VM is destroyed.

For example, we can create a VM and submit a task that requires some data and generate different files. We only have to provide the location of this data and it will be automatically available … Continue Reading

Creating an EMOTIVE Scheduler

One of the key issues of EMOTIVE Cloud

is the simplicity for developing and adding new Schedulers. This post will explain the key steps in order to create a Scheduler that will run on top of EMOTIVE.

The first step is implementing the VRMMScheduler interface which specifies:

List<String> getNodes();

List<String> getLocation(String id) throws VRMMSchedulerException;

void nodeUp(String nodeId);

void nodeDown(String nodeId);

Implementing this methods the RM will be able to notify if a node managed by your scheduler is up or not and allows monitoring different metrics of the nodes.

The simple scheduler code example can be found at the SVN.

RM interface

In order to take beneffit of the … Continue Reading

New Resource Monitor

VRMM born as a part of the BREIN european project. It was a good starting point for developing VtM and RM, nevertheless, this issue made the software highly tied to the BREIN architecture. For this reason, high efforts has been done in order to make it indendent.

A month ago, VtM was already independent and it could be used as a standalone software for creating and managing VMs. However, making RM a generic component is not a trivial task since it depends on the Scheduler and the Resource Manager. This has implied a big challenge in terms of software design, but … Continue Reading