Enterprise Integration Zone is brought to you in partnership with:

Rauf has posted 29 posts at DZone. You can read more from them at their website. View Full User Profile

SOAfaces Powers up Hadoop

12.10.2011
| 1926 views |
  • submit to reddit
soafaces has always been a very flexible open source toolkit for building GWT clients and server components. Now with the release of v2.6.0, soafaces enables easier integration and management with third party systems like Hadoop by adding key features needed to manage remotely running processes.

Running and tracking Hadoop jobs takes a little extra effort in order to seamlessly integrate with a remote Hadoop environment. With release 2.6.0, it is now easier to compose, launch, and track Hadoop jobs remotely. This brings the full power of JobServer and soafaces to hadoop users. Hadoop users now can schedule their jobs and track them all the way through execution using a set of web based interfaces that provide role/user management, security and audit trail reporting among many other features.

One very nice feature with using soafaces and JobServer, is that you can chain multiple Hadoop jobs together and send the results of one Hadoop job into the input of another Hadoop job. You can transfer files and content in out and out of HDFS and orchestrate and chain of Hadoop jobs to complete a Hadoop workflow.

Release 2.6.0 includes some key new features like application and runtime scope cookies that let a Tasklet manage state between job runs enabling better coordination with third party systems like Hadoop.

This release also includes two built in soafaces components that let you report on your Hadoop environment and launch and track any Hadoop job. These components are bundled with the other BeanSoup components that come as part of the sample components with soafaces.

With these components, you can build and customize your own GWT GUI interfaces for each Hadoop job you have. soafaces provides a standard component/Tasklet you can you use out of the box to run your custom Hadoop jobs. And you can tailor the code with your own custom logic to provide specialized GWT reporting for each unique Hadoop job, for example.

Use these links to try soafaces, download JobServer and start managing your Big Data from the comfort of your JobServer Workbench.
Published at DZone with permission of its author, Rauf Issa.

(Note: Opinions expressed in this article and its replies are the opinions of their respective authors and not those of DZone, Inc.)