Cloud Zone is brought to you in partnership with:

Krystian Lider is co-owner of the SolDevelo - software development company with strong focus on software quality. Krystian has posted 4 posts at DZone. View Full User Profile

How to Use Free and Almost Unlimited Cloud-Computing Resources From Google?

05.19.2010
| 9331 views |
  • submit to reddit

Distributed computing is a very beneficial way for computing certain kinds of distributable problems using a large number of computers (nodes). But what if you do not have enough computers? The answer is to use Google App Engine.

Google App Engine is a simple framework which allows you to write and deploy web apps on Google’s servers. Although you cannot run full MapReduce application on GAE you can use it to compute tasks.

The Dynamic Agent Computations (DAC) framework now allows you to use Google App Engine's computing power to speed up your computations. Normally, DAC framework distributes tasks to all Worker processes connected to it. Obviously this approach requires new computers to run. Alternatively you can use 'virtual' computers provided to you in GAE's environment.

Here is a little comparison of results gathered using single computer with two core 2.0 GHz processor and in combination with Goggle App Engine.

GAE chart

As you can see on the chart a single GAE thread is much slower than single local thread. However here comes the numbers. You can easily have 6 GAE's threads even on a free Google App Engine account. This amount allows you to double the number of tasks computed per minute. And this means everything will finish two times faster. Of course starting more threads or having more GAE's accounts will just boost the gain.

Still there are some restrictions from Google App Engine like 30 seconds response limit which means that the tasks can't be to long. Also free accounts have many quota limits, especially 6.50 CPU hours might be crucial.

You can find an example of usage in the google_app_engine sample of the newest DAC distribution available on our website

Published at DZone with permission of its author, Krystian Lider.

(Note: Opinions expressed in this article and its replies are the opinions of their respective authors and not those of DZone, Inc.)

Comments

Vinay Soni replied on Wed, 2010/05/19 - 10:21am

"Google App Engine is a simple framework which allows you to write and deploy web apps on Google’s servers"

 

Question: What DBMSs does GAE support? Or is it something propritery?

 

Thnks,

 

Vinay

Krystian Lider replied on Thu, 2010/05/20 - 8:53am

You can use App Engine Datastore (which uses Google's BigTable database system).

www labs.google.com/papers/bigtable.html

 

There will be hosted SQL databases feature available later this year.

Here you can find more information about Google App Engine: www code.google.com/appengine

 

Hatma Suryotrisongko replied on Tue, 2011/05/17 - 7:52pm

I am a newbie..

I do not understand how to run the 'google app engine' dacframe sample not on my local machine, but on GAE server such as xxxx.appspot.com.

could you please explain it ?

 

Sirikant Noori replied on Fri, 2012/03/30 - 12:55pm

 

 

Nodes or computers could be used for distributable problems etc. In other case, Google app Engine is more preferable which let you to deploy certain apps at the servers of Google.To make your computations speedy , use it.

 

Many thanks

Java Exam

Comment viewing options

Select your preferred way to display the comments and click "Save settings" to activate your changes.