Skip to content

Modifying Hadoop to propagate more information about slaves to the master node through the heartbeat.

License

Notifications You must be signed in to change notification settings

ganjianwei/hadoop_ekg

Repository files navigation

Hadoop EKG is a modified version of Hadoop where we're attempting to
take advantage of heartbeats (sent from the TaskTracker to JobTracker)
to propagate more information about the TaskTracker, e.g. CPU usage,
memory usage etc., so that the JobTracker can make decisions on 
scheduling based on the real-time data it receives.

A good use case is that the JobTracker can label tasks as CPU intensive
if it sees that the (map/reduce) task results in high CPU usage on the
TaskTracker.


----------------------------------------------------------------------



For the latest information about Hadoop, please visit our website at:

   http://hadoop.apache.org/core/

and our wiki, at:

   http://wiki.apache.org/hadoop/

This distribution includes cryptographic software.  The country in 
which you currently reside may have restrictions on the import, 
possession, use, and/or re-export to another country, of 
encryption software.  BEFORE using any encryption software, please 
check your country's laws, regulations and policies concerning the
import, possession, or use, and re-export of encryption software, to 
see if this is permitted.  See <http://www.wassenaar.org/> for more
information.

The U.S. Government Department of Commerce, Bureau of Industry and
Security (BIS), has classified this software as Export Commodity 
Control Number (ECCN) 5D002.C.1, which includes information security
software using or performing cryptographic functions with asymmetric
algorithms.  The form and manner of this Apache Software Foundation
distribution makes it eligible for export under the License Exception
ENC Technology Software Unrestricted (TSU) exception (see the BIS 
Export Administration Regulations, Section 740.13) for both object 
code and source code.

The following provides more details on the included cryptographic
software:
  Hadoop Core uses the SSL libraries from the Jetty project written 
by mortbay.org.

About

Modifying Hadoop to propagate more information about slaves to the master node through the heartbeat.

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published