Skip to content

A new FailoverProxyProvider named ConfiguredFailoverProxyProviderCached to cache active namenode, based on hadoop 2.7.3

Notifications You must be signed in to change notification settings

call-fold/hadoop-failover-client

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

3 Commits
 
 
 
 
 
 
 
 

Repository files navigation

Hadoop Failover Client


A new failover to cache active namenode index to avoid trying to connect to each namenode by hashcode

base

  • hadoop 2.7.3

requirement

setting in hdfs-site.xml

 <!-- namespace can be found in core-site.xml (fs.defaultFS) -->
<property>
  <name>dfs.client.failover.proxy.provider.[namespace]</name>
  <value>org.apache.hadoop.hdfs.server.namenode.ha.ConfiguredFailoverProxyProviderCached</value>
</property>

when you submit a mapreduce or spark application to yarn, if you set this in client, you should also upload the compiled jar to hdfs and add it to task classpath


About

A new FailoverProxyProvider named ConfiguredFailoverProxyProviderCached to cache active namenode, based on hadoop 2.7.3

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages