yarn


IllegalAccessError for RequestHedgingRMFailoverProxyProvider while launching Apache Twill Application in hadoop cluster after HDP upgrade


I'm trying to launch Apache Twill application from hadoop cluster, the cluster is recently upgraded from HDP 2.2 to HDP 2.5 but I'm getting llegalAccessError for RequestHedgingRMFailoverProxyProvider class . This class is part of org.apache.hadoop.yarn.client package. I'm getting this error in the Application Master. The job status goes directy to 'not running state' right after 'accepted state'.
Exception in thread "Hadoop22YarnAMClient STARTING" Exception in thread "YarnAMClientService STARTING" java.lang.IllegalAccessError: tried to access method org.apache.hadoop.yarn.client.ConfiguredRMFailoverProxyProvider.getProxyInternal()Ljava/lang/Object; from class org.apache.hadoop.yarn.client.RequestHedgingRMFailoverProxyProvider
at org.apache.hadoop.yarn.client.RequestHedgingRMFailoverProxyProvider.init(RequestHedgingRMFailoverProxyProvider.java:75)
at org.apache.hadoop.yarn.client.RMProxy.createRMFailoverProxyProvider(RMProxy.java:163)
at org.apache.hadoop.yarn.client.RMProxy.createRMProxy(RMProxy.java:93)
at org.apache.hadoop.yarn.client.ClientRMProxy.createRMProxy(ClientRMProxy.java:72)
at org.apache.hadoop.yarn.client.api.impl.AMRMClientImpl.serviceStart(AMRMClientImpl.java:186)
at org.apache.hadoop.service.AbstractService.start(AbstractService.java:193)
at org.apache.twill.internal.yarn.Hadoop21YarnAMClient.startUp(Hadoop21YarnAMClient.java:77)
at com.google.common.util.concurrent.AbstractIdleService$1$1.run(AbstractIdleService.java:43)
at java.lang.Thread.run(Thread.java:745)
com.google.common.util.concurrent.ExecutionError: java.lang.IllegalAccessError: tried to access method org.apache.hadoop.yarn.client.ConfiguredRMFailoverProxyProvider.getProxyInternal()Ljava/lang/Object; from class org.apache.hadoop.yarn.client.RequestHedgingRMFailoverProxyProvider
at com.google.common.util.concurrent.Futures.wrapAndThrowUnchecked(Futures.java:1008)
at com.google.common.util.concurrent.Futures.getUnchecked(Futures.java:1001)
at com.google.common.util.concurrent.AbstractService.startAndWait(AbstractService.java:220)
at com.google.common.util.concurrent.AbstractIdleService.startAndWait(AbstractIdleService.java:106)
at org.apache.twill.internal.appmaster.ApplicationMasterMain$YarnAMClientService.startUp(ApplicationMasterMain.java:221)
at com.google.common.util.concurrent.AbstractIdleService$1$1.run(AbstractIdleService.java:43)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.IllegalAccessError: tried to access method org.apache.hadoop.yarn.client.ConfiguredRMFailoverProxyProvider.getProxyInternal()Ljava/lang/Object; from class org.apache.hadoop.yarn.client.RequestHedgingRMFailoverProxyProvider
at org.apache.hadoop.yarn.client.RequestHedgingRMFailoverProxyProvider.init(RequestHedgingRMFailoverProxyProvider.java:75)
at org.apache.hadoop.yarn.client.RMProxy.createRMFailoverProxyProvider(RMProxy.java:163)
at org.apache.hadoop.yarn.client.RMProxy.createRMProxy(RMProxy.java:93)
at org.apache.hadoop.yarn.client.ClientRMProxy.createRMProxy(ClientRMProxy.java:72)
at org.apache.hadoop.yarn.client.api.impl.AMRMClientImpl.serviceStart(AMRMClientImpl.java:186)
at org.apache.hadoop.service.AbstractService.start(AbstractService.java:193)
at org.apache.twill.internal.yarn.Hadoop21YarnAMClient.startUp(Hadoop21YarnAMClient.java:77)
... 2 more
In general when you see IllegalAccessError this means you have a runtime incompatibility between compiled and runtime code. In this case,
the getProxyInternal() method of ConfiguredRMFailoverProxyProvider is now private. You need to recompile your client code and/or use updated hadoop client libraries to connect to your cluster.

Related Links

Angular4 project and Yarn
Trying to run Apache Apex's Yahoo Finance example on YARN
Oozie whitelisted resource managers causing whitelist error
How set spring-data-flow file-source-kafka message only push content message
Hard Limits and Soft limits in Linux
Previously installed jhipster 3.12 found after yarn installed 4.0.6
Difference between Workload management and Resource Management in YARN
Scheduling reduce task in yarn?
Application generated with JHipster 4 returning blank page on 8080, but not on 9000
ngrx example app yarn connect ECONNREFUSED 10.4.5.47:443
Sqoop2 - Binding to YARN queues And performance tuning
How to configure two or more labels for a queue in yarn?
ClassNotFoundException with Scalding on Zeppelin managed on YARN
Hadoop Memory Total and VMWare
Creating a dynamic resource pool for yarn through Cloudera Manager REST api
Configure Host and Port ID for a worker in yarn cluster

Categories

HOME
yii2
gitlab
coq
gerrit
reflection
fluentd
malloc
ezpublish
convolution
upload
paradox
append
esper
maude-system
n-gram
moonmail
remote-access
phaser
quartz-scheduler
caml
progressive-web-apps
graphlab
beyondcompare
google-cloud-speech
extjs5
poltergeist
filezilla
elasticsearch-net
nameservers
bosh
.net-4.0
create-table
typed.js
perlin-noise
uiswipegesturerecognizer
html5-fullscreen
overriding
http-digest
hot-module-replacement
event-driven
ssjs
android-fingerprint-api
temporary-files
broadcastreceiver
galen
core-plot
http-live-streaming
keydown
mime
upstart
jedis
blogengine.net
r-forge
imanage
sonarlint-vs
chord-diagram
intrusion-detection
asp.net-4.5
py2app
ctest
xml-attribute
impresspages
testng-dataprovider
ios4
cannon.js
citrus-pay
notify
clicktag
ng-animate
coldbox
gui-test-framework
preferences
openexr
picturefill
datagridviewcolumn
centos5
fmod
html5-notifications
flexmojos
gnu-smalltalk
dbconnection
buster.js
html4
hungarian-algorithm
ember-app-kit
jquery-ui-layout
pendrive
xtype
yslow
.nettiers
gamma
fixed-width
zend-tool
libs
adrotator
zend-decorators
3gp
misv

Resources

Encrypt Message



code
soft
python
ios
c
html
jquery
cloud
mobile