Getting a message Agent Version outdated
Hi team,
After deploying the new client version 5.6.0.5802, we weren't able to configure our agent properly. We could see the connection status as"The agent is connected, but instrumentation is not available" after the server restart.
We deployed an agent version of dynatrace-agent-5.6.0.5802-unix.jar But the agent Version shown in Agent Details was
"5.6.0.5713: The Agent version is outdated. Restart your application in order to get the most recent version injected."
Instrumentation disabled since the agent was not mapped into an agent group.
We restarted the server couple of times. Still we could see the same message.
OS : RHEL Linux 2.6.18-348.4.1.el5 64-bit
Agent Version Deployed : 5.6.0.5802
Initially we had 5.6.0.5713 we uninstalled by removing the directory.
Dynatrace Client Version : 5.6.5802
We aren't sure from where it picks the agent version 5.6.0.5713. dt_savasudevan_Jboss_Invoiceserv_5877.log
Have attached the log file for reference.Could you please review.
Thanks
Sattish.
Hi Rob & Richard,
Thanks for your inputs. Removing the agent hostname in agent mapping field helped us in successful deployment.We were able to connect to agent without instrumentation errors. Thanks once again.
Sattish.
The good news is that you have connected to the dT server, and it seems that the version is correct.
The message indicates that even though the agent connected, it was not mapped to any agent group. Looking at your mapping, the agent name part looks good. Is there a reason why you have a pattern in the "Agent Host" field? This is not common, to limit an agent mapping only when it comes from a particular server. If you must have that agent host, please look to make sure that that string really does "starts with" the name that you have there.
Yeah, looks like you have the fully qualified domain name there, whereas the agent log is reporting just the host. I would just clear that completely
Hi Rob,
Eventhough we upgraded all our components to the latest version we arent able to configure our Java agent.
We were able to connect to dynatrace server but not able to configure the unix agent deployed.
Dynatrace Server Version : 5.6.0.5802
Dynatrace Client Version: 5.6.0.5802
Dynatrace Linux Agent Version: 5.6.0.5802
Connection Status: The Agent is connected, but Instrumentation is not available.
Instrumentation State : Instrumentation disabled since the agent was not mapped into an agent group
We didnt get the bootstrap log .
Have listed the agent log for reference. Could you please review the above config issue.
2014-03-12 06:46:14 [c216c2c2] info [native] CPU0: cpu MHz: 2400.1570 (min/max MHz: 0.0000/ 0.0000) cpu has TSC: yes, ConstantTSC: yes
2014-03-12 06:46:14 [c216c2c2] info [native] CPU1: cpu MHz: 2400.1570 (min/max MHz: 0.0000/ 0.0000) cpu has TSC: yes, ConstantTSC: yes
2014-03-12 06:46:14 [c216c2c2] info [native] CPU2: cpu MHz: 2400.1570 (min/max MHz: 0.0000/ 0.0000) cpu has TSC: yes, ConstantTSC: yes
2014-03-12 06:46:14 [c216c2c2] info [native] CPU3: cpu MHz: 2400.1570 (min/max MHz: 0.0000/ 0.0000) cpu has TSC: yes, ConstantTSC: yes
2014-03-12 06:46:14 [c216c2c2] info [native] CPU4: cpu MHz: 2400.1570 (min/max MHz: 0.0000/ 0.0000) cpu has TSC: yes, ConstantTSC: yes
2014-03-12 06:46:14 [c216c2c2] info [native] CPU5: cpu MHz: 2400.1570 (min/max MHz: 0.0000/ 0.0000) cpu has TSC: yes, ConstantTSC: yes
2014-03-12 06:46:14 [c216c2c2] info [native] CPU6: cpu MHz: 2400.1570 (min/max MHz: 0.0000/ 0.0000) cpu has TSC: yes, ConstantTSC: yes
2014-03-12 06:46:14 [c216c2c2] info [native] CPU7: cpu MHz: 2400.1570 (min/max MHz: 0.0000/ 0.0000) cpu has TSC: yes, ConstantTSC: yes
2014-03-12 06:46:14 [c216c2c2] info [native] CPU8: cpu MHz: 2400.1570 (min/max MHz: 0.0000/ 0.0000) cpu has TSC: yes, ConstantTSC: yes
2014-03-12 06:46:14 [c216c2c2] info [native] CPU9: cpu MHz: 2400.1570 (min/max MHz: 0.0000/ 0.0000) cpu has TSC: yes, ConstantTSC: yes
2014-03-12 06:46:14 [c216c2c2] info [native] CPU10: cpu MHz: 2400.1570 (min/max MHz: 0.0000/ 0.0000) cpu has TSC: yes, ConstantTSC: yes
2014-03-12 06:46:14 [c216c2c2] info [native] CPU11: cpu MHz: 2400.1570 (min/max MHz: 0.0000/ 0.0000) cpu has TSC: yes, ConstantTSC: yes
2014-03-12 06:46:14 [c216c2c2] info [native] CPU12: cpu MHz: 2400.1570 (min/max MHz: 0.0000/ 0.0000) cpu has TSC: yes, ConstantTSC: yes
2014-03-12 06:46:14 [c216c2c2] info [native] CPU13: cpu MHz: 2400.1570 (min/max MHz: 0.0000/ 0.0000) cpu has TSC: yes, ConstantTSC: yes
2014-03-12 06:46:14 [c216c2c2] info [native] CPU14: cpu MHz: 2400.1570 (min/max MHz: 0.0000/ 0.0000) cpu has TSC: yes, ConstantTSC: yes
2014-03-12 06:46:14 [c216c2c2] info [native] CPU15: cpu MHz: 2400.1570 (min/max MHz: 0.0000/ 0.0000) cpu has TSC: yes, ConstantTSC: yes
2014-03-12 06:46:14 [c216c2c2] info [native] CPU16: cpu MHz: 2400.1570 (min/max MHz: 0.0000/ 0.0000) cpu has TSC: yes, ConstantTSC: yes
2014-03-12 06:46:14 [c216c2c2] info [native] CPU17: cpu MHz: 2400.1570 (min/max MHz: 0.0000/ 0.0000) cpu has TSC: yes, ConstantTSC: yes
2014-03-12 06:46:14 [c216c2c2] info [native] CPU18: cpu MHz: 2400.1570 (min/max MHz: 0.0000/ 0.0000) cpu has TSC: yes, ConstantTSC: yes
2014-03-12 06:46:14 [c216c2c2] info [native] CPU19: cpu MHz: 2400.1570 (min/max MHz: 0.0000/ 0.0000) cpu has TSC: yes, ConstantTSC: yes
2014-03-12 06:46:14 [c216c2c2] info [native] CPU20: cpu MHz: 2400.1570 (min/max MHz: 0.0000/ 0.0000) cpu has TSC: yes, ConstantTSC: yes
2014-03-12 06:46:14 [c216c2c2] info [native] CPU21: cpu MHz: 2400.1570 (min/max MHz: 0.0000/ 0.0000) cpu has TSC: yes, ConstantTSC: yes
2014-03-12 06:46:14 [c216c2c2] info [native] CPU22: cpu MHz: 2400.1570 (min/max MHz: 0.0000/ 0.0000) cpu has TSC: yes, ConstantTSC: yes
2014-03-12 06:46:14 [c216c2c2] info [native] CPU23: cpu MHz: 2400.1570 (min/max MHz: 0.0000/ 0.0000) cpu has TSC: yes, ConstantTSC: yes
2014-03-12 06:46:15 [c216c2c2] info [native] High-resolution hardware timer detected.
2014-03-12 06:46:15 [c216c2c2] info [native] -----------------------------------------------------------------------------------------
2014-03-12 06:46:15 [c216c2c2] info [native] dynaTrace Agent for Java Copyright (c) 2004-2013 Compuware Corporation, www.compuware.com
2014-03-12 06:46:15 [c216c2c2] info [native] -----------------------------------------------------------------------------------------
2014-03-12 06:46:15 [c216c2c2] info [native] Version ..................... 5.6.0.5802, build date Jan 27 2014 20:09:25
2014-03-12 06:46:15 [c216c2c2] info [native] Command line is /x/opt/oracle/oracle-jdk-7u45-linux-x64/jdk1.7.0_45/bin/java -XX:+TieredCompilation -Dprogram.name=standalone.bat -XX:MaxPermSize=256M -Dsun.rmi.dgc.client.gcInterval=3600000 -Dsun.rmi.dgc.server.gcInterval=3600000 -Djava.net.preferIPv4Stack=true -Djboss.server.default.config=standalone.xml -Dorg.jboss.resolver.warning=true -Djboss.modules.system.pkgs=org.jboss.byteman -Dorg.jboss.boot.log.file=/x/web/STAGE2LP13/invoiceserv/logs/boot.log -Dlogging.configuration=file:/x/web/STAGE2LP13/invoiceserv/standalone/configuration/logging.properties -Dorg.tanukisoftware.wrapper.WrapperManager.mbean=false -Dsun.net.inetaddr.ttl=10 -Dnetworkaddress.cache.ttl=60 -Dsun.rmi.transport.tcp.connectionPool=true -Xmn410m -XX:MaxDirectMemorySize=1G -Doracle.net.tns_admin=/etc -XX:+PrintGCDetails -Xloggc:/x/web/STAGE2LP13/invoiceserv/logs/verbosegc.log -XX:+UseGCLogFileRotation -XX:NumberOfGCLogFiles=10 -XX:GCLogFileSize=10024k -XX:+UseConcMarkSweepGC -XX:+PrintGCDateStamps -XX:+PrintGCApplicationStoppedTime -XX:+PrintGCApplicationConcurrentTime -XX:+PrintTenuringDistribution -XX:+PrintHeapAtGC -agentpath:/opt/dynatrace-5.6.0/agent/lib64/libdtagent.so=name=savasudevan_invoiceserv,server=stage2m018.qa.paypal.com:9998 -Xms1024m -Xmx1024m -Djava.library.path=/x/web/STAGE2LP13/invoiceserv/jsw/lib -classpath /x/web/STAGE2LP13/invoiceserv/config:/x/opt/infra-jboss-as-7.1/jboss-modules.jar:/x/web/STAGE2LP13/invoiceserv/jsw/lib/wrapper.jar -Dwrapper.key=3piNt7N41u_X_rt4 -Dwrapper.port=32009 -Dwrapper.jvm.port.min=31000 -Dwrapper.jvm.port.max=31999 -Dwrapper.disable_console_input=TRUE -Dwrapper.pid=14367 -Dwrapper.version=3.5.10 -Dwrapper.native_library=wrapper -Dwrapper.service=TRUE -Dwrapper.cpu.timeout=10 -Dwrapper.jvmid=1 org.tanukisoftware.wrapper.WrapperSimpleApp org.jboss.modules.Main -mp /x/web/STAGE2LP13/invoiceserv/standalone/modules:/x/opt/infra-jboss-as-7.1/modules: -jaxpmodule javax.xml.jaxp-provider org.jboss.as.standalone -Djboss.home.dir=/x/opt/infra-jboss-as-7.1 -Djboss.server.base.dir=/x/web/STAGE2LP13/invoiceserv/standalone -Dcom.paypal.config.root=/x/web/STAGE2LP13/invoiceserv/config -Dcom.paypal.protected.root=/x/web/STAGE2LP13/invoiceserv/protected -Djboss.management.native.port=10439 -Djboss.application.http.port=10437 -Djboss.jmx.remoting.port=10440 -Djboss.application.osgi.port=10441 -Dorg.jboss.as.logging.per-deployment=false -Djboss.bind.address=0.0.0.0 -Djboss.application.https.port=10436
2014-03-12 06:46:15 [c216c2c2] info [native] Build platform .............. Linux x86 64-bit
2014-03-12 06:46:15 [c216c2c2] info [native] Platform .................... Linux 2.6.18-348.4.1.el5 x86_64
2014-03-12 06:46:15 [c216c2c2] info [native] Bootstrap version ........... 5.6.0.5802
2014-03-12 06:46:15 [c216c2c2] info [native] Log level console ........... info
2014-03-12 06:46:15 [c216c2c2] info [native] Log level file .............. info
2014-03-12 06:46:15 [c216c2c2] info [native] Log file .................... /tmp/dynaTrace/log/dt_savasudevan_invoiceserv_14394.log
2014-03-12 06:46:15 [c216c2c2] info [native] Agent host .................. stage2lp13
2014-03-12 06:46:15 [c216c2c2] info [native] Agent library ............... /tmp/dynaTrace/agent/downloads/5.6.0.5802/native/linux-x86-64/libdtagentcore.so
2014-03-12 06:46:15 [c216c2c2] info [native] Options string .............. name=savasudevan_invoiceserv,server=stage2m018.qa.paypal.com:9998
2014-03-12 06:46:15 [c216c2c2] info [native] Agent name .................. savasudevan_invoiceserv
2014-03-12 06:46:15 [c216c2c2] info [native] Server/Collector ............ stage2m018.qa.paypal.com:9998
2014-03-12 06:46:15 [c216c2c2] info [native] Interface type .............. JVMTI
2014-03-12 06:46:15 [c216c2c2] info [native] Process ID .................. 14394
2014-03-12 06:46:15 [c216c2c2] info [native] JVM name .................... Java HotSpot(TM) 64-Bit Server VM 24.45-b08
2014-03-12 06:46:15 [c216c2c2] info [native] JVM vendor .................. Oracle Corporation
2014-03-12 06:46:15 [c216c2c2] info [native] JVM info .................... mixed mode, sharing
2014-03-12 06:46:15 [c216c2c2] info [native] Trying to connect to Server for up to 19 seconds
2014-03-12 06:46:15 [c216c2c2] warning [native] Starting without instrumentation, agent did not match a System Profile.
2014-03-12 06:46:15 [c216c2c2] info [native] Instrumentation channel connected successfully
2014-03-12 06:46:15 [c216c2c2] info [native] Agent classes defined successfully
2014-03-12 06:46:15 [c216c2c2] info [native] Platform .................... Linux 2.6.18-348.4.1.el5, amd64
2014-03-12 06:46:15 [c216c2c2] info [java ] Java Agent Version .......... 5.6.0.5802, Agent15
2014-03-12 06:46:15 [dbf832c2] info [native] Control channel connected successfully
2014-03-12 06:46:15 [dbf832c2] info [native] Agent ID .................... 104d7a68
2014-03-12 06:46:15 [dbf832c2] info [native] Process ID .................. 14394
2014-03-12 06:46:15 [dbf832c2] info [native] Capture ..................... disabled
2014-03-12 06:46:15 [dbf832c2] info [native] Capture CPU times ........... disabled
2014-03-12 06:46:15 [dbf832c2] info [native] Hot Sensor Placement ........ not available
2014-03-12 06:46:15 [dbf832c2] info [native] Hypervisor .................. unknown
2014-03-12 06:46:15 [c216c2c2] info [native] Eventsender channel connected successfully
2014-03-12 06:46:20 [dbf832c2] info [native] License = skipped by license check - agent did not match system profile;
2014-03-12 07:10:24 [dbf832c2] info [native] Sending log files (including previous)
Thanks
Sattish.
Hi Rob,
Thanks Rob, would upgrading the dtcollector version to the latest will resolve our issue.
Sattish.
That would do it. Are you good now?
Rob
Hi Team,
Checked the dtcollector version and it seems to be the older version 5.6.5713 compared to the new version 5.6.5802.
Thanks
Sattish.
Hi Roman & Rob,
Thanks for the response. Here is the complete description of bootstrap log.
2014-03-07 01:20:08 [18a06251] info [native] dynaTrace Bootstrap Agent 5.6.0.5802
2014-03-07 01:20:08 [18a06251] info [native] Using /opt/dynatrace-5.6.0 as Agent storage
2014-03-07 01:20:08 [18a06251] info [native] Log file at /opt/dynatrace-5.6.0/log/dt_savasudevan_Jboss_Invoiceserv_bootstrap_5877.log
2014-03-07 01:20:08 [18a06251] info [native] Trying to connect to stage2m018.qa.paypal.com:9998 for up to 20 seconds
2014-03-07 01:20:08 [18a06251] info [native] Connected successfully
2014-03-07 01:20:08 [18a06251] info [native] Server requests us to use Agent 5.6.0.5713 with a hash of 506a7c0901a3b3398925e7430d40f710
2014-03-07 01:20:08 [18a06251] info [native] Requesting Agent library from Server
2014-03-07 01:20:08 [18a06251] info [native] Loading Agent /opt/dynatrace-5.6.0/agent/downloads/5.6.0.5713/native/linux-x86-64/libdtagentcore.so
From the logs it looks like the bootstrap is still loading from cache. How to tell the server to load it from the latest version.
Thanks
Sattish.
Has the collector had any appropriate patches applied? The agent version is handed out from the collector. From the log, the bootstrap is still loading from an older agent version in the "downloads" directory, where it is cached.
Hi Satish,
What happens if you map the agent to a system profile before restarting? And what does the bootstrap agent log file contain, you just attached the Java one...
Best, Roman
