• Forums
    • Public Forums
      • Community Connect
      • Dynatrace
        • Dynatrace Open Q&A
      • Application Monitoring & UEM
        • AppMon & UEM Open Q&A
      • Network Application Monitoring
        • NAM Open Q&A
  • Home /
  • Public Forums /
  • Application Monitoring & UEM /
  • AppMon & UEM Open Q&A /
avatar image
Question by David W. · Mar 17, 2015 at 05:27 AM ·

Rollback after upgrade of dynatrace server/collector/agents

As part of our Change Management process we need to include rollback plans. We normally upgrade the server, which then automatically upgrades the collectors, which then automatically update the agents. Rolling all that back could be "interesting". Any hints on keeping the corporate types off our backs by sharing instructions about how to roll all three back after an errant upgrade? Not that anything ever could go wrong, of course! (smile)

Comment

People who like this

0 Show 0
10 |2000000 characters needed characters left characters exceeded
  • Viewable by all users
  • Viewable by moderators
  • Viewable by moderators and the original poster
  • Advanced visibility
Toggle Comment visibility. Current Visibility: Viewable by all users

Up to 10 attachments (including images) can be used with a maximum of 50.0 MiB each and 250.0 MiB total.

4 Replies

  • Sort: 
  • Most voted
  • Newest
  • Oldest
avatar image

Answer by Srikar M. · Mar 17, 2015 at 07:23 AM

Adding to the great details provided by James...

With regards to upgrade, from a high level, here are the implementation steps...(back up db, session store and config files; acquire the new license and uem before hand); disconnect the performance warehouse; deactivate the license and uem volume; stop the collector service, stop the server service; Install the new version for server and collector (as you can see the old version still exists); run the migration commands to port configurations from old version to new; bring up the new server service then the collector service; import the new license; connect to performance warehouse. If an application is restarted at this time the bootstrapped agents will be updated;

From a roll back strategy consider these points...once the new server service connects to the performance warehouse it will update the schema (if any) - so from a roll back point of view have a db backup that can be restored, you also want to back up the session store for restoring it. For server and collector service you can stop the current (new) service and start the old one (at this point you will have to restore the db and session store)...for the agent you can re-install the older version.

Hope this helps.

Srikar

Comment
Kristel P.

People who like this

1 Show 0 · Share
10 |2000000 characters needed characters left characters exceeded
  • Viewable by all users
  • Viewable by moderators
  • Viewable by moderators and the original poster
  • Advanced visibility
Toggle Comment visibility. Current Visibility: Viewable by all users

Up to 10 attachments (including images) can be used with a maximum of 50.0 MiB each and 250.0 MiB total.

avatar image

Answer by David W. · Mar 17, 2015 at 07:47 AM

Great feedback!

We do a variation of  James' B - we do a side-by-side with the server and collectors. So, rollback for those is straightforward by going back to the earlier versions it appears.

That leaves the question of the agents. Are you saying that when they "phone home" they will automatically go back to the previous version? Otherwise, we have hundreds of agents (potentially) that would have to be manually rolled back. Major ugh!

Comment

People who like this

0 Show 0 · Share
10 |2000000 characters needed characters left characters exceeded
  • Viewable by all users
  • Viewable by moderators
  • Viewable by moderators and the original poster
  • Advanced visibility
Toggle Comment visibility. Current Visibility: Viewable by all users

Up to 10 attachments (including images) can be used with a maximum of 50.0 MiB each and 250.0 MiB total.

avatar image

Answer by James D. · Mar 17, 2015 at 07:14 AM

Hey David, we also have a strict change process that requires a back-out plan. We looked at a few options for ours since older versions of dynaTrace are less than friendly for these types of scenarios. We actually DON'T auto-update our agents. A long time ago in v4 we had an agent cause a performance problem with one system. Since then we were gun shy of course. So, we now roll out agents per machine/application.

In both instances you can lose session data if your transaction storage is on the same drives, or is backed up.

Scenario A - Install/Back-out using backup using bootstrap agents

  1. Create a snapshot or backup of the servers, collectors, etc. to fall back on.
  2. Migrate profiles and other data
  3. Upgrade in place
  4. Rollout agents
  5. <<disaster strikes>>
  6. Bring back old snapshots
  7. Agents will phone home and get old version 
    1. This may or may not work depending on how far you're jumping in versions.

Scenario B - Install/Back-out side by side using bootstrap agents

  1. Install servers, collectors, etc. on the same hardware using different ports.
    1. In most cases we just added 100 to them.
  2. Copy profiles and other data
  3. Roll out agents by changing the ports in the agent confg.
    1. Can be automated by editing registry entries.
    2. Can be done over time to "test in production" before committing
  4. <<disaster strikes>>
  5. Undo agent changes by setting ports back to original values
  6. Uninstall new version once everyone is back home safe

Scenario C - Install/Back-out side by side using non-bootstrap agents

  1. Install servers, collectors, etc. on the same hardware using different ports.
    1. In most cases we just added 100 to them.
  2. Copy profiles and other data
  3. Roll out agents by installing new version and changing the ports in the agent confg.
    1. Can be done over time to "test in production" before committing
  4. <<disaster strikes>>
  5. Uninstall new agents, install old agents
  6. Uninstall new version once everyone is back home safe
Comment

People who like this

0 Show 0 · Share
10 |2000000 characters needed characters left characters exceeded
  • Viewable by all users
  • Viewable by moderators
  • Viewable by moderators and the original poster
  • Advanced visibility
Toggle Comment visibility. Current Visibility: Viewable by all users

Up to 10 attachments (including images) can be used with a maximum of 50.0 MiB each and 250.0 MiB total.

avatar image

Answer by Kyle K. · Mar 17, 2015 at 06:05 AM

As far as fixpacks go I think you can select which fixpack to roll out across the system so the back up would be to select the older fixpack version as far as major releases, I'm not quite sure.

Comment

People who like this

0 Show 0 · Share
10 |2000000 characters needed characters left characters exceeded
  • Viewable by all users
  • Viewable by moderators
  • Viewable by moderators and the original poster
  • Advanced visibility
Toggle Comment visibility. Current Visibility: Viewable by all users

Up to 10 attachments (including images) can be used with a maximum of 50.0 MiB each and 250.0 MiB total.

How to get started

First steps in the forum
Read Community User Guide
Best practices of using forum

NAM 2019 SP5 is available


Check the RHEL support added in the latest NAM service pack.

Learn more

LIVE WEBINAR

"Performance Clinic - Monitoring as a Self Service with Dynatrace"


JANUARY 15, 3:00 PM GMT / 10:00 AM ET

Register here

Follow this Question

Answers Answers and Comments

2 People are following this question.

avatar image avatar image

Forum Tags

dotnet mobile monitoring load iis 6.5 kubernetes mainframe rest api dashboard framework 7.0 appmon 7 health monitoring adk log monitoring services auto-detection uem webserver test automation license web performance monitoring ios nam probe collector migration mq web services knowledge sharing reports window java hybris javascript appmon sensors good to know extensions search 6.3+ server documentation easytravel web dashboard kibana system profile purelytics docker splunk 6.1 process groups account 7.2 rest dynatrace saas spa guardian appmon administration production user actions postgresql upgrade oneagent measures security Dynatrace Managed transactionflow technologies diagnostics user session monitoring unique users continuous delivery sharing configuration alerting NGINX splitting business transaction client 6.3 installation database scheduler apache mobileapp RUM php dashlet azure purepath agent 7.1 appmonsaas messagebroker nodejs 6.2 android sensor performance warehouse
  • Forums
  • Public Forums
    • Community Connect
    • Dynatrace
      • Dynatrace Open Q&A
    • Application Monitoring & UEM
      • AppMon & UEM Open Q&A
    • Network Application Monitoring
      • NAM Open Q&A