• Forums
    • Public Forums
      • Community Connect
      • Dynatrace
        • Dynatrace Open Q&A
      • Application Monitoring & UEM
        • AppMon & UEM Open Q&A
      • Network Application Monitoring
        • NAM Open Q&A
  • Home /
  • Public Forums /
  • Application Monitoring & UEM /
  • AppMon & UEM Open Q&A /
avatar image
Question by Steven L. · Jun 06, 2014 at 02:16 AM ·

Performance tuning DynaTrace

 

Hello,

Situation:

We have dynatrace now for a few weeks into produciton, for the moment i have only 10 users,

if i open 5 client on my laptop i can bring the dynatrace server CPU to 100%,

 

The hardware can't be an issue because we did the hardware setûp together with Compuware consultant.

 

Is there a blog / documentation on how to fine tune dynaTrace on performance level?

 

  • We have a post gresql database, is maintenance done by dynatrace or should i create maitenance script (example indexes)
  • I have enabled continuous transaction storage, together with optimize for user triggered transaction analysis

  • High resolution data to 1 day

  • Medium resolution data 1 month

  • Transaction overflow is crazy --> possible to add block timerange bigger then 30 minutes? With rights?

 

Thx

Comment

People who like this

0 Show 0
10 |2000000 characters needed characters left characters exceeded
  • Viewable by all users
  • Viewable by moderators
  • Viewable by moderators and the original poster
  • Advanced visibility
Toggle Comment visibility. Current Visibility: Viewable by all users

Up to 10 attachments (including images) can be used with a maximum of 50.0 MiB each and 250.0 MiB total.

8 Replies

  • Sort: 
  • Most voted
  • Newest
  • Oldest
avatar image
Best Answer

Answer by Andreas G. · Jun 06, 2014 at 11:11 PM

Hi Steve

I guess I need to re-explain. It is not the measures you add to the Business Transactions that make dynaTrace fetch the data from Disk. It is the way you look at the data in the dynaTrace Client. It is totally valid to add Duration to the Result Measure. And - you can add as many result measures you want.

BUT - if you want to look at long term trending data you should use a Chart Dashlet instead of opening the Business Transaciotn Dashlet. For Every Result Measure you define dynaTrace will write the calculated measures from each PurePath to the Performance Warehouse - splitting it by whatever you split your BT. This then allows you to chart it. Charting takes the data from the Performance Warehouse and this is super fast and doesnt require the dynaTrace server to query the data from the PurePaths stored on disk

The Business Transaction Dashlet though - the one you get when double clicking on the BT Name in the Cockpit is a "PurePath-based Dashlet". Meaning - the dynaTrace Server will analyze all PurePaths in the selected timeframe to display the aggregated data. Why do we do that? Because we offer this Dashlet for a Diagnostic Use Case. You can open this Dashlet for e.g: Last 30 minutes and then drill to the handful of PuirePaths that came in for a certain Split Value of your BT.

I hope this explains the difference. What you should try to do is

a) Create a New Dashboard

b) Add a Chart

c) Select the Duration Measure of your BT to see the values that came on over a longer time period

Andi

Comment

People who like this

0 Show 0 · Share
10 |2000000 characters needed characters left characters exceeded
  • Viewable by all users
  • Viewable by moderators
  • Viewable by moderators and the original poster
  • Advanced visibility
Toggle Comment visibility. Current Visibility: Viewable by all users

Up to 10 attachments (including images) can be used with a maximum of 50.0 MiB each and 250.0 MiB total.

avatar image

Answer by Andreas G. · Jun 06, 2014 at 07:39 PM

Hi Steven

I assume these 5 clients are opening dashboards that include things like PurePaths, Database Statements, Exceptions, ... - so - data from PurePaths? If that is the case then please make sure that these dashboards are mainly used for specific diagnostic use cases, e.g: finding out why in a certain timeframe transactions were slow. It doesnt make sense to e.g: "Show me all PurePaths of the last 24 hours". This is root cause for causing really high CPU but also Memory Usage on the dynaTrace server because the server needs to load all these PurePaths from disk into Memory.

It should be no problem at all to have clients looking at charts because this data comes from the Performance Warehouse. Depending on the number of measures you have in the warehouse and the sizing of your database it could still be a problem. Therefore please have a look at the Health Dashboards that are available through the Start Center. Here is the link to the doc: Deployment Dashboards

In the upcoming dynaTrace 6.0 release we address the problem of many clients trying to do PurePath-based analysis. We are currently doing an Early Access Program. In case you have the time and a system where you can install dT 6 let us know and we can sign you up for the early access program

Andi

Comment

People who like this

0 Show 0 · Share
10 |2000000 characters needed characters left characters exceeded
  • Viewable by all users
  • Viewable by moderators
  • Viewable by moderators and the original poster
  • Advanced visibility
Toggle Comment visibility. Current Visibility: Viewable by all users

Up to 10 attachments (including images) can be used with a maximum of 50.0 MiB each and 250.0 MiB total.

avatar image

Answer by Andreas G. · Jun 06, 2014 at 09:46 PM

Hi Steven

I saw the attachment you uploaded. It explains the problem you are experiencing. You are opening a Business Transaction Dashlet and trying to get the result of the last 7 days. In that case the dynaTrace Server needs to load all PurePaths of the last 7 days to produce that table. The reason being is becauset the Busienses Transaction Dashlet then allows you to drill to the individual PurePaths. That is GREAT for doing targeted diagnostics - BUT - only makes sense if you can first narrow down the timeframe to not have the dT Server load milions of PPs

I assume that you would like to see a chart that displayes e.g: Response Times of each individual Message Type over the last couple of days, weeks or months. To do that simply create a Chart and add the Response Time measure of your Business Transaction on the Chart. That will work SUPER FAST as the data comes from the Performance Warehouse and is not computed on demand by looking at all PurePaths.

If you then look at the chart and find hotspots you can zoom into that timeframe and from there drill to the PurePaths for further diagnostics

I hope this makes sense

Comment

People who like this

0 Show 0 · Share
10 |2000000 characters needed characters left characters exceeded
  • Viewable by all users
  • Viewable by moderators
  • Viewable by moderators and the original poster
  • Advanced visibility
Toggle Comment visibility. Current Visibility: Viewable by all users

Up to 10 attachments (including images) can be used with a maximum of 50.0 MiB each and 250.0 MiB total.

avatar image

Answer by Steven L. · Jun 06, 2014 at 10:57 PM

Thx Andreas,

so it seems by adding the purepath duration measure (also purepath cpu duration) dynaTrace goes for this to the disk instead off the database?

 

First explaining why we used purepath duration?

This is an example of web service calls, we see that the response time is 0.X ms instead of X seconds, we think that this is because of

async call, in the purepath details we see that the execution logic time is into the purepath duration and not into the response time, so we added the pure pathduration measure, (for the messages dahsboard, purepath duration = response time so i willl directly change this), but for all of our async web call we have a problem because we cannot use repsonse time, Correct? Or are there other solutions to get the total web call duration out of the database instead of using the disk,

Thx

 

 

Comment

People who like this

0 Show 0 · Share
10 |2000000 characters needed characters left characters exceeded
  • Viewable by all users
  • Viewable by moderators
  • Viewable by moderators and the original poster
  • Advanced visibility
Toggle Comment visibility. Current Visibility: Viewable by all users

Up to 10 attachments (including images) can be used with a maximum of 50.0 MiB each and 250.0 MiB total.

avatar image

Answer by Steven L. · Jun 07, 2014 at 01:28 AM

 

Thx,

So everything which is into a time chart graph is retrieved from the datawarehouse, at the moment we ask data from a 'table dashboard' we retrieve a lot pure path data from the disk.

Ofcourse i don't know the technical challenges of system,, but i taught a table dashboard would also be saved into the database and in a later time be aggregated. 

 

We have a company culture that everyone want to see all the data (smile) 

Of course that is not possible, but i need to make a compromise,

So thinking on a solution:

-->  Now i can only place heavy dashboards on separate account, only used by a few people

      Example my boss wants to compare database statements from today with statements of yesterday.

      So i need to say to him that this is a action that will cost time, correct? Because we saw times of 10 mintutes to retrieve query stats of 6H

      We just get data from disk. Correct?

 

     It would be interesting that i give table dashboards to people BUT that they cannot select more then 30 minutes each time.

     This would certainly be accepted, Is there a way to achive this? Or is this a Feature Enh

 

--> i can control my dashboards (rights), but each chart has a drill down so it is possible that everyone uses a chart to drill down on exceptions in a 

     time period of 6H data, possible to prevent?

 

I can ask people to select only 30 minutes of detail data, but they will get exceptions, query's, ... on 2 week data, 

i used to be a developper / tester and believe me they will do this,

"let see how long the system last" (smile) or just out of a unawareness point of view ,

so i have to prevent this somehow (smile)

 

Is this correct? If we cannot prevent huge data selection, the dynaTrace server will go to 100% cpu (or has memory issues),

which blocks the data insert, which gives use buffer overflow and data loss? Or is the write / read path separated / secured?

 

How do other companies do this?

 

Thx

 

 

 

 

 

 

Comment

People who like this

0 Show 0 · Share
10 |2000000 characters needed characters left characters exceeded
  • Viewable by all users
  • Viewable by moderators
  • Viewable by moderators and the original poster
  • Advanced visibility
Toggle Comment visibility. Current Visibility: Viewable by all users

Up to 10 attachments (including images) can be used with a maximum of 50.0 MiB each and 250.0 MiB total.

avatar image

Answer by Steven L. · Jun 07, 2014 at 01:44 AM

Just a max time selection coupled to a dashboard would make a huge difference

Comment

People who like this

0 Show 0 · Share
10 |2000000 characters needed characters left characters exceeded
  • Viewable by all users
  • Viewable by moderators
  • Viewable by moderators and the original poster
  • Advanced visibility
Toggle Comment visibility. Current Visibility: Viewable by all users

Up to 10 attachments (including images) can be used with a maximum of 50.0 MiB each and 250.0 MiB total.

avatar image

Answer by Andreas G. · Jun 07, 2014 at 03:14 AM

The memory problem on the dynaTrace server is addressed in the upcoming dT 6 release. I am hosting a Whats New Webinar in 2 weeks where we show these new capabilities.

If you like to see things in tables I have three things for you

a) Dynamic Measure Matrix Dashlet -> check it out. It allows you to show multiple measures in a table

b) Business Transaction Hotspot DAshlet. This also displays Business Transaction Data per splitting but instead of going through all PurePaths it is taking the data from the Perf Warehouse -> should have told you that right from the start (smile)

c) The Chart Dashlet also has a table on the bottom of the chart -> not sure if that is what your users like - but - well - it is a table (smile)

Andi

Comment

People who like this

0 Show 0 · Share
10 |2000000 characters needed characters left characters exceeded
  • Viewable by all users
  • Viewable by moderators
  • Viewable by moderators and the original poster
  • Advanced visibility
Toggle Comment visibility. Current Visibility: Viewable by all users

Up to 10 attachments (including images) can be used with a maximum of 50.0 MiB each and 250.0 MiB total.

avatar image

Answer by Steven L. · Jun 11, 2014 at 11:15 PM

Hello,

I have tried the Business Transaction Hotspot DAshlet, it is a huge difference, 72H in 5 seconds.

I aim happy to see that i still have a link to the purepaths (smile), how is that possible?, 

What is the advantage of the Original dashboard compared to the  Hotspot DAshlet?

 

If a select the same period on both dashoards (today) then

i see a small difference in stats (example count & duration)?. At this moment i will not worry about this and

 quickly change all the dashlets, made into the poc, to the Business Transaction Hotspot DAshlet

 

One more question? Only related to pure^paths, Is it somehow posssible to force the user to select a small time period,

for example no more then 30 minutes, if the user want more data, just 'scroll'' 30 minutes back /  further,

any workaround, or is this just a FeatureE

 

Many thx for the solution

Comment

People who like this

0 Show 0 · Share
10 |2000000 characters needed characters left characters exceeded
  • Viewable by all users
  • Viewable by moderators
  • Viewable by moderators and the original poster
  • Advanced visibility
Toggle Comment visibility. Current Visibility: Viewable by all users

Up to 10 attachments (including images) can be used with a maximum of 50.0 MiB each and 250.0 MiB total.

How to get started

First steps in the forum
Read Community User Guide
Best practices of using forum

NAM 2019 SP5 is available


Check the RHEL support added in the latest NAM service pack.

Learn more

LIVE WEBINAR

"Performance Clinic - Monitoring as a Self Service with Dynatrace"


JANUARY 15, 3:00 PM GMT / 10:00 AM ET

Register here

Follow this Question

Answers Answers and Comments

1 Person is following this question.

avatar image

Forum Tags

dotnet mobile monitoring load iis 6.5 kubernetes mainframe rest api dashboard framework 7.0 appmon 7 health monitoring adk log monitoring services auto-detection uem webserver test automation license web performance monitoring ios nam probe collector migration mq web services knowledge sharing reports window java hybris javascript appmon sensors good to know extensions search 6.3+ server documentation easytravel web dashboard kibana system profile purelytics docker splunk 6.1 process groups account 7.2 rest dynatrace saas spa guardian appmon administration production user actions postgresql upgrade oneagent measures security Dynatrace Managed transactionflow technologies diagnostics user session monitoring unique users continuous delivery sharing configuration alerting NGINX splitting business transaction client 6.3 installation database scheduler apache mobileapp RUM php dashlet azure purepath agent 7.1 appmonsaas messagebroker nodejs 6.2 android sensor performance warehouse
  • Forums
  • Public Forums
    • Community Connect
    • Dynatrace
      • Dynatrace Open Q&A
    • Application Monitoring & UEM
      • AppMon & UEM Open Q&A
    • Network Application Monitoring
      • NAM Open Q&A