• Forums
    • Public Forums
      • Community Connect
      • Dynatrace
        • Dynatrace Open Q&A
      • Application Monitoring & UEM
        • AppMon & UEM Open Q&A
      • Network Application Monitoring
        • NAM Open Q&A
  • Home /
  • Public Forums /
  • Network Application Monitoring /
  • NAM Open Q&A /
avatar image
Question by Jean-Louis L. · Mar 30, 2015 at 08:09 PM ·

RtmMemoryPerfind

Hello,

What does the metric RtmMemoryPerfind  mean exactly ?

In this view, we have the RtmMemoryPerfind  with 4 saturations (but the value is 22 % only) - for each satured period, the capture flow is incomplet (it miss a lot of operation and activity)

In my case, is there a memory saturation on the RTM ? Where can I change it?

 

Regards,

JLL

Comment

People who like this

0 Show 0
10 |2000000 characters needed characters left characters exceeded
  • Viewable by all users
  • Viewable by moderators
  • Viewable by moderators and the original poster
  • Advanced visibility
Toggle Comment visibility. Current Visibility: Viewable by all users

Up to 10 attachments (including images) can be used with a maximum of 50.0 MiB each and 250.0 MiB total.

7 Replies

  • Sort: 
  • Most voted
  • Newest
  • Oldest
avatar image

Answer by Jean-Louis L. · Apr 10, 2015 at 12:57 PM

Very interesting. Thank you for this explanation.

The call is already opened. SUPDCRUM-5320

Regards.

JLL

Comment

People who like this

0 Show 0 · Share
10 |2000000 characters needed characters left characters exceeded
  • Viewable by all users
  • Viewable by moderators
  • Viewable by moderators and the original poster
  • Advanced visibility
Toggle Comment visibility. Current Visibility: Viewable by all users

Up to 10 attachments (including images) can be used with a maximum of 50.0 MiB each and 250.0 MiB total.

avatar image

Answer by Wojciech K. · Apr 10, 2015 at 12:47 PM

Jean-Louis,

Usually one should use the value recommended by rtminst. Too large values may even increase the amount of dropped traffic (a large buffer allows a large backlog of packets to be accumulated, and when sampling starts the AMD must process all those buffered packets, further reducing performance and increasing sampling).

If you are experiencing drops/sampling at a traffic volume of 30kpps you should open a Support ticket. This apparently is a problem, but it is not memory-related (at least not directly). Determining the root cause would require anaylysis of AMD performance logs.

Regards,

Wojtek.

Comment

People who like this

0 Show 0 · Share
10 |2000000 characters needed characters left characters exceeded
  • Viewable by all users
  • Viewable by moderators
  • Viewable by moderators and the original poster
  • Advanced visibility
Toggle Comment visibility. Current Visibility: Viewable by all users

Up to 10 attachments (including images) can be used with a maximum of 50.0 MiB each and 250.0 MiB total.

avatar image

Answer by Jean-Louis L. · Apr 10, 2015 at 12:33 PM

Hello Wotjek,

What is the max value for the SHM buffer size you recommend to configure in the rtminst ?

For this case, I don't think that the data collected has reached the limit. The AMD is a very large AMD (32 Proc, 146 GB Ram...), and a regular AMD can collect about 900 Mbps according to the documentation. When the limite of the rtmMemoryPerfInd is reached, there are max 10 MPkts by 5 minutes - the traffix does not exceed 33k packets per second!

 

regards,

JLL

Comment

People who like this

0 Show 0 · Share
10 |2000000 characters needed characters left characters exceeded
  • Viewable by all users
  • Viewable by moderators
  • Viewable by moderators and the original poster
  • Advanced visibility
Toggle Comment visibility. Current Visibility: Viewable by all users

Up to 10 attachments (including images) can be used with a maximum of 50.0 MiB each and 250.0 MiB total.

avatar image

Answer by Wojciech K. · Apr 09, 2015 at 04:34 PM

Jean-Louis,

Increasing the SHM buffer space past some value won't have any effect on performance (it may only delay sampling a bit). The fact of the AMD being overloaded is not related to NIC capacities. The 300Mbps that is being filtered and sent to analysis equals to more or less 300k packets per second - which is roughly the top traffic volume for all decodes (you can find exact traffic processing capabilities in the documentation). The AMD is expected to drop packets and activate sampling when reaching this limit (the exact limit depends on the decodes being used and the traffic profile). 

Wojtek.

Comment

People who like this

0 Show 0 · Share
10 |2000000 characters needed characters left characters exceeded
  • Viewable by all users
  • Viewable by moderators
  • Viewable by moderators and the original poster
  • Advanced visibility
Toggle Comment visibility. Current Visibility: Viewable by all users

Up to 10 attachments (including images) can be used with a maximum of 50.0 MiB each and 250.0 MiB total.

avatar image

Answer by Jean-Louis L. · Apr 08, 2015 at 06:33 PM

Hi Harsal,

For this environment, the default of the SHM Buffer Size is 20642 MB (proposed automatically from the rtminst - I use the standard command of the documenation as you mentioned) and the max is 51606 MB.

I think the AMD change the default and max SHM buffer size depending of the total memory (146 MB here).

Regards,

JLL

 

Comment

People who like this

0 Show 0 · Share
10 |2000000 characters needed characters left characters exceeded
  • Viewable by all users
  • Viewable by moderators
  • Viewable by moderators and the original poster
  • Advanced visibility
Toggle Comment visibility. Current Visibility: Viewable by all users

Up to 10 attachments (including images) can be used with a maximum of 50.0 MiB each and 250.0 MiB total.

avatar image

Answer by Jean-Louis L. · Apr 08, 2015 at 01:30 PM

Hello Wojtek,

thank you for this explanation.

We have tested these 2 configurations :

  data.mem.limit (MB) SHM buffer size (MB) rtmMemoryPerflnd (MAX) Data collected during the Max period
Default  configuration 103212 20642 22% about 50%
Test 51606 32768 64% 5%

The total memory is 146GB.

We increased the SHM buffer size during a test period. But with this new configuration, the AMD lost almost all the packets and there were only 5% of data collected in the CAS.

which value do you recommand for the SHM buffer size?

I don't think that the AMD is overloaded, there are 6 Gbps on the 10 Gb NIC received by the AMD, but there are only 300 Mbps filtered (and treated by the AMD).

It appears that the Max of the rtmMemoryPerflnd is reached with a high activity of the SOAP.

Regards,

JLL

Comment

People who like this

0 Show 1 · Share
10 |2000000 characters needed characters left characters exceeded
  • Viewable by all users
  • Viewable by moderators
  • Viewable by moderators and the original poster
  • Advanced visibility
Toggle Comment visibility. Current Visibility: Viewable by all users

Up to 10 attachments (including images) can be used with a maximum of 50.0 MiB each and 250.0 MiB total.

avatar image Harshal P. · Apr 08, 2015 at 06:08 PM 0
Share

Hi JLL,

Just curious: the documentation says that the SHM buffer size should be 20% of the data memory limit or 4096 MB, whichever is greater..and never be greater than 5120 MB. The example in the documentation sets it to 5120 MB. Any reason you have the SHM buffer size set that high?

Thanks,

Harshal.

avatar image

Answer by Wojciech K. · Apr 08, 2015 at 10:21 AM

Jean-Louis,

The rtmMemoryPerfind metric shows the percentage of total memory that can be used by the AMD (data.mem.limit + SHM size) vs the amount actually used (normal memory allocation + SHM buffer usage). According to the chart you attached, the AMD is running out of SHM space - i.e. it is hitting the SHM buffer capacity and dropping packets - that's why you see a drop in monitored traffic during that time.

There can be two reasons for that:

  • The AMD drops packets due to short bursts of increased traffic volume. In this case, you can solve the problem by increasing the SHM buffer size in rtminst.
  • The AMD is overloaded (analyzes too much traffic) or there is some performance problem.

Regards,

Wojtek.

 

Comment

People who like this

0 Show 0 · Share
10 |2000000 characters needed characters left characters exceeded
  • Viewable by all users
  • Viewable by moderators
  • Viewable by moderators and the original poster
  • Advanced visibility
Toggle Comment visibility. Current Visibility: Viewable by all users

Up to 10 attachments (including images) can be used with a maximum of 50.0 MiB each and 250.0 MiB total.

How to get started

First steps in the forum
Read Community User Guide
Best practices of using forum

NAM 2019 SP5 is available


Check the RHEL support added in the latest NAM service pack.

Learn more

LIVE WEBINAR

"Performance Clinic - Monitoring as a Self Service with Dynatrace"


JANUARY 15, 3:00 PM GMT / 10:00 AM ET

Register here

Follow this Question

Answers Answers and Comments

2 People are following this question.

avatar image avatar image

Forum Tags

esm siebel Dynatrace Managed license nam probe wan citrix dna rest api configuration mq alerting NAM 2018 dashboard dcrumadvisory reports css nam universal decode database mobileapp RUM ads sap nam console scripting nam server sequence transactions nam 2019 upgrade
  • Forums
  • Public Forums
    • Community Connect
    • Dynatrace
      • Dynatrace Open Q&A
    • Application Monitoring & UEM
      • AppMon & UEM Open Q&A
    • Network Application Monitoring
      • NAM Open Q&A