• Forums
    • Public Forums
      • Community Connect
      • Dynatrace
        • Dynatrace Open Q&A
      • Application Monitoring & UEM
        • AppMon & UEM Open Q&A
      • Network Application Monitoring
        • NAM Open Q&A
  • Home
  • Public Forums
  • Application Monitoring & UEM
  • AppMon & UEM Open Q&A
avatar image
Question by James M. · Dec 09, 2013 at 09:44 PM ·

Thoughts on Peak Throughput for Agent-less Monitors?

I can't find any heuristics in the documentation, so maybe DT engineering has done some stress/performance testing in this area.

We are moving heavily into complimenting our agent-base with Monitors, for URL monitoring, app port monitoring, infrastructure monitoring for servers not covered by agents, etc. What I'm trying to learn is more about how Monitors work with their collectors and how many polls can be done simultaneously.

To provide some context, there's probably about 500-1000 servers we could be pinging for general server metrics. This would likely be driven by the same monitor in a single profile. I estimate that if we went all the way, about 25000 processes that could be eligible for URL or process monitoring, but spread out across 50-80 different profiles.

Currently, to keep sanity, we have one collector that is providing this functionality, but it is only monitoring a couple of hundred servers, and currently only about 30 processes.

Any idea on how many simultaneous monitors can be run from a single Monitoring Collector, assuming say 10 measures/host/monitor?

Comment

People who like this

0 Show 0
10 |2000000 characters needed characters left characters exceeded
  • Viewable by all users
  • Viewable by moderators
  • Viewable by moderators and the original poster
  • Advanced visibility
Toggle Comment visibility. Current Visibility: Viewable by all users

Up to 10 attachments (including images) can be used with a maximum of 50.0 MiB each and 250.0 MiB total.

2 Replies

  • Sort: 
  • Most voted
  • Newest
  • Oldest
avatar image

Answer by James M. · Dec 10, 2013 at 03:25 PM

Thanks – that's what I was afraid of. The challenge then is configuring each monitor to use the right collector, hence our RFE to do more with collector clusters, where dynatrace automatically partitions and schedules the activities on a collector farm.  Our infrastructure monitor alone today has several hundred servers in it, and increasing significantly next year.

 These collectors only do monitoring, no agents can connect to them.  We'll work on this; thanks!

Comment

People who like this

0 Show 0 · Share
10 |2000000 characters needed characters left characters exceeded
  • Viewable by all users
  • Viewable by moderators
  • Viewable by moderators and the original poster
  • Advanced visibility
Toggle Comment visibility. Current Visibility: Viewable by all users

Up to 10 attachments (including images) can be used with a maximum of 50.0 MiB each and 250.0 MiB total.

avatar image

Answer by Derek A. · Dec 10, 2013 at 02:57 PM

DynaTrace Collectors support only 100 threads running concurrently (Compuware has this changed?). If the monitor (or I should say Collector) has anything else running at that time too, then they will get queued up and processed when a thread is available again. Depending on how aggressive your monitoring will be you may have some servers miss their data collection if it’s trying to process hundreds & hundreds of servers every minute. I believe 100 is the max, at least it was back in 3.5.2, but I don’t think it’s changed since.

We are also doing a lot of agent-less monitoring for a large amount of URLs, perfmon on a couple thousand servers, some windows service and process monitoring, etc. To get around the 100 thread limit, we just spin up another Collector instance on the server itself. So instead of having say 20 different Collectors on their own server, you could have 2 servers with 10 instances each or 5 servers with 4 instances each or however you want to slice it up depending on your resources. There are some self-monitoring measures for threads you can chart to give you an idea of what's going on for the Collector. Hope this helps.

 

Comment

People who like this

0 Show 0 · Share
10 |2000000 characters needed characters left characters exceeded
  • Viewable by all users
  • Viewable by moderators
  • Viewable by moderators and the original poster
  • Advanced visibility
Toggle Comment visibility. Current Visibility: Viewable by all users

Up to 10 attachments (including images) can be used with a maximum of 50.0 MiB each and 250.0 MiB total.

How to get started

First steps in the forum
Read Community User Guide
Best practices of using forum

NAM 2019 SP5 is available


Check the RHEL support added in the latest NAM service pack.

Learn more

LIVE WEBINAR

"Performance Clinic - Monitoring as a Self Service with Dynatrace"


JANUARY 15, 3:00 PM GMT / 10:00 AM ET

Register here

Follow this Question

Answers Answers and Comments

1 Person is following this question.

avatar image

Forum Tags

dotnet mobile monitoring load iis 6.5 kubernetes mainframe rest api dashboard framework 7.0 appmon 7 health monitoring adk log monitoring services auto-detection uem webserver test automation license web performance monitoring ios nam probe collector migration mq web services knowledge sharing reports window java hybris javascript appmon sensors good to know extensions search 6.3+ server documentation easytravel web dashboard kibana system profile purelytics docker splunk 6.1 process groups account 7.2 rest dynatrace saas spa guardian appmon administration production user actions postgresql upgrade oneagent measures security Dynatrace Managed transactionflow technologies diagnostics user session monitoring unique users continuous delivery sharing configuration alerting NGINX splitting business transaction client 6.3 installation database scheduler apache mobileapp RUM php dashlet azure purepath agent 7.1 appmonsaas messagebroker nodejs 6.2 android sensor performance warehouse
  • Forums
  • Public Forums
    • Community Connect
    • Dynatrace
      • Dynatrace Open Q&A
    • Application Monitoring & UEM
      • AppMon & UEM Open Q&A
    • Network Application Monitoring
      • NAM Open Q&A