• Forums
    • Public Forums
      • Community Connect
      • Dynatrace
        • Dynatrace Open Q&A
      • Application Monitoring & UEM
        • AppMon & UEM Open Q&A
      • Network Application Monitoring
        • NAM Open Q&A
  • Home /
  • Public Forums /
  • Application Monitoring & UEM /
  • AppMon & UEM Open Q&A /
avatar image
Question by Venkata A. · Sep 06, 2014 at 08:55 AM ·

Hadoop Sqoop Job Performance Monitoring

Comment

People who like this

0 Show 0
10 |2000000 characters needed characters left characters exceeded
  • Viewable by all users
  • Viewable by moderators
  • Viewable by moderators and the original poster
  • Advanced visibility
Toggle Comment visibility. Current Visibility: Viewable by all users

Up to 10 attachments (including images) can be used with a maximum of 50.0 MiB each and 250.0 MiB total.

2 Replies

  • Sort: 
  • Most voted
  • Newest
  • Oldest
avatar image

Answer by Andreas G. · Sep 08, 2014 at 05:32 PM

Hi. I am not an expert in Hadoop therefore the following information might not be all that you expect - but I hope it is a start

First - we do have special support for Hadoop MapReduce job performance analysis. Check out the following doc page: Hadoop MapReduce

Second - as you specifically interested in Sqoop job performance: Sqoop seems to be a Java-based tool which means you can instrument this tool with dynaTrace while Sqoop is importing data from your databases to hadoop server. Once you have the agent in place you can define your own custom sensors to get method level information for things that are going on witin Sqoop. The other approach would be to look for JMX Metrics. Once you have a dynaTrace Agent injected in a Java App you can query any JMX Meausures exposed by that App. That might even be the better approach assuming that Sqoop provides some JMX Metrics. Here is a link to the doc that explains how to Using Custom JMX and PMI Measures in Charts

Hope this helps as a start

Comment
Aiden S.

People who like this

1 Show 0 · Share
10 |2000000 characters needed characters left characters exceeded
  • Viewable by all users
  • Viewable by moderators
  • Viewable by moderators and the original poster
  • Advanced visibility
Toggle Comment visibility. Current Visibility: Viewable by all users

Up to 10 attachments (including images) can be used with a maximum of 50.0 MiB each and 250.0 MiB total.

avatar image

Answer by Venkata A. · Sep 06, 2014 at 10:16 AM

Hi,

This is regarding dynatrace and hadoop server monitoring. We have few sqoop jobs to pull the data from database to hadoop server and would like to know how to capture the performance metrics for these jobs exclusivly on the hadoop server. If possible, please guide us to any documentation available for configuring dynatrace agent to monitor at job level rather than providing for the entire server.

Regards,

Venkata

Comment
Aiden S.

People who like this

1 Show 0 · Share
10 |2000000 characters needed characters left characters exceeded
  • Viewable by all users
  • Viewable by moderators
  • Viewable by moderators and the original poster
  • Advanced visibility
Toggle Comment visibility. Current Visibility: Viewable by all users

Up to 10 attachments (including images) can be used with a maximum of 50.0 MiB each and 250.0 MiB total.

How to get started

First steps in the forum
Read Community User Guide
Best practices of using forum

NAM 2019 SP5 is available


Check the RHEL support added in the latest NAM service pack.

Learn more

LIVE WEBINAR

"Performance Clinic - Monitoring as a Self Service with Dynatrace"


JANUARY 15, 3:00 PM GMT / 10:00 AM ET

Register here

Follow this Question

Answers Answers and Comments

2 People are following this question.

avatar image avatar image

Forum Tags

dotnet mobile monitoring load iis 6.5 kubernetes mainframe rest api dashboard framework 7.0 appmon 7 health monitoring adk log monitoring services auto-detection uem webserver test automation license web performance monitoring ios nam probe collector migration mq web services knowledge sharing reports window java hybris javascript appmon sensors good to know extensions search 6.3+ server documentation easytravel web dashboard kibana system profile purelytics docker splunk 6.1 process groups account 7.2 rest dynatrace saas spa guardian appmon administration production user actions postgresql upgrade oneagent measures security Dynatrace Managed transactionflow technologies diagnostics user session monitoring unique users continuous delivery sharing configuration alerting NGINX splitting business transaction client 6.3 installation database scheduler apache mobileapp RUM php dashlet azure purepath agent 7.1 appmonsaas messagebroker nodejs 6.2 android sensor performance warehouse
  • Forums
  • Public Forums
    • Community Connect
    • Dynatrace
      • Dynatrace Open Q&A
    • Application Monitoring & UEM
      • AppMon & UEM Open Q&A
    • Network Application Monitoring
      • NAM Open Q&A