• Forums
    • Public Forums
      • Community Connect
      • Dynatrace
        • Dynatrace Open Q&A
      • Application Monitoring & UEM
        • AppMon & UEM Open Q&A
      • Network Application Monitoring
        • NAM Open Q&A
  • Home /
  • Public Forums /
  • Application Monitoring & UEM /
  • AppMon & UEM Open Q&A /
avatar image
Question by Rafael M. · Nov 22, 2011 at 11:13 PM ·

How to see payload and header from Webpages requested?

Hi everyone,

Is there a way to see the payload and header from the pages that are showed in Web Requests?

Tks,

Comment

People who like this

0 Show 0
10 |2000000 characters needed characters left characters exceeded
  • Viewable by all users
  • Viewable by moderators
  • Viewable by moderators and the original poster
  • Advanced visibility
Toggle Comment visibility. Current Visibility: Viewable by all users

Up to 10 attachments (including images) can be used with a maximum of 50.0 MiB each and 250.0 MiB total.

8 Replies

  • Sort: 
  • Most voted
  • Newest
  • Oldest
avatar image

Answer by Tarjei U. · Dec 09, 2015 at 01:58 PM

So there is no "out of the box" way of getting a correlation ID from the body of a post?

Comment

People who like this

0 Show 4 · Share
10 |2000000 characters needed characters left characters exceeded
  • Viewable by all users
  • Viewable by moderators
  • Viewable by moderators and the original poster
  • Advanced visibility
Toggle Comment visibility. Current Visibility: Viewable by all users

Up to 10 attachments (including images) can be used with a maximum of 50.0 MiB each and 250.0 MiB total.

avatar image Andreas G. ♦ · Dec 09, 2015 at 07:00 PM 2
Share

Not yet. But this feature is coming with Dynatrace 6.3 where you can parse any type of content of HTML responses through our JavaScript Agent - meaning - we can capture this on the browser!

avatar image Valerio F. Andreas G. ♦ · Jun 13, 2016 at 11:23 PM 0
Share

Hi @Andreas, quick question: since Dynatrace 6.3 has been out for quite some time now, in your comment, were you referring to the MetaData capturing capability of the Javascript agent? Thanks a lot!

Valerio

avatar image Andreas G. ♦ Valerio F. · Jun 14, 2016 at 05:45 AM 1
Share

Correct. it allows you capture content of HTML Elements identified via a CSS Selector. You can also capture the return value of a global JavaScript object or the content of a META Tag

avatar image Valerio F. Andreas G. ♦ · Jun 14, 2016 at 10:15 AM 0
Share

Great, thanks Andi! :)

avatar image

Answer by Tarjei U. · Dec 04, 2015 at 02:40 PM

How would one go about capturing the POST payload of a web request? I see for Request header, response header, and request parameter. Is it request parameter? Or is that only for the suffix after a URI like this www.example.com/index.php?<this part>

Comment

People who like this

0 Show 1 · Share
10 |2000000 characters needed characters left characters exceeded
  • Viewable by all users
  • Viewable by moderators
  • Viewable by moderators and the original poster
  • Advanced visibility
Toggle Comment visibility. Current Visibility: Viewable by all users

Up to 10 attachments (including images) can be used with a maximum of 50.0 MiB each and 250.0 MiB total.

avatar image Andreas G. ♦ · Dec 04, 2015 at 03:43 PM 0
Share

Dynatrace can only capture HTTP Parameters - for both GET and POST Requests. But if your POST body is e.g: XML or something other protocol then Dynatrace doesnt capture the full body. If you want to extract certain data out of the body you should try to capture it on the server-side code execution by defining sensors for methods that are processing the individual data parts of the POST BODY

Andi

avatar image

Answer by Ryan C. · Nov 24, 2011 at 04:27 AM

Wildcard each of those choices. Then make sure you are looking at the details of a PurePath that is a POST request, not a GET request. When I first tried to figure this out myself, I was confused because it seemed like it worked for some PurePaths and not for others. Then I noticed (duh!) that some PP's were for GETs (thus no POST data).

Comment

People who like this

0 Show 0 · Share
10 |2000000 characters needed characters left characters exceeded
  • Viewable by all users
  • Viewable by moderators
  • Viewable by moderators and the original poster
  • Advanced visibility
Toggle Comment visibility. Current Visibility: Viewable by all users

Up to 10 attachments (including images) can be used with a maximum of 50.0 MiB each and 250.0 MiB total.

avatar image

Answer by Rafael M. · Nov 24, 2011 at 03:10 AM

Hi guys,

I did set the servlet configuration, but I am getting only the header... I am not seeing any payload information.
PS.: When I setted it, there were only four choices: Request Parameter, Request Attribute, Session Attribute and Request Header. Should I have more options?

tks

Comment

People who like this

0 Show 1 · Share
10 |2000000 characters needed characters left characters exceeded
  • Viewable by all users
  • Viewable by moderators
  • Viewable by moderators and the original poster
  • Advanced visibility
Toggle Comment visibility. Current Visibility: Viewable by all users

Up to 10 attachments (including images) can be used with a maximum of 50.0 MiB each and 250.0 MiB total.

avatar image Andreas G. ♦ · Nov 24, 2011 at 02:21 PM 0
Share

Check the description in Sensor Properties for more information on the ASP.NET and Servlet Sensor Configuration Options

avatar image

Answer by Rafael M. · Nov 23, 2011 at 06:21 PM

Hi guys,

Thank you very much for answers!

But, I got another issue... I do not know if would be the best way to create another topic...

So, I need to do that in the web service agent (Apache one) to handle the these requests, but when I do the Hot Sensor Placement dT comes with that msg:

Performing Hot Sensor Placement on the agent 'agent_name:port' can lead to spurious crashes. Are you sure to perform a Hot Sensor Placement for this agent?

Is it a problem?

Comment

People who like this

0 Show 4 · Share
10 |2000000 characters needed characters left characters exceeded
  • Viewable by all users
  • Viewable by moderators
  • Viewable by moderators and the original poster
  • Advanced visibility
Toggle Comment visibility. Current Visibility: Viewable by all users

Up to 10 attachments (including images) can be used with a maximum of 50.0 MiB each and 250.0 MiB total.

avatar image Andreas G. ♦ · Nov 23, 2011 at 06:34 PM 0
Share

Hi Rafael

The Web Server Agent actually doesnt allow a Hot Sensor Placement. Is it possible you try this on your Application Server that also plays web server?
As this is a different topic feel free to create a new discussion topic on this - and - if you have more details on why you want to do a hotsensorplacement on your web server please let us know

Andi

avatar image Rafael M. Andreas G. ♦ · Nov 23, 2011 at 06:52 PM 0
Share

Hi Andreas,

I wanted it because the apache is the frontend of the application, but even when I try to do it in the agents placed in the weblogic I get the same error.

Have you seen it before? Is it possible dT crashes the server?

avatar image Andreas G. ♦ Rafael M. · Nov 23, 2011 at 07:13 PM 0
Share

I talked with the engineers.
This is a warning message we show on JRockit VMs only. The guys from JRockit told us that Hot Sensor Placement works - but - that there might be problems due to the JRockit Implementation.
In general there should be no problem. We placed this warning message just to let you know that there could be a problem.

Two items
a) I asked our engineers to make this warning message more descriptive
b) The advice from our engineers is that you can definitly do a Hot Sensor Placement in Pre-Prod. But be careful or ommit in Production Environments

Andi

avatar image Rafael M. Andreas G. ♦ · Nov 23, 2011 at 08:55 PM 0
Share

Thanks at lot Andi!

I will do it and get back to you with the results.

avatar image

Answer by Ryan C. · Nov 23, 2011 at 01:23 AM

Edit the servlet/ASP.NET sensor configuration in your system profile for the appropriate agent group. There is a table that allows you to specify which parameters you want to capture. You can use an asterisk to wildcard. There are different types of sources: cookies, headers, etc. You want "parameters" as your source. Be aware that it's not advised to wildard where you end up capturing all parms/values for all pages in a busy production environment. 

I have small environment for testing and with the wildcarding, I capture all POST fields and their values in my PurePaths.

To see the captured values, right-click on the first method (web GET/POST entry point) in your PurePath and select details.

Comment

People who like this

0 Show 2 · Share
10 |2000000 characters needed characters left characters exceeded
  • Viewable by all users
  • Viewable by moderators
  • Viewable by moderators and the original poster
  • Advanced visibility
Toggle Comment visibility. Current Visibility: Viewable by all users

Up to 10 attachments (including images) can be used with a maximum of 50.0 MiB each and 250.0 MiB total.

avatar image Andreas G. ♦ · Nov 23, 2011 at 04:01 AM 0
Share

Ryan is right. I thought you need the response payload - thats why I told you to use the Browser Agent. For request parameters you should use the capture option we have for Servlet and ASP.NET

avatar image Jalpesh S. Andreas G. ♦ · Aug 28, 2015 at 07:23 AM 0
Share

Hi Andi,

We don't have Browser Agent .

Can we capture Request Payload data in Purepath without Browser Agent?

Please find attached snapshot.

request-payload.jpg

Regards,

Jalpesh Shelar

request-payload.jpg (156.3 KiB)
avatar image

Answer by Ryan C. · Nov 23, 2011 at 12:40 AM

What exactly are you trying to see? You can capture quite a bit of information about the HTTP requests, including the headers, POST'ed data, cookies, etc. But this is for the incoming HTTP requests only.

Comment

People who like this

0 Show 1 · Share
10 |2000000 characters needed characters left characters exceeded
  • Viewable by all users
  • Viewable by moderators
  • Viewable by moderators and the original poster
  • Advanced visibility
Toggle Comment visibility. Current Visibility: Viewable by all users

Up to 10 attachments (including images) can be used with a maximum of 50.0 MiB each and 250.0 MiB total.

avatar image Rafael M. · Nov 23, 2011 at 12:51 AM 0
Share

Hi,

Thanks Andreas. I will try to use the browser agent.

Ryan,

I want to see a specific parameter that comes in payload via POST method.

avatar image

Answer by Andreas G. · Nov 22, 2011 at 11:28 PM

Hi

The payload itself can only be captured using the dynaTrace Browser Agent. The Browser Agent is a browser add-on for IE and FF and captures Network Traffic (Headers + Body), JavaScript Execution, DOM Access and REndering Activity. It is comparable with the dynaTrace AJAX Edition whereas it provides specific additional features for cross browser testing, comparison and test automation. So - capturing Headers and Body Payload works with the Browser Agent and is suited for Pre-Production (Test, Dev, CI) environments

For production environments we can capture the response length - but do not right now capture the actual content. To capture response length you need to enable the "Capture Response Size" in the Servlet or ASP.NET Sensor Properties

Hope this helps

Comment

People who like this

0 Show 0 · Share
10 |2000000 characters needed characters left characters exceeded
  • Viewable by all users
  • Viewable by moderators
  • Viewable by moderators and the original poster
  • Advanced visibility
Toggle Comment visibility. Current Visibility: Viewable by all users

Up to 10 attachments (including images) can be used with a maximum of 50.0 MiB each and 250.0 MiB total.

How to get started

First steps in the forum
Read Community User Guide
Best practices of using forum

NAM 2019 SP5 is available


Check the RHEL support added in the latest NAM service pack.

Learn more

LIVE WEBINAR

"Performance Clinic - Monitoring as a Self Service with Dynatrace"


JANUARY 15, 3:00 PM GMT / 10:00 AM ET

Register here

Follow this Question

Answers Answers and Comments

3 People are following this question.

avatar image avatar image avatar image

Forum Tags

dotnet mobile monitoring load iis 6.5 kubernetes mainframe rest api dashboard framework 7.0 appmon 7 health monitoring adk log monitoring services auto-detection uem webserver test automation license web performance monitoring ios nam probe collector migration mq web services knowledge sharing reports window java hybris javascript appmon sensors good to know extensions search 6.3+ server documentation easytravel web dashboard kibana system profile purelytics docker splunk 6.1 process groups account 7.2 rest dynatrace saas spa guardian appmon administration production user actions postgresql upgrade oneagent measures security Dynatrace Managed transactionflow technologies diagnostics user session monitoring unique users continuous delivery sharing configuration alerting NGINX splitting business transaction client 6.3 installation database scheduler apache mobileapp RUM php dashlet azure purepath agent 7.1 appmonsaas messagebroker nodejs 6.2 android sensor performance warehouse
  • Forums
  • Public Forums
    • Community Connect
    • Dynatrace
      • Dynatrace Open Q&A
    • Application Monitoring & UEM
      • AppMon & UEM Open Q&A
    • Network Application Monitoring
      • NAM Open Q&A