• Forums
    • Public Forums
      • Community Connect
      • Dynatrace
        • Dynatrace Open Q&A
      • Application Monitoring & UEM
        • AppMon & UEM Open Q&A
      • Network Application Monitoring
        • NAM Open Q&A
  • Home /
  • Public Forums /
  • Application Monitoring & UEM /
  • AppMon & UEM Open Q&A /
avatar image
Question by narendra p. · Aug 19, 2014 at 04:42 AM ·

Splunk / Big Data business transaction bridge integration with dynatrace

Hi Team,

We require to generate reports of visits & user actions for analysis purposes. Found this can be possible with

1) Splunk ( https://community.compuwareapm.com/community/display/DL/Splunk+Application )               And / Or

2) Big data business transaction bridge & hive ( https://community.compuwareapm.com/community/display/DL/Big+Data+Business+Transaction+Bridge )

However had a question as both the options provide to export only business transactions but we want to export a report of all visits and user actions ( daily , week based , month based ). Pulling a day's data from the dynatrace client is just fine but we face difficulties exporting visits and user actions of more than a week or higher and hence trying to evaluate the above two solutions.

Can someone please guide us as to how to export the visits and actions and not transactions via splunk / business transaction bridge.

Also we are using a trial version of splunk and since splunk captures transaction data as well, is there a way to prevent the transaction data being indexed in splunk.

Regards,

Narendra Patel

Big Data Business Transaction Bridge

Comment

People who like this

0 Show 0
10 |2000000 characters needed characters left characters exceeded
  • Viewable by all users
  • Viewable by moderators
  • Viewable by moderators and the original poster
  • Advanced visibility
Toggle Comment visibility. Current Visibility: Viewable by all users

Up to 10 attachments (including images) can be used with a maximum of 50.0 MiB each and 250.0 MiB total.

3 Replies

  • Sort: 
  • Most voted
  • Newest
  • Oldest
avatar image

Answer by narendra p. · Aug 20, 2014 at 01:10 AM

Hi,

Also wanted to ask if the exported visits / user actions will contain all fields similar to ones we find in visits ( from diagnose user experience ). Start time , end time , browser version , region and client ip are some of the fields that we use.

Did try to create the above suggested BT ( albeit still now only in dynatrace not yet exporting to splunk ) but it gives me only 4 fields which are not similar to the one found in visits.

Also it does not give me any data. Would we require to add any measures or so to the BT as well to capture visits. Also no measures exists for some fields like start time , end time, etc.

Regards,

Narendra Patel

 

Comment

People who like this

0 Show 1 · Share
10 |2000000 characters needed characters left characters exceeded
  • Viewable by all users
  • Viewable by moderators
  • Viewable by moderators and the original poster
  • Advanced visibility
Toggle Comment visibility. Current Visibility: Viewable by all users

Up to 10 attachments (including images) can be used with a maximum of 50.0 MiB each and 250.0 MiB total.

avatar image Rick B. · Aug 20, 2014 at 01:33 AM 0
Share

When you do the export, each visit is streamed out with its information in JSON format, by default.  Here are the fields:

create external table BT_VISIT (
    Name STRING,
    Application STRING,
    VisitId BIGINT,
    StartTime TIMESTAMP,
    EndTime TIMESTAMP,
    Dimensions MAP<STRING, STRING>,
    Values MAP<STRING, DOUBLE>,
    User STRING,
    Converted BOOLEAN,
    Apdex DOUBLE
)

StartTime and EndTime get added automatically as Epoch Time stamps.  The Dimensions Map object contains the splittings of the Business Transaction for that Visit, and the Values Map object contains the measures you add to the "calculate results" field.

In my experience this is not a lot of data (1KB per Visit roughly), but you can use Filter measures in the Business Transaction to try this on a small subset of your Visits before increasing your visibility.

Rick B

avatar image

Answer by narendra p. · Aug 20, 2014 at 12:16 AM

Hi Klaus.

Thank you for your reply.

By indexing i meant that we are evaluating the splunk on a trial license and it has a limit of 500 MB of indexing ( http://www.splunk.com/view/SP-CAAAE8W ).
If we cross that limit 5 times then the search functionality will be disabled for splunk for 30 days.

Since we are generating huge amounts of session files for every day, just wanted to export only the visits and the user actions to splunk which we can then use to prepare reports in splunk and not any other data as it can lead to exhaustion of the 500 MB threshold.

Regards,

Narendra Patel



Comment

People who like this

0 Show 0 · Share
10 |2000000 characters needed characters left characters exceeded
  • Viewable by all users
  • Viewable by moderators
  • Viewable by moderators and the original poster
  • Advanced visibility
Toggle Comment visibility. Current Visibility: Viewable by all users

Up to 10 attachments (including images) can be used with a maximum of 50.0 MiB each and 250.0 MiB total.

avatar image

Answer by Klaus E. · Aug 19, 2014 at 06:21 PM

Hi,

For exporting User actions and Visits you have to define a User Action or Visit based BT. Just set during the creation of the BT the check for "Export results via HTTP and select "Calculate Business Transaction per" User Action or Visit. The rest is the same as for the PurePath based BTs.

What is confusing me is your last statement about the indexing? Could you give me a bit more details around that?

Cheers Klaus

Comment

People who like this

0 Show 0 · Share
10 |2000000 characters needed characters left characters exceeded
  • Viewable by all users
  • Viewable by moderators
  • Viewable by moderators and the original poster
  • Advanced visibility
Toggle Comment visibility. Current Visibility: Viewable by all users

Up to 10 attachments (including images) can be used with a maximum of 50.0 MiB each and 250.0 MiB total.

How to get started

First steps in the forum
Read Community User Guide
Best practices of using forum

NAM 2019 SP5 is available


Check the RHEL support added in the latest NAM service pack.

Learn more

LIVE WEBINAR

"Performance Clinic - Monitoring as a Self Service with Dynatrace"


JANUARY 15, 3:00 PM GMT / 10:00 AM ET

Register here

Follow this Question

Answers Answers and Comments

3 People are following this question.

avatar image avatar image avatar image

Forum Tags

dotnet mobile monitoring load iis 6.5 kubernetes mainframe rest api dashboard framework 7.0 appmon 7 health monitoring adk log monitoring services auto-detection uem webserver test automation license web performance monitoring ios nam probe collector migration mq web services knowledge sharing reports window java hybris javascript appmon sensors good to know extensions search 6.3+ server documentation easytravel web dashboard kibana system profile purelytics docker splunk 6.1 process groups account 7.2 rest dynatrace saas spa guardian appmon administration production user actions postgresql upgrade oneagent measures security Dynatrace Managed transactionflow technologies diagnostics user session monitoring unique users continuous delivery sharing configuration alerting NGINX splitting business transaction client 6.3 installation database scheduler apache mobileapp RUM php dashlet azure purepath agent 7.1 appmonsaas messagebroker nodejs 6.2 android sensor performance warehouse
  • Forums
  • Public Forums
    • Community Connect
    • Dynatrace
      • Dynatrace Open Q&A
    • Application Monitoring & UEM
      • AppMon & UEM Open Q&A
    • Network Application Monitoring
      • NAM Open Q&A