Splunk / Big Data business transaction bridge integration with dynatrace
Hi Team,
We require to generate reports of visits & user actions for analysis purposes. Found this can be possible with
1) Splunk ( https://community.compuwareapm.com/community/display/DL/Splunk+Application ) And / Or
2) Big data business transaction bridge & hive ( https://community.compuwareapm.com/community/display/DL/Big+Data+Business+Transaction+Bridge )
However had a question as both the options provide to export only business transactions but we want to export a report of all visits and user actions ( daily , week based , month based ). Pulling a day's data from the dynatrace client is just fine but we face difficulties exporting visits and user actions of more than a week or higher and hence trying to evaluate the above two solutions.
Can someone please guide us as to how to export the visits and actions and not transactions via splunk / business transaction bridge.
Also we are using a trial version of splunk and since splunk captures transaction data as well, is there a way to prevent the transaction data being indexed in splunk.
Regards,
Narendra Patel
Big Data Business Transaction Bridge
Hi,
Also wanted to ask if the exported visits / user actions will contain all fields similar to ones we find in visits ( from diagnose user experience ). Start time , end time , browser version , region and client ip are some of the fields that we use.
Did try to create the above suggested BT ( albeit still now only in dynatrace not yet exporting to splunk ) but it gives me only 4 fields which are not similar to the one found in visits.
Also it does not give me any data. Would we require to add any measures or so to the BT as well to capture visits. Also no measures exists for some fields like start time , end time, etc.
Regards,
Narendra Patel
When you do the export, each visit is streamed out with its information in JSON format, by default. Here are the fields:
create external table BT_VISIT (
Name STRING,
Application STRING,
VisitId BIGINT,
StartTime TIMESTAMP,
EndTime TIMESTAMP,
Dimensions MAP<STRING, STRING>,
Values MAP<STRING, DOUBLE>,
User STRING,
Converted BOOLEAN,
Apdex DOUBLE
) |
|---|
StartTime and EndTime get added automatically as Epoch Time stamps. The Dimensions Map object contains the splittings of the Business Transaction for that Visit, and the Values Map object contains the measures you add to the "calculate results" field.
In my experience this is not a lot of data (1KB per Visit roughly), but you can use Filter measures in the Business Transaction to try this on a small subset of your Visits before increasing your visibility.
Rick B
Hi Klaus.
Thank you for your reply.
By indexing i meant that we are evaluating the splunk on a trial license and it has a limit of 500 MB of indexing ( http://www.splunk.com/view/SP-CAAAE8W ).
If we cross that limit 5 times then the search functionality will be disabled for splunk for 30 days.
Since we are generating huge amounts of session files for every day, just wanted to export only the visits and the user actions to splunk which we can then use to prepare reports in splunk and not any other data as it can lead to exhaustion of the 500 MB threshold.
Regards,
Narendra Patel
Hi,
For exporting User actions and Visits you have to define a User Action or Visit based BT. Just set during the creation of the BT the check for "Export results via HTTP and select "Calculate Business Transaction per" User Action or Visit. The rest is the same as for the PurePath based BTs.
What is confusing me is your last statement about the indexing? Could you give me a bit more details around that?
Cheers Klaus
