question

Carlos S. avatar image
Carlos S. asked ·

PureLytics and Kibana

Hi,

I'm trying to test the PureLytics, ElasticSearch and Kibana integration and visualization.

However, have some issues on the index creation, despite the documentation, would you have any sample index created for i.e. UEM or UEM actions?

I've tried data.startTime and dt_2016 etc...but it does not match anything so far.

configurationdashboardpluginsuem6.3
index.png (56.7 KiB)
10 |2000000 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 50.0 MiB each and 250.0 MiB total.

Dave M. avatar image
Dave M. answered ·

I use dt* for my index. If you look in your elasiticsearch directory under "indices", you should see the dt* index(es) if any exist. Here is an example path:

C:\tools\elasticsearch-2.3.1\data\elasticsearch\nodes\0\indices

Did you set the Purelytics Streaming in Server Settings and perform a "Test Connection" there?

Did you enable the Purelytics Stream flag at the System Profile level under the General section?

HTH,

dave

Share
10 |2000000 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 50.0 MiB each and 250.0 MiB total.

Richard D. avatar image
Richard D. answered ·

Hi all - I got the exact same issues as everyone here. if you are using windows and cURL for cmd, there are some extra intricacies needed to make this work.

1. Working ES instance - e.g. http://localhost:9200

2. *FIRST* Apply Dynamic Template located from this post

https://community.dynatrace.com/community/pages/viewpage.action?spaceKey=DOCDT63&title=PureLytics+Stream&focusedCommentId=241566071

Dynamic Template -

https://community.dynatrace.com/community/download/attachments/215160834/dynamic_template.txt?version=2&modificationDate=1455701735027≈i=v2

3. From a Mac\Linux the command will look like this

curl -X PUT 'http://localhost:9200/_template/dynatrace' -d '{"order": 0, "template": "dt_*", ...}'

3.5 From a Windows console, command will look like this: - note do not include single quotes nor carriage returns. Also all inner double quotes need the \ escape.

curl -X PUT http://localhost:9200/_template/dynatrace -d "{\"order\": 0, \"template\": \"dt_*\", ...}"

4. The time-field drop down should not have date.startTime available from Kibana

Share
10 |2000000 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 50.0 MiB each and 250.0 MiB total.

Carlos S. avatar image
Carlos S. answered ·

Just a sample dashboard (BTW, design is not my thing...)


sample-dash.png (117.3 KiB)
2 comments Share
10 |2000000 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 50.0 MiB each and 250.0 MiB total.

If you want to arrange a dashboard exchange, I would love to get a copy of this one....my email is dave.mauney@dynatrace.com. If you send me an email, I will let you know what I can offer in return....I have on my to do list to design a few dashboards for kibana but have not even started yet...pulled in other directions so far...I wonder if sharing dashboards is easy with kibana...

0 Likes 0 · ·

Absolutely Dave, I'll love to come up with more meaningful dashboards, let's get started and exchange them. I'll send you an e-mail. Thanks!

0 Likes 0 · ·
Carlos S. avatar image
Carlos S. answered ·

Working like a charm Dave, there is a "tricky uncheck box" for indexes under Kibana (at least tricky for me...) thanks!

Share
10 |2000000 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 50.0 MiB each and 250.0 MiB total.

Babar Q. avatar image
Babar Q. answered ·

Hello @Carlos A. Garcia S.

I am struggling to understand the whole process. I have done with the prerequisite e.g. enabled the PureLytics Stream for the real time streaming on the System Profile level.

Realtime Streaming configuration is also done and I used the master node URL for the connection. I am lucky to get the following after run the dynamic template version 6:

{
  "acknowledged": true
}

In the Timelion below error appears which go away in case I create any index manually.

Timelion: Error: in cell #1: Elasticsearch index not found: _all

I am not able to create index pattern with the "dt_*" or dt_ or dt* etc...

I can see the below information in the Elasticsearch Connector with the errors for the frontend and backend but I don't know where is this data going.

Looking forward for your assistance to make a proper setup.

Regards,

Babar


Share
10 |2000000 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 50.0 MiB each and 250.0 MiB total.

Babar Q. avatar image
Babar Q. answered ·

Dear All,

First time going to work on the Elasticsearch, therefore, I wanted to ask a silly question.

If we have a 3 nodes cluster (1 x Master and 2 x Data Nodes) then what will be the URL in the Realtime Streaming configuration?

Regards,

Babar

Share
10 |2000000 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 50.0 MiB each and 250.0 MiB total.

Shalabh S. avatar image
Shalabh S. answered ·

I am also facing same issue as @Zohaib Ul H. I tried in Kibana 6.1.2 using the dynamic template https://community.dynatrace.com/community/download...

But getting below error from dev tool section (in Kibana).

"type": "illegal_argument_exception", "reason": "Rejecting mapping update to [7gzEQxRUQ4Sfange2mvovQ] as the final mapping would have more than 1 type: [clienterror, useraction, visit]"

2 comments Share
10 |2000000 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 50.0 MiB each and 250.0 MiB total.

Hi Shalabh,

i was facing the same problem a moment ago. I had to use version 5.3.1 for ES and Kibana.

there is a incompatibility problem with dynamic template and version 6.x

best regards,

Patricio

0 Likes 0 · ·

Thanks @Patricio B. I will try out this.

0 Likes 0 · ·
Zohaib H. avatar image
Zohaib H. answered ·

2017-12-12-14-07-33-postman.pngI'm trying to add dynamic template but getting errors of illegal parameter. I'm using this template https://community.dynatrace.com/community/download...

Any reccomendations?


1 comment Share
10 |2000000 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 50.0 MiB each and 250.0 MiB total.

Renato P. avatar image
Renato P. answered ·

I have tried "test connection" on port 9200 and dynatrace returns an error.

It is fun, because on the same server I have kibana, and dynatrace connects to 5601 port.

any thoughs?

1 comment Share
10 |2000000 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 50.0 MiB each and 250.0 MiB total.

Forget it.

you have to set bind host ip variable to communicate.

network.bind_host: 0.0.0.0
0 Likes 0 · ·
Carlos S. avatar image
Carlos S. answered ·

Hi Kristof, exactly I had the same "issue", that isn't explained anywhere but solves the initial symptom.

Regarding time field, which particular/s field/s are you looking for? Just in case I see those on my set up.

Bests, Carlos.

1 comment Share
10 |2000000 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 50.0 MiB each and 250.0 MiB total.

Hi Carlos, there are sample data sets in the documentation, and there it also became apparent that it is just not added. If you want to use it in your data searches, you can always use data.startTime.

0 Likes 0 · ·