question

Andrey R. avatar image
Andrey R. asked ·

Dynatrace/Appmon template for elasticsearch 7.x

Hi Guys,

After I upgraded our ELK environment to version 7 all data/index from dynatrace/appmon appears on elastic but dont process anything (search), follows errors when I tried to 're-put' a template v6

(https://assets.dynatrace.com/global/doc/appmon/integrations-and-extensions/realtime-streaming/purelytics-stream/dynamic_template_version_6.txt?_ga=2.206982107.932496147.1557772246-1497824236.1557772246 )

My appmon is 7.1 ans elastic 7.x

Regards,

{
  "error": {
    "root_cause": [
      {
        "type": "mapper_parsing_exception",
        "reason": "Root mapping definition has unsupported parameters:  [document : {dynamic_templates=[{strings={mapping={type=keyword}, match_mapping_type=string}}], properties={data={properties={agentId={type=long}, clientDetails={properties={gpsCoordinates={type=geo_point}}}, resourceReport={properties={thirdParty={properties={domains={type=nested}}}, cdn={properties={domains={type=nested}}}}}, visitId={type=long}, tagId={type=long}, startTime={type=date}, endTime={type=date}}}, serverName={type=keyword}}}]"
      }
    ],
    "type": "mapper_parsing_exception",
    "reason": "Failed to parse mapping [_doc]: Root mapping definition has unsupported parameters:  [document : {dynamic_templates=[{strings={mapping={type=keyword}, match_mapping_type=string}}], properties={data={properties={agentId={type=long}, clientDetails={properties={gpsCoordinates={type=geo_point}}}, resourceReport={properties={thirdParty={properties={domains={type=nested}}}, cdn={properties={domains={type=nested}}}}}, visitId={type=long}, tagId={type=long}, startTime={type=date}, endTime={type=date}}}, serverName={type=keyword}}}]",
    "caused_by": {
      "type": "mapper_parsing_exception",
      "reason": "Root mapping definition has unsupported parameters:  [document : {dynamic_templates=[{strings={mapping={type=keyword}, match_mapping_type=string}}], properties={data={properties={agentId={type=long}, clientDetails={properties={gpsCoordinates={type=geo_point}}}, resourceReport={properties={thirdParty={properties={domains={type=nested}}}, cdn={properties={domains={type=nested}}}}}, visitId={type=long}, tagId={type=long}, startTime={type=date}, endTime={type=date}}}, serverName={type=keyword}}}]"
    }
  },
  "status": 400
}

appmon7.1purelytics
10 |2000000 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 50.0 MiB each and 250.0 MiB total.

Andrey R. avatar image
Andrey R. answered ·

Solution:

PUT index?include_type_name=true

Share
10 |2000000 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 50.0 MiB each and 250.0 MiB total.

Andrey R. avatar image
Andrey R. answered ·

Hi Guys,

I recreated a template and when I put it to elasticsearch 7.x I received "Ack ... true" (without errors), but timestamp (date format) for DataStartTime does not work yet.


Someone have a good idea?


Follows:

PUT _template/dynatrace
{
  "index_patterns": 
  "dt_*",
    "settings": {
     "codec" : "best_compression",
     "number_of_shards" : "4",
     "number_of_replicas" : "0"
  },
  "mappings": {
      "dynamic_templates" : [
           {
              "strings_as_keywords": {
                 "match_mapping_type": "string",
                 "mapping": {
                    "type": "keyword"
                 }
              } 
           }
        ],
        "properties": {
           "serverName": {
              "type": "keyword"
           },
           "data": {
              "properties": {
                 "startTime": {
                    "type": "date",
                    "format" : "date_time"
                 },
                 "endTime": {
                    "type": "date",
                    "format" : "date_time"
                 },
                 "visitId": {
                     "type": "long"
                 },
                 "tagId": {
                     "type": "long"
                 },
                 "agentId": {
                     "type": "long"
                 },
                 "clientDetails": {
                    "properties" : {
                      "gpsCoordinates" : {
                        "type" : "geo_point"
                      }
                    }
                 },
                 "resourceReport": {
                   "properties" : {
                     "cdn" : {
                       "properties": {
                         "domains": {
                           "type": "nested"
                         }
                       }
                     },
                     "thirdParty" : {
                       "properties": {
                         "domains": {
                           "type": "nested"
                         }
                       }
                     }
                   }
                 }
              }
           }
        }
     },
  "aliases": {}
}

Share
10 |2000000 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 50.0 MiB each and 250.0 MiB total.