Manage export configurations
You can export universe metrics and logs to third-party tools for analysis and customization.
To export either metrics or logs from a universe:
-
Create an export configuration for the integration you want to use. A configuration defines the sign in credentials and settings for the tool that you want to export to.
-
Using the configuration you created, connect your cluster.
While the connection is active, metrics or logs are automatically streamed to the tool.
To be able to export logs from Kubernetes universes, ensure the OpenTelemetry Operator is installed. Refer to OpenTelemetry Operator for Kubernetes in the OpenTelemetry documentation. Metrics export is not supported on Kubernetes.
Available integrations
Currently, you can export data to the following tools:
| Integration | Log export | Metric export |
|---|---|---|
| Datadog | Database audit logs | Yes |
| Splunk | Database audit logs | |
| AWS CloudWatch | Database audit logs | |
| Google Cloud Logging | Database audit logs | |
| Dynatrace | Yes |
Best practices
To limit performance impact and control costs, locate export configurations in a region close to your universe(s).
Manage integrations
Create and manage export configurations on the Integrations > Logs and Metrics Export page.
The page lists the configured third-party integrations.
To view details for a configuration, select it in the list.
To delete a configuration, click the three dots, and choose Delete configuration. You can't delete a configuration that is assigned to a universe.
Note that you can't modify an existing configuration. If you need to change an configuration (for example, to replace or update an API key) for a particular tool, do the following:
- Create a new configuration for the integration with the updated information.
- Assign the new configuration to your universes.
- Unassign the old configuration from universes.
- Delete the old configuration.
Configure integrations
You can add and delete export configurations for the following tools. You can't delete a configuration that is in use by a universe.
Datadog
The Datadog export configuration requires the following:
- Datadog account
- Datadog API key
To create an export configuration, do the following:
- On the Integrations page, on the Log & Metrics Export tab, click Add Configuration.
- Enter a name for the configuration.
- Choose Datadog.
- Enter your Datadog API key.
- Choose the Datadog site to connect to, or choose Self-hosted and enter your URL.
- Click Create Configuration.
Splunk
The Splunk export configuration requires the following:
- Splunk access token
- Endpoint URL
To create an export configuration, do the following:
- On the Integrations page, on the Log & Metrics Export tab, click Add Configuration.
- Enter a name for the configuration.
- Choose Splunk.
- Enter your Splunk Access token.
- Enter the Endpoint URL.
- Optionally, enter the Source, Source Type, and Index.
- Click Validate and Create Configuration.
AWS
The AWS CloudWatch export configuration requires the following:
- Access Key ID and Secret Access Key for the AWS Service Account
- The log group and log stream
- The AWS region where the stream is located
To create an export configuration, do the following:
- On the Integrations page, on the Log & Metrics Export tab, click Add Configuration.
- Enter a name for the configuration.
- Choose AWS CloudWatch.
- Enter your access key and secret access key.
- Enter the Log group and Log stream.
- Enter the region.
- Optionally, provide the ARN for the role.
- Optionally, provide an endpoint URL.
- Click Validate and Create Configuration.
Google Cloud Logging
The Google Cloud Logging export configuration requires the following:
- Google Service Account with the
roles/logging.logWriterrole. - The Service Account credentials JSON key. The credentials should be scoped to the project where the log group is located.
To create an export configuration, do the following:
- On the Integrations page, on the Log & Metrics Export tab, click Add Configuration.
- Enter a name for the configuration.
- Choose GCP Cloud Logging.
- Optionally, provide the project name.
- Upload the JSON file containing your Google Cloud credentials.
- Click Validate and Create Configuration.
Dynatrace
The Dynatrace integration requires the following:
- Publically-accessible endpoint URL of your Dynatrace instance. The endpoint URL is the URL of your Dynatrace instance.
- Dynatrace Access Token. The access token needs to have ingest metrics, ingest logs, ingest OpenTelemetry traces, and read API tokens scope.
To create an export configuration, do the following:
- On the Integrations page, on the Log & Metrics Export tab, click Add Configuration.
- Enter a name for the configuration.
- Choose Dynatrace.
- Enter the Dynatrace Endpoint URL.
- Enter your Dynatrace Access Token.
- Click Validate and Create Configuration.