Kubernetes events integration

The New Relic Kubernetes events integration watches for events happening in your Kubernetes clusters and sends those events to New Relic. To visualize your event data, use the Kubernetes cluster explorer in New Relic One platform, or use the infrastructure events UI.

Installation

The Kubernetes Events integraiton is installed by default both when using our Guided Install, or when installing through Helm.

View your Kubernetes events

Once you have successfully installed the Kubernetes event integration, you can view and query your events in New Relic.

To add events to your New Relic One dashboard:

1. Add a chart to a new or existing dashboard or create a chart using the New Relic query builder.

2. When creating or updating your chart, select the chart type table and use the following event query, replacing YOUR_CLUSTER_NAME with the name of your cluster:

   FROM InfrastructureEvent SELECT
   event.involvedObject.kind,event.involvedObject.name,event.reason,event.message
   WHERE clusterName = 'YOUR_CLUSTER_NAME' limit 100

   Copy

Query events

Here are a few examples to query your data:

Get attributes names

To see all the attributes names, use the following query:

FROM InfrastructureEvent SELECT keyset() WHERE category = 'kubernetes'

See event details

To see details about the latest events in a cluster, use the following query, replacing YOUR_CLUSTER_NAME with the name of your cluster:

FROM InfrastructureEvent SELECT event.involvedObject.kind,
event.involvedObject.name, event.type, event.message, event.reason WHERE
category = 'kubernetes' AND clusterName='YOUR_CLUSTER_NAME'​

The events collected by New Relic will have the exact same attributes as given by Kubernetes. For a reference of these attributes, see the Kubernetes event v1 core documentation.

Search events in New Relic

To search events in the New Relic Infrastructure UI:

1. Navigate to the Infrastructure event page: Go to one.newrelic.com > Infrastructure > Events.
2. In Category, select kubernetes.
3. Use the Search events field to look for specific events. To focus on a specific set of events, select or change the filter set.

View events in the Kubernetes cluster explorer

To view events in the Kubernetes cluster explorer, use either of these methods:

• In New Relic One: Go to one.newrelic.com > Kubernetes cluster explorer.

Then, to view the pod details:

1. In the Kubernetes cluster explorer, select a pod.
2. Select Show pod events.

Optional: Collect metrics of the event collector

To collect metric data for the event collector itself, install the New Relic Prometheus OpenMetrics integration. To get started:

1. Install the New Relic Prometheus OpenMetrics integration.
2. Label the deployment of your Kubernetes events integration with your configured scrape label (default is prometheus.io/scrape=true).

Optional: Define custom attributes

To add custom attributes to the events sent by the integration these need to be specified as environment variables following the nomenclature NRI_KUBE_EVENTS_attributeKey=attributeValue. These environment variables should be defined as part of the spec for the kube-events container.

For example, to add the attribute environment with value staging to all the events, add the following to your manifest:

env:
  - name: NRI_KUBE_EVENTS_environment
    value: dev

Be sure to specify the environment in the spec for the kube-events container, making your manifest look something like this:

...
kind: Deployment
...
spec:
  ...
  template:
    ...
    spec:
      containers:
        - name: kube-events
          ...
          env:
            - name: NRI_KUBE_EVENTS_environment
              value: dev

Troubleshooting

Here are some troubleshooting tips when using the Kubernetes events integration.

kubectl logs deploy/nr-kube-events kube-events

kubectl logs deploy/nr-kube-events infra-agent