make test TEST_NAME=^Test_Helm_Routing_OT$ KIND_NODE_IMAGE="kindest/node:v1.32.0@sha256:c48c62eac5da28cdadcf560d1d8616cfa6783b58f0d94cf63ad1bf49600cb027"
KIND_NODE_IMAGE=kindest/node:v1.32.0@sha256:c48c62eac5da28cdadcf560d1d8616cfa6783b58f0d94cf63ad1bf49600cb027 \
		go test -timeout 60m -v -count 1 -tags=allversions,onlylatest -run=^Test_Helm_Routing_OT . -args 
2025/11/13 10:02:32 Successfully read kind images spec
2025/11/13 10:02:32 Default kind image: kindest/node:v1.32.0@sha256:c48c62eac5da28cdadcf560d1d8616cfa6783b58f0d94cf63ad1bf49600cb027
2025/11/13 10:02:32 Supported kind images: [kindest/node:v1.32.0@sha256:c48c62eac5da28cdadcf560d1d8616cfa6783b58f0d94cf63ad1bf49600cb027 kindest/node:v1.29.0@sha256:eaa1450915475849a73a9227b8f201df25e55e268e5d619312131292e324d570 kindest/node:v1.28.0@sha256:b7a4cad12c197af3ba43202d3efe03246b3f0793f162afb40a33c923952d5b31 kindest/node:v1.27.3@sha256:3966ac761ae0136263ffdb6cfd4db23ef8a83cba8a463690e98317add2c9ba72 kindest/node:v1.26.6@sha256:6e2d8b28a5b601defe327b98bd1c2d1930b49e5d8c512e1895099e4504007adb kindest/node:v1.25.11@sha256:227fa11ce74ea76a0474eeefb84cb75d8dad1b08638371ecf0e86259b35be0c8]
2025/11/13 10:02:32 Couldn't find image archive file , proceeding without it
=== RUN   Test_Helm_Routing_OT
Test_Helm_Routing_OT 2025-11-13T10:02:55+01:00 logger.go:67: Configuring Kubernetes client using config file /Users/antonio.zamorano/.kube/config with context 
Test_Helm_Routing_OT 2025-11-13T10:02:55+01:00 logger.go:67: Running command helm with args [version --namespace test-helm-routing-ot-147]
Test_Helm_Routing_OT 2025-11-13T10:02:55+01:00 logger.go:67: version.BuildInfo{Version:"v3.9.2", GitCommit:"1addefbfe665c350f4daf868a9adc5600cc064fd", GitTreeState:"clean", GoVersion:"go1.18.4"}
Test_Helm_Routing_OT 2025-11-13T10:02:55+01:00 logger.go:67: Running command helm with args [dependency --namespace test-helm-routing-ot-147 update /Users/antonio.zamorano/ttdsrc/sumologic-kubernetes-collection/deploy/helm/sumologic]
Test_Helm_Routing_OT 2025-11-13T10:02:55+01:00 logger.go:67: Getting updates for unmanaged Helm repositories...
Test_Helm_Routing_OT 2025-11-13T10:02:55+01:00 logger.go:67: ...Successfully got an update from the "https://sumologic.github.io/tailing-sidecar" chart repository
Test_Helm_Routing_OT 2025-11-13T10:02:55+01:00 logger.go:67: ...Successfully got an update from the "https://helm.influxdata.com/" chart repository
Test_Helm_Routing_OT 2025-11-13T10:02:55+01:00 logger.go:67: ...Successfully got an update from the "https://falcosecurity.github.io/charts" chart repository
Test_Helm_Routing_OT 2025-11-13T10:02:56+01:00 logger.go:67: ...Successfully got an update from the "https://open-telemetry.github.io/opentelemetry-helm-charts" chart repository
Test_Helm_Routing_OT 2025-11-13T10:02:56+01:00 logger.go:67: ...Successfully got an update from the "https://prometheus-community.github.io/helm-charts" chart repository
Test_Helm_Routing_OT 2025-11-13T10:02:56+01:00 logger.go:67: ...Successfully got an update from the "https://prometheus-community.github.io/helm-charts" chart repository
Test_Helm_Routing_OT 2025-11-13T10:02:58+01:00 logger.go:67: ...Successfully got an update from the "https://charts.bitnami.com/bitnami" chart repository
Test_Helm_Routing_OT 2025-11-13T10:02:58+01:00 logger.go:67: Hang tight while we grab the latest from your chart repositories...
Test_Helm_Routing_OT 2025-11-13T10:02:58+01:00 logger.go:67: ...Successfully got an update from the "hashicorp" chart repository
Test_Helm_Routing_OT 2025-11-13T10:02:59+01:00 logger.go:67: ...Successfully got an update from the "argo" chart repository
Test_Helm_Routing_OT 2025-11-13T10:02:59+01:00 logger.go:67: Update Complete. ⎈Happy Helming!⎈
Test_Helm_Routing_OT 2025-11-13T10:03:01+01:00 logger.go:67: Saving 7 charts
Test_Helm_Routing_OT 2025-11-13T10:03:02+01:00 logger.go:67: Downloading kube-prometheus-stack from repo https://prometheus-community.github.io/helm-charts
Test_Helm_Routing_OT 2025-11-13T10:03:03+01:00 logger.go:67: Downloading falco from repo https://falcosecurity.github.io/charts
Test_Helm_Routing_OT 2025-11-13T10:03:08+01:00 logger.go:67: Downloading metrics-server from repo https://charts.bitnami.com/bitnami
Test_Helm_Routing_OT 2025-11-13T10:03:09+01:00 logger.go:67: Downloading telegraf-operator from repo https://helm.influxdata.com/
Test_Helm_Routing_OT 2025-11-13T10:03:09+01:00 logger.go:67: Downloading tailing-sidecar-operator from repo https://sumologic.github.io/tailing-sidecar
Test_Helm_Routing_OT 2025-11-13T10:03:10+01:00 logger.go:67: Downloading opentelemetry-operator from repo https://open-telemetry.github.io/opentelemetry-helm-charts
Test_Helm_Routing_OT 2025-11-13T10:03:12+01:00 logger.go:67: Downloading prometheus-windows-exporter from repo https://prometheus-community.github.io/helm-charts
Test_Helm_Routing_OT 2025-11-13T10:03:13+01:00 logger.go:67: Deleting outdated charts
Test_Helm_Routing_OT 2025-11-13T10:03:13+01:00 logger.go:67: Running command helm with args [install --namespace test-helm-routing-ot-147 --wait -f /Users/antonio.zamorano/ttdsrc/sumologic-kubernetes-collection/tests/integration/values/values_common.yaml -f /Users/antonio.zamorano/ttdsrc/sumologic-kubernetes-collection/tests/integration/values/values_helm_routing_ot.yaml rel-19980165 /Users/antonio.zamorano/ttdsrc/sumologic-kubernetes-collection/deploy/helm/sumologic]
Test_Helm_Routing_OT 2025-11-13T10:04:21+01:00 logger.go:67: NAME: rel-19980165
Test_Helm_Routing_OT 2025-11-13T10:04:21+01:00 logger.go:67: LAST DEPLOYED: Thu Nov 13 10:03:16 2025
Test_Helm_Routing_OT 2025-11-13T10:04:21+01:00 logger.go:67: NAMESPACE: test-helm-routing-ot-147
Test_Helm_Routing_OT 2025-11-13T10:04:21+01:00 logger.go:67: STATUS: deployed
Test_Helm_Routing_OT 2025-11-13T10:04:21+01:00 logger.go:67: REVISION: 1
Test_Helm_Routing_OT 2025-11-13T10:04:21+01:00 logger.go:67: NOTES:
Test_Helm_Routing_OT 2025-11-13T10:04:21+01:00 logger.go:67: Thank you for installing sumologic.
Test_Helm_Routing_OT 2025-11-13T10:04:21+01:00 logger.go:67: 
Test_Helm_Routing_OT 2025-11-13T10:04:21+01:00 logger.go:67: A Collector with the name "kubernetes" has been created in your Sumo Logic account.
Test_Helm_Routing_OT 2025-11-13T10:04:21+01:00 logger.go:67: 
Test_Helm_Routing_OT 2025-11-13T10:04:21+01:00 logger.go:67: Check the release status by running:
Test_Helm_Routing_OT 2025-11-13T10:04:21+01:00 logger.go:67:   kubectl --namespace test-helm-routing-ot-147 get pods -l "release=rel-19980165"
Test_Helm_Routing_OT 2025-11-13T10:04:21+01:00 logger.go:67: 
Test_Helm_Routing_OT 2025-11-13T10:04:21+01:00 logger.go:67: We've tried to automatically create fields. In an unlikely scenario that this
Test_Helm_Routing_OT 2025-11-13T10:04:21+01:00 logger.go:67: fails please refer to the following to create them manually:
Test_Helm_Routing_OT 2025-11-13T10:04:21+01:00 logger.go:67: https://github.com/SumoLogic/sumologic-kubernetes-collection/blob/2b3ca63/deploy/docs/Installation_with_Helm.md#prerequisite
=== RUN   Test_Helm_Routing_OT/installation
=== RUN   Test_Helm_Routing_OT/installation/otelcol_logs_statefulset_is_ready
=== RUN   Test_Helm_Routing_OT/installation/otelcol_logs_buffers_PVCs_are_created_and_bound
=== RUN   Test_Helm_Routing_OT/installation/otelcol_daemonset_is_ready
=== RUN   Test_Helm_Routing_OT/create_additional_sumologic_mock
Test_Helm_Routing_OT/create_additional_sumologic_mock 2025-11-13T10:04:30+01:00 logger.go:67: Running command kubectl with args [--namespace test-helm-routing-ot-147 apply -f yamls/additional-sumologic-mock.yaml]
Test_Helm_Routing_OT/create_additional_sumologic_mock 2025-11-13T10:04:30+01:00 logger.go:67: deployment.apps/additional-sumologic-mock created
Test_Helm_Routing_OT/create_additional_sumologic_mock 2025-11-13T10:04:30+01:00 logger.go:67: service/additional-sumologic-mock created
=== RUN   Test_Helm_Routing_OT/create_additional_sumologic_mock/additional_sumologic_mock_is_ready
Test_Helm_Routing_OT/create_additional_sumologic_mock/additional_sumologic_mock_is_ready 2025-11-13T10:04:30+01:00 retry.go:91: Wait for service additional-sumologic-mock to be provisioned.
Test_Helm_Routing_OT/create_additional_sumologic_mock/additional_sumologic_mock_is_ready 2025-11-13T10:04:30+01:00 logger.go:67: Configuring Kubernetes client using config file /Users/antonio.zamorano/.kube/config with context 
Test_Helm_Routing_OT/create_additional_sumologic_mock/additional_sumologic_mock_is_ready 2025-11-13T10:04:30+01:00 logger.go:67: Getting list of nodes from Kubernetes
Test_Helm_Routing_OT/create_additional_sumologic_mock/additional_sumologic_mock_is_ready 2025-11-13T10:04:30+01:00 logger.go:67: Configuring Kubernetes client using config file /Users/antonio.zamorano/.kube/config with context 
Test_Helm_Routing_OT/create_additional_sumologic_mock/additional_sumologic_mock_is_ready 2025-11-13T10:04:30+01:00 logger.go:67: Service is now available
=== RUN   Test_Helm_Routing_OT/logs
    features.go:498: Waiting 5 seconds before generating logs...
=== RUN   Test_Helm_Routing_OT/logs/logs_from_log_generator_deployment_present
Test_Helm_Routing_OT/logs/logs_from_log_generator_deployment_present 2025-11-13T10:04:35+01:00 retry.go:91: Wait for service rel-19980165-sumologic-mock to be provisioned.
Test_Helm_Routing_OT/logs/logs_from_log_generator_deployment_present 2025-11-13T10:04:35+01:00 logger.go:67: Configuring Kubernetes client using config file /Users/antonio.zamorano/.kube/config with context 
Test_Helm_Routing_OT/logs/logs_from_log_generator_deployment_present 2025-11-13T10:04:35+01:00 logger.go:67: Getting list of nodes from Kubernetes
Test_Helm_Routing_OT/logs/logs_from_log_generator_deployment_present 2025-11-13T10:04:35+01:00 logger.go:67: Configuring Kubernetes client using config file /Users/antonio.zamorano/.kube/config with context 
Test_Helm_Routing_OT/logs/logs_from_log_generator_deployment_present 2025-11-13T10:04:35+01:00 logger.go:67: Service is now available
Test_Helm_Routing_OT/logs/logs_from_log_generator_deployment_present 2025-11-13T10:04:35+01:00 tunnel.go:177: Creating a port forwarding tunnel for resource svc/rel-19980165-sumologic-mock routing local port 0 to remote port 3000
Test_Helm_Routing_OT/logs/logs_from_log_generator_deployment_present 2025-11-13T10:04:35+01:00 logger.go:67: Configuring Kubernetes client using config file /Users/antonio.zamorano/.kube/config with context 
Test_Helm_Routing_OT/logs/logs_from_log_generator_deployment_present 2025-11-13T10:04:35+01:00 logger.go:67: Configuring Kubernetes client using config file /Users/antonio.zamorano/.kube/config with context 
Test_Helm_Routing_OT/logs/logs_from_log_generator_deployment_present 2025-11-13T10:04:35+01:00 logger.go:67: Configuring Kubernetes client using config file /Users/antonio.zamorano/.kube/config with context 
Test_Helm_Routing_OT/logs/logs_from_log_generator_deployment_present 2025-11-13T10:04:35+01:00 tunnel.go:212: Selected pod rel-19980165-sumologic-mock-58dcb7df9d-mxn5z to open port forward to
Test_Helm_Routing_OT/logs/logs_from_log_generator_deployment_present 2025-11-13T10:04:35+01:00 tunnel.go:225: Using URL https://127.0.0.1:63149/api/v1/namespaces/test-helm-routing-ot-147/pods/rel-19980165-sumologic-mock-58dcb7df9d-mxn5z/portforward to create portforward
Test_Helm_Routing_OT/logs/logs_from_log_generator_deployment_present 2025-11-13T10:04:35+01:00 tunnel.go:242: Requested local port is 0. Selecting an open port on host system
Test_Helm_Routing_OT/logs/logs_from_log_generator_deployment_present 2025-11-13T10:04:35+01:00 tunnel.go:248: Selected port 63337
Test_Helm_Routing_OT/logs/logs_from_log_generator_deployment_present 2025-11-13T10:04:35+01:00 tunnel.go:274: Successfully created port forwarding tunnel
Test_Helm_Routing_OT/logs/logs_from_log_generator_deployment_present 2025-11-13T10:04:38+01:00 http_helper.go:58: Making an HTTP GET call to URL http://localhost:63337/logs/count?deployment=logs-generator&namespace=logs-generator
I1113 10:04:38.654946   63960 assess_funcs.go:393] "received logs, less than expected" received=0 expected=1000
Test_Helm_Routing_OT/logs/logs_from_log_generator_deployment_present 2025-11-13T10:04:41+01:00 http_helper.go:58: Making an HTTP GET call to URL http://localhost:63337/logs/count?deployment=logs-generator&namespace=logs-generator
I1113 10:04:41.643162   63960 assess_funcs.go:393] "received logs, less than expected" received=0 expected=1000
Test_Helm_Routing_OT/logs/logs_from_log_generator_deployment_present 2025-11-13T10:04:44+01:00 http_helper.go:58: Making an HTTP GET call to URL http://localhost:63337/logs/count?deployment=logs-generator&namespace=logs-generator
I1113 10:04:44.644291   63960 assess_funcs.go:410] "received enough logs" received=1000 expected=1000 metadata={"deployment":"logs-generator","namespace":"logs-generator"}
=== RUN   Test_Helm_Routing_OT/logs/logs_from_log_generator_daemonset_present
Test_Helm_Routing_OT/logs/logs_from_log_generator_daemonset_present 2025-11-13T10:04:44+01:00 retry.go:91: Wait for service rel-19980165-sumologic-mock to be provisioned.
Test_Helm_Routing_OT/logs/logs_from_log_generator_daemonset_present 2025-11-13T10:04:44+01:00 logger.go:67: Configuring Kubernetes client using config file /Users/antonio.zamorano/.kube/config with context 
Test_Helm_Routing_OT/logs/logs_from_log_generator_daemonset_present 2025-11-13T10:04:44+01:00 logger.go:67: Getting list of nodes from Kubernetes
Test_Helm_Routing_OT/logs/logs_from_log_generator_daemonset_present 2025-11-13T10:04:44+01:00 logger.go:67: Configuring Kubernetes client using config file /Users/antonio.zamorano/.kube/config with context 
Test_Helm_Routing_OT/logs/logs_from_log_generator_daemonset_present 2025-11-13T10:04:44+01:00 logger.go:67: Service is now available
Test_Helm_Routing_OT/logs/logs_from_log_generator_daemonset_present 2025-11-13T10:04:44+01:00 tunnel.go:177: Creating a port forwarding tunnel for resource svc/rel-19980165-sumologic-mock routing local port 0 to remote port 3000
Test_Helm_Routing_OT/logs/logs_from_log_generator_daemonset_present 2025-11-13T10:04:44+01:00 logger.go:67: Configuring Kubernetes client using config file /Users/antonio.zamorano/.kube/config with context 
Test_Helm_Routing_OT/logs/logs_from_log_generator_daemonset_present 2025-11-13T10:04:44+01:00 logger.go:67: Configuring Kubernetes client using config file /Users/antonio.zamorano/.kube/config with context 
Test_Helm_Routing_OT/logs/logs_from_log_generator_daemonset_present 2025-11-13T10:04:44+01:00 logger.go:67: Configuring Kubernetes client using config file /Users/antonio.zamorano/.kube/config with context 
Test_Helm_Routing_OT/logs/logs_from_log_generator_daemonset_present 2025-11-13T10:04:44+01:00 tunnel.go:212: Selected pod rel-19980165-sumologic-mock-58dcb7df9d-mxn5z to open port forward to
Test_Helm_Routing_OT/logs/logs_from_log_generator_daemonset_present 2025-11-13T10:04:44+01:00 tunnel.go:225: Using URL https://127.0.0.1:63149/api/v1/namespaces/test-helm-routing-ot-147/pods/rel-19980165-sumologic-mock-58dcb7df9d-mxn5z/portforward to create portforward
Test_Helm_Routing_OT/logs/logs_from_log_generator_daemonset_present 2025-11-13T10:04:44+01:00 tunnel.go:242: Requested local port is 0. Selecting an open port on host system
Test_Helm_Routing_OT/logs/logs_from_log_generator_daemonset_present 2025-11-13T10:04:44+01:00 tunnel.go:248: Selected port 63356
Test_Helm_Routing_OT/logs/logs_from_log_generator_daemonset_present 2025-11-13T10:04:44+01:00 tunnel.go:274: Successfully created port forwarding tunnel
Test_Helm_Routing_OT/logs/logs_from_log_generator_daemonset_present 2025-11-13T10:04:47+01:00 http_helper.go:58: Making an HTTP GET call to URL http://localhost:63356/logs/count?daemonset=logs-generator&namespace=logs-generator
I1113 10:04:47.689490   63960 assess_funcs.go:410] "received enough logs" received=1000 expected=1000 metadata={"daemonset":"logs-generator","namespace":"logs-generator"}
=== RUN   Test_Helm_Routing_OT/logs/expected_container_log_metadata_is_present_for_log_generator_deployment
Test_Helm_Routing_OT/logs/expected_container_log_metadata_is_present_for_log_generator_deployment 2025-11-13T10:04:47+01:00 retry.go:91: Wait for service rel-19980165-sumologic-mock to be provisioned.
Test_Helm_Routing_OT/logs/expected_container_log_metadata_is_present_for_log_generator_deployment 2025-11-13T10:04:47+01:00 logger.go:67: Configuring Kubernetes client using config file /Users/antonio.zamorano/.kube/config with context 
Test_Helm_Routing_OT/logs/expected_container_log_metadata_is_present_for_log_generator_deployment 2025-11-13T10:04:47+01:00 logger.go:67: Getting list of nodes from Kubernetes
Test_Helm_Routing_OT/logs/expected_container_log_metadata_is_present_for_log_generator_deployment 2025-11-13T10:04:47+01:00 logger.go:67: Configuring Kubernetes client using config file /Users/antonio.zamorano/.kube/config with context 
Test_Helm_Routing_OT/logs/expected_container_log_metadata_is_present_for_log_generator_deployment 2025-11-13T10:04:47+01:00 logger.go:67: Service is now available
Test_Helm_Routing_OT/logs/expected_container_log_metadata_is_present_for_log_generator_deployment 2025-11-13T10:04:47+01:00 tunnel.go:177: Creating a port forwarding tunnel for resource svc/rel-19980165-sumologic-mock routing local port 0 to remote port 3000
Test_Helm_Routing_OT/logs/expected_container_log_metadata_is_present_for_log_generator_deployment 2025-11-13T10:04:47+01:00 logger.go:67: Configuring Kubernetes client using config file /Users/antonio.zamorano/.kube/config with context 
Test_Helm_Routing_OT/logs/expected_container_log_metadata_is_present_for_log_generator_deployment 2025-11-13T10:04:47+01:00 logger.go:67: Configuring Kubernetes client using config file /Users/antonio.zamorano/.kube/config with context 
Test_Helm_Routing_OT/logs/expected_container_log_metadata_is_present_for_log_generator_deployment 2025-11-13T10:04:47+01:00 logger.go:67: Configuring Kubernetes client using config file /Users/antonio.zamorano/.kube/config with context 
Test_Helm_Routing_OT/logs/expected_container_log_metadata_is_present_for_log_generator_deployment 2025-11-13T10:04:47+01:00 tunnel.go:212: Selected pod rel-19980165-sumologic-mock-58dcb7df9d-mxn5z to open port forward to
Test_Helm_Routing_OT/logs/expected_container_log_metadata_is_present_for_log_generator_deployment 2025-11-13T10:04:47+01:00 tunnel.go:225: Using URL https://127.0.0.1:63149/api/v1/namespaces/test-helm-routing-ot-147/pods/rel-19980165-sumologic-mock-58dcb7df9d-mxn5z/portforward to create portforward
Test_Helm_Routing_OT/logs/expected_container_log_metadata_is_present_for_log_generator_deployment 2025-11-13T10:04:47+01:00 tunnel.go:242: Requested local port is 0. Selecting an open port on host system
Test_Helm_Routing_OT/logs/expected_container_log_metadata_is_present_for_log_generator_deployment 2025-11-13T10:04:47+01:00 tunnel.go:248: Selected port 63359
Test_Helm_Routing_OT/logs/expected_container_log_metadata_is_present_for_log_generator_deployment 2025-11-13T10:04:47+01:00 tunnel.go:274: Successfully created port forwarding tunnel
Test_Helm_Routing_OT/logs/expected_container_log_metadata_is_present_for_log_generator_deployment 2025-11-13T10:04:50+01:00 http_helper.go:58: Making an HTTP GET call to URL http://localhost:63359/logs/count?_sourceCategory=kubernetes%2Flogs%2Fgenerator%2Flogs%2Fgenerator&_sourceHost=%5E%24&_sourceName=logs-generator%5C.logs-generator-%5Ba-z0-9%5D%7B9%2C10%7D-%5Ba-z0-9%5D%7B4%2C5%7D%5C.logs-generator&cluster=kubernetes&container=logs-generator&deployment=logs-generator&host=.%2A-control-plane&namespace=logs-generator&node=.%2A-control-plane&pod=logs-generator-%5Ba-z0-9%5D%7B9%2C10%7D-%5Ba-z0-9%5D%7B4%2C5%7D&pod_labels_app=logs-generator
I1113 10:04:50.736880   63960 assess_funcs.go:410] "received enough logs" received=1000 expected=1000 metadata={"_sourceCategory":"kubernetes/logs/generator/logs/generator","_sourceHost":"^$","_sourceName":"logs-generator\\.logs-generator-[a-z0-9]{9,10}-[a-z0-9]{4,5}\\.logs-generator","cluster":"kubernetes","container":"logs-generator","deployment":"logs-generator","host":".*-control-plane","namespace":"logs-generator","node":".*-control-plane","pod":"logs-generator-[a-z0-9]{9,10}-[a-z0-9]{4,5}","pod_labels_app":"logs-generator"}
=== RUN   Test_Helm_Routing_OT/logs/expected_container_log_metadata_is_present_for_log_generator_daemonset
Test_Helm_Routing_OT/logs/expected_container_log_metadata_is_present_for_log_generator_daemonset 2025-11-13T10:04:50+01:00 retry.go:91: Wait for service rel-19980165-sumologic-mock to be provisioned.
Test_Helm_Routing_OT/logs/expected_container_log_metadata_is_present_for_log_generator_daemonset 2025-11-13T10:04:50+01:00 logger.go:67: Configuring Kubernetes client using config file /Users/antonio.zamorano/.kube/config with context 
Test_Helm_Routing_OT/logs/expected_container_log_metadata_is_present_for_log_generator_daemonset 2025-11-13T10:04:50+01:00 logger.go:67: Getting list of nodes from Kubernetes
Test_Helm_Routing_OT/logs/expected_container_log_metadata_is_present_for_log_generator_daemonset 2025-11-13T10:04:50+01:00 logger.go:67: Configuring Kubernetes client using config file /Users/antonio.zamorano/.kube/config with context 
Test_Helm_Routing_OT/logs/expected_container_log_metadata_is_present_for_log_generator_daemonset 2025-11-13T10:04:50+01:00 logger.go:67: Service is now available
Test_Helm_Routing_OT/logs/expected_container_log_metadata_is_present_for_log_generator_daemonset 2025-11-13T10:04:50+01:00 tunnel.go:177: Creating a port forwarding tunnel for resource svc/rel-19980165-sumologic-mock routing local port 0 to remote port 3000
Test_Helm_Routing_OT/logs/expected_container_log_metadata_is_present_for_log_generator_daemonset 2025-11-13T10:04:50+01:00 logger.go:67: Configuring Kubernetes client using config file /Users/antonio.zamorano/.kube/config with context 
Test_Helm_Routing_OT/logs/expected_container_log_metadata_is_present_for_log_generator_daemonset 2025-11-13T10:04:50+01:00 logger.go:67: Configuring Kubernetes client using config file /Users/antonio.zamorano/.kube/config with context 
Test_Helm_Routing_OT/logs/expected_container_log_metadata_is_present_for_log_generator_daemonset 2025-11-13T10:04:50+01:00 logger.go:67: Configuring Kubernetes client using config file /Users/antonio.zamorano/.kube/config with context 
Test_Helm_Routing_OT/logs/expected_container_log_metadata_is_present_for_log_generator_daemonset 2025-11-13T10:04:50+01:00 tunnel.go:212: Selected pod rel-19980165-sumologic-mock-58dcb7df9d-mxn5z to open port forward to
Test_Helm_Routing_OT/logs/expected_container_log_metadata_is_present_for_log_generator_daemonset 2025-11-13T10:04:50+01:00 tunnel.go:225: Using URL https://127.0.0.1:63149/api/v1/namespaces/test-helm-routing-ot-147/pods/rel-19980165-sumologic-mock-58dcb7df9d-mxn5z/portforward to create portforward
Test_Helm_Routing_OT/logs/expected_container_log_metadata_is_present_for_log_generator_daemonset 2025-11-13T10:04:50+01:00 tunnel.go:242: Requested local port is 0. Selecting an open port on host system
Test_Helm_Routing_OT/logs/expected_container_log_metadata_is_present_for_log_generator_daemonset 2025-11-13T10:04:50+01:00 tunnel.go:248: Selected port 63362
Test_Helm_Routing_OT/logs/expected_container_log_metadata_is_present_for_log_generator_daemonset 2025-11-13T10:04:50+01:00 tunnel.go:274: Successfully created port forwarding tunnel
Test_Helm_Routing_OT/logs/expected_container_log_metadata_is_present_for_log_generator_daemonset 2025-11-13T10:04:53+01:00 http_helper.go:58: Making an HTTP GET call to URL http://localhost:63362/logs/count?_sourceCategory=kubernetes%2Flogs%2Fgenerator%2Flogs%2Fgenerator&_sourceHost=%5E%24&_sourceName=logs-generator%5C.logs-generator-%5Ba-z0-9%5D%7B4%2C5%7D%5C.logs-generator&container=logs-generator&daemonset=logs-generator&host=.%2A-control-plane&namespace=logs-generator&node=.%2A-control-plane&pod=logs-generator-%5Ba-z0-9%5D%7B4%2C5%7D&pod_labels_app=logs-generator
I1113 10:04:53.783338   63960 assess_funcs.go:410] "received enough logs" received=1000 expected=1000 metadata={"_sourceCategory":"kubernetes/logs/generator/logs/generator","_sourceHost":"^$","_sourceName":"logs-generator\\.logs-generator-[a-z0-9]{4,5}\\.logs-generator","container":"logs-generator","daemonset":"logs-generator","host":".*-control-plane","namespace":"logs-generator","node":".*-control-plane","pod":"logs-generator-[a-z0-9]{4,5}","pod_labels_app":"logs-generator"}
=== RUN   Test_Helm_Routing_OT/logs/logs_from_node_systemd_present
Test_Helm_Routing_OT/logs/logs_from_node_systemd_present 2025-11-13T10:04:53+01:00 retry.go:91: Wait for service rel-19980165-sumologic-mock to be provisioned.
Test_Helm_Routing_OT/logs/logs_from_node_systemd_present 2025-11-13T10:04:53+01:00 logger.go:67: Configuring Kubernetes client using config file /Users/antonio.zamorano/.kube/config with context 
Test_Helm_Routing_OT/logs/logs_from_node_systemd_present 2025-11-13T10:04:53+01:00 logger.go:67: Getting list of nodes from Kubernetes
Test_Helm_Routing_OT/logs/logs_from_node_systemd_present 2025-11-13T10:04:53+01:00 logger.go:67: Configuring Kubernetes client using config file /Users/antonio.zamorano/.kube/config with context 
Test_Helm_Routing_OT/logs/logs_from_node_systemd_present 2025-11-13T10:04:53+01:00 logger.go:67: Service is now available
Test_Helm_Routing_OT/logs/logs_from_node_systemd_present 2025-11-13T10:04:53+01:00 tunnel.go:177: Creating a port forwarding tunnel for resource svc/rel-19980165-sumologic-mock routing local port 0 to remote port 3000
Test_Helm_Routing_OT/logs/logs_from_node_systemd_present 2025-11-13T10:04:53+01:00 logger.go:67: Configuring Kubernetes client using config file /Users/antonio.zamorano/.kube/config with context 
Test_Helm_Routing_OT/logs/logs_from_node_systemd_present 2025-11-13T10:04:53+01:00 logger.go:67: Configuring Kubernetes client using config file /Users/antonio.zamorano/.kube/config with context 
Test_Helm_Routing_OT/logs/logs_from_node_systemd_present 2025-11-13T10:04:53+01:00 logger.go:67: Configuring Kubernetes client using config file /Users/antonio.zamorano/.kube/config with context 
Test_Helm_Routing_OT/logs/logs_from_node_systemd_present 2025-11-13T10:04:53+01:00 tunnel.go:212: Selected pod rel-19980165-sumologic-mock-58dcb7df9d-mxn5z to open port forward to
Test_Helm_Routing_OT/logs/logs_from_node_systemd_present 2025-11-13T10:04:53+01:00 tunnel.go:225: Using URL https://127.0.0.1:63149/api/v1/namespaces/test-helm-routing-ot-147/pods/rel-19980165-sumologic-mock-58dcb7df9d-mxn5z/portforward to create portforward
Test_Helm_Routing_OT/logs/logs_from_node_systemd_present 2025-11-13T10:04:53+01:00 tunnel.go:242: Requested local port is 0. Selecting an open port on host system
Test_Helm_Routing_OT/logs/logs_from_node_systemd_present 2025-11-13T10:04:53+01:00 tunnel.go:248: Selected port 63365
Test_Helm_Routing_OT/logs/logs_from_node_systemd_present 2025-11-13T10:04:53+01:00 tunnel.go:274: Successfully created port forwarding tunnel
Test_Helm_Routing_OT/logs/logs_from_node_systemd_present 2025-11-13T10:04:56+01:00 http_helper.go:58: Making an HTTP GET call to URL http://localhost:63365/logs/count?_sourceCategory=kubernetes%2Fsystem&_sourceHost=.%2A-control-plane&_sourceName=%28%3F%21undefined%24%29.%2A&cluster=kubernetes
I1113 10:04:56.830523   63960 assess_funcs.go:410] "received enough logs" received=100 expected=10 metadata={"_sourceCategory":"kubernetes/system","_sourceHost":".*-control-plane","_sourceName":"(?!undefined$).*","cluster":"kubernetes"}
=== RUN   Test_Helm_Routing_OT/logs/logs_from_kubelet_present
Test_Helm_Routing_OT/logs/logs_from_kubelet_present 2025-11-13T10:04:56+01:00 retry.go:91: Wait for service rel-19980165-sumologic-mock to be provisioned.
Test_Helm_Routing_OT/logs/logs_from_kubelet_present 2025-11-13T10:04:56+01:00 logger.go:67: Configuring Kubernetes client using config file /Users/antonio.zamorano/.kube/config with context 
Test_Helm_Routing_OT/logs/logs_from_kubelet_present 2025-11-13T10:04:56+01:00 logger.go:67: Getting list of nodes from Kubernetes
Test_Helm_Routing_OT/logs/logs_from_kubelet_present 2025-11-13T10:04:56+01:00 logger.go:67: Configuring Kubernetes client using config file /Users/antonio.zamorano/.kube/config with context 
Test_Helm_Routing_OT/logs/logs_from_kubelet_present 2025-11-13T10:04:56+01:00 logger.go:67: Service is now available
Test_Helm_Routing_OT/logs/logs_from_kubelet_present 2025-11-13T10:04:56+01:00 tunnel.go:177: Creating a port forwarding tunnel for resource svc/rel-19980165-sumologic-mock routing local port 0 to remote port 3000
Test_Helm_Routing_OT/logs/logs_from_kubelet_present 2025-11-13T10:04:56+01:00 logger.go:67: Configuring Kubernetes client using config file /Users/antonio.zamorano/.kube/config with context 
Test_Helm_Routing_OT/logs/logs_from_kubelet_present 2025-11-13T10:04:56+01:00 logger.go:67: Configuring Kubernetes client using config file /Users/antonio.zamorano/.kube/config with context 
Test_Helm_Routing_OT/logs/logs_from_kubelet_present 2025-11-13T10:04:56+01:00 logger.go:67: Configuring Kubernetes client using config file /Users/antonio.zamorano/.kube/config with context 
Test_Helm_Routing_OT/logs/logs_from_kubelet_present 2025-11-13T10:04:56+01:00 tunnel.go:212: Selected pod rel-19980165-sumologic-mock-58dcb7df9d-mxn5z to open port forward to
Test_Helm_Routing_OT/logs/logs_from_kubelet_present 2025-11-13T10:04:56+01:00 tunnel.go:225: Using URL https://127.0.0.1:63149/api/v1/namespaces/test-helm-routing-ot-147/pods/rel-19980165-sumologic-mock-58dcb7df9d-mxn5z/portforward to create portforward
Test_Helm_Routing_OT/logs/logs_from_kubelet_present 2025-11-13T10:04:56+01:00 tunnel.go:242: Requested local port is 0. Selecting an open port on host system
Test_Helm_Routing_OT/logs/logs_from_kubelet_present 2025-11-13T10:04:56+01:00 tunnel.go:248: Selected port 63368
Test_Helm_Routing_OT/logs/logs_from_kubelet_present 2025-11-13T10:04:56+01:00 tunnel.go:274: Successfully created port forwarding tunnel
Test_Helm_Routing_OT/logs/logs_from_kubelet_present 2025-11-13T10:04:59+01:00 http_helper.go:58: Making an HTTP GET call to URL http://localhost:63368/logs/count?_sourceCategory=kubernetes%2Fkubelet&_sourceHost=.%2A-control-plane&_sourceName=k8s_kubelet&cluster=kubernetes
I1113 10:04:59.892841   63960 assess_funcs.go:410] "received enough logs" received=11 expected=1 metadata={"_sourceCategory":"kubernetes/kubelet","_sourceHost":".*-control-plane","_sourceName":"k8s_kubelet","cluster":"kubernetes"}
Test_Helm_Routing_OT/logs 2025-11-13T10:04:59+01:00 logger.go:67: Running command kubectl with args [--namespace logs-generator delete deployment logs-generator]
Test_Helm_Routing_OT/logs 2025-11-13T10:04:59+01:00 logger.go:67: deployment.apps "logs-generator" deleted from logs-generator namespace
Test_Helm_Routing_OT/logs 2025-11-13T10:04:59+01:00 logger.go:67: Running command kubectl with args [--namespace logs-generator delete daemonset logs-generator]
Test_Helm_Routing_OT/logs 2025-11-13T10:05:00+01:00 logger.go:67: daemonset.apps "logs-generator" deleted from logs-generator namespace
=== RUN   Test_Helm_Routing_OT/logs#01
=== RUN   Test_Helm_Routing_OT/logs#01/logs_from_log_generator_deployment_present
Test_Helm_Routing_OT/logs#01/logs_from_log_generator_deployment_present 2025-11-13T10:05:00+01:00 retry.go:91: Wait for service additional-sumologic-mock to be provisioned.
Test_Helm_Routing_OT/logs#01/logs_from_log_generator_deployment_present 2025-11-13T10:05:00+01:00 logger.go:67: Configuring Kubernetes client using config file /Users/antonio.zamorano/.kube/config with context 
Test_Helm_Routing_OT/logs#01/logs_from_log_generator_deployment_present 2025-11-13T10:05:00+01:00 logger.go:67: Getting list of nodes from Kubernetes
Test_Helm_Routing_OT/logs#01/logs_from_log_generator_deployment_present 2025-11-13T10:05:00+01:00 logger.go:67: Configuring Kubernetes client using config file /Users/antonio.zamorano/.kube/config with context 
Test_Helm_Routing_OT/logs#01/logs_from_log_generator_deployment_present 2025-11-13T10:05:00+01:00 logger.go:67: Service is now available
Test_Helm_Routing_OT/logs#01/logs_from_log_generator_deployment_present 2025-11-13T10:05:00+01:00 tunnel.go:177: Creating a port forwarding tunnel for resource svc/additional-sumologic-mock routing local port 0 to remote port 3000
Test_Helm_Routing_OT/logs#01/logs_from_log_generator_deployment_present 2025-11-13T10:05:00+01:00 logger.go:67: Configuring Kubernetes client using config file /Users/antonio.zamorano/.kube/config with context 
Test_Helm_Routing_OT/logs#01/logs_from_log_generator_deployment_present 2025-11-13T10:05:00+01:00 logger.go:67: Configuring Kubernetes client using config file /Users/antonio.zamorano/.kube/config with context 
Test_Helm_Routing_OT/logs#01/logs_from_log_generator_deployment_present 2025-11-13T10:05:00+01:00 logger.go:67: Configuring Kubernetes client using config file /Users/antonio.zamorano/.kube/config with context 
Test_Helm_Routing_OT/logs#01/logs_from_log_generator_deployment_present 2025-11-13T10:05:00+01:00 tunnel.go:212: Selected pod additional-sumologic-mock-845d44cb4c-n2gwm to open port forward to
Test_Helm_Routing_OT/logs#01/logs_from_log_generator_deployment_present 2025-11-13T10:05:00+01:00 tunnel.go:225: Using URL https://127.0.0.1:63149/api/v1/namespaces/test-helm-routing-ot-147/pods/additional-sumologic-mock-845d44cb4c-n2gwm/portforward to create portforward
Test_Helm_Routing_OT/logs#01/logs_from_log_generator_deployment_present 2025-11-13T10:05:00+01:00 tunnel.go:242: Requested local port is 0. Selecting an open port on host system
Test_Helm_Routing_OT/logs#01/logs_from_log_generator_deployment_present 2025-11-13T10:05:00+01:00 tunnel.go:248: Selected port 63374
Test_Helm_Routing_OT/logs#01/logs_from_log_generator_deployment_present 2025-11-13T10:05:00+01:00 tunnel.go:274: Successfully created port forwarding tunnel
Test_Helm_Routing_OT/logs#01/logs_from_log_generator_deployment_present 2025-11-13T10:05:03+01:00 http_helper.go:58: Making an HTTP GET call to URL http://localhost:63374/logs/count?deployment=logs-generator&namespace=logs-generator
I1113 10:05:03.153095   63960 assess_funcs.go:480] "received enough logs" received=1000 expected=1000 metadata={"deployment":"logs-generator","namespace":"logs-generator"}
=== RUN   Test_Helm_Routing_OT/logs#01/logs_from_log_generator_daemonset_present
Test_Helm_Routing_OT/logs#01/logs_from_log_generator_daemonset_present 2025-11-13T10:05:03+01:00 retry.go:91: Wait for service additional-sumologic-mock to be provisioned.
Test_Helm_Routing_OT/logs#01/logs_from_log_generator_daemonset_present 2025-11-13T10:05:03+01:00 logger.go:67: Configuring Kubernetes client using config file /Users/antonio.zamorano/.kube/config with context 
Test_Helm_Routing_OT/logs#01/logs_from_log_generator_daemonset_present 2025-11-13T10:05:03+01:00 logger.go:67: Getting list of nodes from Kubernetes
Test_Helm_Routing_OT/logs#01/logs_from_log_generator_daemonset_present 2025-11-13T10:05:03+01:00 logger.go:67: Configuring Kubernetes client using config file /Users/antonio.zamorano/.kube/config with context 
Test_Helm_Routing_OT/logs#01/logs_from_log_generator_daemonset_present 2025-11-13T10:05:03+01:00 logger.go:67: Service is now available
Test_Helm_Routing_OT/logs#01/logs_from_log_generator_daemonset_present 2025-11-13T10:05:03+01:00 tunnel.go:177: Creating a port forwarding tunnel for resource svc/additional-sumologic-mock routing local port 0 to remote port 3000
Test_Helm_Routing_OT/logs#01/logs_from_log_generator_daemonset_present 2025-11-13T10:05:03+01:00 logger.go:67: Configuring Kubernetes client using config file /Users/antonio.zamorano/.kube/config with context 
Test_Helm_Routing_OT/logs#01/logs_from_log_generator_daemonset_present 2025-11-13T10:05:03+01:00 logger.go:67: Configuring Kubernetes client using config file /Users/antonio.zamorano/.kube/config with context 
Test_Helm_Routing_OT/logs#01/logs_from_log_generator_daemonset_present 2025-11-13T10:05:03+01:00 logger.go:67: Configuring Kubernetes client using config file /Users/antonio.zamorano/.kube/config with context 
Test_Helm_Routing_OT/logs#01/logs_from_log_generator_daemonset_present 2025-11-13T10:05:03+01:00 tunnel.go:212: Selected pod additional-sumologic-mock-845d44cb4c-n2gwm to open port forward to
Test_Helm_Routing_OT/logs#01/logs_from_log_generator_daemonset_present 2025-11-13T10:05:03+01:00 tunnel.go:225: Using URL https://127.0.0.1:63149/api/v1/namespaces/test-helm-routing-ot-147/pods/additional-sumologic-mock-845d44cb4c-n2gwm/portforward to create portforward
Test_Helm_Routing_OT/logs#01/logs_from_log_generator_daemonset_present 2025-11-13T10:05:03+01:00 tunnel.go:242: Requested local port is 0. Selecting an open port on host system
Test_Helm_Routing_OT/logs#01/logs_from_log_generator_daemonset_present 2025-11-13T10:05:03+01:00 tunnel.go:248: Selected port 63380
Test_Helm_Routing_OT/logs#01/logs_from_log_generator_daemonset_present 2025-11-13T10:05:03+01:00 tunnel.go:274: Successfully created port forwarding tunnel
Test_Helm_Routing_OT/logs#01/logs_from_log_generator_daemonset_present 2025-11-13T10:05:06+01:00 http_helper.go:58: Making an HTTP GET call to URL http://localhost:63380/logs/count?daemonset=logs-generator&namespace=logs-generator
I1113 10:05:06.210046   63960 assess_funcs.go:480] "received enough logs" received=1000 expected=1000 metadata={"daemonset":"logs-generator","namespace":"logs-generator"}
=== RUN   Test_Helm_Routing_OT/logs#01/expected_container_log_metadata_is_present_for_log_generator_deployment
Test_Helm_Routing_OT/logs#01/expected_container_log_metadata_is_present_for_log_generator_deployment 2025-11-13T10:05:06+01:00 retry.go:91: Wait for service additional-sumologic-mock to be provisioned.
Test_Helm_Routing_OT/logs#01/expected_container_log_metadata_is_present_for_log_generator_deployment 2025-11-13T10:05:06+01:00 logger.go:67: Configuring Kubernetes client using config file /Users/antonio.zamorano/.kube/config with context 
Test_Helm_Routing_OT/logs#01/expected_container_log_metadata_is_present_for_log_generator_deployment 2025-11-13T10:05:06+01:00 logger.go:67: Getting list of nodes from Kubernetes
Test_Helm_Routing_OT/logs#01/expected_container_log_metadata_is_present_for_log_generator_deployment 2025-11-13T10:05:06+01:00 logger.go:67: Configuring Kubernetes client using config file /Users/antonio.zamorano/.kube/config with context 
Test_Helm_Routing_OT/logs#01/expected_container_log_metadata_is_present_for_log_generator_deployment 2025-11-13T10:05:06+01:00 logger.go:67: Service is now available
Test_Helm_Routing_OT/logs#01/expected_container_log_metadata_is_present_for_log_generator_deployment 2025-11-13T10:05:06+01:00 tunnel.go:177: Creating a port forwarding tunnel for resource svc/additional-sumologic-mock routing local port 0 to remote port 3000
Test_Helm_Routing_OT/logs#01/expected_container_log_metadata_is_present_for_log_generator_deployment 2025-11-13T10:05:06+01:00 logger.go:67: Configuring Kubernetes client using config file /Users/antonio.zamorano/.kube/config with context 
Test_Helm_Routing_OT/logs#01/expected_container_log_metadata_is_present_for_log_generator_deployment 2025-11-13T10:05:06+01:00 logger.go:67: Configuring Kubernetes client using config file /Users/antonio.zamorano/.kube/config with context 
Test_Helm_Routing_OT/logs#01/expected_container_log_metadata_is_present_for_log_generator_deployment 2025-11-13T10:05:06+01:00 logger.go:67: Configuring Kubernetes client using config file /Users/antonio.zamorano/.kube/config with context 
Test_Helm_Routing_OT/logs#01/expected_container_log_metadata_is_present_for_log_generator_deployment 2025-11-13T10:05:06+01:00 tunnel.go:212: Selected pod additional-sumologic-mock-845d44cb4c-n2gwm to open port forward to
Test_Helm_Routing_OT/logs#01/expected_container_log_metadata_is_present_for_log_generator_deployment 2025-11-13T10:05:06+01:00 tunnel.go:225: Using URL https://127.0.0.1:63149/api/v1/namespaces/test-helm-routing-ot-147/pods/additional-sumologic-mock-845d44cb4c-n2gwm/portforward to create portforward
Test_Helm_Routing_OT/logs#01/expected_container_log_metadata_is_present_for_log_generator_deployment 2025-11-13T10:05:06+01:00 tunnel.go:242: Requested local port is 0. Selecting an open port on host system
Test_Helm_Routing_OT/logs#01/expected_container_log_metadata_is_present_for_log_generator_deployment 2025-11-13T10:05:06+01:00 tunnel.go:248: Selected port 63383
Test_Helm_Routing_OT/logs#01/expected_container_log_metadata_is_present_for_log_generator_deployment 2025-11-13T10:05:06+01:00 tunnel.go:274: Successfully created port forwarding tunnel
Test_Helm_Routing_OT/logs#01/expected_container_log_metadata_is_present_for_log_generator_deployment 2025-11-13T10:05:09+01:00 http_helper.go:58: Making an HTTP GET call to URL http://localhost:63383/logs/count?_sourceCategory=kubernetes%2Flogs%2Fgenerator%2Flogs%2Fgenerator&_sourceHost=%5E%24&_sourceName=logs-generator%5C.logs-generator-%5Ba-z0-9%5D%7B9%2C10%7D-%5Ba-z0-9%5D%7B4%2C5%7D%5C.logs-generator&cluster=kubernetes&container=logs-generator&deployment=logs-generator&host=.%2A-control-plane&namespace=logs-generator&node=.%2A-control-plane&pod=logs-generator-%5Ba-z0-9%5D%7B9%2C10%7D-%5Ba-z0-9%5D%7B4%2C5%7D&pod_labels_app=logs-generator
I1113 10:05:09.273987   63960 assess_funcs.go:480] "received enough logs" received=1000 expected=1000 metadata={"_sourceCategory":"kubernetes/logs/generator/logs/generator","_sourceHost":"^$","_sourceName":"logs-generator\\.logs-generator-[a-z0-9]{9,10}-[a-z0-9]{4,5}\\.logs-generator","cluster":"kubernetes","container":"logs-generator","deployment":"logs-generator","host":".*-control-plane","namespace":"logs-generator","node":".*-control-plane","pod":"logs-generator-[a-z0-9]{9,10}-[a-z0-9]{4,5}","pod_labels_app":"logs-generator"}
=== RUN   Test_Helm_Routing_OT/logs#01/expected_container_log_metadata_is_present_for_log_generator_daemonset
Test_Helm_Routing_OT/logs#01/expected_container_log_metadata_is_present_for_log_generator_daemonset 2025-11-13T10:05:09+01:00 retry.go:91: Wait for service additional-sumologic-mock to be provisioned.
Test_Helm_Routing_OT/logs#01/expected_container_log_metadata_is_present_for_log_generator_daemonset 2025-11-13T10:05:09+01:00 logger.go:67: Configuring Kubernetes client using config file /Users/antonio.zamorano/.kube/config with context 
Test_Helm_Routing_OT/logs#01/expected_container_log_metadata_is_present_for_log_generator_daemonset 2025-11-13T10:05:09+01:00 logger.go:67: Getting list of nodes from Kubernetes
Test_Helm_Routing_OT/logs#01/expected_container_log_metadata_is_present_for_log_generator_daemonset 2025-11-13T10:05:09+01:00 logger.go:67: Configuring Kubernetes client using config file /Users/antonio.zamorano/.kube/config with context 
Test_Helm_Routing_OT/logs#01/expected_container_log_metadata_is_present_for_log_generator_daemonset 2025-11-13T10:05:09+01:00 logger.go:67: Service is now available
Test_Helm_Routing_OT/logs#01/expected_container_log_metadata_is_present_for_log_generator_daemonset 2025-11-13T10:05:09+01:00 tunnel.go:177: Creating a port forwarding tunnel for resource svc/additional-sumologic-mock routing local port 0 to remote port 3000
Test_Helm_Routing_OT/logs#01/expected_container_log_metadata_is_present_for_log_generator_daemonset 2025-11-13T10:05:09+01:00 logger.go:67: Configuring Kubernetes client using config file /Users/antonio.zamorano/.kube/config with context 
Test_Helm_Routing_OT/logs#01/expected_container_log_metadata_is_present_for_log_generator_daemonset 2025-11-13T10:05:09+01:00 logger.go:67: Configuring Kubernetes client using config file /Users/antonio.zamorano/.kube/config with context 
Test_Helm_Routing_OT/logs#01/expected_container_log_metadata_is_present_for_log_generator_daemonset 2025-11-13T10:05:09+01:00 logger.go:67: Configuring Kubernetes client using config file /Users/antonio.zamorano/.kube/config with context 
Test_Helm_Routing_OT/logs#01/expected_container_log_metadata_is_present_for_log_generator_daemonset 2025-11-13T10:05:09+01:00 tunnel.go:212: Selected pod additional-sumologic-mock-845d44cb4c-n2gwm to open port forward to
Test_Helm_Routing_OT/logs#01/expected_container_log_metadata_is_present_for_log_generator_daemonset 2025-11-13T10:05:09+01:00 tunnel.go:225: Using URL https://127.0.0.1:63149/api/v1/namespaces/test-helm-routing-ot-147/pods/additional-sumologic-mock-845d44cb4c-n2gwm/portforward to create portforward
Test_Helm_Routing_OT/logs#01/expected_container_log_metadata_is_present_for_log_generator_daemonset 2025-11-13T10:05:09+01:00 tunnel.go:242: Requested local port is 0. Selecting an open port on host system
Test_Helm_Routing_OT/logs#01/expected_container_log_metadata_is_present_for_log_generator_daemonset 2025-11-13T10:05:09+01:00 tunnel.go:248: Selected port 63387
Test_Helm_Routing_OT/logs#01/expected_container_log_metadata_is_present_for_log_generator_daemonset 2025-11-13T10:05:09+01:00 tunnel.go:274: Successfully created port forwarding tunnel
Test_Helm_Routing_OT/logs#01/expected_container_log_metadata_is_present_for_log_generator_daemonset 2025-11-13T10:05:12+01:00 http_helper.go:58: Making an HTTP GET call to URL http://localhost:63387/logs/count?_sourceCategory=kubernetes%2Flogs%2Fgenerator%2Flogs%2Fgenerator&_sourceHost=%5E%24&_sourceName=logs-generator%5C.logs-generator-%5Ba-z0-9%5D%7B4%2C5%7D%5C.logs-generator&container=logs-generator&daemonset=logs-generator&host=.%2A-control-plane&namespace=logs-generator&node=.%2A-control-plane&pod=logs-generator-%5Ba-z0-9%5D%7B4%2C5%7D&pod_labels_app=logs-generator
I1113 10:05:12.347000   63960 assess_funcs.go:480] "received enough logs" received=1000 expected=1000 metadata={"_sourceCategory":"kubernetes/logs/generator/logs/generator","_sourceHost":"^$","_sourceName":"logs-generator\\.logs-generator-[a-z0-9]{4,5}\\.logs-generator","container":"logs-generator","daemonset":"logs-generator","host":".*-control-plane","namespace":"logs-generator","node":".*-control-plane","pod":"logs-generator-[a-z0-9]{4,5}","pod_labels_app":"logs-generator"}
=== RUN   Test_Helm_Routing_OT/logs#01/logs_from_node_systemd_present
Test_Helm_Routing_OT/logs#01/logs_from_node_systemd_present 2025-11-13T10:05:12+01:00 retry.go:91: Wait for service additional-sumologic-mock to be provisioned.
Test_Helm_Routing_OT/logs#01/logs_from_node_systemd_present 2025-11-13T10:05:12+01:00 logger.go:67: Configuring Kubernetes client using config file /Users/antonio.zamorano/.kube/config with context 
Test_Helm_Routing_OT/logs#01/logs_from_node_systemd_present 2025-11-13T10:05:12+01:00 logger.go:67: Getting list of nodes from Kubernetes
Test_Helm_Routing_OT/logs#01/logs_from_node_systemd_present 2025-11-13T10:05:12+01:00 logger.go:67: Configuring Kubernetes client using config file /Users/antonio.zamorano/.kube/config with context 
Test_Helm_Routing_OT/logs#01/logs_from_node_systemd_present 2025-11-13T10:05:12+01:00 logger.go:67: Service is now available
Test_Helm_Routing_OT/logs#01/logs_from_node_systemd_present 2025-11-13T10:05:12+01:00 tunnel.go:177: Creating a port forwarding tunnel for resource svc/additional-sumologic-mock routing local port 0 to remote port 3000
Test_Helm_Routing_OT/logs#01/logs_from_node_systemd_present 2025-11-13T10:05:12+01:00 logger.go:67: Configuring Kubernetes client using config file /Users/antonio.zamorano/.kube/config with context 
Test_Helm_Routing_OT/logs#01/logs_from_node_systemd_present 2025-11-13T10:05:12+01:00 logger.go:67: Configuring Kubernetes client using config file /Users/antonio.zamorano/.kube/config with context 
Test_Helm_Routing_OT/logs#01/logs_from_node_systemd_present 2025-11-13T10:05:12+01:00 logger.go:67: Configuring Kubernetes client using config file /Users/antonio.zamorano/.kube/config with context 
Test_Helm_Routing_OT/logs#01/logs_from_node_systemd_present 2025-11-13T10:05:12+01:00 tunnel.go:212: Selected pod additional-sumologic-mock-845d44cb4c-n2gwm to open port forward to
Test_Helm_Routing_OT/logs#01/logs_from_node_systemd_present 2025-11-13T10:05:12+01:00 tunnel.go:225: Using URL https://127.0.0.1:63149/api/v1/namespaces/test-helm-routing-ot-147/pods/additional-sumologic-mock-845d44cb4c-n2gwm/portforward to create portforward
Test_Helm_Routing_OT/logs#01/logs_from_node_systemd_present 2025-11-13T10:05:12+01:00 tunnel.go:242: Requested local port is 0. Selecting an open port on host system
Test_Helm_Routing_OT/logs#01/logs_from_node_systemd_present 2025-11-13T10:05:12+01:00 tunnel.go:248: Selected port 63391
Test_Helm_Routing_OT/logs#01/logs_from_node_systemd_present 2025-11-13T10:05:12+01:00 tunnel.go:274: Successfully created port forwarding tunnel
Test_Helm_Routing_OT/logs#01/logs_from_node_systemd_present 2025-11-13T10:05:15+01:00 http_helper.go:58: Making an HTTP GET call to URL http://localhost:63391/logs/count?_sourceCategory=kubernetes%2Fsystem&_sourceHost=.%2A-control-plane&_sourceName=%28%3F%21undefined%24%29.%2A&cluster=kubernetes
I1113 10:05:15.415790   63960 assess_funcs.go:480] "received enough logs" received=128 expected=10 metadata={"_sourceCategory":"kubernetes/system","_sourceHost":".*-control-plane","_sourceName":"(?!undefined$).*","cluster":"kubernetes"}
=== RUN   Test_Helm_Routing_OT/logs#01/logs_from_kubelet_present
Test_Helm_Routing_OT/logs#01/logs_from_kubelet_present 2025-11-13T10:05:15+01:00 retry.go:91: Wait for service additional-sumologic-mock to be provisioned.
Test_Helm_Routing_OT/logs#01/logs_from_kubelet_present 2025-11-13T10:05:15+01:00 logger.go:67: Configuring Kubernetes client using config file /Users/antonio.zamorano/.kube/config with context 
Test_Helm_Routing_OT/logs#01/logs_from_kubelet_present 2025-11-13T10:05:15+01:00 logger.go:67: Getting list of nodes from Kubernetes
Test_Helm_Routing_OT/logs#01/logs_from_kubelet_present 2025-11-13T10:05:15+01:00 logger.go:67: Configuring Kubernetes client using config file /Users/antonio.zamorano/.kube/config with context 
Test_Helm_Routing_OT/logs#01/logs_from_kubelet_present 2025-11-13T10:05:15+01:00 logger.go:67: Service is now available
Test_Helm_Routing_OT/logs#01/logs_from_kubelet_present 2025-11-13T10:05:15+01:00 tunnel.go:177: Creating a port forwarding tunnel for resource svc/additional-sumologic-mock routing local port 0 to remote port 3000
Test_Helm_Routing_OT/logs#01/logs_from_kubelet_present 2025-11-13T10:05:15+01:00 logger.go:67: Configuring Kubernetes client using config file /Users/antonio.zamorano/.kube/config with context 
Test_Helm_Routing_OT/logs#01/logs_from_kubelet_present 2025-11-13T10:05:15+01:00 logger.go:67: Configuring Kubernetes client using config file /Users/antonio.zamorano/.kube/config with context 
Test_Helm_Routing_OT/logs#01/logs_from_kubelet_present 2025-11-13T10:05:15+01:00 logger.go:67: Configuring Kubernetes client using config file /Users/antonio.zamorano/.kube/config with context 
Test_Helm_Routing_OT/logs#01/logs_from_kubelet_present 2025-11-13T10:05:15+01:00 tunnel.go:212: Selected pod additional-sumologic-mock-845d44cb4c-n2gwm to open port forward to
Test_Helm_Routing_OT/logs#01/logs_from_kubelet_present 2025-11-13T10:05:15+01:00 tunnel.go:225: Using URL https://127.0.0.1:63149/api/v1/namespaces/test-helm-routing-ot-147/pods/additional-sumologic-mock-845d44cb4c-n2gwm/portforward to create portforward
Test_Helm_Routing_OT/logs#01/logs_from_kubelet_present 2025-11-13T10:05:15+01:00 tunnel.go:242: Requested local port is 0. Selecting an open port on host system
Test_Helm_Routing_OT/logs#01/logs_from_kubelet_present 2025-11-13T10:05:15+01:00 tunnel.go:248: Selected port 63394
Test_Helm_Routing_OT/logs#01/logs_from_kubelet_present 2025-11-13T10:05:15+01:00 tunnel.go:274: Successfully created port forwarding tunnel
Test_Helm_Routing_OT/logs#01/logs_from_kubelet_present 2025-11-13T10:05:18+01:00 http_helper.go:58: Making an HTTP GET call to URL http://localhost:63394/logs/count?_sourceCategory=kubernetes%2Fkubelet&_sourceHost=.%2A-control-plane&_sourceName=k8s_kubelet&cluster=kubernetes
I1113 10:05:18.482734   63960 assess_funcs.go:480] "received enough logs" received=11 expected=1 metadata={"_sourceCategory":"kubernetes/kubelet","_sourceHost":".*-control-plane","_sourceName":"k8s_kubelet","cluster":"kubernetes"}
=== RUN   Test_Helm_Routing_OT/delete_additional_sumologic_mock
Test_Helm_Routing_OT/delete_additional_sumologic_mock 2025-11-13T10:05:18+01:00 logger.go:67: Running command kubectl with args [--namespace test-helm-routing-ot-147 delete -f yamls/additional-sumologic-mock.yaml]
Test_Helm_Routing_OT/delete_additional_sumologic_mock 2025-11-13T10:05:18+01:00 logger.go:67: deployment.apps "additional-sumologic-mock" deleted from test-helm-routing-ot-147 namespace
Test_Helm_Routing_OT/delete_additional_sumologic_mock 2025-11-13T10:05:18+01:00 logger.go:67: service "additional-sumologic-mock" deleted from test-helm-routing-ot-147 namespace
Test_Helm_Routing_OT 2025-11-13T10:05:18+01:00 logger.go:67: Running command helm with args [delete --namespace test-helm-routing-ot-147 rel-19980165]
Test_Helm_Routing_OT 2025-11-13T10:05:19+01:00 logger.go:67: release "rel-19980165" uninstalled
Test_Helm_Routing_OT 2025-11-13T10:05:19+01:00 logger.go:67: Configuring Kubernetes client using config file /Users/antonio.zamorano/.kube/config with context 
--- PASS: Test_Helm_Routing_OT (144.33s)
    --- PASS: Test_Helm_Routing_OT/installation (9.03s)
        --- PASS: Test_Helm_Routing_OT/installation/otelcol_logs_statefulset_is_ready (3.01s)
        --- PASS: Test_Helm_Routing_OT/installation/otelcol_logs_buffers_PVCs_are_created_and_bound (3.01s)
        --- PASS: Test_Helm_Routing_OT/installation/otelcol_daemonset_is_ready (3.01s)
    --- PASS: Test_Helm_Routing_OT/create_additional_sumologic_mock (0.24s)
        --- PASS: Test_Helm_Routing_OT/create_additional_sumologic_mock/additional_sumologic_mock_is_ready (0.00s)
    --- PASS: Test_Helm_Routing_OT/logs (29.52s)
        --- PASS: Test_Helm_Routing_OT/logs/logs_from_log_generator_deployment_present (9.04s)
        --- PASS: Test_Helm_Routing_OT/logs/logs_from_log_generator_daemonset_present (3.05s)
        --- PASS: Test_Helm_Routing_OT/logs/expected_container_log_metadata_is_present_for_log_generator_deployment (3.05s)
        --- PASS: Test_Helm_Routing_OT/logs/expected_container_log_metadata_is_present_for_log_generator_daemonset (3.05s)
        --- PASS: Test_Helm_Routing_OT/logs/logs_from_node_systemd_present (3.05s)
        --- PASS: Test_Helm_Routing_OT/logs/logs_from_kubelet_present (3.06s)
    --- PASS: Test_Helm_Routing_OT/logs#01 (18.39s)
        --- PASS: Test_Helm_Routing_OT/logs#01/logs_from_log_generator_deployment_present (3.06s)
        --- PASS: Test_Helm_Routing_OT/logs#01/logs_from_log_generator_daemonset_present (3.06s)
        --- PASS: Test_Helm_Routing_OT/logs#01/expected_container_log_metadata_is_present_for_log_generator_deployment (3.06s)
        --- PASS: Test_Helm_Routing_OT/logs#01/expected_container_log_metadata_is_present_for_log_generator_daemonset (3.07s)
        --- PASS: Test_Helm_Routing_OT/logs#01/logs_from_node_systemd_present (3.07s)
        --- PASS: Test_Helm_Routing_OT/logs#01/logs_from_kubelet_present (3.07s)
    --- PASS: Test_Helm_Routing_OT/delete_additional_sumologic_mock (0.13s)
PASS
ok  	github.com/SumoLogic/sumologic-kubernetes-collection/tests/integration	169.734s