Missing ids in templates for Kubernetes hints annotations based autodiscover?

[sebastien-prudhomme]

Hi, I'm evaluating Elastic Agent autodiscover mode for Kubernetes based on annotations.

I've got more and more duplicated logs in Kibana and a lot of these errrors in Elastic Agent logs:

{"log.level":"error","@timestamp":"2024-05-31T11:56:27.810Z","message":"filestream input ID without ID might lead to data duplication, please add an ID and restart Filebeat","component":{"binary":"filebeat","dataset":"elastic_agent.filebeat","id":"filestream-default","type":"filestream"},"log":{"source":"filestream-default"},"[service.name](http://service.name/)":"filebeat","ecs.version":"1.6.0","log.logger":"input","log.origin":{"file.line":176,"[file.name](http://file.name/)":"input-logfile/manager.go","function":"[github.com/elastic/beats/v7/filebeat/input/filestream/internal/input-logfile.(*InputManager).Create](http://github.com/elastic/beats/v7/filebeat/input/filestream/internal/input-logfile.(*InputManager).Create)"},"ecs.version":"1.6.0"}

It seems that the streams defined in the templates here are missing unique "id" field: https://github.com/elastic/elastic-agent/tree/main/deploy/kubernetes/elastic-agent-standalone/templates.d

See how it was fixed here: #2788

Version 8.13.4 on Ubuntu 22.4

No discussion on https://discuss.elastic.co/ because it doesn't accept links.

[elasticmachine]

Pinging @elastic/elastic-agent-data-plane (Team:Elastic-Agent-Data-Plane)