Loki Sink supports setting max live time of persistent connection

[tiantangkuohai]

A note for the community

• Please vote on this issue by adding a 👍 reaction to the original issue to help the community and maintainers prioritize this request
• If you are interested in working on this issue or have submitted a pull request, please leave a comment

Use Cases

We have a K8s cluster running Vector and Loki cluster. We found that when Loki distributor scales out, the new instances got only a few traffic compared to old ones. It looks like Vector Loki Sink use consistent connection to write log to Loki.

Attempted Solutions

We tried to use Nginx reverse proxy between Vector and Loki, it did balance the traffic but it also doubled write latency.

Proposal

Vector support setting max connection live, it can natively support load balance.

References

No response

Version

0.42.0

[jszwedko]

Related issue for the Vector sink: #10728