Skip to content

[Feature] Enable OpenTelemetry Tracing for ChatQnA and AgentQnA #1542

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
7 of 9 tasks
joshuayao opened this issue Feb 13, 2025 · 3 comments
Closed
7 of 9 tasks

[Feature] Enable OpenTelemetry Tracing for ChatQnA and AgentQnA #1542

joshuayao opened this issue Feb 13, 2025 · 3 comments
Assignees
Labels
Backlog feature New feature or request
Milestone

Comments

@joshuayao
Copy link
Collaborator

joshuayao commented Feb 13, 2025

Priority

P1

Description

Leverage OpenTelemetry to enable effective observability for ChatQnA and AgentQnA on TGI and vLLM. OPEA integrated OpenTelemetry protocol (OTLP) tracing in v1.2. In v1.3, we need to enable tracing for ChatQnA and AgentQnA and related components like orchestrator, embedding, llms, reranking, retriever etc, export tracing data to Prometheus and visualize it by Grafana dashboards.

Tracing

Components
Examples

Data Visualization

Deployment

Documentation

@joshuayao joshuayao added the feature New feature or request label Feb 13, 2025
@joshuayao joshuayao added this to the v1.3 milestone Feb 13, 2025
@joshuayao joshuayao added this to OPEA Feb 13, 2025
@joshuayao joshuayao moved this to In progress in OPEA Feb 13, 2025
@joshuayao joshuayao changed the title [Feature] Enable OpenTelemetry Tracing for ChatQnA [Feature] Enable OpenTelemetry Tracing for ChatQnA and AgentQnA Feb 19, 2025
@louie-tsai
Copy link
Collaborator

louie-tsai commented Mar 6, 2025

@louie-tsai
Copy link
Collaborator

@joshuayao
essential functions are merged.

remining PRs are optional and good to have

@joshuayao
Copy link
Collaborator Author

@joshuayao essential functions are merged.

remining PRs are optional and good to have

@louie-tsai
Thanks for your updates. Can I say this feature has been completed?

@joshuayao joshuayao moved this from In review to Done in OPEA Apr 3, 2025
@joshuayao joshuayao closed this as completed by moving to Done in OPEA Apr 3, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Backlog feature New feature or request
Projects
Status: Done
Development

No branches or pull requests

2 participants