Skip to content

[Task]: Move logs out of crawl documents to ensure documents don't exceed 16 MB Mongo limit #2765

@tw4l

Description

@tw4l

Description

Part of scalability work.

Start with moving error and behavior logs to new mongo collection, one document per log line (parsed to be able to support filtering and sorting)

Context

No response

Metadata

Metadata

Assignees

Labels

No labels
No labels

Type

Projects

Status

Done!

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions