Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Move current AWS integration test to separate group and add mock based tests in CI pipeline #12715

Open
1 of 3 tasks
lliangyu-lin opened this issue Apr 3, 2025 · 0 comments
Open
1 of 3 tasks
Labels
improvement PR that improves existing functionality

Comments

@lliangyu-lin
Copy link
Contributor

lliangyu-lin commented Apr 3, 2025

Feature Request / Improvement

The current AWS integration tests are not well maintained because they are not enabled in the CI pipeline and can only be executed locally when specific AWS environment variables are set.

To improve test coverage and maintainability, ideally AWS integration tests should be split into two separate groups:

  • Mock-based integration tests (e.g., using Moto or MinIO):
    These tests simulate AWS services and can run safely in CI without requiring AWS credentials.

  • Real AWS service integration tests:
    These tests interact with actual AWS services and should be run optionally, based on a configuration (e.g., test properties or profile-based settings), rather than relying on local environment variables.

Query engine

None

Willingness to contribute

  • I can contribute this improvement/feature independently
  • I would be willing to contribute this improvement/feature with guidance from the Iceberg community
  • I cannot contribute this improvement/feature at this time
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
improvement PR that improves existing functionality
Projects
None yet
Development

No branches or pull requests

1 participant