Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

LA-174: Adds max rows limit config to privacy req csv download #5671

Merged
merged 5 commits into from
Jan 15, 2025

Conversation

eastandwestwind
Copy link
Contributor

@eastandwestwind eastandwestwind commented Jan 15, 2025

Closes https://ethyca.atlassian.net/browse/LA-174

Description Of Changes

This PR adds a new config var to limit n number of rows for DSR downloads, FIDES__ADMIN_UI__MAX_PRIVACY_REQUEST_DOWNLOAD_ROWS. This is similar to what we already have in place for consent reporting download. The default limit is set at 100,000 for now.

Code Changes

  • Adds new config FIDES__ADMIN_UI__MAX_PRIVACY_REQUEST_DOWNLOAD_ROWS
  • updates DSR download endpoint to throw 400 if request is > this max
  • updates admin-ui code to surface this err in a user-friendly way
  • adds new unit test for this behavior

Steps to Confirm

  1. Set FIDES__ADMIN_UI__MAX_PRIVACY_REQUEST_DOWNLOAD_ROWS=1
  2. In Privacy center, make 2 privacy requests (access and erasure)
  3. In The privacy request manager, attempt to download those requests
  4. Confirm you are unable to download and that a user-friendly message appears with clear instructions.

Pre-Merge Checklist

  • Issue requirements met
  • All CI pipelines succeeded
  • CHANGELOG.md updated
    • Add a db-migration This indicates that a change includes a database migration label to the entry if your change includes a DB migration
    • Add a high-risk This issue suggests changes that have a high-probability of breaking existing code label to the entry if your change includes a high-risk change (i.e. potential for performance impact or unexpected regression) that should be flagged
  • Followup issues:
    • Followup issues created (include link)
    • No followup issues
  • Database migrations:
    • Ensure that your downrev is up to date with the latest revision on main
    • Ensure that your downgrade() migration is correct and works
      • If a downgrade migration is not possible for this change, please call this out in the PR description!
    • No migrations
  • Documentation:
    • Documentation complete, PR opened in fidesdocs
    • Documentation issue created in fidesdocs
    • If there are any new client scopes created as part of the pull request, remember to update public-facing documentation that references our scope registry
    • No documentation updates required

Copy link

vercel bot commented Jan 15, 2025

The latest updates on your projects. Learn more about Vercel for Git ↗︎

Name Status Preview Comments Updated (UTC)
fides-plus-nightly ✅ Ready (Inspect) Visit Preview 💬 Add feedback Jan 15, 2025 7:28pm

Copy link

cypress bot commented Jan 15, 2025

fides    Run #11784

Run Properties:  status check passed Passed #11784  •  git commit 7238c0f487 ℹ️: Merge 5e8fd129981a2af64c43031a0db01cc5ee1f967b into 39ef14b005a5a522ee311ba0060e...
Project fides
Branch Review refs/pull/5671/merge
Run status status check passed Passed #11784
Run duration 00m 38s
Commit git commit 7238c0f487 ℹ️: Merge 5e8fd129981a2af64c43031a0db01cc5ee1f967b into 39ef14b005a5a522ee311ba0060e...
Committer Catherine Smith
View all properties for this run ↗︎

Test results
Tests that failed  Failures 0
Tests that were flaky  Flaky 0
Tests that did not run due to a developer annotating a test with .skip  Pending 0
Tests that did not run due to a failure in a mocha hook  Skipped 0
Tests that passed  Passing 4
⚠️ You've recorded test results over your free plan limit.
Upgrade your plan to view test results.
View all changes introduced in this branch ↗︎

Copy link

codecov bot commented Jan 15, 2025

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 87.15%. Comparing base (a4f4aec) to head (0f3ef06).
Report is 1 commits behind head on main.

Additional details and impacted files
@@           Coverage Diff           @@
##             main    #5671   +/-   ##
=======================================
  Coverage   87.14%   87.15%           
=======================================
  Files         388      388           
  Lines       24014    24021    +7     
  Branches     2593     2594    +1     
=======================================
+ Hits        20928    20935    +7     
  Misses       2525     2525           
  Partials      561      561           

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

Copy link
Contributor

@galvana galvana left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Working as expected, and nice test coverage! 👌

@eastandwestwind
Copy link
Contributor Author

CI failure existing on main caused by #5666

@eastandwestwind eastandwestwind merged commit 72cd9b3 into main Jan 15, 2025
41 of 43 checks passed
@eastandwestwind eastandwestwind deleted the LA-174 branch January 15, 2025 19:59
Copy link

cypress bot commented Jan 15, 2025

fides    Run #11785

Run Properties:  status check passed Passed #11785  •  git commit 72cd9b3fb1: LA-174: Adds max rows limit config to privacy req csv download (#5671)
Project fides
Branch Review main
Run status status check passed Passed #11785
Run duration 01m 04s
Commit git commit 72cd9b3fb1: LA-174: Adds max rows limit config to privacy req csv download (#5671)
Committer Catherine Smith
View all properties for this run ↗︎

Test results
Tests that failed  Failures 0
Tests that were flaky  Flaky 0
Tests that did not run due to a developer annotating a test with .skip  Pending 0
Tests that did not run due to a failure in a mocha hook  Skipped 0
Tests that passed  Passing 4
⚠️ You've recorded test results over your free plan limit.
Upgrade your plan to view test results.
View all changes introduced in this branch ↗︎

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants