Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add progress bar update capability to data transfers in iRODS #578

Merged
merged 2 commits into from
Aug 1, 2024

Conversation

d-w-moore
Copy link
Collaborator

Designed in such as way as to be foreseeably generic and /or adaptable to multiple progress bar libraries. progressbar and tqdm are demonstrated as compatible.

This PR may end up supplanting #575

Copy link
Contributor

@alanking alanking left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Nice. I was having a little trouble following what was happening but I think a few explanatory comments and/or docstrings could help there.

README.md Outdated Show resolved Hide resolved
README.md Show resolved Hide resolved
README.md Outdated Show resolved Hide resolved
irods/manager/data_object_manager.py Show resolved Hide resolved
irods/manager/data_object_manager.py Outdated Show resolved Hide resolved
irods/test/data_obj_test.py Outdated Show resolved Hide resolved
irods/test/data_obj_test.py Outdated Show resolved Hide resolved
irods/test/data_obj_test.py Outdated Show resolved Hide resolved
irods/test/data_obj_test.py Outdated Show resolved Hide resolved
Copy link
Contributor

@alanking alanking left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Latest changes look good. Please resolve open conversations as appropriate (I think all of the ones I opened can be resolved, but I'll let you make that determination). Are tests passing? Are you happy with the changes?

@alanking
Copy link
Contributor

@d-w-moore - Anything left to do here?

@d-w-moore
Copy link
Collaborator Author

@d-w-moore - Anything left to do here?

I think not. I'll look it over once more to be sure, and post another comment when that "internal review" is complete.

@d-w-moore
Copy link
Collaborator Author

Rebased to upstream main.

@d-w-moore
Copy link
Collaborator Author

One test was broken for the progressbar2 library... which i believe is the more current version of progressbar. So that's fixed now.

Copy link
Contributor

@alanking alanking left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks like there are a couple Codacy things that may be worth addressing. Other than my one comment, things seem fine.

Please consider the plan for those first two commits (squashing, removal with co-author credit on the new commit(s), adding issue numbers, etc.).

irods/test/data_obj_test.py Outdated Show resolved Hide resolved
Copy link
Contributor

@alanking alanking left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

# it

qubixes and others added 2 commits August 1, 2024 14:42
Works for both parallel as well as single threaded gets and puts.
updatable objects are either bound update functions taking a number of bytes in a transfer,
or progress-bar objects.  If the latter, the object's type must already be registered.

(See tests: Use of the progressbar and tqdm modules is demonstrated.)
@alanking alanking merged commit 732bc3c into irods:main Aug 1, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Development

Successfully merging this pull request may close these issues.

3 participants