Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Version 2024.8.9 - CF-1.12 updates #5

Merged
merged 69 commits into from
Aug 13, 2024
Merged

Version 2024.8.9 - CF-1.12 updates #5

merged 69 commits into from
Aug 13, 2024

Conversation

dwest77a
Copy link
Collaborator

@dwest77a dwest77a commented Aug 8, 2024

Changes to syntax in multiple scripts to reflect the new terminology in CF-1.12, but CFA-0.6.2 CFA-netCDF files are still supported.

Additional features:

  • Multiple aggregations from a single CFA-netCDF file are now supported, using either multiple or shared fragment array variables.
  • Base substitutions and xarray defaults are now applied.
  • Group structures are now handled by unpacking all required variables to a flat structure. Variable names do not reflect the group structure which may need to be revisited later on.
  • Fragment Wrapper objects can handle multiple filenames, with priority given to remote sources first, even though these are currently not supported as the ChunkWrapper netCDF4 opener is local-only.

Pushed to the next version:

  • Dask Any-Size chunk handling - this is partially implemented but not finished yet.
  • Active Storage: XarrayActive package in development but not yet ready for implementation here.
  • PP/UM file support
  • Post-processing data (Aggregated units and calendar support)

dwest77a and others added 30 commits July 31, 2024 09:06
@dwest77a
Initial commit of edits for CF 1.12
c0c8326
@dwest77a
Added Active Dataset/DataArray classes required for using Active Storage
1a2654e
@dwest77a
Replaced Dataset with CFAActiveDataset
ce88255
@dwest77a
Standardising terminology, added fragment info and array shape attrib…
3d020ce 
…utes to datastore after decoding
@dwest77a
Added testing hooks for mean function calls
664297c
@dwest77a
Added active options
aa0fc8e
@dwest77a
Added active options
275de9f
@dwest77a
Added fragment_getter option to allow active_mean for each fragment.
0126796
@dwest77a
Now returns either normal Dataset or ActiveDataset depending on user …
de4828f 
…input
@dwest77a
Encapsulated Active methods into a subclass
6925b0a
@dwest77a
Added active options and a few other things
2121add
@dwest77a
Minor name changes
427bca4
@dwest77a
Now using XarrayActive components
52e95e3
@dwest77a
Updated scrips in this version ready for merge
aaefa6a
@dwest77a
Merge branch 'CF1.12' into activeStorage
7c23f2b
@dwest77a
Merge pull request #4 from cedadev/activeStorage
d87f390 
Active storage changes into the CF1.12 branch
@dwest77a
Updated gitignore
bf26a4a
@dwest77a
Updated gitignore
bc4d452
@dwest77a
Removed content from official package version
561aee6
@dwest77a
Added new logos etc.
ce7edfb
@dwest77a
Added logo to page
7c6782a
@dwest77a
Updated images
5af2f43
@dwest77a
Updated image manager
b572c3c
@dwest77a
Removed old images
feaa84b
@dwest77a
Added copyright, per-variable decoding, docstrings etc. - upgraded to…
bda4fd9 
… CF1.12
@dwest77a
Updated version 1.0 Chunkwrapper script, to be used in XarrayActive a…
3e19146 
…s well
@dwest77a
Removed get_shapes function, added docstrings and fixed issues with g…
114b9af 
…etting some elements
@dwest77a
Removed superfluous functions
759054b
@dwest77a
Added copywright to group
6f02e25
@dwest77a
Removed 'chunks' option - now part of active_options
3341ac2
dwest77a and others added 27 commits August 8, 2024 12:26
@dwest77a
Minor docstring change
2eacd4f
@dwest77a
Updated requirements with pytest for basic testing
2317b0b
@dwest77a
Testing relative paths
b901b2a
@dwest77a
Fixed recursion issue with active_chunks
8046cd3
@dwest77a
Minor bug fixes to decoder, chunk getter
60e321a
@dwest77a
Added suite of cfa_pure tests
4434f90
@dwest77a
Using correct values for the test data
29e3b3d
@dwest77a
Using correct slicing for assessing array
1960e17
@dwest77a
Fixed final test element
5f9142d
@dwest77a
Added copy routines to Chunk wrapper objects, solves issue #6
eb295d4
@dwest77a
Added *args handler for __array__ to allow numpy casting directly
b6ffb69
@dwest77a
Updated values - non-copying slices didn't seem to give correct resul…
71acb87 
…ts so further testing may be needed
@dwest77a
Docstring updates and changes to script names
9bb4975
@dwest77a
Various documentation changes
2ca9744
@dwest77a
Removed utils
e43a573
@dwest77a
Terminology and class name changes
398eb7e
@dwest77a
Merge branch 'CF1.12' into terms
4c5d82a
@dwest77a
Merge pull request #7 from cedadev/terms
430269d 
Terminology and class name changes
@dwest77a
Updated documentation|
dc61720
@dwest77a
Updated docstrings
a8cfc7b
@dwest77a
Updated docstrings
7d19286
@dwest77a
Fixed 'units' bug - remove units as kwarg in CFAPartition
dad416f
@dwest77a
Removed entrypoint comment
a3d141d
@dwest77a
Resolved copying issue with units
358a0ce
@dwest77a
Filled with a holding message
0e2da5e
@dwest77a
Added bypass for cfunits import if not required
ebbe7e7
@dwest77a
Upgraded to 1.1: Added handler for size-1 dimensions
364d25d
@dwest77a
Copy link
Collaborator Author

Updated to Version 2024.8.13

@dwest77a dwest77a merged commit 59d5ed9 into main Aug 13, 2024
2 checks passed
@dwest77a dwest77a deleted the CF1.12 branch August 13, 2024 09:06
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees

@dwest77a dwest77a

Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
1 participant
@dwest77a