TOPIO/BigWhoop

Fork 0

feat/api #46

Open

Gregor Weiss wants to merge 55 commits from feat/api into main

Gregor Weiss commented

2024-11-07 15:56:03 +00:00

Collaborator

I think this branch is ready to be merged. @hpcpvogl Please have a look and let me know what you think.

refactored api
rewrite cmdl tool with new api
docstring in libbwc.c

I think this branch is ready to be merged. @hpcpvogl Please have a look and let me know what you think. - [x] refactored api - [x] rewrite cmdl tool with new api - [x] docstring in libbwc.c

Gregor Weiss added 54 commits 2024-11-07 15:56:04 +00:00

Reorganize bwc_field and bwc_data to split codec settings and data stream semantically into data structures bwc_codec and bwc_stream. 008ccfa4a9

Cleaning up by removal of redundant information like parameter linked list, file extension, and file pointer including associated functionality.
Start constructing an API taking void pointers to the original data for compression.

Symmetrize API for compression and decompression to follow ad3a1ad061

- allocate codec
- initialize stream (using input data/codestream and output buffer from user)
- create (de-)compression
- run (de-)compression

rename init_stream(...) -> init_bitstream(...). 0673dafb64

init_bitstream without allocation.
emit_symbol and emit_chunck without reallocation.

resolved terminate_stream into shrink_to_fit and transfer_to_span. 1c41147b73

transferal of stream to span not required in assemble_codestream anymore.
assemble_codestream and bwc_compress return the size of the compressed data.
user provided buffer is used.

remove unused bwc_span bwc_stream.codestream.data 3242165d90

Merge pull request 'Cleaned memory management for bitstream' (#41 ) from develop-gws into feat/api bbc538d5e8

uint64 for number of time steps parameter e970a0d892

align integer precision for all dimensions, adaptations in fourth dimension 366827ca4a

rename field->codec for bwc_codec variables 68fcedc9ff

remove bwc_free_data 4baaaddf5f

adjust python API 06b96ae5af

adjust Fortran API d8e2e58862

New Command Line Tool Framework fc922d4354

new eas3_data struct and mods in bitstream eas3_std_params 60b5c6c80a

adjusted terminate_stream to shallow copy between two bitstreams ae7d48c458

add eas3_param_names linked list and functionality to extend b48525b8e4

eas3_add_param_name
also add eas3_free_data

adjust read_eas3_header 00f9e720e9

adjust write_eas3_header 379e10d5a2

adjust read_eas3 858808a46c

adjust write_eas3 62c9bc1a21

rename functions and bitstream stuff to avoid redefinitions 46358b4c1f

correct usage of params and param_names e101bd2404

don't close on null file pointer 49a9cf3d63

initial test compression with new api; working eas3 reader 43dc27014b

comments; todo implement e0bc0d8839

manual aux buffer 31ed09982e

remove eas3_emit_chunck and eas3_terminate_stream df2ad56f14

implement aux_dequeue, test, and remove aux span 58ab32e393

remove eas3_get_chunck 1175e8b71f

rename aux_push_back to aux_enqueue b8a1df1c11

remove span, eas3_bytes_used, eas3_init_stream a5d67f8470

refactor aux buffer and macros 26c00bd4e3

Modified eas3 interface to decouple it from the command line tool. 6d5dc06446

Implemented the arg_parse function for bwccmdl and added preliminary mode setting functionality for main. 90645bcf1b

Implemented the compression path with verbose output and support for all options available to the user. d979950626

Updated the WARNING messages to fit the layout of the verbose command line tool output. 6716a2b1d4

Fixed some memory leak issues. f81807e1e3

refactor and typos 92a646b5e0

open and close header with new header structure 12f937ecac

initial decompression workflow in cmdl tool d631f693c9

fill eas3_data form bwc_stream and bwc_codec d1bfb5236a

doxygen in types.h 9167ec48f3

fill eas3 auxiliary information in cmdl tool compression 55ad00d6c5

bug fixes in bwc_set_aux and bwc_set_com, both missing allocation of bwc_span 5d5aafae37

enqueue parameter names in auxiliary information d13354078b

bwc_to_eas3 and writing decompressed data, tested output can be parsed to compress again d4acd85c37

Update docstrings in eas3.c 1a087c1c85

refactor/clean up in cmdl tool acf703f650

header info mode 6176fea676

mse and psnr analysis 742fb3bc78

bug fix; wrong size in memcpy 64eeda9072

refactor; print (verbose) header, I/O, and control parameters a84768bbec

refactor; uchar -> unsigned char 3353fd7795

Merge pull request 'cmdl-tool' (#45 ) from cmdl-tool into feat/api a2309b0ba2

Reviewed-on: #45

Patrick Vogler was assigned by Gregor Weiss

2024-11-07 15:57:42 +00:00

Gregor Weiss self-assigned this 2024-11-07 15:57:43 +00:00

Patrick Vogler was unassigned by Gregor Weiss

2024-11-07 15:57:54 +00:00

Gregor Weiss requested review from Patrick Vogler 2024-11-07 15:58:00 +00:00

Gregor Weiss added 1 commit 2024-11-08 10:04:31 +00:00

Docstring in libbwc.c and bits of renaming. d49754381b

Gregor Weiss changed title from ~~WIP: feat/api~~ to feat/api

2024-11-08 10:06:27 +00:00

Gregor Weiss added this to the Interfaces project 2024-11-08 10:09:28 +00:00

This pull request can be merged automatically.

You are not authorized to merge this pull request.

View command line instructions

Checkout

From your project repository, check out a new branch and test the changes.

git fetch -u origin feat/api:feat/api

git checkout feat/api

No reviewers

No labels

No milestone

No project

No assignees

1 participant

Notifications

Due date

The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference: TOPIO/BigWhoop#46

No description provided.