Add async raw S3 packet writes#124
Conversation
ac6e515 to
f90b6fa
Compare
|
| Filename | Overview |
|---|---|
| src/common_s3.cpp | New S3 write implementation — async PutObject pipeline with correct mutex/CV lifecycle, staging-buffer management, and AWS SDK refcount. Stub fns provided for disabled builds. |
| include/daqiri/common.h | Adds S3WriterConfig, S3WriteStatus, S3Writer/S3WriteHandle opaque types, and six new API functions. Follows existing BurstParams-free-contract conventions. |
| python/daqiri_common_pybind.cpp | Adds PyS3Writer/PyS3WriteHandle RAII wrappers with GIL-release on blocking calls; write_raw_objects correctly handles wait+destroy sequence without double-free. |
| src/CMakeLists.txt | Adds DAQIRI_ENABLE_S3 CMake option; common_s3.cpp unconditionally compiled with stub fns when disabled; socket→rdma invariant untouched. |
| Dockerfile | Builds AWS SDK for C++ S3-only from source; pinned version via AWS_SDK_CPP_VERSION ARG with sane defaults; SDK installed unconditionally in base image. |
| cmake/daqiriConfig.cmake.in | Correctly propagates DAQIRI_ENABLE_S3 and calls find_dependency(AWSSDK COMPONENTS s3) for downstream CMake consumers when S3 is enabled. |
Reviews (4): Last reviewed commit: "#124 - Guard S3 helpers in disabled buil..." | Re-trigger Greptile
Signed-off-by: Cliff Burdick <cburdick@nvidia.com>
Signed-off-by: Cliff Burdick <cburdick@nvidia.com>
Signed-off-by: Cliff Burdick <cburdick@nvidia.com>
857467d to
1f73c20
Compare
Signed-off-by: Cliff Burdick <cburdick@nvidia.com>
* #124 - Add async raw S3 packet writes Signed-off-by: Cliff Burdick <cburdick@nvidia.com>
No description provided.