Skip to content

DataSysResearch/CStream

CStream

CStream is the research artifact for adaptive stream compression on modern multicore processors. It contains the pipeline-stage implementation, roofline-analysis tools, datasets, experiment configurations, energy-meter support, and scripts used to evaluate CStream.

Project status

This is a DataSys stream-processing research artifact accompanying the CStream paper. It is organized for reproducibility rather than as a general-purpose compression library.

Repository layout

  • 1.Fine-grained-stages/: fine-grained compression pipeline stages.
  • 2-Roofline-acquiring/: roofline measurement tools.
  • 3-Dataset/: dataset preparation assets.
  • 4-Config-files/: experiment configurations.
  • 5-Energy-meter/: host and microcontroller energy-measurement support.
  • 6-Scripts/: experiment scripts.
  • 7-enrichedForTKDE/: material added for the TKDE evaluation.

See the README in each component directory for its prerequisites and commands.

Publications

  • Xianzhi Zeng and Shuhao Zhang. "CStream: Parallel Data Stream Compression on Multicore Edge Devices." IEEE Transactions on Knowledge and Data Engineering, 36(11): 5889-5904, 2024. https://doi.org/10.1109/TKDE.2024.3386862
  • Xianzhi Zeng and Shuhao Zhang. "Parallelizing Stream Compression for IoT Applications on Asymmetric Multicores." IEEE 39th International Conference on Data Engineering, 2023. https://doi.org/10.1109/ICDE55515.2023.00078
  • Xianzhi Zeng and Shuhao Zhang. "A Hardware-Conscious Stateful Stream Compression Framework for IoT Applications (Vision)." 17th ACM International Conference on Distributed and Event-Based Systems, 2023. https://doi.org/10.1145/3583678.3596885

License

The repository is licensed under Apache License 2.0. Third-party components and drivers retain their own notices.

About

Hardware-conscious parallel data-stream compression for multicore edge devices.

Resources

Code of conduct

Contributing

Security policy

Stars

Watchers

Forks

Releases

Packages

Contributors

Languages