From fe5a2e088a49d5da60327b26f4124954192dbca0 Mon Sep 17 00:00:00 2001 From: Haoqiong Bian Date: Sun, 16 Aug 2026 18:30:15 +0800 Subject: [PATCH 1/4] add hdfs survey --- README.md | 8 ++++++-- 1 file changed, 6 insertions(+), 2 deletions(-) diff --git a/README.md b/README.md index 63cbea216..c5fe6dc34 100644 --- a/README.md +++ b/README.md @@ -118,8 +118,8 @@ is compatible with the mainstream data analytic ecosystems. The key ideas and insights in Pixels are elaborated in the following publications. > [Transactional Data Change for Real-Time Analytics in Lakehouses]() -Dongyang Geng, Haoqiong Bian, Zinuo Li, Haoyue Li -*Proceedings of the VLDB Endowment, Volume 19* (**VLDB'26**) + Dongyang Geng, Haoqiong Bian, Zinuo Li, Haoyue Li + *Proceedings of the VLDB Endowment, Volume 19* (**VLDB'26**) > [How Consistent and Fresh are Lake Tables Really](https://doi.org/10.1145/3802514.3812602) Zinuo Li, Dongyang Geng, Haoyue Li, Hailong Yu, Qi Lei, Haoqiong Bian @@ -149,6 +149,10 @@ Dongyang Geng, Haoqiong Bian, Zinuo Li, Haoyue Li Haoqiong Bian *10th Annual Conference on Innovative Data Systems Research* (**CIDR'20**) +> [HDFS存储和优化技术研究综述 (Survey on Storage and Optimization Techniques of HDFS)](https://www.jos.org.cn/jos/article/abstract/5872) + Guodong Jin, Haoqiong Bian, Yueguo Chen, Xiaoyong Du + *Journal of Software, 2020, 31(1): 137-161* + > [Rainbow: Adaptive Layout Optimization for Wide Tables (demo)](https://doi.org/10.1109/ICDE.2018.00200) Haoqiong Bian, Youxian Tao, Guodong Jin, Yueguo Chen, Xiongpai Qin, Xiaoyong Du *Proceedings of the 34th IEEE International Conference on Data Engineering* (**ICDE'18**) From f5177fca4219648ccd674a4ee3c74ce931cefa96 Mon Sep 17 00:00:00 2001 From: Haoqiong Bian Date: Sun, 16 Aug 2026 18:41:38 +0800 Subject: [PATCH 2/4] classify publications --- README.md | 13 +++++++++---- 1 file changed, 9 insertions(+), 4 deletions(-) diff --git a/README.md b/README.md index c5fe6dc34..5c31fc23c 100644 --- a/README.md +++ b/README.md @@ -117,6 +117,7 @@ Pixels is an academic system aims at providing production-grade quality. It supp is compatible with the mainstream data analytic ecosystems. The key ideas and insights in Pixels are elaborated in the following publications. +### Real-Time Analytics > [Transactional Data Change for Real-Time Analytics in Lakehouses]() Dongyang Geng, Haoqiong Bian, Zinuo Li, Haoyue Li *Proceedings of the VLDB Endowment, Volume 19* (**VLDB'26**) @@ -125,6 +126,11 @@ The key ideas and insights in Pixels are elaborated in the following publication Zinuo Li, Dongyang Geng, Haoyue Li, Hailong Yu, Qi Lei, Haoqiong Bian *Proceedings of the 1st International Workshop on Data FORMATS for Modern Architectures and Workloads* (**FORMATS'26 @ SIGMOD**) +> [Pixels: Multiversion Wide Table Store for Data Lakes (abstract)](https://www.cidrdb.org/cidr2020/gongshow2020/gongshow/abstracts/cidr2020_abstract74.pdf) + Haoqiong Bian + *10th Annual Conference on Innovative Data Systems Research* (**CIDR'20**) + +### Elastic Query Processing > [PixelsDB: Serverless and NL-Aided Data Analytics with Flexible Service Levels and Prices (demo)](https://doi.org/10.1109/ICDE65448.2025.00365) Haoqiong Bian, Dongyang Geng, Haoyang Li, Yunpeng Chai, Anastasia Ailamaki *Proceedings of the 41st IEEE International Conference on Data Engineering* (**ICDE'25**) @@ -137,18 +143,17 @@ The key ideas and insights in Pixels are elaborated in the following publication Haoqiong Bian, Tiannan Sha, Anastasia Ailamaki *Proceedings of the 2023 ACM International Conference on Management of Data* (**SIGMOD'23**) +### Caching > [Columnar Storage Optimization and Caching for Data Lakes (short)](https://doi.org/10.48786/edbt.2022.33) Guodong Jin, Haoqiong Bian, Yueguo Chen, Xiaoyong Du *Proceedings of the 25th International Conference on Extending Database Technology* (**EDBT'22**) + +### File Formats > [Pixels: An Efficient Column Store for Cloud Data Lakes](https://doi.org/10.1109/ICDE53745.2022.00276) Haoqiong Bian, Anastasia Ailamaki *Proceedings of the 38th IEEE International Conference on Data Engineering* (**ICDE'22**) -> [Pixels: Multiversion Wide Table Store for Data Lakes (abstract)](https://www.cidrdb.org/cidr2020/gongshow2020/gongshow/abstracts/cidr2020_abstract74.pdf) - Haoqiong Bian - *10th Annual Conference on Innovative Data Systems Research* (**CIDR'20**) - > [HDFS存储和优化技术研究综述 (Survey on Storage and Optimization Techniques of HDFS)](https://www.jos.org.cn/jos/article/abstract/5872) Guodong Jin, Haoqiong Bian, Yueguo Chen, Xiaoyong Du *Journal of Software, 2020, 31(1): 137-161* From 63e356398c963e8e41a28f6d009c33f922bb7a0e Mon Sep 17 00:00:00 2001 From: Haoqiong Bian Date: Sun, 16 Aug 2026 18:41:58 +0800 Subject: [PATCH 3/4] classify publications --- README.md | 1 - 1 file changed, 1 deletion(-) diff --git a/README.md b/README.md index 5c31fc23c..2dfdc70c4 100644 --- a/README.md +++ b/README.md @@ -148,7 +148,6 @@ The key ideas and insights in Pixels are elaborated in the following publication Guodong Jin, Haoqiong Bian, Yueguo Chen, Xiaoyong Du *Proceedings of the 25th International Conference on Extending Database Technology* (**EDBT'22**) - ### File Formats > [Pixels: An Efficient Column Store for Cloud Data Lakes](https://doi.org/10.1109/ICDE53745.2022.00276) Haoqiong Bian, Anastasia Ailamaki From 48d548aa5e5c7992dd4224ebe3de0ffd9805a567 Mon Sep 17 00:00:00 2001 From: Haoqiong Bian Date: Sun, 16 Aug 2026 18:45:17 +0800 Subject: [PATCH 4/4] update comments --- .../io/pixelsdb/pixels/core/reader/PixelsRecordReader.java | 4 ++-- .../pixelsdb/pixels/core/reader/PixelsRecordReaderImpl.java | 2 +- 2 files changed, 3 insertions(+), 3 deletions(-) diff --git a/pixels-core/src/main/java/io/pixelsdb/pixels/core/reader/PixelsRecordReader.java b/pixels-core/src/main/java/io/pixelsdb/pixels/core/reader/PixelsRecordReader.java index a07875959..a45b32370 100644 --- a/pixels-core/src/main/java/io/pixelsdb/pixels/core/reader/PixelsRecordReader.java +++ b/pixels-core/src/main/java/io/pixelsdb/pixels/core/reader/PixelsRecordReader.java @@ -31,7 +31,7 @@ public interface PixelsRecordReader extends AutoCloseable { /** - * Prepare for the next row batch. This method is independent from readBatch(). + * Prepare for the next row batch. This method is independent of readBatch(). * * @param batchSize the willing batch size * @return the real batch size @@ -39,7 +39,7 @@ public interface PixelsRecordReader extends AutoCloseable int prepareBatch(int batchSize) throws IOException; /** - * Read the next row batch. This method is thread-safe and independent from prepareBatch(). + * Read the next row batch. This method is thread-safe and independent of prepareBatch(). * * @param batchSize the row batch size * @return vectorized row batch diff --git a/pixels-core/src/main/java/io/pixelsdb/pixels/core/reader/PixelsRecordReaderImpl.java b/pixels-core/src/main/java/io/pixelsdb/pixels/core/reader/PixelsRecordReaderImpl.java index b294e6887..f613ec00e 100644 --- a/pixels-core/src/main/java/io/pixelsdb/pixels/core/reader/PixelsRecordReaderImpl.java +++ b/pixels-core/src/main/java/io/pixelsdb/pixels/core/reader/PixelsRecordReaderImpl.java @@ -941,7 +941,7 @@ private boolean read() throws IOException private int preRGIdx = 0; /** - * Prepare for the next row batch. This method is independent from {@link #readBatch(int, boolean)}. + * Prepare for the next row batch. This method is independent of {@link #readBatch(int, boolean)}. * * @param batchSize the willing batch size. * @return the real batch size.