Erofs advances container efficiency with page cache sharing

The Enhanced Read-Only File System, or EROFS, has introduced page cache sharing to significantly reduce memory usage in containerized environments. This feature allows multiple containers to share cached pages from the same file system image, cutting memory waste by 40% to 60%. Developed initially by Huawei, EROFS is gaining traction in cloud and edge computing scenarios.

Originally created by Huawei for mobile devices, EROFS has evolved into a key tool for container orchestration in cloud and edge settings. The new page cache sharing feature enables multiple instances of identical file system images to share memory caches, avoiding redundant copies that inflate resource demands. In container-heavy workloads, such as those in Kubernetes, this addresses duplicative caching that hampers performance during rapid pod spin-ups.

Kernel contributors, including Hongzhen Luo and Hongbo Li, have driven this development through patch series submitted to the Linux Kernel Mailing List. The latest version, v11, refines earlier prototypes by fixing bugs, adding readahead support, and improving compatibility with fscache mode and anonymous files. These patches build on work from earlier in the year and target integration into kernels from version 5.16 onward, leveraging the folio infrastructure for efficient memory management.

Benchmarks demonstrate clear benefits. Tests with Android container images showed significant memory reductions when sharing caches across mounts. For example, deploying similar TensorFlow containers on one node achieved up to 20% memory savings, while broader container scenarios yielded 40% to 60% cuts during peak loads like boot storms. Phoronix reports highlight improved read throughput alongside lower memory consumption, especially for overlapping data in machine learning workflows.

The 'sharecache' mount option activates this capability, ensuring safe shared access via techniques like copy-on-write. Community discussions on platforms like X praise its potential, with one post noting it could "cut container memory waste by 40-60%," reducing costs for hyperscale operators. Adoption is expanding beyond Huawei, attracting contributors from Alibaba and others, as EROFS competes with systems like SquashFS through superior compression and caching.

Challenges include securing shared caches against data leaks between containers, with maintainers debating edge cases on the mailing list. Future integrations with cgroups and tools like CRI-O or Docker could enhance density in microservices and IoT gateways, promoting sustainable computing in data-intensive environments.

Relaterede artikler

Illustration of Linux kernel 6.19 release with Tux penguin, scheduling enhancements, Microsoft C extensions, and collaborating tech giants for a news article.
Billede genereret af AI

Linux kernel 6.19 adds scheduling enhancements and Microsoft C extensions

Rapporteret af AI Billede genereret af AI

The upcoming Linux kernel 6.19 introduces key improvements to the sched_ext framework for better eBPF scheduler recovery and integrates Microsoft C extensions for cleaner code compilation. These updates aim to enhance stability, performance, and developer efficiency in various computing environments. Contributions from companies like Google, Meta, and Microsoft highlight growing collaboration in open-source development.

Developers are exploring page cache sharing as a way to improve performance for EROFS containers. This technique appears to offer significant advantages in Linux environments. The findings come from Phoronix, a site focused on Linux hardware and software reviews.

Rapporteret af AI

Kernel developer Cong Wang has introduced DAXFS, a new read-only filesystem designed for direct access to shared memory in Linux. Built on the Direct Access infrastructure, it bypasses traditional page caching to reduce memory overhead. The proposal aims to enable efficient sharing of data across kernels and devices.

Following the recent approval of Rust as a permanent kernel language at the 2025 Kernel Maintainers Summit, new details emerge on performance benchmarks, ongoing challenges, and distribution rollouts, solidifying its role in addressing security vulnerabilities.

Rapporteret af AI

Building on Rust's new permanent status in the Linux kernel—following its history from 2019 experiments to the Tokyo Maintainers Summit approval—production deployments like Android 16's Rust allocator are live, alongside advanced drivers and safety gains, though criticisms highlight ongoing hurdles.

Developers are proposing to enable Intel's Transactional Synchronization Extensions (TSX) by default in the upcoming Linux 7.0 kernel on supported CPUs. This change aims to improve performance without requiring manual configuration. The move targets hardware capable of utilizing TSX features.

Rapporteret af AI

Linus Torvalds has announced the release of Linux 6.18-rc1, marking the start of the release candidate phase for the upcoming kernel version. He described the preceding two-week merge window as 'one of the good merge windows,' noting its average size and lack of serious issues during testing. The kernel includes extensive driver updates and enhancements across various subsystems.

 

 

 

Dette websted bruger cookies

Vi bruger cookies til analyse for at forbedre vores side. Læs vores privatlivspolitik for mere information.
Afvis