Open Source Summit + Embedded Linux Conference North America 2026

With the growth of CPU compute and larger memory heaps, many cloud-native workloads that traditionally relied on remote caches like Redis and Memcached can now benefit from in-process caching using open source libraries.

In this session, we focus on Java-based cloud-native services and show how local caches, such as Caffeine, can colocate cache with application logic, reducing network overhead, simplifying consistency management, and improving latency. Drawing on large-scale production experience, we’ll explore cache invalidation, freshness guarantees, near-cache patterns, and scalability trade-offs, along with practical lessons for handling staleness, TTLs, and other caching challenges while reducing operational complexity and cost.

Finally, we’ll discuss how emerging open source tools like Databricks’ Dicer apply these caching and orchestration principles at scale for real-time services, representing the next frontier. Attendees will learn methods to design low-latency, high-throughput, maintainable, and cost-efficient caching solutions for cloud-native architectures using open source tools.