<Guest12257>
hi, how does Wallaroo work with checkpointing on Kubernetes?
<Guest12257>
Our stack is kafka + kubernetes
<Guest12257>
We are evaluating using Wallaroo to do stateful streaming computation, but not sure about the best way of checkpointing
<slfritchie>
Guest12257: We have little direct experience with running Wallaroo + resilience (which enables checkpointing) on Kubernetes. Consensus on the Internet still recommends not running stateful apps on Kubernetes unless you know exactly what you're doing (and have automated/codified all that knowledge). The management module/plugin/thingies that I've seen to manage Kafka and Cassandra haven't instilled lots of confidence...
<slfritchie>
... in me, though I confess I don't follow those projects closely.
<slfritchie>
We have a mechanism for replicating state data on Wallaroo worker machine A to another machine B, but if you also manage B with Kubernetes, then you've got mostly the same problem.