If most of the latency is from spark, I’m wondering if it’s possible to run the incremental single-event classification task without spark.
We’re looking for realtime dup-detection on a single event. So ideally sub-second.
If the incremental “batch” is a single event, does it still take that long?
That captures my emotion :)
Hi Sonal G., what kind of latency can we expect in an incremental setting with the enterprise version?