Accidentally exponential behavior in Spark
Associated with
Ivan Vergiliev Ivan Vergiliev
7 min read
Accidentally exponential behavior in Spark

An unexpected algorithmic gotcha caused a tree-processing algorithm to perform an exponential number of operations. Here's how we managed to work around the problem on our side without depending on Spark for a fix.

More Ways to Read:
🧃 Juice It The key takeaways that can be read in under a minute
Sign up to unlock