To slightly over simplify, all it takes to be a TLP for Apache is: 1) clear community support 2) a couple Apache members to sponsor (Incubator members help) 3) demonstrated processes that follow the Apache way 4) the will of committers and PMC to move to TLP
What is missing in Livy? I am starting to use Livy but like anyone who sees the “incubator” will be overly cautious. There is a clear need for this project beyond the use cases mentioned. For instance we have a Machine Learning Server that tries to be compute engine neutral but practically speaking uses Spark and HDFS for several algorithms. We would have a hard time scaling a service that runs the Spark Driver in the server process. The solution may well be Livy. Here’s hoping Livy becomes a TLP - Pat