Hi Sean, I'm trying to test a timeout feature in a tool that uses Spark SQL. Basically, if a long-running query exceeds a configured threshold, then the query should be canceled. I couldn't see a simple way to make a "sleep" SQL statement to test the timeout. Instead, I just ran a "select count(*) from table" on a large table to act as a query with a long duration.
Is there any way to trigger a "sleep" like behavior in Spark SQL? Regards, Ram On Tue, May 17, 2022 at 4:23 PM Sean Owen <sro...@gmail.com> wrote: > I don't think that is standard SQL? what are you trying to do, and why not > do it outside SQL? > > On Tue, May 17, 2022 at 6:03 PM K. N. Ramachandran <knra...@gmail.com> > wrote: > >> Gentle ping. Any info here would be great. >> >> Regards, >> Ram >> >> On Sun, May 15, 2022 at 5:16 PM K. N. Ramachandran <knra...@gmail.com> >> wrote: >> >>> Hello Spark Users Group, >>> >>> I've just recently started working on tools that use Apache Spark. >>> When I try WAITFOR in the spark-sql command line, I just get: >>> >>> Error: Error running query: >>> org.apache.spark.sql.catalyst.parser.ParseException: >>> >>> mismatched input 'WAITFOR' expecting (.. list of allowed commands..) >>> >>> >>> 1) Why is WAITFOR not allowed? Is there another way to get a process to >>> sleep for a desired period of time? I'm trying to test a timeout issue and >>> need to simulate a sleep behavior. >>> >>> >>> 2) Is there documentation that outlines why WAITFOR is not supported? I >>> did not find any good matches searching online. >>> >>> Thanks, >>> Ram >>> >> >> >> -- >> K.N.Ramachandran >> Ph: 814-441-4279 >> > -- K.N.Ramachandran Ph: 814-441-4279
