[Dancer-users] Web-front end for long-running processes

Assaf Gordon gordon at cshl.edu
Thu Sep 20 17:46:28 CEST 2012


Hello,

I'm planning a web site (w/ Dancer, of course :) ) that will execute shell scripts (to compute some results) and eventually return the results to the user.

The web-side is simple enough, but the shell scripts might take anywhere between 10 seconds to 10 minutes to execute.

Is there a recommended way to manage external jobs for this type of scenario ?
One extreme is to use SGE/PBS and build a whole database-backed-up queuing system.
The other is perhaps to execute the shell scripts (serialized, one after the other) and just send the results to the users by email.

But if anyone has experience with something similar, any advice will be appreciated.
(This is supposed to be a short-term project, just a front-end to some unix scripts - so I prefer to keep it simple, not build a full-fledged infrastructure from scratch).

Thanks, 
 -gordon


More information about the Dancer-users mailing list