Executing process on Linux from WSGI based web application

Question

I have a dashboard and I want a process to run when the user clicks on a button. That process might take a long time to complete.

My options so far:

using popen or something similar to execute the process
having a daemon monitor a directory. When this directory is changed (a file created) the daemon will do the job and then delete the file before idling again.
using cron, running every 5 seconds and also monitoring some directory.

Which one is more Linux-friendly? Is there any I have not considered?

celery

jfs
– jfs

2012-08-22 18:32:42 +00:00
Commented Aug 22, 2012 at 18:32 — jfs
– jfs, Commented Aug 22, 2012 at 18:32
Looks promising, but a bit overkilling in this case.

martincho
– martincho

2012-08-22 18:35:39 +00:00
Commented Aug 22, 2012 at 18:35 — martincho
– martincho, Commented Aug 22, 2012 at 18:35

Graham Dumpleton · Accepted Answer · 2012-08-23 01:16:28Z

1

This is what task queueing systems like Celery and Redis Queue are for.

answered Aug 23, 2012 at 1:16

Graham Dumpleton

58.7k6 gold badges128 silver badges142 bronze badges

Sign up to request clarification or add additional context in comments.

Comments

Laurent Parenteau · Accepted Answer · 2012-08-22 20:59:41Z

1

Another option is to have a daemon (as in your 2nd option) that listen on some socket. Then, your WSGI application could just connect & send a command. There are many possibilities for how the communication over the socket would take place, choosing the right one depends a lot on the actual case.

This have the advantage that you can eventually have the two application (WSGI and the daemon) run on different computers or VMs at some point.

answered Aug 22, 2012 at 20:59

Laurent Parenteau

2,58621 silver badges32 bronze badges

Collectives™ on Stack Overflow

Executing process on Linux from WSGI based web application

2 Answers 2

Comments

Comments

Hot Network Questions

Collectives™ on Stack Overflow

2 Answers 2

Comments

Comments

Related