Chain two multiprocessing scripts - python

Question

I have two scripts, they are both multiprocessing utilized scripts.

build.py reads from a db and spits out a text file. Parallel jobs are launched to do this.

push.py inserts/updates this text file to a persistent DB. Again, this is multiprocessing too.

Currently I have two separate crontab commands to do this. I want build.py to launch push.py then terminate itself, how can I do this?

Graham · Accepted Answer · 2017-09-27 05:59:25Z

1

You can just use subprocess

In build.py

import subprocess

def main():
    # Do multiprocessing code, wait for all processes to finish
    ...

    # Launch push.py and exit
    subprocess.Popen(['python', '/path/to/push.py'])

if __name__ == '__main__':
    main()

edited Sep 27, 2017 at 5:59

Graham

7,86020 gold badges67 silver badges92 bronze badges

answered Jul 21, 2016 at 19:59

Brendan Abel

38k15 gold badges101 silver badges126 bronze badges

Sign up to request clarification or add additional context in comments.

1 Comment

TylerH Over a year ago

Also temporary congrats on being the first to earn the Bluebook badge!

Collectives™ on Stack Overflow

Chain two multiprocessing scripts - python

1 Answer 1

1 Comment

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

1 Comment

Related