Capture subprocess output [duplicate]

Question

I learned that when executing commands in Python, I should use subprocess. What I'm trying to achieve is to encode a file via ffmpeg and observe the program output until the file is done. Ffmpeg logs the progress to stderr.

If I try something like this:

child = subprocess.Popen(command, shell=True, stderr=subprocess.PIPE)
complete = False
while not complete:
    stderr = child.communicate()

    # Get progress
    print "Progress here later"
    if child.poll() is not None:
        complete = True
    time.sleep(2)

the programm does not continue after calling child.communicate() and waits for the command to complete. Is there any other way to follow the output?

Community · Accepted Answer · 2017-05-23 12:16:53Z

27

communicate() blocks until the child process returns, so the rest of the lines in your loop will only get executed after the child process has finished running. Reading from stderr will block too, unless you read character by character like so:

import subprocess
import sys
child = subprocess.Popen(command, shell=True, stderr=subprocess.PIPE)
while True:
    out = child.stderr.read(1)
    if out == '' and child.poll() != None:
        break
    if out != '':
        sys.stdout.write(out)
        sys.stdout.flush()

This will provide you with real-time output. Taken from Nadia's answer here.

edited May 23, 2017 at 12:16

CommunityBot

11 silver badge

answered Mar 26, 2010 at 17:47

Vlad the Impala

16k19 gold badges86 silver badges130 bronze badges

Sign up to request clarification or add additional context in comments.

2 Comments

jfs Over a year ago

you don't need child.poll() here; you could call child.wait() at the end instead

Psionman Over a year ago

As a pedant, != None is better written is not None

ephemient · Accepted Answer · 2010-03-26 17:42:29Z

1

.communicate() "Read data from stdout and stderr, until end-of-file is reached. Wait for process to terminate."

Instead, you should be able to just read from child.stderr like an ordinary file.

answered Mar 26, 2010 at 17:42

ephemient

206k39 gold badges292 silver badges402 bronze badges

Collectives™ on Stack Overflow

Capture subprocess output [duplicate]

2 Answers 2

2 Comments

Comments

Linked

Hot Network Questions

Collectives™ on Stack Overflow

2 Answers 2

2 Comments

Comments

Linked

Related