Unable to get output of shell script run from python

Question

I want to run a script multiple times, with different paths as arguments, and see the output.

If I run the script path/lizard with argument path_to_code/code1.cpp in a command prompt

path/lizard path_to_code/code1.cpp

I get output - and I would like to run this script on multiple files.

Looking at this and similar questions, I tried

import os, glob

def run_command(command):
    os.system(command)    

program = '"C:/Python27/Scripts/lizard.bat "'
path = '"path_to_code/*.cpp"'
for path1 in glob.glob(path):
    command = program + path1
    run_command(command)

No output.

import glob, subprocess

def run_command(command):
    p = subprocess.Popen(command, stdout=subprocess.PIPE, stderr=subprocess.STDOUT)
    out, err = p.communicate()
    print out

program = '"C:/Python27/Scripts/lizard.bat "'
path = '"path_to_code/*.cpp"'
for path1 in glob.glob(path):
    command = program + path1
    run_command(command)

No output.

(of course i want to iterate recursively through directory but that is next step).

How can I get the output of the program running from script ? I think logically both versions should get me the output... What am I doing wrong ?

The trailing space in the double quotes around the path to the python script looks wrong to me. Does removing that help? — Etan Reisner
– Etan Reisner, Commented May 15, 2015 at 16:05
@EtanReisner without it, the path and the argument are in a single string and there is no such program. — Thalia
– Thalia, Commented May 15, 2015 at 16:06
@Doon that is exactly the question I quoted and what I tried to get working, see second example — Thalia
– Thalia, Commented May 15, 2015 at 16:06
You need a space after the quote I agree but inside the quote seems unlikely (unless you can use "C:/Python27/Scripts/lizard.bat ""path_to_code/*.cpp" at your command prompt correctly or python is stripping those quotes somewhere). — Etan Reisner
– Etan Reisner, Commented May 15, 2015 at 16:07

Doon · Accepted Answer · 2015-05-15 16:44:56Z

1

Try using subprocess.check_output

it should do what you want.

[~] cat foo.sh
#!/bin/sh

echo "Hello World!"

[~] python2.7
Python 2.7.6 (default, Sep  9 2014, 15:04:36)
[GCC 4.2.1 Compatible Apple LLVM 6.0 (clang-600.0.39)] on darwin
Type "help", "copyright", "credits" or "license" for more information.
>>> import subprocess
>>> foo = subprocess.check_output('./foo.sh')
>>> foo
'Hello World!\n'
>>>

so in your specific example

def run_command(command):
    return subprocess.check_output(command,stderr=subprocess.STDOUT)

answered May 15, 2015 at 16:44

Doon

20.3k3 gold badges42 silver badges44 bronze badges

Sign up to request clarification or add additional context in comments.

1 Comment

Thalia Over a year ago

Thank you - My mistake was in how I wrote the arguments, which was caught by Ethan Reisner. This is good learning for me still

Goldfishslayer · Accepted Answer · 2015-05-15 16:45:08Z

1

From what I see you forgot to call communicate on the process. Try

def run_command(command):
    p = subprocess.Popen(command, stdout=subprocess.PIPE, stderr=subprocess.STDOUT)
    stdout, stderr = p.communicate()
    return iter(stdout, b'')

See https://docs.python.org/2/library/subprocess.html?highlight=popen.communicate#subprocess.Popen.communicate

Cheers

answered May 15, 2015 at 16:45

Goldfishslayer

4504 silver badges10 bronze badges

3 Comments

Goldfishslayer Over a year ago

Doon's answer might be more suited for your needs but restricts you to Python 2.7 (if that is any concern to you that is ;))

Thalia Over a year ago

Thanks, I did try the communicate... I wrote that in comment... My mistake was in how I wrote the arguments, which was caught by Ethan Reisner

Thalia Over a year ago

Thank you for the example still, I upvoted it since it does give good info.

Thalia · Accepted Answer · 2015-05-15 17:02:09Z

based on the comments to my question, I tried

program = 'C:/Python27/Scripts/lizard.bat'
...
command = [program, path1]

worked - and then I realized that the quotes were the problem, Etan Reisner was correct. Eliminating them made it work.

Complete corrected code:

import os, subprocess, fnmatch

def run_command(command):
    p = subprocess.Popen(command, stdout=subprocess.PIPE, stderr=subprocess.STDOUT)
    out, err = p.communicate()
    print out

program = 'C:/Python27/Scripts/lizard.bat'
path = 'path_to_code'
matches = []
for root, dirs, filenames in os.walk(path):
    for filename in fnmatch.filter(filenames, '*.cpp'):
         matches.append(os.path.join(root, filename))

for path1 in matches:
    command = [program, path1]
    run_command(command)

Collectives™ on Stack Overflow

Unable to get output of shell script run from python

3 Answers 3

1 Comment

3 Comments

Comments

Linked

Hot Network Questions

Collectives™ on Stack Overflow

3 Answers 3

1 Comment

3 Comments

Comments

Linked

Related