When/How does an anonymous file object close?

Question

In the comments of this question about a python one-liner, it occurred to me I have no idea how python handles anonymous file objects. From the question:

open(to_file, 'w').write(open(from_file).read())

There are two calls to open without using the with keyword (which is usually how I handle files). I have, in the past, used this kind of unnamed file. IIRC, it seemed there was a leftover OS-level lock on the file that would expire after a minute or two.

So what happens to these file handles? Are they cleaned up by garbage collection? By the OS? What happens to the Python machine and file when close() is called, and will it all happen anyway when the script finishes and some time passes?

cdarke · Accepted Answer · 2016-07-29 14:12:36Z

Monitoring the file descriptor on Linux (by checking /proc/$$/fds) and the File Handle on Windows (using SysInternals tools) it appears that the file is closed immediately after the statement.

This cannot be guarenteed however, since the garbage collector has to execute. In the testing I have done it does get closed at once every time.

The with statement is recommended to be used with open, however the occasions when it is actually needed are rare. It is difficult to demonstrate a scenario where you must use with, but it is probably a good idea to be safe.

So your one-liner becomes:

with open(to_file, 'w') as tof, open(from_file) as fof:
    tof.write(fof.read())

The advantage of with is that the special method (in the io class) called __exit__() is guaranteed* to be called.

* Unless you do something like os._exit().

Francisco · Accepted Answer · 2016-07-29 14:31:26Z

2

The files will get closed after the garbage collector collects them, CPython will collect them immediately because it uses reference counting, but this is not a guaranteed behavior.

If you use files without closing them in a loop you might run out of file descriptors, that's why it's recommended to use the with statement (if you're using 2.5 you can use from __future__ import with_statement).

edited Jul 29, 2016 at 14:31

answered Jul 29, 2016 at 14:01

Francisco

11.6k6 gold badges37 silver badges47 bronze badges

Collectives™ on Stack Overflow

When/How does an anonymous file object close?

2 Answers 2

Comments

Comments

Linked

Hot Network Questions

Collectives™ on Stack Overflow

2 Answers 2

Comments

Comments

Linked

Related