Skip to main content

Romain

Paris, France

http://romain.dorgueil.net/

Technology Manager at L'Atelier BNP Paribas.

Python, Startups, Linux and more ...

Read my thoughts and visit my web lab at http://romain.dorgueil.net/

#SOreadytohelp

Jan
5
awarded Populist
2025
Jul
17
awarded Autobiographer
Feb
6
awarded Autobiographer
2024
Mar
20
awarded Yearling
Mar
20
awarded Yearling
2023
Apr
5
awarded Good Answer
2021
Sep
3
awarded Yearling
Sep
3
awarded Yearling
Apr
1
awarded Nice Answer
Jan
3
awarded Supporter
2020
Nov
13
awarded Necromancer
Jul
17
awarded Constituent
Jul
17
accepted How to have a buildbot GitPoller change source watch all branches?
Jul
17
awarded Caucus
Jul
17
answered Django: show the count of related objects in admin list_display
2019
Jun
10
awarded Commentator
Jun
10
comment Bonobo ETL: How to provide global context to all nodes during execution?
I think you'd be better of by having some kind of "file metadata" object created from the file object, handle the file cleanly in one node and only use the (readonly) metadata in the other nodes. Using python file objects with random open/close timings and overall file handle availability in nodes that run . in an unpredictable order would for sure bring you into trouble at some point.
Jun
6
comment Bonobo ETL: How to provide global context to all nodes during execution?
I think the approach work, but not after the record extractor. I can't see why you would want the file object after this place, especially because sharing objects between threads like this can be (well, is) very dangerous. Also, I would tend to pass filenames instead of file objects from one node to another so the node responsible for file operations can handle it correctly (like a context manager, with a finally: close())
Jun
6
answered Bonobo ETL: How to provide global context to all nodes during execution?
Jun
6
answered How to send namedtuples between tranformations?
1 2 3 4