All Questions
9 questions
0
votes
0
answers
60
views
How to parallelize long-running IO operations in a multi-threaded Python application with asyncio?
I am building a Python application that uses an event loop (via the asyncio library) to listen for tick data from a cryptocurrency exchange via a WebSocket. The tick data comes for various symbols, ...
- 1,719
1
vote
1
answer
187
views
multiprocessing vs. threading for communicating from osc server to gui
I'm currently quite undecided on what is actually the best approach to tackle this problem.
Assuming the program only consists of:
GUI using imgui and glfw
OSC Server that listens for incoming ...
- 23
-1
votes
1
answer
1k
views
Unable to animate GIF when Qt app runs in a seperate thread
I want to use PyQt to display a selected static image or an animated gif using QLabel widget. For my specific use case, I am only using Qt to display the image while rest of my Python code does NOT ...
- 1,232
0
votes
1
answer
390
views
How to distribute python script for parallel but sequential processing of large scale data?
Here is the scenario that we have to solve :
Pull all PDF files from server.
convert PDF to PNGs
do some mining on PNGs and generate TXT
parse TXT to generate CSV
merge CSV
I have written a ...
- 352
0
votes
1
answer
130
views
multi-thread application with queue, best approach to deliver each reply to the right caller?
Consider a multi-thread application, in which different pieces of code send commands to a background thread/service through a command queue, and consequently the service puts the replies in a reply ...
1
vote
0
answers
156
views
"WindowsError: access violation 000001" on DispatchMessageW in EventLoop
I research Python internals and write GUI Generic windows use Windows API.
# -*- coding: utf-8 -*-
import time
import threading
import logging
import uuid
import ctypes
import ctypes.wintypes
...
- 442
2
votes
1
answer
492
views
Preforking a Multithreaded Python application
I have a Python program that is already multithreaded and I'd like to replace some of the threads with processes in order to reduce context switching and utilize gevent for async I/O.
The main process ...
- 19.2k
2
votes
2
answers
389
views
Architecture for interactive webapp with concurrent users and heavy data processing
I've run into a specific problem and thought of an solution. But since the solution is pretty involved, I was wondering if others have encountered something similar and could comment on best practises ...
- 353
1
vote
1
answer
2k
views
Python - Best practices to queue / dequeue threads
I have a queue which can contain max 4 queued objects. These objects are threads running web service requests. The thread part is OK.
I have followed many tutorials which talk about consumer and ...
- 5,288