All Questions
9 questions
0
votes
1
answer
240
views
How to design architecture for scalable algo trading application? [closed]
I was using Django-python framework for my web app. When I build a strategy in the UI it gets converted into a .py script file and every 5 mins (can be variable based on my candle interval) the file ...
0
votes
1
answer
141
views
How to pull from a different queue inside Celery task
I have a task queue, queue A, and a resource queue, queue B. At program start, there are a finite number of resources put in queue B. Tasks may execute if they're able to pull a resource from queue B, ...
- 330
0
votes
1
answer
942
views
Daemon process alongside django
Like to see what others think the best architecture for the following.
I am trying to build a project that with a web front end that has the requirement to issue commands to other long running ...
- 1,065
7
votes
1
answer
4k
views
Django + Celery tasks on multiple worker nodes
I've deployed a django(1.10) + celery(4.x) on the same VM, with rabbitmq being the broker(on the same machine).
I want to develop the same application on a multi-node architecture like I can just ...
- 264
1
vote
1
answer
1k
views
Architecting a multithreaded app with a REST interface [closed]
I'm working through possible architectures for a problem. In as few words as possible, the problem is: I need to design a system that allows clients to connect using HTTP/REST to kick off long running ...
- 1,373
2
votes
2
answers
4k
views
django-celery infrastructure over multiple servers, broker is redis
Currently we have everything setup on single cloud server, that includes:
Database server
Apache
Celery
redis to serve as a broker for celery and for some other tasks
etc
Now we are thinking to break ...
- 39.8k
1
vote
1
answer
1k
views
API front-end architecture
I want to build a web site that is a front-end for an API. Basically, the front-end takes some user input and uses that to query the API and retrieve results. When the results are retrieved, they are ...
- 769
7
votes
2
answers
3k
views
How should I use Celery when task results are large?
What's the best way to handle tasks executed in Celery where the result is large? I'm thinking of things like table dumps and the like, where I might be returning data in the hundreds of megabytes.
I'...
- 17.9k
8
votes
3
answers
370
views
Does this web app require a task queue?
Background
I have a web app that will create an image from user input.
The image creation could take up to a couple seconds.
Problem
If I let the server thread, that is handling the request/response ...
