All Questions
Tagged with message-queue architecture
113 questions
0
votes
2
answers
105
views
Discord Bot and a website communication, what should be the system design
I'm building a website that lets users add new items in their profiles. Users can also do the same using Discord bot's commands. In both cases the Discord bot sends a message New item added by @user ...
- 5,172
0
votes
1
answer
179
views
Developing an Efficient Process for Syncing Prices with Shopify Stores
I'm working on a project where I need to sync prices between my app and several Shopify stores. In my app, each user can link their Shopify store, and when a price changes for a product in my app, a ...
- 317
0
votes
2
answers
149
views
Ordered Messaging Service Architecture
Hi everyone, I need to create a service which could receive messages from a FIFO data stream and send the messages in order to each client server.
Let say the the data stream contains of A1, A2, A3, ...
- 43
1
vote
1
answer
67
views
What's the right ZeroMQ architecture for my scenario?
I have a service A that every once in a while needs to send a message to a cluster of services B1, B2 ... BN. Then all of these services need to receive that message reliably, and send a confirmation ...
- 91
0
votes
1
answer
87
views
Is there any example or design of a queue system in microservices?
I just start to learn about microservices and message queue (rabbitmq) and I understand some exchanges as Direct, Topic,Fanout,Header,etc. But I do not clear about something like when should we close ...
0
votes
1
answer
184
views
How to listen for events in side thread?
I am making app for getting information using binance websocket api. We already have main codebase but decided to implement websockets in independent app.
It looks like this:
import asyncio
from ...
- 67
1
vote
1
answer
289
views
How to design a system with pub/sub with time-based coordination
I am working on a high-level design for a pub/sub model where the subscribers should not process messages until a specified time. For example, let's say a set of stock orders need to be cancelled ...
- 63
0
votes
0
answers
97
views
Which message brokers support one to one mapping between a key value and the consumer
I am currently trying to choose a message queue in my backend system and for a use case I would need to do the following
Producer services will publish messages that involve a field named foo
I want ...
0
votes
1
answer
495
views
Should I call REST API when processing a message from Message Queue?
I need some advice on the architecture for a background job. I am using Azure Service Bus with at least once gurantee(peek-lock) feature but question is in general for any message queue. Below is the ...
- 2,538
0
votes
1
answer
44
views
How does using a queue instead of pub-sub help detect missing/stolen data?
On page 33 of "fundamentals of software architecture", in the "analyze trade-offs" section, the book compares 2 different approaches to sending information from the bid producer to ...
- 632
2
votes
2
answers
926
views
Message Queue VS Task Queue architecture
I want to build a product that can perform some Internet scans (in Python) to collect various kinds of data.
I want to design it with tasks that perform these collecting jobs.
There can be multiple ...
- 31
0
votes
1
answer
80
views
Manage ID for tasks not processed yet in queue
I'm looking for tutorials/articles that explain how to maintain ID for items in queue that were not processed yet.
I am looking for a few tutorials to get more perspectives and be exposed to more ...
- 826
5
votes
1
answer
1k
views
Correct way to build an in-app notification service?
Background
I have a monolith Node.js + PostgreSQL app that, besides other things, needs to provide real-time in-app notifications to end users.
It is currently implemented in the following way:
there'...
- 3,535
1
vote
0
answers
416
views
Is it mandatory to use MQ to make microservices communicate with each other?
I'm developing an application on microservice architecture. I'm stuck with the idea of proper integration of MQ.
Do we need to add mq to any communication between microservices? I'm using feign ...
- 51
1
vote
1
answer
2k
views
When to use one queue vs multiple?
Say I want to send emails to users.
When users sign up for an account they get an email.
When they complete an order they get an email.
When they receive a message they get an email.
My hunch is ...
- 869