Questions tagged [latency]
The latency tag has no summary.
26 questions
0
votes
2
answers
250
views
Can caching increase p90 response time
I'm learning about caching and I realized a positional problem I need clarification on.
Suppose the database p90 response time is too high and we need to decrease it. We are considering adding a cache....
- 119
21
votes
6
answers
7k
views
How would you identify slow queries before reaching production?
Let's say you are running a query on your database.
In development and staging, where the amount of data is small, everything looks good.
Unit and integration tests are also fine and the logic is ...
- 519
0
votes
1
answer
135
views
Would an edge-optimized API Gateway deployment or multiple deployments with latency routing be most performant?
I'm deploying a serverless/lambda-based HTTP API via AWS API Gateway. My goal is to minimize latency in handling requests. I am considering two architectures, and I'm wondering which best meets this ...
- 491
-4
votes
1
answer
176
views
A request's round trip time monitoring at microservice production best tools and practices?
I've a microservice's system at production which provide an API to the outer world. Along with each service monitoring via monitoring tool ( Prometheus, zabbix, etc.) of course it's highly desirable ...
- 1
-1
votes
1
answer
1k
views
Suitable networking protocols for low latency, one-packet messaging
What would be some suitable transport and application layer protocols for a secure payments network where low latency is a key goal?
Here "low latency" means completing an encrypted ...
- 107
-1
votes
1
answer
464
views
Reducing duplicate API call between micro services in a latency sensitive flow
Let's suppose that I have 5 microservices, let's also name them ServiceA, ServiceB, ServiceC, ServiceD, ServiceE.
To perform an operation X communication needs to happen between these services.
And ...
- 171
64
votes
10
answers
13k
views
How do I mitigate a scenario where a user goes to pay, but the price is changed mid-request?
This is kind of similar to the Two Generals' Problem, but not quite. I think there is a name for it, but I just can't remember it right now.
I am working on my website's payment flow.
Scenario
...
- 1,701
1
vote
0
answers
59
views
Speeding up read write intensive operation on large files in cloud (Azure)
I am using Azure Storage Blobs to persist certain models per tenant. While processing items for each tenant these models have to be pulled to memory, used for certain operation, updated and pushed ...
- 119
3
votes
2
answers
590
views
Writing requirement for Response Time from Hosted Server
We are contracting with a group to create some cloud services for us, and would like to write a requirement for them stating that a particular API call will provide results within X seconds. They are ...
- 568
5
votes
1
answer
1k
views
Low latency TCP sockets in .NET
Is it possible to optimize a .NET application running on a server version of Windows for near-zero latency TCP communication? Or will there always be unpredictable/unavoidable delays?
For example, ...
- 53
-1
votes
1
answer
96
views
How can I configure storm to receive data from a client, process the data in bolts and then return the processed data to the same client as a stream?
Here my scenario: I have a client application that needs a dedicated powerful computation system that every seconds process some data in input (few kilobyte) and return a few megabytes of processed ...
- 107
0
votes
1
answer
124
views
Design question: Server returns partial results for optimization
I have a service which sends a set of queries to the server in a single call and acts on the decisions from the server. I will first introduce what I already have and the questions will follow.
...
- 101
1
vote
1
answer
4k
views
REST services with a local or remote application
I have several uncommon questions related to the design of REST services hosted on a server communicating with local or remote applications.
As an example, let's say that I have 2 machines ("A" and "...
- 674
5
votes
1
answer
958
views
Do you have a metaphor for cache/data latencies? [closed]
From this answer about latencies, we have some numbers (yes, caveat caveat) for latencies when coding (slightly edited):
L1 cache reference 0.5 ns
Branch mispredict 5 ns
L2 cache reference 7 ns
Main ...
- 209
2
votes
1
answer
858
views
How do you reduce geographic latency in web application (MVC ASP.net) backed by a single database
I'm working on a modest sized web application that receives circa 30k unique users per day, this is an MVC C# application hosted on 3 web servers and backed by a single SQL server, everything is ...
- 161