Questions tagged [distributed-system]
This tag can be used by questions on distributed system concept, design, and implementations.
214 questions
3
votes
4
answers
397
views
Does possession of a valid JWT automatically imply the user is authenticated?
I am tasked with implementing authentication and authorization in a distributed environment, so I plan to use JWT.
I get how authorization works with JWT - if the token is not expired, and the ...
- 199
6
votes
5
answers
3k
views
System Design for low latency reliable online chess game
I want to build a low-latency chess backend (something similar to live chess on chess.com or basically any other online real-time chess), but there are a couple of questions I am unable to get answers ...
- 170
1
vote
1
answer
56
views
What multicast guarantees does passive replication provide?
I know that active replication provides a total ordered multicast (atomic multicast) but what does passive replication provide ?
2
votes
2
answers
147
views
For distributed workflows - tradeoffs having stateless workers operate on central state, versus stateful workers?
I'm working on a problem right now that processes incoming data at a very high rate. Each event that flows in has an association ID, and each group of associated events will affect behaviour over time ...
- 141
4
votes
2
answers
189
views
Lock management for isolation in SAGA Pattern
System Overview:
The architecture involves two services with separate databases:
User-Order Service: Handles user actions such as placing, canceling, and returning orders.
Seller-Order Service: ...
- 149
3
votes
3
answers
548
views
Design question for exactly-once processing in a message-driven system using a unique ID
To achieve exactly-once processing where messages are consumed from a queue with at-least-once delivery, many sources (e.g. here and here and here) suggest attaching a unique ID to messages in the ...
- 139
2
votes
1
answer
254
views
How to track external media (binaries) that multiple engineers will update?
I'm not sure if this is the right forum for this--if not, please point me in the right direction. This will be a little long-winded due to the specific nature of my question, so I apologize in advance....
- 137
1
vote
3
answers
153
views
Does quorum protocols circumvent fundamental limitations posed by the CAP theorem?
I can have multiple replicas of my database to ensure high availability. Then I can have a quorum such that R+W > N to ensure consistency.
So does strategies like quorum base read/write or ...
- 1,450
0
votes
1
answer
180
views
How to rebalance data across nodes?
I am implementing a message queue where messages are distributed across nodes in a cluster. The goal is to design a system to be able to auto-scale without needing to keep a global map of each message ...
- 115
1
vote
2
answers
111
views
Subscribing to a range of topics per instance of a service [closed]
If I have a system where my distributed service is sending live scores of 1000 s of football games from some hypothetical event to millions of clients. The service subscribes to the games from a ...
- 254
0
votes
1
answer
174
views
how about using kubernetes statefulset to mapping the snowflake datacener id and worker id
I am developing a distribution id project, now using the twitter snowflake id as the fundation of the distribution id. In kubernetes cluster, to fetch the uniq and non-conflict datacenter id and ...
- 103
2
votes
1
answer
328
views
Problem with data consistency in Microservice architecture(2pc transaction) when external dependency envolved
I have microservice architecture. I implement a distributed transaction flow (2-phase commit), kafka, and 1 coordinator service. So, my problem is in each step of preparation I am calling an outside ...
- 157
-2
votes
1
answer
223
views
What is the difference between Eventual Consistency, Strong Eventual Consistency, and Causal Consistency?
I read articles about CRDTs and frequently come across the terms 'Strong Eventual Consistency,' 'Eventual Consistency,' and 'Causal Consistency.' What is the relationship between these consistency ...
- 11
-1
votes
1
answer
95
views
Designing a Distributed System for Indigenous Data Sovereignty Across Nations [closed]
I'm looking for some quick "back-of-the-napkin" thoughts from systems engineers on the following scenario:
A collection of Indigenous groups (in the US, Canada, and Australia) want to design ...
6
votes
4
answers
2k
views
Protecting against malicious duplicate IDs in a distributed environment
Let's say we have multiple (somewhat autonomous) (micro-)services, and when entities are created, the ID (UUIDs or whatever) can be set externally. How can we ensure that an ID remains unique across ...
- 71