Sahn Lam
Sahn Lam

@sahnlam

5 Tweets 58 reads Feb 27, 2023
Stack Overflow is a multi-tenant monolithic application serving 2 billion monthly page views across 200 sites.
Here are some amazing stats:
It's on-prem, with only nine IIS web servers.
Each server runs their highly optimized .NET code, handling 6000 rps each, and consuming only 5 - 10% capacity.
The code minimizes memory allocation to keep garbage collection infrequent.
SQL Server has 1.5TB of RAM with no caching layer.
That is a third of the entire Q&A dataset.
Caching didn't work due to the wide distribution of questions. Most cached items expired unused.
Removed Redis 4 years ago; average latency remained unchanged at 20ms.
Like/Retweet the first tweet to share the learning:

Loading suggestions...