My £4 a month server can handle 4.2M requests a day

1

Medium

All these "X requests per unit time" posts are starting to make me want to break out some of my experimental code... I have some services that can process several million events per second. This includes: compressing the event batch, persisting to disk, validation of business logic, execution of all view updates (state tracked server-side), aggregation and distribution of client update events, etc. These implementations are easily capable of saturating NVMe flash. If you want to see where the theoretical limits lie, check out some of the fringe work around the LMAX Disruptor and .NET/C#: https://medium.com/@ocoanet/improving-net-disruptor-performance-part-3-introducing-the-valuedisruptor-5b467730bbe You will find the upper bound of serialized processing to be somewhere around 500 million events per second. Personally, I have not pushed much beyond 7 million per second, but I also use reference types, non-ideal allocation strategies, etc. For making this a web-friendly thing: The trick I have found is to establish a websocket with your clients, and then pipe all of their events down with DOM updates coming up the other way. These 2 streams are entirely decoupled by way of the ringbuffer and a novel update/event strategy. This is how you can chew through insane numbers of events per unit time. All client events get thrown into a gigantic bucket which gets dumped into the CPU furnace in perfectly-sized chunks. The latency added by this approach is measured in hundreds of microseconds to maybe a millisecond. The more complex the client interactions (i.e. More events per unit time), the better this works. Blazor was the original inspiration for this. I may share my implementation at some point in the near future.

#Blogging #Blogging Platform #CMS 2211 social mentions

2

have i been pwned?

#Data Breach #Security & Privacy #Cyber Security 3668 social mentions

3

Protobuf

There are many binary encoding protocols. A popular one is [protobufs](https://developers.google.com/protocol-buffers), which are used by gRPC.

#Configuration Management #Software Development #Mobile Apps 82 social mentions

4

OpenResty

OpenResty [1] is a good mix of these concepts. It serves requests through nginx (which is at its core just a lightweight event loop) and then serves pages through LuaJIT. If you need more speed you could always write an nginx module in C (or in some other language viz the C ABI). [1]: https://openresty.org/en/.

#Web And Application Servers #Web Servers #Application Server 21 social mentions

5

Google Cloud CDN

#CDN #Cloud Computing #Content Distribution 11 social mentions