Due to popular demand, we’re listing sources of interesting material for thinking about the Unix Philosophy. Get ahead with the following:
Apache Kafka, Samza, and the Unix Philosophy of Distributed Data
One of the things I realised while doing research for my book is that contemporary software engineering still has a lot to learn from the 1970s. As we’re in such a fast-moving field, we often have a tendency of dismissing older ideas as irrelevant – and consequently, we end up having to learn the same lessons over and over again, the hard way. Although computers have got faster, data has got bigger and requirements have become more complex, many old ideas are actually still highly relevant today.
Kafka by example: Kafka as Unix Pipes
Imagine the following conversation.
You: What is Apache Kafka?
Me: Apache Kafka is publish-subscribe messaging rethought as a distributed commit log.
You: … What?
Me: Yeah, it’s a distributed, partitioned, replicated commit log service.
You: What on earth are you talking about?
The description is correct. You just have to know what those terms mean. But if you don’t know the terms, then it’s confusing.