Why was Apache Kafka created?
Reading Time: 13 minutes Intro - the Integration Problem We talk all the time about what Kafka is, but not so much about why it is the way it is. What better way than to dive into the original motivation for creating Kafka? Circa 2012, LinkedIn’s original intention with Kafka was to solve a data integration problem. LinkedIn used site activity data (e.g. someone liked this, someone posted this) for many things - tracking fraud/abuse, matching jobs to users, training ML models, basic feature