Storing and Analysing Trillions of Domain Events using Kafka, Cassandra and Spark

Serhat Gülbetekin

Tuesday 10 April 2018 from 15:30 to 16:15

Talk in English - US at Devops Barcelona Conference 2018
Short URL: https://joind.in/talk/dbfa1 (QR-Code (opens in new window))

Avg. Rating

During this session, I will explain how we created a data pipeline to store and analyze trillions of domain events produced by microservices. Then, we will discuss how the underlying infrastructure is built in AWS using automation tools like Terraform, Puppet and Jenkins. Also we will talk about the Kafka ecosystem and how we use it together with Cassandra.

At the end of the talk, we will show in a small demo the journey of a domain event passing through this pipeline until it is stored in S3 for further analysis.

Comments

Comments are closed.

Pau Trepat at 10:24 on 20 Apr 2018 (via Web2 LIVE)

Interesting talk and good demo. Nice to be there