Databricks has done something genuinely impressive. It brings batch, streaming, ML, and now even agents into a single platform. For many teams, that consolidation is the reason Databricks exists at...

Over the last decade, the data ecosystem has evolved faster than anyone expected. Databricks, AWS, and the modern lakehouse stack have made it easier than ever for teams to move independently. With...

One of the most challenging problems I’ve solved recently was figuring out how to collate events arriving from multiple source systems, each with its own delivery pattern, format, and reliability m...

I’ve worked with Databricks for more than a decade now, and it amazes me how it evolved exponentially from a simple Spark workspace into a full platform for data engineering, ML, analytics, and now...

Effects Any program that does anything useful has some side-effect. Well, the whole point of a program is to have some side-effect. Examples of side-effects are reading from console, writing to db,...

Kafka is a distributed streaming platform storing data in topics and providing scalablity with topic partitions. Even though Kafka is extensively used for connecting our microservices through publi...

Kafka is a well known distributed streaming platform that stores data in topics and provides scalability with topic partitions. At Veon, we use Kafka extensively to publish and consume events from...

Scala is a OOP language with full support for functional programming and beautifully mixes them together to bring the best from both the worlds. Pure Functions In functional paradigm, all your fun...

There are different types of polymorphism in Scala. Inheritance, Parametric polymorphism (Generics in Java), etc. We are concerned about Parametric Polymorphism in this post and a classic example w...

Typeclasses are one of the most beautiful ways of extending existing classes and building new features and functionality over them. It is always considered a good practise to evolve programs/syste...