Apache Spark Streaming + Kafka: An integration Story

The BCN Data Engineering meetup is back after the summer holidays, just in time to promote the DataEngConf Barcelona, 25th and 26th of September, which you can read more about here: https://www.dataengconf.com/speakers-bcn18. As might have seen as well, our own Pete Soderling is giving a talk on how to successfully create communities. Check it out here: https://www.meetup.com/CTOs-co-Barcelona/events/254243706/

That’s it for the promotion of other events. Now to the event the 17th, where we’re glad to announce Joan Viladrosa Riera (https://www.linkedin.com/in/joanviladrosa/), Head of Data Engineering at Stuard Delivery. At Stuart, Joan is heading the designing and building of tools for a more data-centric company. Previously, he worked at Billy Mobile as a Senior Big Data Architect and Tech Lead, where he led the transition to the Hadoop and Spark ecosystem, designing applications that scale up to thousands of events per second.

Joan will tell us an integration story between Apache Spark and Kafka. As Joan puts it: Spark Streaming has supported Kafka since it’s inception, but a lot has changed since those times, both in Spark and Kafka sides, to make this integration more fault-tolerant and reliable. Read more and join at https://www.meetup.com/BCN-Data-Engineering/events/254382922/