Join 4,000+ technologists, decision makers and community members in Raleigh, NC

October 13 - 15


Big Data

Beam me up: Voyaging into Big Data

Michele Titolo   

More engineering organizations than ever are dealing with big data. The long times required to process big datasets slow down development cycles and delay analysis. Apache Beam pipelines distribute processing across many workers, reducing the time it takes to transform large datasets. Creating an effective Beam pipeline requires following best practices and using the specialized data structures Beam introduces. In this talk, I’ll share strategies and lessons learned from scaling Apache Beam pipelines to handle ever-increasing workloads.