Stream Processing with Apache Spark: Mastering Structured Streaming and Spark Streaming, Paperback/Gerard Maas

Stream Processing with Apache Spark: Mastering Structured Streaming and Spark Streaming, Paperback/Gerard Maas

Autor
Editura
An publicare
2019
Nr. Pagini
438
ISBN
9781491944240

Descriere

To build analytics tools that provide faster insights, knowing how to process data in real time is a must, and moving from batch processing to stream processing is absolutely required. Fortunately, the Spark in-memory framework/platform for processing data has added an extension devoted to fault-tolerant stream processing: Spark Streaming. If you're familiar with Apache Spark and want to learn how to implement it for streaming jobs, this practical book is a must. Understand how Spark Streaming fits in the big picture Learn core concepts such as Spark RDDs, Spark Streaming clusters, and the fundamentals of a DStream Discover how to create a robust deployment Dive into streaming algorithmics Learn how to tune, measure, and monitor Spark Streaming About the Author: Gerard Maas is the lead engineer at Kensu. io, an early stage startup where he works on context management for big-data environments. Previous to that, he led the design and development of the data processing pipeline of Virdata. com, a startup building a cloud-native Io T platform, where Scala, Apache Spark and Spark Streaming were crucial building blocks. He enjoys contributing to open source projects, small and large. Through his career in technology companies like Alcatel-Lucent, Bell Labs, Sony and Technicolor, he has been mostly involved in the interaction of services and devices, from early days service adaptation when mobile screens only had few text lines, passing through multi-device interactions to Io T device management. He has a degree in Computer Engineering from the Sim n Bol var University, Venezuela. Fran ois Garillot worked on Scala's type system in 2006, earned his Ph D from the French cole Polytechnique in 2011, and worked at Typesafe, after a brief stint in Internet advertising. He's worked on interactive interfaces to the Scala compiler, while nourishing a strong enthusiasm for data analytics in his spare time, until Apache Spark let him fullfill this passion as his main job. He received the first Sp

Pe aceeași temă