Download PDF by Aurobindo Sarkar: Learning Spark SQL

Key Features

• Learn in regards to the layout and implementation of streaming purposes, laptop studying pipelines, deep studying, and large-scale graph processing purposes utilizing Spark SQL APIs and Scala.
• Learn information exploration, facts munging, and the way to strategy established and semi-structured info utilizing real-world datasets and achieve hands-on publicity to the problems and demanding situations of operating with noisy and "dirty" real-world data.
• Understand layout concerns for scalability and function in web-scale Spark software architectures.

Book Description

In the previous yr, Apache Spark has been more and more followed for the advance of disbursed functions. Spark SQL APIs supply an optimized interface that is helping builders construct such functions fast and simply. although, designing web-scale creation purposes utilizing Spark SQL APIs could be a complicated activity. for that reason, knowing the layout and implementation top practices sooner than you begin your undertaking may also help you steer clear of those problems.

This booklet provides an perception into the engineering practices used to layout and construct real-world, Spark-based purposes. The book's hands-on examples offers you the necessary self belief to paintings on any destiny tasks you come across in Spark SQL.

It begins through familiarizing you with info exploration and information munging projects utilizing Spark SQL and Scala. broad code examples may help you realize the tools used to enforce regular use-cases for varied different types of functions. you'll get a walkthrough of the foremost ideas and phrases which are universal to streaming, laptop studying, and graph functions. additionally, you will learn the way such platforms are architected and deployed for a profitable supply of your venture. eventually, you are going to circulation directly to functionality tuning, the place you are going to study functional tips and tips to unravel functionality issues.

What you'll learn

• Familiarize your self with Spark SQL programming together with operating with DataFrame/Dataset API and SQL.
• Perform a chain of hands-on workouts with types of information resource together with CSV, JSON, Avro, MySQL, and MongoDB.
• Perform information caliber tests, information visualization, and simple statistical research tasks.
• Perform info munging projects on publically on hand datasets.
• Learn to take advantage of Spark SQL and SparkR for normal info technology tasks.
• Learn key performance-tuning advice and tips in Spark SQL applications
• Learn to spot circumstances the place Spark SQL can be utilized in large-scale software architectures.

About the Author

Aurobindo Sarkar is at the moment the rustic Head (India Engineering heart) for ZineOne Inc. With a profession spanning 24+ years, he has consulted at a number of the prime enterprises in India, US, united kingdom, and Canada. He focuses on real-time web-scale architectures, laptop studying, deep studying, Cloud Engineering, and massive facts Analytics. Aurobindo has been actively operating as a CTO in know-how startups for over 8 years now. As a member of the head management crew at a number of startups, he has mentored founders and CxOs, supplied know-how advisory providers, and led product structure and engineering teams.