Effectively apply Advanced Analytics to large datasets using the power of PySpark
About This Video
Solve your big data problems by building powerful Machine Learning models with Spark and implementing them using Python
Get up-and-running with Spark's essential libraries and tools (such as PySpark, Spark Streaming, Spark SQL, and Spark MLlib) and learn to apply them in practical, real-world big data applications
Leverage Spark 2.x - one …
Mastering Big Data Analytics with PySpark
Video description
Effectively apply Advanced Analytics to large datasets using the power of PySpark
About This Video
Solve your big data problems by building powerful Machine Learning models with Spark and implementing them using Python
Get up-and-running with Spark's essential libraries and tools (such as PySpark, Spark Streaming, Spark SQL, and Spark MLlib) and learn to apply them in practical, real-world big data applications
Leverage Spark 2.x - one of the most popular big data technologies-to discover how powerful Spark Machine Learning is how easily you can apply it!
In Detail
PySpark helps you perform data analysis at-scale; it enables you to build more scalable analyses and pipelines. This course starts by introducing you to PySpark's potential for performing effective analyses of large datasets. You'll learn how to interact with Spark from Python and connect Jupyter to Spark to provide rich data visualizations. After that, you'll delve into various Spark components and its architecture.
You'll learn to work with Apache Spark and perform ML tasks more smoothly than before. Gathering and querying data using Spark SQL, to overcome challenges involved in reading it. You'll use the DataFrame API to operate with Spark MLlib and learn about the Pipeline API. Finally, we provide tips and tricks for deploying your code and performance tuning.
By the end of this course, you will not only be able to perform efficient data analytics but will have also learned to use PySpark to easily analyze large datasets at-scale in your organization.
Audience
This course will greatly appeal to data science enthusiasts, data scientists, or anyone who is familiar with Machine Learning concepts and wants to scale out his/her work to work with big data.
If you find it difficult to analyze large datasets that keep growing, then this course is the perfect guide for you!
Chapter 1 : Python and Spark: A Match Made in Heaven
Course Overview
Python versus Spark
Preparing for the Course
Connecting Jupyter to Spark
Chapter 2 : Working with PySpark
Getting to Know Spark
The Power of Spark
The Power of Spark MLlib
Spark DataFrames
Spark Data Operations
Chapter 3 : Preparing Data Using Spark SQL
Loading Data from CSV Files
Fixing Issues in Our Data - Part One
Fixing Issues in Our Data - Part Two
Grouping, Joining, and Aggregating - Part One
Grouping, Joining, and Aggregating - Part Two
Chapter 4 : Machine Learning with Spark MLlib
Machine Learning with Spark
Building a Recommendation System with Spark MLlib - Part One
Building a Recommendation System with Spark MLlib - Part Two
Building a Recommendation System with Spark MLlib - Part Three
Finalizing our Recommendation System
What We Have Learned So Far
Chapter 5 : Classification and Regression
Machine Learning with Spark
Machine Learning Pipelines
Running a Logistic Regression Pipeline
Parameters, Features, and Persistence
Frequent Pattern Mining and Statistics
Chapter 6 : Analyzing Big Data
Natural Language Processing with Spark
Identifying Our Data
Data Preparation and Exploration
Creating Our Raw Training Data
Chapter 7 : Processing Natural Language in Spark
Data Preparation and Regular Expressions
Data Cleaning and Transformation
Training a Sentiment Analysis Model - Part One
Training a Sentiment Analysis Model - Part Two
Chapter 8 : Machine Learning in Real-Time
Fetching Data from Twitter
Spark Structured Streaming
Managing and Converting Streams
Assembling Our Streaming ML Solution
A Structured Approach to ML Streaming
Chapter 9 : The Power of PySpark
Running Spark in Production
Running Spark at Scale
Tips, Tricks, and Take-Aways
Start your Free Trial Self paced Go to the Course We have partnered with providers to bring you collection of courses, When you buy through links on our site, we may earn an affiliate commission from provider.
This site uses cookies. By continuing to use this website, you agree to their use.I Accept