There are a variety of useful applications for real-time data, including quick identification of general patterns and trends in data, performing sentiment analysis, crafting responses in real-time, and—perhaps one of the most important uses—when having analysis immediately will change the outcome of the situation. This course provides an in-depth tour of technologies used in processing and analyzing real-time data.
There are a variety of useful applications for real-time data, including quick identification of general patterns and trends in data, performing sentiment analysis, crafting responses in real-time, and—perhaps one of the most important uses—when having analysis immediately will change the outcome of the situation. This course provides an in-depth tour of technologies used in processing and analyzing real-time data.
Introduction To Cassandra
Introducing The Course
Understanding What Cassandra Is
Learning What Cassandra Is Being Used For
Understanding The System Requirements
Opening The Main Virtual Machine
Pop Quiz - Intro to Cassandra
Getting Started With The Architecture
Understanding That Cassandra Is A Distributed Database
Learning What Snitch Is For
Learning What Gossip Is For
Learning How Data Gets Distributed
Learning About Replication
Learning About Virtual Nodes
Pop Quiz - Getting Started with Architecture
Installing Cassandra
Downloading Cassandra
Ensuring Oracle Java 7 Is Installed
Installing Cassandra
Viewing The Main Configuration File
Providing Cassandra With Permission To Directories
Starting Cassandra
Checking Status
Accessing The Cassandra system.log File
Pop Quiz - Installing Cassandra
Communicating With Cassandra
Understanding Ways To Communicate With Cassandra
Using CQLSH
Pop Quiz - Communicating with Cassandra
Creating A Database
Understanding A Cassandra Database
Defining A Keyspace
Deleting A Keyspace
Pop Quiz - Creating a Database
Lab: Create A Second Database
Creating A Table
Creating A Table
Defining Columns And Data Types
Defining A Primary Key
Recognizing A Partition Key
Specifying A Descending Clustering Order
Pop Quiz - Creating a Table
Lab: Create A Second Table
Inserting Data
Understanding Ways To Write Data
Using The INSERT INTO Command
Using The COPY Command
How Data Is Stored In Cassandra
How Data Is Stored On Disk
Pop Quiz - Inserting Data
Lab: Insert Data
Modeling Data
Understanding Data Modeling In Cassandra
Using A WHERE Clause
Understanding Secondary Indexes
Creating A Secondary Index
Defining A Composite Partition Key
Pop Quiz - Modeling Data
Creating An Application
Understanding Cassandra Drivers
Exploring The DataStax Java Driver
Setting Up A Development Environment
Creating An Application Page
Acquiring The DataStax Java Driver Files
Getting The DataStax Java Driver Files Through Maven
Providing The DataStax Java Driver Files Manually
Connecting To A Cassandra Cluster
Executing A Query
Displaying Query Results - Part 1
Displaying Query Results - Part 2
Using An MVC Pattern
Pop Quiz - Creating an Application
Lab: Create A Second Application - Part 1
Lab: Create A Second Application - Part 2
Lab: Create A Second Application - Part 3
Updating And Deleting Data
Updating Data
Understanding How Updating Works
Deleting Data
Understanding Tombstones
Using TTLs
Updating A TTL
Pop Quiz - Updating and Deleting Data
Lab: Update And Delete Data
Selecting Hardware
Understanding Hardware Choices
Understanding RAM And CPU Recommendations
Selecting Storage
Deploying In The Cloud
Pop Quiz - Selecting Hardware
Adding Nodes To A Cluster
Understanding Cassandra Nodes
Having A Network Connection - Part 1
Having A Network Connection - Part 2
Having A Network Connection - Part 3
Specifying The IP Address Of A Node In Cassandra
Specifying Seed Nodes
Bootstrapping A Node
Cleaning Up A Node
Using cassandra-stress
Pop Quiz - Adding Nodes to a Cluster
Lab: Add A Third Node
Monitoring A Cluster
Understanding Cassandra Monitoring Tools
Using Nodetool
Using JConsole
Learning About OpsCenter
Pop Quiz - Monitoring a Cluster
Repairing Nodes
Understanding Repair
Repairing Nodes
Understanding Consistency - Part 1
Understanding Consistency - Part 2
Understanding Hinted Handoff
Understanding Read Repair
Pop Quiz - Repairing Nodes
Lab: Repair Nodes For A Keyspace
Removing A Node
Understanding Removing A Node
Decommissioning A Node
Putting A Node Back Into Service
Removing A Dead Node
Pop Quiz - Removing a Node
Lab: Put A Node Back Into Service
Redefining A Cluster For Multiple Data Centers
Redefining For Multiple Data Centers - Part 1
Redefining For Multiple Data Centers - Part 2
Changing Snitch Type
Modifying cassandra-rackdc.properties
Changing Replication Strategy - Part 1
Changing Replication Strategy - Part 2
Pop Quiz - Redefining a Cluster
Resources For FurTher Learning
Accessing Documentation
Reading Blogs And Books
Watching Video Recordings
Posting Questions
Attending Events
Wrap Up
The Case for Kafka
The Basics
Setting up a Kafka Cluster
Writing a Kafka Producer
Writing a Kafka Consumer
Using Kafka from Python
Troubleshooting Kafka
Integrating Kafka and Hadoop with Flafka
Kafka Availability and Consistency
Kafka Ecosystem
Future of Kafka
Pre-Flight Check
Spark Deconstructed
A Brief History
Simple Spark Apps
Spark Essentials
Spark Examples
Unifying the Pieces - Spark SQL
Unifying the Pieces - Spark Streaming
Unifying the Pieces - MLlib and GraphX
Unified Workflows Demo
The Full SDLC
Developer Certification
Resources
Introduction - Why DataFrames?
ETL to Prepare the Data from Capital Bikeshare
Create a DataFrame, Explore using SQL
Data Preparation for Machine Learning Models
Build a Classifier Using Naive Bayes
Build a Classifier Using Decision Trees
Build a Classifier Using Random Forests
Use a DataFrame to Compare Models
Parquet as a Best Practice with DataFrames
How to Store a DataFrame with Parquet
How to Read a DataFrame Back in From Parquet
Use SQL to Estimate Route Durations
Data Preparation for GraphX - Model Route Costs
Use PageRank to Rank Popular Stations
Optimize Routes to Columbus Circle
Compare Results with Google Maps
Analyze a Popular Tourist Route
Examples of How to Use DataFrames in Python
Summary - The New DataFrames Features in Spark
Introduction - Large-scale real time stream processing and analytics at Strata+Hadoop World - Ben Lorica
Going Real-time: Data Collection and Stream Processing with Apache Kafka - Jay Kreps
Say goodbye to batch - Tyler Akidau (Google)
Stream Processing Everywhere - What to Use? - Jim Scott
From Source to Solution: Building A System for Machine and Event-Oriented Data - Eric Sammer
Spark Streaming - The State of the Union, and Beyond - Tathagata Das
Dynamic Events in Massive Data Streams, from Astrophysics to Marketing Automation - Kirk Borne
TSAR (the TimeSeries AggregatoR) - How to Count Tens of Billions of Daily Events in Real Time Using Open Source Technologies - Anirudh Todi
Streaming Analytics: It’s Not The Same Game - Subutai Ahmad
Realtime Data Analysis Patterns - Mikio Braun (streamdrill)
The IoT P2P Backbone - Bruno Fernandez-Ruiz
Practical Methods for Identifying Anomalies That Matter in Large Datasets - Robert Grossman
Introduction
Introduction to Time Series Problems
Kafka
Kafka Architecture and Deployment
Kafka Usage
Spark
Introduction to Spark
Spark Architecture
Spark Streaming
Spark Streaming: Windows Slides
Spark Streaming: Ingestion Sources Using Kafka
Sparks Streaming: Operations on the Stream
Cassandra
Introduction to Cassandra
Cassandra Basic Architecture
Replication, High Availability and Multi Datacenter
Cassandra Weather Website Example
Cassandra Query Language (CQL)
Cassandra Partitions Clustering
Cassandra Read and Write Path
Working with Cassandra
Cassandra Drivers and Access Patterns
Spark and Cassandra
Spark and Cassandra Architecture
Analyzing Cassandra Data Spark SQL
Spark and Cassandra DataStax Enterprise
Real World Use Cases
Real World Use Cases: Streaming Problems
Real World Use Cases: In-place Analytic Problems