Spark is one of the top job destination of the world . This course is aiming at addressing the common daily tasks the developer are getting and how to resolve the tasks in effective way . This course is also introducing Big Data to understand the basic concept of the problem because of which we are learning different tools and technologies to address the problem.Scala is considered as better java as we can include all the libraries used in Java in Scala and therefore Scala becomes a very strong language.If you're already working on a Java written codebase, part of the team can start working with Scala and still uses the Java classes already written.Scala's syntax is less of a burden than Java's. You don't have to write your trivial getters/setters each time. You can use special method names (à la C++ operators overloading) when it makes your code cleaner. Also, the pattern matching is incredible, you will want to use it everywhere.

Looks odd but most language features which are present in Scala are not unique and could be related to other languages. What makes Scala successful is the way these features are combined.

Most people start using Scala as a better version of whatever mainstream language they were previously using (Java, C#, Ruby, Python, etc). And indeed, it’s not difficult to show that Scala has serious advantages over them. For example, it’s much more concise than Java or C#, more performant and type-safe than Ruby and Python etc. Given the right approach, it’s quite easy to pick it up .

So how does Spark differs from Scala ? Is there any difference or both are same thing . Apache Spark is an open source framework for running large-scale data analytics applications across clustered computers. It can handle both batch and real-time analytics and data processing workloads. On the other hand, Scala is a general-purpose programming language that supports functional and object-oriented programming. It is compiled and run on Java Virtual Machine (JVM). Scala improves productivity, application scalability and reliability. In brief, Scala is considered as the primary language to interact with the Spark Core engine.

• Introducing Big Data & Hadoop

• Basic Hadoop Commands

• Apache Spark On Different platform

• Using databricks

• Apache Spark: Databricks Community Edition/Integration With Azure

• Understanding RDD

• RDD Transformation

• RDD Action

• Spark SQL

• Spark RDD

• Azure Databricks & SQL Data Waraehouse

• Introduction To Scala

  • Basic Scala Functionalities & Working In Intellij Idea

  • Working In Scala-If Else

  • Working In Scala-For Loop

  • Working In Scala-While Loop

  • Working In Scala-Do While

  • Working In Scala-Function

  • Working In Scala-Anonymous Function

  • Working In Scala-Object & Classes

  • Reading & Writing File using Intellij

  • Understanding Partitioning With Demo