Category: Spark

Top Certification Courses in SAS, R, Python, Machine Learning, Big Data, Spark

Top Certification Courses in SAS, R, Python, Machine Learning, Big Data, Spark

In this article, I’ll focus on ranking short duration and certification courses. Which courses are included in these rankings ? I’ve considered the courses which are delivered in online or hybrid mode. Course running in hybrid mode are carried out only in India. For now, I’ve filtered out the courses being delivered in other countries. … Continue reading Top Certification Courses in SAS, R, Python, Machine Learning, Big Data, Spark

Ways to Create SparkDataFrames in SparkR

Ways to Create SparkDataFrames in SparkR

1. Objective We will learn the whole concept of creating DataFrames in SparkR. Data is organized as a distributed collection of data into named columns. Basically, that we call a SparkDataFrames in SparkR. Also, there are many ways to create DataFrames in SparkR. 2. What is SparkDataFrames? Data is organized as a distributed collection of … Continue reading Ways to Create SparkDataFrames in SparkR

The Hadoop Module & High-level Architecture

The Hadoop Module & High-level Architecture

The Apache Hadoop Module: Hadoop Common: this includes the common utilities that support the other Hadoop modules HDFS: the Hadoop Distributed File System provides unrestricted, high-speed access to the application data. Hadoop YARN: this technology accomplishes scheduling of job and efficient management of the cluster resource. MapReduce: highly efficient methodology for parallel processing of huge … Continue reading The Hadoop Module & High-level Architecture

Apache Hive vs Spark SQL: Feature wise comparison

Apache Hive vs Spark SQL: Feature wise comparison

1. Objective While Apache Hive and Spark SQL perform the same action, retrieving data, each does the task in a different way. However, Hive is planned as an interface or convenience for querying data stored in HDFS. Though, MySQL is planned for online operations requiring many reads and writes. So we will discuss Apache Hive … Continue reading Apache Hive vs Spark SQL: Feature wise comparison