new course

short details

  • English
  • 150
  • 250
  • Course Includes
  • Live Classes
  • Continuous Assessment
  • Downloadable Course Materials
  • Real Time feedback

What you will learn

  • Deploy Managed Hadoop apps on the Google Cloud
  • Build deep learning models on the cloud using TensorFlow
  • Make informed decisions about Containers, VMs and AppEngine
  • Use big data technologies such as BigTable, Dataflow, Apache Beam and Pub/Sub


  • need any



Course Content

Basics of Databases DML Vs DDL Operations SQL Vs PL SQL RDBMS Vs NoSQL Basic database objects Data Normalization concepts ( 1st, 2nd, 3rd and BCNF) Basics of Data Modeling
Select Statements Restricting and Sorting data Single row functions Aggregating Using Group functions Manipulating Dat Creating and Managing Tables Joins Including Constraints Using SET Operators Datetime Functions Subqueries
Declaring Variables Writing executable statements Writing control structures Composite data types Cursor Creating Procedures Creating Functions Creating Triggers
Introduction to NoSQL
What is NoSQL? CAP Theorem BASE Concept What are the Types of NoSQL Databases? Intro to MongoDB RDBMS Vs MongoDB Key Value Pairs CRUD operations
High Availability
Load Balancers Theory Direct Connect Load Balancers And Health Checks Lab Advanced Load Balancer Theory [SAA-CO2] Autoscaling Theory [SAA-C02] Autoscaling Groups Lab HA Architecture HA Word Press Site Setting Up EC2 Adding Resilience And Autoscaling
Data Warehousing
Data Warehousing basics What is a Data Warehouse? Data warehouse Vs OLTP System Top Down approach Bottom up approach Enterprise Data Warehouse Vs Data Marts Typical Data Warehouse Architecture Logical Vs Physical Design Star Schema Snowflake Schema Facts and Dimensions Slowly changing dimensions
ETL/ Data Integration
Data Sources and Extraction Data Transformation Data Loading and Refreshing Data Load time and Throughput Mapping and Process scheduling Data Load Administration and Monitoring Lookups and other important transformations Time Series analysis & data loading process for Slowly Changing Dimension(SCD) ETL Tool Walkthrough (Informatica or Talend)
OLAP/ Data Visualization/ Business Intelligence
Decision support systems Modeling the data Business Intelligence Overview Data Quality How is Data Analysed? What is OLAP? What is Data Mining? Vizualizing Data Tabular Data, Charts and Dashboards ROLAP and MOLAP Report automation and scheduling OLAP Tool walkthrough (Tableau or PowerBI)
Big Data/Hadoop
What is Big Data, Emergence of the Big Data, Big Data Scenarios Introduction to Hadoop Architecture, Name Node, Data Nodes Introduction to HDFS, HIVE and HBASE Creating internal/external tables, data types, limitations HDFS/HIVE/HBASE Commands and Hands-on Sqoop - Introduction, Import & Export data from and to Sqoop Introduction to Kafka Introduction to PIG scripting
Big Data Testing
Introduction to PIG scripting Big Data Test Planning Approach Test Data Creation approach Test Execution approach
TESTING in Data Engineering Context
Test Plan Test cases & scenarios Testing cycle UTC Integration Testing System testing UAT Tools HP ALM - High level -Theory Jira - High level demo
Introduction to Agile
Agile overview Agile types Agile methodologies Agile methodology in testing
Introduction to Unix
Unix Basics UNIX commands for various operations UNIX file I/O operations and file permissions
Introduction to Cloud and Azure Fundamentals
-Introduction to Cloud Computing and Cloud Platforms -Cloud Concepts - Principles of Cloud Computing -Create an Azure account -Core Cloud Services - Introduction to Azure -Core Cloud Services - Azure architecture and service guarantees -Core Cloud Services - Manage Services with the Azure portal -Security, responsibility, and trust in Azure -Apply and monitor infrastructure standards with Azure Policy -Control and organize Azure resources with Azure Resource Manager -Predict costs and optimize spending for Azure
Azure Storage
-What is Azure Storage -Storage Types -How does Azure storage works -Blob data storage -Azure Storage security -Managing and Monitoring storage
Azure Data Catalog
-What is Azure Data catalog -Architecture of Azure Data Catalog -Where do I use Azure Data Catalog? -Introduction to Azure portal -Creating a data catalog -Registering Data sources -Supported Data sources in Azure Data Catalog -Publishing the data sources
Azure Data factory
-What is Azure Data Factory -Why Azure Data Factory (ADF) -Key Concepts of ADF -Linked Services, Activity, Pipe Lines -Lab - Building First Pipeline
Azure Data Lake
-What is Azure Data catalog -Introduction to Azure data lake -Basics of U-SQL
"Azure Synapse Analytics (formerly SQL DW) & Polybase"

-Overview -Data Access and Querying -Data Loading and Export -Processing large volume data load for Big Data analysis

Tabular Model
-Learn and implement Tabular models which are Analysis Services databases that run in-memory or in DirectQuery mode -Accessing data directly from backend relational data sources
Power BI
-Power BI Overview -Power Bi Desktop -Power BI Queries - Connect to Data, Common query Tasks -Power BI queries - Parameters and custom task -PowerBI – Modelling -DAX -PowerBI Visuals -PowerBI Service
Event Hub & Stream Analytics
-Event Hub : What is Azure Event Hub -Event Hubs programming Guide -Application of Event Hubs -Managing Event Hubs. -Stream Analytics: what is stream data? -Stream Analytics Pattern -Introducing stream Analytics
Logic Apps
-Streaming data from Social media
Azure DataBricks
-Overview of Azure Databricks -Introducing stream Analytics -Creating ETL pipeline using Azure Databricks -Publish Azure Databricks pipeline
Azure Cosmos DB (DocumentDB)
-Provides an insight to DocumentDB which is a NoSQL offering from Microsoft on the cloud.
HD Insight
-Big Data Analytics with HD Insight -Create Hadoop, HBase, Storm or Spark Clusters on Linux in HDInsight using the portal
Introduction to AWS
Introduction to Cloud computing & AWS
Launch BI Server with termination protection enable Monitor Ec2 Instance Modify Security Group of BI Server to allow access Resize your BI Server Test Termination Protection Termination Ec2 Instance
Create S3 bucket Add an object to S3 bucket Create bucket policy for BI server Configure S3 bucket versioning Load data into S3, processing pipelines
Creating users and groups Configuring IAM policy Configuring IAM roles for BI server
AWS Lambda
Create Lambda function Configure s3 bucket as a Lambda event source Trigger Lambda function by uploading data to S3
AWS Redshift
Intro to Column-oriented database Massively Parallel Processing (MVP) Concepts Data types used in Amazon RedShift Getting started with AWS Redshift Creating an IAM role Launching a Sample Amazon Redshift Cluster Authorizing access to the cluster Connecting to the cluster and running queries Loading sample data from Amazon S3 Cleaning up
Basics of EMR
Amazon Elastic MapReduce (EMR) is an Amazon Web Services (AWS) tool for big data processing and analysis.
Basics of Glue
Fully managed extract, transform, and load (ETL) service
Intro to Amazon Kinesis Data Streams
Massively scalable, highly durable data ingestion and processing service optimized for streaming data.
Basics of DynamoDB
Fully managed proprietary NoSQL database service that supports key-value and document data structures
Basics of Athena
Serverless Interactive Query Service
Route 53 (DNS)
Route53 - Register A Domain Name Lab Route53 Routing Policies Available On AWS Simple Routing Policy Lab Weighted Routing Policy Lab Latency Routing Policy Failover Routing Policy Geolocation Routing Policy Geoproximity Routing Policy (Traffic Flow Only)
Introduction To VPCs Benefits of VPCs Benefits of VPCs Build A Custom VPC Network Address Translation (NAT) Access Control Lists (ACL) Custom VPCs and ELBs VPC Flow Logs Bastions
Project involving creation of database objects, Dimensional Modeling, ETL transformations, Mappings, and OLAP reports using cloud services

About the Instructor

About the Instructor