Learn Data Engineering - Databricks, Spark, Spark Streaming, Data Warehousing etc. all for FREE

44 Databricks SQL Alerts | Configure Alert Schedule and Destinations
10:11
44 Databricks SQL Alerts | Configure Alert Schedule and Destinations
43 Lakehouse Federation or Query Federation in Databricks | Query External Database |Foreign Catalog
10:46
43 Lakehouse Federation or Query Federation in Databricks | Query External Database |Foreign Catalog
42 Streaming Tables and Materialized Views in DBSQL | Background Working | Schedule data Refresh
21:16
42 Streaming Tables and Materialized Views in DBSQL | Background Working | Schedule data Refresh
41 Data Warehousing using DBSQL | SQL Warehouses on Databricks | SQL Query Performance Tuning
16:18
41 Data Warehousing using DBSQL | SQL Warehouses on Databricks | SQL Query Performance Tuning
40 Serverless Compute for Notebooks, Jobs, DLT, ML and Warehouses | Architecture of Serverless
13:05
40 Serverless Compute for Notebooks, Jobs, DLT, ML and Warehouses | Architecture of Serverless
39 Delta Sharing in Databricks | Databricks Express Edition | Share Data outside your Organization
12:38
39 Delta Sharing in Databricks | Databricks Express Edition | Share Data outside your Organization
38 Workspace Catalog Binding in Unity Catalog in Databricks | Limit Catalog Access | Share Catalog
10:39
38 Workspace Catalog Binding in Unity Catalog in Databricks | Limit Catalog Access | Share Catalog
37 Column Level Masking in UC | Mask Sensitive Column in Unity Catalog table using Column Masking
16:15
37 Column Level Masking in UC | Mask Sensitive Column in Unity Catalog table using Column Masking
36 Row Level Filters in UC | Filter Sensitive Data in Unity Catalog table using Row Level Security
20:17
36 Row Level Filters in UC | Filter Sensitive Data in Unity Catalog table using Row Level Security
35 Functions in Unity Catalog using Databricks SQL | SCALAR and TABLE User Defined Functions
16:28
35 Functions in Unity Catalog using Databricks SQL | SCALAR and TABLE User Defined Functions
34 Object Level Security or Permissions in Unity Catalog | Manage Object Privileges in Unity Catalog
20:41
34 Object Level Security or Permissions in Unity Catalog | Manage Object Privileges in Unity Catalog
32 Spark Memory Management | Why OOM Errors in Spark | Spark Unified Memory | Storage/Execution Mem
48:25
32 Spark Memory Management | Why OOM Errors in Spark | Spark Unified Memory | Storage/Execution Mem
33 User Management in Databricks | How to add Users, Service Principal & Groups in Unity Catalog
17:34
33 User Management in Databricks | How to add Users, Service Principal & Groups in Unity Catalog
32 Databricks Secret Management & Secret Scopes | Save secrets in Databricks |Use of Azure Key Vault
14:10
32 Databricks Secret Management & Secret Scopes | Save secrets in Databricks |Use of Azure Key Vault
31 DLT Truncate Load Source | Workflow File Arrival Triggers | Full Refresh | Schedule DLT pipelines
11:16
31 DLT Truncate Load Source | Workflow File Arrival Triggers | Full Refresh | Schedule DLT pipelines
PySpark Full Course | Basic to Advanced Optimization with Spark UI PySpark Training | Spark Tutorial
6:43:45
PySpark Full Course | Basic to Advanced Optimization with Spark UI PySpark Training | Spark Tutorial
30 DLT Data Quality & Expectations | Monitor DLT pipeline using SQL | Define DQ rule |Observability
17:57
30 DLT Data Quality & Expectations | Monitor DLT pipeline using SQL | Define DQ rule |Observability
29 DLT SCD2 & SCD1 table | Apply Changes | CDC | Back loading SCD2 table | Delete/Truncate SCD table
20:10
29 DLT SCD2 & SCD1 table | Apply Changes | CDC | Back loading SCD2 table | Delete/Truncate SCD table
28 DLT Append Flow(Union) & Autoloader | Pass parameter in DLT pipeline |Generate tables dynamically
17:50
28 DLT Append Flow(Union) & Autoloader | Pass parameter in DLT pipeline |Generate tables dynamically
27 DLT Internals & Incremental load | DLT Part 2 | Add or Modify columns| Rename table| Data Lineage
13:33
27 DLT Internals & Incremental load | DLT Part 2 | Add or Modify columns| Rename table| Data Lineage
26 DLT aka Delta Live Tables | DLT Part 1 | Streaming Tables & Materialized Views in DLT pipeline
22:41
26 DLT aka Delta Live Tables | DLT Part 1 | Streaming Tables & Materialized Views in DLT pipeline
25 Medallion Architecture in Data Lakehouse | Use of Bronze, Silver & Gold Layers
3:09
25 Medallion Architecture in Data Lakehouse | Use of Bronze, Silver & Gold Layers
24 Auto Loader in Databricks | AutoLoader Schema Evolution Modes | File Detection Mode in AutoLoader
23:04
24 Auto Loader in Databricks | AutoLoader Schema Evolution Modes | File Detection Mode in AutoLoader
23 Databricks COPY INTO command | COPY INTO Metadata | Idempotent Pipeline | Exactly Once processing
14:51
23 Databricks COPY INTO command | COPY INTO Metadata | Idempotent Pipeline | Exactly Once processing
22 Workflows, Jobs & Tasks | Pass Values within Tasks | If Else Cond | For Each Loop & Re-Run Jobs
25:15
22 Workflows, Jobs & Tasks | Pass Values within Tasks | If Else Cond | For Each Loop & Re-Run Jobs
21 Custom Cluster Policy in Databricks | Create Instance Pools | Warm Instance Pool
13:48
21 Custom Cluster Policy in Databricks | Create Instance Pools | Warm Instance Pool
20 Databricks Computes - All Purpose & Job | Access Modes | Cluster Policies | Cluster Permissions
17:14
20 Databricks Computes - All Purpose & Job | Access Modes | Cluster Policies | Cluster Permissions
19 Orchestrating Notebook Jobs, Schedules using Parameters | Run Notebook from another Notebook
13:51
19 Orchestrating Notebook Jobs, Schedules using Parameters | Run Notebook from another Notebook
18 DBUTILS command | Databricks Utilities | Create Widgets in Databricks Notebooks |DBUTILS FS usage
12:41
18 DBUTILS command | Databricks Utilities | Create Widgets in Databricks Notebooks |DBUTILS FS usage
31 Delta Tables - Deletion Vectors and Liquid Clustering | Optimize Delta Tables | Delta Clustering
12:53
31 Delta Tables - Deletion Vectors and Liquid Clustering | Optimize Delta Tables | Delta Clustering