Databricks Tutorial | Databricks Free Edition Tutorial with End-to-End Data + AI Project
In this databricks tutorial, you will learn Databricks foundations from scratch and build a real end-to-end project in E-Commerce domain that you can confidently put on your resume. This Databricks micro Course explains everything in a simple, intuitive way! Signup to Databricks Free Edition: https://bit.ly/4nK0NTN Code, Dataset, other resources: https://resources.codebasics.io/FXipmd Get Certified by Codebasics with this Databricks Mini Course - https://resources.codebasics.io/t7vk5z ⭐️ Timestamps ⭐️ 00:00:00 Intro 00:01:15 Project Introduction 00:03:09 Stakeholder Discussion 00:04:45 Two Learning Paths 00:05:19 Sign up for the free edition 00:06:03 Explore Databricks UI 00:11:12 Dataframe Basics 00:27:54 Distributed Computing, Spark, and Databricks 00:34:51 SQL and joins in Spark 00:49:48 Reading Spark plans with explain 01:02:37 Spark Architecture 01:07:43 Transformations vs Actions and Lazy Evaluation 01:16:03 Narrow vs Wide Transformation 01:19:55 Partition and Parallelism: Repartition 01:34:00 Partition and Parallelism: Coalesce 01:39:37 Managed vs External Tables 01:43:26 Medallion architecture 01:49:18 Unity Catalog 01:59:21 Acid & Time Travel 02:09:05 About AWS Account & Delta Lake 02:09:26 AWS Account Setup 02:11:39 Delta Lake and Delta format 02:25:09 Intro & Tech Architecture 02:28:23 Catalog Setup 02:31:51 Data Understanding and Upload 02:36:20 Dimension Data Processing 03:00:45 Fact Data Processing 03:14:25 Get Insights using Genie 03:18:02 BI Dashboard 03:28:15 Orchestration 03:33:27 Stakeholder Review Meeting 03:34:50 What’s Next? Do you want to learn technology from me? Check https://codebasics.io/?utm_source=description&utm_medium=yt&utm_campaign=description&utm_id=description for my affordable video courses. Need help building software or data analytics/AI solutions? My company https://www.atliq.com/ can help. Click on the Contact button on that website. 🎥 Codebasics Hindi channel: https://www.youtube.com/channel/UCTmFBhuhMibVoSfYom1uXEg #️⃣ Social Media #️⃣ 🧑🤝🧑 Discord for Community Support: https://discord.gg/r42Kbuk 📸 Codebasics' Instagram: https://www.instagram.com/codebasicshub/ 📝 Codebasics' Linkedin : https://www.linkedin.com/company/codebasics/ ------ 📝 Dhaval's Linkedin : https://www.linkedin.com/in/dhavalsays/ 📝 Hem's Linkedin: https://www.linkedin.com/in/hemvad/ 📽️ Hem's Instagram for daily tips: https://www.instagram.com/hemvadivel/ 📸 Dhaval's Personal Instagram: https://www.instagram.com/dhavalsays/ 🔗 Patreon: https://www.patreon.com/codebasics?fan_landing=true
