Databricks Fundamentals
+ Databricks is an integrated platform for data and AI that enables large-scale development, deployment, and management of data, analytics, and AI-driven solutions. + Founded in 2013 at University of California, Berkeley + Mission: democratize data and AI + 2020- Introduced Lakehouse + 2023- Rise of GenAI (Data +AI) Some Basic Terms: Data Warehouse: Storage of Structured data for BI & reporting Data Lakes: Storage of structured, semi & unstructured data used for almost all type of data suitable for DS,ML we can't use both by connecting each other i.e; as both storage systems with same data to be ingested. People are copying the data to use for each application as for each system the data governance and security rules are different Data Lakehouse: (Data Warehouse + Data Lake) one platform to unify all data, analytics and AI wo...