Databricks Platform Features – Deep Dive into Delta Lake using PySpark Data Frames Do you want to learn Spark Delta Lake hands-on? Here are the YouTube Videos premiered for free. Also, the lectures and content along with the support are available as part of our Udemy course (go to the bottom or look at the …
Databricks Platform Features – Deep Dive into Delta Lake using PySpark Data Frames Read More »
Data Engineering using Databricks on AWS and Azure Course Details As part of this course, you will be learning Data Engineering using Databricks. Getting Started with Databricks Setup Local Development Environment to develop Data Engineering Applications using Databricks Using Databricks CLI to manage files, jobs, clusters, etc related to Data Engineering Applications Spark Application Development …
Data Engineering using Databricks on AWS and Azure Read More »
Exercises – Database Operations¶ Let’s create a table and perform database operations using direct SQL. Exercise 1 – Create Table¶ Create table – courses course_id – sequence generated integer and primary key course_name – which holds alpha numeric or string values up to 60 characters course_author – which holds the name of the author up …
Overview of Transactions¶ Let us go through the details related to Transactions.* We typically perform operations such as COMMIT and ROLLBACK via the applications. COMMIT will persist the changes in the database. ROLLBACK will revert the uncommitted changes in the database. We typically rollback the uncommitted changes in a transaction if there is any exception …
Deleting Data¶ Let us understand how to delete the data from a table. Typical Syntax – DELETE FROM <table> WHERE <condition>. If we do not specify condition, it will delete all the data from the table. It is not recommended to use delete with out where condition to delete all the data (instead we should …
Updating Data¶ Let us see how we can update data in the table. Typical syntax UPDATE <table_name> SET col1 = val1, col2 = val2 WHERE <condition> If WHERE condition is not specified all rows in the table will be updated. For now we will see basic examples for update. One need to have good knowledge …
