Delete a Databricks job
You learned how to create and run a Databricks job using the Python SDK. Sometimes there will be jobs that you previously created that are now deprecated so you want to delete them. You can use the SDK to programatically delete these jobs instead of going into the Databricks console to manually delete them. In this exercise, you will create a job and then use the SDK to delete that job.
We have already created the WorkspaceClient(), storing as w, and a notebook_path variable.
This exercise is part of the course
Databricks with the Python SDK
Exercise instructions
- Create a Databricks job using the
WorkspaceClientthat runs oncluster_id. - Delete the Databricks job created in step 1.
Hands-on interactive exercise
Have a go at this exercise by completing this sample code.
# Create a job that runs the notebook referenced in the `notebook_path` variable
created_job = w.jobs.____(name='sdk-dc-project-task',
tasks=[
jobs.Task(description="create_notebook_test",
____=cluster_id,
notebook_task=jobs.____(
notebook_path=notebook_path),
task_key="my-key")
])
# Delete the job that was just created
w.jobs.____(job_id=created_job.____)