Description
A job finishes, the new data lands in the tables, and someone still has to look through it to see what changed. The Genie Code task in Lakeflow Jobs puts an agent into the job itself, right after the tasks that produced the data.
You add a task, pick Genie Code as the type and write a prompt for what the agent should do once the tasks before it finish:
• Summarize the results of an overnight job and email a report
• Analyze incoming data and flag anomalies
• Investigate a Jira ticket and propose a fix
• Generate a weekly compliance audit
The Genie Code task is generally available. If you don't need a pipeline, a scheduled task in Genie Code runs the same prompt on a schedule, and its runs don't show up in your job runs. The job task is for when the agent has to react to what the pipeline just produced.
This time an agent looks at the tables first.
https://docs.databricks.com/aws/en/jobs/tasks/genie-code