问题

有没有任何替代方案？

英文:

I want to run a Glue ETL job continuously (i.e. start automatically when previous execution of the same job finishes)

a cron trigger won't help because job doesn't always take the same time to finish.

Is there any alternative?

答案1

得分: 1

你应该能够创建一个 Lambda 函数，实现以下功能：

在 Lambda 函数体内运行 Glue 作业，代码看起来会像这样：

import boto3 

client = boto3.client('glue') 
jobname = 'your glue job'
response = client.start_job_run(JobName=jobname)

如果有帮助，请告诉我！

英文:

You should be able to create a lambda function that:

Runs the glue job (in the body of the lambda). That would look something like this:

import boto3 

client = boto3.client(&#39;glue&#39;) 
jobname = &#39;your glue job&#39;
response = client.start_job_run(JobName=jobname)

Is triggered when the glue job runs successfully (with an eventbridge trigger that looks at the glue job state change for the relevant glue job(s))

Let me know if this helps!

通过集体智慧和协作来改善编程学习和解决问题的方式。致力于成为全球开发者共同参与的知识库，让每个人都能够通过互相帮助和分享经验来进步。