英文:
How to run some batch script on all MWAA Airflow worker nodes?
问题
有没有办法在MWAA启动的每个工作节点上运行特定的批处理脚本？
Airflow中是否有可以执行此操作的功能？
英文:
Is there a way to run a specific batch script on every worker node that MWAA spins up?
Is there any feature in airflow that can do this?
答案1
得分: 1
因为MWAA不支持此操作，所以没有实际的方法来执行此操作。各个节点的设置由AWS进行管理，这意味着您无法对其进行干预。
英文:
There is no practical way to do this because it is not supported by MWAA. Set up of the individual nodes is managed by AWS, which means you don't get to mess with it.
答案2
得分: 1
使用最新版本，您可以将脚本作为启动脚本在每个工作节点上运行。为此，脚本需要在S3存储桶中可用，并将其绝对路径提供给MWAA环境的“启动脚本文件”。
有关更多详细信息，请参阅https://docs.aws.amazon.com/mwaa/latest/userguide/using-startup-script.html。
英文:
With the latest version, you can run the scripts as a startup scripts on every worker. For this the scripts needs to be available in the S3 bucket and its absolute path is provided to MWAA environment "Startup script file "
For more details - https://docs.aws.amazon.com/mwaa/latest/userguide/using-startup-script.html
通过集体智慧和协作来改善编程学习和解决问题的方式。致力于成为全球开发者共同参与的知识库，让每个人都能够通过互相帮助和分享经验来进步。
评论