Google Cloud Composer 是一个完全托管的 工作流编排服务,基于 Apache Airflow 构建。它使您能够编写、调度和监控跨云和本地数据中心的管道。使用 GCP Composer,您可以轻松地将工作流与其他 Google Cloud 服务集成,促进高效的数据集成和分析任务。该服务旨在简化管理基于云的数据工作流的复杂性,是数据工程师和开发人员处理大规模数据处理任务的宝贵工具。
枚举
# Get envs infogcloudcomposerenvironmentslist--locations<loc>gcloudcomposerenvironmentsdescribe--location<loc><environment># Get list of dagsgcloudcomposerenvironmentsstoragedagslist--environment<environment>--location<loc># Download dags codemkdir/tmp/dagsgcloudcomposerenvironmentsstoragedagsexport--environment<environment>--location<loc>--destination/tmp/dags# List Data from composergcloudcomposerenvironmentsstoragedatalist--environment<environment>--location<loc># Download datamkdir/tmp/datagcloudcomposerenvironmentsstoragedataexport--environment<environment>--location<loc>--destination/tmp/data# List Plugins from composergcloudcomposerenvironmentsstoragepluginslist--environment<environment>--location<loc># Download pluginsmkdir/tmp/pluginsgcloud composer environments storage data export --environment <environment> --location <loc> --destination /tmp/plugins