Google Cloud Composer 是一个完全托管的 工作流编排服务,基于 Apache Airflow。它使您能够创建、调度和监控跨云和本地数据中心的管道。使用 GCP Composer,您可以轻松将工作流与其他 Google Cloud 服务集成,从而促进高效的数据集成和分析任务。该服务旨在简化管理基于云的数据工作流的复杂性,使其成为处理大规模数据处理任务的数据工程师和开发人员的宝贵工具。
枚举
# Get envs infogcloudcomposerenvironmentslist--locations<loc>gcloudcomposerenvironmentsdescribe--location<loc><environment># Get list of dagsgcloudcomposerenvironmentsstoragedagslist--environment<environment>--location<loc># Download dags codemkdir/tmp/dagsgcloudcomposerenvironmentsstoragedagsexport--environment<environment>--location<loc>--destination/tmp/dags# List Data from composergcloudcomposerenvironmentsstoragedatalist--environment<environment>--location<loc># Download datamkdir/tmp/datagcloudcomposerenvironmentsstoragedataexport--environment<environment>--location<loc>--destination/tmp/data# List Plugins from composergcloudcomposerenvironmentsstoragepluginslist--environment<environment>--location<loc># Download pluginsmkdir/tmp/pluginsgcloudcomposerenvironmentsstoragedataexport--environment<environment>--location<loc>--destination/tmp/plugins