LogExporter

Export logs to a Google Cloud Storage

This task is designed to send logs to a Google Cloud Storage.

yaml
type: "io.kestra.plugin.ee.gcp.gcs.LogExporter"

Examples

Ship logs to GCP

yaml
id: log_shipper
namespace: company.team

triggers:
  - id: daily
    type: io.kestra.plugin.core.trigger.Schedule
    cron: "@daily"

tasks:
  - id: log_export
    type: io.kestra.plugin.ee.core.log.LogShipper
    logLevelFilter: INFO
    lookbackPeriod: P1D
    logExporters:
      - id: GCPLogExporter
        type: io.kestra.plugin.ee.gcp.gcs.LogExporter
        projectId: myProjectId
        format: JSON
        maxLinesPerFile:10000
        bucket: my-bucket
        logFilePrefix: kestra-log-file
        chunk: 1000

Properties

bucket *string

GCS Bucket to upload logs files.

The bucket where log files are going to be imported

id *string

Validation RegExp ^[a-zA-Z0-9][a-zA-Z0-9_-]*

Min length 1

chunk integerstring

Default 1000

The chunk size for every bulk request.

format string

Default JSON

Possible Values

IONJSON

Format of the exported files

The format of the exported files

impersonatedServiceAccount string

The GCP service account to impersonate.

logFilePrefix string

Default kestra-log-file

Prefix of the log files

The prefix of the log files name. The full file name will be logFilePrefix-localDateTime.json/ion

maxLinesPerFile integerstring

Default 100000

Maximum number of lines per file

The maximum number of lines per file

projectId string

The GCP project ID.

scopes array

SubType string

Default ["https://www.googleapis.com/auth/cloud-platform"]

The GCP scopes to be used.

serviceAccount string

The GCP service account key.

​Log​Exporter

LogExporter