Integration

Here you learn how to integrate the Lightly Docker into data pre-processing pipelines.

Warning

The Docker Archive documentation is deprecated

The old workflow described in these docs will not be supported with new Lightly Worker versions above 2.6. Please switch to our new documentation page instead.

• Using the Docker with a Cloud Bucket as Remote Datasource
• Trigger a Docker Job from from the Platform or code
• Load data directly from S3 buckets using s3fs-fuse
• Data Pre-processing Pipeline on AWS with Dagster