Logtail
What is Logtail?Get helpBook a demoSystem Status
Search…
⌃K
Links

AWS S3-compatible archive

Archive your logs in AWS S3 or a compatible storage service.

AWS S3

  1. 1.
    In the AWS Management Console​
    1. 1.
      ​Create a new S3 Bucket and write down its name and region.
    2. 2.
      ​Create a new user in IAM with Programmatic access and configure the permissions to have read and write access to your new bucket. Write down the access key ID and the access secret key.
    3. 3.
      Make sure your bucket is not publicly accessible.
  2. 2.
    In the Logtail Integrations section​
    1. 1.
      Add new AWS S3-compatible archive integration.
    2. 2.
      Give your integration a name.
    3. 3.
      Fill in the bucket name and region from step 1.1
    4. 4.
      Fill in your credentials from step 1.2
    5. 5.
      If you entered all information correctly and if you set up the access privileges correctly, you'll see a confirmation message and you will find a logtail_access_test text file in your Bucket.
  3. 3.
    In the advanced settings of your source, you can now select the integration under the Long-term log archive setting

DigitalOcean Spaces

  1. 1.
    In the DigitalOcean console
    1. 1.
      ​Create a new Space with Restrict File Listing and write down its name and region.
    2. 2.
      In the API section generate a new key. Write down the Key and Secret of the new key.
  2. 2.
    In the Logtail Integrations section​
    1. 1.
      Add new AWS S3-compatible archive integration.
    2. 2.
      Give your integration a name.
    3. 3.
      Select "DigitalOcean Spaces".
    4. 4.
      Fill in the bucket field with the space name and also set the DigitalOcean region
    5. 5.
      Fill in your credentials from step 1.2
      • Key corresponds to Access Key ID
      • Secret corresponds to Secret Access Key
    6. 6.
      If you entered all information correctly and if you set up the access privileges correctly, you'll see a confirmation message and you will find a logtail_access_test text file in your Space.
  3. 3.
    In the advanced settings of your source, you can now select the integration under the Long-term log archive setting

Backblaze B2

  1. 1.
    Log in to your Backblaze B2 account​
    1. 1.
      Create a new Private bucket and write down its name and region
    2. 2.
      In the App Keys section add a new application key with read and write access to the new bucket. Write down keyID and applicationKey (secret).
  2. 2.
    In the Logtail Integrations section​
    1. 1.
      Add new AWS S3-compatible archive integration
    2. 2.
      Give your integration a name
    3. 3.
      Select "Backblaze B2"
    4. 4.
      Fill in the bucket name and the region (include region number, e.g. us-west-002)
    5. 5.
      Fill in your credentials from step 1.2
      • keyID corresponds to Access Key ID
      • applicationKey corresponds to Secret Access Key
    6. 6.
      If you entered all information correctly and if you set up the access privileges correctly, you'll see a confirmation message and you will find a logtail_access_test text file in your Bucket.
  3. 3.
    In the advanced settings of your source, you can now select the integration under the Long-term log archive setting

Google Cloud Storage

  1. 1.
    Log in to your Google Cloud console and go to Cloud Storage.
    1. 1.
      Create a new bucket and write down its name.
    2. 2.
      Open "Interoperability" tab in the settings, create a service account with read and write rights (e.g. using storage.objectAdmin role) to the bucket and write down its access key and secret.
  2. 2.
    Open the Logtail Integrations section.
    1. 1.
      Add a new AWS S3-compatible archive integration.
    2. 2.
      Give your integration a name.
    3. 3.
      Select "Google Cloud Storage".
    4. 4.
      Fill in the bucket name from step 1.1.
    5. 5.
      Fill in your credentials from step 1.2.
    6. 6.
      If you entered all information correctly and if you set up the access privileges correctly, you'll see a confirmation message and you will find a logtail_access_test text file in your Space.
  3. 3.
    In the advanced settings of your source, you can now select the integration under the Long-term log archive setting.

Other S3-compatible storage services

  1. 1.
    Create a new bucket in your S3-compatible service of choice
  2. 2.
    Create an access key and write down the access key ID and the secret key
  3. 3.
    In the Logtail Integrations section​
    1. 1.
      Add new AWS S3-compatible archive integration
    2. 2.
      Give your integration a name
    3. 3.
      Select "Other"
    4. 4.
      Fill in the credentials (access key ID and secret access key)
    5. 5.
      In "Advanced settings" fill in the endpoint of your bucket in the path-style format (e.g., https://<region>.digitaloceanspaces.com/<bucket-name>).
  4. 4.
    In the advanced settings of your source, you can now select the integration under the Long-term log archive setting
Contact us at [email protected] if you're having trouble setting up archiving to your S3-compatible storage service.
How-to Guides - Previous
GeoIP map visualization
Next - How-to Guides
String + JSON format
Last modified 3mo ago