AWS CloudWatch Logs in Docker

Question

I want to use AWS CloudWatch logs in a Kubernetes cluster, where each pod contains a few Docker containers, each deployment would have a separate Log Group, and each container would have a separate stream.
 I could not find a way to send the logging parameters to the docker containers via Kubernetes create / apply.

How can I send the log-driver and log-opt parameters to a Docker container in a pod / deployment?

Setting an AWS CloudWatch Logs driver in docker is done with log-driver=awslogs and log-opt, for example -

#!/bin/bash

docker run \
    --log-driver=awslogs \
    --log-opt awslogs-region=eu-central-1 \
    --log-opt awslogs-group=whatever-group \
    --log-opt awslogs-stream=whatever-stream \
    --log-opt awslogs-create-group=true \
    wernight/funbox \
        fortune

Can anyone helP?

Answer 1

Try using a Helm chart to install Fluentd:

$ helm install --name my-release incubator/fluentd-cloudwatch

Even I tried this from Github, was suggested by an experienced techie, this will help for sure, try this:   https://github.com/kubernetes/charts/tree/master/incubator/fluentd-cloudwatch

Answer 2

The awslogs works without using ECS.

you need to configure the AWS credentials (the user should have IAM roles appropriate [cloudwatch logs]).

I used this tutorial, it worked for me: https://wdullaer.com/blog/2016/02/28/pass-credentials-to-the-awslogs-docker-logging-driver-on-ubuntu/