Loki retention period s3 dynamo

0 votes

I have a question about the retention mechanism in grafana-loki I need store logs for one year and be able to query them Setup is in k8s with the official Loki chart

below is my config

auth_enabled: false ingester: chunk_idle_period: 5m chunk_block_size: 262144 chunk_retain_period: 1m # max_transfer_retries: 0 lifecycler: ring: kvstore: store: inmemory replication_factor: 1 limits_config: enforce_metric_name: false reject_old_samples: true reject_old_samples_max_age: 168h schema_config: configs: - from: 2020-05-15 store: aws object_store: s3 schema: v11 index: prefix: loki_index_prod_ period: 8760h tags: env: prod-loki server: http_listen_port: 3100 storage_config: aws: s3: s3://us-east-1/loki-prod-t s3forcepathstyle: true dynamodb: dynamodb_url: dynamodb://us-east-1 table_manager: index_tables_provisioning: inactive_read_throughput: 5 inactive_write_throughput: 5 provisioned_write_throughput: 10 provisioned_read_throughput: 10 chunk_tables_provisioning: inactive_read_throughput: 5 inactive_write_throughput: 5 provisioned_write_throughput: 10 provisioned_read_throughput: 10 retention_deletes_enabled: true retention_period: 8760h creation_grace_period: 24h

Now retention is configured for a year, but when the retention period is exited new table in dynamodb will be created, and the old one will be immediately deleted?

In this case, I will lose all logs from the previous year and start from scratch?

Another aspect is how to deal with the retention of chunks in s3?

Any help will be beneficial for me!!


 

Apr 12, 2022 in IoT (Internet of Things) by Rahul
• 9,680 points
1,299 views

No answer to this question. Be the first to respond.

Your answer

Your name to display (optional):
Privacy: Your email address will only be used for sending these notifications.

Related Questions In IoT (Internet of Things)

0 votes
0 answers

Amazon S3 image, cannot be saved using html5 canvas, gives Tainted Canvases Error

When I load a hosted image in ...READ MORE

Apr 12, 2022 in IoT (Internet of Things) by Soham
• 9,710 points
1,260 views
0 votes
0 answers
0 votes
0 answers

aws transcoder overwrite files on s3

I'm using the AWS PHP SDK to ...READ MORE

Apr 12, 2022 in IoT (Internet of Things) by Soham
• 9,710 points
491 views
0 votes
0 answers
+1 vote
1 answer
0 votes
3 answers

Error while joining cluster with node

Hi Kalgi after following above steps it ...READ MORE

answered Jan 17, 2019 in Others by anonymous
15,574 views
+15 votes
2 answers

Git management technique when there are multiple customers and need multiple customization?

Consider this - In 'extended' Git-Flow, (Git-Multi-Flow, ...READ MORE

answered Mar 27, 2018 in DevOps & Agile by DragonLord999
• 8,450 points
4,062 views
webinar REGISTER FOR FREE WEBINAR X
REGISTER NOW
webinar_success Thank you for registering Join Edureka Meetup community for 100+ Free Webinars each month JOIN MEETUP GROUP