What tools do you use to manage application logs and how do you handle log management at scale

0 votes
What tools do you use to manage application logs, and how do you handle log management at scale?

Centralized logging at scale: As the volume increases, managing logs at scale is done by collecting, storing, and analyzing massive datasets. Explain your use of centralised logging tools such as ELK Stack, Splunk, or DataDog, and strategies for dealing with data retention, indexing, and searching to make logs accessible and manageable as the volume grows. Also include practices like log rotation and archiving for efficient storage.
Nov 3 in DevOps Tools by Anila
• 4,640 points
70 views

1 answer to this question.

0 votes

Centralization of Application Logs: Centralize application logs by aggregating them across environments on platforms like ELK Stack (Elasticsearch, Logstash, Kibana), Splunk, or Fluentd. All these tools support full-text search, visualization, and real-time monitoring to simplify the analysis and troubleshooting at scale.
Scaling Log Management: On very large environments, I force rotation policies and retention limits for controlling the cost of storage. Logs are archived with low cost in S3 Glacier (or other cold storage) while recent ones stay on fast-access storage. In Kubernetes, Grafana Loki is used for logging. It pairs really well with Prometheus to scale efficiently log aggregation since they index logs by labels instead of content, which cuts the cost of storage and retrieval time.

answered Nov 12 by Gagana
• 5,810 points

Related Questions In DevOps Tools

0 votes
1 answer

What are your favorite command-line tools for DevOps, and how do you use them in your daily workflows?

No DevOps working environment is possible without ...READ MORE

answered Oct 23 in DevOps Tools by Gagana
• 5,810 points
126 views
0 votes
1 answer

How do you test infrastructure as code, and what frameworks or tools do you use for this purpose?

Testing Infrastructure as Code: Provisioning the infrastructure correctly ...READ MORE

answered Oct 24 in DevOps Tools by Gagana
• 5,810 points
152 views
0 votes
1 answer

How do you integrate automated testing into your deployment pipeline, and what tools do you use for this?

Automate tests into a deployment pipeline  1.Add Tests ...READ MORE

answered Oct 23 in DevOps Tools by Gagana
• 5,810 points
109 views
0 votes
1 answer

What tools do you use for container security, and how do you integrate them into your DevOps pipeline?

Securing Containers: Tools and the integration with ...READ MORE

answered Nov 4 in DevOps Tools by Gagana
• 5,810 points
90 views
+5 votes
7 answers

Docker swarm vs kubernetes

Swarm is easy handling while kn8 is ...READ MORE

answered Aug 27, 2018 in Docker by Mahesh Ajmeria
3,969 views
+15 votes
2 answers

Git management technique when there are multiple customers and need multiple customization?

Consider this - In 'extended' Git-Flow, (Git-Multi-Flow, ...READ MORE

answered Mar 27, 2018 in DevOps & Agile by DragonLord999
• 8,450 points
4,053 views
0 votes
1 answer

What tools and processes do you use to manage infrastructure state drift in Terraform?

Manage state drift in Terraform using proactive detection, mitigation, and ...READ MORE

answered 6 days ago in DevOps Tools by Gagana
• 5,810 points
43 views
0 votes
1 answer
webinar REGISTER FOR FREE WEBINAR X
REGISTER NOW
webinar_success Thank you for registering Join Edureka Meetup community for 100+ Free Webinars each month JOIN MEETUP GROUP