Slow Docker Pull

+1 vote
Hi dear community,

We are hosting private docker registry on different remote network and experiencing some pull issues.Now overall scenario is imagine 3 different remote networks.1 and 2 networks are clients and locate on same country 3rd network is docker registry and locates on different country that clients.Now 1st client has like 936.75Mbps(Latency: 1.47 ms (0.12 ms jitter)) download speed and almost has no issues pulling docker images.But second client network has a bit slower (generally high) internet speed like 100Mbps(Latency: 1.44 ms (0.55 ms jitter)).Now this second client has pulling issues like sometimes pull starts fast on some layers then one of the layers(this layer always changes ,not same layers) starts pulling very-very slowly like Kilobayts per second and that pulls takes a lot of time to pull.If I am lucky docker will retry pulling of layer and right after this retry layer pulls fastly or I would need to restart docker service, restarting docker service helps for that particular time(but very bad idea to restart docker on production).I have 3 questions
1)What can be the reason for this problem? is there any way to full debug pull process?
2)How can I customize retry interval for docker layers?
3Is there any way to force docker retry image pull without restarting docker(image pulls are done by kubernetes so pull works somewhere in background)
Oct 7 in Docker by Allahshukur
• 130 points
258 views

1 answer to this question.

0 votes

Hi@Allahshukar,

As you said your docker clients are in a different country then latency is an issue. For example, if you hosted your docker in a cloud platform like AWS, then you can use the CloudFront service. It will work as edge computing. So every client will connect to the nearest cloud datacenter.

answered Oct 7 by MD
• 79,930 points

Latency is the same for both clients but there is a huge difference in speed. Now, what is the other solution than hosting a docker registry locally? what about the retry interval is it customizable? because retries help docker to be fast again it is like a problem with long sessions.

The latency between 1st client and server

Server: ORANGE FRANCE - Bordeaux (id = 29542)
        ISP: AzInTelecom LLC
    Latency:    89.65 ms   (0.08 ms jitter)
   Download:  1798.13 Mbps (data used: 2.8 GB)
     Upload:   923.92 Mbps (data used: 1.6 GB)

The latency between 2nd client and server

Server: ORANGE FRANCE - Bordeaux (id = 29542)
        ISP: Delta Telecom Ltd
    Latency:    90.35 ms   (0.44 ms jitter)
   Download:    89.14 Mbps (data used: 121.0 MB)                              
     Upload:    91.31 Mbps (data used: 109.0 MB)

Hi@Allahshukur,

This is what I told you. Because packets are travelling from one country to another country. You may also face a network connectivity issue. I mean it starts downloading but after some time it shows network issue. According to me, you need to use an edge computing concept. Research on the topic and see if matches your requirement or not.

Related Questions In Docker

+1 vote
3 answers
+4 votes
4 answers

How To Access a Service on Host From a Docker Container?

Adding to kalgi's answer, You can also ...READ MORE

answered Oct 16, 2018 in Docker by lina
• 8,220 points

edited Oct 16, 2018 by lina 18,018 views
+6 votes
4 answers

Error: Docker saying "bad file descriptor"

The solution was easy enough. Add these ...READ MORE

answered Mar 26, 2018 in Docker by DragonLord999
• 8,450 points
2,714 views
+2 votes
6 answers

copy directories in docker container excluding any one directory

One of the way could be copy ...READ MORE

answered Dec 10, 2018 in Docker by Prateek
14,844 views
+2 votes
1 answer
+2 votes
1 answer

Deploy Docker Containers from Docker Cloud

To solve this problem, I followed advice ...READ MORE

answered Sep 3, 2018 in AWS by Priyaj
• 57,700 points
917 views
0 votes
1 answer

How can I install systemctl tool in Docker container?

Hi@akhtar, In docker container if you want to ...READ MORE

answered Feb 5 in Docker by MD
• 79,930 points
4,412 views
0 votes
1 answer

run script shell inside docker app and mongodb container not working?

Hi, I think this error occurs because you ...READ MORE

answered Mar 9 in Docker by MD
• 79,930 points
1,631 views