Distrusted computing using Google Cloud Compuitng

Question

Hi

I would like to inquire about the Google computing engine:

- Is possible to create a distributed cluster by creating many virtual machines and connected them to run code in Parallel.  What is the best service to achieve this? Are there any useful resources?

- If I created many virtual machines instance and shut down one that is not needed, is this enough to avoid charging or I have to delete it?

Thanks.

Answer 1

The question is pretty generic so I can only suggest generic solutions

Yes, you can make a distributed cluster. Just use GKE in this problem. For references on this, do check Kubernetes documentation and GKE documentation.

If you create many VMs (assuming your first GKE cluster), pricing follows Google Compute VM. On stop of instance, billing stops. If you have more than 1 GKE instance, you would need to pay for the "master node" fee which is pretty pricey

Hope this helped!!

To know more about Google Cloud, It is recommended to go for Google Cloud Certification training today.

Thank you!

Comments

Thanks.

I just want to create separate virtual machines via GCE and connect them using a distributed framework like ray or dask.

---

Hey @Angelus, that's interesting. I guess you could probably go with it

Answer 2

You should use autoscaling to add or remove VM instances as and when load increase and decrease.