What is the difference between Google Cloud Dataflow and Google Cloud Dataproc

0 votes
I am using Google Data Flow to implement an ETL data ware house solution.

Looking into google cloud offering, it seems DataProc can also do the same thing.

It also seems DataProc is little bit cheaper than DataFlow.

Does anybody know the pros / cons of DataFlow over DataProc

Why does google offer both?
Mar 31, 2022 in GCP by Rahul
• 3,380 points
2,002 views

1 answer to this question.

0 votes

Cloud Dataflow and Dataproc can both be used to implement ETL data warehousing solutions. An over about the same can be found here. 

  • Cloud Dataproc provides you with Hadoop cluster on GCP and access to Hadoop ecosystem tools (Apache Pig, Hive and Spark)
  • Cloud Dataflow provides you a place to run Apache Beam based jobs on GCP and you do not need to address common aspects of running jobs.
    • Beam jobs are not intended to be portable across 'runners'. Allows you to focus more on the logical computations
    • Cloud Dataflow also offers the ability to create jobs based on templates.

If you need to know more about Cloud Computing, We recommend joining Cloud Computing Course today.

answered Apr 6, 2022 by Korak
• 5,820 points

Related Questions In GCP

0 votes
2 answers
0 votes
1 answer

What is the difference between boot disk and data disk in GCP (especially AI platform)

Boot disk is dedicated to the boot ...READ MORE

answered Apr 6, 2022 in GCP by Korak
• 5,820 points
3,030 views
0 votes
1 answer

what is the difference between BigQuery and Storage on GCP?

Both a data warehouse and a SQL ...READ MORE

answered Nov 7, 2022 in GCP by Tejashwini
• 3,820 points
314 views
0 votes
1 answer
0 votes
1 answer
0 votes
1 answer

What is the Correct Terraform Provider Configuration for Google Cloud Platform Resources with Beta Arguments?

You should use both google and google-beta ...READ MORE

answered Apr 6, 2022 in GCP by Korak
• 5,820 points
1,965 views
0 votes
1 answer

What is the difference between GCP's cloud SQL database and cloud SQL instance

A Cloud SQL instance can have many ...READ MORE

answered Mar 9, 2022 in GCP by Korak
• 5,820 points
678 views
0 votes
1 answer

What is the difference between GCP cloud composer and workflow?

There are some key differences to consider ...READ MORE

answered Mar 17, 2022 in GCP by Korak
• 5,820 points
1,961 views
webinar REGISTER FOR FREE WEBINAR X
REGISTER NOW
webinar_success Thank you for registering Join Edureka Meetup community for 100+ Free Webinars each month JOIN MEETUP GROUP