What is the difference between Google Cloud Dataflow and Google Cloud Dataproc

0 votes
I am using Google Data Flow to implement an ETL data ware house solution.

Looking into google cloud offering, it seems DataProc can also do the same thing.

It also seems DataProc is little bit cheaper than DataFlow.

Does anybody know the pros / cons of DataFlow over DataProc

Why does google offer both?
Mar 31 in GCP by Rahul
• 3,380 points
122 views

1 answer to this question.

0 votes

Cloud Dataflow and Dataproc can both be used to implement ETL data warehousing solutions. An over about the same can be found here. 

  • Cloud Dataproc provides you with Hadoop cluster on GCP and access to Hadoop ecosystem tools (Apache Pig, Hive and Spark)
  • Cloud Dataflow provides you a place to run Apache Beam based jobs on GCP and you do not need to address common aspects of running jobs.
    • Beam jobs are not intended to be portable across 'runners'. Allows you to focus more on the logical computations
    • Cloud Dataflow also offers the ability to create jobs based on templates.
answered Apr 6 by Korak
• 5,820 points

Related Questions In GCP

0 votes
2 answers
0 votes
1 answer

What is the difference between boot disk and data disk in GCP (especially AI platform)

Boot disk is dedicated to the boot ...READ MORE

answered Apr 6 in GCP by Korak
• 5,820 points
54 views
0 votes
1 answer
0 votes
1 answer
0 votes
1 answer

What is the Correct Terraform Provider Configuration for Google Cloud Platform Resources with Beta Arguments?

You should use both google and google-beta ...READ MORE

answered Apr 6 in GCP by Korak
• 5,820 points
198 views
0 votes
1 answer

where is drop down menu for the google cloud platform

It is important that you are signed ...READ MORE

answered Sep 20, 2019 in GCP by Sirajul
• 59,170 points
403 views
0 votes
1 answer

What is the difference between GCP's cloud SQL database and cloud SQL instance

A Cloud SQL instance can have many ...READ MORE

answered Mar 9 in GCP by Korak
• 5,820 points
55 views
0 votes
1 answer

What is the difference between GCP cloud composer and workflow?

There are some key differences to consider ...READ MORE

answered Mar 17 in GCP by Korak
• 5,820 points
164 views
webinar REGISTER FOR FREE WEBINAR X
Send OTP
REGISTER NOW
webinar_success Thank you for registering Join Edureka Meetup community for 100+ Free Webinars each month JOIN MEETUP GROUP