Apache Nifi Execute Process Processor

+3 votes

I am trying to implement the workflow below using Apache Nifi:

  1. ExecuteSQL - This is fetching data from oracle database in avro format
  2. PutHDFS –This is to put the data into hdfs
  3. ExecuteProcess – This processor executes a bash script in the background which in turn creates the external hive table

I have a few questions:

Does ExecuteProcess Processor in Apache Nifi takes incoming flow files?

I am not able to provide ExecuteProcess processor any incomming flow file. If not, is there any way to support taking incoming flow files?

Aug 10, 2018 in Big Data Hadoop by soujanyabargavi
• 210 points

1 answer to this question.

+2 votes

Hey soujanyabargavi

NO, ExecuteProcess does not allow incoming flow files. You can use ExecuteStreamCommand instead. This processor accepts an incoming flowfile and can access attributes and content. You can find more about ExecuteStreamCommand here

answered Sep 20, 2018 by Omkar
• 69,150 points

Related Questions In Big Data Hadoop

0 votes
1 answer
+1 vote
2 answers

Execute Pig Script from Grunt Shell

From your current directory run  pig -x local Then ...READ MORE

answered Oct 25, 2018 in Big Data Hadoop by Kunal
0 votes
1 answer
0 votes
1 answer

Apache Hadoop Yarn example program

You can go to this location $Yarn_Home/share/hadoop/mapreduce . You'll ...READ MORE

answered Apr 4, 2018 in Big Data Hadoop by nitinrawat895
• 11,380 points
0 votes
1 answer

Truffle tests not running after truffle init

This was a bug. They've fixed it. ...READ MORE

answered Sep 11, 2018 in Blockchain by Christine
• 15,830 points
0 votes
1 answer
0 votes
1 answer

How can I calculate exact median with Apache Spark?

You need to sort RDD and take ...READ MORE

answered Oct 8, 2018 in Big Data Hadoop by Omkar
• 69,150 points
0 votes
1 answer

Is it possible to start a zookeeper server instance in process?

To start ZooKeeper you have to execute ZooKeeperServerMain class. You can use ...READ MORE

answered Oct 9, 2018 in Big Data Hadoop by Omkar
• 69,150 points