Apache Nifi Execute Process Processor

+3 votes

I am trying to implement the workflow below using Apache Nifi:

  1. ExecuteSQL - This is fetching data from oracle database in avro format
  2. PutHDFS –This is to put the data into hdfs
  3. ExecuteProcess – This processor executes a bash script in the background which in turn creates the external hive table

I have a few questions:

Does ExecuteProcess Processor in Apache Nifi takes incoming flow files?

I am not able to provide ExecuteProcess processor any incomming flow file. If not, is there any way to support taking incoming flow files?

Aug 10, 2018 in Big Data Hadoop by soujanyabargavi
• 210 points
669 views

1 answer to this question.

+2 votes

Hey soujanyabargavi

NO, ExecuteProcess does not allow incoming flow files. You can use ExecuteStreamCommand instead. This processor accepts an incoming flowfile and can access attributes and content. You can find more about ExecuteStreamCommand here

answered Sep 20, 2018 by Omkar
• 67,620 points

Related Questions In Big Data Hadoop

+1 vote
2 answers

Execute Pig Script from Grunt Shell

From your current directory run  pig -x local Then ...READ MORE

answered Oct 25, 2018 in Big Data Hadoop by Kunal
843 views
0 votes
1 answer
0 votes
1 answer

Apache Hadoop Yarn example program

You can go to this location $Yarn_Home/share/hadoop/mapreduce . You'll ...READ MORE

answered Apr 4, 2018 in Big Data Hadoop by nitinrawat895
• 10,670 points
231 views
0 votes
1 answer

How to transfer data from Netezza to HDFS using Apache Sqoop?

Remove the --direct option. It gives issue ...READ MORE

answered Apr 23, 2018 in Big Data Hadoop by kurt_cobain
• 9,240 points
309 views
0 votes
1 answer

Truffle tests not running after truffle init

This was a bug. They've fixed it. ...READ MORE

answered Sep 11, 2018 in Blockchain by Christine
• 15,790 points
155 views
0 votes
1 answer
0 votes
1 answer

How can I calculate exact median with Apache Spark?

You need to sort RDD and take ...READ MORE

answered Oct 8, 2018 in Big Data Hadoop by Omkar
• 67,620 points
587 views
0 votes
1 answer

Is it possible to start a zookeeper server instance in process?

To start ZooKeeper you have to execute ZooKeeperServerMain class. You can use ...READ MORE

answered Oct 9, 2018 in Big Data Hadoop by Omkar
• 67,620 points
39 views