Missing Service request

+1 vote
Hello All, need assistance on one issue. i use hadoop for ETA job, every day cron job runs and pick all data, but the issue is once the job finish it will pull from one db and store the data in other db. but there were bunch of (service_request) rows are missing, so the data comes like 1st db-->2nd Db then cron jobs runs then data will come to 2nd db -->3rd db. The missing rows is available in 1st db, but not 2nd and 3rd db.

Any idea how to resolve this issue
Sep 17 in Big Data Hadoop by Hemanth
• 240 points
42 views
Are you transferring data from the 1st DB to the next ones using any conditions or filters?
1st Db and 2nd DB maintained by others. once all data loaded in 2nd DB then i will use conditions for required column and get the data to 3rd DB. This process will be done by cron job.
Because 1st DB and 2nd DB maintained by others, maybe they are not sending the required data to the 2nd DB from the 1st DB. Please confirm that from the incharge.

No answer to this question. Be the first to respond.

Your answer

Your name to display (optional):
Privacy: Your email address will only be used for sending these notifications.

Related Questions In Big Data Hadoop

0 votes
1 answer

Hdfs Service Systemd - startup

I guess the issue you are facing ...READ MORE

answered Mar 29, 2018 in Big Data Hadoop by nitinrawat895
• 10,800 points
516 views
0 votes
1 answer

How can Hadoop discover missing or corrupt HDFS data?

HDFS supports fsck command to check for ...READ MORE

answered Jul 19, 2018 in Big Data Hadoop by nitinrawat895
• 10,800 points
188 views
0 votes
1 answer

How to access Hadoop Data using REST service?

The REST API gateway for the Apache ...READ MORE

answered Sep 5, 2018 in Big Data Hadoop by Frankie
• 9,810 points
674 views
0 votes
1 answer

How to discover missing or corrupt HDFS data?

HDFS supports fsck command to check for ...READ MORE

answered Sep 19, 2018 in Big Data Hadoop by nitinrawat895
• 10,800 points
145 views
0 votes
1 answer

Hadoop Apache: Could not fully initialize service [org.apache.oozie.service.ShareLibService]

As mentioned in the error, the problem ...READ MORE

answered Nov 19, 2018 in Big Data Hadoop by Omkar
• 68,480 points
86 views
0 votes
1 answer

How to check Cloudera Manager Service status?

There surely is a command to check ...READ MORE

answered Dec 17, 2018 in Big Data Hadoop by Omkar
• 68,480 points
236 views
+1 vote
1 answer

How to switch off Cloudera Manager Service?

First list the running services: chkconfig --list And then ...READ MORE

answered Dec 17, 2018 in Big Data Hadoop by Omkar
• 68,480 points
46 views
–1 vote
1 answer

Is standby node missing in Hadoop 1.0?

Yes, Hadoop 1.0 didn't have standby namenode. ...READ MORE

answered Dec 20, 2018 in Big Data Hadoop by Omkar
• 68,480 points
25 views
0 votes
1 answer

Not able to start MySql service

Hello. "The system never lies :-P".  The service ...READ MORE

answered Dec 26, 2018 in Big Data Hadoop by Omkar
• 68,480 points
56 views