Trending questions in Big Data Hadoop

0 votes
1 answer

How to create table in cassandra?

Hi@akhtar, To create table in cassandra, you have ...READ MORE

Apr 1, 2020 in Big Data Hadoop by MD
• 95,360 points
179 views
0 votes
1 answer

HDFS on docker containers - is it possible?

Hi @judy, It is possible to Simplifying Hadoop deployments ...READ MORE

Feb 12, 2020 in Big Data Hadoop by Gitika
• 65,850 points
2,243 views
+1 vote
2 answers

Hadoop Learning Path

Hi! Since you have only 6 weeks, it's ...READ MORE

Nov 28, 2019 in Big Data Hadoop by Farheen
640 views
0 votes
2 answers

Load data into the hive table

Hi, We can use a normal insert query ...READ MORE

Oct 16, 2020 in Big Data Hadoop by MD
• 95,360 points
1,008 views
0 votes
1 answer

Hive complex data types

There are three complex types in hive, arrays: ...READ MORE

Jul 5, 2019 in Big Data Hadoop by Gani
11,615 views
0 votes
1 answer

can we store hive output in hadoop hdfs

Hi, You can save your hive output to ...READ MORE

Feb 24, 2020 in Big Data Hadoop by MD
• 95,360 points
1,215 views
0 votes
3 answers

JDBC connection string for Netezza

HI.. Netezza is one of the widely used ...READ MORE

Oct 30, 2020 in Big Data Hadoop by SRI
1,381 views
+2 votes
10 answers

Is there any difference between “hdfs dfs” and “hadoop fs” shell commands?

Yes, there's a difference between hadoop fs and ...READ MORE

Dec 7, 2018 in Big Data Hadoop by Kunal
25,585 views
0 votes
0 answers

HIve sql multiple conditions in where cluase

Hi, My table has created_date, changed_date in datetime ...READ MORE

Feb 12, 2020 in Big Data Hadoop by syam
• 120 points

edited Feb 12, 2020 by Gitika 1,583 views
0 votes
12 answers

What is Zookeeper? What is the purpose of Zookeeper in Hadoop Ecosystem?

Hey, Apache Zookeeper says that it is a ...READ MORE

Apr 29, 2019 in Big Data Hadoop by Gitika
• 65,850 points
21,437 views
+2 votes
1 answer

how to escape delimiter in hive?

Refer to the below code used to ...READ MORE

Oct 31, 2019 in Big Data Hadoop by Kiran
5,433 views
0 votes
1 answer

org.datanucleus.store.rdbms.exceptions.MissingTableException: Required table missing : "DBS" in Catalog "" Schema "".

Hi@akhtar, Here you have to add the below  ...READ MORE

Feb 5, 2020 in Big Data Hadoop by MD
• 95,360 points
1,229 views
0 votes
1 answer

What is ETL tool in Hadoop?

Hi@akhtar, ETL means extract, transform, load. It is ...READ MORE

Feb 2, 2020 in Big Data Hadoop by MD
• 95,360 points
1,398 views
0 votes
1 answer

SOURCE $HIVE_HOME/scripts/metastore/upgrade/mysql/hive-schema-0.14.0.mysql.sql; ERROR:

Hi@akhtar, I think mysql is not able to ...READ MORE

Feb 13, 2020 in Big Data Hadoop by MD
• 95,360 points
673 views
0 votes
1 answer

ERROR 1819 (HY000): Your password does not satisfy the current policy requirements

Hi@akhtar, Before setting password in mysql, check the ...READ MORE

Feb 13, 2020 in Big Data Hadoop by MD
• 95,360 points
438 views
0 votes
1 answer

Exception in thread "main" java.lang.RuntimeException: Hive metastore database is not initialized.

Hi@akhtar, In this scenario, first you check if ...READ MORE

Feb 5, 2020 in Big Data Hadoop by MD
• 95,360 points
701 views
0 votes
0 answers

Sentry: Grant role is getting error, while executing

Hi, Sentry: I am trying to grant a ...READ MORE

Feb 14, 2020 in Big Data Hadoop by Mahboob
• 140 points
375 views
0 votes
0 answers

Grant role is getting error, while executing

Hi, I am trying to grant a role ...READ MORE

Feb 14, 2020 in Big Data Hadoop by Mahboob
• 140 points
318 views
+1 vote
1 answer

How to limit the number of rows per each item in a Hive QL?

SELECT a_id, b, c, count(*) as sumrequests FROM ...READ MORE

Dec 1, 2018 in Big Data Hadoop by Omkar
• 69,210 points
19,186 views
0 votes
2 answers

hadoop copy a local file system folder to HDFS

There's a typo in your command: "hadopp". ...READ MORE

Feb 4, 2019 in Big Data Hadoop by Lohith
22,555 views
+1 vote
1 answer

Can we use LIKE operator in Hive?

Hey, Yes, Hive supports LIKE operator, but it ...READ MORE

Jun 19, 2019 in Big Data Hadoop by Gitika
• 65,850 points
10,445 views
+1 vote
1 answer

Streaming facebook data using Flume framework!!!

Hi You can find the facebook 'API' from ...READ MORE

Jan 21, 2020 in Big Data Hadoop by anonymous
979 views
+1 vote
1 answer

Does sqoop 1.4.6 version on HDP 2.6.4 support SSL

Hi, Is your "JDBC location" string connect?  If ...READ MORE

Jan 29, 2020 in Big Data Hadoop by Roshan
572 views
0 votes
1 answer

What is the difference between S3n, S3a, and S3?

Your doubt is quite an interesting one. Yes, ...READ MORE

Jul 30, 2019 in Big Data Hadoop by ravikiran
• 4,620 points
8,497 views
0 votes
2 answers

How to get column names from Hive table?

To get all the columns of a ...READ MORE

Jun 4, 2019 in Big Data Hadoop by anonymous

edited Jun 4, 2019 by Omkar 14,895 views
+1 vote
1 answer

Information Unavailable:Running jps command in Hadoop

Hi, I think this is because the process ...READ MORE

Jan 21, 2020 in Big Data Hadoop by anonymous
682 views
+1 vote
1 answer

About Available Space Block Placement Policy

Hi, We know, In HDFS data is divided into ...READ MORE

Jan 29, 2020 in Big Data Hadoop by MD
• 95,360 points
444 views
0 votes
1 answer

Difference between put and copyFromLocal

-Put and -copyFromLocal is almost same command ...READ MORE

Jul 29, 2019 in Big Data Hadoop by Neeraj
8,221 views
0 votes
2 answers

Not Able to read the file from hdfs location

Please make sure you connect to spark2-shell ...READ MORE

Jul 14, 2020 in Big Data Hadoop by Shantanu
• 190 points
727 views
+1 vote
2 answers

How to find previous records from a data set in Pig??

Hi, You can use ToDate() and SubtractDuration() function ...READ MORE

Jan 23, 2020 in Big Data Hadoop by MD
• 95,360 points
383 views
+2 votes
0 answers

MapReduce Job is failed: "Job failed as tasks failed. failed Maps:1 failed Reduces:0"

Hi everyone This is an error that I'm ...READ MORE

Jan 17, 2020 in Big Data Hadoop by akhtar
• 38,230 points
539 views
0 votes
1 answer

How to create a parquet table in hive and store data in it from a hive table?

Please use the code attached below for ...READ MORE

Jan 28, 2019 in Big Data Hadoop by Omkar
• 69,210 points
15,820 views
0 votes
5 answers

Hadoop hdfs: list all files in a directory and its subdirectories

Hi, You can try this command: hadoop fs -ls ...READ MORE

Aug 1, 2019 in Big Data Hadoop by Dinish
13,683 views
+1 vote
1 answer

what is splunk?

Splunk is a software platform to search, ...READ MORE

Jan 24, 2020 in Big Data Hadoop by Vardhan
185 views
+1 vote
1 answer

Unhandled internal error. Java heap space

Hi As your file size is too large, ...READ MORE

Jan 21, 2020 in Big Data Hadoop by anonymous
306 views
0 votes
2 answers

How to change the location of a table in hive?

Changing location requires 2 steps: 1.) Change location ...READ MORE

Feb 12, 2020 in Big Data Hadoop by Saksham Sehrawet
5,132 views
0 votes
1 answer

Copy file from local to hdfs from the spark job in yarn mode

Please refer to the below code: import org.apache.hadoop.conf.Configuration import ...READ MORE

Jul 16, 2019 in Big Data Hadoop by Raj
8,375 views
0 votes
1 answer

What is the use of fsimage in hadoop?

The NameNode stores modifications to the file ...READ MORE

Dec 21, 2018 in Big Data Hadoop by Omkar
• 69,210 points
17,190 views
0 votes
3 answers

What is Hive? Is Hive a database?

Hive is a data Warehouse infrastructure/system built ...READ MORE

Jul 1, 2019 in Big Data Hadoop by Ved Gupta
18,960 views
+1 vote
2 answers

Unable to create external table on HIVE

Hi @Ozer, This error occurred because there is ...READ MORE

Nov 7, 2019 in Big Data Hadoop by Richa
2,611 views
0 votes
1 answer

Sqoop could not load db driver class

Hello, Have you tried to put the both ...READ MORE

Dec 13, 2019 in Big Data Hadoop by Alexandru
• 510 points
1,585 views
0 votes
1 answer

How to remove duplicate records from Hive table?

A record is duplicate if there are ...READ MORE

Jul 11, 2019 in Big Data Hadoop by Bhuvan
7,188 views
+1 vote
0 answers

Hadoop Mapreduce : Null Pointer Exception

While running the below program, I got ...READ MORE

Dec 6, 2019 in Big Data Hadoop by Tarun
• 160 points
808 views
0 votes
1 answer

Impala concatenate string.

Yes, you can concatenate two strings using ...READ MORE

Jun 6, 2019 in Big Data Hadoop by Raghu
8,462 views
0 votes
1 answer

Error: Failed to locate WinUtils binary in the Hadoop Binary Path

I will redirect you to a link ...READ MORE

Jun 20, 2019 in Big Data Hadoop by ravikiran
• 4,620 points
7,824 views
0 votes
1 answer

java.lang.IllegalArgumentException: Unable to instantiate SparkSession with Hive support because Hive classes are not found.

 Try using the below build.sbt, code.scala and command ...READ MORE

Jul 30, 2019 in Big Data Hadoop by Kishan
5,913 views
0 votes
1 answer

Converting CSV files to Parquet

--Create Hive external Table for existing data CREATE ...READ MORE

Jul 30, 2019 in Big Data Hadoop by Yogi
5,816 views
0 votes
1 answer

How to groupBy/count then filter on count in Scala

I think the exception is caused because ...READ MORE

Apr 19, 2018 in Big Data Hadoop by kurt_cobain
• 9,390 points
25,960 views
0 votes
1 answer

How can I append data to an existing file in HDFS?

You have to do some configurations as ...READ MORE

Jul 25, 2019 in Big Data Hadoop by ravikiran
• 4,620 points
5,977 views