How do you load this multiline data in spark as a single record

Question

tsv File data sample below.

Question:
Attempting to load a tsv file, sample data indicated below into spark. The issue is that the data is split into two lines within the CallerAddress field, which is enclosed in double quotes. Notice the initial double quote, as in "101 ... and the next line with the ending double quote as in, STE 3305" .  How do you load this in spark as a single record?

---------------------------------------------

CID  CallLocation CallerLocation CallerAddress CallerCity CallerState CallerZip CallDateUTC  Status CallDuration  DateKey

211258030  GA, ATLANTA ATLANTA, GA "101  MARIETTA ST NW

STE 3305" ATLANTA GA 30303 2020-11-06 14:49:19 Answered 180 20201106

Answer 1

Hi@Ruben,

I think you can add an escape option to get this working properly. Add the time of reading the file you can add this option.