Tokenizing text file generates error using word tokenize words

Question

library(tokenizers)
library(SnowballC)

my_data <- read.delim("Shakespeare.txt")

tokenize_words(my_data$ACT.I

I am trying to run this code but getting the following error 

 Error in check_input(x) : 
  Input must be a character vector of any length or a list of character
  vectors, each of which has a length of 1.

Can you help me with this, please?

Answer 1

Hi Bolder,

As you are using the delim function to read the file it would generate factors which cant be used as an input to the tokenizer.

Try 

text_df<-tokenize_words(as.character(my_data))

Hope this helps