Skip to main content

All Questions

3 votes
1 answer
217 views

SQL queries in a dataframe

I want to get table names and column names from queries in a dataframe. The dataframe is like this: ...
elisa's user avatar
  • 185
3 votes
0 answers
44 views

spark takes long time for checking an array of items present in another array

I am new to spark. I have two dataframes df1 and df2. df1 has three rows. df2 has more than few million rows. I want to check whether all items in df2 are in transaction of df1, if so sum up the costs....
priya's user avatar
  • 131