Domanda di colloquio di TransUnion

Remove duplicates from spark dataframe without using in built function. Handle null values.