I am wondering if its possible to list who all modified the file with course of time. I am aware that stat or ls -lrt will give the last user who modified the file. But I want to find out if it is possible to find the N-1 user who modified the file.

Note: I think chances are very slim to find such user. Just want to confirm with experts before declaring its a dead end.

Example:

At 1:00 AM ABC modified the file
At 2:00 AM XYZ modified the same file.

I am aware that XYZ has modified the file, How to find who modified the file before XYZ (In this case ABC)?