Rovay owned a tavern in San Jose, after his boxing career ended. He was murdered at the of 36 on February 17, 1951, while tending bar, after he broke up a quarrel between two sailors and an ex-convict Roy Lambert, 29. Lambert subsequently left the bar, and returned with his brother Ray, 27. It was alleged that Ray Lambert pulled a gun, and fired it at Rovay's chest. Rovay died a few minutes later. Both brothers were charged with murder.
Ray Lambert would be convicted of second degree murder on August 14, 1951. His brother Roy was acquitted of a murder charge, having been accused of handing the gun to Ray.
- Modesto Bee, "Prison Parolee, Brother Face, Murder Charge", February 19, 1951
- Hayward Daily Review "Ray Lambert Found Guilty of Murder", August 15, 1951