Chong had an extensive criminal record, based on searches of the New Orleans Times-Picayune archives. He was sentenced to six months in prison in April 1940, with his two brothers Jerome and Johnny Chong, for an assault on a poll watcher. In 1951, Chong was arrested and later convicted with four others of possessing 18 pounds of marijuana. In 1955, he was arrested for loitering in a house of prostitution. Chong published a classified asking for clemency in the December 6, 1972 New Orleans Times-Picayune.