(AP) — A former jailer in a south Mississippi county is admitting to illegal sex with inmates.

The Sun Herald reports 60-year-old Warren Avery pleaded guilty to one count of attempted unlawful sexual activity and two counts of unlawful sexual activity.

Circuit Judge Dale Harkey sentenced Avery to two years in prison without possibility of parole, fined him $3,000 and ordered him to register as a sex offender.

Two children of a dead woman who accused Avery of rape are suing the city of Lucedale, George County and Avery, seeking money damages.

Daniel Waide, a lawyer for the minor children, says their mother was jailed for failing to pay $1,480 in traffic fines.

Waide says he hoped for stiffer criminal penalties for Avery, but says “some justice is better than no justice.”