The `Achy Breaky Heart` singer - who is separating from his wife Tish after 17 years of marriage - filed for divorce on Tuesday (26.10.10) and legal documents state he wants to share parental responsibilities for their three youngest children, Noah, 10, Braison, 16 and 17-year-old Miley.
In the papers, he asks to "share the care, custody and control" of the trio.
The documents also state he "has no information of any custody proceedings" and the reasons behind the marriage`s breakdown were listed as "irreconcilable differences".
After filing the papers in the Chancery Court of Williamson County, Tennessee, the 49-year-old country star started getting spiritual on his twitter account - and posted extracts from Psalm 91 from the Bible.
He wrote: "He will cover you with his feathers and under his wings you shall take refuge. Truth will be your shield and buckler."
Billy Rae also asked his fans to pray for others during his difficult time.
He added: "Can I ask for your prayers this morning for my children...our troops...the hungry...the sick...the homeless. AMEN. (sic)"
Billy Rae married Tish in December 1992 and as well as having three children together he adopted Tish`s two children, Brandi and Trace, from her previous marriage.
He also has a son, Christopher, from his relationship with Kristen Luckey.