Cave Bastard was founded in 2014 by bassist Troy Oftedal, who left Cattle Decapitation in 2009, and guitarist Nick Padron, formerly of Bridge Jumper, alongside Chase Ferguson (ex-Bridge Jumper), Steve Pearce (Gutrot, Ritual Torture), and Steven Reed (Age Of Collapse).
In summer 2017, Cave Bastard released a split 12-inch with Austin band Blk Ops, on Accident Prone Records, with four songs by each band. Early the next year, they welcomed new drummer Marlon Matthew (Temblad). The Bleak Shall Devour the Earth was released in 2018.
Their second album, Wrath of the Bastard, was released in November 2021 via Antrum Records, sporting cover artwork created by Varises Otak.