The PCM4104 requires a system clock depending on the sampling rate: please see table at the bottom of page 15 of the datasheet.
For example, a 48kHz sample rate requires the system clock (SCKI) to be one of these frequencies: 12.288MHz, 18.432MHz, 24.576MHz, or 36.864MHz.
The McASP controller of the AM335x generates its AHCLKX (transmit high-frequency master clock to be used as the system clock by the PCM4104) by dividing the AUXCLK which as far as I can tell is just a copy of CLK_M_OSC (provided by a 24MHz crystal on the board). Does this mean that I cannot interface with the PCM4104 using the McASP internal clock, but I must rather provide an external clock for the audio subsystem? I feel like I am missing something.