In JRiver go to Player->DSP studio...
Select "output format" and make sure "5.1 channels" is selected under channels
Then select "DiracLiveProcessor" and make sure "5.1 Surround" is selected in the drop down menu in the top right corner.
Press play and start the Dirac Live® application.
You should now be able to calibrate 5.1