Removed light fixture, no junction box behind it, just BX cable. How can I install new fixture?

You can use an "old work" box which is designed to be installed in finished walls and ceilings. Attach the BX cable to the box and you should be good to go. If the wires are actually running from the box that opens to the next room, then you should be able to replace them with a short section of romex.