Why could the other (robot) side hear me and I can't hear them?

The robot could be muted. Check that the lights are not red on the speaker. If they are, press the mic button to unmute.

Mute can also be remotely toggled. On the screen, click the settings button (gear icon) and a menu will pop up with options to control volume as well as mute/unmute the mic on the robot.