Horizontal scrolling on mobile?

I have a fully horizontal scroll website on desktop, the whole design works towards that. I’ve managed to translate it to the mobile layout pretty nicely, turns out the horizontal scrolling in mobile is not good, you really have to find a blank space to scroll and to work properly, trying to scroll over picture of text will not work. Is someone else experiencing that, or maybe I’m doing something wrong?