I struggle with the same thing. However, God was teaching me something, we must have the right perspective: these temptations that God allows are opportunities to crucify our fleshly desires. Imagine this if God had already given you your spouse, would you still choose to sin? God has shown me that lust can destroy not only relationships but entire families. Right now, He’s working in me, teaching me that there may not be consequences at this moment but if I don’t fully let go of lust, there will be serious consequences in the future. I encourage you (and myself) to adopt the mindset that we are in a relationship with God and if He had given you your spouse today, would you still fall into sin, even knowing they are right there beside you? Be like Joseph he ran away from lust