you should safe sex with him u have to right to be happy n enjoy the life I think it is not wrong but make secret this relation.