Is it too fast and am i in the wrong!!?

Ok so i just started dating my boyfriend willie monday, but i've know him for awhile. Ok so last year i worked at millers and he did to and i started talking to him and i started liking him i found out that he had a girl friend and i was kind of close to her, they dated for a while. But he broke up with her like a month ago and now were dating he asked me out and i said yes, he told me that he always had a thing for me. And the reason he broke up with her was bec. he had to lie to her bec. he likes to drink and smoke and she doesnt and she tryed to changed him. And he said that i understand him better and i wouldnt change him i like him for who he is. so am i in the wrong for dating him?? and my feelings for him are grwoing really fast im falling for him super hard... is that too fast what should i do???