Is it the really the end?

ive had words with my husband of 10 years that since he is away (work contratc for 2 years), and can't support us( me and our 3 kids) financially for now ( he is half done 1 year working).. and by the way he doesn't want to spend his work vacation with us, i am deciding to move in to my parents home. for total security (financially and emotionally). He listens to hearsays about me and my lifestyle while he is away... and often calls me long distance just to quarrel about the issues he heard.... i ve had enough of him.... am i being unfair if i really do the final move out?