What counts as a annoying neighbor?

i have complaints about an annoying person in the area he gets his money from the government his wife is on 2 cheques and together another cheque totaling well over 3grand he rents an apartment under $600 but don't buy food he says it is too expensive he sooner get his stuff for free he goes house too house trying too beg for food and money claiming everyone who lives in orillia owes him cause he was born very dirt poor he says all persons young and old and every walk of life owes him he lets his bank account get real high in money yet won't buy stuff including clothes just the other day the police was called he was trying too steal money out of a woman's purse who is 97 years of age the police asked him why and i laughed at what he says i didn't do anything wrong officers i am a christian plus on top of that he pleads he don't remember doing things wrong he says this and tells he is a christian something is very wrong with this guy as well as annoying that is why i am asking does anyone have one of these in their area