why not try using a line trace by channel. then you could test on the visibility channel, then if theres no hits then you know there is line of sight.
line of sight to may be a better way to go but i dont see any way to ignore certain actors like what your looking for.