open3 STDERR blocking

I'm currently using open3 to launch ssh sessions, when I use -vvv with
ssh the process is blocked by STDERR. When I only use the -v flag, it
works perfectly. ssh prints to STDERR for debug information.

when I close STDERR before the open3 call, it works, except I lose all
information on STDERR. I've tried to dupe STDERR to STDOUT and
still the same issues.

The error handle I pass to open3, doesn't seem to work if I close
STDERR. Anyone have a work around for this issue?

I've tried several non blocking code using IO::Select,
IO::Handle(->blocking(0)). Nothing seems to work like it should. Some
pointers would be great :).