I had a neighbor in Cincy who was one of the CDC's top experts in ebola. He'd have to fly our to Africa on a moments notice a few times a decade. He had some very interesting stories. He claimed it wasn't really dangerous for him and his staff, but was for the locals. except as noted above, it would burn itself out too quickly.
Something lethal with a long latency period while being contagious would do massive harm.