I dont, here is why.
I feel like Wasp and Ant-Man could be left out. They're character concepts are interesting and it would be good to have them since they were founding members of the Avengers in the comic-verse, and everyone wants the movie to stay to the source material. But this is the Movie-verse, it isn't a necessity to stick to the same arcs as the comics. The movie should be free to make its own story arc, but also to still allow it to be similar to the comic-verse, in regards to staying true to the source material, just not entirely. I don't think I would really enjoy Hank and Janet, I don't see how they could logically work on the big screen without making it feel unrealistic, and not being a flop.
I Also don't think they could work because Ant-man and Wasp would definitely require they're own tie-in movie. Which would give Marvel Studios difficulty in regards to funding the star power, and being able to distribute each character into the movie without them over shadowing the any other hero in the next Avengers. Besides I would much rather see the likes of Black Panther, Spider-Man, and Ms. Marvel, than a guy who can turn 30ft tall or reduce his size to that of an ant..or a woman who can also reduce her size and shoots glowing stingers at people. (Its funny as I was typing the last sentence I started to think maybe that would be cool because it hasn't been done before, but I remembered it would still just be wildly unrealistic, no matter how much of a scientific breakthrough it would appear be, and I'd still much rather see other heroes with more interesting and slightly more down to earth abilities).
Another thing, also think about the kids who like to pretend to be super heroes, Thats something I used to do as a kid and I'm pretty sure the majority of us did. Today we see kids who like to smash stuff with their fist or hammer pretending to be Thor or the Hulk. Or kids who would run around with an Iron Man's mask, Captain America's shield, or Hawkeye's bow and quiver, or a girl with a Ms Marvel mask.. or a kids who would pretend to be acrobatic like Spider-Man and Black Widow. How could they pretend to be Ant-man or Wasp? It be pretty creepy seeing a kid playing with ants and pretending he's 30ft tall...or a girl who thinks she's a wasp. I dont know, this point isn't that relevant but its still something to think about.
However, not having Wasp and Ant-Man does have its down side. With out them there would be no Ultron and no Vision. Having them could set up and amazing story arc. But If there could be a way to have Ultron and Vision in an Avengers movie without having having Hank Pym or Janet than I'm all for it. But it would be near impossible and too far of an astray from the comic-source material.