Yup. That's the one. Although, I'm not quite sure why the product image shows someone attempting to remove a *soldered on* chip.
You really need the tool to remove these chips from their sockets. Yeah, a paper clip can kinda work, dental picks too - but if you're not careful you can break the socket.
As for normal chips DIP package chips, just use a small flathead screwdriver.