The Destroyer has no sentience of its own–it’s animated by a possessing spirit. But it’s also enchanted by Odin, so it’s been able, in certain circumstances, to lift the Hammer. Ultron registers to the enchantment as a being, not as a machine, and so cannot lift the hammer.