ListView with Button in dpad and touchmode possible?

view story

http://stackoverflow.com – I have a ListView with an item, that consists of a button and some other stuff. If the item is pressed it should lead to action A being executed. If the button in the item is pressed action B should be executed. I made this work in touchmode (Even though there is a small bug that the button gets highlighted even if not directly pressed). However I now need to support D-Pad mode as well now. (Google TV) Using the D-Pad I can't first focus the whole item, and with the next click just the button. I searched and tried like crasy. I can't seem to make it work. Is it even possible? (HowTos)