Modern mobile phones enable users to access a wide variety of information and communication services anytime and anywhere. In order for people with disabilities to benefit from these services, mobile devices must provide accessible user interfaces. Currently, users with motor and visual impairments often have difficulty using mobile devices due to issues such as screen readability and small controls. These problems may be exacerbated when attempting to use such devices in crowded, noisy or otherwise distracting environments. We are developing accessible mobile interaction techniques that adapt the mobile device interface to the user by leveraging information about the user's current location, activity, and level of ability.