Test Status Mapping


The following table shows the functional Gaia UI tests and the targets they are currently run against. Each test indicates the expected outcome from running the test.
Hover over the test name for the full path of the test file. Hover over the expected state to see if there's an associated reason

Generated on: Tue Jan 6 10:53:45 2015


Test Device Desktop
Flame Desktop
Name Run Class State State
test_settings.py unit settings Enabled Enabled
test_cell_data_settings.py unit settings Enabled --
test_cell_roaming_settings.py unit settings Enabled --
test_wifi_settings.py unit settings Enabled --
test_bluetooth.py unit unit Enabled --
test_cleanup_gaia.py unit unit Enabled Enabled
test_cleanup_storage.py unit unit Enabled --
test_cleanup_preferences.py unit unit Enabled Enabled
test_connect_to_local_area_network.py unit unit Enabled --
test_contacts.py unit unit Enabled Enabled
test_file_manager.py unit unit Enabled Enabled
test_kill.py unit unit Enabled Enabled
test_killall.py unit unit Enabled Enabled
test_cold_launch.py unit unit Enabled Enabled
test_launch_l10n.py unit unit Enabled Enabled
test_launch_twice.py unit unit Enabled Enabled
test_launch_via_manifest.py unit unit Enabled Enabled
test_launch_via_entry_point.py unit unit Enabled Enabled
test_warm_launch.py unit unit Enabled Enabled
test_lock_screen.py unit unit Enabled Enabled
test_permissions.py unit unit Enabled Enabled
test_prefs.py unit unit Enabled Enabled
test_resources.py unit unit Enabled Enabled
test_wifi.py unit unit Enabled --
test_browser_cell_data.py functional browser Enabled --
test_browser_lan.py functional browser Enabled Enabled
test_browser_save_image.py functional browser Enabled --
test_browser_search.py functional browser Enabled Enabled
test_browser_navigation.py functional browser Enabled Enabled
test_browser_bookmark.py functional browser Enabled Enabled
test_browser_play_video.py functional browser Enabled Enabled
test_browser_share_link.py functional browser Enabled Enabled
test_browser_clear_browsing_history.py functional browser Enabled --
test_calendar_new_event_appears_on_all_calendar_views.py functional calendar Enabled Enabled
test_calendar_flick_through_months.py functional calendar Enabled Enabled
test_camera_capture_photo.py functional camera Enabled --
test_camera_capture_video.py functional camera Enabled --
test_camera_flash_modes.py functional camera Enabled Disabled
test_camera_multiple_shots.py functional camera Enabled --
test_camera_delete_captured_video.py functional camera Enabled --
test_cards_view_kill_apps_with_two_apps.py functional cards_view Enabled --
test_cards_view_with_two_apps.py functional cards_view Enabled --
test_clock_create_new_alarm.py functional clock Enabled --
test_clock_set_alarm.py functional clock Enabled Enabled
test_add_new_contact.py functional contacts Enabled --
test_call_contact.py functional contacts Enabled --
test_edit_contact.py functional contacts Enabled --
test_delete_all_contacts.py functional contacts Enabled Enabled
test_default_contact_image.py functional contacts Enabled --
test_sms_contact.py functional contacts Enabled --
test_add_photo_to_contact.py functional contacts Enabled --
test_sort_contacts.py functional contacts Enabled --
test_delete_contact.py functional contacts Enabled --
test_add_contact_to_favorites.py functional contacts Enabled --
test_import_contacts_from_sim.py functional contacts Enabled --
test_export_contacts_to_sdcard.py functional contacts Enabled --
test_import_contacts_from_sdcard.py functional contacts Enabled --
test_import_contacts_from_gmail.py functional contacts Enabled Enabled
test_sync_facebook_contacts.py functional contacts Enabled Enabled
test_unlink_facebook.py functional contacts Enabled Enabled
test_import_edit_export_contact.py functional contacts Enabled --
test_import_contacts_menu_no_network.py functional contacts Enabled Enabled
test_import_gmail_no_network.py functional contacts Enabled Enabled
test_cost_control_ftu.py functional cost_control Enabled --
test_cost_control_data_alert_mobile.py functional cost_control Disabled --
test_cost_control_reset_wifi.py functional cost_control Enabled --
test_dialer_airplane_mode.py functional dialer Enabled --
test_dialer.py functional dialer Enabled --
test_MMI.py functional dialer Enabled --
test_clear_phone_number.py functional dialer Enabled Enabled
test_dialer_add_contact.py functional dialer Enabled --
test_call_log_all_calls.py functional dialer Disabled --
test_call_log_groups.py functional dialer Enabled XFailed
test_delete_call_log.py functional dialer Enabled XFailed
test_dialer_find_contact.py functional dialer Enabled --
test_dialer_receive_call.py functional dialer Enabled --
test_dialer_receive_call_with_locked_screen.py functional dialer Enabled --
test_dialer_set_up_conference_call.py functional dialer Enabled --
test_dialer_miss_call_from_known_contact_notification.py functional dialer Enabled --
test_dialer_clear_miss_call_notification.py functional dialer Enabled --
test_dialer_receive_call_with_contact_photo.py functional dialer Enabled --
test_redial_last_number.py functional dialer Enabled --
test_dialer_dsds_make_phone_call_with_default_sim.py functional dialer Enabled --
test_dialer_dsds_receive_call_on_both_sims.py functional dialer Enabled --
test_setup_basic_gmail.py functional email Enabled Enabled
test_setup_and_send_imap_email.py functional email Enabled Enabled
test_IMAP_email_notification.py functional email Enabled Enabled
test_setup_and_send_active_sync_email.py functional email Disabled Disabled
test_receive_active_sync_email.py functional email Disabled Disabled
test_rocketbar_launch_link.py functional rocketbar Enabled Enabled
test_rocketbar_add_collection_save_bookmark.py functional rocketbar Enabled Enabled
test_rocketbar_search.py functional rocketbar Enabled Enabled
test_rocketbar_offline_behavior.py functional rocketbar Enabled --
test_fmradio_add_remove_from_favorites.py functional fmradio Enabled --
test_fmradio_find_stations.py functional fmradio Disabled --
test_fmradio_frequency_dialer.py functional fmradio Enabled --
test_fmradio_turn_on_off.py functional fmradio Enabled --
test_fmradio_airplane_mode.py functional fmradio Enabled --
test_ftu_skip_tour.py functional ftu Enabled --
test_ftu_with_tour.py functional ftu Enabled Enabled
test_ftu_skip_tour_desktopb2g.py functional ftu Disabled XFailed
test_gallery_view.py functional gallery Enabled --
test_gallery_empty.py functional gallery Enabled Enabled
test_gallery_flick.py functional gallery Enabled --
test_gallery_delete_image.py functional gallery Enabled --
test_gallery_delete_multiple_images.py functional gallery Enabled Enabled
test_gallery_cancel_delete_multiple_images.py functional gallery Enabled Enabled
test_gallery_edit_photo.py functional gallery Enabled Enabled
test_gallery_crop_photo.py functional gallery Enabled Enabled
test_gallery_handle_invalid_file.py functional gallery Enabled --
test_gallery_handle_valid_image_file.py functional gallery Enabled --
test_gallery_share_picture.py functional gallery Enabled Enabled
test_gallery_switch_to_camera.py functional gallery Enabled Enabled
test_gallery_switch_to_camera_main_view.py functional gallery Enabled --
test_homescreen_column_layout.py functional homescreen Enabled --
test_homescreen_change_wallpaper.py functional homescreen Enabled Enabled
test_homescreen_delete_app.py functional homescreen Enabled Enabled
test_homescreen_delete_app_packaged.py functional homescreen Enabled Enabled
test_homescreen_divider.py functional homescreen Enabled Enabled
test_homescreen_edit_mode.py functional homescreen Enabled Enabled
test_homescreen_launch_app.py functional homescreen Enabled Enabled
test_homescreen_launch_app_packaged.py functional homescreen Enabled Enabled
test_homescreen_move_app.py functional homescreen Enabled --
test_keyboard.py functional keyboard Enabled --
test_number_keyboard.py functional keyboard Enabled Enabled
test_keyboard_predictive_key.py functional keyboard Enabled Enabled
test_email_keyboard.py functional keyboard Enabled Enabled
test_keyboard_bug_1073870.py functional keyboard Enabled Enabled
test_lockscreen_unlock_to_homescreen.py functional lockscreen Enabled Enabled
test_lockscreen_unlock_to_camera.py functional lockscreen Enabled --
test_lockscreen_unlock_to_camera_with_passcode.py functional lockscreen Disabled --
test_lockscreen_unlock_to_homescreen_with_passcode.py functional lockscreen Enabled Enabled
test_lockscreen_unlock_to_emergency_call_screen.py functional lockscreen Enabled --
test_lockscreen_notification.py functional lockscreen Enabled Enabled
test_lockscreen_wake_with_notification.py functional lockscreen Enabled Enabled
test_marketplace_launch.py functional marketplace Enabled Enabled
test_marketplace_packaged_app.py functional marketplace Enabled Enabled
test_add_to_an_existing_contact_from_messages.py functional messages Enabled --
test_add_to_new_contact_from_messages.py functional messages Enabled --
test_sms.py functional messages Enabled --
test_sms_add_contact.py functional messages Enabled --
test_sms_with_attachments.py functional messages Enabled --
test_sms_to_dialer.py functional messages Enabled --
test_sms_contact_match.py functional messages Enabled Enabled
test_sms_contact_input_validation.py functional messages Enabled Enabled
test_sms_notification.py functional messages Enabled --
test_mms_add_subject.py functional messages Enabled Enabled
test_inbox_to_settings.py functional messages Enabled --
test_sms_semicolon_completes_the_entered_recipient.py functional messages Enabled Enabled
test_sms_with_picture_attached.py functional messages Enabled --
test_sms_forward_sent_message.py functional messages Enabled --
test_sms_auto_save_draft.py functional messages Enabled --
test_music_album_mp3.py functional music Enabled --
test_music_artist_mp3.py functional music Enabled --
test_music_empty.py functional music Enabled Enabled
test_music_songs_3gp.py functional music Enabled --
test_music_change_rating.py functional music Enabled Enabled
test_persona_app.py functional persona Enabled Enabled
test_findmydevice.py functional settings Enabled Enabled
test_settings_change_language.py functional settings Enabled --
test_settings_change_language_rtl.py functional settings Enabled --
test_settings_gps.py functional settings Enabled Enabled
test_settings_do_not_track.py functional settings Enabled --
test_settings_bluetooth.py functional settings Enabled --
test_settings_wifi.py functional settings Enabled --
test_settings_cell_data.py functional settings Enabled --
test_settings_dsds_cell_data.py functional settings Disabled Disabled
test_settings_airplane_mode.py functional settings Enabled --
test_settings_media_storage.py functional settings Enabled --
test_settings_wallpaper.py functional settings Enabled --
test_settings_passcode.py functional settings Enabled --
test_settings_change_keyboard_language.py functional settings Enabled --
test_settings_device_info.py functional settings Enabled --
test_settings_power_save_mode.py functional settings Enabled --
test_settings_battery_power_save_mode.py functional settings Enabled --
test_settings_sim_manager.py functional settings Disabled Disabled
test_settings_root.py functional settings Enabled --
test_settings_change_ring_tone.py functional settings Enabled --
test_settings_usb_storage.py functional settings Enabled --
test_system_notification_bar.py functional system Enabled Enabled
test_geolocation_prompt.py functional system Enabled --
test_quick_settings.py functional system Enabled Enabled
test_system_message.py functional system Enabled Enabled
test_system_message_pending.py functional system Enabled Enabled
test_inter_app_comm.py functional system Enabled Enabled
test_power_button_long_press.py functional system Enabled Enabled
test_privileged_app_audio_capture_prompt.py functional system Enabled --
test_privileged_app_video_capture_prompt.py functional system Enabled --
test_privileged_app_contacts_prompt.py functional system Enabled Enabled
test_privileged_app_device_music_prompt.py functional system Enabled Enabled
test_privileged_app_device_picture_prompt.py functional system Enabled Enabled
test_privileged_app_device_sdcard_prompt.py functional system Enabled Enabled
test_privileged_app_device_video_prompt.py functional system Enabled Enabled
test_privileged_app_geolocation_prompt.py functional system Enabled Enabled
test_video_empty.py functional videoplayer Enabled Enabled
test_play_3gp_video.py functional videoplayer Enabled --
test_play_ogv_video.py functional videoplayer Enabled Enabled
test_play_webm_video.py functional videoplayer Enabled Enabled
test_play_mp4_video.py functional videoplayer Enabled --
test_play_ogg_video.py functional videoplayer Enabled --
test_a11y_calendar_month_view_wheel.py accessibility calendar Enabled Enabled
test_a11y_calendar_month_view_select_day.py accessibility calendar Enabled Enabled
test_a11y_calendar_month_view_select_event.py accessibility calendar Enabled Enabled
test_a11y_calendar_settings_view.py accessibility calendar Enabled Enabled
test_a11y_calendar_views_visibility.py accessibility calendar Enabled Enabled
test_a11y_email_cards_visibility.py accessibility email Enabled Enabled
test_a11y_email_settings_view.py accessibility email Enabled Enabled
test_a11y_ftu.py accessibility ftu Enabled --
test_a11y_ftu_desktopb2g.py accessibility ftu Disabled --
test_a11y_keyboard_key_names.py accessibility keyboard Enabled --
test_a11y_keyboard_word_suggestions.py accessibility keyboard Enabled Enabled
test_a11y_unlock_to_homescreen.py accessibility lockscreen Disabled Disabled
test_a11y_unlock_to_camera.py accessibility lockscreen Enabled --
test_a11y_callscreen_overlay_visibility.py accessibility phone Enabled --
test_a11y_callscreen_visibility.py accessibility phone Enabled --
test_a11y_phone_call_log.py accessibility phone Enabled --
test_a11y_phone_keypad.py accessibility phone Enabled Enabled
test_a11y_phone_select_toolbars.py accessibility phone Enabled Enabled
test_a11y_phone_edit_contact.py accessibility phone Enabled Enabled
test_a11y_slider_visibility.py accessibility settings Enabled Enabled
test_a11y_color_filters.py accessibility settings Enabled Enabled
test_a11y_captions.py accessibility settings Enabled Enabled
test_a11y_cards_view.py accessibility system Enabled Enabled
test_a11y_cards_view_status_bar_visibility.py accessibility system Enabled Enabled
test_a11y_notification_visibility.py accessibility system Enabled Enabled
test_a11y_software_buttons_visibility.py accessibility system Enabled --
test_a11y_screen_manager.py accessibility system Enabled Enabled
test_a11y_update_manager_toaster_visibility.py accessibility system Enabled Enabled
test_a11y_utility_tray_notifications.py accessibility system Enabled Enabled
test_a11y_utility_tray_settings.py accessibility system Enabled Enabled
test_a11y_utility_tray_visibility.py accessibility system Enabled Enabled
test_a11y_volume_buttons.py accessibility system Enabled Enabled
test_a11y_volume_buttons_panel_visibility.py accessibility system Enabled Enabled