AndroidWorld Benchmark
Droidrun achieves state of the art performance on AndroidWorld with 78.4% success rate across 116 diverse tasks. Despite setup challenges and evaluation limitations, our open source approach using GPT-5 and direct Accessibility API access outperforms all competing agents.
AndroidWorld Benchmark Results
Success rates of leading AI agents on the 116-task AndroidWorld benchmark (18.09.2025)
Audio Recorder Record Audio
Task: AudioRecorderRecordAudio
SuccessAudio Recorder Record Audio
Task: AudioRecorderRecordAudio
SuccessAudio Recorder Record Audio With File Name
Task: AudioRecorderRecordAudioWithFileName
SuccessAudio Recorder Record Audio With File Name
Task: AudioRecorderRecordAudioWithFileName
SuccessBrowser Maze
Task: BrowserMaze
SuccessBrowser Maze
Task: BrowserMaze
SuccessCamera Take Photo
Task: CameraTakePhoto
SuccessCamera Take Photo
Task: CameraTakePhoto
SuccessCamera Take Video
Task: CameraTakeVideo
SuccessCamera Take Video
Task: CameraTakeVideo
SuccessClock Stop Watch Paused Verify
Task: ClockStopWatchPausedVerify
SuccessClock Stop Watch Paused Verify
Task: ClockStopWatchPausedVerify
SuccessClock Stop Watch Running
Task: ClockStopWatchRunning
SuccessClock Stop Watch Running
Task: ClockStopWatchRunning
SuccessClock Timer Entry
Task: ClockTimerEntry
SuccessClock Timer Entry
Task: ClockTimerEntry
SuccessContacts Add Contact
Task: ContactsAddContact
SuccessContacts Add Contact
Task: ContactsAddContact
SuccessContacts New Contact Draft
Task: ContactsNewContactDraft
SuccessContacts New Contact Draft
Task: ContactsNewContactDraft
SuccessExpense Add Multiple
Task: ExpenseAddMultiple
SuccessExpense Add Multiple
Task: ExpenseAddMultiple
SuccessExpense Add Multiple From Gallery
Task: ExpenseAddMultipleFromGallery
SuccessExpense Add Multiple From Gallery
Task: ExpenseAddMultipleFromGallery
SuccessExpense Add Single
Task: ExpenseAddSingle
SuccessExpense Add Single
Task: ExpenseAddSingle
SuccessExpense Delete Duplicates
Task: ExpenseDeleteDuplicates
SuccessExpense Delete Duplicates
Task: ExpenseDeleteDuplicates
SuccessExpense Delete Duplicates2
Task: ExpenseDeleteDuplicates2
SuccessExpense Delete Duplicates2
Task: ExpenseDeleteDuplicates2
SuccessExpense Delete Multiple
Task: ExpenseDeleteMultiple
SuccessExpense Delete Multiple
Task: ExpenseDeleteMultiple
SuccessExpense Delete Multiple2
Task: ExpenseDeleteMultiple2
SuccessExpense Delete Multiple2
Task: ExpenseDeleteMultiple2
SuccessExpense Delete Single
Task: ExpenseDeleteSingle
SuccessExpense Delete Single
Task: ExpenseDeleteSingle
SuccessFiles Delete File
Task: FilesDeleteFile
SuccessFiles Delete File
Task: FilesDeleteFile
SuccessFiles Move File
Task: FilesMoveFile
SuccessFiles Move File
Task: FilesMoveFile
SuccessMarkor Create Folder
Task: MarkorCreateFolder
SuccessMarkor Create Folder
Task: MarkorCreateFolder
SuccessMarkor Create Note
Task: MarkorCreateNote
SuccessMarkor Create Note
Task: MarkorCreateNote
SuccessMarkor Create Note And Sms
Task: MarkorCreateNoteAndSms
SuccessMarkor Create Note And Sms
Task: MarkorCreateNoteAndSms
SuccessMarkor Create Note From Clipboard
Task: MarkorCreateNoteFromClipboard
SuccessMarkor Create Note From Clipboard
Task: MarkorCreateNoteFromClipboard
SuccessMarkor Delete All Notes
Task: MarkorDeleteAllNotes
SuccessMarkor Delete All Notes
Task: MarkorDeleteAllNotes
SuccessMarkor Delete Newest Note
Task: MarkorDeleteNewestNote
SuccessMarkor Delete Newest Note
Task: MarkorDeleteNewestNote
SuccessMarkor Delete Note
Task: MarkorDeleteNote
SuccessMarkor Delete Note
Task: MarkorDeleteNote
SuccessMarkor Transcribe Receipt
Task: MarkorTranscribeReceipt
SuccessMarkor Transcribe Receipt
Task: MarkorTranscribeReceipt
SuccessNotes Is Todo
Task: NotesIsTodo
SuccessNotes Is Todo
Task: NotesIsTodo
SuccessNotes Meeting Attendee Count
Task: NotesMeetingAttendeeCount
SuccessNotes Meeting Attendee Count
Task: NotesMeetingAttendeeCount
SuccessNotes Recipe Ingredient Count
Task: NotesRecipeIngredientCount
SuccessNotes Recipe Ingredient Count
Task: NotesRecipeIngredientCount
SuccessNotes Todo Item Count
Task: NotesTodoItemCount
SuccessNotes Todo Item Count
Task: NotesTodoItemCount
SuccessOpen App Task Eval
Task: OpenAppTaskEval
SuccessOpen App Task Eval
Task: OpenAppTaskEval
SuccessOsm And Favorite
Task: OsmAndFavorite
SuccessOsm And Favorite
Task: OsmAndFavorite
SuccessRecipe Add Multiple Recipes
Task: RecipeAddMultipleRecipes
SuccessRecipe Add Multiple Recipes
Task: RecipeAddMultipleRecipes
SuccessRecipe Add Single Recipe
Task: RecipeAddSingleRecipe
SuccessRecipe Add Single Recipe
Task: RecipeAddSingleRecipe
SuccessRecipe Delete Duplicate Recipes
Task: RecipeDeleteDuplicateRecipes
SuccessRecipe Delete Duplicate Recipes
Task: RecipeDeleteDuplicateRecipes
SuccessRecipe Delete Multiple Recipes
Task: RecipeDeleteMultipleRecipes
SuccessRecipe Delete Multiple Recipes
Task: RecipeDeleteMultipleRecipes
SuccessRecipe Delete Multiple Recipes With Constraint
Task: RecipeDeleteMultipleRecipesWithConstraint
SuccessRecipe Delete Multiple Recipes With Constraint
Task: RecipeDeleteMultipleRecipesWithConstraint
SuccessRecipe Delete Multiple Recipes With Noise
Task: RecipeDeleteMultipleRecipesWithNoise
SuccessRecipe Delete Multiple Recipes With Noise
Task: RecipeDeleteMultipleRecipesWithNoise
SuccessRecipe Delete Single Recipe
Task: RecipeDeleteSingleRecipe
SuccessRecipe Delete Single Recipe
Task: RecipeDeleteSingleRecipe
SuccessRecipe Delete Single With Recipe With Noise
Task: RecipeDeleteSingleWithRecipeWithNoise
SuccessRecipe Delete Single With Recipe With Noise
Task: RecipeDeleteSingleWithRecipeWithNoise
SuccessRetro Create Playlist
Task: RetroCreatePlaylist
SuccessRetro Create Playlist
Task: RetroCreatePlaylist
SuccessRetro Playing Queue
Task: RetroPlayingQueue
SuccessRetro Playing Queue
Task: RetroPlayingQueue
SuccessRetro Playlist Duration
Task: RetroPlaylistDuration
SuccessRetro Playlist Duration
Task: RetroPlaylistDuration
SuccessRetro Save Playlist
Task: RetroSavePlaylist
SuccessRetro Save Playlist
Task: RetroSavePlaylist
SuccessSave Copy Of Receipt Task Eval
Task: SaveCopyOfReceiptTaskEval
SuccessSave Copy Of Receipt Task Eval
Task: SaveCopyOfReceiptTaskEval
SuccessSimple Calendar Add One Event
Task: SimpleCalendarAddOneEvent
SuccessSimple Calendar Add One Event
Task: SimpleCalendarAddOneEvent
SuccessSimple Calendar Add One Event In Two Weeks
Task: SimpleCalendarAddOneEventInTwoWeeks
SuccessSimple Calendar Add One Event In Two Weeks
Task: SimpleCalendarAddOneEventInTwoWeeks
SuccessSimple Calendar Add One Event Relative Day
Task: SimpleCalendarAddOneEventRelativeDay
SuccessSimple Calendar Add One Event Relative Day
Task: SimpleCalendarAddOneEventRelativeDay
SuccessSimple Calendar Add One Event Tomorrow
Task: SimpleCalendarAddOneEventTomorrow
SuccessSimple Calendar Add One Event Tomorrow
Task: SimpleCalendarAddOneEventTomorrow
SuccessSimple Calendar Add Repeating Event
Task: SimpleCalendarAddRepeatingEvent
SuccessSimple Calendar Add Repeating Event
Task: SimpleCalendarAddRepeatingEvent
SuccessSimple Calendar Delete Events
Task: SimpleCalendarDeleteEvents
SuccessSimple Calendar Delete Events
Task: SimpleCalendarDeleteEvents
SuccessSimple Calendar Delete Events On Relative Day
Task: SimpleCalendarDeleteEventsOnRelativeDay
SuccessSimple Calendar Delete Events On Relative Day
Task: SimpleCalendarDeleteEventsOnRelativeDay
SuccessSimple Calendar Delete One Event
Task: SimpleCalendarDeleteOneEvent
SuccessSimple Calendar Delete One Event
Task: SimpleCalendarDeleteOneEvent
SuccessSimple Calendar Event On Date At Time
Task: SimpleCalendarEventOnDateAtTime
SuccessSimple Calendar Event On Date At Time
Task: SimpleCalendarEventOnDateAtTime
SuccessSimple Calendar Events In Time Range
Task: SimpleCalendarEventsInTimeRange
SuccessSimple Calendar Events In Time Range
Task: SimpleCalendarEventsInTimeRange
SuccessSimple Calendar Events On Date
Task: SimpleCalendarEventsOnDate
SuccessSimple Calendar Events On Date
Task: SimpleCalendarEventsOnDate
SuccessSimple Calendar First Event After Start Time
Task: SimpleCalendarFirstEventAfterStartTime
SuccessSimple Calendar First Event After Start Time
Task: SimpleCalendarFirstEventAfterStartTime
SuccessSimple Calendar Location Of Event
Task: SimpleCalendarLocationOfEvent
SuccessSimple Calendar Location Of Event
Task: SimpleCalendarLocationOfEvent
SuccessSimple Calendar Next Event
Task: SimpleCalendarNextEvent
SuccessSimple Calendar Next Event
Task: SimpleCalendarNextEvent
SuccessSimple Calendar Next Meeting With Person
Task: SimpleCalendarNextMeetingWithPerson
SuccessSimple Calendar Next Meeting With Person
Task: SimpleCalendarNextMeetingWithPerson
SuccessSimple Draw Pro Create Drawing
Task: SimpleDrawProCreateDrawing
SuccessSimple Draw Pro Create Drawing
Task: SimpleDrawProCreateDrawing
SuccessSimple Sms Reply
Task: SimpleSmsReply
SuccessSimple Sms Reply
Task: SimpleSmsReply
SuccessSimple Sms Reply Most Recent
Task: SimpleSmsReplyMostRecent
SuccessSimple Sms Reply Most Recent
Task: SimpleSmsReplyMostRecent
SuccessSimple Sms Resend
Task: SimpleSmsResend
SuccessSimple Sms Resend
Task: SimpleSmsResend
SuccessSimple Sms Send
Task: SimpleSmsSend
SuccessSimple Sms Send
Task: SimpleSmsSend
SuccessSimple Sms Send Clipboard Content
Task: SimpleSmsSendClipboardContent
SuccessSimple Sms Send Clipboard Content
Task: SimpleSmsSendClipboardContent
SuccessSimple Sms Send Received Address
Task: SimpleSmsSendReceivedAddress
SuccessSimple Sms Send Received Address
Task: SimpleSmsSendReceivedAddress
SuccessSports Tracker Activities Count For Week
Task: SportsTrackerActivitiesCountForWeek
SuccessSports Tracker Activities Count For Week
Task: SportsTrackerActivitiesCountForWeek
SuccessSports Tracker Activity Duration
Task: SportsTrackerActivityDuration
SuccessSports Tracker Activity Duration
Task: SportsTrackerActivityDuration
SuccessSports Tracker Total Duration For Category This Week
Task: SportsTrackerTotalDurationForCategoryThisWeek
SuccessSports Tracker Total Duration For Category This Week
Task: SportsTrackerTotalDurationForCategoryThisWeek
SuccessSystem Bluetooth Turn Off
Task: SystemBluetoothTurnOff
SuccessSystem Bluetooth Turn Off
Task: SystemBluetoothTurnOff
SuccessSystem Bluetooth Turn Off Verify
Task: SystemBluetoothTurnOffVerify
SuccessSystem Bluetooth Turn Off Verify
Task: SystemBluetoothTurnOffVerify
SuccessSystem Bluetooth Turn On
Task: SystemBluetoothTurnOn
SuccessSystem Bluetooth Turn On
Task: SystemBluetoothTurnOn
SuccessSystem Bluetooth Turn On Verify
Task: SystemBluetoothTurnOnVerify
SuccessSystem Bluetooth Turn On Verify
Task: SystemBluetoothTurnOnVerify
SuccessSystem Brightness Max
Task: SystemBrightnessMax
SuccessSystem Brightness Max
Task: SystemBrightnessMax
SuccessSystem Brightness Max Verify
Task: SystemBrightnessMaxVerify
SuccessSystem Brightness Max Verify
Task: SystemBrightnessMaxVerify
SuccessSystem Brightness Min
Task: SystemBrightnessMin
SuccessSystem Brightness Min
Task: SystemBrightnessMin
SuccessSystem Brightness Min Verify
Task: SystemBrightnessMinVerify
SuccessSystem Brightness Min Verify
Task: SystemBrightnessMinVerify
SuccessSystem Copy To Clipboard
Task: SystemCopyToClipboard
SuccessSystem Copy To Clipboard
Task: SystemCopyToClipboard
SuccessSystem Wifi Turn Off
Task: SystemWifiTurnOff
SuccessSystem Wifi Turn Off
Task: SystemWifiTurnOff
SuccessSystem Wifi Turn Off Verify
Task: SystemWifiTurnOffVerify
SuccessSystem Wifi Turn Off Verify
Task: SystemWifiTurnOffVerify
SuccessSystem Wifi Turn On
Task: SystemWifiTurnOn
SuccessSystem Wifi Turn On
Task: SystemWifiTurnOn
SuccessSystem Wifi Turn On Verify
Task: SystemWifiTurnOnVerify
SuccessSystem Wifi Turn On Verify
Task: SystemWifiTurnOnVerify
SuccessTasks Due On Date
Task: TasksDueOnDate
SuccessTasks Due On Date
Task: TasksDueOnDate
SuccessTasks High Priority Tasks
Task: TasksHighPriorityTasks
SuccessTasks High Priority Tasks
Task: TasksHighPriorityTasks
SuccessTasks Incomplete Tasks On Date
Task: TasksIncompleteTasksOnDate
SuccessTasks Incomplete Tasks On Date
Task: TasksIncompleteTasksOnDate
SuccessTurn Off Wifi And Turn On Bluetooth
Task: TurnOffWifiAndTurnOnBluetooth
SuccessTurn Off Wifi And Turn On Bluetooth
Task: TurnOffWifiAndTurnOnBluetooth
SuccessTurn On Wifi And Open App
Task: TurnOnWifiAndOpenApp
SuccessTurn On Wifi And Open App
Task: TurnOnWifiAndOpenApp
SuccessVlc Create Playlist
Task: VlcCreatePlaylist
SuccessVlc Create Playlist
Task: VlcCreatePlaylist
SuccessBrowser Multiply
Task: BrowserMultiply
FailedBrowser Multiply
Task: BrowserMultiply
FailedExpense Add Multiple From Markor
Task: ExpenseAddMultipleFromMarkor
FailedExpense Add Multiple From Markor
Task: ExpenseAddMultipleFromMarkor
FailedMarkor Add Note Header
Task: MarkorAddNoteHeader
FailedMarkor Add Note Header
Task: MarkorAddNoteHeader
FailedMarkor Change Note Content
Task: MarkorChangeNoteContent
FailedMarkor Change Note Content
Task: MarkorChangeNoteContent
FailedMarkor Edit Note
Task: MarkorEditNote
FailedMarkor Edit Note
Task: MarkorEditNote
FailedMarkor Merge Notes
Task: MarkorMergeNotes
FailedMarkor Merge Notes
Task: MarkorMergeNotes
FailedMarkor Move Note
Task: MarkorMoveNote
FailedMarkor Move Note
Task: MarkorMoveNote
FailedMarkor Transcribe Video
Task: MarkorTranscribeVideo
FailedMarkor Transcribe Video
Task: MarkorTranscribeVideo
FailedOsm And Marker
Task: OsmAndMarker
FailedOsm And Marker
Task: OsmAndMarker
FailedOsm And Track
Task: OsmAndTrack
FailedOsm And Track
Task: OsmAndTrack
FailedRecipe Add Multiple Recipes From Image
Task: RecipeAddMultipleRecipesFromImage
FailedRecipe Add Multiple Recipes From Image
Task: RecipeAddMultipleRecipesFromImage
FailedRecipe Add Multiple Recipes From Markor
Task: RecipeAddMultipleRecipesFromMarkor
FailedRecipe Add Multiple Recipes From Markor
Task: RecipeAddMultipleRecipesFromMarkor
FailedRecipe Add Multiple Recipes From Markor2
Task: RecipeAddMultipleRecipesFromMarkor2
FailedRecipe Add Multiple Recipes From Markor2
Task: RecipeAddMultipleRecipesFromMarkor2
FailedRecipe Delete Duplicate Recipes2
Task: RecipeDeleteDuplicateRecipes2
FailedRecipe Delete Duplicate Recipes2
Task: RecipeDeleteDuplicateRecipes2
FailedRecipe Delete Duplicate Recipes3
Task: RecipeDeleteDuplicateRecipes3
FailedRecipe Delete Duplicate Recipes3
Task: RecipeDeleteDuplicateRecipes3
FailedSimple Calendar Any Events On Date
Task: SimpleCalendarAnyEventsOnDate
FailedSimple Calendar Any Events On Date
Task: SimpleCalendarAnyEventsOnDate
FailedSimple Calendar Events In Next Week
Task: SimpleCalendarEventsInNextWeek
FailedSimple Calendar Events In Next Week
Task: SimpleCalendarEventsInNextWeek
FailedSports Tracker Activities On Date
Task: SportsTrackerActivitiesOnDate
FailedSports Tracker Activities On Date
Task: SportsTrackerActivitiesOnDate
FailedSports Tracker Longest Distance Activity
Task: SportsTrackerLongestDistanceActivity
FailedSports Tracker Longest Distance Activity
Task: SportsTrackerLongestDistanceActivity
FailedSports Tracker Total Distance For Category Over Interval
Task: SportsTrackerTotalDistanceForCategoryOverInterval
FailedSports Tracker Total Distance For Category Over Interval
Task: SportsTrackerTotalDistanceForCategoryOverInterval
FailedTasks Completed Tasks For Date
Task: TasksCompletedTasksForDate
FailedTasks Completed Tasks For Date
Task: TasksCompletedTasksForDate
FailedTasks Due Next Week
Task: TasksDueNextWeek
FailedTasks Due Next Week
Task: TasksDueNextWeek
FailedTasks High Priority Tasks Due On Date
Task: TasksHighPriorityTasksDueOnDate
FailedTasks High Priority Tasks Due On Date
Task: TasksHighPriorityTasksDueOnDate
FailedVlc Create Two Playlists
Task: VlcCreateTwoPlaylists
FailedVlc Create Two Playlists
Task: VlcCreateTwoPlaylists
Failed