Droidrun Logo: Running Droid Droidrun

AndroidWorld Benchmark

Droidrun achieves state of the art performance on AndroidWorld with 63.0% success rate across 116 diverse tasks. Despite setup challenges and evaluation limitations, our open source approach using Gemini 2.5 Pro and direct Accessibility API access outperforms all competing agents.

View Method View Leaderboard

AndroidWorld Benchmark Results

Success rates of leading AI agents on the 116-task AndroidWorld benchmark (2024-2025)

Droidrun
Other Agents
63% Success Rate
AndroidWorld benchmark results
73/116 (63%)
73 Success
•
43 Failed

Audio Recorder Record Audio

Task: AudioRecorderRecordAudio

Success

Audio Recorder Record Audio With File Name

Task: AudioRecorderRecordAudioWithFileName

Success

Browser Maze

Task: BrowserMaze

Success

Browser Multiply

Task: BrowserMultiply

Success

Camera Take Photo

Task: CameraTakePhoto

Success

Camera Take Video

Task: CameraTakeVideo

Success

Clock Stop Watch Paused Verify

Task: ClockStopWatchPausedVerify

Success

Clock Stop Watch Running

Task: ClockStopWatchRunning

Success

Clock Timer Entry

Task: ClockTimerEntry

Success

Contacts Add Contact

Task: ContactsAddContact

Success

Contacts New Contact Draft

Task: ContactsNewContactDraft

Success

Expense Add Multiple

Task: ExpenseAddMultiple

Success

Expense Add Single

Task: ExpenseAddSingle

Success

Expense Delete Duplicates

Task: ExpenseDeleteDuplicates

Success

Expense Delete Duplicates2

Task: ExpenseDeleteDuplicates2

Success

Expense Delete Multiple

Task: ExpenseDeleteMultiple

Success

Expense Delete Multiple2

Task: ExpenseDeleteMultiple2

Success

Expense Delete Single

Task: ExpenseDeleteSingle

Success

Files Delete File

Task: FilesDeleteFile

Success

Files Move File

Task: FilesMoveFile

Success

Markor Change Note Content

Task: MarkorChangeNoteContent

Success

Markor Create Folder

Task: MarkorCreateFolder

Success

Markor Create Note

Task: MarkorCreateNote

Success

Markor Delete Newest Note

Task: MarkorDeleteNewestNote

Success

Markor Delete Note

Task: MarkorDeleteNote

Success

Notes Is Todo

Task: NotesIsTodo

Success

Notes Meeting Attendee Count

Task: NotesMeetingAttendeeCount

Success

Notes Todo Item Count

Task: NotesTodoItemCount

Success

Open App Task Eval

Task: OpenAppTaskEval

Success

Osm And Favorite

Task: OsmAndFavorite

Success

Recipe Add Multiple Recipes

Task: RecipeAddMultipleRecipes

Success

Recipe Add Single Recipe

Task: RecipeAddSingleRecipe

Success

Recipe Delete Duplicate Recipes

Task: RecipeDeleteDuplicateRecipes

Success

Recipe Delete Multiple Recipes

Task: RecipeDeleteMultipleRecipes

Success

Recipe Delete Multiple Recipes With Noise

Task: RecipeDeleteMultipleRecipesWithNoise

Success

Recipe Delete Single Recipe

Task: RecipeDeleteSingleRecipe

Success

Recipe Delete Single With Recipe With Noise

Task: RecipeDeleteSingleWithRecipeWithNoise

Success

Retro Create Playlist

Task: RetroCreatePlaylist

Success

Retro Playing Queue

Task: RetroPlayingQueue

Success

Retro Save Playlist

Task: RetroSavePlaylist

Success

Save Copy Of Receipt Task Eval

Task: SaveCopyOfReceiptTaskEval

Success

Simple Calendar Add One Event

Task: SimpleCalendarAddOneEvent

Success

Simple Calendar Add One Event Tomorrow

Task: SimpleCalendarAddOneEventTomorrow

Success

Simple Calendar Delete Events

Task: SimpleCalendarDeleteEvents

Success

Simple Calendar Delete Events On Relative Day

Task: SimpleCalendarDeleteEventsOnRelativeDay

Success

Simple Calendar Events In Time Range

Task: SimpleCalendarEventsInTimeRange

Success

Simple Calendar Events On Date

Task: SimpleCalendarEventsOnDate

Success

Simple Calendar First Event After Start Time

Task: SimpleCalendarFirstEventAfterStartTime

Success

Simple Calendar Location Of Event

Task: SimpleCalendarLocationOfEvent

Success

Simple Calendar Next Event

Task: SimpleCalendarNextEvent

Success

Simple Draw Pro Create Drawing

Task: SimpleDrawProCreateDrawing

Success

Simple Sms Reply Most Recent

Task: SimpleSmsReplyMostRecent

Success

Simple Sms Resend

Task: SimpleSmsResend

Success

Sports Tracker Activity Duration

Task: SportsTrackerActivityDuration

Success

Sports Tracker Longest Distance Activity

Task: SportsTrackerLongestDistanceActivity

Success

Sports Tracker Total Distance For Category Over Interval

Task: SportsTrackerTotalDistanceForCategoryOverInterval

Success

System Bluetooth Turn Off

Task: SystemBluetoothTurnOff

Success

System Bluetooth Turn Off Verify

Task: SystemBluetoothTurnOffVerify

Success

System Bluetooth Turn On

Task: SystemBluetoothTurnOn

Success

System Bluetooth Turn On Verify

Task: SystemBluetoothTurnOnVerify

Success

System Brightness Max

Task: SystemBrightnessMax

Success

System Brightness Max Verify

Task: SystemBrightnessMaxVerify

Success

System Brightness Min

Task: SystemBrightnessMin

Success

System Brightness Min Verify

Task: SystemBrightnessMinVerify

Success

System Wifi Turn Off

Task: SystemWifiTurnOff

Success

System Wifi Turn Off Verify

Task: SystemWifiTurnOffVerify

Success

System Wifi Turn On

Task: SystemWifiTurnOn

Success

System Wifi Turn On Verify

Task: SystemWifiTurnOnVerify

Success

Tasks Incomplete Tasks On Date

Task: TasksIncompleteTasksOnDate

Success

Turn Off Wifi And Turn On Bluetooth

Task: TurnOffWifiAndTurnOnBluetooth

Success

Turn On Wifi And Open App

Task: TurnOnWifiAndOpenApp

Success

Vlc Create Playlist

Task: VlcCreatePlaylist

Success

Vlc Create Two Playlists

Task: VlcCreateTwoPlaylists

Success

Browser Draw

Task: BrowserDraw

Failed

Expense Add Multiple From Gallery

Task: ExpenseAddMultipleFromGallery

Failed

Expense Add Multiple From Markor

Task: ExpenseAddMultipleFromMarkor

Failed

Markor Add Note Header

Task: MarkorAddNoteHeader

Failed

Markor Create Note And Sms

Task: MarkorCreateNoteAndSms

Failed

Markor Create Note From Clipboard

Task: MarkorCreateNoteFromClipboard

Failed

Markor Delete All Notes

Task: MarkorDeleteAllNotes

Failed

Markor Edit Note

Task: MarkorEditNote

Failed

Markor Merge Notes

Task: MarkorMergeNotes

Failed

Markor Move Note

Task: MarkorMoveNote

Failed

Markor Transcribe Receipt

Task: MarkorTranscribeReceipt

Failed

Markor Transcribe Video

Task: MarkorTranscribeVideo

Failed

Notes Recipe Ingredient Count

Task: NotesRecipeIngredientCount

Failed

Osm And Marker

Task: OsmAndMarker

Failed

Osm And Track

Task: OsmAndTrack

Failed

Recipe Add Multiple Recipes From Image

Task: RecipeAddMultipleRecipesFromImage

Failed

Recipe Add Multiple Recipes From Markor

Task: RecipeAddMultipleRecipesFromMarkor

Failed

Recipe Add Multiple Recipes From Markor2

Task: RecipeAddMultipleRecipesFromMarkor2

Failed

Recipe Delete Duplicate Recipes2

Task: RecipeDeleteDuplicateRecipes2

Failed

Recipe Delete Duplicate Recipes3

Task: RecipeDeleteDuplicateRecipes3

Failed

Recipe Delete Multiple Recipes With Constraint

Task: RecipeDeleteMultipleRecipesWithConstraint

Failed

Retro Playlist Duration

Task: RetroPlaylistDuration

Failed

Simple Calendar Add One Event In Two Weeks

Task: SimpleCalendarAddOneEventInTwoWeeks

Failed

Simple Calendar Add One Event Relative Day

Task: SimpleCalendarAddOneEventRelativeDay

Failed

Simple Calendar Add Repeating Event

Task: SimpleCalendarAddRepeatingEvent

Failed

Simple Calendar Any Events On Date

Task: SimpleCalendarAnyEventsOnDate

Failed

Simple Calendar Delete One Event

Task: SimpleCalendarDeleteOneEvent

Failed

Simple Calendar Event On Date At Time

Task: SimpleCalendarEventOnDateAtTime

Failed

Simple Calendar Events In Next Week

Task: SimpleCalendarEventsInNextWeek

Failed

Simple Calendar Next Meeting With Person

Task: SimpleCalendarNextMeetingWithPerson

Failed

Simple Sms Reply

Task: SimpleSmsReply

Failed

Simple Sms Send

Task: SimpleSmsSend

Failed

Simple Sms Send Clipboard Content

Task: SimpleSmsSendClipboardContent

Failed

Simple Sms Send Received Address

Task: SimpleSmsSendReceivedAddress

Failed

Sports Tracker Activities Count For Week

Task: SportsTrackerActivitiesCountForWeek

Failed

Sports Tracker Activities On Date

Task: SportsTrackerActivitiesOnDate

Failed

Sports Tracker Total Duration For Category This Week

Task: SportsTrackerTotalDurationForCategoryThisWeek

Failed

System Copy To Clipboard

Task: SystemCopyToClipboard

Failed

Tasks Completed Tasks For Date

Task: TasksCompletedTasksForDate

Failed

Tasks Due Next Week

Task: TasksDueNextWeek

Failed

Tasks Due On Date

Task: TasksDueOnDate

Failed

Tasks High Priority Tasks

Task: TasksHighPriorityTasks

Failed

Tasks High Priority Tasks Due On Date

Task: TasksHighPriorityTasksDueOnDate

Failed