-
Notifications
You must be signed in to change notification settings - Fork 137
Open
Labels
Description
Note: This report excludes Firestore. Please also check the report for Firestore.
Testing History (last 7 days)
| Date | Build vs Source Repo | Test vs Source Repo | SDK Packaging | Build vs SDK Package | Test vs SDK Package | Notes |
|---|---|---|---|---|---|---|
| 2026‑03‑13 | ✅ Pass | ❌ Failure | ✅ Pass | ✅ Pass | ✅ Pass (flaky) | A test error in Auth on Linux. |
| 2026‑03‑14 | ✅ Pass | ❌ Failure | ✅ Pass | ✅ Pass | ✅ Pass (flaky) | Test errors in Auth on Linux and Windows. |
| 2026‑03‑15 | ✅ Pass | ❌ Failure | ✅ Pass | ✅ Pass | ✅ Pass | A test error in Auth on Android emulator, and test flakes in Auth on Android, Installations on Android emulator, and Database on Android. |
| 2026‑03‑16 | ✅ Pass | ✅ Pass (flaky) | ✅ Pass | ✅ Pass | ❌ Failure | Test flakes in Auth on Android emulator and App Check on iOS. |
| 2026‑03‑17 | ✅ Pass | ❌ Failure | ✅ Pass | ✅ Pass | ✅ Pass | A test error in Auth on iOS simulator, and test flakes in Auth on Android emulator and iOS. |
| 2026‑03‑18 | ✅ Pass | ❌ Failure | ✅ Pass | ✅ Pass | ✅ Pass (flaky) | A test error in Auth on Windows, and test flakes in Auth on Android emulator and Messaging on Android. |
| 2026‑03‑19 | ✅ Pass | ❌ Failure | ✅ Pass | ✅ Pass | ✅ Pass (flaky) | Test errors in Auth on MacOS and Windows. |
View extended history (last 30 days)
Testing History (last 30 days)
| Date | Build vs Source Repo | Test vs Source Repo | SDK Packaging | Build vs SDK Package | Test vs SDK Package | Notes |
|---|---|---|---|---|---|---|
| 2026‑02‑18 | ✅ Pass | ✅ Pass (flaky) | ✅ Pass | ✅ Pass | ✅ Pass (flaky) | A test flake in Auth on Android. |
| 2026‑02‑19 | ✅ Pass | ❌ Failure | ✅ Pass | ✅ Pass | ✅ Pass (flaky) | Test errors in Auth on Linux and Android, and a test flake in Auth on Android. |
| 2026‑02‑20 | ✅ Pass | ✅ Pass (flaky) | ✅ Pass | ✅ Pass | ❌ Failure | A test flake in Auth on Android emulator. |
| 2026‑02‑21 | ✅ Pass | ❌ Failure | ✅ Pass | ✅ Pass | ✅ Pass (flaky) | Test errors in Auth on MacOS, Windows, and Linux. |
| 2026‑02‑22 | ✅ Pass | ❌ Failure | ✅ Pass | ✅ Pass | ✅ Pass (flaky) | Test errors in Auth on Linux and Windows, and test flakes in Storage on Android emulator and Installations on Android emulator. |
| 2026‑02‑23 | ✅ Pass | ✅ Pass (flaky) | ✅ Pass | ✅ Pass | ❌ Failure | A test flake in Auth on Android. |
| 2026‑02‑24 | ✅ Pass | ❌ Failure | ✅ Pass | ✅ Pass | ❌ Failure | Test errors in Auth on Linux and Windows. |
| 2026‑02‑25 | ✅ Pass | ✅ Pass (flaky) | ✅ Pass | ✅ Pass | ❌ Failure | A test flake in Auth on Android. |
| 2026‑02‑26 | ✅ Pass | ✅ Pass (flaky) | ✅ Pass | ✅ Pass | ❌ Failure | A test flake in Remote Config on Android emulator. |
| 2026‑02‑27 | ✅ Pass | ❌ Failure | ✅ Pass | ✅ Pass | ✅ Pass (flaky) | A test error in Auth on Windows, and test flakes in Auth on Android emulator and Storage on Android. |
| 2026‑02‑28 | ✅ Pass | ❌ Failure | ✅ Pass | ✅ Pass | ✅ Pass (flaky) | Test errors in Auth on Windows and Linux, and a test flake in Messaging on Android. |
| 2026‑03‑01 | ✅ Pass | ✅ Pass (flaky) | ✅ Pass | ✅ Pass | ❌ Failure | A test flake in App Check on Android. |
| 2026‑03‑02 | ✅ Pass | ❌ Failure | ✅ Pass | ✅ Pass | ❌ Failure | A test error in Analytics on Windows, and test flakes in Storage on Android emulator, Messaging on Android, and Auth on Android. |
| 2026‑03‑03 | ✅ Pass | ❌ Failure | ✅ Pass | ✅ Pass | ❌ Failure | A test error in Auth on Windows and a test flake in Auth on Android. |
| 2026‑03‑04 | ✅ Pass | ❌ Failure | ✅ Pass | ✅ Pass | ✅ Pass | A test error in Auth on Android emulator and a test flake in Auth on Android emulator. |
| 2026‑03‑05 | ✅ Pass | ❌ Failure | ✅ Pass | ✅ Pass | ❌ Failure | Test errors in Auth on Linux and Windows and Analytics on Windows. |
| 2026‑03‑06 | ✅ Pass | ✅ Pass (flaky) | ✅ Pass | ✅ Pass | ✅ Pass (flaky) | A test flake in Auth on Android emulator. |
| 2026‑03‑07 | ✅ Pass | ✅ Pass (flaky) | ✅ Pass | ✅ Pass | ✅ Pass (flaky) | A test flake in Functions on Android emulator. |
| 2026‑03‑08 | ✅ Pass | ❌ Failure | ✅ Pass | ❌ Failure | ❌ Failure | Test errors in Auth on Linux and Windows. |
| 2026‑03‑09 | ✅ Pass | ✅ Pass (flaky) | ✅ Pass | ✅ Pass | ❌ Failure | A test flake in Auth on Android. |
| 2026‑03‑10 | ✅ Pass | ❌ Failure | ✅ Pass | ✅ Pass | ✅ Pass (flaky) | A test error in Auth on Windows, and test flakes in App Check on Android and Auth on Android emulator. |
| 2026‑03‑11 | ❌ Failure | ✅ Pass | ✅ Pass | ✅ Pass | ✅ Pass (flaky) | Missing build logs on Linux. |
| 2026‑03‑12 | ✅ Pass | ✅ Pass (flaky) | ✅ Pass | ✅ Pass | ❌ Failure | Test flakes in Remote Config on Android and Auth on Android. |
| 2026‑03‑13 | ✅ Pass | ❌ Failure | ✅ Pass | ✅ Pass | ✅ Pass (flaky) | A test error in Auth on Linux. |
| 2026‑03‑14 | ✅ Pass | ❌ Failure | ✅ Pass | ✅ Pass | ✅ Pass (flaky) | Test errors in Auth on Linux and Windows. |
| 2026‑03‑15 | ✅ Pass | ❌ Failure | ✅ Pass | ✅ Pass | ✅ Pass | A test error in Auth on Android emulator, and test flakes in Auth on Android, Installations on Android emulator, and Database on Android. |
| 2026‑03‑16 | ✅ Pass | ✅ Pass (flaky) | ✅ Pass | ✅ Pass | ❌ Failure | Test flakes in Auth on Android emulator and App Check on iOS. |
| 2026‑03‑17 | ✅ Pass | ❌ Failure | ✅ Pass | ✅ Pass | ✅ Pass | A test error in Auth on iOS simulator, and test flakes in Auth on Android emulator and iOS. |
| 2026‑03‑18 | ✅ Pass | ❌ Failure | ✅ Pass | ✅ Pass | ✅ Pass (flaky) | A test error in Auth on Windows, and test flakes in Auth on Android emulator and Messaging on Android. |
| 2026‑03‑19 | ✅ Pass | ❌ Failure | ✅ Pass | ✅ Pass | ✅ Pass (flaky) | Test errors in Auth on MacOS and Windows. |
Top 10 flakes/failures (last 30 days)
| # | Latest | Product | Platform | Test Info |
|---|---|---|---|---|
| 16 | 1 day ago | Auth | Android | FirebaseAuthTest.TestSignInWithBadEmailFails (flaky) Logs: 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 |
| 11 | Today | Auth | Windows | FirebaseAuthTest.TestSignInWithBadEmailFails (failure) Logs: 1 2 3 4 5 6 7 8 9 10 11 |
| 9 | 5 days ago | Auth | Linux | FirebaseAuthTest.TestSignInWithBadEmailFails (failure) Logs: 1 2 3 4 5 6 7 8 9 |
| 3 | 17 days ago | Storage | Android | Crash or timeout (flaky) Logs: 1 2 3 |
| 3 | 4 days ago | Auth | Android | FirebaseAuthTest.TestSignInWithBadEmailFails (failure) Logs: 1 2 3 |
| 2 | 14 days ago | Analytics | Windows | FirebaseAnalyticsTest.TestDesktopInitialization (failure) Logs: 1 2 |
| 2 | 14 days ago | Analytics | Windows | FirebaseAnalyticsTest.TestSetLogCallback (failure) Logs: 1 2 |
| 2 | 1 day ago | Messaging | Android | FirebaseMessagingTest.TestSendMessageToToken (flaky) Logs: 1 2 |
| 2 | 4 days ago | Installations | Android | FirebaseInstallationsTest.TestCanGetToken (flaky) Logs: 1 2 |
| 2 | Today | Auth | MacOS | FirebaseAuthTest.TestSignInWithBadEmailFails (failure) Logs: 1 2 |
📄
2026-03-13 Pass Failure Pass Pass Pass (flaky) A test error in Auth on Linux. 2026-03-14 Pass Failure Pass Pass Pass (flaky) Test errors in Auth on Linux and Windows. 2026-03-15 Pass Failure Pass Pass Pass A test error in Auth on Android emulator, and test flakes in Auth on Android, Installations on Android emulator, and Database on Android. 2026-03-16 Pass Pass (flaky) Pass Pass Failure Test flakes in Auth on Android emulator and App Check on iOS. 2026-03-17 Pass Failure Pass Pass Pass A test error in Auth on iOS simulator, and test flakes in Auth on Android emulator and iOS. 2026-03-18 Pass Failure Pass Pass Pass (flaky) A test error in Auth on Windows, and test flakes in Auth on Android emulator and Messaging on Android. 2026-03-19 Pass Failure Pass Pass Pass (flaky) Test errors in Auth on MacOS and Windows.
✅ [build against repo] Integration test succeeded!
Requested by @DellaBitta on commit 5f348b8
Last updated: Thu Mar 19 03:55 PDT 2026
View integration test log & download artifacts
[build against SDK] Integration test with FLAKINESS (succeeded after retry)
Requested by @firebase-workflow-trigger[bot] on commit 5f348b8
Last updated: Thu Mar 19 06:47 PDT 2026
View integration test log & download artifacts
| Failures | Configs |
|---|---|
| auth | [TEST] [FLAKINESS] [Android] [1/3 os: macos] [1/4 android_device: android_latest](1 failed tests)FirebaseAuthTest.TestSignInWithBadEmailFails(1 failed tests)FirebaseAuthTest.TestSignInWithBadEmailFails |
Add flaky tests to go/fpl-cpp-flake-tracker
Reactions are currently unavailable