Lokalise main application degraded performance

Incident Report for Lokalise

Postmortem

Between February 27 and March 1, 2025, our service experienced performance degradation in background tasks that impacted essential processes including file imports, synchronization with content integrations, and some bulk actions.

What happened?
A faulty release unintentionally caused our background tasks to stop working as expected. Although the issue did not appear immediately, it became noticeable the next evening. Our team promptly identified the problem, initiated an investigation, and implemented a corrective patch, ensuring full service restoration.

Impact

  • February 27th, 2025, 20:00 UTC to March 1, 2025, 12:02 UTC: Customers experienced slower performance.
  • March 1, 2025, 14:30 UTC: Corrective patch deployed.

What we are doing to prevent this in the future
We recognize the importance of this event, and are taking further steps to ensure it does not happen again. Our key actions include:

  • Additional monitoring of background tasks to quickly spot issues.
  • Exploring options for our system to recover automatically from minor errors.
  • Enhancing our test coverage to help identify potential issues earlier in the release process.

We sincerely apologize for the inconvenience this incident caused. Thank you for your patience and understanding as we continue to improve Lokalise’s resilience and reliability. If you have any questions or require further assistance, please contact hello@lokalise.com.

Posted Mar 11, 2025 - 11:10 UTC

Resolved

This incident has been resolved.
Posted Mar 01, 2025 - 17:08 UTC

Monitoring

A fix has been implemented and we are monitoring the results.
Posted Mar 01, 2025 - 14:30 UTC

Identified

The issue has been identified and a fix is being implemented.
Posted Feb 28, 2025 - 18:01 UTC

Investigating

We are currently experiencing issues with UI import and bulk actions. We are investigating the issue.
Posted Feb 27, 2025 - 20:00 UTC
This incident affected: Lokalise App.