Thursday, 12 September 2024

Filled under:

 I wanted to provide an update on the database outage that occurred this morning and the actions taken so far:

  • Vendor Case Raised: A case has been raised with Oracle (Case #123456) and in parallel, I informed the UNIX System Administrators to raise a case with Red Hat (Case #789012). While reviewing the logs during the Oracle case, we noticed I/O and kernel-related messages, suggesting it is an OS-level issue that requires further investigation.

  • Oracle Feedback: Oracle has confirmed that these issues must be investigated at the OS layer. I have relayed this information to the UNIX Admin team for their follow-up.

  • Database Restoration: I have successfully synchronized the database and restored the required parameters to ensure functionality. Initially, manual intervention was needed to bring the database in sync.

  • Backup Status: The backup has been running for the past 9 hours without directly impacting the application or its performance. However, I discovered that the backup is also configured to run on the BCP environment, and I have requested that this be temporarily disabled.

  • Application-Side Errors: We have noticed some authentication-related errors on the application side, but there is no direct impact at the moment. We are actively investigating the issue to determine the root cause.

0 comments:

Post a Comment