Active Incident

Updated a few seconds ago

NOTICE: Mandatory mobile app migration due to Google policy changesOperational

Incident Status

Operational

Components

OTT & NOW App

Locations

US-CLOUD-1


July 29, 2024 10:47AM CDT
July 29, 2024 3:47PM UTC
[Monitoring] Google has recently announced two major changes to Google Play Store app submission requirements that will affect clients using BLOX Digital’s legacy mobile applications: The Google Play Store will stop accepting updates to apps using versions of the Google Play Billing library earlier than version 6.0.1. New apps and app updates must target Android 14 (API level 34) to be submitted to Google Play. Both of these changes take effect on August 31, 2024. While apps that your users have previously downloaded will continue to serve your content after August 31, they will no longer receive software updates and new users will not be able to find your app in Google Play after that date. In response to Google’s policy changes, BLOX Digital will proactively protect our clients by migrating all apps to the newest version of our mobile app codebase, which is fully compatible with the latest requirements. As part of this migration, upgraded iOS apps will also be submitted to Apple’s App Store. We are actively working on a final migration plan and will provide more details—including timelines and any actions you may need to take—as they become available. To ensure that you continue to benefit from the latest features and security improvements, we are committed to making this transition as smooth as possible. Thank you for your continued partnership with BLOX Digital. If you have any questions or need immediate assistance, don’t hesitate to contact our customer support team.

BLOX CMS




Operational

Job Processing




Operational

BLOX Total CMS




Operational

Network




Operational

Database




Operational

Storage System




Operational

Support Call Center




Operational

BLOX VMS




Operational

Rayos CMS




Operational

FTP, Drive, DNS, E-Mail




Operational

E-Editions




Operational

Advertising & Behavioral Targeting




Operational

Business Directory




Operational

Forms




Operational

Subscription




Operational

Analytics & Email Reach




Operational

Calendar




Operational

BLOX CMS /APP




Operational

Sandstone Administration




Operational

OTT & NOW App




Operational

GamesPerform




Operational

Data Insights




Operational

History (Last 7 days)

AP APIs outagePartial Service Disruption

Incident Status

Partial Service Disruption


Components

BLOX CMS


Locations

US-EAST-1, US-MIDWEST-1



September 30, 2024 11:01AM CDT
September 30, 2024 4:01PM UTC
[Investigating] Our developers are working with AP to address and outage from 09/29 4:40 PM on their APIs that have caused issues with our syndication process.

October 2, 2024 1:26PM CDT
October 2, 2024 6:26PM UTC
[Resolved] AP API's was restored on 09/30 at 11:45 AM central, This issue has been fixed since then.
BLOX Subscriptions 1.59.1 release at 4:00 PM central.Operational

Incident Status

Operational


Components

Subscription


Locations

US-EAST-1, US-MIDWEST-1



October 1, 2024 4:03PM CDT
October 1, 2024 9:03PM UTC
[Monitoring] BLOX Subscriptions 1.59.1 will be released at 4:00 PM central with improvements to the email notifications to subscribers when renewals fails.

October 2, 2024 8:57AM CDT
October 2, 2024 1:57PM UTC
[Resolved] Software released.
Load balancer updatesPlanned Maintenance

Description

On Tuesday, October 1st, at 10:00 PM CDT, a software security update will be applied to the load balancers overseeing traffic for the Rayos and BLOX platforms. The updates will be applied one load balancer at a time. We do not anticipate any disruptions to service. If any services are affected during this process, we will promptly provide updates.


Components

BLOX CMS, Network, Rayos CMS


Locations

US-EAST-1, US-MIDWEST-1


Schedule

October 1, 2024 10:00PM - October 1, 2024 11:00PM CDT
October 2, 2024 3:00AM - October 2, 2024 4:00AM UTC


October 1, 2024 10:00PM CDT
October 2, 2024 3:00AM UTC
[Update] Scheduled maintenance is starting.

October 1, 2024 11:00PM CDT
October 2, 2024 4:00AM UTC
[Update] Scheduled maintenance is complete.
BLOX PageTracker 1.35.0 rollbackOperational

Incident Status

Operational


Components

BLOX Total CMS


Locations

GLOBAL



September 17, 2024 4:04PM CDT
September 17, 2024 9:04PM UTC
[Investigating] BLOX PageTracker 1.35.0 is being rolled back due to reported issues with Budget View not functioning correctly. Our developers are investigating the root cause of the issue.

September 30, 2024 8:46AM CDT
September 30, 2024 1:46PM UTC
[Monitoring] BLOX PageTracker 1.35.0 will be re-released at 10:00 AM central.

October 1, 2024 3:59PM CDT
October 1, 2024 8:59PM UTC
[Resolved] Software re-released.
BLOX VMS Live Stream DisruptionPartial Service Disruption

Incident Status

Partial Service Disruption


Components

BLOX VMS


Locations

US-CLOUD-1



September 27, 2024 4:50PM CDT
September 27, 2024 9:50PM UTC
[Investigating] We are currently investigating an issue with a BLOX VMS Live Server that has caused a disruption for a subset of our customers. Our team is actively working to resolve the issue and is in the process of migrating affected customers to an alternate server. We will provide further updates as soon as more information becomes available.

September 27, 2024 4:58PM CDT
September 27, 2024 9:58PM UTC
[Monitoring] We have migrated all affected streams to an alternate server. If you experience any further issues, please report them to our support team.

October 1, 2024 12:05PM CDT
October 1, 2024 5:05PM UTC
[Resolved] All services operating normally
BLOX VMS manager 500 errorsPartial Service Disruption

Incident Status

Partial Service Disruption


Components

BLOX VMS


Locations

US-CLOUD-1



September 25, 2024 8:55AM CDT
September 25, 2024 1:55PM UTC
[Investigating] We're investigating reports of customers receiving 500 errors within the BLOX VMS manager. We'll provide updates as we gather more information.

September 25, 2024 9:11AM CDT
September 25, 2024 2:11PM UTC
[Monitoring] Root cause has been determined and a patch implemented.

September 25, 2024 3:34PM CDT
September 25, 2024 8:34PM UTC
[Monitoring] We will release a permanent patch for the issue today, Sept 25, at 3:45pm Central to fully resolve this issue. This will be VMS version 3.36.3

September 26, 2024 1:32PM CDT
September 26, 2024 6:32PM UTC
[Resolved] BLOX VMS version 3.36.3 was successfully deployed and corrected the issue causing 500 errors in the VMS.
Platform Security UpdatePlanned Maintenance

Description

We will be performing a gradual rollout of security updates to the BLOX platform over the next couple of weeks. The updates will provide additional protection against automated attacks and will be monitored closely for any potential issues that may arise. The updates will begin rolling out on August 22, 2024 at 9:00AM central. 09/20/2024 Software has been released and the Security Update is now completed.


Components

BLOX CMS, Forms, Subscription


Locations

US-EAST-1, US-MIDWEST-1


Schedule

August 22, 2024 9:00AM - September 17, 2024 5:00PM CDT
August 22, 2024 2:00PM - September 17, 2024 10:00PM UTC


September 26, 2024 9:00AM CDT
September 26, 2024 2:00PM UTC
[Update] All platform changes have been made to all sites.

September 26, 2024 9:00AM CDT
September 26, 2024 2:00PM UTC
[Update] This migration is considered complete at this stage.
Blox VMS 3.36.2 release Sept 23 at 2:00 PM centralOperational

Incident Status

Operational


Components

BLOX VMS


Locations

US-CLOUD-1



September 23, 2024 9:35AM CDT
September 23, 2024 2:35PM UTC
[Monitoring] We will be releasing VMS version 3.36.2 today at 2:00pm. This release contains a fix for a bug that was causing deleted video content to not be removed from storage.

September 25, 2024 2:23PM CDT
September 25, 2024 7:23PM UTC
[Resolved] This release went out successfully.