All systems are operational

Past Incidents

8th May 2023

ph24-12 ph24-12 down

The hypervisor seems to be offline

  • A bug in the running kernel version caused the system to kernel panic, we have patched the kernel and rebooted the system.

    • 17th December 2022

    Crashed Hypervisor ph24-11

    The hypervisor ph24-11 is not responding due to IO related issues with the hosts software raid.

  • There have been fan control related issues which lead to a crashing system. We have adjusted the fan control configuration to suite our needs.

  • The system has been evacuated and we are conducting further investigations to ensure that this problem does not occur again.

    • 16th November 2022

    Crashing VMs

    We are currently investigating an issue where several VMs have crashed.

  • The issue has been resolved

    • 22nd October 2022

    ph24-9 Malfunction of hypervisor ph24-9

    We are working on restoring the functionality of the affected guests and of the hypervisor.

  • The Problem has been resolved

    • 15th August 2022

    prohosting24.de Backend errors

    We are currently implementing a fix which should make the web app operational again.

  • All problems have been resolved now.

  • We stumbled across some issues with restored tables, those tables are going to be restored again manually.

  • The Problem has been resolved

    • 5th April 2022

    ns2.prohosting24.de / ns2.prohosting24.eu Nameserver 2 shutdown

    We performed a controlled shutdown of the secondary name server ns2 due to a detected inconsistency in replicated DNS zones. We are currently investigating why axfr zone transfer is not working as expected.

    All dns zones are still resolveable through the primary nameserver ns1.

  • We have redeployed the secondary name server. All DNS zones are now available and consistent on both nameservers.

    • 4th April 2022

    Network 5.181.151.0/24 offline

    The provider of the subnet 5.181.151.0/24 has interrupted the routes.

    I have assigned a new IP address to the affected servers. If the server is not accessible via this address after a reboot, the address may have to be adjusted manually using the noVNC console.

  • All customers have been migrated to other IP-Address spaces.

    • 3rd April 2022

    Backup server Proxmox backup server peformance issues

    Current migration of data between raid arrays on the backup server provided by our housing provider is causing performance issues that result in the inability to create or restore backups at this time. After the data migration is complete, the backup creation and restoration tasks are performed much faster than before.

  • The backup server is fully operational.

  • The Backupserver is now beeing migrated back to a raid 10 array.

  • The migration has finished successfully.

    • 2nd April 2022

    CEPH cluster Performance issues due to maintenance

    Performance issues detected

  • Migration of data has finished successfully. Everything is up and running again.

  • We have temporarily added a new object store daemon to ph24-8 and managed to get the crashed ph24-8/9 object store daemon working again. The ph24-5 hypervisor was successfully taken out of service.

    Migration of data that is still in progress may affect the performance of the Ceph cluster.

  • The ph24-8/9 object store daemon crashed while we were performing a data migration to other object stores. This failure resulted in unavailability of 25 pg's. The data was not lost, but was unavailable for a few minutes.

    • 27th March 2022

    Network Network unavailable for subnet 5.181.151.0/24

    All services from the network 5.181.151.0/24 are unreachable

  • The owner of the IPv4 resources 5.181.151.0/24 removed the route object for the subnet because of an abuse report regarding fraudulent content being hosted at web.prohosting24.de.

    The fraudulent content has been removed and the connectivity was restored by recreating the old route object.