tag:status.ironscales.com,2005:/historyIRONSCALES Status - Incident History2024-03-29T01:23:13-04:00IRONSCALEStag:status.ironscales.com,2005:Incident/189670542023-10-29T18:00:00-04:002023-10-30T07:34:59-04:00Mailbox Management issue notification<p><small>Oct <var data-var='date'>29</var>, <var data-var='time'>18:00</var> EDT</small><br><strong>Resolved</strong> - IRONSCALES acknowledges that there was a temporary issue where our system might have inadvertently disabled certain mailboxes. Rest assured, this issue has been promptly addressed, and preventive measures are in place to avoid such occurrences in the future. Thus, you may see an increase in enabled mailboxes. The remaining mailboxes in the disabled mailboxes are mailboxes that were manually disabled from protection in the past.<br /> <br />Kindly navigate to 'Mailboxes' on IRONSCALES to verify that your mailbox list is current and up-to-date.</p>tag:status.ironscales.com,2005:Incident/186794662023-10-08T02:30:22-04:002023-10-08T02:30:22-04:00Scheduled maintenance IRONSCALES US Platform<p><small>Oct <var data-var='date'> 8</var>, <var data-var='time'>02:30</var> EDT</small><br><strong>Completed</strong> - The scheduled maintenance has been completed.</p><p><small>Oct <var data-var='date'> 8</var>, <var data-var='time'>01:30</var> EDT</small><br><strong>In progress</strong> - Scheduled maintenance is currently in progress. We will provide updates as necessary.</p><p><small>Oct <var data-var='date'> 3</var>, <var data-var='time'>12:25</var> EDT</small><br><strong>Update</strong> - Corrected maintenance time to start at 01:30 AM EDT</p><p><small>Oct <var data-var='date'> 3</var>, <var data-var='time'>12:16</var> EDT</small><br><strong>Scheduled</strong> - IRONSCALES US Site: members.ironscales.com, would undergo scheduled maintenance to upgrade compute infrastructure to assure supportability and latest security fixes are in place , Dashboards would not be available, realtime email inspection and mitigation would resume after it finishes including backlog accumulated during the maintenance time.</p>tag:status.ironscales.com,2005:Incident/186575062023-10-01T07:51:08-04:002023-10-01T07:51:08-04:00Scheduled maintenance IRONSCALES<p><small>Oct <var data-var='date'> 1</var>, <var data-var='time'>07:51</var> EDT</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Oct <var data-var='date'> 1</var>, <var data-var='time'>06:09</var> EDT</small><br><strong>Update</strong> - We are continuing to investigate this issue.</p><p><small>Oct <var data-var='date'> 1</var>, <var data-var='time'>06:08</var> EDT</small><br><strong>Investigating</strong> - IRONSCALES EU Site would undergo scheduled maintenance to upgrade compute infrastructure to assure supportability and latest security fixes are in place , Dashboards would not be available, realtime email inspection and mitigation would resume after it finishes including backlog accumulated during the maintenance time.</p>tag:status.ironscales.com,2005:Incident/185763392023-09-22T08:51:08-04:002023-09-22T08:51:08-04:00Inspected emails outage in IRONSCALES EU<p><small>Sep <var data-var='date'>22</var>, <var data-var='time'>08:51</var> EDT</small><br><strong>Resolved</strong> - Our team identified and restarted the faulty infrastructure components , IRONSCALES EU platform is back online with realtime protection. emails and messages received during the downtime would be processed and inspected now. <br />we will keep monitoring the system's health to make sure everything works as expected.</p><p><small>Sep <var data-var='date'>22</var>, <var data-var='time'>08:32</var> EDT</small><br><strong>Identified</strong> - we have identified the source cause of the issue and working to resolve it.</p><p><small>Sep <var data-var='date'>22</var>, <var data-var='time'>08:32</var> EDT</small><br><strong>Investigating</strong> - we are investigating a issue with email inspection in IRONSCALES EU region. (members.eu.ironscales.com), our engineering team is working to resolve the issue.</p>tag:status.ironscales.com,2005:Incident/185763092023-09-22T07:30:00-04:002023-09-22T08:29:12-04:00Inspected emails outage in IRONSCALES EU<p><small>Sep <var data-var='date'>22</var>, <var data-var='time'>07:30</var> EDT</small><br><strong>Resolved</strong> - we are investigating a issue with email inspection in IRONSCALES EU region. (members.eu.ironscales.com), our engineering team is working to resolve the issue.</p>tag:status.ironscales.com,2005:Incident/180986172023-08-09T18:03:51-04:002023-08-09T18:03:51-04:00Access to simulation & training<p><small>Aug <var data-var='date'> 9</var>, <var data-var='time'>18:03</var> EDT</small><br><strong>Resolved</strong> - Problem resolved and simulation and training page is accessible now</p><p><small>Aug <var data-var='date'> 9</var>, <var data-var='time'>16:04</var> EDT</small><br><strong>Investigating</strong> - We are aware of some customers experiencing an issue with accessing the phishing simulation & training page. There are no issues with the phishing simulation & training services, but rather an isolated incident related to accessing the corresponding webpage. Our team is diligently working on addressing this at the earliest and we'll update this status page with additional updates.</p>tag:status.ironscales.com,2005:Incident/178900862023-07-19T12:10:23-04:002023-07-19T12:10:23-04:00MS Teams Protection for IRONSCALES EU<p><small>Jul <var data-var='date'>19</var>, <var data-var='time'>12:10</var> EDT</small><br><strong>Resolved</strong> - Microsoft Teams protection is now fully operational. IRONSCALES will keep monitoring Microsoft API for any additional changes</p><p><small>Jul <var data-var='date'>19</var>, <var data-var='time'>07:28</var> EDT</small><br><strong>Monitoring</strong> - A fix has been deployed to our EU production system and MS Teams protection in the EU environment should be operational, we are monitoring the results and will send follow-up updates.</p><p><small>Jul <var data-var='date'>19</var>, <var data-var='time'>05:23</var> EDT</small><br><strong>Identified</strong> - Our teams have identified the source of the issue and are researching a solution.</p><p><small>Jul <var data-var='date'>18</var>, <var data-var='time'>15:47</var> EDT</small><br><strong>Update</strong> - Our engineers have identified that there is a change within the Microsoft API for Teams which is disabling Teams protection for our EU tenant customers. We are still exploring corrective actions we can take for providing MS Teams protection in the EU environment. North American environment Teams Protection is currently operational. Please expect another update by end of day (EST) July 19.<br /><br />Other services such as Office 365 email protection are not affected at this time.</p><p><small>Jul <var data-var='date'>18</var>, <var data-var='time'>11:09</var> EDT</small><br><strong>Investigating</strong> - Our engineers identified an issue preventing IRONSCALES protection for Microsoft Teams service for IRONSCALES EU Customers.<br />Other services such as Office 365 email protection are not affected.</p>tag:status.ironscales.com,2005:Incident/178825952023-07-17T21:10:54-04:002023-07-18T03:17:52-04:00Office 365 Mitigations Delay<p><small>Jul <var data-var='date'>17</var>, <var data-var='time'>21:10</var> EDT</small><br><strong>Resolved</strong> - The issue has been resolved, our monitors show that Office 365 Mitigations are back to normal timings as of July 18th 1:20AM GMT.</p><p><small>Jul <var data-var='date'>17</var>, <var data-var='time'>19:17</var> EDT</small><br><strong>Monitoring</strong> - Our teams applied a fix to address the Office 365 Mitigation delays and we are monitoring the solution. The backlog of Mitigations is now processed faster, approximate estimation to return to realtime Mitigations is by 5am GMT, July 18th, 2023</p><p><small>Jul <var data-var='date'>17</var>, <var data-var='time'>18:13</var> EDT</small><br><strong>Update</strong> - We are continuing to investigate this issue.</p><p><small>Jul <var data-var='date'>17</var>, <var data-var='time'>17:58</var> EDT</small><br><strong>Investigating</strong> - Investigating - We identified a problem causing considerable delays with Office 365 protection/mitigation due to an internal issue. Detection is still active and incidents are being created. Our teams are working diligently to detect and solve the issue immediately.</p>tag:status.ironscales.com,2005:Incident/174685842023-06-04T05:23:29-04:002023-06-04T05:23:29-04:00Planned maintenance Ironscales US Database upgrade<p><small>Jun <var data-var='date'> 4</var>, <var data-var='time'>05:23</var> EDT</small><br><strong>Resolved</strong> - the database system of Ironscales US has been upgraded successfully.</p><p><small>Jun <var data-var='date'> 4</var>, <var data-var='time'>04:26</var> EDT</small><br><strong>Update</strong> - We are continuing to investigate this issue.</p><p><small>Jun <var data-var='date'> 4</var>, <var data-var='time'>04:08</var> EDT</small><br><strong>Investigating</strong> - As part of our regular updates to our infrastructure we are upgrading our main database system for our US customers using members.ironscales.com to use the latest version, support latest security fixes , and introduce performance enhancements .<br />The Ironscales US platform is expected to have downtime for up to 2 hours.<br />Scan-backs and email inspection would pause and resume after the maintenance is over.</p>tag:status.ironscales.com,2005:Incident/174681772023-06-04T03:28:44-04:002023-06-04T03:28:44-04:00Planned maintenance Ironscales EU Database upgrade<p><small>Jun <var data-var='date'> 4</var>, <var data-var='time'>03:28</var> EDT</small><br><strong>Resolved</strong> - the database system of Ironscales EU has been upgraded successfully.</p><p><small>Jun <var data-var='date'> 4</var>, <var data-var='time'>02:56</var> EDT</small><br><strong>Investigating</strong> - As part of our regular updates to our infrastructure we are upgrading our main database system for our EU customers using members.eu.ironscales.com to use the latest version, support latest security fixes , and introduce performance enhancements .<br />The Ironscales EU platform is expected to have downtime for up to 2 hours.<br />Scan-backs and email inspection would pause and resume after the maintenance is over.</p>tag:status.ironscales.com,2005:Incident/173136632023-05-20T15:17:53-04:002023-05-20T15:18:22-04:00members.ironscales.com site service outage<p><small>May <var data-var='date'>20</var>, <var data-var='time'>15:17</var> EDT</small><br><strong>Resolved</strong> - The DNS issue has been resolved. <br />Our services should be accessible, we have verified it from various global locations to all our endpoints, also mailboxes protection caught up with any communication during the service degradation.<br />If you still experience issues accessing our services please refresh your browser DNS cache, more instructions and examples can be found in the following URL:<br />https://geekflare.com/clear-dns-cache-on-windows-chrome-firefox-and-safari/</p><p><small>May <var data-var='date'>20</var>, <var data-var='time'>14:44</var> EDT</small><br><strong>Update</strong> - Progress update and mitigation : We are currently experiencing problems accessing our services residing under the ironscales.com domain such as www.ironscales.com , members.ironscales.com , and members.eu.ironscales.com due to DNS issues.<br />we have contacted our DNS registrar and fixed the DNS routing issue to our sites, however ,the services might still be unreachable on your side due to DNS caching at your end or the global DNS network .<br />to expedite solution on your end you may clear your browser DNS cache, for example in Google Chrome you can do this by <br />Opening Chrome. In the URL bar, type in chrome://net-internals/#dns: In the left pane, select DNS. In the right pane, tap the Clear host cache button.<br />more instructions and examples can be found in the following URL:<br />https://geekflare.com/clear-dns-cache-on-windows-chrome-firefox-and-safari/</p><p><small>May <var data-var='date'>20</var>, <var data-var='time'>13:51</var> EDT</small><br><strong>Identified</strong> - We are currently working on a fix</p>tag:status.ironscales.com,2005:Incident/167477152023-04-05T04:30:37-04:002023-04-05T04:55:30-04:00Downgraded scanning and incident escalations<p><small>Apr <var data-var='date'> 5</var>, <var data-var='time'>04:30</var> EDT</small><br><strong>Resolved</strong> - A fix was implemented by our team to the affected database tables escalations and scanning should resume as expected.</p><p><small>Apr <var data-var='date'> 4</var>, <var data-var='time'>12:47</var> EDT</small><br><strong>Update</strong> - Our engineering teams have identified the root cause and are in process of applying a solution.</p><p><small>Apr <var data-var='date'> 4</var>, <var data-var='time'>06:30</var> EDT</small><br><strong>Update</strong> - We are continuing to work on a fix for this issue.</p><p><small>Apr <var data-var='date'> 4</var>, <var data-var='time'>06:29</var> EDT</small><br><strong>Update</strong> - We are continuing to work on a fix for this issue.</p><p><small>Apr <var data-var='date'> 4</var>, <var data-var='time'>05:10</var> EDT</small><br><strong>Identified</strong> - since 5:10am EST an issue with one of our database tables is preventing IRONSCALES US system from escalation of incidents that should derive from our scanners. affecting :<br />* escalation (Malware & URL Protection)<br />* auto-resolution (by 3d-party scanners).<br />* processing scan results for new links.<br />This does not apply to AI based escalations that has no issue.<br />Our team has identified the issue and is working on a fix .</p>tag:status.ironscales.com,2005:Incident/159663052023-01-29T06:26:11-05:002023-01-29T06:26:11-05:00Ironscales US planned maintenance<p><small>Jan <var data-var='date'>29</var>, <var data-var='time'>06:26</var> EST</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Jan <var data-var='date'>29</var>, <var data-var='time'>05:03</var> EST</small><br><strong>Update</strong> - planned maintenance is extended, expected to be finished within 40 min.</p><p><small>Jan <var data-var='date'>29</var>, <var data-var='time'>04:00</var> EST</small><br><strong>Update</strong> - We are continuing to investigate this issue.</p><p><small>Jan <var data-var='date'>29</var>, <var data-var='time'>03:53</var> EST</small><br><strong>Investigating</strong> - Ironscales US site is undergoing planned maintenance , expected to be finished approximately by 09:00 GMT</p>tag:status.ironscales.com,2005:Incident/159415242023-01-26T08:34:54-05:002023-01-26T08:34:54-05:00Some of our services in Ironscales US Site [members.ironscales.com] are suffering a partial outage<p><small>Jan <var data-var='date'>26</var>, <var data-var='time'>08:34</var> EST</small><br><strong>Resolved</strong> - the incident has been resolved, realtime email protection is resumed and past backlog is processed.</p><p><small>Jan <var data-var='date'>26</var>, <var data-var='time'>07:38</var> EST</small><br><strong>Update</strong> - We are continuing to work on a fix for this issue.</p><p><small>Jan <var data-var='date'>26</var>, <var data-var='time'>07:38</var> EST</small><br><strong>Identified</strong> - the issue has been identified and is being handled by our staff.</p>tag:status.ironscales.com,2005:Incident/139392532022-11-29T12:58:47-05:002022-12-12T10:48:14-05:00members.ironscales.com site service outage/slowdown<p><small>Nov <var data-var='date'>29</var>, <var data-var='time'>12:58</var> EST</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Nov <var data-var='date'>29</var>, <var data-var='time'>09:51</var> EST</small><br><strong>Monitoring</strong> - A fix has been implemented and we are monitoring the results.</p><p><small>Nov <var data-var='date'>29</var>, <var data-var='time'>09:42</var> EST</small><br><strong>Identified</strong> - The issue has been identified and a fix is being implemented.</p><p><small>Nov <var data-var='date'>29</var>, <var data-var='time'>09:35</var> EST</small><br><strong>Investigating</strong> - We are currently investigating US site members.ironscales.com slowdown and unavailability issue.</p>tag:status.ironscales.com,2005:Incident/120100722022-10-14T04:58:08-04:002022-10-14T04:58:08-04:00EU Site service outage<p><small>Oct <var data-var='date'>14</var>, <var data-var='time'>04:58</var> EDT</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Oct <var data-var='date'>14</var>, <var data-var='time'>04:21</var> EDT</small><br><strong>Identified</strong> - The issue has been identified and a fix is being implemented.</p><p><small>Oct <var data-var='date'>14</var>, <var data-var='time'>04:21</var> EDT</small><br><strong>Investigating</strong> - We are currently investigating a service outage at our EU Site : https://members.eu.ironscales.com/ <br />US site customers are unaffected.<br />IRONSCALES will update with progress as soon as possible.</p>tag:status.ironscales.com,2005:Incident/111542332022-09-16T16:28:43-04:002022-09-16T16:28:43-04:00Automatic incidents not created on GWS<p><small>Sep <var data-var='date'>16</var>, <var data-var='time'>16:28</var> EDT</small><br><strong>Resolved</strong> - This incident has been resolved</p><p><small>Sep <var data-var='date'>16</var>, <var data-var='time'>15:43</var> EDT</small><br><strong>Identified</strong> - The issue has been identified and a fix is being implemented.</p><p><small>Sep <var data-var='date'>16</var>, <var data-var='time'>12:58</var> EDT</small><br><strong>Investigating</strong> - The system is not creating new incidents in GWS but manual reports and classification are working.</p>tag:status.ironscales.com,2005:Incident/108733662022-08-21T05:38:45-04:002022-08-21T05:38:45-04:00Maintenance on IRONSCALES US<p><small>Aug <var data-var='date'>21</var>, <var data-var='time'>05:38</var> EDT</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Aug <var data-var='date'>21</var>, <var data-var='time'>04:05</var> EDT</small><br><strong>Identified</strong> - Our maintenance procedure on IRONSCALES US site is taking longer than expected.<br />Our engineers are working to resolve it.<br />We are extending our maintenance window to 4 hours and expect to finish approximately by 09:00am UTC<br />thank you for your patience.</p>tag:status.ironscales.com,2005:Incident/108230222022-08-21T03:00:27-04:002022-08-21T03:00:27-04:00IRONSCALES maintenance - US region<p><small>Aug <var data-var='date'>21</var>, <var data-var='time'>03:00</var> EDT</small><br><strong>Completed</strong> - The scheduled maintenance has been completed.</p><p><small>Aug <var data-var='date'>21</var>, <var data-var='time'>02:57</var> EDT</small><br><strong>Update</strong> - Our maintenance is taking more time than expected.<br />We are extending our maintenance window to 3 hours and expect to finish by 8am UTC</p><p><small>Aug <var data-var='date'>21</var>, <var data-var='time'>01:01</var> EDT</small><br><strong>In progress</strong> - Scheduled maintenance is currently in progress. We will provide updates as necessary.</p><p><small>Aug <var data-var='date'>14</var>, <var data-var='time'>03:38</var> EDT</small><br><strong>Scheduled</strong> - Please be advised that there will be a scheduled maintenance for the IRONSCALES US region hosted environment on August 21st, 2022 from 05:00 AM to 07:00 AM UTC<br /><br />During the downtime, we will perform important maintenance operations on our servers.<br /><br />Customers connecting to the IRONSCALES EU region will not be affected by the US downtime.<br /><br />Please review the following KB Article for any additional details: https://support.ironscales.com/hc/en-us/articles/5592859496092</p>tag:status.ironscales.com,2005:Incident/107987932022-08-14T02:51:16-04:002022-08-14T02:51:16-04:00IRONSCALES maintenance<p><small>Aug <var data-var='date'>14</var>, <var data-var='time'>02:51</var> EDT</small><br><strong>Completed</strong> - The scheduled maintenance has been completed.</p><p><small>Aug <var data-var='date'>14</var>, <var data-var='time'>02:50</var> EDT</small><br><strong>Update</strong> - Scheduled maintenance for IRONSCALES EU platform has been completed, system is up and running.</p><p><small>Aug <var data-var='date'>14</var>, <var data-var='time'>01:00</var> EDT</small><br><strong>In progress</strong> - Scheduled maintenance is currently in progress. We will provide updates as necessary.</p><p><small>Aug <var data-var='date'>10</var>, <var data-var='time'>13:27</var> EDT</small><br><strong>Scheduled</strong> - Please be advised that there will be a scheduled maintenance for the IRONSCALES EU region hosted environment on August 14th, 2022 from 05:00 AM to 07:00 AM UTC<br /><br />During the downtime, we will perform important maintenance operations on our servers.<br /><br />Customers connecting to the IRONSCALES US region will not be affected by the EU downtime.<br /><br />Please review the following KB Article for any additional details: https://support.ironscales.com/hc/en-us/articles/5592859496092</p>tag:status.ironscales.com,2005:Incident/105694282022-07-13T16:06:19-04:002022-07-13T16:39:27-04:00Dashboard is not available<p><small>Jul <var data-var='date'>13</var>, <var data-var='time'>16:06</var> EDT</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Jul <var data-var='date'>13</var>, <var data-var='time'>15:47</var> EDT</small><br><strong>Monitoring</strong> - A fix has been implemented and we are monitoring the results.</p><p><small>Jul <var data-var='date'>13</var>, <var data-var='time'>14:49</var> EDT</small><br><strong>Identified</strong> - We are investigating an issue with the US site dashboards. Users may report being unable to access the platform.</p>tag:status.ironscales.com,2005:Incident/96779652022-03-31T14:55:42-04:002022-03-31T14:55:52-04:00[US Site] Inspection and Mitigation Delays - Office 365 / Google Workspace<p><small>Mar <var data-var='date'>31</var>, <var data-var='time'>14:55</var> EDT</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Mar <var data-var='date'>31</var>, <var data-var='time'>12:36</var> EDT</small><br><strong>Update</strong> - We are continuing to monitor for any further issues.</p><p><small>Mar <var data-var='date'>31</var>, <var data-var='time'>12:03</var> EDT</small><br><strong>Monitoring</strong> - The US Site Microsoft Office 365 and Google Workspace are running behind, which is causing some delays in the emails' inspection and mitigation.</p>tag:status.ironscales.com,2005:Incident/96595772022-03-28T11:30:00-04:002022-03-29T12:20:08-04:00System Slowness<p><small>Mar <var data-var='date'>28</var>, <var data-var='time'>11:30</var> EDT</small><br><strong>Resolved</strong> - Some customers may experience system slowness which can be experienced in the IRONSCALES dashboards and inspection response for Office 365 and Google Workspace.</p>tag:status.ironscales.com,2005:Incident/93266462022-02-15T16:07:29-05:002022-02-15T16:07:29-05:00US dashboard is not available<p><small>Feb <var data-var='date'>15</var>, <var data-var='time'>16:07</var> EST</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Feb <var data-var='date'>15</var>, <var data-var='time'>16:00</var> EST</small><br><strong>Update</strong> - We are continuing to monitor for any further issues.</p><p><small>Feb <var data-var='date'>15</var>, <var data-var='time'>15:59</var> EST</small><br><strong>Monitoring</strong> - A fix has been implemented and we are monitoring the results.</p><p><small>Feb <var data-var='date'>15</var>, <var data-var='time'>15:33</var> EST</small><br><strong>Investigating</strong> - We are investigating an issue with the US site dashboards. Users may report being unable to access the platform.</p>tag:status.ironscales.com,2005:Incident/88549382021-12-15T10:55:40-05:002021-12-15T11:10:53-05:00US Site may not be available for some customers<p><small>Dec <var data-var='date'>15</var>, <var data-var='time'>10:55</var> EST</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Dec <var data-var='date'>15</var>, <var data-var='time'>10:40</var> EST</small><br><strong>Update</strong> - We are continuing to investigate this issue.</p><p><small>Dec <var data-var='date'>15</var>, <var data-var='time'>10:39</var> EST</small><br><strong>Investigating</strong> - We are investigating an issue with the US site dashboards. Users may report being unable to access the platform.</p>