Service issue, April 4th, 2012

[JYU]

Service is back now.

[JYU]

It was back normal for a minute, and down again.

[j8d7o03]

Got dial tone on one of two lines, still unable to make calls. Hopefully this will be fixed sometime today.

[seagame2001]

It was up and down right now. Working for a bit then it's stopped

[nirajshah7]

still down in Scarborough M1P xxx

[FONGO_steve]

We have posted an announcement which our team will update as it's easier for us to send updates that way than posting in several threads.

To answer some concerns earlier in the post - this absolutely will be fixed ASAP. We have all hands on deck in several offices working towards a resolution.

[TheHardy]

The up and down nature of it suggests to me that it is a SERVER side issue, and it pops back up when a new server is fired up and takes the load -- but, as there is probably another issue, that server soon goes down again ...

As Steve posted here, and also in the update thread, I am POSITIVE that NOW that they KNOW about the issue, they are working to resolve it.

I think that in defense of FPL, I also need to point out that while DV/FPL are free-services (except the LD part), Fibernetics is the provider on which DV/FPL run -- and Fibernetics is a full-fledged CLEC -- meaning that they have the same infrastructure as Telus and Bell -- and Fibernetics is a PAID service provider. They take keeping their network up and running very seriously, so don't be mislead to think that because Fongo/FPL/DV is free that it is ignored.

The only downfall so far is the fact that REPORTING the outtage seems to be an issue, but that is moot for now, as they ARE dealing with the problem!

[kslay]

Working for me in Scarborough/Toronto now.

[OttawaGuy]

Working in Ottawa, too!

[lifeisfun]

Working in Ottawa

[TheHardy]

FPL account up and down, same with secondary DV account (same prefix) although the DV seems to be more robust ATM.

Anything from server login errors with the PC softphone app, to not registering once it is OPEN (error connecting to server), to failed calls -- getting a ringback tone, or just dead air and the call not completing.

Of course, on the positive side, some successful calls (all local Vancouver-ish #s).

Totally seems hit and miss right now, they must be trying a few solutions ...

[kslay]

FPL account up and down, same with secondary DV account (same prefix) although the DV seems to be more robust ATM.

Anything from server login errors with the PC softphone app, to not registering once it is OPEN (error connecting to server), to failed calls -- getting a ringback tone, or just dead air and the call not completing.

Of course, on the positive side, some successful calls (all local Vancouver-ish #s).

Totally seems hit and miss right now, they must be trying a few solutions ...

Yeah I agree with you. Same issue here, I thought it was working but it seems to be a hit and miss ATM. All I can say is keep at it team Fongo.

[fab]

Working in Gatineau,

Thanks again for this great product..!

[hlq216]

Toronto too
My Voip device is SPA1001. I set Whistle Phone as second phone line. I can still talk to people who use Whistle phone.

[seagame2001]

FPL was working and now down again

[kslay]

I got a call from Toll Free Serv 888-847-0148 at 3:35 pm eastern. I didn't pick up since I was recording a video for YouTube. No message was left. However it seems to be working now I tried making a few calls after that phone call came in. I'm guessing that was from Fongo?

[mysaurin]

Dell Voice is working fine....

[yys2000]

Working in Newmarket now.

[VoipDiy]

At 3:30 PM MST my phone finally started working again - 1st time since early this morning.
Now, at 4:30 PM MST, it is not working again. Registration appears to be intermittant... it's on... it's not.... it's on.... it's not....

[marginal]

How likely is that this problem will happen again FONGO_steve?

Thanks.

[FONGO_steve]

How likely is that this problem will happen again FONGO_steve?

Thanks.

Our team will post a formal announcement later today with a summary of the issues.

Downtime is never acceptable and we will be evaluating everything that happened to ensure measures are put in place so it doesn't happen again.

[TheHardy]

How likely is that this problem will happen again FONGO_steve?

ANY outtage? Highly likely -- nothing is bulletproof. This specific outtage? I think the learning curve might have been steep and caught them on an OFF-day, but from all I have seen in the months I have been here, they will learn from it and also modify their internal procedures.

As Steve posted, they need to assess what all went wrong, and will hopefully let us know. I am fairly sure that there was more than one issue -- even when it was kicking to backup servers, we had service that went up and down and then up and down again -- sort of like a cascading failure. So, IMHO, a quick non-technical read from my end would be that the backup DID kick in, either manually or automatically, and then failed again ...

Even POTS lines are not immune to failures.

[TheHardy]

Our team will post a formal announcement later today with a summary of the issues.

Downtime is never acceptable and we will be evaluating everything that happened to ensure measures are put in place so it doesn't happen again.

I look forward to seeing how close our arm-chair quarterback assessments were to the actual scenario.

Glad to hear that the official company line is that changes are afoot to prevent this.

While it may not be entirely practical, perhaps isolating the websites from the working servers that handle the VOIP traffic will ensure up-time on the website? I was happy to see that the forums remained online as a source of information at least (albeit sketchy and sparse).

Again, thanks Steve for your commitment to the forums and keeping us as up to speed as you can (and also to the behind-the-scenes team that played with duct-tape, tin cans, twine and superglue yesterday to put things back together!)

[marginal]

Thank you both for the replies.
So far I can tell for sure two things.
1. Good, that it happened on a sunday.
2. So far so good with FPL, I have had paid telephone lines that were much more prone to have service interruptions.

Thanks again to all the people who work so hard in order to supply (almost) free telephone lines to all of us who want to have them.

[FONGO_mike]

http://forum.fongo.com/viewtopic.php?f=11&t=4796