Recent maintenance on website

1235715

Comments

  • ABM
    ABM Forum Participant Posts: 14,578
    1000 Comments
    edited June 2020 #122

    Don't say such things, Roger  sealed.  I've been suffering from a poorly PC for a fortnight or more, just got my nice shiny new hard drive fitted  and came in here hoping to find all my previous problems had been cured  !! Straight in to find its still as slow as a three legged Gerry-hattrick tortoise and littered with  " server errors "  --  .  To think I thort it was me poorly, oft abused Tower unit,  must go and take it a new duster as an apology !!

      Love to All  kiss

  • Justin Bricknell
    Justin Bricknell Forum Participant Posts: 32
    First Comment
    edited June 2020 #123

    Hi all 

    Apologies for the continuing site performance issues. 

    Several fixes have been attempted over the past few days and the technical teams (at CAMC and three of our external partners) have been working round the clock to try and fix the current issues. 

    The resource fix mentioned the other day has resolved the issue of the web database server running at 100% CPU but there are still other issues to address.

    Two fixes are being implemented today. One of those has gone in already, although you won't see a material difference in front end performance with this fix alone. The second of these fixes is currently being tested and promoted through our non-production environments before hopefully being promoted to the live production website later today. 

    I will respond later to some of the individual points made by CT users over the past few days. In the meantime, I can assure that the ongoing web performance issues are being treated as our No.1 priority at the moment and all available resources are working on it.

    Kind regards

    Justin

     

  • Wherenext
    Wherenext Club Member Posts: 10,586 ✭✭✭
    5,000 Likes 1000 Comments Name Dropper
    edited June 2020 #124

    Cheers Justin.👏

  • MichaelT
    MichaelT Forum Participant Posts: 1,874
    1000 Comments
    edited June 2020 #125

    I tried logging out and you are right no server errors, gone and blown it now as I had to log in to create this postsmile

  • JVB66
    JVB66 Forum Participant Posts: 22,892
    1000 Comments
    edited June 2020 #126

    I am continuously getting Page unresponsive box which after several attepts with the wait button may  work or more likly go to internal server error ,which is what has been  happening since last week ,so what ever is being done the CT website is is not agreeing with any of the fixessurprised

  • Tinwheeler
    Tinwheeler Forum Participant Posts: 23,135 ✭✭✭
    10,000 Likes 1000 Comments Name Dropper
    edited June 2020 #127

    + 1 👍🏻👏🏻

  • papgeno
    papgeno Forum Participant Posts: 2,158
    1000 Comments
    edited June 2020 #128

    Thanks Justin not that I understood much of what you said.

  • huskydog
    huskydog Club Member Posts: 5,460 ✭✭✭✭✭
    1000 Comments
    edited June 2020 #129

    I have to report that for me ,it’s no better , keep getting server error, but it all adds the fun of CT 

  • Justin Bricknell
    Justin Bricknell Forum Participant Posts: 32
    First Comment
    edited June 2020 #130

    Ok, so as promised, here are some responses to a few of the recent posts in this thread....

    JBV66 - "Why is it it seems the rest of the club sites are working as normal? but it is as it seems , always CT that has this really long term issues?"

    The current web performance issues are affecting all areas of the site. We are seeing slow page load speeds and Internal Server Errors across the site, not just CT. 

    David Klyne - "I suppose you would expect to keeping booking side of website going over the Club Forum? I could be way off here but I wonder if the problem is that Club Together is constantly being updated by member posts. "

    As with any business, the ability to sell products/services will be seen as a priority, I guess... but we have declared Major Incidents internally based on issues that are related only (or mostly) to Club Together, so we do take CT issues seriously. You make a valid point with the constant updating of posts in CT. Each one of these replies has to be written back to the database and then indexed, and some of the issues in the past month have certainly been index related. This current issue appears to be more to do with the way the caching is configured on the site.

    Peedee - "I think CT and the main web site run on different servers and it sounds like the CT one is underfunded????? It could also be a problem with communicating between servers????"

    No, everything you see on the website as a user is served up by the same web app servers. There are parts of the site that are handled by different code but fundamentally it all sits on the same infrastructure.

    Cyberyacht - "There you have it. It's under-resourced. CT is the poor relation"

    As above, this is not correct.

    Bakers2 - "More essential maintenance last night. So much 'essential' maintenance???"

    Unfortunately, there is at the moment as we continue to try and fix the current issues. We've had several short-lead time/emergency outages to try and implement potential fixes. 

    Timwheeler - "I know nuffin but it seems logical to me that 'What are you all up to' is so huge it might make sense to bin it and start afresh to save storage space."

    We don't actually have any particular space issues. I agree that some of the threads do seem very lengthy and probably hold info that is no longer relevant but that's just my personal opinion. I'm not the person responsible for maintaining the website, or even CT. 

    Metheven - "First time ever I have been held in a queue online when looking at available site bookings"

    The queuing system is always running in the background. A user will only actually be put into a queue when there are >45 transactions per second on the website. This morning, that threshold was reduced to help with load/performance.

    MichaelT - "more server errors than actual pages, they may as well take the site of line till they can afford to fix it properly"

    It's not a question of cost, it's more to do with finding the root cause of the current issues. Many log files have been analysed over the past few days, each with thousands and thousands of entries in them. Even with many technical teams looking at these logs, it's a time consuming process. Fixes are attempted to address these issues but they don't always fix the underlying issue and the process starts again.

     

     

    I hope the above is useful in answering at least some of the questions/comments posed recently. 

    I'm going back on the next technical call now, so won't be able to reply for a few hours if there are any responses/further questions.

    Justin

     

     

  • Tinwheeler
    Tinwheeler Forum Participant Posts: 23,135 ✭✭✭
    10,000 Likes 1000 Comments Name Dropper
    edited June 2020 #131

    Thanks, Justin.

    Do you ever sleep? 🙂

  • Cornersteady
    Cornersteady Club Member Posts: 14,425 ✭✭✭
    5,000 Likes 1000 Comments Name Dropper Photogenic
    edited June 2020 #132

    I'm still getting server errors and each page takes quite a while to load, not worth posting atm

  • Tinwheeler
    Tinwheeler Forum Participant Posts: 23,135 ✭✭✭
    10,000 Likes 1000 Comments Name Dropper
    edited June 2020 #133

    Me, too, Corners. Every now and then I get in by a fluke, I think.

  • CJDM
    CJDM Forum Participant Posts: 129
    100 Comments
    edited June 2020 #134

    Justin, many thanks for the feedback.  As you pointed out, there are quite a lot of very lengthy posts, not least the 'What are you all up to' thread with 36500 replies.  Surely the whole history for this post isn't needed? Can the oldest 36000 be Deleted User?  If not, and it does have a system impact then I would suggest deleting it. 

    I know that when the system constantly malfunctions the pressure on the techies to get it fixed is immense.  Pressure can lead to rushed changes and version release without the ideal testing cycles being completed.  We need to be patient with Justin and the team and hopefully we will get back to 'normal'.  I guess that in a worse case scenario the techies will have to restore the system back to a safe point, but this might mean losing ALL updates/bookings after that point.

  • Justin Bricknell
    Justin Bricknell Forum Participant Posts: 32
    First Comment
    edited June 2020 #135

    Just to clarify , the main fix hasn't yet gone live today. It's currently being tested on our non-production environments, with a view to promoting the fix to the live website later this evening.

     

  • Tinwheeler
    Tinwheeler Forum Participant Posts: 23,135 ✭✭✭
    10,000 Likes 1000 Comments Name Dropper
    edited June 2020 #136

    EB, Justin responded to my point about deleting lengthy threads earlier. 

  • EmilysDad
    EmilysDad Forum Participant Posts: 8,973
    1000 Comments
    edited June 2020 #137

    Soooo painfully sloooow!

  • CJDM
    CJDM Forum Participant Posts: 129
    100 Comments
    edited June 2020 #138

    Whoops! Thanks, TW. I have missed much of the last few days, not least because of the current issues.

  • Oneputt
    Oneputt Club Member Posts: 9,144 ✭✭✭
    2,500 Likes 1000 Comments
    edited June 2020 #139

    Been looking back 3.5 years at the optimism expressed in the revised website.  That optimism quickly disappeared as we found reviews lost, stories Deleted User and retained stories with other folks photos attached, threads gone AWOL.  All these years later little has changed, it's taken me nearly 2 hours to post this 

  • nelliethehooker
    nelliethehooker Club Member Posts: 13,636
    1000 Comments Name Dropper
    edited June 2020 #140

    I know the feeling, brue, I've given up trying to post in the UK campsite section because of repeated server error notices.

  • nelliethehooker
    nelliethehooker Club Member Posts: 13,636
    1000 Comments Name Dropper
    edited June 2020 #141

    I know the feeling brue, as I've given up posting in the UK Sites section because of repeated server errors. This is at least the 4th go I've had at getting this message to post.

  • Tinwheeler
    Tinwheeler Forum Participant Posts: 23,135 ✭✭✭
    10,000 Likes 1000 Comments Name Dropper
    edited June 2020 #142

    Life's too short, One. Move on. 🤘

  • nelliethehooker
    nelliethehooker Club Member Posts: 13,636
    1000 Comments Name Dropper
    edited June 2020 #143

    Just like buses, no joy for ages then 2 come along at the same time!!

  • SteveL
    SteveL Club Member Posts: 12,299 ✭✭✭
    5,000 Likes 1000 Comments
    edited June 2020 #144

    It is really almost impossible to do anything. Just by chance I seem to have got in this time. I have tried periodically this evening and every time got a server error. Hopefully the fix this evening will work and be more permanent than the previous try's,🤞

  • huskydog
    huskydog Club Member Posts: 5,460 ✭✭✭✭✭
    1000 Comments
    edited June 2020 #145

    Well ,they’ve had three and a half years trying to get it to work ,so I’m not holding my breath surprised

  • BrianJosie
    BrianJosie Forum Participant Posts: 391
    100 Comments
    edited June 2020 #146

     My word it’s much worst tonight 😡 server error comes up on almost everything you try and do , and still painfully slow. Surely the CAMC have someone in their IT dept that can sort out the problem or is that expecting to much 🤔🙄

    Brian & Jo

  • redface
    redface Forum Participant Posts: 1,701
    1000 Comments
    edited June 2020 #147

     Last night I ended up asking the  Q&A chappie, on a new help page, what was going on.

    I think he more or less suggested that the site was under improvement.

    We will see!

    Seems to be more normal today.

  • Tinwheeler
    Tinwheeler Forum Participant Posts: 23,135 ✭✭✭
    10,000 Likes 1000 Comments Name Dropper
    edited June 2020 #148

    Have you not read Justin's posts, BJ?

    I think the guy deserves better than that.

  • EmilysDad
    EmilysDad Forum Participant Posts: 8,973
    1000 Comments
    edited June 2020 #149

    Why? They've had years to sort it ... and they've not!

  • Tinwheeler
    Tinwheeler Forum Participant Posts: 23,135 ✭✭✭
    10,000 Likes 1000 Comments Name Dropper
    edited June 2020 #150

    Well, it actually seems to be working so maybe they have 🤞🤞🤞🤞

  • brue
    brue Forum Participant Posts: 21,176 ✭✭✭✭✭
    1000 Comments
    edited June 2020 #151

    OH no it isn't. I'm getting lots of server errors.