Dorkinians Website V3

Building on the foundations of the previous Dorkinians Website, the new site aims to provide deeper analysis of the available stats and clearer display across player, team and club statistics.

Serving over 600 players, it is built as a PWA, allowing a more native experience with a chatbot key feature for users to ask questions to.

The app provides a far more detailed analysis of the club's stats, built upon a graph database using Neo4j.

One of the lessons learned was learning how to deal with Netlify's 30 second timeout limit for functions, where my initial script was timing out on every run. Splitting the database seeding code out into Heroku and optimising the script run time was sufficient to get the script up working remotely with email notifications and job id tracking for status updates. I learned how to test and check memory build ups to avoid crashes within the Heroku limit I was working within and set up an Admin dashboard within the site for job monitoring and triggering.

I also learned how to set up a PWA to work across iOS and Android mobile devices and feel like a native app, whilst working on desktop as well.

To make the chat bot work, I utilised test driven development, defining the tests for questions and answers expected and then developing the chat bot logic from that.

For the table data, I discovered the FA Site to have a very good bot detection system but an awful API for developers to use and so automating the data updates was a pain point I had to use an external ScraperAPI service for.

In the frontend, I was able to implement skeleton loaders and optimise data fetching orders to prioritise important visible data to users to make the app feel fast and efficient.

After completing development, I learned how to set up E2E testing for both mobile and desktop versions of the app using Playwright, automating a weekly test through GitHub Actions. Setting up the tests after the majority of development was also a lesson learned that I will take into my next project to write the tests before I start coding.