Hello! I'm a well rounded Data Engineer and Business Intelligence Developer from the United Kingdom, with a strong focus on real-time and batch data processing, full stack development, database administration, and building efficient data pipelines. I specialize in transforming raw data into actionable insights through the development of robust and efficient data pipelines, engaging web applications, and comprehensive dashboards for data visualization.
Since the age of 10, I have gained a background in IT, data engineering, web/software development and data analytics. My expertise includes creating sophisticated data processing scripts and pipelines, developing both frontend and backend web applications, and implementing advanced scripting and automation. I am also adept at designing advanced dashboards that offer deep insights and clear visualizations. I am dedicated to delivering high-quality, scalable solutions and continuously exploring innovative ways to leverage data. I am very sophisticated in my approaches relevant to anything IT, focusing on efficiency and unlocking true potential from systems with my indepth knowledge and eagerness to learn new tech. I am also a heavy supporter of documentation.
I have worked in, or have been heavily exposed in to the following industries:
A real time CDC Data Replication process written in
to speedup data replication from traditional OLTP databases to a ClickHouse Data Warehouse.
View it here
A real time web page classification and threat analysis application built with
and
View it here
A data warehouse schema creation tool powered by AI and
to quickly create data structures using your databases Information schema & Google's
View it here
A business website generator with full backend control, completely databaseless written in
to speedup creation of a website using pure PHP and JSON. Including themes, SEO and content control
View it here
A secure single note sharing application written in Python (flask)
to help share sensitive one time note data, allowing you to skip out on 3rd party solutions and avoid compromise.
View it here
Data Engineering, Frontend+Backend Web Development, API Development, ETL Development, Data Services, Business Intelligence, Data Warehousing, Database Administration, DB Backup/Restore Data Analytics, Dashboarding, Reporting, Query Writing/Optimisation, Stored Procedure/Function Development, Web Scraping, Data Collection, Data Cleansing, Automation, Monitor/Alert Development, Generative AI Development, IoT Development (Cameras Data), Excel Macros/Google Apps Script