Skip to content
View cqllum's full-sized avatar
🔦
🔦
  • United Kingdom

Block or report cqllum

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Please don't include any personal information such as legal names or email addresses. Maximum 100 characters, markdown supported. This note will be visible to only you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
cqllum/README.md

Hi there 👋

🚀 About Me

Hello! I'm a well rounded Data Engineer and Business Intelligence Developer from the United Kingdom, with a strong focus on real-time and batch data processing, full stack development, database administration, and building efficient data pipelines. I specialize in transforming raw data into actionable insights through the development of robust and efficient data pipelines, engaging web applications, and comprehensive dashboards for data visualization.

🎨 My Background

Since the age of 10, I have gained a background in IT, data engineering, web/software development and data analytics. My expertise includes creating sophisticated data processing scripts and pipelines, developing both frontend and backend web applications, and implementing advanced scripting and automation. I am also adept at designing advanced dashboards that offer deep insights and clear visualizations. I am dedicated to delivering high-quality, scalable solutions and continuously exploring innovative ways to leverage data. I am very sophisticated in my approaches relevant to anything IT, focusing on efficiency and unlocking true potential from systems with my indepth knowledge and eagerness to learn new tech. I am also a heavy supporter of documentation.

💡 Industry Exposure

I have worked in, or have been heavily exposed in to the following industries:

  • Gambling (iGaming), Ecommerce, Warehousing and Logistics, Cyber Security, Cloud Hosting, SaaS, Insurance, Construction, Telecommunications

  • 🦾 What am I currently working on?

    A real time CDC Data Replication process written in to speedup data replication from traditional OLTP databases to a ClickHouse Data Warehouse.

    View it here


    🖊️ Some things I've made

    A real time web page classification and threat analysis application built with and
    View it here

    A data warehouse schema creation tool powered by AI and to quickly create data structures using your databases Information schema & Google's
    View it here

    A business website generator with full backend control, completely databaseless written in to speedup creation of a website using pure PHP and JSON. Including themes, SEO and content control
    View it here

    A secure single note sharing application written in Python (flask) to help share sensitive one time note data, allowing you to skip out on 3rd party solutions and avoid compromise.
    View it here


    💻 Technical Skillset

    Take a look below and learn a bit more about my skillset

    🔑 Key Skills Overview

    Data Engineering, Frontend+Backend Web Development, API Development, ETL Development, Data Services, Business Intelligence, Data Warehousing, Database Administration, DB Backup/Restore Data Analytics, Dashboarding, Reporting, Query Writing/Optimisation, Stored Procedure/Function Development, Web Scraping, Data Collection, Data Cleansing, Automation, Monitor/Alert Development, Generative AI Development, IoT Development (Cameras Data), Excel Macros/Google Apps Script

    👨‍💻 Programming

    SQL Python PHP Javascript Flask Django jQuery HTML5 CSS3 Bootstrap Bash PowerShell Java React Go Perl Lua C# R Google Apps Script GraphQL Markdown LaTeX Jinja JSON

    💿 Database - SQL/NoSQL - (OLTP/OLAP)

    Postgres MicrosoftSQLServer MySQL Mariadb SQLite Oracle ClickHouse Singlestore BigQuery Redis MongoDB ElasticSearch InfluxDB

    🏃 Data Pipelines / Processing (ETL)

    Apache Kafka Apache Spark Apache Airflow Zookeeper Mirrormaker Selenium Chromedriver Pandas NumPy SciPy Scikit Learn OpenCV Tensorflow dbt Airbyte Seaborn Matplotlib NLTK

    📊 Business Intelligence (BI) + Monitoring

    Looker PowerBi Tableau Metabase Grafana DataDog Excel Amazon Quicksight Jaspersoft Studio

    ☁️ Cloud

    Google Cloud AWS Azure DigitalOcean OVH IONOS Vultr Vercel

    🎫 OS Exposure

    Windows iOS MacOS Ubuntu Debian CentOs Rocky Linux Red Hat ChromeOS Android

    🧉 Virtualisation

    Proxmox VMWare VirtualBox HyperV Nutanix Docker Kubernetes Qemu

    🤖 AI

    ChatGPT Google Gemini Copilot

    🕒 Version Control

    Git GitHub GitLab

    🤝 Collaboration

    Jira Asana Manage Engine SD+ Monday Microsoft Teams Miro Slack Badge Skype

    🛠️ Other

    NGINX Apache2 Lightspeed Linux Microsoft Office Libre Office Cloudflare Heroku Vim Adobe Adobe Photoshop Gimp Adobe XD Figma Adobe Illustrator

    Pinned Loading

    1. db2ch db2ch Public

      ⚡Replicate your Database to Clickhouse in real time without Debezium, Kafka, or Clickhouse Materialized Engines

      Go 3

    2. php-website-generator php-website-generator Public

      PHP Business website generator - Databaseless

      CSS

    3. schema2dwh schema2dwh Public

      ⚡ Automatically produce a data model on your database using its information schema using GenAI.

      Python 1

    4. private-note private-note Public

      Python Flask & SQLite based Localised Private note sharing application. Secure business data. Skip the third parties.

      HTML 1