Skip to content

Commit

Permalink
added a cicd
Browse files Browse the repository at this point in the history
  • Loading branch information
sahi-oro committed Sep 7, 2024
1 parent 6a67c22 commit 0c59643
Showing 1 changed file with 71 additions and 0 deletions.
71 changes: 71 additions & 0 deletions .github/workflows/s.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,71 @@
name: S3 and Drive CI/CD Pipeline
on:
push:
branches:
- feat/drive-to-s3
jobs:
run-pipeline:
runs-on: ubuntu-latest
steps:
- name: Checkout code
uses: actions/checkout@v2

- name: Print AWS Key (for debugging only)
run: echo "AWS_ACCESS_KEY_ID=${{ secrets.AWS_ACCESS_KEY_ID }}"

- name: Install AWS CLI, unzip, wget, and gdown
run: |
sudo apt-get update
sudo apt-get install awscli unzip wget
pip install gdown
- name: Configure AWS credentials manually
run: |
aws configure set aws_access_key_id "${{ secrets.AWS_ACCESS_KEY_ID }}"
aws configure set aws_secret_access_key "${{ secrets.AWS_SECRET_ACCESS_KEY }}"
aws configure set region ap-south-1
- name: Rename folder in S3 to backup
run: |
aws s3 mv s3://isac-nitkkr-public/isaac-s3-images/ s3://isac-nitkkr-public/isaac-s3-images-bkp/ --recursive
env:
AWS_REGION: ap-south-1

- name: Upload cookies.txt
uses: actions/upload-artifact@v3
with:
name: cookies
path: ~/.cache/gdown/cookies.txt

- name: Download File from Google Drive using gdown
run: |
gdown --id 1YLdE1YjT1qSU8ank-ZVhYs5cl0jQohS8 -O /tmp/file.zip
- name: Verify File Download
run: |
file /tmp/file.zip
ls -l /tmp/
- name: Unzip downloaded file
run: |
if file /tmp/file.zip | grep -q 'Zip archive data'; then
unzip /tmp/file.zip -d /tmp/unzipped_files
else
echo "File is not a ZIP archive"
exit 1
fi
- name: Upload unzipped files to S3
run: |
aws s3 cp /tmp/unzipped_files/ s3://isac-nitkkr-public/isaac-s3-images/ --recursive
env:
AWS_REGION: ap-south-1

- name: Delete backup folder from S3 if all tasks pass
if: ${{ success() }}
run: |
aws s3 rm s3://isac-nitkkr-public/isaac-s3-images-bkp/ --recursive
env:
AWS_REGION: ap-south-1


0 comments on commit 0c59643

Please sign in to comment.