Arun

  • Home
  • About
  • Resume
  • Portfolio
  • Skills and Tools
  • Languages
  • Awards
  • Professional Certification
  • Publications

Data Engineering

  1. Portfolio section
  2. Home
  • Cloud
  • AWS-GCP
  • AWS S3
  • EC2
  • Docker
  • Jupyter-nifi
  • Snowflake
  • Data modeling
  • QL
  • SQL
  • Bigquerry
  • SCD
  • SQL project

Data ETL projects

Data Engineering

Spotify ETL Project on AWS

Spotify ETL Project on Snowflake

Real-Time Streaming with Apache Nifi and AWS

Job Market : Data Engineering

Data Engineering projects

APIs and FastApi

Flask

Docker containerization

System design

Linux systems

Web Scrapping

NoSQL & MongoDB

Neo4j & Graph theory

Elasticsearch

Hadoop®

Apache Spark

Scala Spark

Apache Kafka

Streamlit: python applications

Other projects

Software devlopment and testing

Unit Testing : pytest

CI/CD pipelines & Jenkins

Pyspark

Pyspark LinearRegression

Pyspark ML Pipeline

Shell Scripting

© Copyright Arun