What you'll do:

• Design, implementation, and improvement of processes & automation of Data infrastructure
• Tuning of Data pipelines for reliability & performance
• Building tools and scripts to develop, monitor, troubleshoot ETL’s
• Perform scalability, latency, and availability tests on a regular basis.
• Perform code reviews and QA data imported by various processes.
• Investigate, analyze, correct and document reported data defects.
• Create and maintain technical specification documentation.

• Min. 4 years of Professional work Experience, with 1-2 years of hands-on experience with Databricks
• Highly proficient in SQL & Data model (conceptual and logical) concepts
• Proficient in Python & Spark
• Knowledge of Distributed computing and cloud databases like Redshift, Big query etc.
• 1+ years of Hands-on experience with one of the top cloud platforms - AWS/GCP/Azure.
• Experience with Modern Data stack tools like Airflow, Terraform, dbt, Glue, Dataproc etc.
• Exposure to Hadoop & Shell scripting a plus