What you'll do

• Design, implementation, and improvement of processes & automation of Data infrastructure

• Tuning of Data pipelines for reliability & performance

• Building tools and scripts to develop, monitor, troubleshoot ETL's

• Perform scalability, latency, and availability tests on a regular basis

• - Perform code reviews and QA data imported by various processes.

• Investigate, analyze, correct and document reported data defects.

• Create and maintain technical specification documentation.

What makes you a great fit

• B.Tech/BS degree in Computer Science, Computer Engineering, Statistics, or other Engineering disciplines

• Min. 3 years of Professional work Experience, with 2+ years of hands-on experience with Databricks

• Highly proficient in SQL & Data model (conceptual and logical) concepts

• Proficiency with Python & Spark (2+ year)

• Knowledge of Distributed computing and cloud databases like Redshift, Big query etc.

• 1+ years of Hands-on experience with one of the top cloud platforms - AWS/GCP/Azure.

• Experience with Modern Data stack tools like Airflow, Terraform, dbt, Glue, Dataproc etc.

• Exposure to Hadoop & Shell scripting a plus