bigshyft
PPluralsight
Pluralsight
Data Engineer 3
Acquired
Start-up
1001-5000 employees
6y - 9y

(Competitive pay)

Bengaluru/ Bangalore
SQL, Kafka, Python, Databricks, Scala

Role

Company

Job Description

What you’ll do:

  • Contribute to Data Warehouse models and curation
  • Support the evolution of data environment to deliver high-quality data, speed, and availability
  • Assist in the curation of source-system data to deliver trusted data sets
  • Provide input and involvement on data cataloging and data management efforts
  • Be involved in production ELT (Extract, Load, Transform)performance tuning and environment-level resource consumption and management
  • Drive the migration of POC pipelines to production data processes
  • Design , Build, Test and Maintain efficient and reliable data pipelines.


What makes you a great fit:

  • A minimum of 6+ Years of IT Experience in computer science, engineering, data science or similar fields
  • Experience in SQL development on RDBMS (Snowflake and Postgres preferred)
  • Familiarity with Database design and data warehouse concepts
  • Experience with streaming & real-time data processing using a technology like Spark, Kafka, ksqlDB, or Databricks, etc.
  • Experience with dimensional data modeling/data workflow diagrams (conceptual, logical, and physical)
  • Knowledge of software development lifecycle and source control (github, gitlab, TeamCity, etc.)
  • Solid understanding of ELT (Extract, Load, Transform) pipeline development and orchestration (dbt, airflow, python, Fivetran, Stitch, etc.) and how to deploy them
  • Some knowledge of cloud services such as AWS DynamoDB, Glue, Lambda, Step Functions, S3, CloudFormation or similar Azure/ GCP services
  • Strong programming skills in Python, Scala or SQL (Python or Scala is added advantage)
  • Experience in any Data streaming Tool like Spark, Data bricks tool is preferred.
  • Capability to manipulate, understand, and analyze complex, high-volume data
  • Understanding of how and why data pipelines are built
All about us
Pluralsight

Hi there! We’re advancing the world’s technology workforce. And we're here to give you and your tech teams the skills and insights to thrive.

Employee count
1001-5000 employees
Employment Type
Full Time Job
Company Type
Start-up
Headquarters
Utah, United States

Apply to Similar Jobs

  • DDigit88
    Digit88
    Data Engineer
    Unfunded
    Start-up
    51-200 employees
    4y - 7y
    ₹25 - ₹45 LPA
    Remote/ Work from Home, Bengaluru/ Bangalore, Pune
    Scala, Kafka, Spark, AWS, SQL
  • CCloudside Technologies
    Cloudside Technologies
    Data Engineer
    Unfunded
    Start-up
    51-200 employees
    5y - 8y
    ₹15 - ₹25 LPA
    Bengaluru/ Bangalore
    Python, Spark, Scala, SQL, ETL
  • RRED.Health
    RED.Health
    Data Engineer
    Series A
    Start-up
    201-500 employees
    3y - 7y
    ₹15 - ₹30 LPA
    Bengaluru/ Bangalore
    Python, Scala, AWS, Hadoop, SQL
  • LLufthansa Technik
    Lufthansa Technik
    Data Engineer
    201-500 employees
    Private
    4y - 8y

    Competitive pay

    Bengaluru/ Bangalore
    Python, SQL, Flask, ETL, Azure
  • MMoback Technologies
    Moback Technologies
    Data Engineer
    Seed
    Start-up
    51-200 employees
    5y - 10y
    ₹15 - ₹30 LPA
    Bengaluru/ Bangalore
    Python, Azure, SQL, ETL