bigshyft
SSequoia
Sequoia
Lead Data Engineer
Unfunded
Start-up
501-1000 employees
8y - 11y
₹50 - ₹70 LPA
Bengaluru/ Bangalore
AWS, ETL, Data Warehousing, Data Modelling

Role

Company

Job Description

What you'll do:

  • Design and develop data-ingestion frameworks, real-time processing solutions, and data processing and transformation frameworks.
  • Deploy and provide support for application codes and analytical models.
  • Provide senior-level technical consulting to peer data engineers during design and development for highly complex and critical data projects.
  • Create and enhance data enable seamless integration and flow across the data ecosystem.
  • Provide business analysis and develop ETL code and scripting to meet all technical specifications and business requirements according to the established designs.
  • Develop real-time data ingestion and stream-analytic solutions leveraging technologies such as Kafka, Apache Spark, Python and AWS-based solutions.
  • Utilize multiple development languages/tools such as Python, SPARK, Hive, Java to build prototypes and evaluate results for effectiveness and feasibility.
  • Contribute to determining programming approach, tools, and techniques that best meet the business requirements.
  • Provide subject matter expertise in the analysis, preparation of specifications and plans for the development of data processes.
  • Operationalize open source data-analytic tools for enterprise use.
  • Ensure data governance policies are followed by implementing or validating data lineage, quality checks, and data classification.


What makes you a great fit:

  • 6+ years of experience in data platform administration/engineering.
  • Capability to architect highly scalable distributed systems, using different tools.
  • Expert knowledge of data modelling and understanding of different data structures and their benefits and limitations under particular use cases.
  • Experience using Big Data batch and streaming tools.
  • Knowledge and experience using query languages (SQL, Cypher) for relational and graph databases.
  • Capability to collaborate with stakeholders and project leaders to understand requirements, deliverables, and set expectations on tasks that you will be responsible for.
  • Ability to work in a fast-paced, rapidly changing environment.
  • Experience working in an agile and collaborative team environment.
  • Excellent written and verbal communication, presentation and professional speaking skills.
  • Passion for learning and interest in pursuing classroom training and self-discovery on a variety of emerging technologies.
  • Hands-on experience with Amazon Web Services (AWS)-based solutions such as Lambda, Dynamodb, Snowflake and S3
  • Experience in migrating ETL processes (not just data) from relational warehouse databases to AWS-based solutions.
  • Experience within the financial industry.
  • Strong documentation, customer service and communication skills.
  • Innovative and able to reach and collaborate with other team members and functional teams.
  • Ability to handle multiple tasks in a fast-paced environment.
  • Most importantly, live our values day in and day out.

All about us
Sequoia

Sequoia is the pioneer in total people investment. We help companies master the practice of driving outcomes that matter through their total rewards. With expert guidance and the Sequoia People Platform, we connect our offerings for compensation, benefits, wellbeing, HR and payroll, and business protection to a higher strategic outcome, enabling companies to manage their global people investments, reduce administrative burdens, and reach a deeper level of employee care and support.

Employee count
501-1000 employees
Employment Type
Full Time Job
Company Type
Start-up
Headquarters
San Mateo, California, United States

Apply to Similar Jobs

  • BBlend360
    Blend360
    Senior Data Engineer
    Series C
    Start-up
    501-1000 employees
    5y - 9y

    Competitive pay

    Bengaluru/ Bangalore
    Python, SQL, Google Cloud Platform, AWS, Data Warehousing
  • LLifesight
    Lifesight
    Data Engineer
    Seed
    Start-up
    51-200 employees
    4y - 12y
    ₹20 - ₹50 LPA
    Bengaluru/ Bangalore
    Java, Scala, SQL, Spark, AWS
  • NNIRA
    NIRA
    Senior Data Architect
    Series A
    Start-up
    201-500 employees
    8y - 12y
    ₹25 - ₹50 LPA
    Bengaluru/ Bangalore
    ETL, Hadoop, Spark, Python, architecture
  • EEagleView
    EagleView
    Staff Engineer - Data pipeline
    Acquired
    Start-up
    1001-5000 employees
    10y - 16y

    Competitive pay

    Bengaluru/ Bangalore
    Spark, Kafka, AWS, Scala, Golang
  • MMoback Technologies
    Moback Technologies
    Data Engineer
    Seed
    Start-up
    51-200 employees
    5y - 10y
    ₹15 - ₹30 LPA
    Bengaluru/ Bangalore
    Azure, SQL, PostgreSQL, Tensorflow, Spark