S
Sequoia
Lead Data Engineer
Unfunded
Start-up
501-1000 employees
8y - 11y
₹50 - ₹70 LPA
Bengaluru/ Bangalore
AWS, ETL, Data Warehousing, Data Modelling
Role
Company
Job Description
What you'll do:
- Design and develop data-ingestion frameworks, real-time processing solutions, and data processing and transformation frameworks.
- Deploy and provide support for application codes and analytical models.
- Provide senior-level technical consulting to peer data engineers during design and development for highly complex and critical data projects.
- Create and enhance data enable seamless integration and flow across the data ecosystem.
- Provide business analysis and develop ETL code and scripting to meet all technical specifications and business requirements according to the established designs.
- Develop real-time data ingestion and stream-analytic solutions leveraging technologies such as Kafka, Apache Spark, Python and AWS-based solutions.
- Utilize multiple development languages/tools such as Python, SPARK, Hive, Java to build prototypes and evaluate results for effectiveness and feasibility.
- Contribute to determining programming approach, tools, and techniques that best meet the business requirements.
- Provide subject matter expertise in the analysis, preparation of specifications and plans for the development of data processes.
- Operationalize open source data-analytic tools for enterprise use.
- Ensure data governance policies are followed by implementing or validating data lineage, quality checks, and data classification.
What makes you a great fit:
- 6+ years of experience in data platform administration/engineering.
- Capability to architect highly scalable distributed systems, using different tools.
- Expert knowledge of data modelling and understanding of different data structures and their benefits and limitations under particular use cases.
- Experience using Big Data batch and streaming tools.
- Knowledge and experience using query languages (SQL, Cypher) for relational and graph databases.
- Capability to collaborate with stakeholders and project leaders to understand requirements, deliverables, and set expectations on tasks that you will be responsible for.
- Ability to work in a fast-paced, rapidly changing environment.
- Experience working in an agile and collaborative team environment.
- Excellent written and verbal communication, presentation and professional speaking skills.
- Passion for learning and interest in pursuing classroom training and self-discovery on a variety of emerging technologies.
- Hands-on experience with Amazon Web Services (AWS)-based solutions such as Lambda, Dynamodb, Snowflake and S3
- Experience in migrating ETL processes (not just data) from relational warehouse databases to AWS-based solutions.
- Experience within the financial industry.
- Strong documentation, customer service and communication skills.
- Innovative and able to reach and collaborate with other team members and functional teams.
- Ability to handle multiple tasks in a fast-paced environment.
- Most importantly, live our values day in and day out.
All about us
Sequoia
Sequoia is the pioneer in total people investment. We help companies master the practice of driving outcomes that matter through their total rewards. With expert guidance and the Sequoia People Platform, we connect our offerings for compensation, benefits, wellbeing, HR and payroll, and business protection to a higher strategic outcome, enabling companies to manage their global people investments, reduce administrative burdens, and reach a deeper level of employee care and support.
Employee count
501-1000 employees
Employment Type
Full Time Job
Company Type
Start-up
Headquarters
San Mateo, California, United States
Our links
http://sequoia.comFind Popular Jobs on BigShyft.com
Jobs By Skill in City
Apply to Similar Jobs
- BBlend360Senior Data EngineerSeries CStart-up501-1000 employees5y - 9y
Competitive pay
Bengaluru/ BangalorePython, SQL, Google Cloud Platform, AWS, Data Warehousing - LLifesightData EngineerSeedStart-up51-200 employees4y - 12y₹20 - ₹50 LPABengaluru/ BangaloreJava, Scala, SQL, Spark, AWS
- NNIRASenior Data ArchitectSeries AStart-up201-500 employees8y - 12y₹25 - ₹50 LPABengaluru/ BangaloreETL, Hadoop, Spark, Python, architecture
- EEagleViewStaff Engineer - Data pipelineAcquiredStart-up1001-5000 employees10y - 16y
Competitive pay
Bengaluru/ BangaloreSpark, Kafka, AWS, Scala, Golang - MMoback TechnologiesData EngineerSeedStart-up51-200 employees5y - 10y₹15 - ₹30 LPABengaluru/ BangaloreAzure, SQL, PostgreSQL, Tensorflow, Spark
Find Popular Jobs on BigShyft.com
Jobs By Skill in City
- Home
- >
- Jobs in Bengaluru
- >
- Aws Jobs
- >
- Aws Jobs in Bengaluru
- >
- Lead Data Engineer