I
IndiGG
AWS - Data Engineer
51-200 employees
Private
3y - 5y
₹10 - ₹15 LPA
Bengaluru/ Bangalore
SQL, ETL, AWS, Spark, PySpark
Role
Company
Job Description
What you'll do :
- Designing and developing data warehouse solutions: Collaborate with stakeholders, including business analysts and data scientists, to understand data requirements and translate them into efficient data warehouse designs. Develop data models, schema definitions, and ELT (Extract, Load, Transfer) processes to populate and maintain the data warehouse.
- ELT Development: Design, develop, and optimize ELT processes to extract data from various sources, transform it to match the data warehouse schema, and load it into the data warehouse. Ensure the ETL processes are efficient, scalable, and reliable.
- Data Integration: Integrate data from disparate sources such as databases, flat files, APIs, and streaming data into the data warehouse. Implement data validation and cleansing processes to ensure data accuracy and consistency.
- Performance Optimisation: Monitor and tune the performance of data warehouse systems to ensure efficient query processing and data retrieval. Identify and resolve performance bottlenecks by optimizing database schema, indexes, and query execution plans.
- Data Governance and Security: Implement and enforce data governance policies, ensuring data quality, integrity, and security within the data warehouse. Define access controls and security measures to protect sensitive data.
- Data Analysis and Reporting: Work closely with data analysts and business intelligence teams to understand reporting requirements and provide them with the necessary data extracts, views, and data marts. Support ad-hoc data analysis and reporting needs.
- Documentation and Documentation: Document data warehouse designs, data models, ETL processes, and system configurations. Maintain up-to-date technical documentation for reference and knowledge sharing.
- Troubleshooting and Maintenance: Monitor data warehouse systems for issues, troubleshoot and resolve them promptly. Perform regular maintenance activities such as backups, patching, and system upgrades.
- Stay Current with Industry Trends: Keep up-to-date with the latest advancements and trends in data warehousing technologies, tools, and best practices. Evaluate and recommend new tools and technologies that can enhance the data warehousing capabilities of the organization.
What makes you a great fit :
- Proven experience of a minimum of 3+ years as a data engineer or data warehousing engineer.
- Strong knowledge of data warehousing concepts, methodologies, and best practices.
- Proficiency in SQL and experience with relational databases (e. g., Oracle, SQL Server, PostgreSQL).
- Hands-on experience with ETL tools (e. g., Informatica, Talend, SSIS, Power BI) and data integration techniques.
- Familiarity with data modeling and database design principles.
- Knowledge of data governance, data security, and privacy practices.
- Strong analytical and problem-solving skills.
- Excellent communication and collaboration abilities.
- Ability to work independently and in a team environment.
- Familiarity with cloud-based data warehousing solutions (e. g., Amazon Redshift, Google BigQuery) is a plus.
- Knowledge of programming languages like Python is beneficial.
- Primary Stack: AWS, ETL/ELT, Athena/Glue/EMR, spark/pyspark, Dynamodb, Streaming & CDC
All about us
IndiGG
Online community-based gaming platform. It is an online community-based gaming platform for users to connect, discover, and play games. Users can play games like "Axie infinity", "Pegaxy", "Nyan heroes", and others. They allow players to become clan chiefs and receive rewards, as well as live tournaments, quests, and games.
Employee count
51-200 employees
Employment Type
Full Time Job
Company Type
Private
Headquarters
Bangalore, Karnataka, India
Our links
https://indi.gg/Find Popular Jobs on BigShyft.com
Jobs By Skill in Bengaluru
Jobs By Skill
Apply to Similar Jobs
- AAciesData EngineerUnfundedStart-up51-200 employees3y - 6y₹10 - ₹20 LPAChennai, Bengaluru/ BangaloreSQL, Airflow, ETL, PySpark, Datalake
- DDigit88Data EngineerUnfundedStart-up51-200 employees4y - 7y₹25 - ₹45 LPARemote/ Work from Home, Bengaluru/ Bangalore, PuneScala, Kafka, Spark, AWS, SQL
- LLifesightData EngineerSeedStart-up51-200 employees4y - 12y₹20 - ₹50 LPABengaluru/ BangaloreJava, Scala, SQL, Spark, AWS
- LLufthansa TechnikData Engineer201-500 employeesPrivate4y - 8y
Competitive pay
Bengaluru/ BangalorePython, SQL, Flask, ETL, Azure - RRED.HealthData EngineerSeries AStart-up201-500 employees3y - 7y₹15 - ₹30 LPABengaluru/ BangalorePython, Scala, AWS, Hadoop, SQL
Find Popular Jobs on BigShyft.com
Jobs By Skill in Bengaluru
Jobs By Skill
- Home
- >
- Jobs in Bengaluru
- >
- Sql Jobs
- >
- Sql Jobs in Bengaluru
- >
- AWS - Data Engineer