bigshyft
IIndiGG
IndiGG
AWS - Data Engineer
51-200 employees
Private
3y - 5y
₹10 - ₹15 LPA
Bengaluru/ Bangalore
SQL, ETL, AWS, Spark, PySpark

Role

Company

Job Description

What you'll do :

  • Designing and developing data warehouse solutions: Collaborate with stakeholders, including business analysts and data scientists, to understand data requirements and translate them into efficient data warehouse designs. Develop data models, schema definitions, and ELT (Extract, Load, Transfer) processes to populate and maintain the data warehouse.
  • ELT Development: Design, develop, and optimize ELT processes to extract data from various sources, transform it to match the data warehouse schema, and load it into the data warehouse. Ensure the ETL processes are efficient, scalable, and reliable.
  • Data Integration: Integrate data from disparate sources such as databases, flat files, APIs, and streaming data into the data warehouse. Implement data validation and cleansing processes to ensure data accuracy and consistency.
  • Performance Optimisation: Monitor and tune the performance of data warehouse systems to ensure efficient query processing and data retrieval. Identify and resolve performance bottlenecks by optimizing database schema, indexes, and query execution plans.
  • Data Governance and Security: Implement and enforce data governance policies, ensuring data quality, integrity, and security within the data warehouse. Define access controls and security measures to protect sensitive data.
  • Data Analysis and Reporting: Work closely with data analysts and business intelligence teams to understand reporting requirements and provide them with the necessary data extracts, views, and data marts. Support ad-hoc data analysis and reporting needs.
  • Documentation and Documentation: Document data warehouse designs, data models, ETL processes, and system configurations. Maintain up-to-date technical documentation for reference and knowledge sharing.
  • Troubleshooting and Maintenance: Monitor data warehouse systems for issues, troubleshoot and resolve them promptly. Perform regular maintenance activities such as backups, patching, and system upgrades.
  • Stay Current with Industry Trends: Keep up-to-date with the latest advancements and trends in data warehousing technologies, tools, and best practices. Evaluate and recommend new tools and technologies that can enhance the data warehousing capabilities of the organization.


What makes you a great fit :

  • Proven experience of a minimum of 3+ years as a data engineer or data warehousing engineer.
  • Strong knowledge of data warehousing concepts, methodologies, and best practices.
  • Proficiency in SQL and experience with relational databases (e. g., Oracle, SQL Server, PostgreSQL).
  • Hands-on experience with ETL tools (e. g., Informatica, Talend, SSIS, Power BI) and data integration techniques.
  • Familiarity with data modeling and database design principles.
  • Knowledge of data governance, data security, and privacy practices.
  • Strong analytical and problem-solving skills.
  • Excellent communication and collaboration abilities.
  • Ability to work independently and in a team environment.
  • Familiarity with cloud-based data warehousing solutions (e. g., Amazon Redshift, Google BigQuery) is a plus.
  • Knowledge of programming languages like Python is beneficial.
  • Primary Stack: AWS, ETL/ELT, Athena/Glue/EMR, spark/pyspark, Dynamodb, Streaming & CDC
All about us
IndiGG

Online community-based gaming platform. It is an online community-based gaming platform for users to connect, discover, and play games. Users can play games like "Axie infinity", "Pegaxy", "Nyan heroes", and others. They allow players to become clan chiefs and receive rewards, as well as live tournaments, quests, and games.

Employee count
51-200 employees
Employment Type
Full Time Job
Company Type
Private
Headquarters
Bangalore, Karnataka, India

Apply to Similar Jobs

  • AAcies
    Acies
    Data Engineer
    Unfunded
    Start-up
    51-200 employees
    3y - 6y
    ₹10 - ₹20 LPA
    Chennai, Bengaluru/ Bangalore
    SQL, Airflow, ETL, PySpark, Datalake
  • DDigit88
    Digit88
    Data Engineer
    Unfunded
    Start-up
    51-200 employees
    4y - 7y
    ₹25 - ₹45 LPA
    Remote/ Work from Home, Bengaluru/ Bangalore, Pune
    Scala, Kafka, Spark, AWS, SQL
  • LLifesight
    Lifesight
    Data Engineer
    Seed
    Start-up
    51-200 employees
    4y - 12y
    ₹20 - ₹50 LPA
    Bengaluru/ Bangalore
    Java, Scala, SQL, Spark, AWS
  • LLufthansa Technik
    Lufthansa Technik
    Data Engineer
    201-500 employees
    Private
    4y - 8y

    Competitive pay

    Bengaluru/ Bangalore
    Python, SQL, Flask, ETL, Azure
  • RRED.Health
    RED.Health
    Data Engineer
    Series A
    Start-up
    201-500 employees
    3y - 7y
    ₹15 - ₹30 LPA
    Bengaluru/ Bangalore
    Python, Scala, AWS, Hadoop, SQL