bigshyft
AAdobe
Adobe
Big Data Engineer
Media & Entertainment Tech
B2B
SaaS
Product
Public
Software
10000+ Employees
10y - 13y
₹40 - ₹70 LPA
Bengaluru/ Bangalore
Scala, Java, Hadoop, Spark, DeltaLake

Role

Company

Job Description

What you'll do:

  • Build the underneath data platform and maintain data processing pipelines using best in class technologies. Special focus on R&D to challenge status-quo and build the next generation big data platform that is efficient and cost effective.
  • Translate complex technical and functional requirements into detailed designs.
  • Collaborate with Data Scientists and Product Managers to bring AI-based Assistive experiences to life. Create the roadmap and socialize among team members and stake holders. 
  • Create and instill a team culture that focuses on sound scientific processes and encourages deep engagement with our customers.
  • Handle project scope and risks with data, analytics, and creative problem-solving.
  • Help define data governance policies and implement security and privacy guard rails.


What makes you a great fit:

  • Hands-on engineer with extensive experience ingesting, storing, processing, and analysing large datasets
  • Understanding of data-warehousing and data-modelling techniques
  • Experience working (deploying and operationalising) with DNN frameworks like TensorFlow or PyTorch on large-scale data sets will be a great plus. 
  • Proficient in some of the following tools and technologies:
  • Languages: Python, Java/Scala, SQL
  • Dev-ops pipelines
  • Container orchestration: Docker, Kubernetes
  • Hadoop ecosystem: Hadoop, Spark, Hive etc.
  • Stream processing: Storm, Flink etc.
  • Workflow: Airflow, Flyte, etc.
  • Data Engineering ecosystem: DeltaLake, DataHub etc.
  • General understanding of data structures, algorithms, multi-threaded programming, and distributed computing concepts
  • Ability to be a self-starter and work closely with other data scientists and software engineers to design, test, and build production-ready ML and optimization models and distributed algorithms running on large-scale data sets
  • A total of 10+ years of experience in technical roles involving Big Data Engineering, implementation of Machine Learning models.
  • Deep knowledge of Big Data Architectures, Platforms, Frameworks.
  • Experience with Real Time Bidding / Ad Tech background preferred.
  • Comfort with ambiguity, adaptability to dynamic environment, and the ability to lead a team while working autonomously.
  • Demonstrated ability to influence technical and non-technical stakeholders. 
  • Track record of delivering cloud-scale, data-intensive applications and services that are widely adopted with large customer bases. 
  • An ability to think strategically, look around corners, and create a vision for the current quarter, the year, and five years down the road. 
  • A relentless pursuit of great customer experiences and continuous improvements to the product.
All about us
Adobe

Adobe is the global leader in digital media and digital marketing solutions. Our creative, marketing and document solutions empower everyone – from emerging artists to global brands – to bring digital creations to life and deliver immersive, compelling experiences to the right person at the right moment for the best results. In short, Adobe is everywhere, and we’re changing the world through digital experiences.

Employee count
10000+ Employees
Employment Type
Full Time Job
Company Type
Public
Headquarters
San Jose, California, United States

Apply to Similar Jobs

  • LLifesight
    Lifesight
    Data Engineer
    Seed
    Start-up
    51-200 employees
    4y - 12y
    ₹20 - ₹50 LPA
    Bengaluru/ Bangalore
    Java, Scala, SQL, Spark, AWS
  • NNIRA
    NIRA
    Senior Data Architect
    Series A
    Start-up
    201-500 employees
    8y - 12y
    ₹25 - ₹50 LPA
    Bengaluru/ Bangalore
    ETL, Hadoop, Spark, Python, architecture
  • EEagleView
    EagleView
    Staff Engineer - Data pipeline
    Acquired
    Start-up
    1001-5000 employees
    10y - 16y

    Competitive pay

    Bengaluru/ Bangalore
    Spark, Kafka, AWS, Scala, Golang
  • NNIRA
    NIRA
    Senior Data Architect
    Series A
    Start-up
    201-500 employees
    10y - 15y
    ₹30 - ₹60 LPA
    Bengaluru/ Bangalore
    Hadoop, Python, PySpark, AWS, Spark
  • AAptus Data Labs
    Aptus Data Labs
    Big Data Consultant-Developer-Hadoop
    Unfunded
    Start-up
    51-200 employees
    7y - 12y

    Competitive pay

    Remote/ Work from Home, Bengaluru/ Bangalore
    Hadoop, Hive, ETL, Python, shellscripting