A
Adobe
Big Data Engineer
Media & Entertainment Tech
B2B
SaaS
Product
Public
Software
10000+ Employees
10y - 13y
₹40 - ₹70 LPA
Bengaluru/ Bangalore
Scala, Java, Hadoop, Spark, DeltaLake
Role
Company
Job Description
What you'll do:
- Build the underneath data platform and maintain data processing pipelines using best in class technologies. Special focus on R&D to challenge status-quo and build the next generation big data platform that is efficient and cost effective.
- Translate complex technical and functional requirements into detailed designs.
- Collaborate with Data Scientists and Product Managers to bring AI-based Assistive experiences to life. Create the roadmap and socialize among team members and stake holders.
- Create and instill a team culture that focuses on sound scientific processes and encourages deep engagement with our customers.
- Handle project scope and risks with data, analytics, and creative problem-solving.
- Help define data governance policies and implement security and privacy guard rails.
What makes you a great fit:
- Hands-on engineer with extensive experience ingesting, storing, processing, and analysing large datasets
- Understanding of data-warehousing and data-modelling techniques
- Experience working (deploying and operationalising) with DNN frameworks like TensorFlow or PyTorch on large-scale data sets will be a great plus.
- Proficient in some of the following tools and technologies:
- Languages: Python, Java/Scala, SQL
- Dev-ops pipelines
- Container orchestration: Docker, Kubernetes
- Hadoop ecosystem: Hadoop, Spark, Hive etc.
- Stream processing: Storm, Flink etc.
- Workflow: Airflow, Flyte, etc.
- Data Engineering ecosystem: DeltaLake, DataHub etc.
- General understanding of data structures, algorithms, multi-threaded programming, and distributed computing concepts
- Ability to be a self-starter and work closely with other data scientists and software engineers to design, test, and build production-ready ML and optimization models and distributed algorithms running on large-scale data sets
- A total of 10+ years of experience in technical roles involving Big Data Engineering, implementation of Machine Learning models.
- Deep knowledge of Big Data Architectures, Platforms, Frameworks.
- Experience with Real Time Bidding / Ad Tech background preferred.
- Comfort with ambiguity, adaptability to dynamic environment, and the ability to lead a team while working autonomously.
- Demonstrated ability to influence technical and non-technical stakeholders.
- Track record of delivering cloud-scale, data-intensive applications and services that are widely adopted with large customer bases.
- An ability to think strategically, look around corners, and create a vision for the current quarter, the year, and five years down the road.
- A relentless pursuit of great customer experiences and continuous improvements to the product.
All about us
Adobe
Adobe is the global leader in digital media and digital marketing solutions. Our creative, marketing and document solutions empower everyone – from emerging artists to global brands – to bring digital creations to life and deliver immersive, compelling experiences to the right person at the right moment for the best results. In short, Adobe is everywhere, and we’re changing the world through digital experiences.
Employee count
10000+ Employees
Employment Type
Full Time Job
Company Type
Public
Headquarters
San Jose, California, United States
Our links
http://adobe.comFind Popular Jobs on BigShyft.com
Jobs By Skill in Bengaluru
Jobs By Skill
Apply to Similar Jobs
- LLifesightData EngineerSeedStart-up51-200 employees4y - 12y₹20 - ₹50 LPABengaluru/ BangaloreJava, Scala, SQL, Spark, AWS
- NNIRASenior Data ArchitectSeries AStart-up201-500 employees8y - 12y₹25 - ₹50 LPABengaluru/ BangaloreETL, Hadoop, Spark, Python, architecture
- EEagleViewStaff Engineer - Data pipelineAcquiredStart-up1001-5000 employees10y - 16y
Competitive pay
Bengaluru/ BangaloreSpark, Kafka, AWS, Scala, Golang - NNIRASenior Data ArchitectSeries AStart-up201-500 employees10y - 15y₹30 - ₹60 LPABengaluru/ BangaloreHadoop, Python, PySpark, AWS, Spark
- AAptus Data LabsBig Data Consultant-Developer-HadoopUnfundedStart-up51-200 employees7y - 12y
Competitive pay
Remote/ Work from Home, Bengaluru/ BangaloreHadoop, Hive, ETL, Python, shellscripting
Find Popular Jobs on BigShyft.com
Jobs By Skill in Bengaluru
Jobs By Skill
- Home
- >
- Jobs in Bengaluru
- >
- Scala Jobs
- >
- Scala Jobs in Bengaluru
- >
- Big Data Engineer