Manager Data Engineering Big Data Spark Scala Python Cassandra Elasticserach Aws Airflow Sql Jobs in Bengaluru, India

Professional job seekers finding India jobs through Expertini
750,000+ professionals on Expertini 750,000+ Candidates
Join our global community
Expertini Penguin Mascot Resume Score™
Resume Score™ Instantly
Upload Your CV
Quick 30-second process

Apply Today & Jumpstart Your Career on Expertini, Trusted Since 2008.

Reset

Create Job Alert

 
   
Reset

Senior Data Engineer

Minimum 8+ years of hands-on experience designing, building, deploying, testing, maintaining, monitoring, and owning scalable, resilient, and distributed data pipelines. High proficiency in Python, Scala and Spark for applied large-scale data processing. Expertise with big data technolo ...

Senior Data Engineer

Minimum 8+ years of hands-on experience designing, building, deploying, testing, maintaining, monitoring, and owning scalable, resilient, and distributed data pipelines. High proficiency in Python, Scala and Spark for applied large-scale data processing. Expertise with big data technolo ...

Cloud Engineer

DearHope you are doing well.We have an immediate need for AWS Data Engineers all 5 Days Onsite at Office from 2nd stage Banashankari, Bengaluru location and need someone to start Immediate Joiners only NO ONE MONTH NOTICE.Send resumes to / Role : Data Engineer with AWS a ...

Azure Data Engineer Synapse Analytics/Apache Airflow

<p><p>Job Title : Azure data engineerLocation : BangaloreExperience : 6- 8 yearsNotice Period : Immediate to 15 daysJob Descript ...

Full Stack Engineer

Required Skills: JavaScripting, React, Kafka, Git, Jenkins, Kubernetes, ArgoCD, API Design, event driven architecture, Azure, ADF Job Description Full Stack Engineer ( Offshore ) Big Data: Scala, Databricks, Spark SQL, Spark Streaming, Python, Pyspark, Kafka Streams < ...

Databricks Lead/Architect

Experience: 9+ yearsLocation : Bangalore, Chennai, Gurugram, Kolkata, PuneSkills and Qualifications :Bachelor's and/or masters degree in computer science or equivalent experience.Must have total 9+ yrs. of IT experience and 3+ years' experience in Data warehouse/ETL projects.Deep understandi ...

Databricks Lead/Architect

Experience: 9+ yearsLocation : Bangalore, Chennai, Gurugram, Kolkata, PuneSkills and Qualifications :Bachelor's and/or masters degree in computer science or equivalent experience.Must have total 9+ yrs. of IT experience and 3+ years' experience in Data warehouse/ETL projects.Deep understandi ...

Partner Solutions Engineer (Big Data)

FEQ125R56As a Partner Solutions Architect (PSA) for India, you will work with Databricks' Consulting and System Integrator (C&SI) partners, teammates, and with the technical and sales team members who work directly with our customers. You will develop 'technical champions' within our top ...

Senior Data Engineer

<p><p>Description : Impact & contribution : As an Engineer, you will be required to build strong working relationships with key business and stakeholders to improve outcomes, drive engineering standards across the g ...

Practice SME Data Engineering AWS/Azure

PDL/SME Responsibilities: Technical Expertise:Expertise in building big data pipelines with AWS or Azure Data Engineering services and good hands-on experience with Spark/PySpark, Scala/Python/Java, Data Modelling and Visualization.< ...

Data Engineer

Summary:We are seeking a skilled and forward-thinking Data Engineer to join our Emerging Tech team. This role is designed for someone passionate about working with cutting-edge technologies such as AI, machine learning, IoT, and big data to turn complex data sets into actionable insights.As ...

Java Spark Lead

Key Responsibilities: Lead the design and development of scalable data processing solutions using Java and Apache Spark Collaborate with data architects analysts and other stakeholders to understand data requirements Optimize Spark jobs for performance and scalability in distr ...

Aws Cloud Architect

Hands-on Experience with programming languages such as Python mandatorily.Thorough understanding of AWS from a data engineering and tools standpoint. Experience in another cloud is also beneficial.Experience in AWS Glue, Spark, and Python with Airflow for designing and developing da ...

Cloud Engineer

DearHope you are doing well.We have an immediate need for AWS Data Engineers all 5 Days Onsite at Office from 2nd stage Banashankari, Bengaluru location and need someone to start Immediate Joiners only NO ONE MONTH NOTICE.Send resumes to manju@nam-it.com /9148218735Role : Data Engineer with AWS a ...

Azure Data Engineer Big Data Technologies

<p>Description :About Us :AceNet Consulting is a fast-growing global business and technology consulting firm specializing in business strategy, digital transformation, technology consulting, product development, start-up advi ...

Big Data Architect DataLake/Data Warehousing

<p>Key Responsibilities :- Architect and guide implementation of Data Lakes, Lakehouses, and Data Warehouses using tools such as Snowflake, Microsoft Fabric, and Delta Lake.- Design and implement scalable, secure, and high-performing Big Data a ...

Senior Data Engineer Big Data Technologies

<p>Job Description :Accountabilities :- Understands the business vision from the data solutions and works with all project stakeholders to enable that.- Works alongside multiple other project team members to drive towards the common goal.< ...

Data Architect (Freelancer)

We are seeking India's top-tier Data Architects to join an elite community of professionals solving complex AI challenges. If you have deep expertise in designing, building, and optimizing data pipelines and platforms, this is your opportunity to collaborate with industry leaders and shape the future of intel ...

Data engineer

We’re looking for a Data Engineer to design, build, and scale modern data platforms on AWS. You’ll work with Python, Spark, DBT, and AWS-native services in an Agile environment to deliver scalable, secure, and high-performance data solutions.What you’ll doDevelop and optimize ETL/ELT pipelines with Python, DBT, ...

Data Engineer

This role is for one of the Weekday's clientsSalary range: Rs 2000000 - Rs 4500000 (ie INR 20-45 LPA)Min Experience: 2 yearsLocation: BengaluruJobType: full-timeWe are seeking a passionate and skilled Data Engineer with 2– ...

Data Engineer Snowflake DB

<p><p>Description :</p><p>Job Summary :</p><p>We are seeking a highly skilled Data Engineer to design, build, and optimize scalable data pipelines using Snowflake, AWS services, and Apache Spark. You will be responsib ...

Senior Technical Solutions Engineer (Apache Spark)

P-1377Databricks helps data teams solve the world’s toughest problems. As the leader in Unified Data Analytics, Databricks helps organizations make all their data ready for analytics, empower data-driven decisions across the organization, and rapidly adopt machine learning to outpace the competition Da ...

Staff Dev Ops Engineer AM TECH DA 019

Minimum Requirement Bachelor’s degree in computer science, information systems, software engineering or a related field (foreign equivalent degree acceptable) plus eight (8) years of experience in: software development technologyFive (5) years of experience with/in: Git; SQL; Hadoo ...

Data Engineer

Job description Position - Data EngineerExperience Level: Mid-Senior LevelExperience Required: 3+ YearsOverview:We are seeking a highly skilled and motivated Data Engineer to join our team. In this role, youwill collaborate with cross-functional teams to desig ...

GCP Data Engineer

About the Company: Brillio is one of the fastest growing digital technology service providers and a partner of choice for many Fortune 1000 companies seeking to turn disruption into a competitive advantage through innovative digital adoption. Brillio, renowned for its world-class professionals, referred to as B ...

Engineering Manager, Data Discovery

Minimum qualifications:Bachelor's degree, or equivalent practical experience.8 years of experience with software development in one or more programming languages (e.g., Python, C, C++, Java, JavaScript).5 years of experience in a technical leadership role, ove ...

Engineering Manager Data Platform

Ready to be pushed beyond what you think you’re capable of?At Coinbase, our mission is to increase economic freedom in the world. It’s a massive, ambitious opportunity that demands the best of us, every day, as we build the emerging onchain platform — and with it, the future global financial ...

Engineering Manager Data Platform

Ready to be pushed beyond what you think you’re capable of?At Coinbase, our mission is to increase economic freedom in the world. It’s a massive, ambitious opportunity that demands the best of us, every day, as we build the emerging onchain platform — and with it, the future global financial ...

Engineering Manager Data Platform

Ready to be pushed beyond what you think you’re capable of?At Coinbase, our mission is to increase economic freedom in the world. It’s a massive, ambitious opportunity that demands the best of us, every day, as we build the emerging onchain platform — and with it, the future global financial ...

Group Manager Data Engineering

Company DescriptionWNS (Holdings) Limited (NYSE: WNS), is a leading Business Process Management (BPM) company. We combine our deep industry knowledge with technology and analytics expertise to co-create innovative, digital-led transformational solutions with clients across 10 industrie ...

Senior Manager, Data Engineering

#25WD9141Position Overview We are seeking a highly experienced Principal Engineer to lead the design, development, and evolution of our Batch Processing platform, which powers Autodesk’s Analytics Data Platform (ADP ...

Senior Data Engineering Manager

About the Company />JD: Technical Lead -9+yrs( Databricks, GCP, Unity catalog, Terraform)About the RoleStrong Hands on experie ...

Assistant Manager Data Engineering

About The RoleWe are seeking a skilled Data Engineer to design, build, and optimize scalable data pipelines and infrastructure that empower data-driven decision-making across the organization. The ideal candidate will have strong expertise in Spark streaming and modern data engineering ...

Senior Manager, Data Engineering

Expedia Group brands power global travel for everyone, everywhere. We design cutting-edge tech to make travel smoother and more memorable, and we create groundbreaking solutions for our partners. Our diverse, vibrant, and welcoming community is essential in driving our success. Why Join Us? </ ...

Manager, Data Visualization Engineering

The Role:Mandate Skills:: Deep expertise in Chart.Js & D3.Js We are seeking a Frontend Engineer who specializes in data visualization to build our platform's observability and analytics dashboards. Your mission will be to transform vast streams of c ...

Engineering Manager Data Platform

Ready to be pushed beyond what you think you’re capable of? At Coinbase, our mission is to increase economic freedom in the world. It’s a massive, ambitious opportunity that demands the best of us, every day, as we build the emerging onchain platform — and with it, the future global financia ...

Engineering Manager Data Platform

Ready to be pushed beyond what you think you’re capable of?At Coinbase, our mission is to increase economic freedom in the world. It’s a massive, ambitious opportunity that demands the best of us, every day, as we build the emerging onchain platform — and with it, the future global financi ...

Engineering Manager Data Platform

Get to know OktaOkta is The World's Identity Company. We free everyone to safely use any technology, anywhere, on any device or app. Our flexible and neutral products, Okta Platform and Auth0 Platform, provide secure access, authentication, and automation, placing identity at the core ...

Manager Data/AI Engineering

Job Description:Roles and responsibilities:Drive the team on innovation & implementation, creating & reviewing architectural designs, mentoring the team, and honing its engineering skills.Guide team in creating technical specifications, proto ...

Engineering Manager Data Platform

Ready to be pushed beyond what you think you’re capable of?At Coinbase, our mission is to increase economic freedom in the world. It’s a massive, ambitious opportunity that demands the best of us, every day, as we build the emerging onchain platform — and with it, the future global financial system.To ac ...

Manager, Data Solutions Engineering

Key Responsibilities:Lead one team responsible for a product capabilityLead the delivery of complex solutions, and participate in the creation and presentation of technical designsParticipate in production support along with their teamActively participat ...

Senior Manager, Data Engineering

Expedia Group brands power global travel for everyone, everywhere. We design cutting-edge tech to make travel smoother and more memorable, and we create groundbreaking solutions for our partners. Our diverse, vibrant, and welcoming community is essential in driving our success.Why Join Us?</b ...

Manager Azure Data Engineering

About KPMG in India KPMG entities in India are professional services firm(s). These Indian member firms are affiliated with KPMG International Limited. KPMG was established in India in August 1993. Our professionals leverage the global network of firms, and are conversant with local laws, reg ...

Assistant Manager Data Engineering

About KPMG in India KPMG entities in India are professional services firm(s). These Indian member firms are affiliated with KPMG International Limited. KPMG was established in India in August 1993. Our professionals leverage the global network of firms, and are conversant with local laws, reg ...

Engineering Manager Data Modernization

OrganizationAt CommBank, we never lose sight of the role we play in other people’s financial wellbeing. Our focus is to help people and businesses move forward to progress. To make the right financial decisions and achieve their dreams, targets, and aspirations. Regardless of where you work with ...

Senior Manager, Data Engineering

About the Team/RoleAs the Senior Manager of Data Lake house Engineering, this leader will be responsible for the execution of the Data Lake house platform, Data Lake house , and related technology, systems, and tools. This leader will execute the technology development and architecture in these ...

Group Manager Data Engineering

Job DescriptionGroup Manager - Data Engineering (Full-Stack Developer (Angular, Node.js and Python))Exp – 10 Years (Full stack web Development)We are seeking a highly skilled and motivated Lead - Full-Stack Developer to join our dynamic engineerin ...

Manager/Lead Data Engineering

About ZetaZeta is a Next-Gen Banking Tech company that empowers banks and fintechs to launch banking products for the future. It was founded by and Ramki Gaddipati in 2015.Our flagship processing platform - Zeta Tachyon - is the industry’s first modern, cloud-native, and fully API-enabled stack tha ...

Data Engineer

We’re looking for a Data Engineer to design, build, and scale modern data platforms on AWS. You’ll work with Python, Spark, DBT, and AWS-native services in an Agile environment to deliver scalable, secure, and high-performance data solutions. ...

Data Engineer

We’re looking for a Data Engineer to design, build, and scale modern data platforms on AWS. You’ll work with Python, Spark, DBT, and AWS-native services in an Agile environment to deliver scalable, secure, and high-performance data solutions. ...

🚀 Boost Your Hiring Chances with Our AI-Powered Tool-Kit

Stand out from thousands of applicants. Use our proven career tools to optimize your applications and land your dream job faster.

To-Do Planner

Organize your job search and personal tasks. All data is confidential.

Open Planner

Wellbeing Center

Access your confidential wellness report and resources to manage job search stress.

Check Wellbeing

Skill Coach

Plan your skill development with O*NET support to stay competitive in your field.

Start Coaching

Outfit Helper

Get AI-powered suggestions on what to wear for your next interview.

Find Outfit

Income Tax Calculator

Plan your finances with our calculator, updated for 2025 tax regulations.

Calculate Tax

Salary Benchmark

Get accurate, AI-supported salary trends to know your worth and negotiate better.

Check Salaries

Interview Practice

Practice for any interview with AI-enabled Q&A sessions. All data is private.

Start Practicing

Interview Predictor

Use our AI-supported tool to predict potential interview questions based on your resume.

Predict Questions

Interview Practice Timer

Use our mock interview trainer to perfect your answers under timed conditions.

Start Timer

Behavioral Mastery

Ace tricky behavioral interviews with our AI-powered practice module.

Master Answers

Question Journal

Confidentially record interview questions you were asked for future reference.

Open Journal

Interview Ace

A comprehensive tool to help you master every aspect of your interviews.

Become an Ace

Q&A Logs

Confidentially track your answers to common questions and refine them over time.

View Logs

Application Planner

Schedule and organize your job applications in one confidential planner.

Open Planner

Cover Letter Tool

Create perfect, tailored cover letters for each application with AI support.

Generate Letter

Resume Score

Get instant feedback on your resume with our NLP-supported analysis tool.

Check My Score

ATS Score

Check your resume's compatibility with Applicant Tracking Systems (ATS).

Check ATS Score

Application Analyzer

Use AI to analyze job descriptions and optimize your application materials.

Analyze Application

Career Visualizer

Confidentially plan and visualize your long-term career path and goals.

Visualize My Career

Offer Genius

Get intelligent insights and strategies to confidently negotiate job offers.

Negotiate Offers

JobFlow

Track your entire job search progress from application to offer with this intelligent tool.

Track My Flow

JobSense

Our intelligent matching engine that provides smart job recommendations.

Get Smart Matches

Networking Toolkit

Tools to build and manage your professional connections. All data is confidential.

Build Network

Professional CV

A classic, O*NET supported template for corporate and professional roles.

Use This Template

Executive CV

A premium, O*NET supported template designed for senior and C-level positions.

Use This Template

Modern CV

A fresh, stylish, O*NET supported template perfect for tech and modern industries.

Use This Template

Creative CV

A visually distinct, O*NET supported template for design and artistic roles.

Use This Template

Minimalist CV

A clean, simple, O*NET supported template that focuses purely on content.

Use This Template

Europass CV

The standard European Union recommended format for wide compatibility.

Use This Template

Student CV

An institution-recommended template perfect for internships and first jobs.

Use This Template

Graduate CV

An institution-recommended template for recent graduates entering the workforce.

Use This Template

Academic CV

The researcher-recommended format for roles in academia and research.

Use This Template

Developer/IT CV

A tech-savvy recommended template to highlight your technical skills.

Use This Template

Skilled Worker CV

A trades-recommended template to showcase hands-on skills and experience.

Use This Template

Monochrome CV

A sleek, black-and-white, O*NET supported template for a professional look.

Use This Template

Art CV

An artist-recommended template that allows your creativity to shine.

Use This Template

Harvard CV

A researcher-recommended template based on the classic Harvard format.

Use This Template

Volunteer Research

Help us improve our platform by joining our community research program.

Join Research

Review Us

Share your experience with our tools to help other job seekers.

Share Experience

Register

Create your free account to save jobs, build your profile, and track applications.

Create Account

Login

Access your dashboard, manage applications, and continue your job search.

Access Your Account

Profile Builder

Create a comprehensive professional profile that attracts recruiters and showcases your skills.

Build Your Profile

View Profile

See your public profile exactly as employers will see it. Make sure it's perfect.

Preview Profile

Bookmarked Jobs

Keep track of all your saved job opportunities in one organized place.

View Saved Jobs

Your Reviews

View and manage all the company reviews you've submitted.

See Your Reviews

Following

Manage the list of companies you follow to stay updated on their new openings.

Manage Following

Find Companies

Discover and research top employers in your country and industry.

Discover Employers

Standalone CV Builder

Use our O*NET supported CV builder to create a professional resume from scratch.

Build Your CV

PDF to DOC (Beta)

Convert your PDF resumes or documents into editable Word (DOC) format.

Convert PDF

DOC to PDF (Beta)

Create universally compatible PDF documents from your Word (DOC) files.

Create PDF

General FAQ

Find answers to common questions about our job site and platform.

Read FAQ

Job Seekers FAQ

Get help and find answers to questions specifically for job seekers.

Get Help

Job Matching

Learn about the technology and algorithms behind how we match you to jobs.

Learn How

Personalized Matching

Discover how we use your profile and activity to provide customized job suggestions.

Learn More

Quick Apply

Understand our fast application process and how to make the most of it.

Learn More

Alert Frequency

Learn how to manage your job alert settings so you get the updates you want.

Manage Settings

Job Alerts Guide

A complete guide to understanding how job alerts work and how to use them effectively.

Read Guide

Resume Matching

Learn how our system matches your resume to job requirements.

Learn More

Ethical Branding

Read our guide to building a professional and ethical personal brand.

Read Guide

Candidate Visibility

Learn how to increase your visibility to recruiters on our platform.

Increase Visibility

Verified Badge

Find out how you can get a verified badge to build trust with employers.

Get Verified

AI ATS Technology

Learn about the advanced AI and ATS technology that powers our platform.

Learn More

ATS Ranking

Understand how Applicant Tracking Systems rank you as an applicant.

Learn More

Semantic Matching

Learn how our AI-powered semantic matching goes beyond keywords.

Learn More

    Manager Data Engineering Big Data Spark Scala Python Cassandra Elasticserach Aws Airflow Sql Jobs in Bengaluru Job Search Guide, Trends and Insights

Advance your career or build your team with Expertini's smart job platform. Connecting professionals and employers in Bengaluru, India.