Data Engineer Spark Scala Python Cassandra Elasticsearch Aws Airflow Sql Jobs in Bengaluru, India

Professional job seekers finding India jobs through Expertini
750,000+ professionals on Expertini 750,000+ Candidates
Join our global community
Expertini Penguin Mascot Resume Score™
Resume Score™ Instantly
Upload Your CV
Quick 30-second process

Apply Today & Jumpstart Your Career on Expertini, Trusted Since 2008.

Reset

Create Job Alert

 
   
Reset

Software Engineer, Change data capture

Who we are About Stripe Stripe is a financial infrastructure platform for businesses. Millions of companies—from the world’s largest enterprises to the most ambitious startups—use Stripe to accept payments, grow their revenue, and accelerate new business opportunities. Our mission is to increa ...

Software Engineer, Change data capture

Who we are About Stripe Stripe is a financial infrastructure platform for businesses. Millions of companies—from the world’s largest enterprises to the most ambitious startups—use Stripe to accept payments, grow their revenue, and accelerate new business opportunities. Our mission is to increase ...

Staff, Software Engineer

**Overview** **About Business Unit:** The Product team forms the crux of our powerful platforms and helps connect millions of customers worldwide with the brands that matter most to them. This team of innovative problem solvers develops and builds products that position Epsilon as a differentia ...

Kafka DataEngineer

Job Description Kafka Data EngineerData Engineer to build and manage data pipelines that support batch and streaming data solutions. The role requires expertise in creating seamless data flows across platforms like Data Lake/Lakehouse in Cloudera, Azure Databricks, Kafka for both batch and stream data pipelines ...

Staff, Software Engineer

OverviewAbout Business Unit:The Product team forms the crux of our powerful platforms and helps connect millions of customers worldwide with the brands that matter most to them. This team of innovative problem solvers develops and builds products that position Epsilon as a differentiator, encouraging ...

Big Data BI analyst

• SQL Server 2014/16, Good SQL & ETL skills • Big data skills – Any skills like ADF, Databricks, Spark, Scala,.. • Ability to make business conclusions from data, connect scenarios & provide solutions • Prior experience in Microsoft landscape is preferred. • Good knowledge of SSIS (Not ...

Big Data BI analyst

• SQL Server 2014/16, Good SQL & ETL skills • Big data skills – Any skills like ADF, Databricks, Spark, Scala,.. • Ability to make business conclusions from data, connect scenarios & provide solutions • Prior experience in Microsoft landscape is preferred. • Good knowledge of SSIS (Not ...

Fabric Data Engineer (Remote)

Thinkgrid Labs is at the forefront of innovation and technology. Our expert team of software engineers, architects, and UI/UX designers specialises in crafting bespoke web, mobile, cloud applications, data platforms along with AI solutions and intelligent bots. Thinkgrid Labs is expanding our data pract ...

Fabric Data Engineer (Remote)

Thinkgrid Labs is at the forefront of innovation and technology. Our expert team of software engineers, architects, and UI/UX designers specialises in crafting bespoke web, mobile, cloud applications, data platforms along with AI solutions and intelligent bots. Thinkgrid Labs is expanding our data pract ...

Senior Hadoop / Bigdata Engineer

Candidate should be able to: Work closely with our QA Team to ensure data integrity and overall system quality Work closely with Technology Leadership, Product Managers, and Reporting Team for understanding the functional and system requirements Write Shell/Python scripts for jobs scheduling and d ...

Senior Hadoop / Bigdata Engineer

Candidate should be able to: Work closely with our QA Team to ensure data integrity and overall system quality Work closely with Technology Leadership, Product Managers, and Reporting Team for understanding the functional and system requirements Write Shell/Python scripts for jobs scheduling and d ...

Staff Software Engineer

P-1346 At Databricks, we are passionate about enabling data teams to solve the world's toughest problems — from making the next mode of transportation a reality to accelerating the development of medical breakthroughs. We do this by building and running the world's best data and AI infrastructure platf ...

Senior Software Engineer

P-1346 At Databricks, we are passionate about enabling data teams to solve the world's toughest problems — from making the next mode of transportation a reality to accelerating the development of medical breakthroughs. We do this by building and running the world's best data and AI infrastructure platf ...

Senior Software Engineer Infrastructure

P-1346 At Databricks, we are passionate about enabling data teams to solve the world's toughest problems — from making the next mode of transportation a reality to accelerating the development of medical breakthroughs. We do this by building and running the world's best data and AI infrastructure platf ...

Staff Software Engineer Infrastructure

P-1346 At Databricks, we are passionate about enabling data teams to solve the world's toughest problems — from making the next mode of transportation a reality to accelerating the development of medical breakthroughs. We do this by building and running the world's best data and AI infrastructure platf ...

Senior Software Engineer Infrastructure

P-1346At Databricks, we are passionate about enabling data teams to solve the world's toughest problems — from making the next mode of transportation a reality to accelerating the development of medical breakthroughs. We do this by building and running the world's best data and AI infrastructure platfo ...

Staff Software Engineer Infrastructure

P-1346At Databricks, we are passionate about enabling data teams to solve the world's toughest problems — from making the next mode of transportation a reality to accelerating the development of medical breakthroughs. We do this by building and running the world's best data and AI infrastructure platfo ...

Staff Software Engineer II(Python,Kafka,Microservices)

Scope: We are seeking a highly skilled Python Developer with a strong background in distributed systems, DevOps practices, and Test-Driven Development (TDD).The ideal candidate will be proficient in event-driven architectures using Kafka, familiar with Java-based microservices, and ...

Staff Software Engineer II(Python,Kafka,Microservices)

Scope: We are seeking a highly skilled Python Developer with a strong background in distributed systems, DevOps practices, and Test-Driven Development (TDD).The ideal candidate will be proficient in event-driven architectures using Kafka, familiar with Java-based microservices, and exp ...

Staff Software Engineer II(Python,Kafka,Microservices)

Scope:We are seeking a highly skilled Python Developer with a strong background in distributed systems, DevOps practices, and Test-Driven Development (TDD).The ideal candidate will be proficient in event-driven architectures using Kafka, familiar with Java-based microservices, and exper ...

Senior Principal Software Engineer

Be a part of a team that's ensuring Dell Technologies' product integrity and customer satisfaction. Our IT Software Engineer team turns business requirements into technology solutions by designing, coding and testing/debugging applications, as well as documenting procedures for use and constantly seeking qual ...

Lead Data Engineer

Impetus is hiring Sr. GCP Lead for Bangalore/Gurgaon location. We are looking candidate should have strong experience in Bigdata, spark, pyspark, Python, GCP-Bigquery, Airflow, Dataflow, Dataproc, Pubsub, Cloud Composer, Data Storage & etc. If you have extensive experience in these technologies & wanted to part ...

Lead Data Engineer

Impetus is hiring Sr. GCP Lead for Bangalore/Gurgaon location. We are looking candidate should have strong experience in Bigdata, spark, pyspark, Python, GCP-Bigquery, Airflow, Dataflow, Dataproc, Pubsub, Cloud Composer, Data Storage & etc. If you have extensive experience in these technologies & wanted to part ...

Senior Data Engineer

Job DescriptionThis is an exciting opportunity for an experienced Data Engineer of large scale data solutions who will join a team delivering a transformative solutions for a key Version 1 customer. We are seeking engineers that can support across multiple initiatives and have the f ...

Machine Learning Engineer

Job Title:ML Ops Engineer / ML EngineerExperience - 5Yrs -20 YrsLocation - Chennai / Bangalore / Hyderabad / Pune / Noida / Mumbai/Job Overview:We are looking for an experienced MLOps Engineer to help deploy, scale, and manage machine learning models in production environments. You will work ...

Machine Learning Engineer

Job Title:ML Ops Engineer / ML EngineerExperience - 5Yrs -20 YrsLocation - Chennai / Bangalore / Hyderabad / Pune / Noida / Mumbai/Job Overview:We are looking for an experienced MLOps Engineer to help deploy, scale, and manage machine learning models in production environments. You will work ...

Snowflake DataEngineer

Years of experience - 5Years+Location - BangaloreNotice Period - Immediate to 30 daysAbout the RoleWe’re looking for seasoned data engineers who can take end-to-end ownership of complex data engineering engagements—right from architecture and design to development and delivery. You’ll work with client stakeholde ...

Aws Data Engineer and data analyst

**We're Hiring: Data Engineer & Data Analyst** **Company:** British Petroleum (BP) **Location:** Hybrid **Experience:** 4–7 years British Petroleum is seeking passionate and skilled **Data Engineers** and **Data Analysts** to join our dynamic data team. If you have a strong ...

AWS Data Engineer ETL/Data Warehousing

<p><p>Key Responsibilities : </p><p>- Design, develop, and deploy robust, scalable, real-time AWS-based data solutions aligned with PwCs high standards and client business objectives.</p><p>- Architect and maintain secure, compliant dat ...

Core JAVA, Digital

Dear Applicants, Greeting from TCS I hope your day is going well At Tata Consultancy Services, were looking for someone like you for an Associate Consultant position. This opportunity aligns nicely with your experience in creating immersive technologies and innovative solutions. TC ...

Hadoop Admin

Minimum 7 years of experience with at least 4 to 5 years in Cloud computing Primary Skill: Hands on experience in building EKS clusters(Expert level), Spark on EKS, AWS(EMR, S3, RDS), Python as programming skills and Shell scripting. Work experience in any CI/CD environment is a must Secondary Skills: Experience ...

Infrastructure Engineer AWS Cloud Services

<p><p>Description : </p><p>Responsibilities : </p><p>- Design, implement, and manage our AWS infrastructure, with a strong emphasis on automation, resilience, and cost efficiency.</p><p>- Implem ...

Sr. Engineer (MS Fabric Migration & Development)

Hands-on Migration and DevelopmentPipeline Translation: Directly develop and migrate 20+ complex data pipelines from Azure Data Factory (ADF) into optimized Fabric Data Pipelines and Spark Notebooks (PySpark/Scala).Stored Procedure Conversion: Rewrite and optimize 30+ complex stored procedures into rob ...

Sr. Engineer (MS Fabric Migration & Development)

Hands-on Migration and DevelopmentPipeline Translation: Directly develop and migrate 20+ complex data pipelines from Azure Data Factory (ADF) into optimized Fabric Data Pipelines and Spark Notebooks (PySpark/Scala).Stored Procedure Conversion: Rewrite and optimize 30+ complex stored procedures into r ...

Cloud Engineer

Responsibilities- Good to have Docker and Kubernetes knowledge for troubleshooting clusters and managing container images.- Good to have CI/CD deployment knowledge, GitHub Workflows, YAML Pipelines.- Good Knowledge of API troubleshoot management.- Good to have PowerShell Scripting knowledge.- ...

Azure Databricks (Shell)

<p>Job Description:</p> <div> </div> <ul> <li> <p>Design and implement ETL/ELT pipelines using Databricks and PySpark.</p> </li> <li> <p>Work with Unity Catalog to manage data governance, access controls, lineage, and auditi ...

Senior Data Engineer

While technology is the heart of our business, a global and diverse culture is the heart of our success. We love our people and we take pride in catering them to a culture built on transparency, diversity, integrity, learning and growth. If working in an environment that encourages you to innovate and ...

Senior Associate

Job Purpose We are looking for a skilled Data Engineer with expertise in Snowflake and ETL processes to build, maintain, and troubleshoot data pipelines that support research data services. This role ensures that data infrastructure is robust, scalable, and delivers accurate and timely data to end user ...

Principal Systems Software Engineer

What we're looking for: YOU as a Principal Systems Software Engineer will have the opportunity to collaborate with the brightest engineering minds and work on cutting-edge technology like Data Engineering / Data Platform. Position Overview: Citrix ADC (Application Delivery Control ...

Senior Data Engineer

Position Description: Job Title: Senior Data Engineer Job Description We are looking for a highly experienced Senior Data Engineer to design, build, and scale data-driven systems that power advanced analytics, machine learning models, and critical business decisioning. Th ...

Integration Engineer

Project Role : Integration EngineerProject Role Description : Provide consultative Business and System Integration services to help clients implement effective solutions. Understand and translate customer needs into business and technology solutions. Drive discussions and consult on transfor ...

Bazaarvoice Senior Software Engineer Big Data Applications

<p>About Bazaarvoice :</p><p></p><p>At Bazaarvoice, we create smart shopping experiences. Through our expansive global network, product-passionate community, and powerful enterprise technology, we connect thousands of brands and retailers with billions of consumers global ...

Database Reliability Engineer

Database Reliability EngineerDesired Experience Range: 5 - 7 yearsLocation of Requirement: BangaloreMust Have:- 3 to 5 years of experience managing relational database platforms including Oracle, SQL Server, DB2, PostgreSQL, MySQL, and AWS-hosted services (RDS, Aurora).- Experience with Terraform, Ansible is mus ...

Lead Data Engineer

Impetus is hiring Sr. GCP Lead for Bangalore/Gurgaon location. We are looking candidate should have strong experience in Bigdata, spark, pyspark, Python, GCP-Bigquery, Airflow, Dataflow, Dataproc, Pubsub, Cloud Composer, Data Storage & etc. If you have extensive experience in these technologies & wanted to part ...

Lead data engineer

Impetus is hiring Sr. GCP Lead for Bangalore/Gurgaon location. We are looking candidate should have strong experience in Bigdata, spark, pyspark, Python, GCP-Bigquery, Airflow, Dataflow, Dataproc, Pubsub, Cloud Composer, Data Storage & etc. If you have extensive experience in these technologies & wanted to part ...

Data Engineer

Impetus is hiring Jr & Sr. GCP Developers for Gurgaon & Bangalore location. We are looking with good experience in Bigdata, Spark, Pyspark, Python/Java, GCP-Bigquery, airflow, dataflow, Dataproc, Pubsub, Cloud Composer, GCS OR Cloud Storage. If you are good in all these skills please share your resume at the R ...

IN_Manager_Databricks_Data Analytics_Advisory_Bangalore

Line of ServiceAdvisory Industry/SectorNot Applicable SpecialismData, Analytics & AI Management LevelManager Job Description & SummaryAt PwC, our people in data and analytics engineering focus on leveraging advanced technologies and techniques to design and deve ...

IN_Senior Associate_Databricks Data and Analytics_Advisory_Pan India

Line of ServiceAdvisory Industry/SectorNot Applicable SpecialismData, Analytics & AI Management LevelSenior Associate Job Description & SummaryAt PwC, our people in data and analytics engineering focus on leveraging advanced technologies and techniques to design ...

Data Engineer

Role & responsibilities Design, develop, and maintain data pipelines and ETL processes using Databricks, BigQuery, and SQL. Collaborate with business and technical teams to understand data requirements and deliver high-quality solutions. Optimize data workflows for performance, s ...

Machine Learning Engineer

Job Title:ML Ops Engineer / ML EngineerExperience - 5Yrs -20 YrsLocation - Chennai / Bangalore / Hyderabad / Pune / Noida / Mumbai/Job Overview:We are looking for an experienced MLOps Engineer to help deploy, scale, and manage machine learning models in production environments. You will work ...

🚀 Boost Your Hiring Chances with Our AI-Powered Tool-Kit

Stand out from thousands of applicants. Use our proven career tools to optimize your applications and land your dream job faster.

To-Do Planner

Organize your job search and personal tasks. All data is confidential.

Open Planner

Wellbeing Center

Access your confidential wellness report and resources to manage job search stress.

Check Wellbeing

Skill Coach

Plan your skill development with O*NET support to stay competitive in your field.

Start Coaching

Outfit Helper

Get AI-powered suggestions on what to wear for your next interview.

Find Outfit

Income Tax Calculator

Plan your finances with our calculator, updated for 2025 tax regulations.

Calculate Tax

Salary Benchmark

Get accurate, AI-supported salary trends to know your worth and negotiate better.

Check Salaries

Interview Practice

Practice for any interview with AI-enabled Q&A sessions. All data is private.

Start Practicing

Interview Predictor

Use our AI-supported tool to predict potential interview questions based on your resume.

Predict Questions

Interview Practice Timer

Use our mock interview trainer to perfect your answers under timed conditions.

Start Timer

Behavioral Mastery

Ace tricky behavioral interviews with our AI-powered practice module.

Master Answers

Question Journal

Confidentially record interview questions you were asked for future reference.

Open Journal

Interview Ace

A comprehensive tool to help you master every aspect of your interviews.

Become an Ace

Q&A Logs

Confidentially track your answers to common questions and refine them over time.

View Logs

Application Planner

Schedule and organize your job applications in one confidential planner.

Open Planner

Cover Letter Tool

Create perfect, tailored cover letters for each application with AI support.

Generate Letter

Resume Score

Get instant feedback on your resume with our NLP-supported analysis tool.

Check My Score

ATS Score

Check your resume's compatibility with Applicant Tracking Systems (ATS).

Check ATS Score

Application Analyzer

Use AI to analyze job descriptions and optimize your application materials.

Analyze Application

Career Visualizer

Confidentially plan and visualize your long-term career path and goals.

Visualize My Career

Offer Genius

Get intelligent insights and strategies to confidently negotiate job offers.

Negotiate Offers

JobFlow

Track your entire job search progress from application to offer with this intelligent tool.

Track My Flow

JobSense

Our intelligent matching engine that provides smart job recommendations.

Get Smart Matches

Networking Toolkit

Tools to build and manage your professional connections. All data is confidential.

Build Network

Professional CV

A classic, O*NET supported template for corporate and professional roles.

Use This Template

Executive CV

A premium, O*NET supported template designed for senior and C-level positions.

Use This Template

Modern CV

A fresh, stylish, O*NET supported template perfect for tech and modern industries.

Use This Template

Creative CV

A visually distinct, O*NET supported template for design and artistic roles.

Use This Template

Minimalist CV

A clean, simple, O*NET supported template that focuses purely on content.

Use This Template

Europass CV

The standard European Union recommended format for wide compatibility.

Use This Template

Student CV

An institution-recommended template perfect for internships and first jobs.

Use This Template

Graduate CV

An institution-recommended template for recent graduates entering the workforce.

Use This Template

Academic CV

The researcher-recommended format for roles in academia and research.

Use This Template

Developer/IT CV

A tech-savvy recommended template to highlight your technical skills.

Use This Template

Skilled Worker CV

A trades-recommended template to showcase hands-on skills and experience.

Use This Template

Monochrome CV

A sleek, black-and-white, O*NET supported template for a professional look.

Use This Template

Art CV

An artist-recommended template that allows your creativity to shine.

Use This Template

Harvard CV

A researcher-recommended template based on the classic Harvard format.

Use This Template

Volunteer Research

Help us improve our platform by joining our community research program.

Join Research

Review Us

Share your experience with our tools to help other job seekers.

Share Experience

Register

Create your free account to save jobs, build your profile, and track applications.

Create Account

Login

Access your dashboard, manage applications, and continue your job search.

Access Your Account

Profile Builder

Create a comprehensive professional profile that attracts recruiters and showcases your skills.

Build Your Profile

View Profile

See your public profile exactly as employers will see it. Make sure it's perfect.

Preview Profile

Bookmarked Jobs

Keep track of all your saved job opportunities in one organized place.

View Saved Jobs

Your Reviews

View and manage all the company reviews you've submitted.

See Your Reviews

Following

Manage the list of companies you follow to stay updated on their new openings.

Manage Following

Find Companies

Discover and research top employers in your country and industry.

Discover Employers

Standalone CV Builder

Use our O*NET supported CV builder to create a professional resume from scratch.

Build Your CV

PDF to DOC (Beta)

Convert your PDF resumes or documents into editable Word (DOC) format.

Convert PDF

DOC to PDF (Beta)

Create universally compatible PDF documents from your Word (DOC) files.

Create PDF

General FAQ

Find answers to common questions about our job site and platform.

Read FAQ

Job Seekers FAQ

Get help and find answers to questions specifically for job seekers.

Get Help

Job Matching

Learn about the technology and algorithms behind how we match you to jobs.

Learn How

Personalized Matching

Discover how we use your profile and activity to provide customized job suggestions.

Learn More

Quick Apply

Understand our fast application process and how to make the most of it.

Learn More

Alert Frequency

Learn how to manage your job alert settings so you get the updates you want.

Manage Settings

Job Alerts Guide

A complete guide to understanding how job alerts work and how to use them effectively.

Read Guide

Resume Matching

Learn how our system matches your resume to job requirements.

Learn More

Ethical Branding

Read our guide to building a professional and ethical personal brand.

Read Guide

Candidate Visibility

Learn how to increase your visibility to recruiters on our platform.

Increase Visibility

Verified Badge

Find out how you can get a verified badge to build trust with employers.

Get Verified

AI ATS Technology

Learn about the advanced AI and ATS technology that powers our platform.

Learn More

ATS Ranking

Understand how Applicant Tracking Systems rank you as an applicant.

Learn More

Semantic Matching

Learn how our AI-powered semantic matching goes beyond keywords.

Learn More

    Data Engineer Spark Scala Python Cassandra Elasticsearch Aws Airflow Sql Jobs in Bengaluru Job Search Guide, Trends and Insights

Advance your career or build your team with Expertini's smart job platform. Connecting professionals and employers in Bengaluru, India.