Data Engineer Spark Scala Python Cassandra Elasticsearch Aws Airflow Sql Jobs in Bengaluru, India

Professional job seekers finding India jobs through Expertini
750,000+ professionals on Expertini 750,000+ Candidates
Join our global community
Expertini Penguin Mascot Resume Score™
Resume Score™ Instantly
Upload Your CV
Quick 30-second process

Apply Today & Jumpstart Your Career on Expertini, Trusted Since 2008.

Reset

Create Job Alert

 
   
Reset

Data Engineer

Job Description POSITION: Senior Associate, reporting to Associate Director - Engineering, will play an essential role in designing, developing, and maintaining scalable data pipelines and data infrastructure. You will work closely with data scientists, analysts, and other stakeholders ...

Data Engineer

Job DescriptionPOSITION: Senior Associate, reporting to Associate Director - Engineering, will play an essential role in designing, developing, and maintaining scalable data pipelines and data infrastructure. You will work closely with data scientists, analysts, and other stakeholders to ...

Odoo Architect High Complexity

Position Description: Job Title: Odoo ArchitectPosition: Manager Consulting ExpertExperience: 12+YearsCategory: Software Development/ EngineeringMain location: All CGI Locations + NoidaPosition ID: J-Employment Type: Full TimeJob Description :<br ...

Odoo Architect High Complexity

Position Description: Job Title: Odoo ArchitectPosition: Manager Consulting ExpertExperience: 12+YearsCategory: Software Development/ EngineeringMain location: All CGI Locations + NoidaPosition ID: J-Employment Type: Full TimeJob Description :T ...

Lucideus Technologies Staff Data Engineer ETL/Snowflake DB

<p><p>What Youll Do :</p><p></p><p>- Be the Data Tech Leader: Mentor engineers, champion data engineering best practices, and raise the bar for technical excellence across the org.</p><p>- Architect at Scale: Desi ...

Databricks Lead/Architect

Experience: 9+ yearsLocation : Bangalore, Chennai, Gurugram, Kolkata, PuneSkills and Qualifications :Bachelor's and/or masters degree in computer science or equivalent experience.Must have total 9+ yrs. of IT experience and 3+ years' experience in Data warehouse/ETL projects.Deep understandi ...

Sr. Data Engineer

Company Description Visa is a world leader in payments and technology, with over 259 billion payments transactions flowing safely between consumers, merchants, financial institutions, and government entities in more than 200 countries and territories each year. Our mission is to connect the world throu ...

Lead PySpark Data Engineer _ Exp: 7+ Years

Job Description:Roles and Responsibility:Build and maintain all facets of Data Pipelines for Data Engineering team.Build the pipelines required for optimal extraction, transformation, and loading of data from a wide variety of data sources using Spark, Python and Airflow.Work with internal and extern ...

Lead PySpark Data Engineer _ Exp: 7+ Years

Job Description:Roles and Responsibility:Build and maintain all facets of Data Pipelines for Data Engineering team.Build the pipelines required for optimal extraction, transformation, and loading of data from a wide variety of data sources using Spark, Python and Airflow.Work with internal and extern ...

Databricks Lead/Architect

Experience: 9+ yearsLocation: Bangalore, Chennai, Gurugram, Kolkata, PuneSkills and Qualifications:- Bachelor's and/or masters degree in computer science or equivalent experience.- Must have total 9+ yrs. of IT experience and 3+ years' experience in Data warehouse/ETL projects.- Deep understa ...

Databricks Lead/Architect

Experience: 9+ yearsLocation: Bangalore, Chennai, Gurugram, Kolkata, PuneSkills and Qualifications:- Bachelor's and/or masters degree in computer science or equivalent experience.- Must have total 9+ yrs. of IT experience and 3+ years' experience in Data warehouse/ETL projects.- Deep understa ...

GCP Data Engineer

Job Title: GCP Data EngineerLocation: BengaluruExperience: 3-8 yearsAbout the Role:Design, build, and maintain large-scale data pipelines on BigQuery and other Google Cloud Platform (GCP) services.Use Python and PySpark/Spark to transform, clean, aggregate and prepare data for analytics/ML.Orchestrate workflo ...

Backend Developer

IMMEDIATE JOINER Job Description Backend & MLOps Engineer – Integration, API, and Infrastructure Expert 1.⁠ ⁠Role Objective: Responsible for building robust backend infrastructure, managing ML operations, and creating scalable APIs for AI applications. Must excel in deploying and m ...

Data Engineer

Job description- Role- Data Engineer Experience- 3-7 Years Work Mode- 5 Days working Location - Bangalore Who we are looking for : Strong background in data processing and software engineering, with the ability to build high-quality, scalable, d ...

Lead Software Engineer

Lead Software Engineer – Backend We’re seeking a Lead Software Engineer to join one of our Data Layer teams. As the name implies, the Data Layer is at the core of all things data at Zeta. Our responsibilities include: • Developing and maintaining the Zeta Identity Graph platform, wh ...

Lead Software Engineer

Lead Software Engineer – Backend We're seeking a Lead Software Engineer to join one of our Data Layer teams. As the name implies, the Data Layer is at the core of all things data at Zeta. Our responsibilities include: • Developing and maintaining the Zeta Identity Graph platform, which ...

Lead Software Engineer

Lead Software Engineer – BackendResponsibilitiesWe're seeking a Lead Software Engineer to join one of our Data Layer teams. As the name implies, the Data Layer is at the core of all things data at Zeta. Our responsibilities include: Developing and maintaining the Zeta Identity Graph platfo ...

Lead Software Engineer

Lead Software Engineer – Backend We're seeking a Lead Software Engineer to join one of our Data Layer teams. As the name implies, the Data Layer is at the core of all things data at Zeta. Our responsibilities include: • Developing and maintaining the Zeta Identity Graph platform, which col ...

Python/Aws

Python + AWS Requirements JOB Description – Python + AWS. We are hiring for Python + AWS  Possess strong proficiency in Python programming language with a consistent record of developing robust applications.  Demonstrate expertise in AWS services i ...

Python/Aws

Python + AWS Requirements JOB Description – Python + AWS. We are hiring for Python + AWS  Possess strong proficiency in Python programming language with a consistent record of developing robust applications.  Demonstrate expertise in AWS services including EC2 S3 La ...

Python + AWS

Senior Python Developer Technologies Python AWS Responsibilities Design and develop scalable backend systems using Python Build and maintain RESTful APIs for seamless integration with frontend and third party services Write clean efficient and maintainable code following bes ...

Python/Aws

Python + AWSRequirementsJOB Description – Python + AWS.We are hiring for Python + AWS Possess strong proficiency in Python programming language with a consistent record ofdeveloping robust applications. Demonstrate expertise in AWS services includin ...

Director, Machine Learning

Job Title: Director, Machine Learning Location: Bengaluru, India Experience: 9+ years in Machine Learning, including 3+ years of leadership experience (managing teams of 7+ members) Compensation: Open for the right candidate About the Company Our client ...

Big Data Engineer – Spark, Kafka

Job description: Your Experience 5 years of experience in large scale realtime stream processing using Apache Spark with messaging infrastructure like KafkaPulsar 7 years of experience on Data Pipeline development ETL and processing of structured and unstructured data 5 years of ex ...

Senior Data Engineer Spark/Hadoop

<p><p>Description : </p><p></p><p>Job description :</p><p></p><p>The Sr Data Engineer is an experienced data pipeline builder and data wrangler who enjoys optimizing data systems or building ne ...

Databricks Technical Lead/ Data Architect

Role: Senior Databricks Engineer / Databricks Technical Lead/ Data Architect Experience: 9-15 years Location: Bangalore Skills and Qualifications: Bachelor's and/or masters degree in computer science or equivalent experience. Must have total 9+ yrs. of IT experience a ...

Data Engineer I

Data Engineer I Summary We are hiring a Data Engineer I with 2–3 years of experience to strengthen the Data Engineering team’s operational capacity, support recurring business data needs, and enable the team’s focus on long-term st ...

Data Engineer I

Data Engineer ISummaryWe are hiring a Data Engineer I with 2–3 years of experience to strengthen the Data Engineering team’s operational capacity, support recurring business data needs, and enable the team’s focus on lon ...

Josys Senior Data Engineer PySpark/Scala

<p><p>Location : Bengaluru, Karnataka, India.</p><p>About The Role : </p><p></p><p>We're looking for an experienced Senior Data Engineer (6-8 years) to join our data team. You'll be key in building and maintaining ...

Senior Software Engineer

About Cognite Embark on a transformative journey with Cognite, a global SaaS forerunner in leveraging AI and data to unravel complex business challenges through our cutting-edge offerings including Cognite Atlas AI, an industrial agent workbench, and the Cognite Data Fusion (CDF) platform. We were awarde ...

Backend Dev Engineer

Job description Backend & MLOps Engineer – Integration, API, and Infrastructure Expert 1.⁠ ⁠Role Objective: Responsible for building robust backend infrastructure, managing ML operations, and creating scalable APIs for AI applications. Must excel in deploying and maintaining AI products i ...

SENIOR DATA ENGINER

Primary Roles and Responsibilities: Developing Modern Data Warehouse solutions using Databricks and Azure Stack Ability to provide solutions that are forward-thinking in data engineering and analytics space Collaborate with DW/BI leads to ...

Data Engineer Azure Databricks/Apache Spark

<p><p>Description :Responsibilities :Data Engineering & Architecture :- Design and implement scalable and optimized data pipelines on Databricks using Delta Lake, PySpark, and SQL.&l ...

Senior Data Engineer

Join our dynamic team at the forefront of cutting-edge technology as we seek a seasoned Senior Data Engineer. Embark on a journey where your deep-rooted expertise in computer science fundamentals, alongside an intricate understanding of data structures, algorithms, and system design, becomes the cornersto ...

Business Intelligence Engineer

Key Responsibilities Design, build, and maintain robust ETL/ELT pipelines to process large volumes of streaming and batch data from Creator Success platform Develop and optimize data warehouses, data lakes, and real-time analytics systems using AWS services (Redshift, S3, Kinesis, EMR, Glue) </p ...

Full Stack Developer (Python+Airflow)

Project Description:The primary objective is to develop based on client requirements in the Telecom/network work environmentResponsibilities:A developer with experience in the back end using the technologies listed.Knowledge in SAFe/Agile methodologies, Knowledge of RDBMS, Knowledge in DevOps, Az ...

Full Stack Developer (Python+Airflow)

Project Description:The primary objective is to develop based on client requirements in the Telecom/network work environmentResponsibilities:A developer with experience in the back end using the technologies listed.Knowledge in SAFe/Agile methodologies, Knowledge of RDBMS, Knowledge in DevOps, Az ...

Senior Software Engineer AI/ML Backend Developer

Company Profile:Founded in 1976, CGI is among the largest independent IT and business consulting services firms in the world. With 94,000 consultants and professionals across the globe, CGI delivers an end-to-end portfolio of capabilities, from strategic IT and business consulting to systems integration, ...

senior data scientist

Loc: Manyata Tech Park Exp: 2-5 yrs, AI/ML Engineer Skills Required: ? Exp. with Data engineering & Data/ML pipelines for Analytics & AI/ML Models ? Working with large sets of structured & unstructured data from disparate sources ? Foundational acquaintance of Data Science & AI/ML models ? SQL, Python, Spark, ...

SENIOR DATA ENGINER

Primary Roles and Responsibilities: Developing Modern Data Warehouse solutions using Databricks and Azure Stack Ability to provide solutions that are forward-thinking in data engineering and analytics space Collaborate with DW/BI leads to u ...

SENIOR DATA ENGINER

Primary Roles and Responsibilities:Developing Modern Data Warehouse solutions using Databricks and Azure StackAbility to provide solutions that are forward-thinking in data engineering and analytics spaceCollaborate with DW/BI leads t ...

SENIOR DATA ENGINER

Primary Roles and Responsibilities:Developing Modern Data Warehouse solutions using Databricks and Azure StackAbility to provide solutions that are forward-thinking in data engineering and analytics spaceCollaborate with DW/BI leads to understa ...

Senior Data Enginer

Primary Roles and Responsibilities: Developing Modern Data Warehouse solutions using Databricks and Azure Stack Ability to provide solutions that are forward-thinking in data engineering and analytics space Collaborate with DW/BI leads to ...

SENIOR DATA ENGINER

Primary Roles and Responsibilities: Developing Modern Data Warehouse solutions using Databricks and Azure Stack Ability to provide solutions that are forward-thinking in data engineering and analytics space Collaborate with DW/BI leads to ...

SENIOR DATA ENGINER

Primary Roles and Responsibilities:Developing Modern Data Warehouse solutions using Databricks and Azure StackAbility to provide solutions that are forward-thinking in data engineering and analytics spaceCollaborate with DW/BI leads t ...

SENIOR DATA ENGINER

Primary Roles and Responsibilities: Developing Modern Data Warehouse solutions using Databricks and Azure Stack Ability to provide solutions that are forward-thinking in data engineering and analytics space Collaborate with DW/BI leads to understand ...

Principal Data Pipeline Developer

Primary Roles and Responsibilities:Developing Modern Data Warehouse solutions using Databricks and Azure StackAbility to provide solutions that are forward-thinking in data engineering and analytics spaceCollaborate with DW/BI leads to u ...

Senior Data Enginer

Primary Roles and Responsibilities:Developing Modern Data Warehouse solutions using Databricks and Azure StackAbility to provide solutions that are forward-thinking in data engineering and analytics spaceCollaborate with DW/BI leads to u ...

SENIOR DATA ENGINER

Primary Roles and Responsibilities: Developing Modern Data Warehouse solutions using Databricks and Azure Stack Ability to provide solutions that are forward-thinking in data engineering and analytics space Collaborate with DW/BI leads to understand new ETL pipe ...

Big data developer

Experience: 5 - 9 Years Location: Bangalore/Pune/Hyderabad Work Mode: WFO (Hybrid) Note: Should be open for short/medium-term travel opportunities within India & foreign location Focus: Building applications and solutions Writes code and develops software applications that process big data Creat ...

🚀 Boost Your Hiring Chances with Our AI-Powered Tool-Kit

Stand out from thousands of applicants. Use our proven career tools to optimize your applications and land your dream job faster.

To-Do Planner

Organize your job search and personal tasks. All data is confidential.

Open Planner

Wellbeing Center

Access your confidential wellness report and resources to manage job search stress.

Check Wellbeing

Skill Coach

Plan your skill development with O*NET support to stay competitive in your field.

Start Coaching

Outfit Helper

Get AI-powered suggestions on what to wear for your next interview.

Find Outfit

Income Tax Calculator

Plan your finances with our calculator, updated for 2025 tax regulations.

Calculate Tax

Salary Benchmark

Get accurate, AI-supported salary trends to know your worth and negotiate better.

Check Salaries

Interview Practice

Practice for any interview with AI-enabled Q&A sessions. All data is private.

Start Practicing

Interview Predictor

Use our AI-supported tool to predict potential interview questions based on your resume.

Predict Questions

Interview Practice Timer

Use our mock interview trainer to perfect your answers under timed conditions.

Start Timer

Behavioral Mastery

Ace tricky behavioral interviews with our AI-powered practice module.

Master Answers

Question Journal

Confidentially record interview questions you were asked for future reference.

Open Journal

Interview Ace

A comprehensive tool to help you master every aspect of your interviews.

Become an Ace

Q&A Logs

Confidentially track your answers to common questions and refine them over time.

View Logs

Application Planner

Schedule and organize your job applications in one confidential planner.

Open Planner

Cover Letter Tool

Create perfect, tailored cover letters for each application with AI support.

Generate Letter

Resume Score

Get instant feedback on your resume with our NLP-supported analysis tool.

Check My Score

ATS Score

Check your resume's compatibility with Applicant Tracking Systems (ATS).

Check ATS Score

Application Analyzer

Use AI to analyze job descriptions and optimize your application materials.

Analyze Application

Career Visualizer

Confidentially plan and visualize your long-term career path and goals.

Visualize My Career

Offer Genius

Get intelligent insights and strategies to confidently negotiate job offers.

Negotiate Offers

JobFlow

Track your entire job search progress from application to offer with this intelligent tool.

Track My Flow

JobSense

Our intelligent matching engine that provides smart job recommendations.

Get Smart Matches

Networking Toolkit

Tools to build and manage your professional connections. All data is confidential.

Build Network

Professional CV

A classic, O*NET supported template for corporate and professional roles.

Use This Template

Executive CV

A premium, O*NET supported template designed for senior and C-level positions.

Use This Template

Modern CV

A fresh, stylish, O*NET supported template perfect for tech and modern industries.

Use This Template

Creative CV

A visually distinct, O*NET supported template for design and artistic roles.

Use This Template

Minimalist CV

A clean, simple, O*NET supported template that focuses purely on content.

Use This Template

Europass CV

The standard European Union recommended format for wide compatibility.

Use This Template

Student CV

An institution-recommended template perfect for internships and first jobs.

Use This Template

Graduate CV

An institution-recommended template for recent graduates entering the workforce.

Use This Template

Academic CV

The researcher-recommended format for roles in academia and research.

Use This Template

Developer/IT CV

A tech-savvy recommended template to highlight your technical skills.

Use This Template

Skilled Worker CV

A trades-recommended template to showcase hands-on skills and experience.

Use This Template

Monochrome CV

A sleek, black-and-white, O*NET supported template for a professional look.

Use This Template

Art CV

An artist-recommended template that allows your creativity to shine.

Use This Template

Harvard CV

A researcher-recommended template based on the classic Harvard format.

Use This Template

Volunteer Research

Help us improve our platform by joining our community research program.

Join Research

Review Us

Share your experience with our tools to help other job seekers.

Share Experience

Register

Create your free account to save jobs, build your profile, and track applications.

Create Account

Login

Access your dashboard, manage applications, and continue your job search.

Access Your Account

Profile Builder

Create a comprehensive professional profile that attracts recruiters and showcases your skills.

Build Your Profile

View Profile

See your public profile exactly as employers will see it. Make sure it's perfect.

Preview Profile

Bookmarked Jobs

Keep track of all your saved job opportunities in one organized place.

View Saved Jobs

Your Reviews

View and manage all the company reviews you've submitted.

See Your Reviews

Following

Manage the list of companies you follow to stay updated on their new openings.

Manage Following

Find Companies

Discover and research top employers in your country and industry.

Discover Employers

Standalone CV Builder

Use our O*NET supported CV builder to create a professional resume from scratch.

Build Your CV

PDF to DOC (Beta)

Convert your PDF resumes or documents into editable Word (DOC) format.

Convert PDF

DOC to PDF (Beta)

Create universally compatible PDF documents from your Word (DOC) files.

Create PDF

General FAQ

Find answers to common questions about our job site and platform.

Read FAQ

Job Seekers FAQ

Get help and find answers to questions specifically for job seekers.

Get Help

Job Matching

Learn about the technology and algorithms behind how we match you to jobs.

Learn How

Personalized Matching

Discover how we use your profile and activity to provide customized job suggestions.

Learn More

Quick Apply

Understand our fast application process and how to make the most of it.

Learn More

Alert Frequency

Learn how to manage your job alert settings so you get the updates you want.

Manage Settings

Job Alerts Guide

A complete guide to understanding how job alerts work and how to use them effectively.

Read Guide

Resume Matching

Learn how our system matches your resume to job requirements.

Learn More

Ethical Branding

Read our guide to building a professional and ethical personal brand.

Read Guide

Candidate Visibility

Learn how to increase your visibility to recruiters on our platform.

Increase Visibility

Verified Badge

Find out how you can get a verified badge to build trust with employers.

Get Verified

AI ATS Technology

Learn about the advanced AI and ATS technology that powers our platform.

Learn More

ATS Ranking

Understand how Applicant Tracking Systems rank you as an applicant.

Learn More

Semantic Matching

Learn how our AI-powered semantic matching goes beyond keywords.

Learn More

    Data Engineer Spark Scala Python Cassandra Elasticsearch Aws Airflow Sql Jobs in Bengaluru Job Search Guide, Trends and Insights

Advance your career or build your team with Expertini's smart job platform. Connecting professionals and employers in Bengaluru, India.