Data Engineer Spark Scala Python Cassandra Elasticsearch Aws Airflow Sql Jobs in Bengaluru, India

Professional job seekers finding India jobs through Expertini
750,000+ professionals on Expertini 750,000+ Candidates
Join our global community
Expertini Penguin Mascot Resume Score™
Resume Score™ Instantly
Upload Your CV
Quick 30-second process

Apply Today & Jumpstart Your Career on Expertini, Trusted Since 2008.

Reset

Create Job Alert

 
   
Reset

Lead Data Engineer

Job Id: R0000397566 About us:Working at Target means helping all families discover the joy of everyday life. We bring that vision to life through our values and culture.Learn more about Target here.About the Role:As aLead Data Engineer, you will serve as thete ...

Azure Devops

Roles and Responsibility The DevOps Lead will work in conjunction with the technical leadership to strategize the company’s cloud roadmap to improve business agility and provide modern delivery solutions. The candidate should be able to show exemplary leadership and management traits to ensure the high ...

Azure Devops

Roles and Responsibility The DevOps Lead will work in conjunction with the technical leadership to strategize the company’s cloud roadmap to improve business agility and provide modern delivery solutions. The candidate should be able to show exemplary leadership and management traits to ensure the highe ...

Phyton, Airflow Analyst

Position Description: Company Profile:Founded in , CGI is among the largest independent IT and business consulting services firms in the world. With 94, consultants and professionals across the globe, CGI delivers an end-to-end portfolio of capabilities, from strategic IT and busi ...

Apache Airflow Developer

Job Summary (Apache Airflow Developer)Mandatory Skills Required: Airflow And Python and AWS and Autosys(Optional) Experience Required:4+ years of relevant experience Location: India Notice Period: Immediate joiners to 30 days Analyze and migrate existing Au ...

Phyton, Airflow Analyst

Position Description: Company Profile:Founded in , CGI is among the largest independent IT and business consulting services firms in the world. With 94, consultants and professionals across the globe, CGI delivers an end-to-end portfolio of capabilities, from strategic IT and busines ...

Web Scraping Engineer

Job title: Web Scraping EngineerLocation: GurgaonAbout the RoleWe are looking for a Web Scraping Engineer with proven experience in building, maintaining, and scaling data extraction systems - especially from e-commerce platforms .The ideal candidate will design and implement robust scrapers t ...

Pyspark developer

The ideal candidate will be responsible for developing high-quality applications. They will also be responsible for designing and implementing testable and scalable code.Functional Skills: Experience in Credit Risk/Regulatory risk domain Technical Skills: Spark ,PySpark, Python, Hive, Scala, MapReduce, Unix ...

Principal Software Engineer I DP

At Curriculum Associates, we believe in the potential of every child and are changing the face of education technology with award-winning learning programs like i-Ready that serve a third of the nation’s K–8 students. For more than 50 years, our commitment to making classrooms better places, serving educators ...

Principal Software Engineer I DP

At Curriculum Associates, we believe in the potential of every child and are changing the face of education technology with award-winning learning programs like i-Ready that serve a third of the nation’s K–8 students. For more than 50 years, our commitment to making classrooms better places, serving educators ...

Data Engineer

Experience - 5 + YearsSkills- Snowflakes + AWSAbout the RoleWe are seeking a highly skilled Snowflake + AWS Engineer with strong expertise in cloud-based data engineering, ETL pipeline development, and modern data warehouse architecture. The ideal candidate will have a prove ...

Azure Data Engineer

Position Description: Azure ETL Data Engineer - 2-6 YearsJob Description for Azure ETL Data Engineer:• Design and develop ETL processes based on functional and non-functional requirements in Azure platform• Design and develop migration process from SQL Server to Azure platform• Un ...

Technical Lead Data Engineering

<p><p>Description:</p><p>We are looking for a skilled Data Engineer with 9+ years of experience in big data technologies, particularly Azure, Python, PYSpark, SQL and data lakehouse architectures. The ideal candidate will have a strong background in building ...

Data Engineer

5+ years of experience in data engineering, data analysis, and/or data architecture Strong expertise in SQL and Python · Databricks, Snowflake, Power BI Expereince with distributed data systems such as Hadoop, Spark Experience with Cloud platforms such as Snowflake, Bi ...

Snowflake Solution architect

Job Title: Snowflake Solution ArchitectExperience: 12 to 15 YearsLocation: (Specify – Onsite/Hybrid/Remote)Employment Type: Full-time / PermanentJob Summary:We are looking for an experienced Snowflake Solution Architect to design, implement, and optimize enterprise data solutions using Snowflake on cloud platfor ...

Cloud Engineer

Responsibilities- Good to have Docker and Kubernetes knowledge for troubleshooting clusters and managing container images.- Good to have CI/CD deployment knowledge, GitHub Workflows, YAML Pipelines.- Good Knowledge of API troubleshoot management.- Good to have PowerShell Scripting knowledge.- Should have worked ...

Pyspark developer

The ideal candidate will be responsible for developing high-quality applications. They will also be responsible for designing and implementing testable and scalable code.Functional Skills: Experience in Credit Risk/Regulatory risk domain Technical Skills: Spark ,PySpark, Python, Hive, Scala, MapReduce, Unix shel ...

Data Engineer

We're seeking an exceptional Data Engineer to join our Risk and Compliance Solutions (RCS) Data Engineering team, where you'll architect and build data systems that power Amazon's compliance operations. This role combines technical expertise with business acumen to transform complex data into actionable insights ...

Data Engineer

We're seeking an exceptional Data Engineer to join our Risk and Compliance Solutions (RCS) Data Engineering team, where you'll architect and build data systems that power Amazon's compliance operations. This role combines technical expertise with business acumen to transform complex data into actionable insights ...

Algonomy Lead/Principal Software Engineer Data Management

<p>Designation : Lead / Principal Software Engineer. Experience : 12+ Years. Location : Bangalore. Education: B.E/B.Tech/Masters. At Algonomy, we believe the future of our economy is Algorithmic, where businesses will d ...

Azure Data Engineer SSE

Position Description: Company Profile:At CGI, we’re a team of builders. We call our employees members because all who join CGI are building their own company - one that has grown to 72, professionals located in 40 countries. Founded in , CGI is a leading IT and business proce ...

Azure Data Engineer SSE

Position Description: Company Profile:At CGI, we’re a team of builders. We call our employees members because all who join CGI are building their own company - one that has grown to 72, professionals located in 40 countries. Founded in , CGI is a leading IT and business process ...

Data Engineer

Sr. Data Engineer Location: Bangalore /Coimbatore Job Type: Full-Time Required Skills and Qualifications: 8+ years of experience in Data Engineering and Analytics, with at least 2+ years in a leadership role. Proven experienc ...

Data Engineer , Retail Business Service

DescriptionJob summaryRetail Business Services (RBS) supports Amazon’s Retail business growth WW through three core tasks. These are (a) Selection, where RBS sources, creates and enrich ASINs to drive GMS growth; (b) Defect Elimination: where RBS resolves inbound supply chain defects and develops root ca ...

Data Engineer , Retail Business Service

DescriptionJob summaryRetail Business Services (RBS) supports Amazon’s Retail business growth WW through three core tasks. These are (a) Selection, where RBS sources, creates and enrich ASINs to drive GMS growth; (b) Defect Elimination: where RBS resolves inbound supply chain defects and develops root ca ...

Sr Data Engineer_Kripa_Accion Labs

Must have :-5+ years of experience in data engineering with an emphasis on data analytics and reporting.2+ years of experience with at least one of the following cloud platforms: Microsoft Azure, Amazon Web Services (AWS), Google Cloud Platform (GCP), others.3+ years of experience in SQL, data transf ...

Data Engineer , Retail Business Service

DescriptionJob summary Retail Business Services (RBS) supports Amazon’s Retail business growth WW through three core tasks. These are (a) Selection, where RBS sources, creates and enrich ASINs to drive GMS growth; (b) Defect Elimination: where RBS resolves inbound supply chain defects and develo ...

Data Engineer , Retail Business Service

DescriptionJob summary Retail Business Services (RBS) supports Amazon’s Retail business growth WW through three core tasks. These are (a) Selection, where RBS sources, creates and enrich ASINs to drive GMS growth; (b) Defect Elimination: where RBS resolves inbound supply chain defects and develo ...

Data Engineer

JD Data Engineer This is a full-time position with D Square Consulting Services Pvt Ltd Location: pan-india (Hybrid) Experience: 5+ years Notice Period: Candidates available to join immediately Job Summary We are seeking a skilled ...

Data Engineer

JD Data EngineerThis is a full-time position with D Square Consulting Services Pvt LtdLocation: pan-india (Hybrid)Experience: 5+ yearsNotice Period: Candidates available to join immediatelyJob SummaryWe are seeking a skilled and expe ...

SDE 2

Job Title: Software Development Engineer II (Backend) Experience: 3-6 years Location: Bangalore Tech Stack: , Python, AWS/GCP, MongoDB, PostgreSQL, ElasticSearch, Redis, Kubernetes, Docker, Queues About The RoleWe're looking for an experienced Backend Engineer (SDE II) who can ...

Publicis Sapient Senior Data Engineer

<p>Senior Associate Data Engineering Level 2The Senior Associate People Senior Associate L2 in Data Engineering, you will translate client requirements into technical design, and implement components for data engineering solution. Utilize deep understanding of data ...

Staff Software Engineer

Staff, Software EngineerAbout Business Unit:The Product team forms the crux of our powerful platforms and helps connect millions of customers worldwide with the brands that matter most to them. This team of innovative problem solvers develops and builds products that pos ...

Staff Software Engineer

Staff, Software Engineer About Business Unit: The Product team forms the crux of our powerful platforms and helps connect millions of customers worldwide with the brands that matter most to them. This team of innovative problem solvers develops and builds products that ...

Staff Software Engineer

Staff, Software Engineer About Business Unit: The Product team forms the crux of our powerful platforms and helps connect millions of customers worldwide with the brands that matter most to them. This team of innovative problem solvers develops and ...

Staff Software Engineer

Staff, Software Engineer About Business Unit: The Product team forms the crux of our powerful platforms and helps connect millions of customers worldwide with the brands that matter most to them. This team of innovative problem solvers develops and ...

Staff Software Engineer

Staff, Software EngineerAbout Business Unit:The Product team forms the crux of our powerful platforms and helps connect millions of customers worldwide with the brands that matter most to them. This team of innovative problem solvers develops and builds products that p ...

Senior Software Engineer

NVIDIA is searching for a highly motivated software engineer for the NVIDIA NetQ team that is building a next gen Network management and Telemetry system in cloud using modern design principles at internet scale. NVIDIA NetQ is a highly scalable, modern network operations toolset that provides visibility, tro ...

Devops Consultant

Role & responsibilities Direct Responsibilities Design and develop real-time and batch data pipelines using tools like Apache NiFi, Apache Kafka, and Apache Airflow. Implement and maintain ETL/ELT processes, ensuring data quality and integrity across various data sources. ...

Data Engineer I, Amazon Music IDEA

DescriptionWe are seeking an ambitious Data Engineer to join our Metrics and Data Platform team. The Metrics and Data Platform team plays a critical role in enabling Amazon Music’s business decisions and data-driven software development by collecting and providing behavioral and operational metrics to our in ...

Python Engineer

We are looking for a skilled Data Engineer with strong Python expertise to design, build, and maintain efficient data pipelines and systems. The ideal candidate should be comfortable handling large datasets, integrating data from multiple sources, and working with modern data engineering frameworks. Ke ...

Data Engineer I, Music

We are seeking an ambitious Data Engineer to join our Metrics and Data Platform team. The Metrics and Data Platform team plays a critical role in enabling Amazon Music's business decisions and data-driven software development by collecting and providing behavioral and operational metrics to our internal teams. W ...

Data Engineer I, Music

DESCRIPTION We are seeking an ambitious Data Engineer to join our Metrics and Data Platform team. The Metrics and Data Platform team plays a critical role in enabling Amazon Music's business decisions and data-driven software development by collecting and providing behavioral and operational metr ...

Azure Databricks Engineer

<p><p>Role : Azure Databricks.Exp : 6+yrs.Location : Any Hyderabad, Chennai , Bangalore , Pune , Noida, Gurgaon are preferred.3 must Skills : Azure, Notebooks, ...

Bigdata Developer

About Us “Quess IT Staffing is India’s largest IT staffing company with over 20 years of experience in staffing IT professionals in 300+ companies across levels and skillsets. Our 10,000+ associates deployed in 80+ cities and towns are proficient in over 500 technological skills. Our associates help enable cutti ...

Bigdata Developer

About Us “Quess IT Staffing is India’s largest IT staffing company with over 20 years of experience in staffing IT professionals in 300+ companies across levels and skillsets. Our 10,000+ associates deployed in 80+ cities and towns are proficient in over 500 technological skills. Our associates help enable cutti ...

Machine Learning Engineer

Job Title: Machine Learning Engineer Location: Bengaluru (Hybrid) Experience: 2-6 years About Wissen Infotech Wissen Infotech has been a trusted leader in the IT Services industry for over 25 years, delivering high-quality solutions to a global clientele. Within Wissen, ...

Principal Architect

Role: Principal Architect Reports to: Global Head of Technology (SVP Engineering)Location: Bengaluru (hybrid)Function: Platform & Product Architecture (Cloud-Native Data/SaaS) About Reltio At Reltio, we believe data should fuel business success. Reltio's AI-powered data uni ...

Fabric Data Engineer (Remote)

Thinkgrid Labs is at the forefront of innovation and technology. Our expert team of software engineers, architects, and UI/UX designers specialises in crafting bespoke web, mobile, cloud applications, data platforms along with AI solutions and intelligent bots. Thinkgrid Labs is expanding our data practice to ...

Fabric Data Engineer (Remote)

Thinkgrid Labs is at the forefront of innovation and technology. Our expert team of software engineers, architects, and UI/UX designers specialises in crafting bespoke web, mobile, cloud applications, data platforms along with AI solutions and intelligent bots. Thinkgrid Labs is expanding our data practice to ...

🚀 Boost Your Hiring Chances with Our AI-Powered Tool-Kit

Stand out from thousands of applicants. Use our proven career tools to optimize your applications and land your dream job faster.

To-Do Planner

Organize your job search and personal tasks. All data is confidential.

Open Planner

Wellbeing Center

Access your confidential wellness report and resources to manage job search stress.

Check Wellbeing

Skill Coach

Plan your skill development with O*NET support to stay competitive in your field.

Start Coaching

Outfit Helper

Get AI-powered suggestions on what to wear for your next interview.

Find Outfit

Income Tax Calculator

Plan your finances with our calculator, updated for 2025 tax regulations.

Calculate Tax

Salary Benchmark

Get accurate, AI-supported salary trends to know your worth and negotiate better.

Check Salaries

Interview Practice

Practice for any interview with AI-enabled Q&A sessions. All data is private.

Start Practicing

Interview Predictor

Use our AI-supported tool to predict potential interview questions based on your resume.

Predict Questions

Interview Practice Timer

Use our mock interview trainer to perfect your answers under timed conditions.

Start Timer

Behavioral Mastery

Ace tricky behavioral interviews with our AI-powered practice module.

Master Answers

Question Journal

Confidentially record interview questions you were asked for future reference.

Open Journal

Interview Ace

A comprehensive tool to help you master every aspect of your interviews.

Become an Ace

Q&A Logs

Confidentially track your answers to common questions and refine them over time.

View Logs

Application Planner

Schedule and organize your job applications in one confidential planner.

Open Planner

Cover Letter Tool

Create perfect, tailored cover letters for each application with AI support.

Generate Letter

Resume Score

Get instant feedback on your resume with our NLP-supported analysis tool.

Check My Score

ATS Score

Check your resume's compatibility with Applicant Tracking Systems (ATS).

Check ATS Score

Application Analyzer

Use AI to analyze job descriptions and optimize your application materials.

Analyze Application

Career Visualizer

Confidentially plan and visualize your long-term career path and goals.

Visualize My Career

Offer Genius

Get intelligent insights and strategies to confidently negotiate job offers.

Negotiate Offers

JobFlow

Track your entire job search progress from application to offer with this intelligent tool.

Track My Flow

JobSense

Our intelligent matching engine that provides smart job recommendations.

Get Smart Matches

Networking Toolkit

Tools to build and manage your professional connections. All data is confidential.

Build Network

Professional CV

A classic, O*NET supported template for corporate and professional roles.

Use This Template

Executive CV

A premium, O*NET supported template designed for senior and C-level positions.

Use This Template

Modern CV

A fresh, stylish, O*NET supported template perfect for tech and modern industries.

Use This Template

Creative CV

A visually distinct, O*NET supported template for design and artistic roles.

Use This Template

Minimalist CV

A clean, simple, O*NET supported template that focuses purely on content.

Use This Template

Europass CV

The standard European Union recommended format for wide compatibility.

Use This Template

Student CV

An institution-recommended template perfect for internships and first jobs.

Use This Template

Graduate CV

An institution-recommended template for recent graduates entering the workforce.

Use This Template

Academic CV

The researcher-recommended format for roles in academia and research.

Use This Template

Developer/IT CV

A tech-savvy recommended template to highlight your technical skills.

Use This Template

Skilled Worker CV

A trades-recommended template to showcase hands-on skills and experience.

Use This Template

Monochrome CV

A sleek, black-and-white, O*NET supported template for a professional look.

Use This Template

Art CV

An artist-recommended template that allows your creativity to shine.

Use This Template

Harvard CV

A researcher-recommended template based on the classic Harvard format.

Use This Template

Volunteer Research

Help us improve our platform by joining our community research program.

Join Research

Review Us

Share your experience with our tools to help other job seekers.

Share Experience

Register

Create your free account to save jobs, build your profile, and track applications.

Create Account

Login

Access your dashboard, manage applications, and continue your job search.

Access Your Account

Profile Builder

Create a comprehensive professional profile that attracts recruiters and showcases your skills.

Build Your Profile

View Profile

See your public profile exactly as employers will see it. Make sure it's perfect.

Preview Profile

Bookmarked Jobs

Keep track of all your saved job opportunities in one organized place.

View Saved Jobs

Your Reviews

View and manage all the company reviews you've submitted.

See Your Reviews

Following

Manage the list of companies you follow to stay updated on their new openings.

Manage Following

Find Companies

Discover and research top employers in your country and industry.

Discover Employers

Standalone CV Builder

Use our O*NET supported CV builder to create a professional resume from scratch.

Build Your CV

PDF to DOC (Beta)

Convert your PDF resumes or documents into editable Word (DOC) format.

Convert PDF

DOC to PDF (Beta)

Create universally compatible PDF documents from your Word (DOC) files.

Create PDF

General FAQ

Find answers to common questions about our job site and platform.

Read FAQ

Job Seekers FAQ

Get help and find answers to questions specifically for job seekers.

Get Help

Job Matching

Learn about the technology and algorithms behind how we match you to jobs.

Learn How

Personalized Matching

Discover how we use your profile and activity to provide customized job suggestions.

Learn More

Quick Apply

Understand our fast application process and how to make the most of it.

Learn More

Alert Frequency

Learn how to manage your job alert settings so you get the updates you want.

Manage Settings

Job Alerts Guide

A complete guide to understanding how job alerts work and how to use them effectively.

Read Guide

Resume Matching

Learn how our system matches your resume to job requirements.

Learn More

Ethical Branding

Read our guide to building a professional and ethical personal brand.

Read Guide

Candidate Visibility

Learn how to increase your visibility to recruiters on our platform.

Increase Visibility

Verified Badge

Find out how you can get a verified badge to build trust with employers.

Get Verified

AI ATS Technology

Learn about the advanced AI and ATS technology that powers our platform.

Learn More

ATS Ranking

Understand how Applicant Tracking Systems rank you as an applicant.

Learn More

Semantic Matching

Learn how our AI-powered semantic matching goes beyond keywords.

Learn More

    Data Engineer Spark Scala Python Cassandra Elasticsearch Aws Airflow Sql Jobs in Bengaluru Job Search Guide, Trends and Insights

Advance your career or build your team with Expertini's smart job platform. Connecting professionals and employers in Bengaluru, India.