Lead Engineer Bigdata - PySpark

TOWER B, EON FREE ZONE II, India

INR 2000K-2400K (estimate) Senior-level Full Time

@ C...

Expired Save

Expired 29d ago

Tasks

Collaborate with stakeholders
Design, develop, and maintain data pipelines
Develop and maintain documentation
Implement data transformations and quality checks
Mentor junior developers
Optimize data processing jobs
Troubleshoot data pipeline issues

Perks/Benefits

Skills/Tech-stack

Expired Save

Language: en | Views: 2 | Clicks: 0 | Saves: 0

Related jobs

Agentic AI architect INR 2500K-4800K

APIs | AWS | Agent Orchestration | Autogen | Azure

Employee referral bonuses | Flexible work options | Fun culture | In-house technology training | Learning and development programs

Senior-level Full Time

Chennai, India

12h ago
AI Developer (Python) INR 1800K-2500K

CI/CD | Document parsing | ETL | FastAPI | Generative AI

Flexible work options | In-house technology training | Learning and development programs | Medical insurance | Performance bonuses

Mid-level Full Time

Chennai, India

12h ago
Sr. Data Engineer I INR 2400K-4000K

AWS | AWS Glue | Amazon EMR | Apache Kafka | Cloud Migration

Continuous learning | International travel | Mentorship | Professional growth

Senior-level Full Time

Bangalore, India

13h ago
Senior Manager – Data Scientist INR 2520K-3500K

AWS | AWS SageMaker | Agent systems | Agentic AI | Azure

Career growth | Continuous learning opportunities | Mentorship | Mentorship and coaching

Senior-level Full Time

India-Gurugram

13h ago
Research Engineer INR 1200K-1800K

Data Processing | Deep learning | Distributed Computing | LLM | Language Models

Mid-level Full Time

Gurugram, India

13h ago
Python Robot QA INR 1500K-2500K

Agile | Azure DevOps | Backup and Recovery | C# | Case management

Senior-level Full Time

IN-AP-Hyderabad

13h ago
Python Robot QA INR 1500K-2541K

API Testing | Agile | Azure DevOps | Backup and Recovery | Case management

Flexible work timing | Hybrid work model

Senior-level Full Time

IN-AP-Hyderabad R

13h ago
DBT Data Engineer INR 400K-1200K

API Development | AWS Glue | AWS S3 | Amazon Redshift | Apache Airflow

Senior-level Full Time

IN-AP-Hyderabad

13h ago
Data Engineer INR 1500K-2000K

API Development | AWS SQS | Amazon Aurora | Amazon Redshift | Amazon S3

Senior-level Full Time

IN-AP-Hyderabad

13h ago
Database Developer INR 1200K-2200K

AWS Aurora | AWS Aurora PostgreSQL | AWS Cloud | AWS Cloud Database Services | AWS DMS

Senior-level Full Time

IN-KA-Bangalore

13h ago
Staff Engineer, Test Development Engineering (Embedded Firmware Development Engineer) INR 1236K-2156K

ARM Microcontroller | C# | DMA | GDB | Git

Senior-level Full Time

Bengaluru, KA, India

13h ago
AI Engineer INR 300K-300K

API Development | Agent Development | Agent Development Framework | Agent Development Kit | Anthropic

Internal demos | Internal training sessions

Entry-level Full Time

Pune, Maharashtra, India

14h ago
Partner Engineer, Generative AI INR 2500K-4500K

AWS | Azure | Bias Mitigation | C++ | Conversational AI

Senior-level Full Time

Bangalore, India | Mumbai, India

14h ago
Tools and Automation Engineer INR 1000K-1400K

AIOps | Active Directory | Ansible | Automation Anywhere | Copilot

Mid-level Full Time

Ahmedabad, Gujarat, India

15h ago
Data Engineer INR 800K-2000K

APIs | AWS Data | AWS Data Catalog | AWS Glue | Amazon S3

Senior-level Full Time

Gurgaon, Haryana, India

16h ago
Consultant-B2 INR 1500K-2000K

AI Search | Agentic architecture | Assistants API | Autogen | Azure AI

Mid-level Full Time

Gurugram, Haryana, India

16h ago
AWS AI Lead Engineer INR 2400K-2829K

AWS CDK | AWS IAM | Amazon EKS | Amazon Web Services | Argo CD

Senior-level Full Time

Hyderabad, India

16h ago
Senior Analyst INR 2500K-4500K

Agentic AI | Agile | Causal Inference | Cypher | Experimental Design

Senior-level Full Time

Mumbai, Maharashtra, India

16h ago
Python , web scrapping data conversion VBA INR 1500K-2156K

API | Alerting | BeautifulSoup | Data Automation | Data Engineering

Hybrid working | UK time zone

Senior-level Full Time

Gurgaon, HR, India

16h ago
Deputy Manager-Data Engineering INR 1500K-2000K

Apache Airflow | Azure | Azure Data | Azure Data Factory | Azure Databricks

Mid-level Full Time

Gurgaon, HR, India

16h ago
AI/ML Engineer INR 2500K-3000K

AWS | Anomaly Detection | Automated retraining | Azure | Chroma

Collaborative work environment | Competitive compensation | Continuous learning opportunities | Growth-oriented culture

Mid-level Full Time

Gujarat, Surat, India

17h ago
Principal Engineer, Data Analytics Engineering 9+ years (Data Engineering , GenAI , Python , SQL) INR 2500K-5000K

AWS | Airflow | Amazon Bedrock | Anthropic API | CI/CD

Senior-level Full Time

Bengaluru, KA, India

17h ago
GCP Cloud Engineer INR 2500K-4500K

AI Pipelines | BigQuery | Blue-Green Deployment | Blue/green | CI/CD

Senior-level Full Time

Chennai, Tamil Nadu, India

18h ago
Associate Process Manager INR 2000K-2500K

API Gateway | AWS Bedrock | AWS Lambda | AWS Step Functions | Agent systems

Mid-level Full Time

Pune, Maharashtra, India

18h ago
Data Analytics Professional INR 1000K-1700K

APIs | Agile | Analytics | Confluence | Dashboards

Mid-level Full Time

Bengaluru, IN, 560103

18h ago

Lead Engineer Bigdata - PySpark

Tasks

Perks/Benefits

Skills/Tech-stack

Education

Roles

Regions

Countries

States

Related jobs