PA2026Q1JB035 - Principal Data Pipeline Lead

Hyderabad India - Block B

INR 2000K-2400K (estimate) Senior-level Full Time

@ S...

Apply Save

Found 1d ago

Tasks

Build streaming pipelines
Collaborate on data platform evolution
Design batch and real-time data pipelines
Develop data transformation workflows
Enable analytics with Trino and StarRocks
Establish pipeline architecture testing and reliability best practices
Implement CDC pipelines
Ingest data from DB2 replication streams
Integrate API based data sources
Mentor data engineers
Process fixed width and CSV data feeds
Recruit and grow the data engineering team
Store and manage data in Apache Iceberg and Parquet

Perks/Benefits

Skills/Tech-stack

Education

N/A

Roles

Apply Save

Language: en | Views: 0 | Clicks: 0 | Saves: 0

Related jobs

Principal Consultant-Data Scientists with AI and Generative Model experience! INR 3125K-4225K

AWS | Azure | BERT | Data Visualization | GCP

Senior-level Full Time

India-Chennai

15h ago
Lead Consultant - RAG Engineer INR 2535K-4225K

AWS | AWS Step Functions | Airflow | Amazon SageMaker | Cloud Native

Continuous learning opportunities | Hands-on experience | Mentorship

Senior-level Full Time

India-Gurugram

15h ago
Software Engineer (Python, AI/ML) ID47296 INR 2535K-4225K

CI/CD | Data Modeling | Git | Microservices | Pytest

Budget for education | Budget for personal growth | Budget for wellness | Local team meetups | Remote work

Senior-level Full Time

Noida, India

16h ago
Python Developer INR 2500K-3000K

AWS | Debugging | Django | Event Driven | Event-driven architecture

Mid-level Full Time

IN-KA-Bangalore

16h ago
Databrick Developer INR 2000K-2040K

Agile | Airflow | Amazon Web Services | Apache Spark | CI/CD

Senior-level Full Time

IN-TN-Chennai

16h ago
Databrick Developer INR 2000K-2040K

Agile | Amazon Web Services | Apache Airflow | Apache Kafka | Apache Spark

Senior-level Full Time

IN-TN-Chennai

16h ago
GEN AI developer INR 2500K-3000K

API Integration | Anthropic Claude | Context Management | Crew AI | FastAPI

Mid-level Full Time

IN-KA-Bangalore

16h ago
Python GCP Lead INR 1500K-2000K

Agile | Apache Spark | BigQuery | Cloud Storage | Cloud platform

Senior-level Full Time

IN-AP-Hyderabad

16h ago
Software Engineer - Product (Technical Leadership) INR 2829K-5000K

AI | Data Analysis | Java | JavaScript | Machine Learning

Senior-level Full Time

Bangalore, India

17h ago
Partner Engineer, Generative AI INR 2500K-3000K

AWS | Azure | C plus plus | C# | Cloud Computing

Senior-level Full Time

Bangalore, India | Mumbai, India

17h ago
Consultant- Data Support INR 316K-500K

Alteryx | Azure Data | Azure Data Engineering | Azure Data Lake | Azure Databricks

24/7 rotation | Customer service focus

Entry-level Full Time

Bangalore, Karnataka, India

17h ago
Embedded C++ developer with RTOS skills INR 1000K-2000K

Bitbucket | C plus plus | CAN | CANopen | Change Management

Senior-level Full Time

bengaluru, India

18h ago
Embedded C++ developer with Yocto skills INR 2000K-3200K

Bitbucket | C plus plus | CAN | CANopen | CI/CD

Senior-level Full Time

bengaluru, India

18h ago
Microsoft Fabric Data Engineer INR 1800K-2040K

Azure Data | Azure Data Factory | Azure DevOps | CI/CD | Data Factory

Senior-level Full Time

Thane, Maharashtra, India

18h ago
Data Science – (Gen AI Developer) - Associate INR 2000K-2400K

Autogen | CI/CD | Data Analysis | Data Visualization | ETL

Senior-level Full Time

Bengaluru, Karnataka, India

18h ago
Consultant _ADF INR 2000K-2000K

ADF Mapping Data Flows | ARM Templates | Agile | Azure Data | Azure Data Factory

Senior-level Full Time

Bangalore, Karnataka, India

18h ago
Lead Data Engineer INR 1200K-2000K

Azure | Azure Blob | Azure Blob Storage | Azure Data | Azure Data Factory

UK shift work

Senior-level Full Time

Bengaluru, KA, India

20h ago
Associate Process Manager INR 1500K-2000K

AWS | Azure | Data Preprocessing | Docker | Elasticsearch

Mid-level Full Time

Mumbai, Maharashtra, India

20h ago
Azure Data Engineer Consultant INR 1600K-3000K

Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Databricks

Discounts on products and services | Maternity leave | Networking opportunities | Paternity leave

Mid-level Full Time

Bangalore, Karnataka, India

21h ago
Data Quality Engineer-Azure Data Platform Testing INR 1500K-2000K

Agile | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage

Mid-level Full Time

Gurugram, Haryana, India

21h ago
Senior Machine Learning Engineer (Job Location: Mahadevapura) INR 3384K-4725K

AWS | Azure | CI/CD | Databricks | Distributed Systems

Hybrid work model | Learning and development programs | Mentoring | Remote work options

Senior-level Full Time

Bangalore, India R

22h ago
Data Engineer Ii INR 1200K-2000K

AWS | Agile | Batch Processing | DBT | Data Lakes

Extensive training initiatives | Group insurance | Growth opportunities | Hospitalization insurance | Meal vouchers

Mid-level Full Time

Bangalore, KA, IN, 560076

22h ago
Gen AI - Business Analyst - Manager INR 1500K-2800K

APIs | AWS | Airflow | Amazon SageMaker | Azure

Mid-level Full Time

Gurgaon, Haryana, India

22h ago
Data Solutions Engineer - MI Solutions INR 1200K-1600K

Analysis Services | Azure Analysis | Azure Analysis Services | Azure Data | Azure Data Factory

Mid-level Full Time

Gurgaon, India

23h ago
Software Engineer II- Python, Databricks, AWS, Spark, IDMC INR 1500K-2200K

AWS Lambda | Amazon Aurora | Amazon EKS | Amazon S3 | Apache Airflow

Mid-level Full Time

Bengaluru, Karnataka, India

1d ago

PA2026Q1JB035 - Principal Data Pipeline Lead

Tasks

Perks/Benefits

Skills/Tech-stack

Education

Roles

Regions

Countries

States

Cities

Related jobs