Data Engineer III
Chennai, Tamil Nadu, India
INR 1500K-2500K (estimate) Senior-level Full Time
Tasks
- Apply CI CD version control automated testing and deployment automation
- Build and manage workflow orchestration with Apache Airflow or Google Cloud Composer
- Build optimize data solutions with Google BigQuery and Cloud Storage
- Create dbt models transformation frameworks and data quality processes
- Define engineering standards reusable frameworks and best practices
- Design and implement Lakehouse architectures
- Design develop maintain scalable ETL ELT data pipelines
- Develop data ingestion and transformation pipelines from databases SaaS APIs files
- Enable self service data capabilities for data consumers
- Establish data observability and monitoring frameworks
- Explore and implement AI ML and GenAI for data engineering workflows and automation
- Implement API integrations and data ingestion frameworks
- Implement CDC and data ingestion using Informatica CDC or similar tools
- Implement data governance metadata lineage and data discovery capabilities
- Optimize data pipelines and BigQuery workloads for performance scalability reliability cost
- Troubleshoot data pipeline and platform issues drive root cause analysis
Perks/Benefits
- N/A
Skills/Tech-stack
API Integration | Apache Airflow | Automated testing | CI/CD | Change Data Capture | Cloud Composer | Cloud Storage | Cloud platform | DBT | Data Capture | Data Governance | Data Lineage | Data Modeling | Data Observability | Data Quality | Data Warehousing | DevOps | ELT | ETL | Git | Google BigQuery | Google Cloud | Google Cloud Composer | Google Cloud Platform | Google Cloud Storage | Informatica | Infrastructure as Code | Lakehouse | Metadata Management | Python | REST APIs | SQL | Terraform | “as-code”
Education
N/A
Roles
Related jobs
-
Senior-level Full TimeHyderabad, India2h ago
-
Data Engineer II INR 2000K-3000KAWS | Amazon Kinesis | Amazon Redshift | Apache Airflow | Apache BeamCareer growth opportunities | Complimentary games | Family Leaves | Healthcare coverage | Mental well-being supportSenior-level Full TimeLocations: Hyderabad, Telangana, India2h ago
-
Advanced Engineer-AI/ML INR 2500K-4680KAI orchestration | API Integration | ASR | AWS | Action modelsEmployee discounts | Training opportunities | Tuition reimbursement | Wellness benefitsSenior-level Full TimeBangalore - Karnataka, India - Kalyani …3h ago
-
Senior Software Engineer, AI/ML, Google Cloud INR 2500K-5000KC plus plus | Data Processing | Data Structures | Data structures algorithms | DebuggingSenior-level Full TimeHyderabad, Telangana, India5h ago
-
Principal Silicon Engineer - Storage INR 1163K-3500KAmazon S3 | Azure Blob | Azure Blob Storage | Azure Files | Backup and RecoverySenior-level Full TimeIndia5h ago
-
Lead Software Engineer Java INR 3000K-4500KAI code assistants | AWS | Agile | Apache Spark | Application ResiliencySenior-level Full TimeMumbai, Maharashtra, India6h ago
-
Informatica / Data warehousing Engineer INR 2700K-4000KAgile | BigQuery | Dashboard Design | Dashboard Development | Data GovernanceSenior-level Full TimeIndia6h ago
-
Informatica / Data warehousing Engineer INR 2771K-4000KAccess Controls | Agile | BigQuery | Cloud Storage | Cloud platformSenior-level Full TimeIndia6h ago
-
AI/ML Engineer INR 2000K-3500KAzure | Data Pretraining | Data Structures | DeepSpeed | Distributed SystemsCar lease benefits | Career advancement programs | Certification programs | Continuous learning opportunities | Corporate NPSMid-level Full TimeBangalore, Karnataka, India R6h ago
-
Senior / Lead Data Engineer - Azure Databricks INR 1500K-3000KAzure | Azure Databricks | Azure DevOps | CI/CD | Conformed DimensionsSenior-level Full TimeHyderabad, TS, India6h ago
-
Senior-level Full TimeHyderabad, Telangana, India6h ago
-
Advanced Robotics Simulation Engineer INR 2000K-4680KDocker | GPU Computing | Isaac Lab | Isaac Sim | Isaac-GymSenior-level Full TimeChennai, Tamil Nadu, India7h ago
-
Java Full Stack AI Engineer- LINA GI INR 2200K-3200KAPI Security | Angular | App Service | Azure | Azure AppCertification programs | Corporate NPS | Dental insurance | Education reimbursement | Employee assistance programSenior-level Full TimeTelangana, India R7h ago
-
Senior-level Full TimeHyderabad, TS, India7h ago
-
Junior AI Specialist INR 336K-480KAWS | Airflow | Azure | DBT | Data AnalysisCertification programs | Health insurance | Internship opportunities | Language courses | MentorshipEntry-level Full TimeAll Cities , India R7h ago
-
Data Protection Lead Engineer INR 1500K-3000KArtificial Intelligence | Azure | Cloud platform | DLP | Data ClassificationSenior-level Full TimeIndia8h ago
-
Senior-level Full TimeChennai, Tamil Nadu, India8h ago
-
SO_Cloud_Devops_Engineer_SME_2026 INR 400K-500KAzure Data | Azure Data Factory | CI/CD | Command Line | Command-line scriptingEntry-level Full Timepune, India9h ago
-
Analyst, Business Intelligence INR 3000K-5000KAWS | Azure | Azure OpenAI | CI/CD | Distributed SystemsEmployee assistance program | Flexible working environment | LinkedIn Learning | Volunteer time offSenior-level Full TimeChennai, TN, India9h ago
-
Data Transformation and Management Specialist INR 1500K-3000KAgile | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageSenior-level Full TimePune, Maharashtra, India9h ago
-
Bash | Data Processing | Docker | GCP | Infrastructure as CodeEntrepreneurial team | Fast-growing environment | Flexible asynchronous culture | Remote/distributed workMid-level Full TimeBangalore, India10h ago
-
Bash | Data Ingestion | Data Processing | Docker | GCPAsynchronous culture | Flexible remote setting | Friendly laid-back atmosphere | Opportunity for high impactMid-level Full TimeDelhi, India10h ago
-
Sr Data Engineer INR 3000K-4000KAPIs | Airflow | Apache Iceberg | CI/CD | Control-MAnnual leave | Development courses | Employee assistance program | Flexible working options | Life insuranceSenior-level Full TimeBangalore, IN11h ago
-
Senior-level Full TimeBengaluru, Karnataka, India11h ago
-
Advanced Software Engr INR 2500K-4500KAI Agents | API Design | Cloud Platforms | Distributed Systems | DjangoSenior-level Full TimeBengaluru, Karnataka, India11h ago