Data Engineer
Tasks
- Administer Cloud Composer where applicable
- Administer and optimize Apache Airflow environment
- Build and maintain data pipeline transformations
- Catalog and maintain data lineage
- Define data quality and governance standards
- Design ETL/ELT pipelines
- Document and deploy dbt models
- Manage data lifecycle ingestion transformation quality storage retention
- Mentor junior data engineers
- Own dbt Core models and tests
- Perform design and code reviews
- Troubleshoot production data pipeline issues
Perks/Benefits
- N/A
Skills/Tech-stack
Agile | Apache Airflow | Automated testing | CI/CD | Cloud Composer | Cloud Storage | Cloud platform | DBT Core | Data Governance | Data Warehousing | ELT | ETL | Git | Google Cloud | Google Cloud Platform | Google Cloud Storage | Kafka | Python | SQL
Education
N/A
Roles
Related jobs
-
Mid-level Full TimeIN-MH-Pune2h ago
-
Mid-level Full TimeIN-MH-Pune2h ago
-
Associate Engineer - AI/ML with Python INR 2800K-4000KAWS | Bitbucket | CSS | Celery | DjangoFlexible growth opportunities | In office 5 days per week | Professional development | Training opportunitiesMid-level Full TimeBangalore - Karnataka, India - Kalyani …2h ago
-
Microsoft Fabric Data Engineer INR 1500K-2500KAzure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure DevOpsSenior-level Full TimePune, Maharashtra, India6h ago
-
Senior IT Project Manager/ Prompt Engineer INR 2500K-3600KAgile | CI/CD | Case Routing | Copado | Data ArchitectureSenior-level Full TimeBangalore, Karnataka, IN, 5601009h ago
-
Senior-level Full TimeBangalore, KA, IN,9h ago
-
Senior Machine Learning Engineer, Content Platform INR 3264K-5000KAmazon EMR | Amazon S3 | Apache Airflow | BERT | Big Data401k retirement plan | Commuter benefits | Dental insurance | Disability insurance | Financial wellness supportSenior-level Full TimeBengaluru, India11h ago
-
Sr Software Engineer l Java, AWS, Python, Microservices INR 3242K-4000KAWS | Agile | Architecture | Debugging | DesignSenior-level Full TimeMumbai, India11h ago
-
AI/ML Specialist - Agentic AI & Generative AI INR 2000K-5000KAgentic AI | Agile Scrum | Azure Machine Learning | Data Engineering | Data PipelinesSenior-level Full TimeHyderabad, TG, IN, 50003215h ago
-
Technical Lead-AI/ML, Generative AI & Agentic AI INR 2000K-4680KAgentic AI | Agile | Azure Machine Learning | Data Engineering | Data PipelinesSenior-level Full TimeHyderabad, TG, IN, 50003215h ago
-
Senior-level Full TimeChennai, India17h ago
-
Senior Staff Data Analytics Engineer INR 3242K-4500KAI Operations | AI gateway | API Management | Agentic Frameworks | AutomationSenior-level Full TimeBengaluru, KA, India20h ago
-
Senior-level Full TimePune, India22h ago
-
Solutions Engineer - Data Engineering INR 2000K-3000KApache Airflow | CI/CD | DAG | Data Transformation | DockerHybrid work model | Office in HyderabadMid-level Full TimeHyderabad22h ago
-
Senior-level Full TimeMumbai, Maharashtra, India23h ago
-
Staff Software Engineer (Python) INR 3500K-5000KAWS | Authentication | Batch Processing | Data Pipelines | Distributed SystemsCollaborative team environment | Leadership development programs | Training sessionsSenior-level Full TimeMumbai, MH, India23h ago
-
Compute-Hyd 169229 INR 2000K-3000KAI Agents | API Development | Embeddings | LLM orchestration | Language ModelsMid-level Full TimeHyderabad, IND-TG, India23h ago
-
Lead Data Engineer - CDP INR 2500K-4500KAPI Gateway | Analytics.js | CCPA | CI/CD | CPRAArchitecture workshops | Client stakeholder management | Technical mentorshipSenior-level Full TimeHyderabad, TS, India1d ago
-
Senior Data Engineer - AWS INR 1500K-4000KAWS Glue | AWS Lambda | AWS S3 | Amazon EMR | Amazon RedshiftSenior-level Full TimeBangalore, India1d ago
-
Data Engineer Snowflake INR 1500K-2200KAWS | Amazon Redshift | Azure | Cloud platform | Data GovernanceMid-level Full TimeGurugram, Haryana, India1d ago
-
Mid-level Full TimeBangalore - Karnataka - India Pune …1d ago
-
Business Analyst- Automation & AI Solutions (m/f/d) INR 1200K-1800KAuthentication | CI/CD | Databases | JSON | LLMCounseling | Hybrid work model | Learning and development | Mentoring program | Travel vouchersMid-level Full TimeGurugram1d ago
-
Mid-level Full TimeHyderabad, TS, 500032, IN1d ago
-
Principal Data Engineer INR 1500K-2500KAgile | Apache Airflow | Apache Kafka | Automated testing | CI/CDSenior-level Full TimeIN-MH-Pune1d ago
-
Senior-level Full TimeIN-MH-Pune1d ago