Data Engineer - EAI
Tasks
- Build ETL/ELT pipelines
- Deliver curated datasets for reporting
- Design data integration pipelines
- Develop CI/CD workflows
- Develop Python and SQL ingestion logic
- Implement data quality checks
- Manage Airflow or Cloud Composer workflows
- Monitor pipeline execution
- Optimize BigQuery queries
- Transform raw data with dbt
Perks/Benefits
- N/A
Skills/Tech-stack
Agile | Airflow | Ascend io | CI/CD | Cloud Composer | Clustering | Collibra | DBT | Data Governance | Data Quality | Databricks | Dataflow | ELT | ETL | Fivetran | Git | Google BigQuery | Google Pub/Sub | Infrastructure automation | Kafka | Kanban | Partitioning | Pub/Sub | Python | Python Scripting | Query Optimization | SQL | Scrum
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Related jobs
-
Senior Forward Deployed Engineer, Cloud Applied AI INR 2000K-5000KArtificial Intelligence | CI/CD | Continuous Deployment | Continuous integration | Generative AISenior-level Full TimeBengaluru, Karnataka, India1h ago
-
Mid-level Full TimeBangalore, Karnataka, India2h ago
-
Azure Data Engineer Consultant INR 1500K-2000KADLS | Azure | Azure Blob | Azure Blob Storage | Azure DataMid-level Full TimeBangalore, Karnataka, India2h ago
-
Senior Software Engineer INR 2000K-3380KAWS | Apache Kafka | Apache Spark | Azure | Batch ProcessingSenior-level Full TimeBengaluru, KA, IN2h ago
-
Senior-level Full TimeNew Delhi, IN, 1100373h ago
-
Senior-level Full TimeBangalore6h ago
-
Snowflake Data Engineer- Consultant INR 1500K-2700KAWS | AWS Data | AWS Data Pipeline | AWS Glue | AWS IAMCorporate social responsibility programs | Discounts on products and services | Maternity leave | Networking opportunities | Paternity leaveMid-level Full TimeBangalore, Karnataka, India6h ago
-
Software Engineer - Productivity Engineering INR 1200K-2500KAmazon SQS | Anthropic | Async/Await | Data Modeling | DjangoEqual employment opportunity | Hybrid work environmentMid-level Full TimeBengaluru, KA, India7h ago
-
Consultant - Cloud AI Developer INR 1000K-1700KAI/ML | AWS | Application Modernization | Application rationalization | Azure OpenAIMid-level Full TimeGurgaon, Haryana, India7h ago
-
Staff Analytics Engineer - Finance INR 2800K-3465KCI/CD | DBT | Data Governance | Data Modeling | Data QualityHybrid work | On-site onboardingSenior-level Full TimeBengaluru, India7h ago
-
AM - Cloud Data Engineer INR 1500K-2400KAWS N/A | Apache Airflow | Apache Kafka | Apache Spark | Azure DataSenior-level Full TimePune, Maharashtra, India8h ago
-
Consultant - Cloud Data Engineer INR 1000K-2000KApache Airflow | Apache Kafka | Apache Spark | Azure Data | Azure Data FactoryMid-level Full TimeGurgaon, Haryana, India8h ago
-
Consultant - Cloud Data Engineer INR 1000K-2000KAWS N/A | Apache Airflow | Apache Druid | Apache Druid N/A | Apache KafkaMid-level Full TimeGurgaon, Haryana, India8h ago
-
AM - Cloud Data Engineer INR 1500K-2400KAWS Lake Formation | Apache Airflow | Apache Kafka | Apache Spark | AzureSenior-level Full TimeBangalore, Karnataka, India8h ago
-
Consultant - Cloud Data Engineer INR 1500K-2400KAWS Lake Formation | Apache Airflow | Apache Kafka | Apache Spark | Azure DataSenior-level Full TimePune, Maharashtra, India8h ago
-
Consultant - Cloud Data Engineer INR 1000K-2000KApache Airflow | Apache Kafka | Apache Spark | Azure | Azure CosmosMid-level Full TimeBangalore, Karnataka, India8h ago
-
Consultant - Cloud Data Engineer INR 1500K-2400KApache Airflow | Apache Kafka | Apache Spark | Azure | Azure DataSenior-level Full TimeBangalore, Karnataka, India8h ago
-
Consultant - Cloud Data Engineer INR 1000K-2000KAWS Data | AWS Data Catalog | Apache Airflow | Apache Kafka | Apache SparkClient-facing consulting experience | Flexible work environment | Growth mindset | Professional development | Team collaborationMid-level Full TimeGurgaon, Haryana, India8h ago
-
Consultant - Cloud Data Engineer INR 1000K-2000KAWS Lake Formation | Apache Airflow | Apache Kafka | Apache Spark | AzureMid-level Full TimeBangalore, Karnataka, India8h ago
-
Mid-level Full TimeBangalore, Karnataka, India8h ago
-
Software Engineer II INR 2000K-4590KAWS | Automated testing | CI/CD | Cause analysis | Cloud ComputingLearning and trainingSenior-level Full TimeMumbai, India9h ago
-
Mid-level Full TimePune, Maharashtra, India9h ago
-
Software Engineer (Data Engineering & Building APIs) INR 1200K-1680KAWS | AWS Lambda | Agile | Algorithms | CI/CDHybrid work environmentMid-level Full TimeGurgaon - Cyber Park, India13h ago
-
GCP Data Engineer - VOIS INR 1000K-1500KAlerting | Apache Spark | BigQuery | Cloud Composer | Cloud StorageContinuous learning | International team collaborationMid-level Full TimePune, IN13h ago
-
POD Engineers (Jr) INR 938K-1400KAWS S3 | Amazon Web Services | Apache Kafka | Apache Spark | AzureTravel opportunityMid-level Full TimeAndaman and Nicobar Islands, AN, IN13h ago