Data Engineer
Tasks
- Build and operate ETL/ELT pipelines
- Collaborate via code reviews and documentation
- Design build and optimize production data workflows
- Design database schemas and indexes
- Implement data quality testing and monitoring
- Migrate data platform from Azure Databricks to AWS stack
- Orchestrate workflows with Airflow or Dagster
- Prototype and benchmark new data tools and patterns
- Set up observability for pipelines
- Tune query performance and troubleshoot issues
- Use CI CD practices for pipeline reliability
- Use DBT for data transformations
- Write and optimize SQL queries
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | Apache Airflow | CI/CD | ClickHouse | DBT | Dagster | Data Quality | Database Schema | Database Schema Design | Docker | ELT | ETL | Git | Kubernetes | Observability | PostgreSQL | Python | Query Optimization | SQL | SQL Server | Schema Design | Terraform
Education
Roles
Related jobs
-
Algorithms | C++ | Code Refactoring | Code review | Data StructuresExposure to AI development projects | Fast onboarding | Flexible schedule | Part time contractor | Performance-based compensationSenior-level Contract Full TimeIndia R7h ago
-
Senior Engineer- Fullstack INR 2475K-5000KAPIs | Analytics | Backend Services | Data Modeling | Data correctnessHybrid work schedule | In person collaboration three days per weekSenior-level Full TimeBangalore, Karnataka, India R1d ago
-
Lead Data Integration Engineer INR 2000K-3000KAgile Scrum | CI/CD | Data Lake | Data Modeling | Data PipelinesHealth and life insurance | Hybrid work model | Paid time off | Pension/retirement benefits | Personal/family careSenior-level Full TimeChennai, India R1d ago
-
AWS Data Engineer (Contract) INR 1500K-3000KAWS CloudFormation | AWS Glue | AWS Glue Data Catalog | AWS IAM | AWS Lake FormationContract employment | Remote workSenior-level ContractIndia, Remote R1d ago
-
Senior Data Engineer - Remote INR 2520K-3380KAWS Athena | AWS CloudWatch | AWS Glue | AWS IAM | Amazon SQSFlexible schedule | Night shift flexibility | Remote workSenior-level Full TimeChennai, TN, IN R1d ago
-
Software Engineering Expert (AI Training) USD 200K-460KAlgorithms | C++ | Code Refactoring | Data Structures | DebuggingFast onboarding | Flexible contractor schedule | Remote workMid-level Contract Full TimeIndia - Remote R1d ago
-
Computer Scientist II INR 3000K-3500KAPI | Authentication | CI/CD | Code review | Distributed SystemsSenior-level Full TimeNoida, India R1d ago
-
Sr. ML Engineer INR 3470K-4500KADLS | AKS | Apache Spark | Azure | Azure DataFull-time employment | Mentoring | Remote workSenior-level ContractIndia - Remote R1d ago
-
Senior Software Engineer (India) INR 3000K-4200KAWS | AWS CDK | Asyncio | CI/CD | DatadogRemote work opportunity | Work from homeSenior-level Full TimeIndia - Remote R1d ago
-
Mid-level Full TimeRemote, India R1d ago
-
Data Engineering Senior Analyst - HIH - Evernorth INR 2771K-3500KAWS | Data Governance | Data Lake | Data Modeling | Data QualityRemote work flexibilitySenior-level Full TimeHIH - Hyderabad, India R1d ago
-
Forward Deployment Engineer INR 2500K-3900KAI guardrails | APIs | Apache Superset | CI/CD | CrewAICustomer facing collaboration | Flexible shift schedule | Professional growth opportunities | Remote workSenior-level Full TimeBengaluru, Karnataka, India - Remote R1d ago
-
AI Engineer II (Remote) USD 39K-72KAWS | CI/CD | Docker | Embeddings | Entity recognitionFull-time role | Remote workMid-level Full TimeIndia, Remote R1d ago
-
Mid-level Full TimeBangalore, Karnataka, India R1d ago
-
Senior-level Full TimeNoida,UP,India R1d ago
-
AWS | Apache Spark | Asynchronous programming | Azure | ChromaDBAccidental death and dismemberment coverage | Dental insurance | Flexible paid time off | Health insurance | Life insuranceMid-level Full TimeIndia R1d ago
-
Data Engineer INR 2400K-3500KApplication Insights | Azure Data | Azure Data Factory | Azure RBAC | DAXRemote workSenior-level Full TimeIndia, India R2d ago
-
Staff Forward Deployed Engineer INR 2500K-3900KAWS | Apache Kafka | Apache Spark | Architecture Design | AutomationSenior-level Full TimeRemote - India R2d ago
-
Data Compliance | Data Governance | Data Ingestion | Data Modeling | Data PipelinesCareer development | Continuous learning | Fitness support | Flexible work location | Generous time offSenior-level Full TimeIndia R2d ago
-
AWS | Anomaly Detection | Clustering | DBT Cloud | DBT CoreAutonomy | Flexible working schedule | Fully remote work | High-impact role | International team collaborationSenior-level Full TimeIndia R2d ago
-
AI Platform Engineer / Senior Consultant Specialist INR 3000K-5000KAPI Development | Ansible | Batch inference | CI/CD | DockerSenior-level Full TimeHyderabad, Telangana, India R2d ago
-
Senior Machine Learning Engineer INR 3000K-4200KAWS | Airflow | Azure | Azure ML | Batch inferenceHybrid work | Remote workSenior-level Full TimeBengaluru, India R2d ago
-
Principal Specialist- Data Science Customer Programs INR 3000K-4000KApache Spark | Data Engineering | Data Governance | Data Lineage | Data ModelingHybrid work environment | UK shift working hoursSenior-level Full TimeIN-KA-BENGALURU-NORTHGATE ~ Sy No 2/2 Venkatala … R2d ago
-
Data Engineer II INR 1000K-2000KAmazon S3 | Apache Kafka | Apache Spark | CDC | CI/CDAutonomy | Inclusive and diverse environment | Learning stipend | Mentorship | Remote environmentMid-level Full TimeIndia - Remote R2d ago
-
Mid-level Full TimeIndia - Remote R2d ago