Data Engineer
Tasks
- Build Data Lakes and Data Warehouses
- Collaborate with cross-functional teams
- Debug software defects
- Design ETL pipelines
- Document data processes and systems
- Gather requirements and translate to technical solutions
- Integrate structured data and unstructured data
- Monitor and improve performance and reliability
- Propose scalable secure and maintainable solutions
- Refactor and optimize existing codebase
- Support Agile sprint planning and stand ups
- Validate cleanse and transform data
- Write integration tests
- Write unit tests
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | Apache Spark | Azure | Cloud platform | Data Lake | Data Warehousing | Databricks | ELK Stack | ELT | ETL | Elasticsearch | Flask | Git | Google Cloud | Google Cloud Platform | Integration Testing | Kibana | Linux | Logstash | MongoDB | MySQL | OpenCV | Pandas | PostgreSQL | PySpark | Pytest | Python | REST APIs | Redis | Regex | Requests | SQL | Scikit-learn | Shell Scripting | Subprocess | Unit Testing
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Related jobs
-
API Design | AWS | Amazon SageMaker | Automated retraining | CI/CDAutonomy and ownership | Continuous learning | Fully remote | High-growth environment | Professional developmentSenior-level Full TimeIndia R5h ago
-
AIOps | APIs | AWS | Anomaly Detection | AzureFlexible working hours | Fully remote | Remote collaborationMid-level Full TimeIndia R1d ago
-
AI Engineer - India INR 1800K-3000KAzure APIM | Cloud platform | Cypher | Embeddings | FastAPICareer pathing | Flexi benefit plan | Focus time Fridays | Food at work | Group medical coverageMid-level Full TimeChennai R2d ago
-
Database Engineering Associate - Snowflake Developer INR 1500K-2000KAPI Integration | AWS | Access Management | Agile | Batch ProcessingFlexible hybrid work model | Health insurance | Life insurance | Paid time off | Pension/retirement benefitsMid-level Full TimeHyderabad, India R2d ago
-
Business Intelligence Engineer - Snowflake Developer INR 2500K-4132KAgile | Airflow | Bitbucket | CI/CD | Common table expressionsFlexible remote days | Health insurance | Hybrid work model | Life insurance | Paid time offSenior-level Full TimeHyderabad, India R3d ago
-
Business Intelligence Engineer - Power BI Developer INR 1500K-2000KAgile | BI Performance Tuning | DAX | Data Modeling | Dimension modelingFlexible remote work | Health insurance | Hybrid work model | Life insurance | Paid time offMid-level Full TimeHyderabad, India R3d ago
-
Algorithms | C++ | Code Refactoring | Code review | Data StructuresExposure to AI development projects | Fast onboarding | Flexible schedule | Part time contractor | Performance-based compensationSenior-level Contract Full TimeIndia R3d ago
-
VP - Senior Data Engineer INR 3715K-4720KAmazon Web Services | Apache Airflow | Artificial Intelligence | Azure | CI/CDComprehensive healthcare | Flexible time off | Hybrid work model | Retirement plan | Support for working parentsSenior-level Full TimeBL4 - KNG Tower 1, Indiqube … R3d ago
-
Senior Software Engineer (India) INR 3500K-4500KAWS | AWS CDK | Asyncio | Authentication | AuthorizationRemote work | Work from homeSenior-level Full TimeIndia - Remote R3d ago
-
Forward Deployed AI Engineer INR 3000K-3500KAI Foundry | AIOps | Automated testing | Azure AI | Azure AI FoundryHybrid workSenior-level Full TimeIndia - Remote R3d ago
-
Senior-level Full TimeIndia - Remote R3d ago
-
Senior Data Engineer INR 3000K-4000KAWS | AWS Glue | AWS Lambda | Agile | Amazon AthenaCab allowance | Flexible leave policies | Free meals | Health insurance | Home office setup allowanceSenior-level Full TimeHyderabad, India R3d ago
-
Lead Data Integration Engineer INR 2000K-3000KAgile Scrum | CI/CD | Data Lake | Data Modeling | Data PipelinesHealth and life insurance | Hybrid work model | Paid time off | Pension/retirement benefits | Personal/family careSenior-level Full TimeChennai, India R4d ago
-
AWS Data Engineer (Contract) INR 1500K-3000KAWS CloudFormation | AWS Glue | AWS Glue Data Catalog | AWS IAM | AWS Lake FormationContract employment | Remote workSenior-level ContractIndia, Remote R4d ago
-
Senior Data Engineer - Remote INR 2520K-3380KAWS Athena | AWS CloudWatch | AWS Glue | AWS IAM | Amazon SQSFlexible schedule | Night shift flexibility | Remote workSenior-level Full TimeChennai, TN, IN R4d ago
-
Software Engineering Expert (AI Training) USD 200K-460KAlgorithms | C++ | Code Refactoring | Data Structures | DebuggingFast onboarding | Flexible contractor schedule | Remote workMid-level Contract Full TimeIndia - Remote R4d ago
-
Computer Scientist II INR 3000K-3500KAPI | Authentication | CI/CD | Code review | Distributed SystemsSenior-level Full TimeNoida, India R4d ago
-
Sr. ML Engineer INR 3470K-4500KADLS | AKS | Apache Spark | Azure | Azure DataFull-time employment | Mentoring | Remote workSenior-level ContractIndia - Remote R4d ago
-
Senior Software Engineer (India) INR 3000K-4200KAWS | AWS CDK | Asyncio | CI/CD | DatadogRemote work opportunity | Work from homeSenior-level Full TimeIndia - Remote R4d ago
-
Data Engineering Senior Analyst - HIH - Evernorth INR 2771K-3500KAWS | Data Governance | Data Lake | Data Modeling | Data QualityRemote work flexibilitySenior-level Full TimeHIH - Hyderabad, India R4d ago
-
Forward Deployment Engineer INR 2500K-3900KAI guardrails | APIs | Apache Superset | CI/CD | CrewAICustomer facing collaboration | Flexible shift schedule | Professional growth opportunities | Remote workSenior-level Full TimeBengaluru, Karnataka, India - Remote R4d ago
-
Senior-level Full TimeIndia - Remote R4d ago
-
AI machine learning | Apache Spark | Automation | Big Data | CassandraComprehensive healthcare | Flexible time off | Retirement plan | Tuition reimbursementExecutive-level Full TimeM11 - Commers III, 43, 44 … R4d ago
-
AI Engineer II (Remote) USD 39K-72KAWS | CI/CD | Docker | Embeddings | Entity recognitionFull-time role | Remote workMid-level Full TimeIndia, Remote R4d ago
-
Mid-level Full TimeBangalore, Karnataka, India R4d ago