Data Engineer
Tasks
- Build Data Lakes and Data Warehouses
- Collaborate on requirements to technical solutions
- Collaborate with cross-functional teams
- Debug defects and performance bottlenecks
- Design ETL pipelines
- Implement data security and reliability
- Integrate structured and unstructured data
- Maintain data process documentation
- Optimize refactor codebase
- Participate in Agile sprint planning
- Validate cleanse and transform data
- Write integration tests
- Write unit tests
Perks/Benefits
- N/A
Skills/Tech-stack
API | AWS | Azure | Cloud platform | Concurrent processing | Data Lakehouse | Data Warehousing | Databricks | Distributed task queues | ELT | ETL | Elasticsearch | Flask | Git | Google Cloud | Google Cloud Platform | Integration Testing | Kibana | Linux | Logging | Logstash | Machine Learning | MongoDB | MySQL | ORM | OpenCV | Pandas | Parallel processing | PostgreSQL | PySpark | Pytest | Python | Redis | Regex | Requests | SQL | Scikit-learn | Shell Scripting | Spark | Subprocess | Task Queues | Unit Testing
Education
Roles
Related jobs
-
Azure Databricks | Azure DevOps | Data Quality | Data Warehousing | DatabricksCollaborative Agile environment | Fully remote | Hands on cloud data platform exposureMid-level Full TimeIndia R12h ago
-
Machine Learning Engineer - IV (Computer Vision) INR 1000K-1800KANN search | Airflow | Approximate Nearest Neighbor | CoreML | Data IngestionMid-level Full TimeIndia (remote) R1d ago
-
Senior Machine Learning Engineer INR 3584K-4580KAWS | Azure | CI/CD | Data Science | DatabricksLearning and development programs | Mentorship culture | Remote workSenior-level Full TimeBangalore, India R1d ago
-
Senior Machine Learning Engineer INR 3584K-4580KAmazon Web Services | Azure | CI/CD | Cloud platform | DatabricksCoaching and mentoring | Employee development programs | Learning and development programs | Remote work flexibilitySenior-level Full TimeBangalore, India R1d ago
-
Data Engineer -6 Years-Remote INR 1500K-2500KA/B | A/B Testing | B testing | Data Analysis | PythonRemote workMid-level Full TimeBengaluru, Karnataka, India R1d ago
-
Senior Software Engineer - Data Platform INR 3500K-4580KAmazon Redshift | Apache Airflow | Apache Flink | Apache Kafka | Apache SparkCompany holidays | Daily meals | Dental insurance | Family planning assistance | Fitness coachingSenior-level Full TimeBengaluru, Karnataka, India R1d ago
-
Mid-level Full TimeBangalore, Karnataka, India R1d ago
-
Alerting | Amazon Redshift | Anomaly Detection | Aurora PostgreSQL | CI/CDFully remoteSenior-level Full TimeIndia R1d ago
-
Senior Specialist - AI Strategy (Mobility) INR 3000K-5000KAgentic AI | Agile delivery | Anomaly Detection | Artificial Intelligence | Cloud ArchitectureSenior-level Full TimePune, Maharashtra, IND, 411013 R1d ago
-
AI-enabled | AI-enabled development | API Integration | Architecture | Data ModelingLaptop provided | Medical insurance | Mentorship | No weekend work | Remote workSenior-level Contract Full TimeDelhi R1d ago
-
AI Governance | Airflow | Alerting | Anomaly Detection | Artifact RegistryMid-level Full TimePune, Maharashtra, India R1d ago
-
AWS Glue | AWS Glue Data Catalog | Amazon Athena | Amazon QuickSight | Amazon RedshiftContract-based engagement | Cross-functional team collaboration | Fully remote work | Professional growthSenior-level Contract Full TimeIndia R1d ago
-
AWS | Authentication | Autovacuum | Backup and Restore | Client LibrariesAnnual offsites | Coworking allowance | Employee equity | Flexible schedule | Fully remoteSenior-level Full TimeIndia R1d ago
-
Apache Spark | Azure | Cost Optimization | Data Governance | Data ModelingFully remote work setup | Professional growth opportunities | Supportive work cultureSenior-level Full TimeIndia R1d ago
-
AI Engineer INR 3200K-5000KAPI Integration | AWS | Airflow | Azure | CI/CDMentorship | Remote workSenior-level Full TimeBangalore or Remote, KA, IN R1d ago
-
Mid-level Full TimeNoida, India R1d ago
-
Computer Scientist ( Java Backend ) INR 1000K-1890KAlgorithms | Apache Kafka | Data Structures | Java | Message PubSubMid-level Full TimeBangalore, India R1d ago
-
Computer Scientist 2 INR 3470K-4580KAWS | Asynchronous Event Driven | Asynchronous Event Driven Systems | Automated testing | AzureSenior-level Full TimeBangalore, India R1d ago
-
Senior AI/ ML Engineer INR 2000K-6000KArtificial Intelligence | CI/CD | Cloud Computing | Computer Vision | ContainersSenior-level Full TimeIndia - Remote R1d ago
-
AI Model Quality Engineer INR 3000K-5000KAPI Testing | Bias and fairness | Concept drift | Concept drift detection | Continuous MonitoringSenior-level Full TimeBangalore, Karnataka, India (Hybrid) R2d ago
-
Mid-level Full TimeIndia - Remote R2d ago
-
Apache Spark | Automation | Azure Data | Azure Data Services | Data GovernanceRemote workSenior-level Full TimeIndia - Remote R3d ago
-
CCaaS | CRM | CTI | Embeddings | EvaluationFully remote | Learning opportunities | Startup environmentSenior-level Full TimeHyderabad R3d ago
-
Senior DevOps Engineer - Storage Platforms | India INR 3000K-4000KAnsible | Bash | Block Storage | CI/CD | CentOSSenior-level Full TimeIndia, Bengaluru (Hybrid) R4d ago
-
AWS | Airflow | Cloud platform | Data Pipelines | Deep learningAccess to Collaboration Platforms | Access to development tools | Continuous learning environment | Equity opportunities | Medical/Dental/Vision insuranceMid-level Full TimeIndia R4d ago