Data Engineer
Tasks
- Build Data Lakes and Data Warehouses
- Collaborate on requirements to technical solutions
- Collaborate with cross-functional teams
- Debug defects and performance bottlenecks
- Design ETL pipelines
- Implement data security and reliability
- Integrate structured and unstructured data
- Maintain data process documentation
- Optimize refactor codebase
- Participate in Agile sprint planning
- Validate cleanse and transform data
- Write integration tests
- Write unit tests
Perks/Benefits
- N/A
Skills/Tech-stack
API | AWS | Azure | Cloud platform | Concurrent processing | Data Lakehouse | Data Warehousing | Databricks | Distributed task queues | ELT | ETL | Elasticsearch | Flask | Git | Google Cloud | Google Cloud Platform | Integration Testing | Kibana | Linux | Logging | Logstash | Machine Learning | MongoDB | MySQL | ORM | OpenCV | Pandas | Parallel processing | PostgreSQL | PySpark | Pytest | Python | Redis | Regex | Requests | SQL | Scikit-learn | Shell Scripting | Spark | Subprocess | Task Queues | Unit Testing
Education
Roles
Related jobs
-
Software Engineer INR 1500K-2100KAWS | Agile | Bash | CI/CD | CloudWatchFamily wellbeing benefits | Health and wellbeing benefits | Hybrid work | Paid time off | Work-life balance benefitsMid-level Full TimeHyderabad, India R12h ago
-
AWS | Artificial Intelligence | Azure | CI/CD | Computer VisionCareer development | Inclusive culture | Professional learning | Remote workSenior-level Full TimeIndia R16h ago
-
Data / Retrieval Engineer INR 3200K-4720KAPIs | Access Control | Attribute-Based Access Control | Attribute-based access | ChunkingSenior-level Full TimeNoida/Gurgaon, UP, IN R18h ago
-
AI Orchestration / Platform Engineer INR 2500K-4680KAlerting | Authentication | Authorization | CI/CD | CachingSenior-level Full TimeNoida/Gurgaon, HR, IN R18h ago
-
Principal Agentic AI Engineer / Hands-on Technical Lead INR 3600K-5000KAI tracing | Agent patterns | Authentication | Authorization | AutogenSenior-level Full TimeNoida/Gurgaon, HR, IN R18h ago
-
Machine Learning Engineer 3 ( Firefly ) INR 3264K-5000KCUDA | Diffusion Models | Distributed Systems | GANs | GPU resource managementSenior-level Full TimeNoida, India R18h ago
-
AI Services | Azure AI | Azure AI Services | Azure OpenAI | Azure SpeechHybrid work | Onsite work | Travel 10 percentSenior-level Full TimeKarnataka, Bengaluru Old No 62, Plot … R18h ago
-
Principal Software Engineer INR 3264K-5876KAWS | Apache Iceberg | Apache Kafka | Apache Spark | Automated testingSenior-level Full TimeHyderabad, TG, India R2d ago
-
Staff Machine Learning Engineer INR 3600K-5000KA/B | A/B Testing | AWS | Agentic Workflows | AzureHybrid work | Onsite collaborationSenior-level Full TimeIndia - Pune - Office R2d ago
-
Senior Embedded Software Engineer INR 1716K-2500KAUTOSAR | Artifactory | Automotive SPICE | C plus plus | C#BusinessBike bicycle leasing | Continuing education programs | Corporate volunteering | End-of-year bonuses | Flexible working hoursSenior-level Full TimePune, MH, IN, 411057 R2d ago
-
Mid-level Full TimeHaryana, India R2d ago
-
Continuous integration | Development Lifecycle | Git | JavaScript | LaravelCo-working space | Mentorship | Modern equipment | Training programs | Trial dayMid-level Full TimeChennai, Hybrid R3d ago
-
Principal Data Engineer Data Technology INR 3000K-4000KAPIs | AWS | Apache Spark | CI/CD | Cloud platformSenior-level Full TimePune, Maharashtra, India R3d ago
-
Data Engineer _ ALM - MTCR INR 1500K-3000KApache Hive | Apache Spark | Apache YARN | Bitbucket | CDEHybrid workSenior-level Full TimeIndia - Pune R3d ago
-
Senior Software Engineer INR 1492K-3000KAutomated testing | Azure Data | Azure Data Factory | Azure Databricks | Azure Machine LearningGrowth mindset culture | Hybrid work modelSenior-level Full TimeIndia, Telangana, Hyderabad R3d ago
-
Senior Machine Learning Engineer INR 3584K-4800KAWS | Azure | CI/CD | Cloud platform | DatabricksCoaching and mentoring | Development programs | Learning and development programs | Remote work flexibility | Work from office or client siteSenior-level Full TimeBangalore, India R3d ago
-
Senior Machine Learning Engineer INR 3584K-4800KAWS | Azure | CI/CD | Databricks | Distributed SystemsCareer Development Programs | Learning and development programs | Mentoring and coaching | Remote work flexibilitySenior-level Full TimeBangalore, India R3d ago
-
Staff Software Engineer - India INR 4000K-5000KAPI Development | AWS | Agentic AI | Azure | Cloud infrastructureCareer growth | High visibility and impact | Open Source contributionSenior-level Full TimeBengaluru R3d ago
-
Mid-level Full TimePune, Maharashtra, India R3d ago
-
Apache Spark | Artificial Intelligence | Docker | Generative AI | KubernetesCareer development opportunities | Employee resource groups | Inclusive Workplace Programs | Paid time off | Paid volunteer timeSenior-level Full TimeIndia R3d ago
-
AWS | Analytics | BigQuery | ClickHouse | Cloud infrastructureContinuous learning | Flexible work location | Inclusive workplace culture | Professional growth opportunities | Remote-friendly work environmentMid-level Full TimeIndia R3d ago
-
AI/ML Engineer INR 1500K-2500KAI Platform | AWS SageMaker | Airflow | Azure Machine Learning | CI/CDMid-level Full Time Part TimeIndia - Remote R3d ago
-
ASR | AWS | Audio Processing | Cloud platform | ContainerizationFlexible working hours | Fully remote | Mentorship | Professional growthSenior-level Full TimeIndia R3d ago
-
Technical Lead (.Net) - (India) INR 2500K-4500K.NET | API Development | AWS | Agile | Automated testingSenior-level Full TimeVirtual - India R3d ago
-
Mid-level Full TimeIndia - Remote R3d ago