Data Engineer II
Tasks
- Build and manage Data Lakes and Data Warehouses
- Build data pipelines
- Create SQL-based data solutions
- Design ETL/ELT workflows
- Develop data processing and orchestration
- Document data workflows and processes
- Enforce data quality checks
- Implement Apache Spark transformations
- Implement CI/CD pipelines
- Optimize data pipelines
- Optimize data systems performance scalability cost
- Use Databricks for big data processing
- Use Git for version control
- Use Jenkins for automation
Perks/Benefits
Skills/Tech-stack
AWS | AWS Glue | Alteryx | Apache Spark | Azure | Azure Data | Azure Data Factory | Azure DevOps | Azure Event | Azure Event Hubs | CI/CD | Data Factory | Data Lakes | Data Pipelines | Data Quality | Data Warehouses | Databricks | ELT | ETL | Event Hubs | Git | Jenkins | Kafka | Power BI | PySpark | Python | SQL | Tableau
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Related jobs
-
Azure Databricks | Azure DevOps | Data Quality | Data Warehousing | DatabricksCollaborative Agile environment | Fully remote | Hands on cloud data platform exposureMid-level Full TimeIndia R9h ago
-
Machine Learning Engineer - IV (Computer Vision) INR 1000K-1800KANN search | Airflow | Approximate Nearest Neighbor | CoreML | Data IngestionMid-level Full TimeIndia (remote) R23h ago
-
Senior Machine Learning Engineer INR 3584K-4580KAWS | Azure | CI/CD | Data Science | DatabricksLearning and development programs | Mentorship culture | Remote workSenior-level Full TimeBangalore, India R1d ago
-
Senior Machine Learning Engineer INR 3584K-4580KAmazon Web Services | Azure | CI/CD | Cloud platform | DatabricksCoaching and mentoring | Employee development programs | Learning and development programs | Remote work flexibilitySenior-level Full TimeBangalore, India R1d ago
-
Data Engineer -6 Years-Remote INR 1500K-2500KA/B | A/B Testing | B testing | Data Analysis | PythonRemote workMid-level Full TimeBengaluru, Karnataka, India R1d ago
-
Senior Software Engineer - Data Platform INR 3500K-4580KAmazon Redshift | Apache Airflow | Apache Flink | Apache Kafka | Apache SparkCompany holidays | Daily meals | Dental insurance | Family planning assistance | Fitness coachingSenior-level Full TimeBengaluru, Karnataka, India R1d ago
-
Mid-level Full TimeBangalore, Karnataka, India R1d ago
-
Alerting | Amazon Redshift | Anomaly Detection | Aurora PostgreSQL | CI/CDFully remoteSenior-level Full TimeIndia R1d ago
-
Senior Specialist - AI Strategy (Mobility) INR 3000K-5000KAgentic AI | Agile delivery | Anomaly Detection | Artificial Intelligence | Cloud ArchitectureSenior-level Full TimePune, Maharashtra, IND, 411013 R1d ago
-
AI-enabled | AI-enabled development | API Integration | Architecture | Data ModelingLaptop provided | Medical insurance | Mentorship | No weekend work | Remote workSenior-level Contract Full TimeDelhi R1d ago
-
AI Governance | Airflow | Alerting | Anomaly Detection | Artifact RegistryMid-level Full TimePune, Maharashtra, India R1d ago
-
AWS Glue | AWS Glue Data Catalog | Amazon Athena | Amazon QuickSight | Amazon RedshiftContract-based engagement | Cross-functional team collaboration | Fully remote work | Professional growthSenior-level Contract Full TimeIndia R1d ago
-
AWS | Authentication | Autovacuum | Backup and Restore | Client LibrariesAnnual offsites | Coworking allowance | Employee equity | Flexible schedule | Fully remoteSenior-level Full TimeIndia R1d ago
-
Mid-level Full TimeIndia - Remote R1d ago
-
Apache Spark | Azure | Cost Optimization | Data Governance | Data ModelingFully remote work setup | Professional growth opportunities | Supportive work cultureSenior-level Full TimeIndia R1d ago
-
AI Engineer INR 3200K-5000KAPI Integration | AWS | Airflow | Azure | CI/CDMentorship | Remote workSenior-level Full TimeBangalore or Remote, KA, IN R1d ago
-
Mid-level Full TimeNoida, India R1d ago
-
Computer Scientist 2 INR 3470K-4580KAWS | Asynchronous Event Driven | Asynchronous Event Driven Systems | Automated testing | AzureSenior-level Full TimeBangalore, India R1d ago
-
Senior AI/ ML Engineer INR 2000K-6000KArtificial Intelligence | CI/CD | Cloud Computing | Computer Vision | ContainersSenior-level Full TimeIndia - Remote R1d ago
-
AI Model Quality Engineer INR 3000K-5000KAPI Testing | Bias and fairness | Concept drift | Concept drift detection | Continuous MonitoringSenior-level Full TimeBangalore, Karnataka, India (Hybrid) R1d ago
-
Mid-level Full TimeIndia - Remote R2d ago
-
Apache Spark | Automation | Azure Data | Azure Data Services | Data GovernanceRemote workSenior-level Full TimeIndia - Remote R3d ago
-
CCaaS | CRM | CTI | Embeddings | EvaluationFully remote | Learning opportunities | Startup environmentSenior-level Full TimeHyderabad R3d ago
-
Senior DevOps Engineer - Storage Platforms | India INR 3000K-4000KAnsible | Bash | Block Storage | CI/CD | CentOSSenior-level Full TimeIndia, Bengaluru (Hybrid) R4d ago
-
AWS | Airflow | Cloud platform | Data Pipelines | Deep learningAccess to Collaboration Platforms | Access to development tools | Continuous learning environment | Equity opportunities | Medical/Dental/Vision insuranceMid-level Full TimeIndia R4d ago