Data Engineer- Manager
Tasks
- Automate operational tasks with shell scripts
- Build Databricks workflows and ingestion solutions
- Collaborate with cross-functional teams on requirements
- Create unit tests and support code reviews
- Design and maintain CI/CD pipelines
- Design and maintain data pipelines
- Develop and deploy containerized applications
- Implement and optimize relational database designs
- Lead projects and deliver scalable engineering solutions
- Prepare and maintain technical documentation
- Recommend process improvements
- Troubleshoot production issues and analyze logs
Perks/Benefits
- Employee networks
- Flexible work/life support
- Inclusive development opportunities
- Paid volunteer days
Skills/Tech-stack
AWS | Apache Iceberg | Apache Spark | Artifactory | Bitbucket | CI/CD | Data Modeling | Data Processing | Databricks | Distributed data | Distributed data processing | Docker | ECS | EKS | EMR | ETL | GitHub | Glue | IAM | Jenkins | Lambda | PySpark | Python | Relational databases | S3 | SQL | Shell Scripting | Snowflake | Spark
Education
Roles
Data Engineer | Engineer | Engineering | Engineering Manager | Manager
Related jobs
-
Senior-level Full TimeIN-AP-Hyderabad2h ago
-
AWS DE- Gen AI INR 2000K-3300KAWS Glue | AWS Identity | AWS Identity and Access Management | AWS Identity and Access Management IAM | AWS LambdaSenior-level Full TimeIN-TN-Chennai2h ago
-
Data Engineer INR 1600K-2500KAmazon Web Services | Apache Spark | Cloud platform | Docker | Google CloudSenior-level Full TimeIN-AP-Hyderabad2h ago
-
Senior AI/ML Engineer – Generative AI INR 3700K-5000KA/B | A/B Testing | AI orchestration | API Integration | Agent systemsSenior-level Full TimeIndia5h ago
-
Software Engineer II INR 1000K-2000KApache Spark | Azure Cosmos | Azure Cosmos DB | Azure Data | Azure Data FactoryMid-level Full TimeIndia, Telangana, Hyderabad6h ago
-
AI Assisted Development | APIs | AWS | AWS Lambda | AgileSenior-level Full TimeBengaluru, Karnataka, India6h ago
-
Senior AI Engineer I INR 3264K-5876KAPIs | Apache Airflow | BigQuery | Cloud platform | Data PipelinesSenior-level Full TimeBengaluru, KA, India7h ago
-
Sr. Specialist, Data Engineering INR 2771K-4000KAgile | Airflow | BigQuery | CI/CD | Cloud FunctionsRelocation assistance within countrySenior-level Full TimeMumbai, MH, IN7h ago
-
API Integration | Azure Blob | Azure Blob Storage | Azure Data | Azure Data FactoryMid-level Full TimePune, Maharashtra, India9h ago
-
Azure Blob | Azure Blob Storage | Azure Data | Azure Data Factory | Azure SQLMid-level Full TimePune, Maharashtra, India9h ago
-
Azure Blob | Azure Blob Storage | Azure Data | Azure Data Factory | Azure Data LakeMid-level Full TimePune, Maharashtra, India9h ago
-
IT engineer data lakehouse INR 1500K-2500K3NF | APIs | Audit trails | Azure | Azure DatabricksMobile and flexible working models | Sabbaticals | Training opportunitiesSenior-level Full TimeBengaluru, KA, India9h ago
-
Mid-level Full TimeBangalore, Karnataka, India10h ago
-
Lead Software Engineer INR 2500K-5000KAWS | Asynchronous programming | Authentication | Authorization | AutogenSenior-level Full TimeRemote, India R11h ago
-
Senior Software Engineer - Ingestion INR 2040K-2800KBackup and Recovery | C++ | Data Capture | Database replication | Distributed SystemsSenior-level Full TimeBengaluru, India12h ago
-
Manager, Data Engineering, Smai INR 1500K-2028KAgentic AI | Apache NiFi | Apache Spark | Cloud Data | Cloud Data WarehouseMid-level Full TimeHyderabad - Phoenix Aquila, India15h ago
-
Alteryx | Big Data | Data Mining | Data Modeling | Data VisualizationFlexibility programmes | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeBengaluru Millenia, India15h ago
-
.NET | Agile | Azure | Azure Databricks | C#Senior-level Full TimeKolkata DN 57, India15h ago
-
Mid-level Full TimeBangalore, Karnataka, IN India, 56008715h ago
-
Forward Deployment Engineer (AI Solutions)-BK INR 2500K-4500KAI Agents | AWS Bedrock | Amazon Web Services | Angular | Azure OpenAIMid-level Full TimeBengaluru, Karnataka, India15h ago
-
Forward Deployment Engineer (AI Solutions) INR 2500K-5000KAI Agents | AWS Bedrock | Amazon Web Services | Angular | Azure OpenAIMid-level Full TimeBengaluru, Karnataka, India15h ago
-
DE-RCE-Fraud Analytics-Manager-GDSN02 INR 800K-1200KAWS SageMaker | Apache Hive | Apache Spark | Data analytics | Data extractionMid-level Full TimeBengaluru, KA, IN, 56001615h ago
-
DE-RCE-Fraud Analytics-Senior-GDSN02 INR 3264K-5000KAWS Glue | AWS Lambda | Amazon EventBridge | Amazon S3 | CI/CDSenior-level Full TimeBengaluru, KA, IN, 56001615h ago
-
Manager Data Analytics & Artificial Intelligence INR 1000K-2000KAmazon Web Services | Azure | BigQuery | Cloud platform | Google CloudMid-level Full TimeBangalore, KA, IN, 56010315h ago
-
Senior-level Full TimePune, MH, IN, 41100515h ago