Senior Data Engineer
Tasks
- Build Spark jobs
- Build data utilities
- Collaborate with agile teams
- Deploy CI/CD pipelines
- Deploy bug fixes
- Develop data pipelines
- Monitor and automate data workflows
- Optimize Spark workloads
- Provide rotational production support
Perks/Benefits
Skills/Tech-stack
Agile | Apache Airflow | Apache Spark | Azure | CI/CD | Databricks | DevOps | Docker | Git | Jenkins | Kubernetes | Pandas | PostgreSQL | PySpark | SQL | Scala
Education
Roles
Related jobs
-
Staff Software Engineer, Machine Learning INR 2520K-3880KA/B | A/B Testing | Alerting | B testing | BackpressureEqual opportunity workplace | Health and wellness programs | Time offSenior-level Full TimeBengaluru, KA, India6h ago
-
Principal Staff Software Engineer, Systems Infrastructure INR 2100K-4500KAPI Design | Apache Hadoop | Apache Kafka | Apache Spark | Big DataHealth and wellness programs | Time away from workExecutive-level Full TimeBengaluru, KA, India6h ago
-
Principal Staff Software Engineer, AI Infrastructure INR 1800K-5800KApache Kafka | C++ | Compliance | Data Modeling | Distributed SystemsHealth and wellness programs | Hybrid work option | Time away from workExecutive-level Full TimeBengaluru, KA, India6h ago
-
Principal Staff Software Engineer, Machine Learning INR 1800K-4000KA/B | A/B Testing | B testing | Backpressure Control | CachingHealth and wellness programs | Time awayExecutive-level Full TimeBengaluru, KA, India6h ago
-
Data Scientist I INR 2520K-4500KAWS | Amazon Bedrock | Amazon SageMaker | Autogen | BERTCommunity outreach programs | Employee Resource Group | Employee stock purchase program | Health and wellness incentivesSenior-level Full TimeBangalore, KA, IN, 5600667h ago
-
Technical Anchor INR 2500K-3000KASR | AWS | Adobe Experience | Adobe Experience Manager | Amazon LexAgile team collaboration | Off-hours support | On-call rotational support | Weekend support rotational basisSenior-level Full TimeChennai, Tamil Nadu, India7h ago
-
Access Control | Ansible | Backup Management | Capacity Planning | DockerSenior-level Full TimeBengaluru, KA, India8h ago
-
Senior-level Full TimePune, India9h ago
-
Senior-level Full TimeBangalore, INDIA R13h ago
-
AI Solutions Architect INR 2500K-4500KAWS | Convolutional Neural Networks | Data Governance | Distributed Systems | DockerSenior-level Full TimeIndia - Remote R13h ago
-
Senior Azure Fabric Data Engineer INR 1500K-2000KAirflow | Azure | Azure Data | Azure Data Factory | Azure Data LakeRemote work | Work from homeSenior-level Full TimeIndia - Remote R13h ago
-
Data Engineer - Manager INR 2000K-2146KApache Kafka | Apache Spark | Azure | Azure Databricks | Data WarehousingEmployee networks | Flexible work/life support | Hybrid work schedule | Inclusive development opportunities | Paid volunteer daysSenior-level Full TimeBangalore, India13h ago
-
Data Engineer - Manager INR 2000K-2146KApache Kafka | Apache Spark | Azure | Azure Databricks | Data WarehousingEmployee networks | Flexible work/life support | Hybrid work schedule | Inclusive development opportunities | Paid volunteer daysSenior-level Full TimeBangalore, India13h ago
-
EY - GDS Consulting - AI And DATA -Azure Databricks - Senior INR 2040K-2400KAgile | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageCoaching and feedback | Flexible working arrangements | Professional development opportunitiesSenior-level Full TimeBengaluru, KA, IN, 56001613h ago
-
Fraud Data Engineer, Assistant Vice President INR 600K-2000KAgile | Big Data | Confluence | Data Governance | Data QualityConfidential counseling | Employee Learning and Development | Paid parental leave | Paid time off | Telehealth accessExecutive-level Full TimeG-BLOCK, BANDRA-KURLA COMPLEX BANDRA EAST MUMBAI, …13h ago
-
Backend Engineer INR 2200K-3500KAKS | API documentation | Alerting | Asynchronous programming | AzureSenior-level Full TimeIND Bengaluru - Technology Campus, India13h ago
-
Senior-level Full TimeGurugram, India20h ago
-
Mid-level Full TimeGurugram, India20h ago
-
Software Engineer III - Data INR 2520K-3380KAWS | Apache Airflow | Apache Flink | Apache Spark | AzureERG events | Equipment provided | Health coverage | Learning and development | Paid HolidaysSenior-level Full TimeBengaluru, Karnataka, India21h ago
-
Senior Data & Analytics Systems Engineer INR 2520K-3380KApache Airflow | Apache Spark | Cloud Functions | Cloud Storage | Cloud platformSenior-level Full TimeGurugram, India21h ago
-
Mid-level Full TimeGurugram, India22h ago
-
FinOps Data Engineer INR 2520K-3380KAPI Gateway | AWS Glue | Agile | Amazon Athena | Amazon RedshiftSenior-level Full TimeGurugram, India22h ago
-
Senior Data Engineer INR 2520K-3380KAirflow | Apache Dataproc | CI/CD | Databricks | DataformDiversity & inclusion culture | Growth opportunitiesSenior-level Full TimeGurugram, India22h ago
-
Senior-level Full TimeGurugram, India22h ago
-
Senior Data Governance Engineer INR 2520K-3356KCloud platform | Collibra | Data Catalog | Data Governance | Data LineageSenior-level Full TimeGurugram, India22h ago