Senior Data Engineer
Tasks
- Design and develop data ingestion and processing pipelines
- Develop scalable data processing engines
- Evaluate open-source data technologies
- Implement SDLC for cloud based big data solutions
- Interface with product and engineering teams
- Monitor and tune Spark based platforms
- Test and deploy cloud based big data solutions
- Validate and process large data volumes with distributed computing
- Write complex algorithms for optimal solutions
Perks/Benefits
Skills/Tech-stack
Airflow | Apache Hive | Azure | CI/CD | Data Lake | Data Mining | Data Warehousing | Databricks | Distributed Computing | Docker | Git | GitHub Actions | Python | Scala | Spark
Education
Roles
Related jobs
-
Staff Software Engineer, Machine Learning INR 2520K-3880KA/B | A/B Testing | Alerting | B testing | BackpressureEqual opportunity workplace | Health and wellness programs | Time offSenior-level Full TimeBengaluru, KA, India4h ago
-
Sr. Staff Software Engineer, Machine Learning INR 3200K-4725KC++ | Data Pipelines | Deep learning | Experimentation | Generative AIHealth and wellness programs | Time away from workSenior-level Full TimeBengaluru, KA, India4h ago
-
Principal Staff Software Engineer, Machine Learning INR 1800K-4000KA/B | A/B Testing | B testing | Backpressure Control | CachingHealth and wellness programs | Time awayExecutive-level Full TimeBengaluru, KA, India4h ago
-
Data Scientist I INR 2520K-4500KAWS | Amazon Bedrock | Amazon SageMaker | Autogen | BERTCommunity outreach programs | Employee Resource Group | Employee stock purchase program | Health and wellness incentivesSenior-level Full TimeBangalore, KA, IN, 5600665h ago
-
Access Control | Ansible | Backup Management | Capacity Planning | DockerSenior-level Full TimeBengaluru, KA, India6h ago
-
Senior-level Full TimePune, India6h ago
-
AI Solutions Architect INR 2500K-4500KAWS | Convolutional Neural Networks | Data Governance | Distributed Systems | DockerSenior-level Full TimeIndia - Remote R11h ago
-
Senior Azure Fabric Data Engineer INR 1500K-2000KAirflow | Azure | Azure Data | Azure Data Factory | Azure Data LakeRemote work | Work from homeSenior-level Full TimeIndia - Remote R11h ago
-
Data Engineer - Manager INR 2000K-2146KApache Kafka | Apache Spark | Azure | Azure Databricks | Data WarehousingEmployee networks | Flexible work/life support | Hybrid work schedule | Inclusive development opportunities | Paid volunteer daysSenior-level Full TimeBangalore, India11h ago
-
Data Engineer - Manager INR 2000K-2146KApache Kafka | Apache Spark | Azure | Azure Databricks | Data WarehousingEmployee networks | Flexible work/life support | Hybrid work schedule | Inclusive development opportunities | Paid volunteer daysSenior-level Full TimeBangalore, India11h ago
-
EY - GDS Consulting - AI And DATA -Azure Databricks - Senior INR 2040K-2400KAgile | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageCoaching and feedback | Flexible working arrangements | Professional development opportunitiesSenior-level Full TimeBengaluru, KA, IN, 56001611h ago
-
Senior-level Full TimeGurugram, India18h ago
-
Mid-level Full TimeGurugram, India18h ago
-
Software Engineer III - Data INR 2520K-3380KAWS | Apache Airflow | Apache Flink | Apache Spark | AzureERG events | Equipment provided | Health coverage | Learning and development | Paid HolidaysSenior-level Full TimeBengaluru, Karnataka, India18h ago
-
Senior Data & Analytics Systems Engineer INR 2520K-3380KApache Airflow | Apache Spark | Cloud Functions | Cloud Storage | Cloud platformSenior-level Full TimeGurugram, India19h ago
-
Mid-level Full TimeGurugram, India20h ago
-
FinOps Data Engineer INR 2520K-3380KAPI Gateway | AWS Glue | Agile | Amazon Athena | Amazon RedshiftSenior-level Full TimeGurugram, India20h ago
-
Senior Data Engineer INR 2520K-3380KAirflow | Apache Dataproc | CI/CD | Databricks | DataformDiversity & inclusion culture | Growth opportunitiesSenior-level Full TimeGurugram, India20h ago
-
Senior-level Full TimeGurugram, India20h ago
-
Senior Data Governance Engineer INR 2520K-3356KCloud platform | Collibra | Data Catalog | Data Governance | Data LineageSenior-level Full TimeGurugram, India20h ago
-
Data & Analytics Systems Engineer INR 2700K-3880KApache Airflow | Apache Spark | BigQuery | Cloud Functions | Cloud StorageMid-level Full TimeGurugram, India20h ago
-
Analytics Engineer INR 2520K-3380KBigQuery | Cloud platform | Data Modeling | Data Warehousing | Enterprise Performance ManagementEntry-level Full TimeGurugram, India20h ago
-
Analytics Engineer INR 2520K-3380KBigQuery | Cloud platform | Data Modeling | Data Warehousing | Enterprise Performance ManagementCareer development | Diversity and inclusion | Flexible work environment | Reward and recognitionMid-level Full TimeGurugram, India20h ago
-
Senior Data Scientist #3081 INR 2500K-3200KAWS SageMaker | Azure ML | Azure OpenAI | CI/CD | DatabricksFlexible working hours | Global collaboration opportunities | Professional development programs | Recognition programsSenior-level Full TimeChennai, India21h ago
-
Software Engineer (AI/DevOps) ID53179 INR 2829K-3500KAI/ML | CD pipelines | CI/CD | CI/CD pipelines | DockerCompetitive INR salary | Innovative projects | Legal presence in India | Local meet-ups | Remote workSenior-level Full TimePune City, India22h ago