Senior Data Engineer
Bengaluru, Karnataka, India
INR 3000K-3880K (estimate) Senior-level Full Time
Tasks
- Automate CI/CD
- Build batch data pipelines
- Build data observability systems
- Build data products with stakeholders
- Create BI-ready datasets
- Design analytics ready datasets
- Design real-time data pipelines
- Implement data quality validation
- Implement unit testing and integration testing
- Monitor data integrity drift and health
- Own pipeline engineering
- Perform code reviews
- Translate data into insights
- Troubleshoot pipeline issues
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | Airflow | Apache Spark | Azure | CI/CD | Cassandra | Cloud Computing | Code review | Data Observability | Data Quality | Databricks | Delta Lake | Docker | GCP | Integration Testing | Kafka | Kubernetes | Machine Learning | Python | Snowflake | Streaming | Terraform | Unit Testing | Unity Catalog
Education
N/A
Roles
Related jobs
-
Staff Software Engineer, Agentic AI INR 2000K-3500KArtificial Intelligence | C# | C++ | Database technologies | Distributed SystemsSenior-level Full TimeHyderabad, Telangana, India20h ago
-
[T] Senior Software Engineer, AI/ML, Google Cloud INR 2500K-4800KC++ | Data Processing | Debugging | Distributed Computing | Information RetrievalSenior-level Full TimeBangalore, Karnataka, India20h ago
-
SW Engineer, Machine Learning INR 2500K-3465KAmazon EMR | Amazon S3 | Apache Airflow | Apache Spark | BERTDental insurance | Disability insurance | Financial wellness support | Health insurance | Hybrid work scheduleSenior-level Full TimeBengaluru, India1d ago
-
Senior-level Full TimeBengaluru, KA, IN, 5600161d ago
-
Senior-level Full TimeBengaluru, KA, IN, 5600161d ago
-
Staff Software Engineer- Enterprise AI INR 2475K-4800KAmazon Web Services | C# | C++ | Cloud Computing | Cloud platformCareer development | Employee resource groups | Flexible WFH | Generous PTO | Volunteer timeSenior-level Full TimeIndia-Bangalore1d ago
-
Mid-level Full TimeHyderabad, Telangana, India1d ago
-
Vice President ML Ops Engineer INR 2000K-6000KAWS | AWS SageMaker | AWS SageMaker Pipelines | Amazon Bedrock | Amazon SageMakerExecutive-level Full TimeNoida, Candor TechSpace, India1d ago
-
Senior Data Engineer INR 3000K-4000KAWS | AWS Elastic Map-Reduce | AWS Step Functions | Agile | Apache AirflowFree transportation | Medical insurance | Paid leave | Sponsored training and workshops | Wellness programSenior-level Full TimeBengaluru, Karnataka, India1d ago
-
Agentic AI | Amazon Web Services | Azure | Cloud Computing | Cloud platformAccess to modern cloud and AI tooling ecosystems | Exposure to cutting-edge AI technologies | Long-term contract | Opportunity to shape technical strategy | Remote work flexibilitySenior-level Full TimeIndia1d ago
-
Airflow | Apache Spark | CI/CD | Contextual Bandits | DatabricksCollaborative environment | Continuous learning | Inclusive culture | Professional growth | Remote-friendlySenior-level Full TimeIndia1d ago
-
.NET | API Management | Agile | Angular | AuthenticationCollaborative cross-functional team | Fully remote within India | Hands on GenAI projects | Innovation-focused environmentSenior-level Full TimeIndia R1d ago
-
Agile | Airflow | Azure | Azure Data | Azure Data FactoryCareer development | Fully remote | Inclusive collaborative environment | Long-term contract | MentorshipSenior-level Full TimeIndia R1d ago
-
Data Engineer ID56374 INR 2000K-2500KAgentic AI | Airflow | Apache Spark | BigQuery | Bitemporal DataEducation budget | Growth budget | Innovative projects | Legal presence in India | Local team connectionSenior-level Full TimeTrivandrum, India1d ago
-
Data Engineer ID56374 INR 2000K-2500KApache Airflow | Apache Spark | BigQuery | CI/CD | Cloud ComposerEducation budget | Innovative projects | Local connection | Remote work | Wellness budgetSenior-level Full TimeIndore, India1d ago
-
Data Engineer ID56374 INR 2000K-2500KApache Airflow | Apache Spark | Bitemporal Data | Bitemporal data modeling | CI/CDDedicated budgets for growth | Education budget | Innovative projects | Local connection | Periodic meet upsSenior-level Full TimeKolkata, India1d ago
-
Data Engineer ID56374 INR 2000K-2500KAirflow | Apache Spark | BigQuery | Bitemporal Data | Bitemporal data modelingEducation budget | Growth budget | Innovative projects | Legal presence in India | Local connectionSenior-level Full TimeJalalabad, India1d ago
-
Data Engineer ID56374 INR 2000K-2500KApache Airflow | Apache Spark | BigQuery | Bitemporal Data | Bitemporal data modelingBudgets for education | Budgets for growth | Innovative projects | Legal presence in India | Local connectionSenior-level Full TimeKochi, India1d ago
-
Data Engineer ID56374 INR 2000K-2500KApache Airflow | Apache Delta | Apache Delta Lake | Apache Spark | BigQuery cost managementEducation budget | Growth budget | Innovative projects | Legal presence in India | Local connection meetupsSenior-level Full TimePune City, India1d ago
-
Data Engineer ID56374 INR 2000K-2500KAgentic AI | Apache Airflow | Apache Spark | BigQuery | CI/CDDedicated budget for education | Dedicated budget for growth | Dedicated budget for wellness | Local connection | Periodic meetupsSenior-level Full TimeBangalore North, India1d ago
-
Data Engineer ID56374 INR 2000K-2500KApache Airflow | Apache Spark | BigQuery | CI/CD | Change Data CaptureEducation budget | Growth budget | Innovative projects | Legal compliance in India | Local connectionSenior-level Full TimeMumbai, India1d ago
-
Data Engineer ID56374 INR 2000K-2500KAgentic AI | Apache Airflow | Apache Spark | BigQuery | Bitemporal DataBudgets for growth and education | Innovative projects | Legal presence in India | Local connection meetups | Remote workSenior-level Full TimeAhmedabad, India1d ago
-
Data Engineer ID56374 INR 2000K-2500KApache Airflow | Apache Spark | BigQuery | CI/CD | Change Data CaptureEducation budget | Growth budget | Innovative projects | Local connection | Periodic meet upsSenior-level Full TimeChennai, India1d ago
-
Data Engineer ID56374 INR 2000K-2500KApache Airflow | Apache Spark | BigQuery | CI/CD | Change Data CaptureDedicated budgets for growth | Education budget | Innovative projects | Local connection | Periodic meet upsSenior-level Full TimeGurgaon Kty., India1d ago
-
Data Engineer ID56374 INR 2000K-2500KApache Airflow | Apache Spark | Cloud Composer | Cloud Monitoring | Cloud PubSubEducation budget | Growth budget | Innovative projects | Local connection | Periodic meetupsSenior-level Full TimeNew Delhi, India1d ago