Senior Data Engineer
Tasks
- Build and maintain ETL and ELT processes
- Build data pipeline monitoring and alerting
- Collaborate with data scientists and analysts
- Create automated data ingestion pipelines
- Design data architectures and pipelines
- Develop analytics optimized data models and schemas
- Ensure data quality and reliability
- Implement CI/CD for data pipelines
- Implement data transformation logic
- Optimize pipeline performance and cost-efficiency
- Participate in architecture reviews
- Partner with clients on data requirements
Perks/Benefits
- Career advancement
- Hybrid work options
- Professional development programs
- Remote work options
- Training programs
Skills/Tech-stack
AWS | Access Management | Amazon Neptune | Apache Airflow | Apache Kafka | Apache Spark | Azure | Azure Resource | Azure Resource Manager | CCPA | Cloud platform | CloudFormation | DBT | Data Governance | Data Lakes | Data Modeling | Data Quality | Data Security | Data Warehouse | Data Warehouse Design | Data Warehouses | Data mesh | Databricks | Dimensional Modeling | Docker | Event Driven | Event-driven architecture | Fivetran | GDPR | Google Cloud | Google Cloud Platform | Graph Databases | Hadoop | Identity and Access Management | Identity and access | Infrastructure as Code | Java | Kubernetes | MLOps | Machine Learning | Microservices | MongoDB | MySQL | Neo4j | PostgreSQL | Python | Resource manager | SQL | Scala | Serverless | Snowflake | Terraform | Warehouse design | “as-code”
Education
N/A
Roles
Related jobs
-
Senior-level Full TimeIndia - Bengaluru; India - Hyderabad4h ago
-
GCP Data Engineer INR 2000K-3000KApache Airflow | Apache Spark | BigQuery | Cloud Composer | Cloud DataflowSenior-level Full TimeIndia - Bengaluru; India - Hyderabad4h ago
-
AWS | Agentic AI | Apache Spark | Databricks | Generative AICollaborative global engineering culture | Continuous learning | Flexible work environment | Opportunity to work on cutting edge GenAI | Remote-friendly work environmentSenior-level Full TimeIndia4h ago
-
API | Agile | Apache Airflow | Bitbucket | CI/CDEmployee assistance program | Flexible working environment | LinkedIn Learning | Volunteer time offMid-level Full TimeChennai, India5h ago
-
Staff Software Engineer - Data INR 3200K-4600KAWS Lambda | Airflow | Ansible | Apache Flink | Apache SparkSenior-level Full TimeBengaluru, INDIA, India7h ago
-
.NET | APIs | AWS | Alerting | AzureAdoption leave | Employee assistance program | Health care benefits | Maternity leave | Mental wellness programsSenior-level Full TimeIndia7h ago
-
AI Data Engineer INR 2000K-3300KAWS | Agent memory | Audio Processing | Batch Processing | Cloud ComputingEquityMid-level Full TimeNew Delhi9h ago
-
Data Engineer, Analytics Engineering, VP INR 1500K-6000KAWS Data | AWS Data Catalog | AWS Glue | AWS Glue Catalog | AWS Glue Data GovernanceExecutive-level Full TimeBengaluru, India10h ago
-
AI Engineer - Full Stack INR 1200K-2500KAI output validation | AI tools | Agile | C++ | Code reviewEthical AI Guidelines | Learning opportunities | Onsite interview optionMid-level Full TimeIND-Pune-Smartworks, India10h ago
-
AI Engineer - Full Stack INR 1200K-2500KAgile | Code Management | Relational databases | SQL | Source CodeMid-level Full TimeIND-Pune-Smartworks, India10h ago
-
Data Engineer With Data Observability INR 1500K-2000KAWS | Agile | Airflow | CI/CD | Cloud OperationsMid-level Full TimeBangalore, IN10h ago
-
Principal Data Engineer INR 3000K-4000KAWS | Agile | Amazon EC2 | Amazon S3 | Automated testingBereavement leave | Diversity, equity, & inclusion programs | Employee assistance program | Employee referral program | Healthcare insuranceSenior-level Full TimeIND - Bengaluru, India10h ago
-
AI Research Engineer - Applied AI INR 2000K-3000KAPI Design | AWS SageMaker | Anomaly Detection | Azure Machine Learning | Bias auditingAsynchronous culture | Distributed team | Remote workMid-level Full TimeRemote - REMOTE, India, India R10h ago
-
Senior Data Engineer INR 2000K-2250KApache Airflow | CI/CD | Cloud Composer | Cloud Dataflow | Cloud StorageSenior-level Full Time111443-IND-HYDERABAD-INTL HYD WF CENTRE BLK B8 …10h ago
-
Principal Engineer - Java with Gen AI INR 2000K-3465KAgent Frameworks | Azure | Cloud Native | Concurrency | EmbeddingsSenior-level Full Time110380-IND-BENGALURU-INTL BLR Twr-1&2 CARNATION, India10h ago
-
Senior Machine Learning Engineer, Model Training & Evaluation INR 2500K-4500KBenchmarking | Checkpointing | DeepSpeed | Distributed Training | Experiment trackingAccidental insurance | Flexible hours | Hybrid work | Life insurance | Medical insuranceSenior-level Full TimeBangalore, India (Hybrid) R12h ago
-
Sr. Delivery Solutions Architect INR 3000K-3900KData Architecture | Data and AI | Distributed Systems | Executive Communication | Program ManagementHybrid work | Travel 30 percentSenior-level Full TimeBengaluru, India12h ago
-
Software Engineer INR 1300K-2000KAgile | Cloud Computing | Code review | Data Modeling | Data StorageMid-level Full TimePune, India17h ago
-
Senior Software Engineer, Machine Learning INR 2500K-4500KDeep learning | Distributed Training | Generative AI | Language Models | Language ProcessingHealth and wellness programs | Time offSenior-level Full TimeBengaluru, KA, India18h ago
-
AWS Glue | AWS Lambda | Amazon QuickSight | Amazon S3 | DBTSenior-level Full TimeIndia20h ago
-
API Testing | Agile | Airflow | Azure | BitbucketEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offSenior-level Full TimeChennai/Pune, India21h ago
-
Staff Fullstack Engineer INR 2000K-3465KAnsible | Anthropic Claude | Async Programming | Azure Document Intelligence | CI/CDSenior-level Full TimeBengaluru, Karnataka21h ago
-
Gen AI Engineer INR 2000K-4800KAI Governance | API Integration | AWS Bedrock | Azure OpenAI | Azure OpenAI ServiceSenior-level Full TimeIN-TN-Chennai22h ago
-
Senior-level Full TimeIN-TN-Chennai22h ago
-
Dot Net FSD AWS INR 1400K-1800K.Net Core | API Gateway | AWS CDK | AWS CodePipeline | AWS Well ArchitectedMid-level Full TimeIN-KA-Bangalore22h ago