Data Engineer
Tasks
- Build optimize Snowflake data warehousing solutions
- Collaborate to translate business requirements into AWS and Snowflake solutions
- Design data pipelines for batch micro batch and real time
- Design develop test implement AWS data solutions
- Ensure data quality with rules and test cases
- Implement Snowflake Snowpipe
- Implement Snowflake Time Travel
- Implement Snowflake Zero Copy Cloning
- Implement data models and schemas optimized for Snowflake
- Ingest data using Kinesis or MSK
- Integrate data pipelines with Snowflake
- Lead data engineering projects on AWS
- Migrate and manage data structures in AWS
- Support ongoing maintenance with stakeholders
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | AWS Glue | Amazon EMR | Amazon S3 | Ansible | Data Modeling | Data Quality | ELT | ETL | Git | Kinesis | MSK | Python | Snowflake | Snowpipe | Terraform | Time Travel | Zero copy | Zero-Copy Cloning
Education
N/A
Roles
Regions
Countries
States
Related jobs
-
AI/ML Engineer INR 2500K-3500KAPI Development | BigQuery | CI/CD | Classification | Cloud FunctionsInnovation culture | Personal growth | Professional growthSenior-level Full TimeBengaluru , Pune3h ago
-
Senior Data Engineer - Azure Databricks INR 1500K-2500KAgile | Apache Kafka | Azure Data | Azure Data Factory | Azure Data LakeSenior-level Full TimeHyderabad, TS, India4h ago
-
Applied Computer Vision Engineer - Data Driven Development INR 1500K-2000KAzure | Azure Blob | Azure Blob Storage | Azure Machine Learning | Blob StorageMid-level Full Timebangalore, India5h ago
-
Senior-level Full TimeBangalore5h ago
-
Embedded Python Developer INR 3000K-4460KAsynchronous programming | Bash | CAN | CI/CD | DockerFlexible working hours | Pre-IPO stock options | Technology Career GrowthSenior-level Full TimePune7h ago
-
Software Engineer - .NET - Career INR 1200K-2156K.NET | Agile | Angular | Azure DevOps | C#Guided career tracks | Healthcare benefits | Hybrid work setting | Online learning platform | Organizational growthMid-level Full TimeIND-Trivandrum-Equifax Analytics-PEC, India10h ago
-
Tech Lead Gen AI INR 2500K-4000KAI vector search | Arize AI | Cloud Monitoring | Cloud Run | Cloud platformAccess to training and industry experts | Hybrid work options | International mobility | Learning and development | Professional development programsSenior-level Full TimeBengaluru16h ago
-
Senior Data Engineer INR 1960K-2800KAWS | Agile | DBT | Data Governance | Data ModelingFlexible work options | Life leave days | Professional development days | Vacation time | Volunteer daysSenior-level Full TimePune, MH, India17h ago
-
Mid-level Full TimePune, India18h ago
-
AWS | Amazon Bedrock | Amazon SageMaker | Artificial Intelligence | AuditingCollaborative & Inclusive Culture | Comprehensive employee benefits | Continuous learning | Flexibility for hybrid work | Fully remote workMid-level Full TimeIndia R19h ago
-
Mid-level Full TimeKarnataka, Bengaluru, India20h ago
-
Expert Data Engineer (Databricks) INR 1500K-2400KAPI Design | API Key | AWS Glue | AWS IAM | AWS LambdaSenior-level Full TimeMaharashtra, Pune, India20h ago
-
Senior Data Engineer (Databricks) INR 2000K-2800KAPI Keys | AWS Glue | AWS IAM | AWS Lambda | AWS S3Senior-level Full TimeMaharashtra, Pune, India20h ago
-
Data Engineer (GCP) ID56375 INR 1500K-2500KApache Airflow | Apache Spark | BigQuery | CI/CD | Change Data CaptureEducation budget | Local connection | Personal growth budget | Remote work | Wellness budgetSenior-level Full TimeMumbai, India21h ago
-
Data Engineer (GCP) ID56375 INR 1500K-2500KApache Airflow | Apache Spark | BigQuery | CI/CD | Change Data CaptureGrowth education budget | Local compliance in India | Remote work | Team meet-ups | Wellness budgetSenior-level Full TimeBangalore North, India21h ago
-
Data Engineer (GCP) ID56375 INR 1500K-2500KApache Airflow | Apache Hadoop | Apache Spark | CI/CD | Change Data CaptureBudgets for personal growth education and wellness | Legal presence in India | Local connection | Periodic meet ups | Remote workSenior-level Full TimePune City, India21h ago
-
Senior Data Engineer- F2F interview Diversity Hiring on 13th June (Must have- Python, Oracle db/ SQL) INR 2829K-3500KApache Hive | Azure | CI/CD | Databricks | OracleEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offSenior-level Full TimeChennai, TN, India21h ago
-
AWS | AWS Glue | AWS Lambda | AWS Step Functions | AgileHybrid work modelSenior-level ContractShaikpet, India21h ago
-
MLOps Engineer INR 1200K-1680KAWS | AWS Lambda | Amazon Bedrock | Amazon S3 | Amazon SQSEmployee Share Savings Plan | Hybrid work | Learning programs | Mentoring | Paid volunteer dayMid-level Full TimeBengaluru22h ago
-
Data Engineer INR 1500K-2500KAWS Glue | AWS Step Functions | Amazon Athena | Amazon Kinesis | Amazon Web ServicesSenior-level Full TimeIN-MH-Pune22h ago
-
Software Engineer - ML Ops DevOps INR 2500K-3465KAWS | Argo CD | Azure | CI/CD | Data PipelinesCollaborative work environment | Professional development | Training opportunitiesSenior-level Full TimeBangalore - Karnataka, India - Kalyani …22h ago
-
Associate Engineer - Embedded AI & Data Analytics INR 1000K-1141KC plus plus | Classification | Data Modeling | Data Observability | Data PipelinesCollaborative work environment | On-site work schedule | Professional development opportunities | Training opportunitiesMid-level Full TimeBangalore - Karnataka, India - Kalyani …22h ago
-
Advanced Engineer - Embedded C++ Linux INR 1236K-1854KASPICE | CI/CD | Cloud Computing | Communications | Configuration ManagementEmployee discounts | Employee recognition rewards | Training opportunities | Tuition reimbursement | Wellness benefitsSenior-level Full TimeBangalore - Karnataka, India - Kalyani …22h ago
-
Data Engineer II (SAS) INR 1500K-2500KADaM | AWS | Apache Spark | Azure | Business IntelligenceTraining and supportMid-level Full TimeBangalore22h ago
-
Data Engineer II INR 1200K-1800K.NET | AWS | Azure | C# | CDISCClient onboarding support | Technical trainingMid-level Full TimeBangalore22h ago