IN_Senior Associate_ AWS Data Engineer_Data and Analytics_Advisory_Bangalore
Bengaluru Millenia, India
INR 1500K-2600K (estimate) Senior-level Full Time
Tasks
- Apply data security governance and access control
- Build batch and near real time ingestion pipelines
- Build data processing transformations with PySpark
- Build data processing transformations with Python
- Create technical documentation for data pipelines and workflows
- Design data pipelines
- Develop ETL/ELT workflows
- Develop stored procedures views and CTEs
- Implement Snowflake SnowPipe Streams Tasks
- Implement Snowflake data warehouse solutions
- Implement data quality checks monitoring and reconciliation
- Ingest data into AWS and Snowflake
- Optimize Snowflake performance and cost
- Orchestrate pipelines with Apache Airflow DAGs
- Troubleshoot pipeline failures and data issues
- Use Git for source control and CI CD deployments
- Write SQL queries and transformations
Perks/Benefits
Skills/Tech-stack
AWS | AWS Glue | AWS Lambda | Apache Airflow | Athena | CI/CD | DBT | Data Modeling | Data Pipelines | Data Warehousing | Dimensional Modeling | Docker | ELT | EMR | ETL | Git | Great Expectations | IAM | Kafka | Kubernetes | Lakehouse | PySpark | Python | Redshift | S3 | SQL | Snowflake | Terraform
Education
Bachelor of Engineering | Bachelor of Science | Bachelor of Technology | Master of Engineering | Master of Science
Roles
Related jobs
-
Senior-level ContractShaikpet, India3h ago
-
Senior-level Full TimeHyderabad, India4h ago
-
Data Engineer II INR 2000K-3000KAWS | Amazon Kinesis | Amazon Redshift | Apache Airflow | Apache BeamCareer growth opportunities | Complimentary games | Family Leaves | Healthcare coverage | Mental well-being supportSenior-level Full TimeLocations: Hyderabad, Telangana, India4h ago
-
Advanced Engineer-AI/ML INR 2500K-4680KAI orchestration | API Integration | ASR | AWS | Action modelsEmployee discounts | Training opportunities | Tuition reimbursement | Wellness benefitsSenior-level Full TimeBangalore - Karnataka, India - Kalyani …5h ago
-
Senior Software Engineer, AI/ML, Google Cloud INR 2500K-5000KC plus plus | Data Processing | Data Structures | Data structures algorithms | DebuggingSenior-level Full TimeHyderabad, Telangana, India7h ago
-
Principal Silicon Engineer - Storage INR 1163K-3500KAmazon S3 | Azure Blob | Azure Blob Storage | Azure Files | Backup and RecoverySenior-level Full TimeIndia7h ago
-
Lead Software Engineer Java INR 3000K-4500KAI code assistants | AWS | Agile | Apache Spark | Application ResiliencySenior-level Full TimeMumbai, Maharashtra, India8h ago
-
Informatica / Data warehousing Engineer INR 2700K-4000KAgile | BigQuery | Dashboard Design | Dashboard Development | Data GovernanceSenior-level Full TimeIndia8h ago
-
Informatica / Data warehousing Engineer INR 2771K-4000KAccess Controls | Agile | BigQuery | Cloud Storage | Cloud platformSenior-level Full TimeIndia8h ago
-
AI/ML Engineer INR 2000K-3500KAzure | Data Pretraining | Data Structures | DeepSpeed | Distributed SystemsCar lease benefits | Career advancement programs | Certification programs | Continuous learning opportunities | Corporate NPSMid-level Full TimeBangalore, Karnataka, India R8h ago
-
Senior / Lead Data Engineer - Azure Databricks INR 1500K-3000KAzure | Azure Databricks | Azure DevOps | CI/CD | Conformed DimensionsSenior-level Full TimeHyderabad, TS, India8h ago
-
Senior-level Full TimeHyderabad, Telangana, India9h ago
-
Advanced Robotics Simulation Engineer INR 2000K-4680KDocker | GPU Computing | Isaac Lab | Isaac Sim | Isaac-GymSenior-level Full TimeChennai, Tamil Nadu, India9h ago
-
Java Full Stack AI Engineer- LINA GI INR 2200K-3200KAPI Security | Angular | App Service | Azure | Azure AppCertification programs | Corporate NPS | Dental insurance | Education reimbursement | Employee assistance programSenior-level Full TimeTelangana, India R9h ago
-
Senior-level Full TimeHyderabad, TS, India9h ago
-
Junior AI Specialist INR 336K-480KAWS | Airflow | Azure | DBT | Data AnalysisCertification programs | Health insurance | Internship opportunities | Language courses | MentorshipEntry-level Full TimeAll Cities , India R9h ago
-
Data Protection Lead Engineer INR 1500K-3000KArtificial Intelligence | Azure | Cloud platform | DLP | Data ClassificationSenior-level Full TimeIndia10h ago
-
Senior-level Full TimeChennai, Tamil Nadu, India10h ago
-
SO_Cloud_Devops_Engineer_SME_2026 INR 400K-500KAzure Data | Azure Data Factory | CI/CD | Command Line | Command-line scriptingEntry-level Full Timepune, India11h ago
-
Analyst, Business Intelligence INR 3000K-5000KAWS | Azure | Azure OpenAI | CI/CD | Distributed SystemsEmployee assistance program | Flexible working environment | LinkedIn Learning | Volunteer time offSenior-level Full TimeChennai, TN, India11h ago
-
Data Transformation and Management Specialist INR 1500K-3000KAgile | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageSenior-level Full TimePune, Maharashtra, India12h ago
-
Bash | Data Processing | Docker | GCP | Infrastructure as CodeEntrepreneurial team | Fast-growing environment | Flexible asynchronous culture | Remote/distributed workMid-level Full TimeBangalore, India12h ago
-
Bash | Data Ingestion | Data Processing | Docker | GCPAsynchronous culture | Flexible remote setting | Friendly laid-back atmosphere | Opportunity for high impactMid-level Full TimeDelhi, India12h ago
-
Sr Data Engineer INR 3000K-4000KAPIs | Airflow | Apache Iceberg | CI/CD | Control-MAnnual leave | Development courses | Employee assistance program | Flexible working options | Life insuranceSenior-level Full TimeBangalore, IN13h ago
-
Senior-level Full TimeBengaluru, Karnataka, India13h ago